-- Logs begin at Wed 2022-07-20 02:58:53 UTC, end at Wed 2022-07-20 05:47:46 UTC. -- Jul 20 03:56:34.630671 n-d-760456-11 systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 03:56:34.639830 n-d-760456-11 devstack@n-api.service[104272]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 03:56:34.641785 n-d-760456-11 devstack@n-api.service[104272]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 03:56:34 2022] *** Jul 20 03:56:34.641785 n-d-760456-11 devstack@n-api.service[104272]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 03:56:34.641785 n-d-760456-11 devstack@n-api.service[104272]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 03:56:34.641785 n-d-760456-11 devstack@n-api.service[104272]: nodename: n-d-760456-11 Jul 20 03:56:34.641785 n-d-760456-11 devstack@n-api.service[104272]: machine: x86_64 Jul 20 03:56:34.641785 n-d-760456-11 devstack@n-api.service[104272]: clock source: unix Jul 20 03:56:34.641785 n-d-760456-11 devstack@n-api.service[104272]: pcre jit disabled Jul 20 03:56:34.641785 n-d-760456-11 devstack@n-api.service[104272]: detected number of CPU cores: 4 Jul 20 03:56:34.641785 n-d-760456-11 devstack@n-api.service[104272]: current working directory: / Jul 20 03:56:34.641785 n-d-760456-11 devstack@n-api.service[104272]: detected binary path: /usr/bin/uwsgi-core Jul 20 03:56:34.642433 n-d-760456-11 devstack@n-api.service[104272]: your processes number limit is 47680 Jul 20 03:56:34.642433 n-d-760456-11 devstack@n-api.service[104272]: your memory page size is 4096 bytes Jul 20 03:56:34.642433 n-d-760456-11 devstack@n-api.service[104272]: detected max file descriptor number: 2048 Jul 20 03:56:34.642433 n-d-760456-11 devstack@n-api.service[104272]: lock engine: pthread robust mutexes Jul 20 03:56:34.642433 n-d-760456-11 devstack@n-api.service[104272]: thunder lock: enabled Jul 20 03:56:34.642433 n-d-760456-11 devstack@n-api.service[104272]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 03:56:34.642433 n-d-760456-11 devstack@n-api.service[104272]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 03:56:34.686089 n-d-760456-11 devstack@n-api.service[104272]: Python main interpreter initialized at 0x562fe58f09c0 Jul 20 03:56:34.686089 n-d-760456-11 devstack@n-api.service[104272]: python threads support enabled Jul 20 03:56:34.686089 n-d-760456-11 devstack@n-api.service[104272]: your server socket listen backlog is limited to 100 connections Jul 20 03:56:34.686089 n-d-760456-11 devstack@n-api.service[104272]: your mercy for graceful operations on workers is 90 seconds Jul 20 03:56:34.686457 n-d-760456-11 devstack@n-api.service[104272]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 03:56:34.686533 n-d-760456-11 devstack@n-api.service[104272]: *** Operational MODE: preforking *** Jul 20 03:56:34.686775 n-d-760456-11 devstack@n-api.service[104272]: *** uWSGI is running in multiple interpreter mode *** Jul 20 03:56:34.686775 n-d-760456-11 devstack@n-api.service[104272]: spawned uWSGI master process (pid: 104272) Jul 20 03:56:34.686958 n-d-760456-11 systemd[1]: Started Devstack devstack@n-api.service. Jul 20 03:56:34.694282 n-d-760456-11 devstack@n-api.service[104272]: spawned uWSGI worker 1 (pid: 104273, cores: 1) Jul 20 03:56:34.694282 n-d-760456-11 devstack@n-api.service[104272]: spawned uWSGI worker 2 (pid: 104274, cores: 1) Jul 20 03:56:34.694282 n-d-760456-11 devstack@n-api.service[104272]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 03:56:35.367445 n-d-760456-11 devstack@n-api.service[104274]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 03:56:35.384476 n-d-760456-11 devstack@n-api.service[104273]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 03:56:36.510182 n-d-760456-11 devstack@n-api.service[104274]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:56:36.510182 n-d-760456-11 devstack@n-api.service[104274]: from cryptography.utils import int_from_bytes Jul 20 03:56:36.510798 n-d-760456-11 devstack@n-api.service[104274]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:56:36.510798 n-d-760456-11 devstack@n-api.service[104274]: from cryptography.utils import int_from_bytes Jul 20 03:56:36.531588 n-d-760456-11 devstack@n-api.service[104273]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:56:36.531588 n-d-760456-11 devstack@n-api.service[104273]: from cryptography.utils import int_from_bytes Jul 20 03:56:36.532038 n-d-760456-11 devstack@n-api.service[104273]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 03:56:36.532038 n-d-760456-11 devstack@n-api.service[104273]: from cryptography.utils import int_from_bytes Jul 20 03:56:39.041279 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 03:56:39.041953 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 03:56:39.042050 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 03:56:39.042050 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 03:56:39.042639 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 03:56:39.042728 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 03:56:39.042815 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 03:56:39.042815 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 03:56:39.042962 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 03:56:39.043040 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 03:56:39.043131 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.043349 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.043461 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.043668 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.043765 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.043986 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.044087 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.044305 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.044393 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.044613 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.044714 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.044935 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.045029 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.045250 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.045337 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.045566 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.045664 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.045826 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.045919 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.046138 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.046236 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.046476 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.046576 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-760456-11 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.046807 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.046899 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-760456-11 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.047115 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.047210 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.047419 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.047506 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.047730 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.047817 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.048033 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.048118 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.048341 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.048439 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.048648 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.048734 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.048955 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.049150 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.049460 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.049612 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.049770 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.049893 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.050077 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.050211 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.050414 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.050608 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.050741 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.050924 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.051070 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.051234 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.051371 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.051557 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.051685 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.051865 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.052002 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.052189 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.052326 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.052501 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.052630 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.052901 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-760456-11 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.053031 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-760456-11 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.053219 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.053371 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.053514 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.053638 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.053830 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.053965 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.054273 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.054988 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.055218 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.055431 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.055637 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.055787 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.055922 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.056053 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.056180 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.056304 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.056488 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.056619 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.056818 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.056954 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.057140 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.057278 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.057463 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.057607 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.057786 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.057915 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.058090 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.058220 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.058434 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.058573 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.058746 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.058882 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.059072 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.059206 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.059376 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.059505 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.059681 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.059810 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.059943 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.060083 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.060216 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.060341 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.060548 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.060720 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.060850 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.060973 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.061164 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.061297 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.061434 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.061566 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.061701 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.061843 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.061977 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.062109 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.062278 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.062420 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.062588 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.062805 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.062942 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.063066 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.063190 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.063323 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.063536 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.063661 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.063791 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.063928 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.064122 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.064259 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.064385 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.064509 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.064632 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.064763 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.064956 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.065095 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.065269 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.065396 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.065590 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.065716 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.065897 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.066042 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.066215 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.066363 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.066631 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.066761 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.066899 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.067031 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.067157 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.067281 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.067499 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.067639 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.067815 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.067944 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.068123 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.068264 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.068442 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.068571 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.068762 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.068897 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.069069 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.069204 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.069373 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.069509 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.069678 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.069823 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.070177 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.070421 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.070633 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.070812 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.070942 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.071057 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.071187 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.071320 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.071445 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.071578 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.071711 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.071836 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.071968 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.072092 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.072217 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.072355 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.072480 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.072604 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.072728 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.072852 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.072976 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.073109 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.073240 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.073381 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.073507 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.073688 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.073818 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.073994 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.074139 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.074357 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.074489 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.074613 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.074822 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.074957 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.075082 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.075205 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.075338 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.075494 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.075633 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.075799 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.075928 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.076119 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.076247 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.076438 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.076577 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.076747 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.076876 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.077053 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.077189 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.077357 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.077495 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.077663 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.077801 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.077967 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.078101 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.078289 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.078435 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.078605 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.078732 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.078915 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.079049 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.079219 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.079366 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.079520 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.079656 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.079828 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.079955 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.080133 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.080270 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.080440 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.080569 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.080736 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.080870 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.081043 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.081183 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.081349 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.081489 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.081653 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.081781 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.081957 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.082094 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.082305 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.082452 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.082578 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.082701 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.082875 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.083006 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.083179 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.083317 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.083483 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.083612 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.083787 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.083918 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.084085 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.084217 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.084430 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.084564 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.084698 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.084821 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.084986 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.085114 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.085290 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.085431 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.085639 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.085853 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.086063 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.086238 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.086383 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 03:56:39.086522 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.086649 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.086774 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.086897 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.087056 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.087239 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.087387 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.087554 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.087684 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.087885 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.088013 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.088206 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.088342 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.088518 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.088647 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.088830 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.088958 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.089148 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.089287 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.089459 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.089586 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.089771 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.089900 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.090084 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.090213 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.090683 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.090818 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.091006 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.091142 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.091325 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.091465 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.091640 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.091767 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.091956 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.092085 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.092272 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.092407 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.092582 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.092718 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.092890 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.093018 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.093210 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.093341 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.093530 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.093656 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.093842 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.093971 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.094148 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.094300 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.094541 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.094680 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.094845 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.094987 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.095165 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.095292 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.095484 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.095613 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.095799 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.096009 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.096139 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.096262 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.096393 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.096527 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.096705 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.096844 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.097032 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.097168 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.097344 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.097480 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.097662 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.097793 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.097977 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.098105 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.098311 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.098445 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.098627 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.098758 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.098938 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.099068 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.099249 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.099376 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.099561 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.099691 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.099887 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.100020 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.100205 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.100335 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.100519 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.100650 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.100833 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.100960 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.101721 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.101928 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.102154 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.102801 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.102928 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.103035 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.103140 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.103261 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.103378 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.103485 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.103591 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.103695 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.103811 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.103927 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.104034 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.104140 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.104245 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.104358 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.104472 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.104608 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.104803 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.104916 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.105046 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.107347 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.107514 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.107670 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.107807 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.107936 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.108064 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.108199 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.108335 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.108470 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.108604 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.108729 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.108854 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.108978 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.109118 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.109235 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.109367 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.109500 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.109624 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.109749 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.109882 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.110008 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.110140 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.110317 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.110445 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.110570 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.110708 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.110835 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.110967 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.111100 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.111226 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.111360 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.111491 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.111617 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.111741 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.111872 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.111997 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.112130 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.112264 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.112397 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.112534 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.112661 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.112792 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.112927 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.113060 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.113185 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.113310 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.113441 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.113565 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.113699 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.113831 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.113956 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.114079 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.114203 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.114401 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.114529 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.114653 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.114793 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.114987 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.115117 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.115251 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.115379 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.115502 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.115625 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.115748 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.115880 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.116017 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.116150 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.116286 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.116412 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.116536 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.116660 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.117467 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.117674 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.117869 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.118087 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.118285 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.118432 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.118568 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.118694 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.118819 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.118958 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.119085 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.119219 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.119334 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.119465 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.119604 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.119738 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.119870 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.120009 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.120136 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.120261 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.120385 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.120517 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.120643 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.120776 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.120910 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.121036 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.121160 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.121267 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.121379 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.121485 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.121601 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.121709 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.121815 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.121928 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.122047 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.122161 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.122286 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.122400 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.122550 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.122668 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.122865 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.122984 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.123179 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.123297 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.123504 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.123620 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.123818 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.123943 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.124139 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.124254 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.124451 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.124567 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.124762 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.124878 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.125081 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.125203 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.125379 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.125583 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.126245 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.126416 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.126543 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.126669 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.126808 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.126937 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.127062 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.127186 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.127310 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.127440 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.127573 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.127707 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.127840 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.127966 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.127966 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.128209 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.128343 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.128468 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.128593 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.128716 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.128841 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.128974 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.129108 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.129232 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.129378 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.129550 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.129674 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.129812 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.129991 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.130122 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.130322 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.130455 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.130633 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.130771 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.130946 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.131076 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.131249 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.131376 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.131560 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.131698 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.131878 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.132016 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.132209 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.132338 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.132717 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.132850 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.132995 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.133143 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.133271 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.133451 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.133598 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.133762 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.133899 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.134074 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.134205 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.134404 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.134556 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.134709 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.134838 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.135016 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.135158 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.135355 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.135492 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.135618 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.135731 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.135925 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.136052 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.136231 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.136369 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.136542 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.136668 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.136848 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.136983 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.137152 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.137281 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.137455 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.137582 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.137759 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.137884 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.138071 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.138200 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.138403 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.138530 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.138725 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.138851 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.139040 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.139177 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.139343 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.139471 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.139647 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.139773 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.139961 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.140088 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.140269 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.140397 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.140575 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.140711 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.140882 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.141010 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.141185 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.141319 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.141490 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.141627 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.141797 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.141924 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.142122 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.142265 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.142469 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.142641 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.142769 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.142894 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.143073 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.143204 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.143394 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.143534 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.143704 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.143840 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.144010 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.144138 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.144322 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.144458 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.144635 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.144763 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.144943 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.145073 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.145255 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.145461 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.145589 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.145725 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.145862 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.145988 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.146172 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.146360 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.146515 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.146643 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.146823 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.146960 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.147134 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.147263 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.147440 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.147566 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.147742 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.147879 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.148081 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.148244 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.148461 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.148671 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.148869 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.149010 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.149142 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.149383 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.149552 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.149703 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.149893 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.150030 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.150214 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.150371 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.150639 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.150769 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.150966 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.151107 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.151289 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.151419 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.151624 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.151753 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.151930 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.152070 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.152252 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.152363 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.152536 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.152661 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.152840 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.152955 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.153154 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.153277 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.153459 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.153574 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.153763 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.153892 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.154069 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.154193 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.154400 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.154515 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.154705 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.154820 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.155011 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.155128 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.155313 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.155451 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.155637 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.155748 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.155912 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.156028 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.156214 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.156327 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.156527 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.156657 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.156831 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.156946 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.157146 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.157262 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.157455 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.157570 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.157757 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.157872 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.158062 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.158185 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.158392 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.158509 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.158699 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.158828 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.159006 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.159122 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.159351 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.159491 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.159659 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.159789 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.159999 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.160129 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.160304 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.160427 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.160612 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.160737 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.160938 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.161060 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.161242 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.161366 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.161548 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.161664 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.161850 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.161965 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.162153 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.162315 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.162482 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.162597 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.162784 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.162913 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.163093 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.163216 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.163399 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.163514 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.164283 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.164540 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.164769 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.164938 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.165066 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.165192 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.165316 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.165450 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.165590 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.165805 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.165934 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.166059 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.166183 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.166341 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.166470 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.166647 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.166777 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.166959 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.167089 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.167266 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.167406 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.167567 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.167694 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.167875 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.168003 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.168178 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.168307 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.168483 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.168610 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.168792 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.168929 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.169096 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.169225 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.169397 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.169533 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.169709 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.169847 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.170014 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.170141 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.170339 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.170468 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.170653 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.170793 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.170963 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.171090 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.171266 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.171395 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.171568 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.171704 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.171881 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.172012 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.172186 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.172314 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.172487 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.172628 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.172796 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.172923 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.173102 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.173232 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.173495 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.173627 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.173761 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.173877 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.174006 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.174122 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.174334 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.174454 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.174640 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.174768 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.174945 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.175062 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.175249 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.175372 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.175550 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.175681 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.175858 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.175994 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.176160 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.176262 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.176461 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.176567 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.176762 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.176875 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.177064 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.177160 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.177369 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.177466 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.177674 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.177777 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.177980 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.178083 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.178304 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.178402 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.178615 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.178799 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.178925 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.179067 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.180045 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.180199 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.180311 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.180469 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.180604 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.180731 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.180731 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.180968 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.181102 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.181228 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.181354 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.181477 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.181646 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.181776 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.181951 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.182082 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.182293 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.182422 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.182600 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.182913 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.183217 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.183523 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.183638 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.183846 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.183971 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.184159 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.184437 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.184555 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.184760 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.184883 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.185085 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.185412 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.185652 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.185785 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.186029 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.186169 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.186309 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.186449 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.186611 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.186743 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.186929 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.187077 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.187239 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.187382 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.187551 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.187682 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.187864 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.187993 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.188173 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.188312 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.188484 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.188613 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.188798 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.188926 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.189104 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.189250 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.189416 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.189545 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.189725 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.189855 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.190030 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.190153 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.190365 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.190495 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.190675 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.190804 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.190980 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.191110 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.191289 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.191418 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.191593 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.191729 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.191901 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.192030 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.192202 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.192330 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.192513 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.192640 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.192820 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.192952 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.193147 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.193284 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.193460 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.193598 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.193768 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.193897 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.194081 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.194210 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.194413 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.194555 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.194728 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.194881 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.195075 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.195286 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.195495 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.195671 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.195802 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.195928 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.196077 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.196286 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.196424 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.196560 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.196695 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.196827 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.196953 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.197085 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.197249 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.197381 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.197574 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.197703 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.197880 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.197997 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.198185 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.198321 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.198518 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.198638 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.198837 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.198938 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.199142 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.199240 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.199464 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.199563 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.199841 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.199926 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.200221 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.200330 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.200485 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.200568 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.204557 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.204694 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.204795 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.204879 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.204957 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205036 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205122 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205211 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205291 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205369 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205454 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205540 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205540 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205692 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205773 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205850 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.205935 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206021 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206100 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206185 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206282 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206360 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206459 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206553 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206633 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206710 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206787 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206876 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.206963 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207042 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207136 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207203 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207276 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207355 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207432 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207508 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207585 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207662 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207750 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207835 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207919 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.207997 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208070 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208142 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208228 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208307 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208384 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208461 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208538 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208614 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208702 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208781 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.208925 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.209062 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.209232 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.209497 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.209600 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.209815 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.209917 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.210128 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.210229 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.210467 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.211699 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.211811 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.211900 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.211983 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212112 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212218 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212304 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212383 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212461 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212547 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212627 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212718 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212807 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212894 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.212981 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.213061 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.213166 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.213249 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.213326 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.213489 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.213706 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.213794 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.214109 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.214314 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.214467 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.214615 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.214747 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.214832 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.215019 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.215153 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.215616 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.215718 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.215923 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.216012 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.216244 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.216333 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.216574 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.216663 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.216903 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.217004 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.217215 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.217304 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.217549 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.217645 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.217867 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.217962 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.218177 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.218295 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.218509 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.218598 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.218818 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.218917 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.219134 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.219229 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.219440 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.219530 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.219751 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.219887 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.220057 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.220146 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.220363 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.220446 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.220669 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.220766 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.220978 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.221066 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.221280 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.221367 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.221583 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.221671 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.221885 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.221980 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.222209 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.222329 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.222539 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.222630 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.222862 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.222950 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.223173 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.223259 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.223477 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.223572 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.223783 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.223877 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.224083 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.224182 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.224393 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.224479 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.224700 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.224787 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.225008 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.225104 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.225317 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.225405 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.225645 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.225733 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.225953 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.226054 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.226930 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.227399 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.227485 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.227565 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.227645 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.227811 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.227897 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.227977 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.228100 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.228190 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.228445 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.228536 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.228754 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.228842 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.229078 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.229165 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.229397 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.229496 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.229711 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.229797 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.230029 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.230118 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.230395 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.230495 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.230688 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.230777 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.231007 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.231254 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.231351 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.231587 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.231674 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.231905 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.231992 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.232221 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.232310 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.232537 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.232625 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.232853 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.232938 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.233166 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.233255 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.233477 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.233564 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.233791 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.233880 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.234106 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.234195 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.234457 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.234687 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.234791 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.235021 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.235113 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.235340 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.235428 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.235655 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.235752 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.235972 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.236063 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.236291 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.236380 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.236608 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.236704 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.236924 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.237014 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.237239 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.237330 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.237553 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.237655 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.237868 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.237967 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.238187 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.238330 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.238531 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.238630 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.238847 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.238943 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.239165 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.239253 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.239477 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.239567 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.239791 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.239879 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.240107 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.240195 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.240417 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.240505 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.240728 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.240816 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.241041 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.241128 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.241355 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.241444 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.241676 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.241794 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.242942 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.243049 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.243134 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.243215 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.243296 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.243374 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.243557 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.243665 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.243816 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.243905 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.244148 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.244341 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.244600 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.244697 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.244921 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.245011 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.245239 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.245328 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.245557 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.245647 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.245887 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.245977 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.246224 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.246398 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.246571 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.246661 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.246884 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.246980 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.247190 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.247287 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.247502 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.247598 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.247814 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.248022 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.248111 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.248375 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.248481 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.248712 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.248808 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.249020 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.249115 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.249344 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.249440 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.249655 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.249743 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.249978 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.250187 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.250320 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.250565 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.250655 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.250882 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.250969 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.251208 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.251310 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.251517 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.251614 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.251835 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.251923 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.252142 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.252239 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.252466 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.252555 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.252771 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.252859 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.253081 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.253178 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.253398 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.253486 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.253709 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.253979 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.254082 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.254331 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.254423 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.254645 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.254733 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.254954 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.255061 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.255260 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.255357 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.255571 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.255659 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.255875 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.255965 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.256203 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.256290 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.256508 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.256596 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.256815 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.256904 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.257118 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.257207 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.257453 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.258025 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.258025 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.258201 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.258299 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.258381 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.258475 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.258564 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.258654 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.258782 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.258954 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.259045 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.259262 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.259358 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.259565 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.259653 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.259867 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.259955 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.260179 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.260275 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.260496 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.260586 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.260789 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.260922 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.261102 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.261202 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.261409 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.261497 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.261715 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.261802 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.262019 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.262116 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.262355 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.262449 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.262667 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.262757 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.262973 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.263071 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.263284 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.263373 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.263591 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.263678 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.263901 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.263990 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.264209 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.264307 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.264546 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.264759 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.264930 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.265091 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.265179 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.265412 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.265499 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.265745 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.265843 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.266063 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.266151 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.266395 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.266484 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.266705 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.266803 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.267010 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.267098 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.267321 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.267409 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.267633 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.267722 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.267945 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.268033 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.268255 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.268493 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.268590 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.268832 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.268920 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.269156 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.269251 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.269464 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.269560 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.269774 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.269861 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.270084 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.270171 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.270416 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.270510 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.270723 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.270821 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.271030 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.271117 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.271338 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.271427 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.271649 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.271736 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.271963 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.272051 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.272278 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.272368 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.272591 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.272678 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.272900 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.273002 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.273977 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.274091 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.274176 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.274275 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.274375 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.274478 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.274688 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.274778 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.275000 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.275096 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.275312 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.275409 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.275623 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.275719 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.275936 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.276024 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.276240 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.276329 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.276584 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.276670 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.276903 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.276993 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.277221 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.277310 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.277540 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.277627 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.277851 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.277948 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.278161 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.278269 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.278494 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.278592 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.278805 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.278894 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.279123 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.279211 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.279430 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.279517 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.279752 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.279847 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.280060 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.280148 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.280407 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.280535 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.280731 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.280829 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.281037 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.281171 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.281340 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.281437 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.281643 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.281743 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.281951 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.282040 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.282299 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.282393 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.282597 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.282687 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.282900 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.282987 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.283202 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.283298 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.283510 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.283600 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.283813 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.283900 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.284116 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.284205 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.284418 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.284516 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.284720 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.284808 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.285028 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.285129 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.285329 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.285419 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.285630 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.285725 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.285932 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.286029 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.286235 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.286342 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.286560 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.286650 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.286859 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.286956 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.287165 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.287259 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.287468 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.287557 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.287768 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.287869 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.288069 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.288164 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.288369 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.288458 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.288738 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.289865 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.289865 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.290017 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.290098 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.290185 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.290313 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.290476 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.290569 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.290783 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.290872 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.291088 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.291190 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.291446 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.291543 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.291706 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.291794 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.292012 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.292110 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.292317 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.292406 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.292625 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.292713 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.292930 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.293021 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.293263 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.293364 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.293577 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.293667 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.293889 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.293979 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.294203 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.294311 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.294540 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.294628 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.294851 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.294941 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.295158 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.295245 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.295480 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.295570 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.295802 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.295899 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.296109 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.296197 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.296419 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.296515 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.296747 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.296842 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.297056 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.297142 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.297369 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.297466 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.297681 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.297768 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.297991 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.298084 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.298327 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.298435 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.298643 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.298732 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.298954 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.299040 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.299270 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.299360 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.299584 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.299672 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.299911 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.300007 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.300225 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.300314 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.300540 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.300670 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.300858 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.300947 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.301173 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.301262 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.301502 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.301589 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.301815 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.301912 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.302126 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.302213 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.302460 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.302548 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.302777 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.302878 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.303093 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.303183 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.303412 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.303500 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.303727 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.303825 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.304042 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.304131 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.304415 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.305034 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.305034 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.305207 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.305286 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.305365 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.305454 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.305543 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 03:56:39.305734 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.306066 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.306426 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.306779 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.307096 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.307443 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.307776 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.308095 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.308411 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.308725 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 03:56:39.308973 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 03:56:39.369519 n-d-760456-11 devstack@n-api.service[104273]: INFO dbcounter [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Registered counter for database nova_api Jul 20 03:56:39.373152 n-d-760456-11 devstack@n-api.service[104274]: INFO dbcounter [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Registered counter for database nova_api Jul 20 03:56:39.481250 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_db.sqlalchemy.engines [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:56:39.485056 n-d-760456-11 devstack@n-api.service[104274]: DEBUG oslo_db.sqlalchemy.engines [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:56:39.487853 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writer thread running {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:56:39.491405 n-d-760456-11 devstack@n-api.service[104274]: DEBUG dbcounter [-] [104274] Writer thread running {{(pid=104274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:56:39.545273 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.context [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) {{(pid=104273) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 03:56:39.548447 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.context [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) {{(pid=104274) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 03:56:39.549166 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:56:39.550772 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:56:39.551576 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:56:39.552420 n-d-760456-11 devstack@n-api.service[104274]: DEBUG oslo_concurrency.lockutils [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:56:39.553728 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:56:39.553975 n-d-760456-11 devstack@n-api.service[104274]: DEBUG oslo_concurrency.lockutils [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:56:39.554827 n-d-760456-11 devstack@n-api.service[104274]: DEBUG oslo_concurrency.lockutils [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 03:56:39.555930 n-d-760456-11 devstack@n-api.service[104273]: INFO dbcounter [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Registered counter for database nova_cell0 Jul 20 03:56:39.556951 n-d-760456-11 devstack@n-api.service[104274]: DEBUG oslo_concurrency.lockutils [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 03:56:39.558955 n-d-760456-11 devstack@n-api.service[104274]: INFO dbcounter [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Registered counter for database nova_cell0 Jul 20 03:56:39.559782 n-d-760456-11 devstack@n-api.service[104273]: INFO dbcounter [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Registered counter for database nova_cell1 Jul 20 03:56:39.562773 n-d-760456-11 devstack@n-api.service[104274]: INFO dbcounter [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Registered counter for database nova_cell1 Jul 20 03:56:39.567391 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_db.sqlalchemy.engines [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:56:39.568556 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_db.sqlalchemy.engines [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:56:39.570462 n-d-760456-11 devstack@n-api.service[104274]: DEBUG oslo_db.sqlalchemy.engines [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:56:39.572991 n-d-760456-11 devstack@n-api.service[104274]: DEBUG oslo_db.sqlalchemy.engines [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:56:39.574821 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writer thread running {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:56:39.577148 n-d-760456-11 devstack@n-api.service[104274]: DEBUG dbcounter [-] [104274] Writer thread running {{(pid=104274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:56:39.716291 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writer thread running {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:56:39.719139 n-d-760456-11 devstack@n-api.service[104274]: DEBUG dbcounter [-] [104274] Writer thread running {{(pid=104274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:56:39.726443 n-d-760456-11 devstack@n-api.service[104273]: INFO dbcounter [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Registered counter for database nova_cell0 Jul 20 03:56:39.729878 n-d-760456-11 devstack@n-api.service[104274]: INFO dbcounter [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Registered counter for database nova_cell0 Jul 20 03:56:39.735577 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_db.sqlalchemy.engines [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:56:39.738939 n-d-760456-11 devstack@n-api.service[104274]: DEBUG oslo_db.sqlalchemy.engines [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 03:56:39.739905 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writer thread running {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:56:39.743928 n-d-760456-11 devstack@n-api.service[104274]: DEBUG dbcounter [-] [104274] Writer thread running {{(pid=104274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 03:56:40.081961 n-d-760456-11 devstack@n-api.service[104273]: WARNING keystonemiddleware.auth_token [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:56:40.088161 n-d-760456-11 devstack@n-api.service[104274]: WARNING keystonemiddleware.auth_token [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:56:40.090381 n-d-760456-11 devstack@n-api.service[104273]: WARNING keystonemiddleware.auth_token [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:56:40.095826 n-d-760456-11 devstack@n-api.service[104274]: WARNING keystonemiddleware.auth_token [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:56:40.437425 n-d-760456-11 devstack@n-api.service[104273]: WARNING keystonemiddleware.auth_token [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:56:40.443441 n-d-760456-11 devstack@n-api.service[104273]: WARNING keystonemiddleware.auth_token [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:56:40.449009 n-d-760456-11 devstack@n-api.service[104274]: WARNING keystonemiddleware.auth_token [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 03:56:40.449236 n-d-760456-11 devstack@n-api.service[104273]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562fe58f09c0 pid: 104273 (default app) Jul 20 03:56:40.451315 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:56:40.452493 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Jul 20 03:56:40.452910 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Wed Jul 20 03:56:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:56:40.455081 n-d-760456-11 devstack@n-api.service[104274]: WARNING keystonemiddleware.auth_token [None req-2d0f5a39-4c8d-425c-a52f-cc463b222ed9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 03:56:40.460218 n-d-760456-11 devstack@n-api.service[104274]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562fe58f09c0 pid: 104274 (default app) Jul 20 03:57:57.201268 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:57:57.202280 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jul 20 03:57:57.202942 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:57:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:57:57.215576 n-d-760456-11 devstack@n-api.service[104274]: DEBUG dbcounter [-] [104274] Writing DB stats nova_api:SELECT=3 {{(pid=104274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:57:57.217202 n-d-760456-11 devstack@n-api.service[104274]: DEBUG dbcounter [-] [104274] Writing DB stats nova_cell0:SELECT=3 {{(pid=104274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:57:57.218364 n-d-760456-11 devstack@n-api.service[104274]: DEBUG dbcounter [-] [104274] Writing DB stats nova_cell1:SELECT=3 {{(pid=104274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:57:57.219087 n-d-760456-11 devstack@n-api.service[104274]: DEBUG dbcounter [-] [104274] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:57:58.078007 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-4da088bc-3318-4f78-b0aa-403ea943fb55 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:57:58.108611 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-4da088bc-3318-4f78-b0aa-403ea943fb55 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.899061 Jul 20 03:57:58.109343 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1291 bytes} [Wed Jul 20 03:57:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:58:00.411503 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:00.412506 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-fc596b27-257c-4a13-bf47-d5b906b81af5 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 20 03:58:00.412899 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:00.883102 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-dab348e0-fbe2-4dab-8ea6-62422300c296 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "ram": 256, "name": "cirros256", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:00.901487 n-d-760456-11 devstack@n-api.service[104274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 03:58:00.901487 n-d-760456-11 devstack@n-api.service[104274]: warnings.warn(msg) Jul 20 03:58:00.932569 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-dab348e0-fbe2-4dab-8ea6-62422300c296 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.511689 Jul 20 03:58:00.933488 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1282 bytes} [Wed Jul 20 03:58:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:58:01.150285 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-1ab713b2-8482-4683-99b0-afca601d39f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:01.153299 n-d-760456-11 devstack@n-api.service[104273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 03:58:01.153299 n-d-760456-11 devstack@n-api.service[104273]: warnings.warn(msg) Jul 20 03:58:01.155965 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writing DB stats nova_api:SELECT=3 {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:58:01.156825 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writing DB stats nova_cell1:SELECT=3 {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:58:01.157532 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writing DB stats nova_cell0:SELECT=3 {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:58:01.158221 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:58:01.223902 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-1ab713b2-8482-4683-99b0-afca601d39f8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282130 Jul 20 03:58:01.225035 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1335 bytes} [Wed Jul 20 03:58:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 03:58:03.511279 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-dab348e0-fbe2-4dab-8ea6-62422300c296 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:03.512299 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-dab348e0-fbe2-4dab-8ea6-62422300c296 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Jul 20 03:58:03.512703 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:04.268754 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-103e4d98-8365-48d1-9f25-c8d7e123758e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M"}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:04.305276 n-d-760456-11 devstack@n-api.service[104273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 03:58:04.305276 n-d-760456-11 devstack@n-api.service[104273]: warnings.warn(msg) Jul 20 03:58:04.336849 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-103e4d98-8365-48d1-9f25-c8d7e123758e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.818095 Jul 20 03:58:04.338621 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1282 bytes} [Wed Jul 20 03:58:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:58:04.350866 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-6bac3207-2255-4723-b32e-7af1a24954a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:04.352558 n-d-760456-11 devstack@n-api.service[104274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 03:58:04.352558 n-d-760456-11 devstack@n-api.service[104274]: warnings.warn(msg) Jul 20 03:58:04.396035 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-6bac3207-2255-4723-b32e-7af1a24954a3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048598 Jul 20 03:58:04.396876 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1335 bytes} [Wed Jul 20 03:58:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 03:58:06.897387 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-103e4d98-8365-48d1-9f25-c8d7e123758e admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:06.898433 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-103e4d98-8365-48d1-9f25-c8d7e123758e admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 20 03:58:06.898866 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 03:58:07.467653 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-8a436802-22d6-48ca-aba8-6add1b6c7a7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "name": "ds1G", "id": "d2"}} {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:07.497435 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-8a436802-22d6-48ca-aba8-6add1b6c7a7c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.585097 Jul 20 03:58:07.498802 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1282 bytes} [Wed Jul 20 03:58:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:58:07.510113 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-fa8ac7af-2087-4e71-b582-2514517a71b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:07.538832 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-fa8ac7af-2087-4e71-b582-2514517a71b4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030874 Jul 20 03:58:07.546664 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1335 bytes} [Wed Jul 20 03:58:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:58:09.979826 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-8a436802-22d6-48ca-aba8-6add1b6c7a7c admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:09.981965 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-8a436802-22d6-48ca-aba8-6add1b6c7a7c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002184 Jul 20 03:58:09.984240 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:10.359599 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-3cb1c1cc-6888-42a4-8a42-dbb81a91b1a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:10.379575 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-3cb1c1cc-6888-42a4-8a42-dbb81a91b1a4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.390891 Jul 20 03:58:10.388342 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1282 bytes} [Wed Jul 20 03:58:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:58:10.393125 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-2c408a1f-3210-4f60-9f7a-7e5a45f08a52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:10.419800 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-2c408a1f-3210-4f60-9f7a-7e5a45f08a52 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030334 Jul 20 03:58:10.420712 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1335 bytes} [Wed Jul 20 03:58:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:58:12.757365 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-3cb1c1cc-6888-42a4-8a42-dbb81a91b1a4 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:12.758681 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-3cb1c1cc-6888-42a4-8a42-dbb81a91b1a4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001797 Jul 20 03:58:12.759205 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:13.261568 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-96241ac1-2030-428d-aa80-bbc602e640e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "id": "d4", "name": "ds4G", "vcpus": 4}} {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:13.281517 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-96241ac1-2030-428d-aa80-bbc602e640e6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514695 Jul 20 03:58:13.282000 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1282 bytes} [Wed Jul 20 03:58:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:58:13.293839 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-c79d70cc-d510-40a3-819d-2a0c1a0f4264 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:13.318476 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-c79d70cc-d510-40a3-819d-2a0c1a0f4264 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028174 Jul 20 03:58:13.319202 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1335 bytes} [Wed Jul 20 03:58:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:58:15.672350 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-96241ac1-2030-428d-aa80-bbc602e640e6 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:15.673952 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-96241ac1-2030-428d-aa80-bbc602e640e6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Jul 20 03:58:15.679857 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:15 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:16.177320 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-7b39d118-570d-40ed-9880-d7e18269e977 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:16.202270 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-7b39d118-570d-40ed-9880-d7e18269e977 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.520946 Jul 20 03:58:16.203677 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1291 bytes} [Wed Jul 20 03:58:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 03:58:18.506630 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-96241ac1-2030-428d-aa80-bbc602e640e6 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:18.507632 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-96241ac1-2030-428d-aa80-bbc602e640e6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jul 20 03:58:18.508036 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:18.933050 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-62e4a074-a396-4e66-9d90-b189c551eef5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:18.951445 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-62e4a074-a396-4e66-9d90-b189c551eef5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.436798 Jul 20 03:58:18.952011 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1282 bytes} [Wed Jul 20 03:58:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 03:58:18.964211 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-82b56187-6f4b-4d86-afa6-0b1e6933cdfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:18.999325 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-82b56187-6f4b-4d86-afa6-0b1e6933cdfb admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038886 Jul 20 03:58:18.999924 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1332 bytes} [Wed Jul 20 03:58:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 03:58:21.239214 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-62e4a074-a396-4e66-9d90-b189c551eef5 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:21.240481 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-62e4a074-a396-4e66-9d90-b189c551eef5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Jul 20 03:58:21.240894 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 03:58:21.683759 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-3cb38d4d-5f3e-4f5f-87a7-5f691ea81ed5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1}} {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:21.702830 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-3cb38d4d-5f3e-4f5f-87a7-5f691ea81ed5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456206 Jul 20 03:58:21.703503 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1282 bytes} [Wed Jul 20 03:58:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:58:21.715335 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-3a22c07e-22ac-4eb2-9ac0-4b8b10eaaaac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:21.739095 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-3a22c07e-22ac-4eb2-9ac0-4b8b10eaaaac admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027498 Jul 20 03:58:21.739935 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1332 bytes} [Wed Jul 20 03:58:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:58:23.977834 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-3cb38d4d-5f3e-4f5f-87a7-5f691ea81ed5 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:23.978875 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-3cb38d4d-5f3e-4f5f-87a7-5f691ea81ed5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 20 03:58:23.979284 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:24.378555 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-f76600ef-ee2c-46b0-8222-eff5033437b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "disk": 40, "swap": 0, "rxtx_factor": 1.0}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:24.397052 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-f76600ef-ee2c-46b0-8222-eff5033437b6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.411178 Jul 20 03:58:24.397707 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1282 bytes} [Wed Jul 20 03:58:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:58:24.410908 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-3d2d6304-d52b-4c1c-b7aa-27a8af648fce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:24.433318 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-3d2d6304-d52b-4c1c-b7aa-27a8af648fce admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026122 Jul 20 03:58:24.433975 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1332 bytes} [Wed Jul 20 03:58:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:58:26.709052 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-f76600ef-ee2c-46b0-8222-eff5033437b6 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:26.710146 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-f76600ef-ee2c-46b0-8222-eff5033437b6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 20 03:58:26.710634 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:27.142875 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-a1de4e1f-032f-4e34-b169-75e16d27c832 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:27.167532 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-a1de4e1f-032f-4e34-b169-75e16d27c832 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450691 Jul 20 03:58:27.168325 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1282 bytes} [Wed Jul 20 03:58:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 03:58:27.179942 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-dd1bcc16-3652-492b-866a-e70c6644055d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:27.212629 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-dd1bcc16-3652-492b-866a-e70c6644055d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036275 Jul 20 03:58:27.223248 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1332 bytes} [Wed Jul 20 03:58:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:58:29.510394 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-a1de4e1f-032f-4e34-b169-75e16d27c832 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:29.511416 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-a1de4e1f-032f-4e34-b169-75e16d27c832 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 20 03:58:29.511817 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:29.957597 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-b51a24c6-00d4-4af3-b43c-bdf738874e76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "vcpus": 8}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:29.982233 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-b51a24c6-00d4-4af3-b43c-bdf738874e76 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463612 Jul 20 03:58:29.983676 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1282 bytes} [Wed Jul 20 03:58:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:58:29.996420 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-02297be7-877b-4cf1-81f9-6383f91afff2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:58:30.000370 n-d-760456-11 devstack@n-api.service[104274]: DEBUG dbcounter [-] [104274] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:58:30.025283 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-02297be7-877b-4cf1-81f9-6383f91afff2 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032541 Jul 20 03:58:30.026182 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1332 bytes} [Wed Jul 20 03:58:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 03:58:54.250330 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-b51a24c6-00d4-4af3-b43c-bdf738874e76 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:54.253250 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-b51a24c6-00d4-4af3-b43c-bdf738874e76 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002414 Jul 20 03:58:54.253652 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:58:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:54.663658 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-a4800c6b-5337-4601-bf86-f86a4af61425 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:54.681349 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-a4800c6b-5337-4601-bf86-f86a4af61425 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.421798 Jul 20 03:58:54.681882 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1291 bytes} [Wed Jul 20 03:58:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 03:58:55.758689 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-b51a24c6-00d4-4af3-b43c-bdf738874e76 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:55.759679 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-b51a24c6-00d4-4af3-b43c-bdf738874e76 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 20 03:58:55.760075 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Jul 20 03:58:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:56.313143 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-02c5193f-e885-41fa-aa45-7caf8ee04ee8 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:56.320033 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.wsgi [None req-02c5193f-e885-41fa-aa45-7caf8ee04ee8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-02c5193f-e885-41fa-aa45-7caf8ee04ee8 admin admin] Request method failure captured: Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: Accept: application/json Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: Accept-Encoding: gzip, deflate Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: Connection: keep-alive Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: Content-Length: 0 Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: Host: 10.222.0.59 Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: Openstack-Api-Version: compute 2.90 Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: Openstack-System-Scope: None Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: User-Agent: python-novaclient Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Auth-Token: gAAAAABi131_q_Lm1lDrUeXcT5AilUnocBd6f6ZLgOzBFXR6SlBSXUvEyR3DCYvEfhZ0iiGOBkx28A_JyDyLz6AWflGKIuujk08uJweQImvv-fVlQlz991qxgv_2RHWoVnlz6jkzGPtaQ3WpHj1q8_1ZLvjUDbPwdXah0RpyZMJCIMtRkcP0ylA Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Domain-Id: None Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Domain-Name: None Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Identity-Status: Confirmed Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Is-Admin-Project: True Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Domain-Id: default Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Domain-Name: Default Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Name: admin Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Role: member,reader,admin Jul 20 03:58:56.323326 n-d-760456-11 devstack@n-api.service[104274]: X-Roles: member,reader,admin Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2409c916eee643309d23578a107904fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2409c916eee643309d23578a107904fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: X-Tenant: admin Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: X-Tenant-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: X-Tenant-Name: admin Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: X-User: admin Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: X-User-Domain-Id: default Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: X-User-Domain-Name: Default Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: X-User-Id: 29fc59062d314d4985c75b27c3b6c023 Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: X-User-Name: admin Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: method: > Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: exception: Flavor 42 could not be found. Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: action_args: {'id': '42'} Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 03:58:56.325040 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:56.326091 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:56.327633 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-02c5193f-e885-41fa-aa45-7caf8ee04ee8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 03:58:56.329654 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-02c5193f-e885-41fa-aa45-7caf8ee04ee8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.400828 Jul 20 03:58:56.329654 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 03:58:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 03:58:56.335187 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-c293ead2-8bfb-44a0-9ae4-419b25032c26 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:56.338224 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 03:58:56.358583 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-c293ead2-8bfb-44a0-9ae4-419b25032c26 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026977 Jul 20 03:58:56.359129 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Jul 20 03:58:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 03:58:56.371992 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-e51b0e11-1405-4f71-a2a5-e3af89868db4 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:56.394663 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-e51b0e11-1405-4f71-a2a5-e3af89868db4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026380 Jul 20 03:58:56.395206 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Jul 20 03:58:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 03:58:56.404665 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-950c20d8-6add-4d5f-8caa-98cf08bb1797 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:56.411185 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.wsgi [None req-950c20d8-6add-4d5f-8caa-98cf08bb1797 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-950c20d8-6add-4d5f-8caa-98cf08bb1797 admin admin] Request method failure captured: Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: Accept: application/json Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: Accept-Encoding: gzip, deflate Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: Connection: keep-alive Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: Content-Length: 0 Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: Host: 10.222.0.59 Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: Openstack-Api-Version: compute 2.90 Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: Openstack-System-Scope: None Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: User-Agent: python-novaclient Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Auth-Token: gAAAAABi131_q_Lm1lDrUeXcT5AilUnocBd6f6ZLgOzBFXR6SlBSXUvEyR3DCYvEfhZ0iiGOBkx28A_JyDyLz6AWflGKIuujk08uJweQImvv-fVlQlz991qxgv_2RHWoVnlz6jkzGPtaQ3WpHj1q8_1ZLvjUDbPwdXah0RpyZMJCIMtRkcP0ylA Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Domain-Id: None Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Domain-Name: None Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Identity-Status: Confirmed Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Is-Admin-Project: True Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Domain-Id: default Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Domain-Name: Default Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Name: admin Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Role: member,reader,admin Jul 20 03:58:56.414512 n-d-760456-11 devstack@n-api.service[104273]: X-Roles: member,reader,admin Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2409c916eee643309d23578a107904fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2409c916eee643309d23578a107904fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: X-Tenant: admin Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: X-Tenant-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: X-Tenant-Name: admin Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: X-User: admin Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: X-User-Domain-Id: default Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: X-User-Domain-Name: Default Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: X-User-Id: 29fc59062d314d4985c75b27c3b6c023 Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: X-User-Name: admin Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: method: > Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: exception: Flavor 42 could not be found. Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: action_args: {'id': '42'} Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 03:58:56.416090 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:56.417025 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:56.418061 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-950c20d8-6add-4d5f-8caa-98cf08bb1797 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 03:58:56.419087 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-950c20d8-6add-4d5f-8caa-98cf08bb1797 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014835 Jul 20 03:58:56.419087 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 03:58:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 03:58:57.381840 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-e51b0e11-1405-4f71-a2a5-e3af89868db4 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:57.382915 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-e51b0e11-1405-4f71-a2a5-e3af89868db4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 20 03:58:57.383310 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Jul 20 03:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:57.908466 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-3ac9ffab-d831-476c-943c-285e2dc18d3a admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:57.914237 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.wsgi [None req-3ac9ffab-d831-476c-943c-285e2dc18d3a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-3ac9ffab-d831-476c-943c-285e2dc18d3a admin admin] Request method failure captured: Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: Accept: application/json Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: Accept-Encoding: gzip, deflate Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: Connection: keep-alive Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: Content-Length: 0 Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: Host: 10.222.0.59 Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: Openstack-Api-Version: compute 2.90 Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: Openstack-System-Scope: None Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: User-Agent: python-novaclient Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Auth-Token: gAAAAABi132B5KgGodWOOgg5AmR0judO3Lg8GwqwYxrHZm2CZuZxnXEx7luiA-lYghqcJj-w6AehbtN-3kimbhdZI2iNyym-rk73IUxL29ZRYX1gJe_IxaeKJvZMYi-KM7ipmxqKGZXIBpakglyh6qT1jgbQdsPl79MkHHPFCxLjV9qLotjzZSw Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Domain-Id: None Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Domain-Name: None Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Identity-Status: Confirmed Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Is-Admin-Project: True Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Domain-Id: default Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Domain-Name: Default Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Name: admin Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Role: member,reader,admin Jul 20 03:58:57.915766 n-d-760456-11 devstack@n-api.service[104273]: X-Roles: member,reader,admin Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2409c916eee643309d23578a107904fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2409c916eee643309d23578a107904fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: X-Tenant: admin Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: X-Tenant-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: X-Tenant-Name: admin Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: X-User: admin Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: X-User-Domain-Id: default Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: X-User-Domain-Name: Default Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: X-User-Id: 29fc59062d314d4985c75b27c3b6c023 Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: X-User-Name: admin Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: method: > Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: exception: Flavor 84 could not be found. Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: action_args: {'id': '84'} Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 03:58:57.917281 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:57.918295 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:57.919694 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-3ac9ffab-d831-476c-943c-285e2dc18d3a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 03:58:57.920953 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-3ac9ffab-d831-476c-943c-285e2dc18d3a admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396214 Jul 20 03:58:57.920953 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 03:58:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 03:58:57.927657 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-25effe24-0509-4fb6-82d3-0afbb5fbe2ce admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:57.942014 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-25effe24-0509-4fb6-82d3-0afbb5fbe2ce admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018050 Jul 20 03:58:57.942637 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Jul 20 03:58:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 03:58:57.951994 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-38df6729-9587-4890-9110-e9bc0a4bae68 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:57.966005 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-38df6729-9587-4890-9110-e9bc0a4bae68 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017521 Jul 20 03:58:57.966560 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Jul 20 03:58:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 03:58:57.976333 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-12ca619b-93b0-401d-ac24-fcc7d49f5016 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:57.981707 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.wsgi [None req-12ca619b-93b0-401d-ac24-fcc7d49f5016 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-12ca619b-93b0-401d-ac24-fcc7d49f5016 admin admin] Request method failure captured: Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: Accept: application/json Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: Accept-Encoding: gzip, deflate Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: Connection: keep-alive Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: Content-Length: 0 Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: Host: 10.222.0.59 Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: Openstack-Api-Version: compute 2.90 Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: Openstack-System-Scope: None Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: User-Agent: python-novaclient Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Auth-Token: gAAAAABi132B5KgGodWOOgg5AmR0judO3Lg8GwqwYxrHZm2CZuZxnXEx7luiA-lYghqcJj-w6AehbtN-3kimbhdZI2iNyym-rk73IUxL29ZRYX1gJe_IxaeKJvZMYi-KM7ipmxqKGZXIBpakglyh6qT1jgbQdsPl79MkHHPFCxLjV9qLotjzZSw Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Domain-Id: None Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Domain-Name: None Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Identity-Status: Confirmed Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Is-Admin-Project: True Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Domain-Id: default Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Domain-Name: Default Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Name: admin Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Role: member,reader,admin Jul 20 03:58:57.983222 n-d-760456-11 devstack@n-api.service[104274]: X-Roles: member,reader,admin Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2409c916eee643309d23578a107904fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2409c916eee643309d23578a107904fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: X-Tenant: admin Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: X-Tenant-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: X-Tenant-Name: admin Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: X-User: admin Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: X-User-Domain-Id: default Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: X-User-Domain-Name: Default Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: X-User-Id: 29fc59062d314d4985c75b27c3b6c023 Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: X-User-Name: admin Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: method: > Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: exception: Flavor 84 could not be found. Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: action_args: {'id': '84'} Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 03:58:57.984631 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:57.985896 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:57.987191 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-12ca619b-93b0-401d-ac24-fcc7d49f5016 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 03:58:57.988423 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-12ca619b-93b0-401d-ac24-fcc7d49f5016 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011793 Jul 20 03:58:57.988423 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 03:58:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 03:58:58.982755 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-38df6729-9587-4890-9110-e9bc0a4bae68 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:58.983786 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-38df6729-9587-4890-9110-e9bc0a4bae68 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 20 03:58:58.984179 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Jul 20 03:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:58:59.503541 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-05bc8f31-1497-4545-9b0d-a53f0ed04c16 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:59.509179 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.wsgi [None req-05bc8f31-1497-4545-9b0d-a53f0ed04c16 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-05bc8f31-1497-4545-9b0d-a53f0ed04c16 admin admin] Request method failure captured: Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: Accept: application/json Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: Accept-Encoding: gzip, deflate Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: Connection: keep-alive Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: Content-Length: 0 Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: Host: 10.222.0.59 Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: Openstack-Api-Version: compute 2.90 Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: Openstack-System-Scope: None Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: User-Agent: python-novaclient Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Auth-Token: gAAAAABi132CCiNvZNaXvHFtew01len2UDmVi_ab71N7A7Ylk5rCbNKjHpp6zsMfe4nYsgzPaB4Ph6EEVUPXJbppQHCC2cTKIc9FeWyYBXzovfMEKzc9WT-18O0dzjgTLUSZ69yHMxFUH9eANwF6NpxYvMFAb8vihXga5KahLNnQJN1r-pMrL9E Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Domain-Id: None Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Domain-Name: None Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Identity-Status: Confirmed Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Is-Admin-Project: True Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Domain-Id: default Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Domain-Name: Default Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Project-Name: admin Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Role: member,reader,admin Jul 20 03:58:59.510705 n-d-760456-11 devstack@n-api.service[104274]: X-Roles: member,reader,admin Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2409c916eee643309d23578a107904fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2409c916eee643309d23578a107904fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: X-Tenant: admin Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: X-Tenant-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: X-Tenant-Name: admin Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: X-User: admin Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: X-User-Domain-Id: default Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: X-User-Domain-Name: Default Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: X-User-Id: 29fc59062d314d4985c75b27c3b6c023 Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: X-User-Name: admin Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: method: > Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: exception: Flavor 451 could not be found. Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: action_args: {'id': '451'} Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 03:58:59.512186 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:59.513503 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: ERROR nova.api.openstack.wsgi Jul 20 03:58:59.514913 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-05bc8f31-1497-4545-9b0d-a53f0ed04c16 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 03:58:59.516129 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-05bc8f31-1497-4545-9b0d-a53f0ed04c16 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389956 Jul 20 03:58:59.516129 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 03:58:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 03:58:59.522657 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-a996d6c6-6860-45fa-8709-20b53d90a5d9 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:59.536084 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-a996d6c6-6860-45fa-8709-20b53d90a5d9 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017218 Jul 20 03:58:59.536602 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Jul 20 03:58:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 03:58:59.546075 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:59.561591 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019066 Jul 20 03:58:59.562114 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Jul 20 03:58:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 03:58:59.571616 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-dce77000-1bc2-491e-b234-be0858d2143d admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:58:59.576829 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.wsgi [None req-dce77000-1bc2-491e-b234-be0858d2143d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-dce77000-1bc2-491e-b234-be0858d2143d admin admin] Request method failure captured: Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: Accept: application/json Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: Accept-Encoding: gzip, deflate Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: Connection: keep-alive Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: Content-Length: 0 Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: Host: 10.222.0.59 Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: Openstack-Api-Version: compute 2.90 Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: Openstack-System-Scope: None Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: User-Agent: python-novaclient Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Auth-Token: gAAAAABi132CCiNvZNaXvHFtew01len2UDmVi_ab71N7A7Ylk5rCbNKjHpp6zsMfe4nYsgzPaB4Ph6EEVUPXJbppQHCC2cTKIc9FeWyYBXzovfMEKzc9WT-18O0dzjgTLUSZ69yHMxFUH9eANwF6NpxYvMFAb8vihXga5KahLNnQJN1r-pMrL9E Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Domain-Id: None Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Domain-Name: None Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Identity-Status: Confirmed Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Is-Admin-Project: True Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Domain-Id: default Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Domain-Name: Default Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Project-Name: admin Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Role: member,reader,admin Jul 20 03:58:59.578332 n-d-760456-11 devstack@n-api.service[104273]: X-Roles: member,reader,admin Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2409c916eee643309d23578a107904fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2409c916eee643309d23578a107904fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2409c916eee643309d23578a107904fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: X-Tenant: admin Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: X-Tenant-Id: 2409c916eee643309d23578a107904fa Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: X-Tenant-Name: admin Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: X-User: admin Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: X-User-Domain-Id: default Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: X-User-Domain-Name: Default Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: X-User-Id: 29fc59062d314d4985c75b27c3b6c023 Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: X-User-Name: admin Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: method: > Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: exception: Flavor 451 could not be found. Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: action_args: {'id': '451'} Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 03:58:59.580561 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:59.581608 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: ERROR nova.api.openstack.wsgi Jul 20 03:58:59.582938 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-dce77000-1bc2-491e-b234-be0858d2143d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 03:58:59.584259 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-dce77000-1bc2-491e-b234-be0858d2143d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011920 Jul 20 03:58:59.584259 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 03:58:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 03:59:00.552885 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:00.553885 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 20 03:59:00.554292 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Jul 20 03:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:01.085635 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-468e9d5d-a20a-45c2-9ca3-35a1d38889de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:01.104474 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-468e9d5d-a20a-45c2-9ca3-35a1d38889de admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.409407 Jul 20 03:59:01.105009 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Jul 20 03:59:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:59:02.072899 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:02.073903 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 20 03:59:02.074321 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Jul 20 03:59:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:02.603810 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-20c37036-da14-4c12-add1-76ef3e58788a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:02.621545 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-20c37036-da14-4c12-add1-76ef3e58788a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408169 Jul 20 03:59:02.622094 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Jul 20 03:59:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:59:03.591749 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:03.592743 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 20 03:59:03.593128 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Jul 20 03:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:04.115439 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-b6a16e12-c435-47c1-8b77-bf311bdcbe78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:04.133227 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-b6a16e12-c435-47c1-8b77-bf311bdcbe78 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.405233 Jul 20 03:59:04.133818 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Jul 20 03:59:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:59:05.110269 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:05.111876 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jul 20 03:59:05.112268 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Jul 20 03:59:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:05.643211 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-aa25e7c6-1c9d-4270-a96c-6e85eb2a7583 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 03:59:05.667290 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-aa25e7c6-1c9d-4270-a96c-6e85eb2a7583 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.416958 Jul 20 03:59:05.668095 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Jul 20 03:59:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 03:59:06.636433 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:06.637426 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 20 03:59:06.637819 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Jul 20 03:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:07.168376 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-743544e3-36e2-4a73-8205-363e0daa8534 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:07.187817 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-743544e3-36e2-4a73-8205-363e0daa8534 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.413243 Jul 20 03:59:07.188290 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Wed Jul 20 03:59:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 03:59:59.653177 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 03:59:59.654224 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-8ee93830-9235-426c-89ad-c0d002f46be1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 20 03:59:59.654658 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 930 bytes} [Wed Jul 20 03:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 03:59:59.666098 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:00.047841 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-8b32dffd-b436-4630-99fa-aad27d4c4c8d admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:00.067364 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-8b32dffd-b436-4630-99fa-aad27d4c4c8d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406471 Jul 20 04:00:00.068719 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1291 bytes} [Wed Jul 20 03:59:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:00:00.089252 n-d-760456-11 devstack@n-api.service[104274]: DEBUG dbcounter [-] [104274] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=104274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:00:00.093310 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-07241982-0b94-4e41-bb17-40613edeea6d admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:00.101682 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-07241982-0b94-4e41-bb17-40613edeea6d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013791 Jul 20 04:00:00.102220 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1282 bytes} [Wed Jul 20 04:00:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:00:00.113950 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-a87aa323-a6db-4e7c-acdb-03805cae4f33 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:00.122082 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-a87aa323-a6db-4e7c-acdb-03805cae4f33 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011734 Jul 20 04:00:00.122793 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1285 bytes} [Wed Jul 20 04:00:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:00:00.135458 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-79edbf79-1e98-4616-b3ca-c48216b78130 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:00.144653 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-79edbf79-1e98-4616-b3ca-c48216b78130 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013087 Jul 20 04:00:00.145189 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1285 bytes} [Wed Jul 20 04:00:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:00:00.156843 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-7c2cef3e-8112-4e34-aa83-3030629f9c15 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:00:00.164640 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-7c2cef3e-8112-4e34-aa83-3030629f9c15 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011495 Jul 20 04:00:00.165150 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1282 bytes} [Wed Jul 20 04:00:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:05:20.000210 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-79edbf79-1e98-4616-b3ca-c48216b78130 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:20.001225 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-79edbf79-1e98-4616-b3ca-c48216b78130 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 20 04:05:20.001621 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Jul 20 04:05:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:20.143463 n-d-760456-11 devstack@n-api.service[104273]: DEBUG dbcounter [-] [104273] Writing DB stats nova_api:SELECT=6 {{(pid=104273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:05:20.288662 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-de36593f-8682-42dd-9826-977abd820bc2 admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:20.289897 n-d-760456-11 devstack@n-api.service[104273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:05:20.289897 n-d-760456-11 devstack@n-api.service[104273]: warnings.warn(msg) Jul 20 04:05:20.291135 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-de36593f-8682-42dd-9826-977abd820bc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:05:20.291581 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-de36593f-8682-42dd-9826-977abd820bc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:05:20.292395 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-de36593f-8682-42dd-9826-977abd820bc2 admin admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:05:20.292827 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-de36593f-8682-42dd-9826-977abd820bc2 admin admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:05:20.334033 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-de36593f-8682-42dd-9826-977abd820bc2 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.191952 Jul 20 04:05:20.334632 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:05:20 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:05:21.185989 n-d-760456-11 devstack@n-api.service[104274]: DEBUG nova.api.openstack.wsgi [None req-79edbf79-1e98-4616-b3ca-c48216b78130 admin admin] Calling method '>' {{(pid=104274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:21.187018 n-d-760456-11 devstack@n-api.service[104274]: INFO nova.api.openstack.requestlog [None req-79edbf79-1e98-4616-b3ca-c48216b78130 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 20 04:05:21.187409 n-d-760456-11 devstack@n-api.service[104274]: [pid: 104274|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Jul 20 04:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:21.377320 n-d-760456-11 devstack@n-api.service[104273]: DEBUG nova.api.openstack.wsgi [None req-a8b438f1-65d9-4d48-b074-42db99e8ecbc admin admin] Calling method '>' {{(pid=104273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:21.378458 n-d-760456-11 devstack@n-api.service[104273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:05:21.378458 n-d-760456-11 devstack@n-api.service[104273]: warnings.warn(msg) Jul 20 04:05:21.380241 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-a8b438f1-65d9-4d48-b074-42db99e8ecbc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:05:21.380976 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-a8b438f1-65d9-4d48-b074-42db99e8ecbc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:05:21.381749 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-a8b438f1-65d9-4d48-b074-42db99e8ecbc admin admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:05:21.382174 n-d-760456-11 devstack@n-api.service[104273]: DEBUG oslo_concurrency.lockutils [None req-a8b438f1-65d9-4d48-b074-42db99e8ecbc admin admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:05:21.404719 n-d-760456-11 devstack@n-api.service[104273]: INFO nova.api.openstack.requestlog [None req-a8b438f1-65d9-4d48-b074-42db99e8ecbc admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.078263 Jul 20 04:05:21.405268 n-d-760456-11 devstack@n-api.service[104273]: [pid: 104273|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:05:21 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:06:06.015993 n-d-760456-11 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 04:06:06.016539 n-d-760456-11 devstack@n-api.service[104272]: Wed Jul 20 04:06:06 2022 - graceful shutdown triggered... Jul 20 04:06:06.017016 n-d-760456-11 devstack@n-api.service[104273]: Gracefully killing worker 1 (pid: 104273)... Jul 20 04:06:06.017688 n-d-760456-11 devstack@n-api.service[104274]: Gracefully killing worker 2 (pid: 104274)... Jul 20 04:06:07.017672 n-d-760456-11 devstack@n-api.service[104272]: worker 1 buried after 1 seconds Jul 20 04:06:07.018202 n-d-760456-11 devstack@n-api.service[104272]: worker 2 buried after 1 seconds Jul 20 04:06:07.018202 n-d-760456-11 devstack@n-api.service[104272]: goodbye to uWSGI. Jul 20 04:06:07.019365 n-d-760456-11 systemd[1]: devstack@n-api.service: Succeeded. Jul 20 04:06:07.019936 n-d-760456-11 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 04:06:07.022677 n-d-760456-11 systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 04:06:07.040645 n-d-760456-11 devstack@n-api.service[119594]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 04:06:07.058333 n-d-760456-11 devstack@n-api.service[119594]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 04:06:07 2022] *** Jul 20 04:06:07.058333 n-d-760456-11 devstack@n-api.service[119594]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 04:06:07.058333 n-d-760456-11 devstack@n-api.service[119594]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 04:06:07.058333 n-d-760456-11 devstack@n-api.service[119594]: nodename: n-d-760456-11 Jul 20 04:06:07.058333 n-d-760456-11 devstack@n-api.service[119594]: machine: x86_64 Jul 20 04:06:07.058333 n-d-760456-11 devstack@n-api.service[119594]: clock source: unix Jul 20 04:06:07.058333 n-d-760456-11 devstack@n-api.service[119594]: pcre jit disabled Jul 20 04:06:07.058333 n-d-760456-11 devstack@n-api.service[119594]: detected number of CPU cores: 4 Jul 20 04:06:07.058333 n-d-760456-11 devstack@n-api.service[119594]: current working directory: / Jul 20 04:06:07.058333 n-d-760456-11 devstack@n-api.service[119594]: detected binary path: /usr/bin/uwsgi-core Jul 20 04:06:07.059108 n-d-760456-11 devstack@n-api.service[119594]: your processes number limit is 47680 Jul 20 04:06:07.059108 n-d-760456-11 devstack@n-api.service[119594]: your memory page size is 4096 bytes Jul 20 04:06:07.059108 n-d-760456-11 devstack@n-api.service[119594]: detected max file descriptor number: 2048 Jul 20 04:06:07.059108 n-d-760456-11 devstack@n-api.service[119594]: lock engine: pthread robust mutexes Jul 20 04:06:07.059108 n-d-760456-11 devstack@n-api.service[119594]: thunder lock: enabled Jul 20 04:06:07.059108 n-d-760456-11 devstack@n-api.service[119594]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 04:06:07.059108 n-d-760456-11 devstack@n-api.service[119594]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 04:06:07.104116 n-d-760456-11 devstack@n-api.service[119594]: Python main interpreter initialized at 0x565238fb19c0 Jul 20 04:06:07.104116 n-d-760456-11 devstack@n-api.service[119594]: python threads support enabled Jul 20 04:06:07.104116 n-d-760456-11 devstack@n-api.service[119594]: your server socket listen backlog is limited to 100 connections Jul 20 04:06:07.104116 n-d-760456-11 devstack@n-api.service[119594]: your mercy for graceful operations on workers is 90 seconds Jul 20 04:06:07.104573 n-d-760456-11 devstack@n-api.service[119594]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 04:06:07.104573 n-d-760456-11 devstack@n-api.service[119594]: *** Operational MODE: preforking *** Jul 20 04:06:07.104918 n-d-760456-11 devstack@n-api.service[119594]: *** uWSGI is running in multiple interpreter mode *** Jul 20 04:06:07.104918 n-d-760456-11 devstack@n-api.service[119594]: spawned uWSGI master process (pid: 119594) Jul 20 04:06:07.105067 n-d-760456-11 systemd[1]: Started Devstack devstack@n-api.service. Jul 20 04:06:07.106241 n-d-760456-11 devstack@n-api.service[119594]: spawned uWSGI worker 1 (pid: 119605, cores: 1) Jul 20 04:06:07.106241 n-d-760456-11 devstack@n-api.service[119594]: spawned uWSGI worker 2 (pid: 119606, cores: 1) Jul 20 04:06:07.106241 n-d-760456-11 devstack@n-api.service[119594]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 04:06:07.775019 n-d-760456-11 devstack@n-api.service[119605]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 04:06:07.778619 n-d-760456-11 devstack@n-api.service[119606]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 04:06:08.992995 n-d-760456-11 devstack@n-api.service[119606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:06:08.992995 n-d-760456-11 devstack@n-api.service[119606]: from cryptography.utils import int_from_bytes Jul 20 04:06:08.993746 n-d-760456-11 devstack@n-api.service[119606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:06:08.993746 n-d-760456-11 devstack@n-api.service[119606]: from cryptography.utils import int_from_bytes Jul 20 04:06:09.000827 n-d-760456-11 devstack@n-api.service[119605]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:06:09.000827 n-d-760456-11 devstack@n-api.service[119605]: from cryptography.utils import int_from_bytes Jul 20 04:06:09.001326 n-d-760456-11 devstack@n-api.service[119605]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:06:09.001326 n-d-760456-11 devstack@n-api.service[119605]: from cryptography.utils import int_from_bytes Jul 20 04:06:11.299795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 04:06:11.300409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 04:06:11.300573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 04:06:11.300938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 04:06:11.301200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 04:06:11.301597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.301924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.302274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.302606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.302937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.303251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.303575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.303895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.304225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.304484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.304802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.305125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-760456-11 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.305448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.305757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.306068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.306418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.306726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.307048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.307352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.307849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.308303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.308614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.308977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.309258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.309587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.309884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.310289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.311206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.311540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.311851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.312250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-760456-11 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.312570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.312896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.313200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.313610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.313923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.314235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.314577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.314902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.315212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.315540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.315862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.316181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.316501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.316804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.317113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.317422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.317740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.318046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.318374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.318627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.318933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.319253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.319573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.319897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.320146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.320397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.320714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.321032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.321342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.321658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.321963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.322291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.322604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.322913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.323241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.323526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.323846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.324162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.324485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.324794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.325113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.325509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.325760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.326681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.327023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.327345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.327657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.327975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.328296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.328606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.328915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.329221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.329542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.329881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.330188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.330462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.330767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.331074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.331411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.331713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.332021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.332328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.332631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.332940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.333247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.333554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.333862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.334167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.334500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.334808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.335115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.335421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.335740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.336060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.336367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.336672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.336978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.337284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.337605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.337912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.338218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.338632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.338939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.339244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.339563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.339872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.340183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.340500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.340802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.341109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.341430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.342444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.342762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.343070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.343374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.343697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.343988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.344295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.344600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.344903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.345224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.345535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.345844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.346151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.346483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.346807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.347145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.347480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.347825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.348144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.348479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.348814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.349138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.349455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.349772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.350099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.350443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.350756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.351072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.351394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.351720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.352051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.352375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.352695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.353015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.353335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.353654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.353983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.354339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.354657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.355002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.355346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.355662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.355990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.356313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.356627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.356942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.357335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.357663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.358006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.358346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.358672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.358992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.359308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.359623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.359941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.360259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.360598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.360916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.361236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.361561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.361880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.362195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.362535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.362846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.363200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.363466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.363772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.364086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.364393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.364715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.365045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.365356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.365687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.365995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.366329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.366644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.366956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.367265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.367578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.367891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.368198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.368520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.368831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.369137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.369461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.369767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.370073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.370413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.370727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.371040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.371353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.371676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.371998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.372312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.372629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.373095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.373666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.373986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.374343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.374679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.375003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.375308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.375631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.375940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.376251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.376559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.376873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.377180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.377487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.377794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.378101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.378433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.378760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.379040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 04:06:11.379473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.379590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 04:06:11.379679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.379679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.379851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 04:06:11.379951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.380181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 04:06:11.380374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.380537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 04:06:11.380654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.381070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.381241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.381407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.381581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.381731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.381898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.382055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.382216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.382401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.382498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.382724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.382911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.383064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.383217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.383359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.383518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.383677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.383783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.383929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.384050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.384250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.384363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.384564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.384669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-760456-11 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.384885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.384985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.385197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.385296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.385507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.385612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.385823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.385928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.386129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.386231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.386465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.386572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.386775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.386882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.387114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.387282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.387447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.387598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.387766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.387909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.388088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.388211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.388928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.389246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.389495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.389600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.389824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.389926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.390150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.390282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.390485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.390579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.390804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.390911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.391201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.391308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.391433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.391541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.391744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.391850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-760456-11 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.392071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.392173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.392382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.392484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.392700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.392943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.393044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.393131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.393306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.393450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.393638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.393784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.393972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.394167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.394348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.394460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.394606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.394722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.394928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.395024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.395242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.395393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.395554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.395659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.395867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.395962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.396175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.396268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.396479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.396574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.396788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.396882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.397104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.397206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.397412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.397521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.397723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.397826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.397991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.398117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.398326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.398438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.398650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.398752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.398954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.399103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.399258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.399410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.399553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.399644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.399769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.399907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.400105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.400231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.400413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.400534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.400724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.400856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.401036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.401138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.401367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.401480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.401651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.401748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.401960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.402077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.402360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.402489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.402589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.402676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.402888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.403032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.403207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.403308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.403526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.403627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.403832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.404095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.404724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.404837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.405066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.405524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.405645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.405853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.405973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.406166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.406294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.406503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.406610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.406829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.406924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.407149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.407245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.407464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.407565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.407775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.407879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.408088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.408192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.408398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.408489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.408733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.408837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.409017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.409118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.409333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.409434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.409646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.409758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.409958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.410064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.410212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.410347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.410547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.410657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.410858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.410953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.411183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.411464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.411580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.411788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.411884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.412097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.412199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.412401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.412506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.412714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.412809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.413025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.413167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.413336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.413445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.413648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.413750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.413958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.414096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.414281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.414393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.414595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.414703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.414908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.415020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.415215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.415316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.415532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.415670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.415844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.416009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.416188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.416338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.416443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.416543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.416743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.416866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.417044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.417151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.417348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.417450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.417652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.417753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.417958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.418065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.418290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.418400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.418597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.418700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.418905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.419079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.419209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.419310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.419527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.419724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.419969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.420283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.420385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.420591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.420691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.420897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.421001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.421242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.421343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.421561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.421676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.421861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.421963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.422174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.422299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.422509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.422611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.422822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.422926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.423136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.423299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.423446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.423550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.423754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.423850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.424058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.424197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.424362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.424463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.424674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.424768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.424984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.425137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.425293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.425463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.425638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.425796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.425948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.426098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.426279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.426447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:06:11.426556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.426645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.426797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.426901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.427100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.427207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.427404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.427508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.427720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.427846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.428029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.428183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.428334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.428511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.428637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.428831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.428934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.429154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.429261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.429484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.429586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.429800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.429902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.430118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.430212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.430457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.430561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.430763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.430865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.431069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.431183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.431373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.431475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.431686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.431873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.432025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.432171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.432318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.432471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.432628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.432813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.432902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.432987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.433199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.433306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.433563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.433728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.433883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.434037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.434213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.434356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.434456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.434579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.434732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.434900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.435060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.435261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.435444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.435694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.436036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.436130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.436367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.436469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.436690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.436792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.437009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.437109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.437318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.437399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.437624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.437719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.437929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.438023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.438233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.438362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.438560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.438664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.438865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.438961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.439188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.439292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.439498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.439599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.439805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.439902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.440111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.440213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.440414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.440509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.440758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.440852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.441063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.441164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.441419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.441512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.441794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.441913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.442021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.442117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.442372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.442469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.442687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.442856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.443030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.443185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.443344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.443487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.443639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.443808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.443964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.444111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.444265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.444423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.444576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.444729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.444886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.445030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.445181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.445323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.445468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.445631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.445790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.445937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.446093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.446236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.446437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.446605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.446698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.446790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.446939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.447101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.447243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.447400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.447564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.447717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.447861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.448007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.448160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.448396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.448549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.448694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.448845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.448994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.449154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.449313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.449458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.449613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.449758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.449901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.450046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.450187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.450356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.450454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.450570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.450664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.451414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.451532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.451836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.452125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.452239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.452450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.452560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.452772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.452951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.453108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.453256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.453409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.453562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.453704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.453845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.453991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.454154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.454338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.454433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.454706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.454813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.455021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.455123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.455335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.455433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.455644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.455744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.455954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.456048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.456262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.456355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.456577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.456672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.456886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.456989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.457190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.457295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.457497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.457610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.457805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.457917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.458113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.458207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.458467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.458571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.458783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.458887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.459093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.459196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.459402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.459496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.459713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.459817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.460054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.460246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.460405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.460558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.460715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.460810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.460961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.461055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.461267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.461362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.461589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.461691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.461945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.462083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.462301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.462464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.462626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.462783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.462909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.463097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.463252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.463397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.463555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.463715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.463873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.464020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.464175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.464347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.464494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.464650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.464799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.464946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.465095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.465249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.465400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.465541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.465687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.465841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.465985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.466139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.466309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.466403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.467380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.467650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.467804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.468003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.468099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.468326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.468419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.468642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.468745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.468966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.469067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.469291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.469393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.469610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.469713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.469929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.470031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.470281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.470389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.470586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.470694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.470913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.471021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.471232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.471335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.471542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.471645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.471852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.471954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.472165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.472279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.472479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.472573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.472789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.472881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.473098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.473192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.473407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.473500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.473714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.473816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.474019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.474113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.474345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.474448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.474668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.474812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.474973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.475067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.475296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.475392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.475612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.475715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.475930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.476038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.476244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.476339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.476547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.476641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.476859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.476966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.477166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.477267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.477471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.477566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.477776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.477923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.478080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.478176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.478421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.478531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.478740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.478906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.479051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.479146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.479363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.480001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.480122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.480212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.480321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.480403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.480477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.480623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.481128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.481451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.481551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.481551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.481773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.481866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.482288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.482506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.482810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.483141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.483247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.483452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.483567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.483764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.483869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.484099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.484203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.484384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.484511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.484690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.484804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.485014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.485107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.485296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.485400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.485600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.485703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.485905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.486007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.486211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.486328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.486573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.486677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.486879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.486980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.487203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.487309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.487518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.487680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.487823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.487938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.488131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.488290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.488436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.488539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.488749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.488857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.489069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.489162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.489384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.489475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.489700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.489878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.490017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.490175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.490347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.490445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.490677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.490833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.490989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.491083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.491305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.491562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.491670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.491904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.491999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.492228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.492344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.492543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.492658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.492855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.492951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.493169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.493263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.493479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.493583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.493799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.493903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.494115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.494289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.494456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.494565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.494844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.494992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.495145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.495321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.495416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.495638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.495759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.495952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.496068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.496266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.496361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.496574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.496667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.496884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.496986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.497190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.497293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.497500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.497593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.497812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.497922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.498133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.498488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.498698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.498807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.499028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.499188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.499344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.499446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.499665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.499759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.499979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.500075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.500311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.500418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.500630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.500725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.500948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.501071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.501258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.501399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.501569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.501677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.501891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.501984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.502208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.502344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.502577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.502762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.502940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.503093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.503240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.503385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.503544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.503692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.503849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.503992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.504152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.504317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.504476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.504633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.504790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.504934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.505106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.505247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.505354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.505450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.505630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.505985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.506200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.506330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.506540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.506645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.506856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.506952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.507172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.507267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.507483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.507690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.507793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.508005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.508117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.508487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.508613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.508712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.508807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.508964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.509061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.509281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.509374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.509586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.509688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.509901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.510005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.510205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.510331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.510536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.510640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.510848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.510962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.511159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.511268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.511466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.511635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.511805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.511966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.512121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.512268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.512420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.512575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.512745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.512907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.513077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.513229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.513905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.514051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.514406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.514626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.514739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.514958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.515099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.515279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.515376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.515595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.515700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.515916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.516018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.516229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.516333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.516542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.516645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.516858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.516964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.517181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.517276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.517496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.517592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.517803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.517911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.518110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.518206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.518604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.518712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.518803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.518898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.519038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.519143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.519347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.519443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.519655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.519758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.519961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.520062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.520271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.520367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.520576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.520670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.520882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.521004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.521200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.521377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.521546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.521702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.521869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.522015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.522169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.522373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.522483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.522573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.522705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.522802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.523009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.523110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.523322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.523429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.523627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.523729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.523939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.524047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.524248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.524343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.524578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.524722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.524915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.525018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.525235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.525355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.525538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.525634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.525842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.525943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.526157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.526876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.526876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.527083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.527083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.527252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.527341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.527428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.527428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.527600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.527700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.527795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.528006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.528118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.528335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.528561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.528749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.528906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.529700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.529909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.530350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.530465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.530696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.530806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.531009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.531103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.531322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.531484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.531648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.531791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.531948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.532102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.532247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.532400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.532544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.532708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.532860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.533023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.533177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.533347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.533491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.533638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.533790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.533941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.534094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.534264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.534416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.534563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.534727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.534870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.535023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.535183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.535412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.535589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.535742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.535896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.536051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.536206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.536359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.536504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.536659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.536812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.536988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.537141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.537288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.537433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.537580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.537724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.537883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.538029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.538182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.538378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.538521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.538623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.538773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.538869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.538965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.539158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.539262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.539479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.539575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.539791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.539895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.540117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.540219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.540517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.540612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.540833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.540928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.541151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.541246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.541467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.541564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.541775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.541878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.542089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.542196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.542436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.542533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.542747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.542840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.543066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.543174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.543374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.543467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.543700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.543794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.544014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.544118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.544340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.544436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.544764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.545217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.545331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.545543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.545660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.545850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.545949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.546162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.546293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.546510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.546605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.546822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.546918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.547128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.547237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.547433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.547534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.547743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.547838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.548048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.548151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.548355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.548449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.548660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.548774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.548965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.549072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.549274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.549368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.549575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.549671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.549879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.549974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.550181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.550339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.550513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.550631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.550816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.550961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.551118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.551283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.551427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.551616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.551724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.552023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.552116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.552325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.552425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.552627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.552724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.552928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.553024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.553265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.553383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.553575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.553703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.553886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.553992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.554204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.554321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.554543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.554640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.554859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.554955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.555166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.555263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.555486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.555610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.555806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.555913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.556116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.556221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.556425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.556520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.556733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.556835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.557043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.557152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.557352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.557455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.557663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.557759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.557977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.558091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.558305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.558419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.558617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.558750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.558945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.559097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.559257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.559352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.559561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.559662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.559884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.559978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.560213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.560321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.560608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.560987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.561098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.561308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.561411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.561659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.561753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.561972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.562078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.562309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.562406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.562624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.562721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.562935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.563046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.563250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.563354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.563564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.563666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.563872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.563968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.564182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.564278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.564497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.564606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.564814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.564910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.565142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.565250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.565452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.565561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.565758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.565879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.566070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.566175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.566419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.566538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.566736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.566844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.567051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.567154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.567360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.567469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.567670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.567765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.567980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.568081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.568307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.568411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.568617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.568713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.568882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 04:06:11.568979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.569245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.569554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.569865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.570175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.570551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.570861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.571202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.571534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.571862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.572196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.572514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.572843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.573168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.573488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.573809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.574127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.574482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.574805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.575124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.575441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.575760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.576612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.577585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.578186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.578553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.578879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.579204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.579527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.579850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.580170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.580489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.580805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.581123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.581441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.581781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.582114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.582478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.582826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.583155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.583477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.583798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.584118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.584488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.584809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.585122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.585449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.585773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.586094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.586439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.586763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.587084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.587404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.587723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.588040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.588360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.588679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.589015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.589364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.589689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.590007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.590360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.590684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.591269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.592252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.593209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.593549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.593889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.594222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.594579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.594919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.595236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.595557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.595882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.596198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.596510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.596844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.597159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.597469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.597797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.598130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.598733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.599102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.599433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.599770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.600106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.600433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.600747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.601086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.601403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.601716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.602041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.602386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.602706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.603019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.603340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.603657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.603967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.604286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.604597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.604931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.605243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.605557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.605867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.606184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.606520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.607298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.607298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.608185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.608531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.608852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.609178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.609497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.609824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.610143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.610491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.610859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.611203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.611520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.611834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.612164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.612482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.612821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.613143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.613511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.613822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.614148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.614773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.615117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.635595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.635595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.635595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.635595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.635595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.635595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.635595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.635595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.639841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.639841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.639841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.639841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.639841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.639841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.639841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.639841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.640534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.640534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.640534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.640534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.640534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.640534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.640534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.640534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.649146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.649146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.649146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.649146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.649146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.649146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.649146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.649146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.650474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.650474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.650474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.650474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.650474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.650474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.650474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.650474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.651890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.651890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.651890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.651890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.651890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.651890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.651890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.651890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.652372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.652372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.652372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.652372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.652372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.652372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.652372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.652372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.653525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.653525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.653525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.653525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.653525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.653525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.653525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.653525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.655654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.656687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.657726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.658030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.658450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.658778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.659106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.659442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.659779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.660098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.660433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.660907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.661126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.661451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.661806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.662143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.662491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.662812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.663125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:06:11.663394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 04:06:11.726683 n-d-760456-11 devstack@n-api.service[119606]: INFO dbcounter [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Registered counter for database nova_api Jul 20 04:06:11.747515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_db.sqlalchemy.engines [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:06:11.755927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writer thread running {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:06:11.814805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.context [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) {{(pid=119606) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 04:06:11.819695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:06:11.821370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:06:11.821476 n-d-760456-11 devstack@n-api.service[119605]: INFO dbcounter [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Registered counter for database nova_api Jul 20 04:06:11.822172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:06:11.824242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:06:11.827217 n-d-760456-11 devstack@n-api.service[119606]: INFO dbcounter [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Registered counter for database nova_cell0 Jul 20 04:06:11.831441 n-d-760456-11 devstack@n-api.service[119606]: INFO dbcounter [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Registered counter for database nova_cell1 Jul 20 04:06:11.839080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_db.sqlalchemy.engines [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:06:11.840397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_db.sqlalchemy.engines [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:06:11.846958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_db.sqlalchemy.engines [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:06:11.848097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writer thread running {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:06:11.849403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writer thread running {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:06:11.853963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writer thread running {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:06:11.913486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.context [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) {{(pid=119605) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 04:06:11.917735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:06:11.919381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:06:11.920467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:06:11.922514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:06:11.924545 n-d-760456-11 devstack@n-api.service[119605]: INFO dbcounter [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Registered counter for database nova_cell0 Jul 20 04:06:11.928750 n-d-760456-11 devstack@n-api.service[119605]: INFO dbcounter [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Registered counter for database nova_cell1 Jul 20 04:06:11.936880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_db.sqlalchemy.engines [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:06:11.939343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_db.sqlalchemy.engines [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:06:11.946498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writer thread running {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:06:11.947816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writer thread running {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:06:12.004649 n-d-760456-11 devstack@n-api.service[119606]: INFO dbcounter [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Registered counter for database nova_cell0 Jul 20 04:06:12.011556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_db.sqlalchemy.engines [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:06:12.017207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writer thread running {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:06:12.100786 n-d-760456-11 devstack@n-api.service[119605]: INFO dbcounter [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Registered counter for database nova_cell0 Jul 20 04:06:12.112090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_db.sqlalchemy.engines [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:06:12.116719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writer thread running {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:06:12.346825 n-d-760456-11 devstack@n-api.service[119606]: WARNING keystonemiddleware.auth_token [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:06:12.354586 n-d-760456-11 devstack@n-api.service[119606]: WARNING keystonemiddleware.auth_token [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:06:12.449741 n-d-760456-11 devstack@n-api.service[119605]: WARNING keystonemiddleware.auth_token [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:06:12.457319 n-d-760456-11 devstack@n-api.service[119605]: WARNING keystonemiddleware.auth_token [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:06:12.697621 n-d-760456-11 devstack@n-api.service[119606]: WARNING keystonemiddleware.auth_token [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:06:12.704075 n-d-760456-11 devstack@n-api.service[119606]: WARNING keystonemiddleware.auth_token [None req-6461fdeb-f3aa-4a40-92ba-6baed361d9ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:06:12.710510 n-d-760456-11 devstack@n-api.service[119606]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565238fb19c0 pid: 119606 (default app) Jul 20 04:06:12.800884 n-d-760456-11 devstack@n-api.service[119605]: WARNING keystonemiddleware.auth_token [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:06:12.807368 n-d-760456-11 devstack@n-api.service[119605]: WARNING keystonemiddleware.auth_token [None req-22327d4d-b912-46b5-9705-068e5df4f2f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:06:12.814091 n-d-760456-11 devstack@n-api.service[119605]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565238fb19c0 pid: 119605 (default app) Jul 20 04:06:58.206950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:06:58.208158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:06:58.209050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:06:58.209871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:06:59.273284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:06:59.275015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:06:59.275966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:06:59.276932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:06:59.621307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-252bdade-fe0f-4e3a-83d2-c825ad75f44e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '.version_select at 0x7fb848d5bca0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:59.622826 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:06:59.622826 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:06:59.639260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-252bdade-fe0f-4e3a-83d2-c825ad75f44e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) {{(pid=119606) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 20 04:06:59.640982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-252bdade-fe0f-4e3a-83d2-c825ad75f44e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:06:59.641433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-252bdade-fe0f-4e3a-83d2-c825ad75f44e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:06:59.673381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-252bdade-fe0f-4e3a-83d2-c825ad75f44e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:06:59.673922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-252bdade-fe0f-4e3a-83d2-c825ad75f44e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:06:59.688132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-252bdade-fe0f-4e3a-83d2-c825ad75f44e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:06:59.688640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-252bdade-fe0f-4e3a-83d2-c825ad75f44e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:06:59.695586 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-252bdade-fe0f-4e3a-83d2-c825ad75f44e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.500062 Jul 20 04:06:59.696168 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1/1] 10.222.0.59 () {58 vars in 1166 bytes} [Wed Jul 20 04:06:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:00.045915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Calling method '.version_select at 0x7fb848e93d30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:00.047690 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.047690 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:00.049132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.049584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.066447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.066896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.104715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.105173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.117404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.118002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.135533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.136123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.143331 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9a000cc-d756-4769-9715-62a558027f5c tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1575 microversion: 2.53 time: 0.446140 Jul 20 04:07:00.144044 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2/2] 10.222.0.59 () {60 vars in 1242 bytes} [Wed Jul 20 04:06:59 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1575 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:07:00.268465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dcf15f13-7994-46d7-aee4-181252dd2a88 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-697270817", "id": 1674928640, "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:00.287109 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.287109 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:00.316880 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dcf15f13-7994-46d7-aee4-181252dd2a88 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.171666 Jul 20 04:07:00.317462 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3/3] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:00 2022] POST /compute/v2.1/flavors => generated 429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:00.337448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a502854-8163-4846-82c4-bda2ff4bae0b tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Calling method '.version_select at 0x7fb848d5dc10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:00.339717 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.339717 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:00.347000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0a502854-8163-4846-82c4-bda2ff4bae0b tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) {{(pid=119605) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 20 04:07:00.347818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a502854-8163-4846-82c4-bda2ff4bae0b tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.348262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a502854-8163-4846-82c4-bda2ff4bae0b tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.375755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a502854-8163-4846-82c4-bda2ff4bae0b tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.376202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a502854-8163-4846-82c4-bda2ff4bae0b tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.391436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a502854-8163-4846-82c4-bda2ff4bae0b tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.392088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a502854-8163-4846-82c4-bda2ff4bae0b tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.399463 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a502854-8163-4846-82c4-bda2ff4bae0b tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.131691 Jul 20 04:07:00.400048 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1/4] 10.222.0.59 () {60 vars in 1207 bytes} [Wed Jul 20 04:06:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:07:00.405444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f077b41-ee67-4035-8515-5da5c3aad0a3 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1358120432", "name": "tempest-test_aggregate-1987186894"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:00.442653 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.442653 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:00.443740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-3f077b41-ee67-4035-8515-5da5c3aad0a3 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Generated uuid 269e792b-5060-434e-94a8-d333dd04852d for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:00.521083 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f077b41-ee67-4035-8515-5da5c3aad0a3 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.119901 Jul 20 04:07:00.528099 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2/5] 10.222.0.59 () {60 vars in 1164 bytes} [Wed Jul 20 04:07:00 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:00.594349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c45f8e8b-0d97-49b6-aa6e-169a0deb59c1 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:00.595595 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.595595 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:00.596811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c45f8e8b-0d97-49b6-aa6e-169a0deb59c1 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.597260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c45f8e8b-0d97-49b6-aa6e-169a0deb59c1 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.598047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c45f8e8b-0d97-49b6-aa6e-169a0deb59c1 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.598708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c45f8e8b-0d97-49b6-aa6e-169a0deb59c1 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.641281 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c45f8e8b-0d97-49b6-aa6e-169a0deb59c1 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.322565 Jul 20 04:07:00.641888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f39fe599-f147-435c-b90f-6156487f277d tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-547276328", "id": 214428280, "os-flavor-access:is_public": "False"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:00.642430 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 4/6] 10.222.0.59 () {58 vars in 1175 bytes} [Wed Jul 20 04:07:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:00.643282 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.643282 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:00.676667 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f39fe599-f147-435c-b90f-6156487f277d tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.147412 Jul 20 04:07:00.677241 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3/7] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:00 2022] POST /compute/v2.1/flavors => generated 427 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:00.682018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Calling method '.version_select at 0x7fb848c26c10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:00.683443 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.683443 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:00.685840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.686315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.700931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.701382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.744352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.744832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.758674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.758803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d3401f5-efdd-44c1-9ad7-9aa0a2f027ab tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:00.759135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.760354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d3401f5-efdd-44c1-9ad7-9aa0a2f027ab tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.760806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d3401f5-efdd-44c1-9ad7-9aa0a2f027ab tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.761819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d3401f5-efdd-44c1-9ad7-9aa0a2f027ab tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.763205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d3401f5-efdd-44c1-9ad7-9aa0a2f027ab tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.772660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.773124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.779796 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43d8ba14-4fe4-42fa-9e4c-73762b92803d tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 267 microversion: 2.53 time: 0.101201 Jul 20 04:07:00.780553 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 4/8] 10.222.0.59 () {60 vars in 1221 bytes} [Wed Jul 20 04:07:00 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:00.791265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6ec169e6-7a35-423a-93d5-c58df6777821 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:00.792615 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.792615 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:00.797902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d3401f5-efdd-44c1-9ad7-9aa0a2f027ab tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] 10.222.0.59 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.154656 Jul 20 04:07:00.799849 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 5/9] 10.222.0.59 () {58 vars in 1163 bytes} [Wed Jul 20 04:07:00 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:00.803817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cdbf945d-b8b2-4b08-9dd5-7dcb0a1c748c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:00.804830 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.804830 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:00.818349 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cdbf945d-b8b2-4b08-9dd5-7dcb0a1c748c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.018749 Jul 20 04:07:00.818942 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 6/10] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:07:00 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:00.822684 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6ec169e6-7a35-423a-93d5-c58df6777821 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1674928640" status: 202 len: 0 microversion: 2.1 time: 0.040989 Jul 20 04:07:00.823566 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 5/11] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:07:00 2022] DELETE /compute/v2.1/flavors/1674928640 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:00.828320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fc5a7e36-b559-4ded-899b-fb9e01fca34a tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7f83e973b8394da089b7e7f8185cb230"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:00.828969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d216ce28-4305-4b05-ae42-7f821abffb17 tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Calling method '.version_select at 0x7fb848327700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:00.829733 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.829733 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:00.830731 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.830731 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:00.832211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d216ce28-4305-4b05-ae42-7f821abffb17 tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.832901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d216ce28-4305-4b05-ae42-7f821abffb17 tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.854205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d216ce28-4305-4b05-ae42-7f821abffb17 tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.854707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d216ce28-4305-4b05-ae42-7f821abffb17 tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.862669 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d216ce28-4305-4b05-ae42-7f821abffb17 tempest-HypervisorAdminV253TestBase-1559261302 tempest-HypervisorAdminV253TestBase-1559261302-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/35658e96-9787-4884-b01d-9cbb417a2d30" status: 200 len: 793 microversion: 2.53 time: 0.037794 Jul 20 04:07:00.863261 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 6/12] 10.222.0.59 () {60 vars in 1297 bytes} [Wed Jul 20 04:07:00 2022] GET /compute/v2.1/os-hypervisors/35658e96-9787-4884-b01d-9cbb417a2d30 => generated 793 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:00.867752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-954bc8c5-9ec7-44cb-af21-5b38337fba0f tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:00.868654 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.868654 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:00.869790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-954bc8c5-9ec7-44cb-af21-5b38337fba0f tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.870218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-954bc8c5-9ec7-44cb-af21-5b38337fba0f tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.871105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-954bc8c5-9ec7-44cb-af21-5b38337fba0f tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.872425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-954bc8c5-9ec7-44cb-af21-5b38337fba0f tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.913183 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-954bc8c5-9ec7-44cb-af21-5b38337fba0f tempest-AZAdminV2TestJSON-168532000 tempest-AZAdminV2TestJSON-168532000-project-admin] 10.222.0.59 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.048567 Jul 20 04:07:00.914173 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1184 bytes} [Wed Jul 20 04:07:00 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:00.921264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec3c73d1-3505-4ea4-bc8d-c2ab1bb8edf1 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:00.922832 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:00.922832 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:00.931061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec3c73d1-3505-4ea4-bc8d-c2ab1bb8edf1 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:00.931519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec3c73d1-3505-4ea4-bc8d-c2ab1bb8edf1 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:00.978026 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fc5a7e36-b559-4ded-899b-fb9e01fca34a tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/214428280/action" status: 200 len: 96 microversion: 2.1 time: 0.154099 Jul 20 04:07:00.979251 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 7/14] 10.222.0.59 () {60 vars in 1196 bytes} [Wed Jul 20 04:07:00 2022] POST /compute/v2.1/flavors/214428280/action => generated 96 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:00.988095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5936f64e-db4d-4785-8cef-6d5961f62078 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:01.035606 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5936f64e-db4d-4785-8cef-6d5961f62078 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054559 Jul 20 04:07:01.037033 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 8/15] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:01.424554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8ca1f963-cd33-49ea-bf71-fcab5c9439bc tempest-FlavorsAccessTestJSON-1979677167 tempest-FlavorsAccessTestJSON-1979677167-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:01.470096 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8ca1f963-cd33-49ea-bf71-fcab5c9439bc tempest-FlavorsAccessTestJSON-1979677167 tempest-FlavorsAccessTestJSON-1979677167-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.431726 Jul 20 04:07:01.470840 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 9/16] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:01 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:01.476344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c27043a6-7d92-4384-877e-cb87afecc01e tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1597795003", "id": 288114775, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:01.477941 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:01.477941 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:01.502537 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c27043a6-7d92-4384-877e-cb87afecc01e tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.030565 Jul 20 04:07:01.503593 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 10/17] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:01 2022] POST /compute/v2.1/flavors => generated 414 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:01.508589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6fb9d324-dce3-476d-a57a-44370a8bf555 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7f83e973b8394da089b7e7f8185cb230"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:01.510033 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:01.510033 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:01.658355 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec3c73d1-3505-4ea4-bc8d-c2ab1bb8edf1 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 316 microversion: 2.1 time: 0.741376 Jul 20 04:07:01.660512 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 8/18] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:00 2022] POST /compute/v2.1/os-aggregates/1/action => generated 316 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:01.666654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-731fda96-0ed0-4ac2-bb23-fcd2f88c13c4 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:01.765306 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-731fda96-0ed0-4ac2-bb23-fcd2f88c13c4 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.102373 Jul 20 04:07:01.767252 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 9/19] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:01 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:01.783534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-969952b8-679c-497f-920a-955628d695e2 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:01.784652 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:01.784652 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:01.829134 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-969952b8-679c-497f-920a-955628d695e2 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/288114775" status: 202 len: 0 microversion: 2.1 time: 0.049512 Jul 20 04:07:01.830319 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 10/20] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:07:01 2022] DELETE /compute/v2.1/flavors/288114775 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:07:01.882516 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6fb9d324-dce3-476d-a57a-44370a8bf555 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/214428280/action" status: 200 len: 21 microversion: 2.1 time: 0.377640 Jul 20 04:07:01.888029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 11/21] 10.222.0.59 () {60 vars in 1196 bytes} [Wed Jul 20 04:07:01 2022] POST /compute/v2.1/flavors/214428280/action => generated 21 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:01.893831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bb227d6e-b08e-4ef3-a8a7-dba7cbc4aedc tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:01.925183 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bb227d6e-b08e-4ef3-a8a7-dba7cbc4aedc tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035580 Jul 20 04:07:01.926936 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 12/22] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:01.944562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-451015fa-072f-4331-a562-70f772ef7729 tempest-FlavorsAccessTestJSON-1979677167 tempest-FlavorsAccessTestJSON-1979677167-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:01.958902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1418621121", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "availability_zone": "tempest-test_az-1358120432"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:01.973748 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-451015fa-072f-4331-a562-70f772ef7729 tempest-FlavorsAccessTestJSON-1979677167 tempest-FlavorsAccessTestJSON-1979677167-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045414 Jul 20 04:07:01.974654 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 13/23] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:01.989824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2b70b5b2-6d5c-4c1e-9da2-0ebb19c13433 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-537666519", "id": 515649818, "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:02.003935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:02.004804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:02.009014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:02.010747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:02.015339 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2b70b5b2-6d5c-4c1e-9da2-0ebb19c13433 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.031199 Jul 20 04:07:02.022218 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 14/24] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:01 2022] POST /compute/v2.1/flavors => generated 425 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:02.028874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f08dae2c-9415-464e-bdeb-2fe276a646ea tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.030110 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:02.030110 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:02.073052 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f08dae2c-9415-464e-bdeb-2fe276a646ea tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/214428280" status: 202 len: 0 microversion: 2.1 time: 0.048993 Jul 20 04:07:02.076159 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 15/25] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:07:02 2022] DELETE /compute/v2.1/flavors/214428280 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:02.084612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1cba2d67-1f01-4a9e-bcb7-0496509f5381 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.115939 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1cba2d67-1f01-4a9e-bcb7-0496509f5381 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/515649818" status: 202 len: 0 microversion: 2.1 time: 0.035257 Jul 20 04:07:02.120677 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 16/26] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:07:02 2022] DELETE /compute/v2.1/flavors/515649818 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:02.133768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aea7e1c1-19d6-458c-809e-fd2430ed4860 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.158192 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aea7e1c1-19d6-458c-809e-fd2430ed4860 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036094 Jul 20 04:07:02.170960 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 17/27] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:02.179451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5edb87d7-f095-409b-8301-bcd2123bff87 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.221914 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5edb87d7-f095-409b-8301-bcd2123bff87 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049745 Jul 20 04:07:02.222933 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 18/28] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:02.237109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1f443c6a-4530-4bfe-9fca-6f1e90dcd950 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-959452214", "id": 1806330963, "os-flavor-access:is_public": "False"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:02.271698 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1f443c6a-4530-4bfe-9fca-6f1e90dcd950 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.042606 Jul 20 04:07:02.272829 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 19/29] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:02 2022] POST /compute/v2.1/flavors => generated 430 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:02.280218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0184e5eb-d7ac-4a53-9e5e-fdf97fd7a688 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1119048510", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:02.333172 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0184e5eb-d7ac-4a53-9e5e-fdf97fd7a688 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.058823 Jul 20 04:07:02.342181 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 20/30] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:02 2022] POST /compute/v2.1/flavors => generated 507 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:02.353643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e1c08da3-ff8a-4c57-9b3b-01cc1a4590d8 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.357701 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:02.357701 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:02.377085 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e1c08da3-ff8a-4c57-9b3b-01cc1a4590d8 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/1806330963/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.033127 Jul 20 04:07:02.377736 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 21/31] 10.222.0.59 () {58 vars in 1208 bytes} [Wed Jul 20 04:07:02 2022] GET /compute/v2.1/flavors/1806330963/os-flavor-access => generated 21 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:02.384002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-151c52c5-37ff-4a4e-bdd3-db4d5fc24f84 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.423142 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-151c52c5-37ff-4a4e-bdd3-db4d5fc24f84 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/e9d9f4d6-3008-41e4-b8c7-3e538f9cb0bd" status: 202 len: 0 microversion: 2.1 time: 0.042519 Jul 20 04:07:02.424981 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 22/32] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:07:02 2022] DELETE /compute/v2.1/flavors/e9d9f4d6-3008-41e4-b8c7-3e538f9cb0bd => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:02.447115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d584e561-44bd-4f96-ac62-cc8ac33cd102 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.490737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=13 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:02.505112 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d584e561-44bd-4f96-ac62-cc8ac33cd102 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1806330963" status: 202 len: 0 microversion: 2.1 time: 0.072938 Jul 20 04:07:02.505906 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 23/33] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:07:02 2022] DELETE /compute/v2.1/flavors/1806330963 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:02.510649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c90c7b19-bf31-4a04-95ad-a5365157c71e tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.555908 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c90c7b19-bf31-4a04-95ad-a5365157c71e tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048493 Jul 20 04:07:02.576515 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 24/34] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:02.581543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f4f57cdd-b17d-4836-9869-c4b769a7c6a0 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.607153 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f4f57cdd-b17d-4836-9869-c4b769a7c6a0 tempest-FlavorsAccessTestJSON-689854269 tempest-FlavorsAccessTestJSON-689854269-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029295 Jul 20 04:07:02.608017 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 25/35] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:02.614563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9a912afd-4ab8-4684-9d40-ee19c920edac tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1288540313", "id": "77b28b55-5caf-4adf-947d-596d3103312e", "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:02.657569 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9a912afd-4ab8-4684-9d40-ee19c920edac tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.048623 Jul 20 04:07:02.658421 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 26/36] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:02 2022] POST /compute/v2.1/flavors => generated 507 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:02.669565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb19d9a2-e239-42d8-bef6-86dae411309a tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.709784 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb19d9a2-e239-42d8-bef6-86dae411309a tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/77b28b55-5caf-4adf-947d-596d3103312e" status: 202 len: 0 microversion: 2.1 time: 0.043609 Jul 20 04:07:02.710229 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 27/37] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:07:02 2022] DELETE /compute/v2.1/flavors/77b28b55-5caf-4adf-947d-596d3103312e => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:07:02.720447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-71fd503f-8cd1-4b2e-aa32-f1abfa9c5033 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.754201 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-71fd503f-8cd1-4b2e-aa32-f1abfa9c5033 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037622 Jul 20 04:07:02.766443 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 28/38] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:02.771728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-719374c2-ff19-402d-a02c-ff15bb569353 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-422363131", "id": 1254064133, "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:02.800538 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-719374c2-ff19-402d-a02c-ff15bb569353 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.032846 Jul 20 04:07:02.809934 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 29/39] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:02 2022] POST /compute/v2.1/flavors => generated 413 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:02.821694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-41fc5a4b-c1f1-4a9c-9744-ba1f1bec712e tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:02.837221 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-41fc5a4b-c1f1-4a9c-9744-ba1f1bec712e tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/1254064133" status: 200 len: 413 microversion: 2.1 time: 0.020393 Jul 20 04:07:02.838102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:07:02.842320 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 30/40] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:07:02 2022] GET /compute/v2.1/flavors/1254064133 => generated 413 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:03.159543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:07:03.160265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:07:03.165917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:07:03.166584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:07:03.167145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:07:03.195606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:03.196296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:03.197242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:03.197828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:03.242293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Getting quotas for project b54ca14804604df88d85aea23b5873d9. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:07:03.250199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Getting quotas for user 8ee35434e090442e8ee148f66f96afdb and project b54ca14804604df88d85aea23b5873d9. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:07:03.263564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:07:03.278369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:07:03.366871 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4e2a740b-5c3a-489e-8609-e3bee47a906e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.535206 Jul 20 04:07:03.373793 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 11/41] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:07:03.386877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7701decc-2a71-435b-b61f-03bd329e99f0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:03.388334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7701decc-2a71-435b-b61f-03bd329e99f0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:03.526439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7701decc-2a71-435b-b61f-03bd329e99f0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:03.545943 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7701decc-2a71-435b-b61f-03bd329e99f0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1243 microversion: 2.1 time: 0.170468 Jul 20 04:07:03.551664 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 12/42] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:03 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1243 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:03.565773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4469856b-4045-418b-aadb-e72cb9200199 tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:03.600934 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4469856b-4045-418b-aadb-e72cb9200199 tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.755516 Jul 20 04:07:03.601878 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 31/43] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:02 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:03.617772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bdc2d920-0352-47f7-bbef-76b74a6c1027 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:03.618658 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:03.618658 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:03.642488 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bdc2d920-0352-47f7-bbef-76b74a6c1027 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1254064133" status: 202 len: 0 microversion: 2.1 time: 0.028484 Jul 20 04:07:03.646484 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 13/44] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:07:03 2022] DELETE /compute/v2.1/flavors/1254064133 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:03.652179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3d839b0e-9f9c-4133-bbad-c9bec3fc187b tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:03.689383 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3d839b0e-9f9c-4133-bbad-c9bec3fc187b tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035279 Jul 20 04:07:03.694132 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 32/45] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:03.706486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-228f04c1-1e7c-43f8-8d5e-17958f8c6f7f tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-808483852", "id": 415977537, "os-flavor-access:is_public": "False"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:03.708102 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:03.708102 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:03.733468 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-228f04c1-1e7c-43f8-8d5e-17958f8c6f7f tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.031502 Jul 20 04:07:03.736276 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 14/46] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:03 2022] POST /compute/v2.1/flavors => generated 426 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:03.746927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-71b6bf67-40ee-41d7-b110-60aa396e0027 tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "415977537"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:03.785596 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-71b6bf67-40ee-41d7-b110-60aa396e0027 tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] HTTP exception thrown: Flavor 415977537 could not be found. Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-71b6bf67-40ee-41d7-b110-60aa396e0027 tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] Request method failure captured: Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 106 Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi139gveXwjBR2XR8Y-hQsoqDMSejLDIyrJj8xRFAPIjvufn7p39OwdqdtHQIbERCBYJud_d3sIx7MO2GoyoLUEI7vMMFM89cVXXCkJPib1qoSX83SvzYpkIsKda7V1XCwZlXHsFeyGxjsr_V56JqGciOMQqWVbAFLteNO12KFJ-6KkLo Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 9abc9928b067435d8e7c26c3b181403f Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsAdminTestJSON-394133818 Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:03.789737 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9abc9928b067435d8e7c26c3b181403f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9abc9928b067435d8e7c26c3b181403f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9abc9928b067435d8e7c26c3b181403f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9abc9928b067435d8e7c26c3b181403f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsAdminTestJSON-394133818 Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 9abc9928b067435d8e7c26c3b181403f Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-394133818 Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsAdminTestJSON-394133818-project Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: aaa1a48868a94889bf8ae3dbf70da959 Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsAdminTestJSON-394133818-project Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "test", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "415977537"}} Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:07:03.791280 n-d-760456-11 devstack@n-api.service[119606]: exception: Flavor 415977537 could not be found. Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '415977537'}}} Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 415977537 could not be found. Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:03.792108 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 415977537 could not be found. Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:03.794544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:03.795598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:03.795598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:03.795598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:03.795598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 415977537 could not be found. Jul 20 04:07:03.795598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:03.795598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-71b6bf67-40ee-41d7-b110-60aa396e0027 tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] Returning 400 to user: Flavor 415977537 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:03.795598 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-71b6bf67-40ee-41d7-b110-60aa396e0027 tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.049744 Jul 20 04:07:03.795598 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 33/47] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:03 2022] POST /compute/v2.1/servers => generated 80 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:07:03.802076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca909042-57b4-4006-98e9-64ec7d8f6348 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:03.815524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:DELETE=11 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:03.828728 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ca909042-57b4-4006-98e9-64ec7d8f6348 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/415977537" status: 202 len: 0 microversion: 2.1 time: 0.030046 Jul 20 04:07:03.830298 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 15/48] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:07:03 2022] DELETE /compute/v2.1/flavors/415977537 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:03.838933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e47e146d-c82a-40ca-9731-858f9dd51cf4 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:03.894128 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e47e146d-c82a-40ca-9731-858f9dd51cf4 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059640 Jul 20 04:07:03.896693 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 34/49] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:03.912490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-259e1c22-8b72-4da2-9b54-8774d22dcaa2 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1287265470", "id": 263275286, "os-flavor-access:is_public": "False"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:03.960075 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-259e1c22-8b72-4da2-9b54-8774d22dcaa2 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.047441 Jul 20 04:07:03.962072 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 16/50] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:03 2022] POST /compute/v2.1/flavors => generated 412 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:03.973327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d2f9b9e4-d311-49bf-964c-85dfb3b25c47 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1561506431", "id": 1275727751, "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:04.007018 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d2f9b9e4-d311-49bf-964c-85dfb3b25c47 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.038037 Jul 20 04:07:04.008970 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 35/51] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:03 2022] POST /compute/v2.1/flavors => generated 414 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:04.022277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e815c4fd-b69b-4229-8bd3-56426e4db44e tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.052285 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e815c4fd-b69b-4229-8bd3-56426e4db44e tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.036027 Jul 20 04:07:04.066579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f36c073d-c6c8-41a5-84e1-fd60526f37a9 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.070881 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 17/52] 10.222.0.59 () {58 vars in 1168 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:04.090905 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f36c073d-c6c8-41a5-84e1-fd60526f37a9 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.029004 Jul 20 04:07:04.098971 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 36/53] 10.222.0.59 () {58 vars in 1176 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:04.105161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-778a9a51-9050-4ca3-83f8-e19f9e5b4029 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.119491 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-778a9a51-9050-4ca3-83f8-e19f9e5b4029 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.019244 Jul 20 04:07:04.147082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8ab2fa9-a41a-495d-8a63-bcd191888036 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.154735 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 18/54] 10.222.0.59 () {58 vars in 1170 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:04.168388 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f8ab2fa9-a41a-495d-8a63-bcd191888036 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.024471 Jul 20 04:07:04.169241 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 37/55] 10.222.0.59 () {58 vars in 1168 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:04.181357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b2aac15-37c7-47a0-855f-1398096dc711 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.209191 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b2aac15-37c7-47a0-855f-1398096dc711 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.031793 Jul 20 04:07:04.221408 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 19/56] 10.222.0.59 () {58 vars in 1168 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:04.224538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-25aed609-09d3-4b85-bd49-d7bceb00f2a1 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.269667 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-25aed609-09d3-4b85-bd49-d7bceb00f2a1 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.048663 Jul 20 04:07:04.270646 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 38/57] 10.222.0.59 () {58 vars in 1174 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:04.287975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-814b0097-3ec3-4ec8-8110-cfbc56a7efe7 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.307254 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-814b0097-3ec3-4ec8-8110-cfbc56a7efe7 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.025105 Jul 20 04:07:04.308655 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 20/58] 10.222.0.59 () {58 vars in 1172 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:04.324541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-019b0dab-216a-43df-9989-bf02c0208903 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.352582 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-019b0dab-216a-43df-9989-bf02c0208903 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.032582 Jul 20 04:07:04.365097 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 39/59] 10.222.0.59 () {58 vars in 1168 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:04.380749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-068e3b0c-05ce-41ba-a4aa-5ff88e53e5bc tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.427728 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-068e3b0c-05ce-41ba-a4aa-5ff88e53e5bc tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1275727751" status: 202 len: 0 microversion: 2.1 time: 0.050354 Jul 20 04:07:04.429026 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 21/60] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:07:04 2022] DELETE /compute/v2.1/flavors/1275727751 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:04.439210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-795d98cd-44c2-4c1f-beeb-0ae9571a1603 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.478666 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-795d98cd-44c2-4c1f-beeb-0ae9571a1603 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040931 Jul 20 04:07:04.479723 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 40/61] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:04.503675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e89a1389-275b-4942-a08b-f665c2187e4a tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.546512 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e89a1389-275b-4942-a08b-f665c2187e4a tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/263275286" status: 202 len: 0 microversion: 2.1 time: 0.053165 Jul 20 04:07:04.547434 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 22/62] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:07:04 2022] DELETE /compute/v2.1/flavors/263275286 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:04.556031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a3b29ef7-6683-4321-bdd3-5883413fb593 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.567337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b64a648-36ec-4590-b8c9-76bb61b8623c tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.568066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8b64a648-36ec-4590-b8c9-76bb61b8623c tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:04.624138 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a3b29ef7-6683-4321-bdd3-5883413fb593 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072412 Jul 20 04:07:04.625842 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 41/63] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:04.650045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9697e7c7-d1d2-43e0-be6b-528d7e197053 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2079178197", "id": 343810020, "os-flavor-access:is_public": "False"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:04.698483 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9697e7c7-d1d2-43e0-be6b-528d7e197053 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.059820 Jul 20 04:07:04.704208 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 42/64] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:04 2022] POST /compute/v2.1/flavors => generated 412 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:04.714281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8b64a648-36ec-4590-b8c9-76bb61b8623c tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:04.720313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7e31f5c3-50ee-46d4-ba4d-f3860028b2f6 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.721603 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8b64a648-36ec-4590-b8c9-76bb61b8623c tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1243 microversion: 2.1 time: 0.159721 Jul 20 04:07:04.722207 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 23/65] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1243 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:04.796724 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7e31f5c3-50ee-46d4-ba4d-f3860028b2f6 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083002 Jul 20 04:07:04.806365 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 43/66] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:04.817619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-739cca97-8423-470d-9178-048d21b33e6a tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.903105 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-739cca97-8423-470d-9178-048d21b33e6a tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088539 Jul 20 04:07:04.905904 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 24/67] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:04.924117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c294ceb3-5958-40bf-915d-1f2e7e624ad1 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.950322 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c294ceb3-5958-40bf-915d-1f2e7e624ad1 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/343810020" status: 202 len: 0 microversion: 2.1 time: 0.031808 Jul 20 04:07:04.954316 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 44/68] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:07:04 2022] DELETE /compute/v2.1/flavors/343810020 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:04.959953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f52a44ad-33fc-4aba-bb46-0263c801d6fc tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:04.994839 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f52a44ad-33fc-4aba-bb46-0263c801d6fc tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038883 Jul 20 04:07:04.995399 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 25/69] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:05.012469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-440e6e0b-7dae-4998-8f43-3e4bfff86af2 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-261065409", "id": 176761841, "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:05.068825 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-440e6e0b-7dae-4998-8f43-3e4bfff86af2 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.060637 Jul 20 04:07:05.069803 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 45/70] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:05 2022] POST /compute/v2.1/flavors => generated 410 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:05.080902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f13d50d0-63b0-41f2-a40e-60ace69a1047 tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:05.156041 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f13d50d0-63b0-41f2-a40e-60ace69a1047 tempest-FlavorsAdminTestJSON-394133818 tempest-FlavorsAdminTestJSON-394133818-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.078888 Jul 20 04:07:05.157381 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 26/71] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:05 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:05.172684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94737b4d-c74f-46df-829d-26ff5c1de0b8 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:05.219895 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94737b4d-c74f-46df-829d-26ff5c1de0b8 tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/176761841" status: 202 len: 0 microversion: 2.1 time: 0.052209 Jul 20 04:07:05.223853 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 46/72] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:07:05 2022] DELETE /compute/v2.1/flavors/176761841 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:05.235547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-44b91573-26a6-4e26-b8ff-7b56ab9c657c tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:05.276553 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-44b91573-26a6-4e26-b8ff-7b56ab9c657c tempest-FlavorsAdminTestJSON-824674846 tempest-FlavorsAdminTestJSON-824674846-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046064 Jul 20 04:07:05.279801 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 27/73] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:05.739031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-22b76568-776f-46c9-99f4-147a0634ee4f tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:05.740735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-22b76568-776f-46c9-99f4-147a0634ee4f tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:05.784240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22b76568-776f-46c9-99f4-147a0634ee4f tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:05.786450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22b76568-776f-46c9-99f4-147a0634ee4f tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:05.789282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22b76568-776f-46c9-99f4-147a0634ee4f tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:05.792571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22b76568-776f-46c9-99f4-147a0634ee4f tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:06.897617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-22b76568-776f-46c9-99f4-147a0634ee4f tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:06.926141 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-22b76568-776f-46c9-99f4-147a0634ee4f tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1291 microversion: 2.1 time: 1.191183 Jul 20 04:07:06.938326 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 47/74] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:05 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1291 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:07.951240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e9c2c84c-9252-486d-aa6a-5a1edb463531 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:07.952323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e9c2c84c-9252-486d-aa6a-5a1edb463531 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:07.997937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9c2c84c-9252-486d-aa6a-5a1edb463531 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:08.003982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9c2c84c-9252-486d-aa6a-5a1edb463531 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:08.004993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9c2c84c-9252-486d-aa6a-5a1edb463531 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:08.005271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9c2c84c-9252-486d-aa6a-5a1edb463531 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:08.774748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e9c2c84c-9252-486d-aa6a-5a1edb463531 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:08.797293 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e9c2c84c-9252-486d-aa6a-5a1edb463531 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1297 microversion: 2.1 time: 0.850660 Jul 20 04:07:08.799879 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 28/75] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:07 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1297 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:09.817778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b093e43-48f7-42bd-bdca-d37e95b5ca89 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:09.819264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6b093e43-48f7-42bd-bdca-d37e95b5ca89 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:09.837550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b093e43-48f7-42bd-bdca-d37e95b5ca89 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:09.838156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b093e43-48f7-42bd-bdca-d37e95b5ca89 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:09.839381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b093e43-48f7-42bd-bdca-d37e95b5ca89 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:09.842895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b093e43-48f7-42bd-bdca-d37e95b5ca89 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:09.905777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6c7e8121-94ce-499d-900d-40c086c2e466 tempest-AZAdminNegativeTestJSON-1582770800 tempest-AZAdminNegativeTestJSON-1582770800-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:09.911887 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:09.911887 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:09.913027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6c7e8121-94ce-499d-900d-40c086c2e466 tempest-AZAdminNegativeTestJSON-1582770800 tempest-AZAdminNegativeTestJSON-1582770800-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'aadf50d2354a4053a5c426116cccbcb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5157896bc1de44d08a9b76da2fd8a4b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6c7e8121-94ce-499d-900d-40c086c2e466 tempest-AZAdminNegativeTestJSON-1582770800 tempest-AZAdminNegativeTestJSON-1582770800-project] Request method failure captured: Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi139rWkSGenIb8ltFqTWI7akT2SdrXS_-M6qhICzEvlDVbDcYDjmBm7Ua60LDzL7Jk258e_XiUzJpepR7wv_sfXFd4GNPq2_UR42ld5haGy1YtMFOuuenzMhXy5jAUcGwZwTB9EpZAAaJ3NobBSHiPb9hycijxq1a7zwheC0UnaJq9vI Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 5157896bc1de44d08a9b76da2fd8a4b7 Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1582770800 Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:09.932430 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5157896bc1de44d08a9b76da2fd8a4b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5157896bc1de44d08a9b76da2fd8a4b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5157896bc1de44d08a9b76da2fd8a4b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5157896bc1de44d08a9b76da2fd8a4b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AZAdminNegativeTestJSON-1582770800 Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 5157896bc1de44d08a9b76da2fd8a4b7 Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1582770800 Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AZAdminNegativeTestJSON-1582770800-project Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: aadf50d2354a4053a5c426116cccbcb4 Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AZAdminNegativeTestJSON-1582770800-project Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:07:09.933536 n-d-760456-11 devstack@n-api.service[119606]: action_args: {} Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:09.935444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:07:09.936455 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:09.937832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6c7e8121-94ce-499d-900d-40c086c2e466 tempest-AZAdminNegativeTestJSON-1582770800 tempest-AZAdminNegativeTestJSON-1582770800-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:09.940518 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6c7e8121-94ce-499d-900d-40c086c2e466 tempest-AZAdminNegativeTestJSON-1582770800 tempest-AZAdminNegativeTestJSON-1582770800-project] 10.222.0.59 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.632549 Jul 20 04:07:09.947754 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 48/76] 10.222.0.59 () {58 vars in 1184 bytes} [Wed Jul 20 04:07:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 640 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:10.617970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6b093e43-48f7-42bd-bdca-d37e95b5ca89 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:10.626916 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b093e43-48f7-42bd-bdca-d37e95b5ca89 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 0.814157 Jul 20 04:07:10.634796 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 29/77] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:09 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:11.649367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:11.657534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-85a53ac0-b891-4e56-8f27-b9f5d1a612f8 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:11.661202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-85a53ac0-b891-4e56-8f27-b9f5d1a612f8 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:11.693657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85a53ac0-b891-4e56-8f27-b9f5d1a612f8 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:11.694587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85a53ac0-b891-4e56-8f27-b9f5d1a612f8 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:11.696346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85a53ac0-b891-4e56-8f27-b9f5d1a612f8 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:11.698762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85a53ac0-b891-4e56-8f27-b9f5d1a612f8 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:11.987813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b093e43-48f7-42bd-bdca-d37e95b5ca89 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:11.988810 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b093e43-48f7-42bd-bdca-d37e95b5ca89 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001325 Jul 20 04:07:11.994756 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 30/78] 10.222.0.59 () {56 vars in 885 bytes} [Wed Jul 20 04:07:11 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:07:12.525758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-85a53ac0-b891-4e56-8f27-b9f5d1a612f8 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:12.545973 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-85a53ac0-b891-4e56-8f27-b9f5d1a612f8 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 0.895630 Jul 20 04:07:12.551323 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 49/79] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:11 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:13.569746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d1547c4-225a-484b-b670-e77eb795b41e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:13.570430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4d1547c4-225a-484b-b670-e77eb795b41e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:13.582948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:13.594141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d1547c4-225a-484b-b670-e77eb795b41e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:13.594969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d1547c4-225a-484b-b670-e77eb795b41e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:13.603748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d1547c4-225a-484b-b670-e77eb795b41e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:13.609297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d1547c4-225a-484b-b670-e77eb795b41e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:14.242554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4d1547c4-225a-484b-b670-e77eb795b41e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:14.264517 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4d1547c4-225a-484b-b670-e77eb795b41e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 0.699741 Jul 20 04:07:14.280142 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 31/80] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:13 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:14.748853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6ac7f40e-ebdd-4460-81fe-12726b57062e tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-884408124", "ram": 512, "vcpus": 1, "disk": 10, "id": 1725029166, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:14.751224 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:14.751224 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:14.793902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6ac7f40e-ebdd-4460-81fe-12726b57062e tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.869117 Jul 20 04:07:14.800637 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 50/81] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:13 2022] POST /compute/v2.1/flavors => generated 415 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:14.805976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-25653e18-a5a7-43c4-8ddc-9124eb33f7cf tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:14.808009 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:14.808009 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:14.875166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=10 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:14.998318 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-25653e18-a5a7-43c4-8ddc-9124eb33f7cf tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/1725029166/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.196107 Jul 20 04:07:15.018349 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 32/82] 10.222.0.59 () {60 vars in 1223 bytes} [Wed Jul 20 04:07:14 2022] POST /compute/v2.1/flavors/1725029166/os-extra_specs => generated 66 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:15.296833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4c8cb506-43db-47a8-8e34-7902d61a5392 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:15.299534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4c8cb506-43db-47a8-8e34-7902d61a5392 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:15.311799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c8cb506-43db-47a8-8e34-7902d61a5392 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:15.312420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c8cb506-43db-47a8-8e34-7902d61a5392 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:15.314556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c8cb506-43db-47a8-8e34-7902d61a5392 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:15.316963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c8cb506-43db-47a8-8e34-7902d61a5392 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:15.827319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e3357230-fcb0-4278-a4bf-c13bd0ca7e83 tempest-FlavorsExtraSpecsTestJSON-912714668 tempest-FlavorsExtraSpecsTestJSON-912714668-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:15.844020 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e3357230-fcb0-4278-a4bf-c13bd0ca7e83 tempest-FlavorsExtraSpecsTestJSON-912714668 tempest-FlavorsExtraSpecsTestJSON-912714668-project] 10.222.0.59 "GET /compute/v2.1/flavors/1725029166/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.839360 Jul 20 04:07:15.849880 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 51/83] 10.222.0.59 () {58 vars in 1202 bytes} [Wed Jul 20 04:07:15 2022] GET /compute/v2.1/flavors/1725029166/os-extra_specs => generated 66 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:15.940811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3bfc3e35-ed74-45aa-b57e-6b50690ee4e7 req-0469cb59-d13e-4dc0-af61-0824f379f5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e", "tag": "d4cdfd38-bf9e-44b6-9bfd-1b4a9a87904e"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:15.959340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3bfc3e35-ed74-45aa-b57e-6b50690ee4e7 req-0469cb59-d13e-4dc0-af61-0824f379f5a5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:15.960932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3bfc3e35-ed74-45aa-b57e-6b50690ee4e7 req-0469cb59-d13e-4dc0-af61-0824f379f5a5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:16.008744 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3bfc3e35-ed74-45aa-b57e-6b50690ee4e7 req-0469cb59-d13e-4dc0-af61-0824f379f5a5 service nova] Creating event network-changed:d4cdfd38-bf9e-44b6-9bfd-1b4a9a87904e for instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e on n-h1-760456-11 Jul 20 04:07:16.011160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3bfc3e35-ed74-45aa-b57e-6b50690ee4e7 req-0469cb59-d13e-4dc0-af61-0824f379f5a5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:07:16.013536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5ec0e91-d6a1-4a6c-ab01-431dde20ae77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:16.015595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5ec0e91-d6a1-4a6c-ab01-431dde20ae77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:16.018945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5ec0e91-d6a1-4a6c-ab01-431dde20ae77 None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:16.019619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5ec0e91-d6a1-4a6c-ab01-431dde20ae77 None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:16.042704 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.compute.rpcapi [None req-b5ec0e91-d6a1-4a6c-ab01-431dde20ae77 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 04:07:16.044370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5ec0e91-d6a1-4a6c-ab01-431dde20ae77 None None] Releasing lock "compute-rpcapi-router" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:07:16.087886 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b5ec0e91-d6a1-4a6c-ab01-431dde20ae77 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236515 Jul 20 04:07:16.088732 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 52/84] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:16.095770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c957ee0-e087-4edd-9f30-bf62449058ef tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:16.103549 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:16.103549 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:16.166730 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9c957ee0-e087-4edd-9f30-bf62449058ef tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/1725029166/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.076375 Jul 20 04:07:16.167581 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 53/85] 10.222.0.59 () {60 vars in 1223 bytes} [Wed Jul 20 04:07:16 2022] POST /compute/v2.1/flavors/1725029166/os-extra_specs => generated 66 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:16.177189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e12274d2-1eeb-4038-afc2-9263d6407443 tempest-FlavorsExtraSpecsTestJSON-912714668 tempest-FlavorsExtraSpecsTestJSON-912714668-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:16.196458 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e12274d2-1eeb-4038-afc2-9263d6407443 tempest-FlavorsExtraSpecsTestJSON-912714668 tempest-FlavorsExtraSpecsTestJSON-912714668-project] 10.222.0.59 "GET /compute/v2.1/flavors/1725029166/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.023091 Jul 20 04:07:16.200660 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 54/86] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:07:16 2022] GET /compute/v2.1/flavors/1725029166/os-extra_specs/hw:numa_nodes => generated 22 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:07:16.211631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-14351bc9-ff25-4bbe-87d5-8f234f4db9e4 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:16.250930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:DELETE=9,nova_api:SAVEPOINT=3,nova_api:RELEASE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:16.270771 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-14351bc9-ff25-4bbe-87d5-8f234f4db9e4 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/1725029166/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.062959 Jul 20 04:07:16.274578 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 55/87] 10.222.0.59 () {60 vars in 1223 bytes} [Wed Jul 20 04:07:16 2022] POST /compute/v2.1/flavors/1725029166/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:07:16.284001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7cbaf476-c80c-4f90-9e09-2bc58149a752 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:16.302093 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7cbaf476-c80c-4f90-9e09-2bc58149a752 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/1725029166/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.021615 Jul 20 04:07:16.310146 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 56/88] 10.222.0.59 () {58 vars in 1202 bytes} [Wed Jul 20 04:07:16 2022] GET /compute/v2.1/flavors/1725029166/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:07:16.319398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-248d160b-2251-4133-b07b-5670aed2c809 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:16.320859 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:16.320859 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:16.388684 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-248d160b-2251-4133-b07b-5670aed2c809 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "PUT /compute/v2.1/flavors/1725029166/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.072849 Jul 20 04:07:16.389323 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 57/89] 10.222.0.59 () {60 vars in 1264 bytes} [Wed Jul 20 04:07:16 2022] PUT /compute/v2.1/flavors/1725029166/os-extra_specs/hw:numa_nodes => generated 22 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:07:16.407289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-301ce678-dc07-471b-977d-9cd6151485bb tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:16.432803 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-301ce678-dc07-471b-977d-9cd6151485bb tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/1725029166/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037098 Jul 20 04:07:16.434434 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 58/90] 10.222.0.59 () {58 vars in 1202 bytes} [Wed Jul 20 04:07:16 2022] GET /compute/v2.1/flavors/1725029166/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:16.445546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aede2f17-c808-4d27-9c38-b1ed08cbc59d tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:16.447032 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:16.447032 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:16.504257 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aede2f17-c808-4d27-9c38-b1ed08cbc59d tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1725029166/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.064658 Jul 20 04:07:16.508587 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 59/91] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:07:16 2022] DELETE /compute/v2.1/flavors/1725029166/os-extra_specs/hw:numa_nodes => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:16.517286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9d128089-414e-4688-a89a-a5119c183e85 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:16.563402 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9d128089-414e-4688-a89a-a5119c183e85 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1725029166/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.051807 Jul 20 04:07:16.568311 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 60/92] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:07:16 2022] DELETE /compute/v2.1/flavors/1725029166/os-extra_specs/hw:cpu_policy => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:16.580548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d412732f-65d4-4388-b2b4-a000b3ca58b0 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:16.601666 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d412732f-65d4-4388-b2b4-a000b3ca58b0 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/1725029166/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028508 Jul 20 04:07:16.607183 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 61/93] 10.222.0.59 () {58 vars in 1202 bytes} [Wed Jul 20 04:07:16 2022] GET /compute/v2.1/flavors/1725029166/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:16.617563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93c78e48-2cd5-4ffb-8af8-571f3f413bb5 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:16.622646 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:16.622646 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:16.669006 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-93c78e48-2cd5-4ffb-8af8-571f3f413bb5 tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1725029166" status: 202 len: 0 microversion: 2.1 time: 0.059688 Jul 20 04:07:16.672531 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 62/94] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:07:16 2022] DELETE /compute/v2.1/flavors/1725029166 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:07:16.681741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9afdce5-e80c-4e68-aa39-76eb31cf2d3e tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:16.744483 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c9afdce5-e80c-4e68-aa39-76eb31cf2d3e tempest-FlavorsExtraSpecsTestJSON-1981601516 tempest-FlavorsExtraSpecsTestJSON-1981601516-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070034 Jul 20 04:07:16.763116 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 63/95] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:17.303033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4c8cb506-43db-47a8-8e34-7902d61a5392 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:17.311041 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4c8cb506-43db-47a8-8e34-7902d61a5392 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 2.033194 Jul 20 04:07:17.311516 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 33/96] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:15 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:18.329503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b134a05-2aba-42f3-b770-e0d66f285957 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:18.330352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b134a05-2aba-42f3-b770-e0d66f285957 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:18.336941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b134a05-2aba-42f3-b770-e0d66f285957 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:18.349031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b134a05-2aba-42f3-b770-e0d66f285957 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:18.351627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b134a05-2aba-42f3-b770-e0d66f285957 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:18.355692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b134a05-2aba-42f3-b770-e0d66f285957 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:19.347304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b134a05-2aba-42f3-b770-e0d66f285957 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:19.370518 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b134a05-2aba-42f3-b770-e0d66f285957 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 1.041770 Jul 20 04:07:19.371797 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 64/97] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:18 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:20.390083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d79ea39c-f3d9-4aa2-866c-e38442de3a24 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:20.390884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d79ea39c-f3d9-4aa2-866c-e38442de3a24 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:20.413014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d79ea39c-f3d9-4aa2-866c-e38442de3a24 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:20.418583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d79ea39c-f3d9-4aa2-866c-e38442de3a24 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:20.419677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d79ea39c-f3d9-4aa2-866c-e38442de3a24 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:20.420341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d79ea39c-f3d9-4aa2-866c-e38442de3a24 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:21.257862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d79ea39c-f3d9-4aa2-866c-e38442de3a24 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:21.270584 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d79ea39c-f3d9-4aa2-866c-e38442de3a24 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 0.885297 Jul 20 04:07:21.271206 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 34/98] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:20 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:22.287379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-938be5ad-f3db-4c61-aae4-08897673fd57 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:22.288727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-938be5ad-f3db-4c61-aae4-08897673fd57 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:22.306173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-938be5ad-f3db-4c61-aae4-08897673fd57 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:22.307630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-938be5ad-f3db-4c61-aae4-08897673fd57 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:22.311787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-938be5ad-f3db-4c61-aae4-08897673fd57 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:22.315364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-938be5ad-f3db-4c61-aae4-08897673fd57 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:22.758508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-938be5ad-f3db-4c61-aae4-08897673fd57 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:22.771402 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-938be5ad-f3db-4c61-aae4-08897673fd57 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 0.487820 Jul 20 04:07:22.774119 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 65/99] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:22 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:23.233555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b983542-b64d-48bc-81b2-34a7d75c3656 tempest-FlavorMetadataValidation-1498517081 tempest-FlavorMetadataValidation-1498517081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-963309102", "id": 958526738, "os-flavor-access:is_public": "True"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:23.235649 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:23.235649 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:23.276202 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b983542-b64d-48bc-81b2-34a7d75c3656 tempest-FlavorMetadataValidation-1498517081 tempest-FlavorMetadataValidation-1498517081-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.472296 Jul 20 04:07:23.278493 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 35/100] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:07:22 2022] POST /compute/v2.1/flavors => generated 467 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:07:23.292262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-abc82b19-4b4a-47f9-b576-20563cb0754b tempest-FlavorMetadataValidation-1498517081 tempest-FlavorMetadataValidation-1498517081-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:23.296608 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:23.296608 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:23.757001 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-abc82b19-4b4a-47f9-b576-20563cb0754b tempest-FlavorMetadataValidation-1498517081 tempest-FlavorMetadataValidation-1498517081-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/958526738/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.468948 Jul 20 04:07:23.762880 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 66/101] 10.222.0.59 () {62 vars in 1261 bytes} [Wed Jul 20 04:07:23 2022] POST /compute/v2.1/flavors/958526738/os-extra_specs => generated 62 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:23.772000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b3a83f0f-dead-4c6c-8dbd-4fa2a343e8a1 tempest-FlavorMetadataValidation-1498517081 tempest-FlavorMetadataValidation-1498517081-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:23.773226 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:23.773226 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:23.792462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-41ea8fb5-acda-4b19-9537-88f878785341 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:23.793612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-41ea8fb5-acda-4b19-9537-88f878785341 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:23.803380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41ea8fb5-acda-4b19-9537-88f878785341 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:23.806829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41ea8fb5-acda-4b19-9537-88f878785341 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:23.812593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41ea8fb5-acda-4b19-9537-88f878785341 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:23.813289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41ea8fb5-acda-4b19-9537-88f878785341 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:23.816666 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b3a83f0f-dead-4c6c-8dbd-4fa2a343e8a1 tempest-FlavorMetadataValidation-1498517081 tempest-FlavorMetadataValidation-1498517081-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/958526738" status: 202 len: 0 microversion: 2.86 time: 0.045322 Jul 20 04:07:23.822026 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 36/102] 10.222.0.59 () {60 vars in 1198 bytes} [Wed Jul 20 04:07:23 2022] DELETE /compute/v2.1/flavors/958526738 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:07:23.833494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b32aebac-fbb7-4570-b5d4-b4900cca6ff4 tempest-FlavorMetadataValidation-1498517081 tempest-FlavorMetadataValidation-1498517081-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:23.889974 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b32aebac-fbb7-4570-b5d4-b4900cca6ff4 tempest-FlavorMetadataValidation-1498517081 tempest-FlavorMetadataValidation-1498517081-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.066402 Jul 20 04:07:23.907851 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 37/103] 10.222.0.59 () {60 vars in 1186 bytes} [Wed Jul 20 04:07:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:07:24.300685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-41ea8fb5-acda-4b19-9537-88f878785341 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:24.315692 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-41ea8fb5-acda-4b19-9537-88f878785341 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 0.529119 Jul 20 04:07:24.316542 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 67/104] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:23 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:24.973528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-92a7a248-e282-4ab3-af3d-c688916fc7b6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Calling method '.version_select at 0x7fb8481bdf70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:24.979338 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:24.979338 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:24.983220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92a7a248-e282-4ab3-af3d-c688916fc7b6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:24.988127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92a7a248-e282-4ab3-af3d-c688916fc7b6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:24.993792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92a7a248-e282-4ab3-af3d-c688916fc7b6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:24.994946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92a7a248-e282-4ab3-af3d-c688916fc7b6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:25.095673 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-92a7a248-e282-4ab3-af3d-c688916fc7b6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.743458 Jul 20 04:07:25.096289 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 38/105] 10.222.0.59 () {58 vars in 1127 bytes} [Wed Jul 20 04:07:24 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:25.334940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-578481bd-1bb1-4314-a71d-23e59e85fda0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:25.335578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-578481bd-1bb1-4314-a71d-23e59e85fda0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:25.355978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-578481bd-1bb1-4314-a71d-23e59e85fda0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:25.356589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-578481bd-1bb1-4314-a71d-23e59e85fda0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:25.362043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-578481bd-1bb1-4314-a71d-23e59e85fda0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:25.365629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-578481bd-1bb1-4314-a71d-23e59e85fda0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:25.583971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a3afca27-de68-4781-8e6d-f642fd43d05c tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Calling method '.version_select at 0x7fb8480e8550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:25.585242 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:25.585242 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:25.586387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a3afca27-de68-4781-8e6d-f642fd43d05c tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'd9e44f194e784f04936b03eaea67927d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba669012dc3a445c8cb0da30e2403579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a3afca27-de68-4781-8e6d-f642fd43d05c tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Request method failure captured: Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1396ucvufv0Qs3FT5K-Vk4W47-DCGIOlMlXUJ1nlsfIe228ifX9t4xOilo3qd_hqxlpW7OllSBQ93dE1Oy59-jF_3weIC0Fr-udNDQmgLh4NDwRVyO5WT5eP5hQrSJxjZgXQxZzDnlt-_03wUHl7xzG4G_FFz-GJ6meUTYdYFO1y3rw Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:25.591455 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: d9e44f194e784f04936b03eaea67927d Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: action_args: {} Jul 20 04:07:25.592611 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:25.593343 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:07:25.594367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.595375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a3afca27-de68-4781-8e6d-f642fd43d05c tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:25.595375 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a3afca27-de68-4781-8e6d-f642fd43d05c tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] 10.222.0.59 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.492226 Jul 20 04:07:25.597296 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 68/106] 10.222.0.59 () {58 vars in 1127 bytes} [Wed Jul 20 04:07:25 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 495 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:07:25.612257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-905b6688-796c-436f-9be6-54a521e77b0b tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Calling method '.version_select at 0x7fb848127d30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:25.615434 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:25.615434 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:25.620235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-905b6688-796c-436f-9be6-54a521e77b0b tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'd9e44f194e784f04936b03eaea67927d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba669012dc3a445c8cb0da30e2403579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-905b6688-796c-436f-9be6-54a521e77b0b tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Request method failure captured: Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hosts/n-d-760456-11/reboot HTTP/1.1 Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1396ucvufv0Qs3FT5K-Vk4W47-DCGIOlMlXUJ1nlsfIe228ifX9t4xOilo3qd_hqxlpW7OllSBQ93dE1Oy59-jF_3weIC0Fr-udNDQmgLh4NDwRVyO5WT5eP5hQrSJxjZgXQxZzDnlt-_03wUHl7xzG4G_FFz-GJ6meUTYdYFO1y3rw Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:25.624991 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: d9e44f194e784f04936b03eaea67927d Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'n-d-760456-11'} Jul 20 04:07:25.626098 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:25.626791 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:07:25.627837 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.628733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-905b6688-796c-436f-9be6-54a521e77b0b tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:25.631483 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-905b6688-796c-436f-9be6-54a521e77b0b tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-d-760456-11/reboot" status: 403 len: 111 microversion: 2.1 time: 0.027143 Jul 20 04:07:25.633504 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 69/107] 10.222.0.59 () {58 vars in 1190 bytes} [Wed Jul 20 04:07:25 2022] GET /compute/v2.1/os-hosts/n-d-760456-11/reboot => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:25.652980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1ad5b66d-823b-4f57-988d-5421945a7ea6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Calling method '.version_select at 0x7fb8489cfa60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:25.725083 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-1ad5b66d-823b-4f57-988d-5421945a7ea6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1ad5b66d-823b-4f57-988d-5421945a7ea6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Request method failure captured: Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1398MbLt8Xf2Xq-Dy0xUK7njqd8K-4xQ9oPgZtiEAL25aTMR4zmu4ijzFaAJN6SRznOu092-klCOoLoJTpiEcuAWdpHGyJNW3uK6pnvUabZkfnCbqhwy_l8J9tsHLiCi_-ndb5WRWXgfD0R9PIsr0LFRLtRf4XtJMwTLRQ4LCd5-5t8 Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:07:25.739289 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 860183749e694f688417d2e19cb819aa Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:07:25.740503 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:25.741333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:07:25.742361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1ad5b66d-823b-4f57-988d-5421945a7ea6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1ad5b66d-823b-4f57-988d-5421945a7ea6 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.101043 Jul 20 04:07:25.744051 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 70/108] 10.222.0.59 () {58 vars in 1211 bytes} [Wed Jul 20 04:07:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:07:25.754933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7ac3b8ee-517d-46d3-89b3-5f3f2ff35c39 tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Calling method '.version_select at 0x7fb842ffd310>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:25.755746 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:25.755746 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:25.759583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7ac3b8ee-517d-46d3-89b3-5f3f2ff35c39 tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'd9e44f194e784f04936b03eaea67927d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba669012dc3a445c8cb0da30e2403579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7ac3b8ee-517d-46d3-89b3-5f3f2ff35c39 tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Request method failure captured: Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hosts/n-d-760456-11 HTTP/1.1 Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1396ucvufv0Qs3FT5K-Vk4W47-DCGIOlMlXUJ1nlsfIe228ifX9t4xOilo3qd_hqxlpW7OllSBQ93dE1Oy59-jF_3weIC0Fr-udNDQmgLh4NDwRVyO5WT5eP5hQrSJxjZgXQxZzDnlt-_03wUHl7xzG4G_FFz-GJ6meUTYdYFO1y3rw Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:25.777978 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: d9e44f194e784f04936b03eaea67927d Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'n-d-760456-11'} Jul 20 04:07:25.779381 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:25.780092 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:07:25.781022 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.781951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7ac3b8ee-517d-46d3-89b3-5f3f2ff35c39 tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:25.783680 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7ac3b8ee-517d-46d3-89b3-5f3f2ff35c39 tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-d-760456-11" status: 403 len: 109 microversion: 2.1 time: 0.035617 Jul 20 04:07:25.784253 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 71/109] 10.222.0.59 () {58 vars in 1169 bytes} [Wed Jul 20 04:07:25 2022] GET /compute/v2.1/os-hosts/n-d-760456-11 => generated 109 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:25.811935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32a153e4-1115-4976-90fa-7475e604da98 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Calling method '.version_select at 0x7fb8489ec550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:25.845631 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-32a153e4-1115-4976-90fa-7475e604da98 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32a153e4-1115-4976-90fa-7475e604da98 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Request method failure captured: Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1398MbLt8Xf2Xq-Dy0xUK7njqd8K-4xQ9oPgZtiEAL25aTMR4zmu4ijzFaAJN6SRznOu092-klCOoLoJTpiEcuAWdpHGyJNW3uK6pnvUabZkfnCbqhwy_l8J9tsHLiCi_-ndb5WRWXgfD0R9PIsr0LFRLtRf4XtJMwTLRQ4LCd5-5t8 Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:07:25.853788 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 860183749e694f688417d2e19cb819aa Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:07:25.855014 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.856285 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.857354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.859134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32a153e4-1115-4976-90fa-7475e604da98 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:25.871960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-578481bd-1bb1-4314-a71d-23e59e85fda0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:25.873187 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-32a153e4-1115-4976-90fa-7475e604da98 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.074396 Jul 20 04:07:25.881462 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 72/110] 10.222.0.59 () {58 vars in 1190 bytes} [Wed Jul 20 04:07:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:25.888131 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-578481bd-1bb1-4314-a71d-23e59e85fda0 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 0.556919 Jul 20 04:07:25.892040 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 39/111] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:25 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:25.897135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ebe6885e-194a-4a75-a76e-b7b8a4a1766c tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Calling method '.version_select at 0x7fb842ffd550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:25.897988 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:25.897988 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:25.904958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ebe6885e-194a-4a75-a76e-b7b8a4a1766c tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'd9e44f194e784f04936b03eaea67927d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba669012dc3a445c8cb0da30e2403579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ebe6885e-194a-4a75-a76e-b7b8a4a1766c tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Request method failure captured: Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hosts/n-d-760456-11/shutdown HTTP/1.1 Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1396ucvufv0Qs3FT5K-Vk4W47-DCGIOlMlXUJ1nlsfIe228ifX9t4xOilo3qd_hqxlpW7OllSBQ93dE1Oy59-jF_3weIC0Fr-udNDQmgLh4NDwRVyO5WT5eP5hQrSJxjZgXQxZzDnlt-_03wUHl7xzG4G_FFz-GJ6meUTYdYFO1y3rw Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:25.911855 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: d9e44f194e784f04936b03eaea67927d Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'n-d-760456-11'} Jul 20 04:07:25.913236 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:25.913894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:07:25.914864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.915712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ebe6885e-194a-4a75-a76e-b7b8a4a1766c tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:25.915712 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ebe6885e-194a-4a75-a76e-b7b8a4a1766c tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-d-760456-11/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.028003 Jul 20 04:07:25.923192 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 73/112] 10.222.0.59 () {58 vars in 1196 bytes} [Wed Jul 20 04:07:25 2022] GET /compute/v2.1/os-hosts/n-d-760456-11/shutdown => generated 113 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:25.933052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b217d4e9-82c8-461b-9855-79c3a88875d1 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Calling method '.version_select at 0x7fb8481b1820>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:25.939357 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:25.939357 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:25.972963 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-b217d4e9-82c8-461b-9855-79c3a88875d1 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b217d4e9-82c8-461b-9855-79c3a88875d1 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Request method failure captured: Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi1398MbLt8Xf2Xq-Dy0xUK7njqd8K-4xQ9oPgZtiEAL25aTMR4zmu4ijzFaAJN6SRznOu092-klCOoLoJTpiEcuAWdpHGyJNW3uK6pnvUabZkfnCbqhwy_l8J9tsHLiCi_-ndb5WRWXgfD0R9PIsr0LFRLtRf4XtJMwTLRQ4LCd5-5t8 Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:25.991070 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 860183749e694f688417d2e19cb819aa Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:07:25.992677 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:25.993329 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:07:25.994297 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:25.995233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:25.999286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b217d4e9-82c8-461b-9855-79c3a88875d1 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:26.005772 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b217d4e9-82c8-461b-9855-79c3a88875d1 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.077853 Jul 20 04:07:26.009189 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 40/113] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 04:07:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:26.019488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fff32a27-6c51-4909-b128-e9f9195364a8 tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Calling method '.version_select at 0x7fb842ffd1f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:26.021476 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:26.021476 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:26.021688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fff32a27-6c51-4909-b128-e9f9195364a8 tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'd9e44f194e784f04936b03eaea67927d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba669012dc3a445c8cb0da30e2403579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fff32a27-6c51-4909-b128-e9f9195364a8 tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Request method failure captured: Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hosts/n-d-760456-11/startup HTTP/1.1 Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1396ucvufv0Qs3FT5K-Vk4W47-DCGIOlMlXUJ1nlsfIe228ifX9t4xOilo3qd_hqxlpW7OllSBQ93dE1Oy59-jF_3weIC0Fr-udNDQmgLh4NDwRVyO5WT5eP5hQrSJxjZgXQxZzDnlt-_03wUHl7xzG4G_FFz-GJ6meUTYdYFO1y3rw Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:26.025069 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: d9e44f194e784f04936b03eaea67927d Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'n-d-760456-11'} Jul 20 04:07:26.026198 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:26.026907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:07:26.027885 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.028907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fff32a27-6c51-4909-b128-e9f9195364a8 tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:26.029448 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fff32a27-6c51-4909-b128-e9f9195364a8 tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-d-760456-11/startup" status: 403 len: 110 microversion: 2.1 time: 0.015607 Jul 20 04:07:26.041233 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 74/114] 10.222.0.59 () {58 vars in 1193 bytes} [Wed Jul 20 04:07:26 2022] GET /compute/v2.1/os-hosts/n-d-760456-11/startup => generated 110 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:26.053777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d2f5caa5-f15e-4fe2-bbc6-1756318cb8dc tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Calling method '.version_select at 0x7fb842f6f280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:26.053777 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:26.053777 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:26.100312 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-d2f5caa5-f15e-4fe2-bbc6-1756318cb8dc tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d2f5caa5-f15e-4fe2-bbc6-1756318cb8dc tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Request method failure captured: Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi1398MbLt8Xf2Xq-Dy0xUK7njqd8K-4xQ9oPgZtiEAL25aTMR4zmu4ijzFaAJN6SRznOu092-klCOoLoJTpiEcuAWdpHGyJNW3uK6pnvUabZkfnCbqhwy_l8J9tsHLiCi_-ndb5WRWXgfD0R9PIsr0LFRLtRf4XtJMwTLRQ4LCd5-5t8 Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:26.105303 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 860183749e694f688417d2e19cb819aa Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:07:26.106697 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:26.107375 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:07:26.108363 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d2f5caa5-f15e-4fe2-bbc6-1756318cb8dc tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:26.110156 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d2f5caa5-f15e-4fe2-bbc6-1756318cb8dc tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.060440 Jul 20 04:07:26.115611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:26.125078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fccb1800-4c0b-46c0-8b36-868d0e517777 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Action: 'update', calling method: .version_select at 0x7fb842fc1d30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fccb1800-4c0b-46c0-8b36-868d0e517777 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Request method failure captured: Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/os-hosts/n-d-760456-11 HTTP/1.1 Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 51 Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1398MbLt8Xf2Xq-Dy0xUK7njqd8K-4xQ9oPgZtiEAL25aTMR4zmu4ijzFaAJN6SRznOu092-klCOoLoJTpiEcuAWdpHGyJNW3uK6pnvUabZkfnCbqhwy_l8J9tsHLiCi_-ndb5WRWXgfD0R9PIsr0LFRLtRf4XtJMwTLRQ4LCd5-5t8 Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:07:26.142556 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 860183749e694f688417d2e19cb819aa Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: {"status": "enable", "maintenance_mode": "invalid"} Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:26.143851 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'n-d-760456-11', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.144524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.145783 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.146849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.146849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:07:26.146849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:07:26.146849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:07:26.146849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.146849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fccb1800-4c0b-46c0-8b36-868d0e517777 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:26.146849 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fccb1800-4c0b-46c0-8b36-868d0e517777 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-hosts/n-d-760456-11" status: 400 len: 199 microversion: 2.1 time: 0.029219 Jul 20 04:07:26.146849 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 75/116] 10.222.0.59 () {60 vars in 1189 bytes} [Wed Jul 20 04:07:26 2022] PUT /compute/v2.1/os-hosts/n-d-760456-11 => generated 199 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:07:26.147375 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 41/116] 10.222.0.59 () {58 vars in 1214 bytes} [Wed Jul 20 04:07:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:26.174034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b5f2cfe-8d6b-47e4-a64c-080f8ea8a6b2 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Action: 'update', calling method: .version_select at 0x7fb842f843a0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b5f2cfe-8d6b-47e4-a64c-080f8ea8a6b2 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Request method failure captured: Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/os-hosts/n-d-760456-11 HTTP/1.1 Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 51 Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1398MbLt8Xf2Xq-Dy0xUK7njqd8K-4xQ9oPgZtiEAL25aTMR4zmu4ijzFaAJN6SRznOu092-klCOoLoJTpiEcuAWdpHGyJNW3uK6pnvUabZkfnCbqhwy_l8J9tsHLiCi_-ndb5WRWXgfD0R9PIsr0LFRLtRf4XtJMwTLRQ4LCd5-5t8 Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:07:26.186554 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 860183749e694f688417d2e19cb819aa Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: {"status": "invalid", "maintenance_mode": "enable"} Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:26.187851 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'n-d-760456-11', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.188605 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.190143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.193094 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.193094 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:07:26.193094 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:07:26.193094 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:07:26.193094 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.193094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b5f2cfe-8d6b-47e4-a64c-080f8ea8a6b2 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:26.193094 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b5f2cfe-8d6b-47e4-a64c-080f8ea8a6b2 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-hosts/n-d-760456-11" status: 400 len: 189 microversion: 2.1 time: 0.026649 Jul 20 04:07:26.201989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1892084f-1a61-414a-888c-fe7e2bdade9d tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Action: 'update', calling method: .version_select at 0x7fb8481b14c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:26.203632 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:26.203632 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:26.204641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1892084f-1a61-414a-888c-fe7e2bdade9d tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'd9e44f194e784f04936b03eaea67927d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba669012dc3a445c8cb0da30e2403579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:26.209323 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 76/117] 10.222.0.59 () {60 vars in 1189 bytes} [Wed Jul 20 04:07:26 2022] PUT /compute/v2.1/os-hosts/n-d-760456-11 => generated 189 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1892084f-1a61-414a-888c-fe7e2bdade9d tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Request method failure captured: Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: request: PUT /compute/v2.1/os-hosts/n-d-760456-11 HTTP/1.1 Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 50 Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi1396ucvufv0Qs3FT5K-Vk4W47-DCGIOlMlXUJ1nlsfIe228ifX9t4xOilo3qd_hqxlpW7OllSBQ93dE1Oy59-jF_3weIC0Fr-udNDQmgLh4NDwRVyO5WT5eP5hQrSJxjZgXQxZzDnlt-_03wUHl7xzG4G_FFz-GJ6meUTYdYFO1y3rw Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:26.210101 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ba669012dc3a445c8cb0da30e2403579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ba669012dc3a445c8cb0da30e2403579 Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-778955633 Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: d9e44f194e784f04936b03eaea67927d Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-HostsAdminNegativeTestJSON-778955633-project Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: {"status": "enable", "maintenance_mode": "enable"} Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:07:26.211472 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'n-d-760456-11', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:26.212373 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:07:26.213498 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.215258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1892084f-1a61-414a-888c-fe7e2bdade9d tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:26.215490 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1892084f-1a61-414a-888c-fe7e2bdade9d tempest-HostsAdminNegativeTestJSON-778955633 tempest-HostsAdminNegativeTestJSON-778955633-project] 10.222.0.59 "PUT /compute/v2.1/os-hosts/n-d-760456-11" status: 403 len: 111 microversion: 2.1 time: 0.018862 Jul 20 04:07:26.220373 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 42/118] 10.222.0.59 () {60 vars in 1189 bytes} [Wed Jul 20 04:07:26 2022] PUT /compute/v2.1/os-hosts/n-d-760456-11 => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:26.231297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5db4778-aa8e-47e7-a305-fd43873d55f9 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Action: 'update', calling method: .version_select at 0x7fb842fc1ee0>, body: {"status": null, "maintenance_mode": null} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5db4778-aa8e-47e7-a305-fd43873d55f9 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Request method failure captured: Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/os-hosts/n-d-760456-11 HTTP/1.1 Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 42 Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1398MbLt8Xf2Xq-Dy0xUK7njqd8K-4xQ9oPgZtiEAL25aTMR4zmu4ijzFaAJN6SRznOu092-klCOoLoJTpiEcuAWdpHGyJNW3uK6pnvUabZkfnCbqhwy_l8J9tsHLiCi_-ndb5WRWXgfD0R9PIsr0LFRLtRf4XtJMwTLRQ4LCd5-5t8 Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:07:26.236442 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 860183749e694f688417d2e19cb819aa Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: {"status": null, "maintenance_mode": null} Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:07:26.237752 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'n-d-760456-11', 'body': {'status': None, 'maintenance_mode': None}} Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi None Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.238620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.240042 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.240977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:07:26.240977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:07:26.240977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:07:26.240977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.240977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5db4778-aa8e-47e7-a305-fd43873d55f9 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:26.248984 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5db4778-aa8e-47e7-a305-fd43873d55f9 tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-hosts/n-d-760456-11" status: 400 len: 127 microversion: 2.1 time: 0.022918 Jul 20 04:07:26.253824 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 77/119] 10.222.0.59 () {60 vars in 1189 bytes} [Wed Jul 20 04:07:26 2022] PUT /compute/v2.1/os-hosts/n-d-760456-11 => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:07:26.264112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-532f08f3-268a-4a8e-9d20-fde498c1089b tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Action: 'update', calling method: .version_select at 0x7fb842f065e0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:26.267484 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.hosts [None req-532f08f3-268a-4a8e-9d20-fde498c1089b tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Enabling host nonexistent_hostname. Jul 20 04:07:26.298859 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-532f08f3-268a-4a8e-9d20-fde498c1089b tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-532f08f3-268a-4a8e-9d20-fde498c1089b tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Request method failure captured: Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 50 Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi1398MbLt8Xf2Xq-Dy0xUK7njqd8K-4xQ9oPgZtiEAL25aTMR4zmu4ijzFaAJN6SRznOu092-klCOoLoJTpiEcuAWdpHGyJNW3uK6pnvUabZkfnCbqhwy_l8J9tsHLiCi_-ndb5WRWXgfD0R9PIsr0LFRLtRf4XtJMwTLRQ4LCd5-5t8 Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:26.302328 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5751c60ac1bd4f8d8c611136b50dc458"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 5751c60ac1bd4f8d8c611136b50dc458 Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246160434 Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 860183749e694f688417d2e19cb819aa Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246160434-project-admin Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: {"status": "enable", "maintenance_mode": "enable"} Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:26.303760 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:07:26.304833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:26.305940 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:26.308382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-532f08f3-268a-4a8e-9d20-fde498c1089b tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:26.310143 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-532f08f3-268a-4a8e-9d20-fde498c1089b tempest-HostsAdminNegativeTestJSON-246160434 tempest-HostsAdminNegativeTestJSON-246160434-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.049665 Jul 20 04:07:26.310428 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 43/120] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Jul 20 04:07:26 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:26.908003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b6c8f84d-5abe-4b41-b6bd-edabe0e60163 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:26.909829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b6c8f84d-5abe-4b41-b6bd-edabe0e60163 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:26.935876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6c8f84d-5abe-4b41-b6bd-edabe0e60163 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:26.936342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6c8f84d-5abe-4b41-b6bd-edabe0e60163 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:26.937159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6c8f84d-5abe-4b41-b6bd-edabe0e60163 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:26.937633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6c8f84d-5abe-4b41-b6bd-edabe0e60163 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:27.369737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6da3221e-a663-4b87-b6d7-84e608cf3592 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Action: 'create', calling method: .version_select at 0x7fb84833a700>, body: {"keypair": {"name": "tempest-keypair-1547335326", "type": "ssh", "user_id": "89429bd6eb8040aa8e632d6c8c89fcd3", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3vsqcO0XSxiB01FqXrEFlujndhW8MR1lxKHSw4hrgkOiAc0WbzsznoMGObiJ8/X5rcilhrnkzLVKU/EjKuToYxlcbUpT9LGCX8z5pOeX33mlvLOyHBcjwRAkI3fnrA5A=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:27.432899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-6da3221e-a663-4b87-b6d7-84e608cf3592 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Getting quotas for project 679d0b4c638b4b7daee7605b2824453a. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:07:27.449888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-6da3221e-a663-4b87-b6d7-84e608cf3592 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Getting quotas for user f8428a48972d4e80ad457d53a6322259 and project 679d0b4c638b4b7daee7605b2824453a. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:07:27.513071 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6da3221e-a663-4b87-b6d7-84e608cf3592 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.399613 Jul 20 04:07:27.513762 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 44/121] 10.222.0.59 () {62 vars in 1199 bytes} [Wed Jul 20 04:07:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 406 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 20 04:07:27.530797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-98fcee7e-8e79-428e-80f5-1a287a0a8515 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Action: 'create', calling method: .version_select at 0x7fb8482f8af0>, body: {"keypair": {"name": "tempest-keypair-1714488215", "type": "ssh", "user_id": "89429bd6eb8040aa8e632d6c8c89fcd3", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEHYPg5g7NtqjVoUDxUcrg/0//WSSA0dEyYcUfZ4ZFYbpNpHgTEO34owj5LrBwN4CMufYzPTlhnbJqDtFUY5QMJXaIuRSaWAATY4I5ArasduxGwcFKVrirXKt4q8OkmFw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:27.553890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=81,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:27.582395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b6c8f84d-5abe-4b41-b6bd-edabe0e60163 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:27.607608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-98fcee7e-8e79-428e-80f5-1a287a0a8515 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Getting quotas for project 679d0b4c638b4b7daee7605b2824453a. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:07:27.618735 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b6c8f84d-5abe-4b41-b6bd-edabe0e60163 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 0.711995 Jul 20 04:07:27.622289 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 78/122] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:26 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:27.633645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-98fcee7e-8e79-428e-80f5-1a287a0a8515 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Getting quotas for user f8428a48972d4e80ad457d53a6322259 and project 679d0b4c638b4b7daee7605b2824453a. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:07:27.712018 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-98fcee7e-8e79-428e-80f5-1a287a0a8515 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.189580 Jul 20 04:07:27.712634 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 45/123] 10.222.0.59 () {62 vars in 1199 bytes} [Wed Jul 20 04:07:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 20 04:07:27.727081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c46c09ab-827b-41a3-a90b-84d8669e3786 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Calling method '.version_select at 0x7fb8480e33a0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:27.764358 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c46c09ab-827b-41a3-a90b-84d8669e3786 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] 10.222.0.59 "GET /compute/v2.1/os-keypairs/tempest-keypair-1547335326?user_id=89429bd6eb8040aa8e632d6c8c89fcd3" status: 200 len: 512 microversion: 2.10 time: 0.040302 Jul 20 04:07:27.767219 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 46/124] 10.222.0.59 () {60 vars in 1339 bytes} [Wed Jul 20 04:07:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1547335326?user_id=89429bd6eb8040aa8e632d6c8c89fcd3 => generated 512 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:27.801077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-068a49a6-46ea-48fa-956f-ef677b231ad2 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Action: 'create', calling method: .version_select at 0x7fb8480b8280>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2099535416", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe4KroWSanYYJQ8+/7vfxxG2skTWQpfH3JgKhzhVxAviKWSIObwgIXYOUGWPxYgmpBEe11nov+6eaE2rqrKPB0SYWzkDOijhtiEtwvJESdoCohNPACFlw9ZLFQFI3BtRQ=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:27.875926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-068a49a6-46ea-48fa-956f-ef677b231ad2 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Getting quotas for project 679d0b4c638b4b7daee7605b2824453a. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:07:27.899382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-068a49a6-46ea-48fa-956f-ef677b231ad2 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Getting quotas for user f8428a48972d4e80ad457d53a6322259 and project 679d0b4c638b4b7daee7605b2824453a. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:07:27.990946 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-068a49a6-46ea-48fa-956f-ef677b231ad2 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.216743 Jul 20 04:07:27.991544 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 47/125] 10.222.0.59 () {62 vars in 1199 bytes} [Wed Jul 20 04:07:27 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 218 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:07:28.003790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-734ff1e8-e5d7-4d97-adc3-15493e221750 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Calling method '.version_select at 0x7fb842f06940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:28.006633 n-d-760456-11 devstack@n-api.service[119605]: WARNING oslo_db.sqlalchemy.utils [None req-734ff1e8-e5d7-4d97-adc3-15493e221750 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:07:28.033046 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-734ff1e8-e5d7-4d97-adc3-15493e221750 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] 10.222.0.59 "GET /compute/v2.1/os-keypairs?user_id=89429bd6eb8040aa8e632d6c8c89fcd3" status: 200 len: 726 microversion: 2.10 time: 0.032778 Jul 20 04:07:28.043613 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 48/126] 10.222.0.59 () {60 vars in 1258 bytes} [Wed Jul 20 04:07:27 2022] GET /compute/v2.1/os-keypairs?user_id=89429bd6eb8040aa8e632d6c8c89fcd3 => generated 726 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:07:28.055202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e7581264-f534-4ca6-8e6b-2193f2867f65 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Calling method '.version_select at 0x7fb8480e33a0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:28.132069 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e7581264-f534-4ca6-8e6b-2193f2867f65 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2099535416" status: 204 len: 0 microversion: 2.10 time: 0.081456 Jul 20 04:07:28.133689 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 49/127] 10.222.0.59 () {60 vars in 1324 bytes} [Wed Jul 20 04:07:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2099535416 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:07:28.162403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2c44749c-1c21-4462-b5ad-5c265912dbe4 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Calling method '.version_select at 0x7fb842f6f670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:28.203838 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2c44749c-1c21-4462-b5ad-5c265912dbe4 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714488215?user_id=89429bd6eb8040aa8e632d6c8c89fcd3" status: 204 len: 0 microversion: 2.10 time: 0.064462 Jul 20 04:07:28.209217 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 50/128] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:07:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714488215?user_id=89429bd6eb8040aa8e632d6c8c89fcd3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:07:28.216008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-49e6dd0a-f3d1-4e62-99d4-3405c694b534 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] Calling method '.version_select at 0x7fb8481b1700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:28.238542 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-49e6dd0a-f3d1-4e62-99d4-3405c694b534 tempest-KeyPairsV210TestJSON-2044577013 tempest-KeyPairsV210TestJSON-2044577013-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547335326?user_id=89429bd6eb8040aa8e632d6c8c89fcd3" status: 204 len: 0 microversion: 2.10 time: 0.028056 Jul 20 04:07:28.244113 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 51/129] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:07:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547335326?user_id=89429bd6eb8040aa8e632d6c8c89fcd3 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:07:28.369252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4cf87015-96dc-49f3-89a1-5ec4f6b5ba5a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:28.395203 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4cf87015-96dc-49f3-89a1-5ec4f6b5ba5a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.702339 Jul 20 04:07:28.396703 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 79/130] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:07:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:28.638854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-47074fc1-0ffd-49ff-a5c2-89ec7a19521e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:28.639479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-47074fc1-0ffd-49ff-a5c2-89ec7a19521e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:28.655334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47074fc1-0ffd-49ff-a5c2-89ec7a19521e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:28.662828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47074fc1-0ffd-49ff-a5c2-89ec7a19521e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:28.665088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47074fc1-0ffd-49ff-a5c2-89ec7a19521e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:28.665551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47074fc1-0ffd-49ff-a5c2-89ec7a19521e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:28.685544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=61 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:28.861459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fd30ef88-226d-4e0b-a4d8-6c1c931e1854 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-717708176", "id": 1576664184, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:28.866208 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:28.866208 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:28.919963 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fd30ef88-226d-4e0b-a4d8-6c1c931e1854 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.515576 Jul 20 04:07:28.926306 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 52/131] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:28 2022] POST /compute/v2.1/flavors => generated 424 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:28.933388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d79732fc-c644-4c73-a61b-245296ef50a1 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:28.958729 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d79732fc-c644-4c73-a61b-245296ef50a1 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030839 Jul 20 04:07:28.961911 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 53/132] 10.222.0.59 () {58 vars in 1181 bytes} [Wed Jul 20 04:07:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:28.975089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d52ba507-052c-445a-b7d4-e072bb30e525 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-103717129", "id": 691925149, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:29.007740 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d52ba507-052c-445a-b7d4-e072bb30e525 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.038570 Jul 20 04:07:29.008889 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 54/133] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:28 2022] POST /compute/v2.1/flavors => generated 421 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:29.024387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34b5dbb7-59a6-4c4e-8b64-f2438714fcb3 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:29.053417 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-34b5dbb7-59a6-4c4e-8b64-f2438714fcb3 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035603 Jul 20 04:07:29.055334 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 55/134] 10.222.0.59 () {58 vars in 1181 bytes} [Wed Jul 20 04:07:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:29.070894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bfaebd17-1868-4df5-bbbb-1015f732590a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Action: 'create', calling method: .version_select at 0x7fb842f068b0>, body: {"keypair": {"name": "tempest-keypair-295056878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMbeWaUZcZ2x6U5b3WWtqIb1aSIQIva8mcbLPTQ6brzGpgJoscVEahLn8HE+pRuDbXbir8jZ+u3E1wJRCXk5gZN9vsLM8FDEKOoxPkhvBNkcjSPYfvEdm0J0UcAZCqHaA=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:29.097585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-bfaebd17-1868-4df5-bbbb-1015f732590a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Getting quotas for project e4208e8570ad4fc597f5cc44f7785171. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:07:29.104367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-bfaebd17-1868-4df5-bbbb-1015f732590a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Getting quotas for user c5dc8e2f30ce43ebb7919cdd1ab417ef and project e4208e8570ad4fc597f5cc44f7785171. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:07:29.141103 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bfaebd17-1868-4df5-bbbb-1015f732590a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075329 Jul 20 04:07:29.142145 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 56/135] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:07:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:29.169877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-47074fc1-0ffd-49ff-a5c2-89ec7a19521e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:29.182152 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-47074fc1-0ffd-49ff-a5c2-89ec7a19521e tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 0.548294 Jul 20 04:07:29.183734 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 80/136] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:28 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:30.027054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c925e017-5f99-4aca-a311-cf03264cec6b req-96b722bb-1cf8-4ecf-99a8-f6dde154b1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e", "name": "network-vif-plugged", "status": "completed", "tag": "d4cdfd38-bf9e-44b6-9bfd-1b4a9a87904e"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:30.051721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c925e017-5f99-4aca-a311-cf03264cec6b req-96b722bb-1cf8-4ecf-99a8-f6dde154b1ad service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:30.052171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c925e017-5f99-4aca-a311-cf03264cec6b req-96b722bb-1cf8-4ecf-99a8-f6dde154b1ad service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:30.081719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=69 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:30.100971 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c925e017-5f99-4aca-a311-cf03264cec6b req-96b722bb-1cf8-4ecf-99a8-f6dde154b1ad service nova] Creating event network-vif-plugged:d4cdfd38-bf9e-44b6-9bfd-1b4a9a87904e for instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e on n-h1-760456-11 Jul 20 04:07:30.101605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c925e017-5f99-4aca-a311-cf03264cec6b req-96b722bb-1cf8-4ecf-99a8-f6dde154b1ad service nova] Acquired lock "compute-rpcapi-router" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:07:30.103214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a8ae685-c199-45b0-8146-3158b7c59092 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:30.103828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a8ae685-c199-45b0-8146-3158b7c59092 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:30.106623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a8ae685-c199-45b0-8146-3158b7c59092 None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:30.108896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a8ae685-c199-45b0-8146-3158b7c59092 None None] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:30.139624 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.compute.rpcapi [None req-2a8ae685-c199-45b0-8146-3158b7c59092 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 04:07:30.141108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a8ae685-c199-45b0-8146-3158b7c59092 None None] Releasing lock "compute-rpcapi-router" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:07:30.189355 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a8ae685-c199-45b0-8146-3158b7c59092 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275418 Jul 20 04:07:30.190682 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 57/137] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:30.201395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2dad10e1-083a-4865-89af-7e0e345c5894 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:30.202673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2dad10e1-083a-4865-89af-7e0e345c5894 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:30.213016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2dad10e1-083a-4865-89af-7e0e345c5894 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:30.231470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2dad10e1-083a-4865-89af-7e0e345c5894 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:30.232284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2dad10e1-083a-4865-89af-7e0e345c5894 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:30.238652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2dad10e1-083a-4865-89af-7e0e345c5894 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:31.197123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2dad10e1-083a-4865-89af-7e0e345c5894 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:31.211992 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2dad10e1-083a-4865-89af-7e0e345c5894 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 1.013477 Jul 20 04:07:31.218193 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 81/138] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:30 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:32.160048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d942a4c-9daa-46ff-a039-35550d315b50 tempest-InstanceUsageAuditLogTestJSON-1668227210 tempest-InstanceUsageAuditLogTestJSON-1668227210-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:32.160894 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:32.160894 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:32.203744 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4d942a4c-9daa-46ff-a039-35550d315b50 tempest-InstanceUsageAuditLogTestJSON-1668227210 tempest-InstanceUsageAuditLogTestJSON-1668227210-project-admin] 10.222.0.59 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20 04:07:31" status: 200 len: 318 microversion: 2.1 time: 0.534489 Jul 20 04:07:32.213091 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 58/139] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 04:07:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004%3A07%3A31 => generated 318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:32.218587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f61e6e4-6ebb-43b9-bb4b-8fe55f4589a6 tempest-InstanceUsageAuditLogTestJSON-1668227210 tempest-InstanceUsageAuditLogTestJSON-1668227210-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:32.219770 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:32.219770 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:32.233579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dd850c0f-461f-499d-a40d-cc9166556455 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:32.234604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dd850c0f-461f-499d-a40d-cc9166556455 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:32.248684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd850c0f-461f-499d-a40d-cc9166556455 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:32.249160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd850c0f-461f-499d-a40d-cc9166556455 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:32.250135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd850c0f-461f-499d-a40d-cc9166556455 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:32.252248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd850c0f-461f-499d-a40d-cc9166556455 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:32.265788 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f61e6e4-6ebb-43b9-bb4b-8fe55f4589a6 tempest-InstanceUsageAuditLogTestJSON-1668227210 tempest-InstanceUsageAuditLogTestJSON-1668227210-project-admin] 10.222.0.59 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.053193 Jul 20 04:07:32.276441 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 82/140] 10.222.0.59 () {58 vars in 1184 bytes} [Wed Jul 20 04:07:32 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:33.678904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dd850c0f-461f-499d-a40d-cc9166556455 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:33.693067 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dd850c0f-461f-499d-a40d-cc9166556455 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1339 microversion: 2.1 time: 1.463365 Jul 20 04:07:33.694038 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 59/141] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:32 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1339 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:33.887619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1248380372", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "691925149", "adminPass": "***", "networks": [{"uuid": "959e7597-ad54-4e7a-82f9-9bba1080a6fa"}], "security_groups": [{"name": "tempest-securitygroup--1996471354"}], "key_name": "tempest-keypair-295056878", "user_data": "}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:33.899944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-df6aa2e0-ec1a-492f-8df3-faf3efc6ba8c tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Calling method '.version_select at 0x7fb842f84ee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:33.900840 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:33.900840 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:33.903762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df6aa2e0-ec1a-492f-8df3-faf3efc6ba8c tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:33.904238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df6aa2e0-ec1a-492f-8df3-faf3efc6ba8c tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:33.952330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df6aa2e0-ec1a-492f-8df3-faf3efc6ba8c tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:33.953002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df6aa2e0-ec1a-492f-8df3-faf3efc6ba8c tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:33.989564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df6aa2e0-ec1a-492f-8df3-faf3efc6ba8c tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:33.990017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df6aa2e0-ec1a-492f-8df3-faf3efc6ba8c tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.033636 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-df6aa2e0-ec1a-492f-8df3-faf3efc6ba8c tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.392875 Jul 20 04:07:34.034277 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 83/142] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:33 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:34.053826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e1eec255-11d3-4991-bc15-41e545ced58f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Calling method '.version_select at 0x7fb842ffd280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.056390 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:34.056390 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:34.057593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1eec255-11d3-4991-bc15-41e545ced58f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.058116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1eec255-11d3-4991-bc15-41e545ced58f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.086747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1eec255-11d3-4991-bc15-41e545ced58f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.087625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1eec255-11d3-4991-bc15-41e545ced58f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.114110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1eec255-11d3-4991-bc15-41e545ced58f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.116270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1eec255-11d3-4991-bc15-41e545ced58f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.132552 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e1eec255-11d3-4991-bc15-41e545ced58f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1508 microversion: 2.1 time: 0.086676 Jul 20 04:07:34.152392 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 84/143] 10.222.0.59 () {58 vars in 1166 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1508 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:34.160677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2a16e50d-cb0b-4c47-aeb1-3e1ea8a9eb72 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Calling method '.version_select at 0x7fb842f84e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.161939 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:34.161939 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:34.163396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a16e50d-cb0b-4c47-aeb1-3e1ea8a9eb72 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.164044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a16e50d-cb0b-4c47-aeb1-3e1ea8a9eb72 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.183382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] validate_networks() for [('959e7597-ad54-4e7a-82f9-9bba1080a6fa', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:07:34.207960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a16e50d-cb0b-4c47-aeb1-3e1ea8a9eb72 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.210326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a16e50d-cb0b-4c47-aeb1-3e1ea8a9eb72 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.235534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a16e50d-cb0b-4c47-aeb1-3e1ea8a9eb72 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.238480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a16e50d-cb0b-4c47-aeb1-3e1ea8a9eb72 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.252962 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2a16e50d-cb0b-4c47-aeb1-3e1ea8a9eb72 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.097185 Jul 20 04:07:34.253665 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 85/144] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:34.265998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ad847619-acbf-4a9d-b2d6-2455f14d5371 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Calling method '.version_select at 0x7fb842f84af0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.268965 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:34.268965 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:34.271791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad847619-acbf-4a9d-b2d6-2455f14d5371 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.272271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad847619-acbf-4a9d-b2d6-2455f14d5371 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.336030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad847619-acbf-4a9d-b2d6-2455f14d5371 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.338658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad847619-acbf-4a9d-b2d6-2455f14d5371 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.375088 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ad847619-acbf-4a9d-b2d6-2455f14d5371 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.113537 Jul 20 04:07:34.375771 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 86/145] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:34.397044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0faa5e02-9f90-48df-bb52-ae002783415d tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Calling method '.version_select at 0x7fb8489ec550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.397956 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:34.397956 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:34.404662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0faa5e02-9f90-48df-bb52-ae002783415d tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.410992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0faa5e02-9f90-48df-bb52-ae002783415d tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.485469 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0faa5e02-9f90-48df-bb52-ae002783415d tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.098025 Jul 20 04:07:34.501684 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 87/146] 10.222.0.59 () {58 vars in 1178 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:34.516477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8485bc95-792e-435e-a91a-a14f842617ff tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Calling method '.version_select at 0x7fb842f84940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.517465 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:34.517465 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:34.523080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8485bc95-792e-435e-a91a-a14f842617ff tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.524847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8485bc95-792e-435e-a91a-a14f842617ff tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.567257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8485bc95-792e-435e-a91a-a14f842617ff tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.567723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8485bc95-792e-435e-a91a-a14f842617ff tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.598180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8485bc95-792e-435e-a91a-a14f842617ff tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.598706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8485bc95-792e-435e-a91a-a14f842617ff tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.610535 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8485bc95-792e-435e-a91a-a14f842617ff tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.098312 Jul 20 04:07:34.612556 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 88/147] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:34.624898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-82cf9509-09db-4ba9-a4bf-17135f8fc693 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Calling method '.version_select at 0x7fb842f84160>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.626044 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:34.626044 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:34.630657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82cf9509-09db-4ba9-a4bf-17135f8fc693 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.632265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82cf9509-09db-4ba9-a4bf-17135f8fc693 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.670757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82cf9509-09db-4ba9-a4bf-17135f8fc693 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.671670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82cf9509-09db-4ba9-a4bf-17135f8fc693 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.685343 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-82cf9509-09db-4ba9-a4bf-17135f8fc693 tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.067038 Jul 20 04:07:34.691413 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 89/148] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:34.703181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baa183dd-ed4b-4329-97bf-eb1c2f872d4f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Calling method '.version_select at 0x7fb842ffd5e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.704248 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:34.704248 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:34.705744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa183dd-ed4b-4329-97bf-eb1c2f872d4f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.706386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa183dd-ed4b-4329-97bf-eb1c2f872d4f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.733762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa183dd-ed4b-4329-97bf-eb1c2f872d4f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.734541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa183dd-ed4b-4329-97bf-eb1c2f872d4f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.750700 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-baa183dd-ed4b-4329-97bf-eb1c2f872d4f tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.048962 Jul 20 04:07:34.752584 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 90/149] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:34.764301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4c0f40b6-a86d-4f64-8719-0bb58fdbb138 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.765222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4c0f40b6-a86d-4f64-8719-0bb58fdbb138 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:34.769104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:RELEASE=7,nova_api:SAVEPOINT=6,nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:34.784244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c0f40b6-a86d-4f64-8719-0bb58fdbb138 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.786945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c0f40b6-a86d-4f64-8719-0bb58fdbb138 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:34.787867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c0f40b6-a86d-4f64-8719-0bb58fdbb138 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:34.794957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c0f40b6-a86d-4f64-8719-0bb58fdbb138 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:35.049706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4c0f40b6-a86d-4f64-8719-0bb58fdbb138 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:35.078198 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4c0f40b6-a86d-4f64-8719-0bb58fdbb138 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1489 microversion: 2.1 time: 0.324318 Jul 20 04:07:35.081304 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 91/150] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1489 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:35.127308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2fa41a2f-c654-4d9e-8ff3-83cc9b473bac tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Calling method '.version_select at 0x7fb842f545e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:35.128080 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:35.128080 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:35.129295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fa41a2f-c654-4d9e-8ff3-83cc9b473bac tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:35.129749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fa41a2f-c654-4d9e-8ff3-83cc9b473bac tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:35.174332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fa41a2f-c654-4d9e-8ff3-83cc9b473bac tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:35.174785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fa41a2f-c654-4d9e-8ff3-83cc9b473bac tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:35.213085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fa41a2f-c654-4d9e-8ff3-83cc9b473bac tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:35.213523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fa41a2f-c654-4d9e-8ff3-83cc9b473bac tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:35.277987 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2fa41a2f-c654-4d9e-8ff3-83cc9b473bac tempest-HypervisorAdminTestJSON-760001655 tempest-HypervisorAdminTestJSON-760001655-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.167727 Jul 20 04:07:35.280080 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 92/151] 10.222.0.59 () {58 vars in 1172 bytes} [Wed Jul 20 04:07:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:35.290296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bccb95d0-075c-4900-85e9-08fed73ed518 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:35.291025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bccb95d0-075c-4900-85e9-08fed73ed518 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:35.308155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bccb95d0-075c-4900-85e9-08fed73ed518 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:35.308614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bccb95d0-075c-4900-85e9-08fed73ed518 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:35.314378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bccb95d0-075c-4900-85e9-08fed73ed518 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:35.315875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bccb95d0-075c-4900-85e9-08fed73ed518 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:36.072777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:07:36.073381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:07:36.074501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:07:36.075237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:07:36.075653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:07:36.098993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:36.099444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:36.100252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:36.100696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:36.189077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Getting quotas for project e4208e8570ad4fc597f5cc44f7785171. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:07:36.201841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Getting quotas for user c5dc8e2f30ce43ebb7919cdd1ab417ef and project e4208e8570ad4fc597f5cc44f7785171. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:07:36.247352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:07:36.252971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:07:36.255616 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bccb95d0-075c-4900-85e9-08fed73ed518 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1642 microversion: 2.1 time: 0.972821 Jul 20 04:07:36.260614 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 93/152] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:35 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1642 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:36.280193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-082456db-d0a9-41da-aff8-f62cee3c0075 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:36.281164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-082456db-d0a9-41da-aff8-f62cee3c0075 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:36.290412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-082456db-d0a9-41da-aff8-f62cee3c0075 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:36.291328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-082456db-d0a9-41da-aff8-f62cee3c0075 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:36.293047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-082456db-d0a9-41da-aff8-f62cee3c0075 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:36.293710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-082456db-d0a9-41da-aff8-f62cee3c0075 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:36.348209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-082456db-d0a9-41da-aff8-f62cee3c0075 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:07:36.377994 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d4506acd-953d-451b-9f8c-4e73e04ee53f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.495641 Jul 20 04:07:36.380697 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 60/153] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 2499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:07:36.402383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a69dabe8-665e-4356-9838-fd9539ee82ba tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:36.403391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a69dabe8-665e-4356-9838-fd9539ee82ba tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:36.627046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a69dabe8-665e-4356-9838-fd9539ee82ba tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:36.671811 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-082456db-d0a9-41da-aff8-f62cee3c0075 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 204 len: 0 microversion: 2.1 time: 0.397635 Jul 20 04:07:36.673189 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 94/154] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:07:36 2022] DELETE /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:07:36.687673 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a69dabe8-665e-4356-9838-fd9539ee82ba tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1262 microversion: 2.1 time: 0.299421 Jul 20 04:07:36.688296 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 61/155] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:36 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1262 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:36.689080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce6156c4-1bd7-4014-bcfc-d1faa0009ec3 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:36.691245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce6156c4-1bd7-4014-bcfc-d1faa0009ec3 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:36.722485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce6156c4-1bd7-4014-bcfc-d1faa0009ec3 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:36.723224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce6156c4-1bd7-4014-bcfc-d1faa0009ec3 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:36.725615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce6156c4-1bd7-4014-bcfc-d1faa0009ec3 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:36.730852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce6156c4-1bd7-4014-bcfc-d1faa0009ec3 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:37.088855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce6156c4-1bd7-4014-bcfc-d1faa0009ec3 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:37.103627 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce6156c4-1bd7-4014-bcfc-d1faa0009ec3 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1495 microversion: 2.1 time: 0.419414 Jul 20 04:07:37.118749 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 95/156] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:36 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1495 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:37.708212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-953a10ad-b2ec-4aea-9fc3-e317710a8b7f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:37.709235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-953a10ad-b2ec-4aea-9fc3-e317710a8b7f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:37.816445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-953a10ad-b2ec-4aea-9fc3-e317710a8b7f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:37.828354 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-953a10ad-b2ec-4aea-9fc3-e317710a8b7f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1262 microversion: 2.1 time: 0.123726 Jul 20 04:07:37.832574 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 62/157] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:37 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1262 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:38.124585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b87c437-0e1e-4188-92ce-59af61c25710 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:38.126061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4b87c437-0e1e-4188-92ce-59af61c25710 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:38.137614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b87c437-0e1e-4188-92ce-59af61c25710 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:38.138779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b87c437-0e1e-4188-92ce-59af61c25710 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:38.141006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b87c437-0e1e-4188-92ce-59af61c25710 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:38.146145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b87c437-0e1e-4188-92ce-59af61c25710 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:38.458534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4b87c437-0e1e-4188-92ce-59af61c25710 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:38.469717 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4b87c437-0e1e-4188-92ce-59af61c25710 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1495 microversion: 2.1 time: 0.349971 Jul 20 04:07:38.480474 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 96/158] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:38 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1495 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:38.850433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e1404b8-20b1-47a4-8ba2-9d96d02d272f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:38.851055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3e1404b8-20b1-47a4-8ba2-9d96d02d272f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:38.866406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e1404b8-20b1-47a4-8ba2-9d96d02d272f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:38.875990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e1404b8-20b1-47a4-8ba2-9d96d02d272f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:38.877318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e1404b8-20b1-47a4-8ba2-9d96d02d272f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:38.877839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e1404b8-20b1-47a4-8ba2-9d96d02d272f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:39.155242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6296ed08-c917-4879-bc76-4f369922a442 tempest-NetworksTest-2064459311 tempest-NetworksTest-2064459311-project-admin] Calling method '.version_select at 0x7fb8480b8160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:39.319912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3e1404b8-20b1-47a4-8ba2-9d96d02d272f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:39.322588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:39.340245 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3e1404b8-20b1-47a4-8ba2-9d96d02d272f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1322 microversion: 2.1 time: 0.494782 Jul 20 04:07:39.352521 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 97/159] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:38 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:39.491393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9139151e-5941-459c-864a-318691cb7340 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:39.492100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9139151e-5941-459c-864a-318691cb7340 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:39.511965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9139151e-5941-459c-864a-318691cb7340 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:39.512435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9139151e-5941-459c-864a-318691cb7340 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:39.514787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9139151e-5941-459c-864a-318691cb7340 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:39.515360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9139151e-5941-459c-864a-318691cb7340 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:39.790355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9139151e-5941-459c-864a-318691cb7340 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:39.809063 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9139151e-5941-459c-864a-318691cb7340 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1495 microversion: 2.1 time: 0.325073 Jul 20 04:07:39.819227 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 98/160] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:39 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1495 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:40.062994 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6296ed08-c917-4879-bc76-4f369922a442 tempest-NetworksTest-2064459311 tempest-NetworksTest-2064459311-project-admin] 10.222.0.59 "GET /compute/v2.1/os-networks" status: 200 len: 4719 microversion: 2.1 time: 1.535213 Jul 20 04:07:40.067731 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 63/161] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:07:38 2022] GET /compute/v2.1/os-networks => generated 4719 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:40.072560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06992c72-1c97-49d2-acec-e2ae404d6cc5 tempest-NetworksTest-2064459311 tempest-NetworksTest-2064459311-project-admin] Calling method '.version_select at 0x7fb842e633a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:40.185335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-92b03742-e2a1-4091-853e-4ee7c9432e9d req-ab23dd79-25ae-4fd3-8cb2-9f90927880e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e", "name": "network-vif-deleted", "tag": "d4cdfd38-bf9e-44b6-9bfd-1b4a9a87904e"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:40.209833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-92b03742-e2a1-4091-853e-4ee7c9432e9d req-ab23dd79-25ae-4fd3-8cb2-9f90927880e9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:40.211263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-92b03742-e2a1-4091-853e-4ee7c9432e9d req-ab23dd79-25ae-4fd3-8cb2-9f90927880e9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:40.235129 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-92b03742-e2a1-4091-853e-4ee7c9432e9d req-ab23dd79-25ae-4fd3-8cb2-9f90927880e9 service nova] Creating event network-vif-deleted:d4cdfd38-bf9e-44b6-9bfd-1b4a9a87904e for instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e on n-h1-760456-11 Jul 20 04:07:40.240389 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-92b03742-e2a1-4091-853e-4ee7c9432e9d req-ab23dd79-25ae-4fd3-8cb2-9f90927880e9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059713 Jul 20 04:07:40.241603 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 64/162] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:40.313838 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-06992c72-1c97-49d2-acec-e2ae404d6cc5 tempest-NetworksTest-2064459311 tempest-NetworksTest-2064459311-project-admin] 10.222.0.59 "GET /compute/v2.1/os-networks/b1f89390-4f46-4a2a-8cc8-f5bf1d50534f" status: 200 len: 652 microversion: 2.1 time: 0.244948 Jul 20 04:07:40.318551 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 99/163] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:07:40 2022] GET /compute/v2.1/os-networks/b1f89390-4f46-4a2a-8cc8-f5bf1d50534f => generated 652 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:40.328902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d591d0bc-7ba7-4dde-8e5d-fd73eba2f9b9 tempest-NetworksTest-2064459311 tempest-NetworksTest-2064459311-project-admin] Calling method '.version_select at 0x7fb842f6f670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:40.360313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d4b7cae5-56b6-4f22-8b50-f2bcad63501a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:40.361713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d4b7cae5-56b6-4f22-8b50-f2bcad63501a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:40.380575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4b7cae5-56b6-4f22-8b50-f2bcad63501a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:40.381809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4b7cae5-56b6-4f22-8b50-f2bcad63501a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:40.383402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4b7cae5-56b6-4f22-8b50-f2bcad63501a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:40.387351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4b7cae5-56b6-4f22-8b50-f2bcad63501a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:40.544465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d4b7cae5-56b6-4f22-8b50-f2bcad63501a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:40.554125 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d4b7cae5-56b6-4f22-8b50-f2bcad63501a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1320 microversion: 2.1 time: 0.197670 Jul 20 04:07:40.555061 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 100/164] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:40 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1320 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:41.032229 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d591d0bc-7ba7-4dde-8e5d-fd73eba2f9b9 tempest-NetworksTest-2064459311 tempest-NetworksTest-2064459311-project-admin] 10.222.0.59 "GET /compute/v2.1/os-networks" status: 200 len: 4719 microversion: 2.1 time: 0.708407 Jul 20 04:07:41.033475 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 65/165] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:07:40 2022] GET /compute/v2.1/os-networks => generated 4719 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:41.041876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:41.044174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:41.069797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:41.071016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:41.072781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:41.072781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:41.117557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:41.118528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:41.119996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lazy-loading 'fault' on Instance uuid 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:07:41.218912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e96c6ec5-643f-41f3-b3c6-d609c047af96 tempest-QuotaClassesAdminTestJSON-2123747071 tempest-QuotaClassesAdminTestJSON-2123747071-project-admin] Calling method '.version_select at 0x7fb842f5edc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:41.220682 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:41.220682 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:41.240476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee35434e090442e8ee148f66f96afdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54ca14804604df88d85aea23b5873d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:41.252894 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0d7ded93-c047-477e-b102-0be717dc317b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 200 len: 1329 microversion: 2.1 time: 0.212675 Jul 20 04:07:41.253568 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 66/166] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:41 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 1329 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:41.273110 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e96c6ec5-643f-41f3-b3c6-d609c047af96 tempest-QuotaClassesAdminTestJSON-2123747071 tempest-QuotaClassesAdminTestJSON-2123747071-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.715025 Jul 20 04:07:41.281180 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 101/167] 10.222.0.59 () {58 vars in 1184 bytes} [Wed Jul 20 04:07:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:41.291422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-542ebef6-5144-470f-a3d4-0e9bca0ab7e5 tempest-QuotaClassesAdminTestJSON-2123747071 tempest-QuotaClassesAdminTestJSON-2123747071-project-admin] Action: 'update', calling method: .version_select at 0x7fb84805ac10>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:41.293940 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:41.293940 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:41.306297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:41.589154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-690d0f4e-dab1-415f-853b-371bc7d3fdfa tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:41.590339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-690d0f4e-dab1-415f-853b-371bc7d3fdfa tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:41.612098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-690d0f4e-dab1-415f-853b-371bc7d3fdfa tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:41.612565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-690d0f4e-dab1-415f-853b-371bc7d3fdfa tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:41.613452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-690d0f4e-dab1-415f-853b-371bc7d3fdfa tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:41.615500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-690d0f4e-dab1-415f-853b-371bc7d3fdfa tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:41.844505 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-542ebef6-5144-470f-a3d4-0e9bca0ab7e5 tempest-QuotaClassesAdminTestJSON-2123747071 tempest-QuotaClassesAdminTestJSON-2123747071-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.557063 Jul 20 04:07:41.845661 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 67/168] 10.222.0.59 () {60 vars in 1205 bytes} [Wed Jul 20 04:07:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:41.865676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-690d0f4e-dab1-415f-853b-371bc7d3fdfa tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:41.880098 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-690d0f4e-dab1-415f-853b-371bc7d3fdfa tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1320 microversion: 2.1 time: 0.309189 Jul 20 04:07:41.883279 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 102/169] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:41 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:41.884050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-306d66d7-1bd6-454a-91ad-e76f23927441 tempest-QuotaClassesAdminTestJSON-2123747071 tempest-QuotaClassesAdminTestJSON-2123747071-project-admin] Calling method '.version_select at 0x7fb842ee3b80>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:41.885010 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:41.885010 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:41.918311 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-306d66d7-1bd6-454a-91ad-e76f23927441 tempest-QuotaClassesAdminTestJSON-2123747071 tempest-QuotaClassesAdminTestJSON-2123747071-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.041166 Jul 20 04:07:41.919290 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 68/170] 10.222.0.59 () {58 vars in 1184 bytes} [Wed Jul 20 04:07:41 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:41.935393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e510c11e-8a7c-43ca-a4b6-0fd8a64c04b7 tempest-QuotaClassesAdminTestJSON-2123747071 tempest-QuotaClassesAdminTestJSON-2123747071-project-admin] Action: 'update', calling method: .version_select at 0x7fb842e1d940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:41.937956 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:41.937956 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:42.161775 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e510c11e-8a7c-43ca-a4b6-0fd8a64c04b7 tempest-QuotaClassesAdminTestJSON-2123747071 tempest-QuotaClassesAdminTestJSON-2123747071-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.235320 Jul 20 04:07:42.163786 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 103/171] 10.222.0.59 () {60 vars in 1205 bytes} [Wed Jul 20 04:07:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:42.272350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa71ce2c-9cd4-4e5f-b0fa-d29ebe7d554a tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:42.273196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aa71ce2c-9cd4-4e5f-b0fa-d29ebe7d554a tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:42.294070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa71ce2c-9cd4-4e5f-b0fa-d29ebe7d554a tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:42.295149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa71ce2c-9cd4-4e5f-b0fa-d29ebe7d554a tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:42.295993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa71ce2c-9cd4-4e5f-b0fa-d29ebe7d554a tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:42.301097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa71ce2c-9cd4-4e5f-b0fa-d29ebe7d554a tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:42.364072 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-aa71ce2c-9cd4-4e5f-b0fa-d29ebe7d554a tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] HTTP exception thrown: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa71ce2c-9cd4-4e5f-b0fa-d29ebe7d554a tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Request method failure captured: Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e HTTP/1.1 Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139fbcilb4IxYX26XLy2JpacZRMQFAjeaQY5EaALF1KTzLRfi0TOnqa0HXEK_FWsniNbekE0m6bi2nkaU4hGzsnaJTCeB7u4Dlt1O5ST0RgoG8QHF2zexfUk1ol4XPwCW-6jfK8pX8KS38lgrUADyaciIKom_-IXBcOSJCbkDQRUusY Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b54ca14804604df88d85aea23b5873d9 Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminTestJSON-1964639519 Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:42.367633 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b54ca14804604df88d85aea23b5873d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b54ca14804604df88d85aea23b5873d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b54ca14804604df88d85aea23b5873d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b54ca14804604df88d85aea23b5873d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminTestJSON-1964639519 Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b54ca14804604df88d85aea23b5873d9 Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1964639519 Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminTestJSON-1964639519-project Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8ee35434e090442e8ee148f66f96afdb Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminTestJSON-1964639519-project Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:42.369253 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e'} Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:42.371113 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:42.372275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:42.376123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa71ce2c-9cd4-4e5f-b0fa-d29ebe7d554a tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Returning 404 to user: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:42.376123 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aa71ce2c-9cd4-4e5f-b0fa-d29ebe7d554a tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 404 len: 111 microversion: 2.1 time: 0.102453 Jul 20 04:07:42.380614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b78d650-d9e5-4921-ad80-718643b15ec8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-760456-11"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:42.382978 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:42.382978 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:42.401065 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 69/172] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:42 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:42.412102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b78d650-d9e5-4921-ad80-718643b15ec8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:42.412572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b78d650-d9e5-4921-ad80-718643b15ec8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.219276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-545c7d54-b829-4320-9672-0ee682898655 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Calling method '.version_select at 0x7fb842eafee0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:43.224511 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:43.224511 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:43.228303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-545c7d54-b829-4320-9672-0ee682898655 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.230835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-545c7d54-b829-4320-9672-0ee682898655 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.287366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-545c7d54-b829-4320-9672-0ee682898655 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.292679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-545c7d54-b829-4320-9672-0ee682898655 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.336891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-545c7d54-b829-4320-9672-0ee682898655 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.338789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-545c7d54-b829-4320-9672-0ee682898655 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.355973 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-545c7d54-b829-4320-9672-0ee682898655 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.818574 Jul 20 04:07:43.357001 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 70/173] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:42 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:43.391244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3a34484-1a9e-48ea-8588-1a5cc203ea68 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:43.391874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3a34484-1a9e-48ea-8588-1a5cc203ea68 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:43.411510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3a34484-1a9e-48ea-8588-1a5cc203ea68 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.411972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3a34484-1a9e-48ea-8588-1a5cc203ea68 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.414157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3a34484-1a9e-48ea-8588-1a5cc203ea68 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.415772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3a34484-1a9e-48ea-8588-1a5cc203ea68 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.564850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3a34484-1a9e-48ea-8588-1a5cc203ea68 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:43.574143 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3a34484-1a9e-48ea-8588-1a5cc203ea68 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1320 microversion: 2.1 time: 0.208662 Jul 20 04:07:43.576931 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 71/174] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:43 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:43.593333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aebf603a-22f5-4c23-9661-8ed2abeb18eb tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Calling method '.version_select at 0x7fb842e051f0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:43.595863 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:43.595863 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:43.602421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aebf603a-22f5-4c23-9661-8ed2abeb18eb tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.603654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aebf603a-22f5-4c23-9661-8ed2abeb18eb tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.681401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aebf603a-22f5-4c23-9661-8ed2abeb18eb tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.684305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aebf603a-22f5-4c23-9661-8ed2abeb18eb tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.724997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aebf603a-22f5-4c23-9661-8ed2abeb18eb tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.726301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aebf603a-22f5-4c23-9661-8ed2abeb18eb tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.740765 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aebf603a-22f5-4c23-9661-8ed2abeb18eb tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/n-h1-760456-11/servers" status: 200 len: 105 microversion: 2.1 time: 0.155213 Jul 20 04:07:43.760575 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 72/175] 10.222.0.59 () {58 vars in 1214 bytes} [Wed Jul 20 04:07:43 2022] GET /compute/v2.1/os-hypervisors/n-h1-760456-11/servers => generated 105 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:43.770486 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b78d650-d9e5-4921-ad80-718643b15ec8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 1.387503 Jul 20 04:07:43.775192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48338288-8fa2-417d-aa7f-df8319236c30 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Calling method '.version_select at 0x7fb842ec5430>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:43.777115 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 104/176] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:43.778364 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:43.778364 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:43.782104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48338288-8fa2-417d-aa7f-df8319236c30 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.785369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6905671b-63f3-4238-9d78-82177cd80802 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:43.785957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48338288-8fa2-417d-aa7f-df8319236c30 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.786202 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:43.786202 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:43.832547 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6905671b-63f3-4238-9d78-82177cd80802 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.050541 Jul 20 04:07:43.833339 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 105/177] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:43 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:43.848293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72c77c1e-d963-4d52-aaf3-a0ec62d96a7b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-254475705"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:43.866168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48338288-8fa2-417d-aa7f-df8319236c30 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.867195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48338288-8fa2-417d-aa7f-df8319236c30 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.904059 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:43.904059 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:43.906127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48338288-8fa2-417d-aa7f-df8319236c30 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.908632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.aggregate [None req-72c77c1e-d963-4d52-aaf3-a0ec62d96a7b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Generated uuid 89ba1c4b-d5cb-4b0f-8a04-ed1472ed28d5 for aggregate {{(pid=119606) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:43.908769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48338288-8fa2-417d-aa7f-df8319236c30 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.930078 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48338288-8fa2-417d-aa7f-df8319236c30 tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.165143 Jul 20 04:07:43.930822 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 73/178] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:43.941865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1c6686e2-d3d8-4916-89a0-4cc6f8fcadab tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Calling method '.version_select at 0x7fb84805ac10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:43.943951 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:43.943951 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:43.947537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c6686e2-d3d8-4916-89a0-4cc6f8fcadab tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:43.954805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c6686e2-d3d8-4916-89a0-4cc6f8fcadab tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:43.962208 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72c77c1e-d963-4d52-aaf3-a0ec62d96a7b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.118279 Jul 20 04:07:43.963344 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 106/179] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:43.994827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac399d7a-c62e-486b-9353-f41bd523ab58 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-760456-11"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:43.996576 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:43.996576 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:44.002787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c6686e2-d3d8-4916-89a0-4cc6f8fcadab tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:44.005018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c6686e2-d3d8-4916-89a0-4cc6f8fcadab tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:44.022208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac399d7a-c62e-486b-9353-f41bd523ab58 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:44.029598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac399d7a-c62e-486b-9353-f41bd523ab58 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:44.054688 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1c6686e2-d3d8-4916-89a0-4cc6f8fcadab tempest-HypervisorAdminUnderV252Test-1585529592 tempest-HypervisorAdminUnderV252Test-1585529592-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/n-h1-760456-11/search" status: 200 len: 105 microversion: 2.1 time: 0.101359 Jul 20 04:07:44.057152 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 74/180] 10.222.0.59 () {58 vars in 1211 bytes} [Wed Jul 20 04:07:43 2022] GET /compute/v2.1/os-hypervisors/n-h1-760456-11/search => generated 105 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:44.335142 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac399d7a-c62e-486b-9353-f41bd523ab58 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.363055 Jul 20 04:07:44.337642 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 107/181] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:44.348481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-59c8d31b-ba8e-40ed-a4b9-796dab7eebd9 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:44.350318 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:44.350318 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:44.362846 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-59c8d31b-ba8e-40ed-a4b9-796dab7eebd9 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.018534 Jul 20 04:07:44.367855 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 75/182] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:07:44 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:44.375701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-82df6e56-81aa-41cb-b6c0-6c040318e351 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-760456-11"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:44.377267 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:44.377267 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:44.402573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82df6e56-81aa-41cb-b6c0-6c040318e351 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:44.404827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82df6e56-81aa-41cb-b6c0-6c040318e351 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:44.597111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6a46cf75-edc1-43c3-b1df-e6b724996f10 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:44.598016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6a46cf75-edc1-43c3-b1df-e6b724996f10 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:44.617571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a46cf75-edc1-43c3-b1df-e6b724996f10 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:44.619584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a46cf75-edc1-43c3-b1df-e6b724996f10 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:44.623750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a46cf75-edc1-43c3-b1df-e6b724996f10 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:44.624532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a46cf75-edc1-43c3-b1df-e6b724996f10 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:44.724404 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-82df6e56-81aa-41cb-b6c0-6c040318e351 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.351524 Jul 20 04:07:44.728698 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 108/183] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:44 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:44.747371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3621efae-76e1-46ac-a59b-380b827f0090 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:44.748275 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:44.748275 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:44.838767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6a46cf75-edc1-43c3-b1df-e6b724996f10 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:44.845603 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3621efae-76e1-46ac-a59b-380b827f0090 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.110324 Jul 20 04:07:44.846234 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 109/184] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:44 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:44.848252 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6a46cf75-edc1-43c3-b1df-e6b724996f10 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1320 microversion: 2.1 time: 0.256538 Jul 20 04:07:44.855352 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 76/185] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:44 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:44.868518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-13fcfdba-4627-4c94-aed7-942a4479dfa8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1865029062"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:44.869956 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:44.869956 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:44.880428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.aggregate [None req-13fcfdba-4627-4c94-aed7-942a4479dfa8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Generated uuid 5dd58205-d5a4-467a-ae0c-9d73b9909454 for aggregate {{(pid=119606) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:44.972438 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-13fcfdba-4627-4c94-aed7-942a4479dfa8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.115038 Jul 20 04:07:44.974341 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 110/186] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:44.985864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-da690565-2505-4092-8932-1d2dc0d2c27a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:44.993105 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:44.993105 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:45.007673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da690565-2505-4092-8932-1d2dc0d2c27a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:45.009713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da690565-2505-4092-8932-1d2dc0d2c27a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:45.206536 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-da690565-2505-4092-8932-1d2dc0d2c27a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.226194 Jul 20 04:07:45.207434 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 77/187] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:44 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:45.218227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-61e2c788-96e1-4bca-bba8-36ad0fa7b0f0 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:45.219660 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:45.219660 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:45.222689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=13,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:45.588453 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-61e2c788-96e1-4bca-bba8-36ad0fa7b0f0 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.374763 Jul 20 04:07:45.599119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ca89c27-2c42-4ccb-a077-21f53a41841b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:45.600475 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:45.600475 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:45.602242 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 111/188] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:07:45 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:45.616041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ca89c27-2c42-4ccb-a077-21f53a41841b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:45.616796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ca89c27-2c42-4ccb-a077-21f53a41841b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:45.794153 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ca89c27-2c42-4ccb-a077-21f53a41841b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.198159 Jul 20 04:07:45.795657 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 78/189] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:45 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:45.805608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-23dd5b02-c29c-49d5-929c-768c92488c57 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:45.806401 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:45.806401 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:45.863857 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-23dd5b02-c29c-49d5-929c-768c92488c57 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.062136 Jul 20 04:07:45.864900 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 112/190] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:45 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:45.874911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-449cc84c-35cb-44bc-92a3-deddf0e77388 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:45.876276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-449cc84c-35cb-44bc-92a3-deddf0e77388 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:45.877078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-987914db-35af-4d76-89ba-abc7fd3d4df0 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-56826658"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:45.878940 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:45.878940 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:45.880115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.aggregate [None req-987914db-35af-4d76-89ba-abc7fd3d4df0 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Generated uuid 86906692-1a2c-4fd0-b66c-9cb617f67da5 for aggregate {{(pid=119606) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:45.886964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=13,nova_api:UPDATE=11,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:45.889657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-449cc84c-35cb-44bc-92a3-deddf0e77388 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:45.898792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-449cc84c-35cb-44bc-92a3-deddf0e77388 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:45.900413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-449cc84c-35cb-44bc-92a3-deddf0e77388 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:45.901191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-449cc84c-35cb-44bc-92a3-deddf0e77388 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:45.930707 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-987914db-35af-4d76-89ba-abc7fd3d4df0 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.057550 Jul 20 04:07:45.932452 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 113/191] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:45 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:45.945161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8056ddde-47c3-489d-8bdd-863ae958fa2b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-760456-11"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:45.955111 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:45.955111 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:45.974497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8056ddde-47c3-489d-8bdd-863ae958fa2b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:45.975120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8056ddde-47c3-489d-8bdd-863ae958fa2b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:46.078847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-449cc84c-35cb-44bc-92a3-deddf0e77388 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:46.088284 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-449cc84c-35cb-44bc-92a3-deddf0e77388 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1320 microversion: 2.1 time: 0.220401 Jul 20 04:07:46.090000 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 79/192] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:45 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:46.204510 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8056ddde-47c3-489d-8bdd-863ae958fa2b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.264961 Jul 20 04:07:46.205232 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 114/193] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:45 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:46.216698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2292f17d-8ee2-455f-82c4-1d297eb441c9 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:46.218178 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:46.218178 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:46.220625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:46.241810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2292f17d-8ee2-455f-82c4-1d297eb441c9 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:46.251635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2292f17d-8ee2-455f-82c4-1d297eb441c9 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:46.490553 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2292f17d-8ee2-455f-82c4-1d297eb441c9 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 225 microversion: 2.1 time: 0.278366 Jul 20 04:07:46.499321 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 80/194] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:46 2022] POST /compute/v2.1/os-aggregates/4/action => generated 225 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:46.511470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bcf95f23-540b-46b7-a40c-c6bc6f1ba7a7 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:46.512216 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:46.512216 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:46.555343 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bcf95f23-540b-46b7-a40c-c6bc6f1ba7a7 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.047684 Jul 20 04:07:46.559872 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 115/195] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:46 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:46.567957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c21ad33d-9316-42ff-99d7-5723151bd861 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2125211394"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:46.569625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6186c9ba-6e8b-4774-9148-012cc21cb26d tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2097767274"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:46.571515 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:46.571515 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:46.574590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-6186c9ba-6e8b-4774-9148-012cc21cb26d tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Generated uuid 57917f1a-6643-4f11-8e90-16f879b067c6 for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:46.580930 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:46.580930 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:46.585970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.aggregate [None req-c21ad33d-9316-42ff-99d7-5723151bd861 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Generated uuid 1636d101-2dc9-4430-8e94-b869550e93e9 for aggregate {{(pid=119606) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:46.632958 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6186c9ba-6e8b-4774-9148-012cc21cb26d tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068672 Jul 20 04:07:46.634067 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 81/196] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:46.664495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa8acbab-fed0-400c-990c-2ad847394a70 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:46.665371 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:46.665371 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:46.678473 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c21ad33d-9316-42ff-99d7-5723151bd861 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.114243 Jul 20 04:07:46.679080 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 116/197] 10.222.0.59 () {62 vars in 1204 bytes} [Wed Jul 20 04:07:46 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:46.710105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d955f64e-bd7d-4778-8062-b673f60141a9 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-382749505"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:46.728896 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa8acbab-fed0-400c-990c-2ad847394a70 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.071407 Jul 20 04:07:46.734067 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 82/198] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:46 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:46.743619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8c3c0f8-1e4a-4205-8d13-066bbc42592c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:46.746520 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:46.746520 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:46.764682 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c8c3c0f8-1e4a-4205-8d13-066bbc42592c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8c3c0f8-1e4a-4205-8d13-066bbc42592c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Request method failure captured: Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139ibMGFpSJCsjgYe1W4aZrxvldg9kWM3OBeaD4F6ZoetBYVczH9nw3QOxO7VH3l4raupV9FAueeIv7L-MLDZ-lNMk3q1dm_3yVGoumt7H_bMW2S0JhP2-3Bp3J-WxqzGpFGQP0yVbGe5uK_Al96yRZBj3htn9OLB8fQ3YG2J5tNKFg Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ed7851f5b5d5481c88603acb96dd9d51 Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:46.769676 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ed7851f5b5d5481c88603acb96dd9d51 Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminTestJSON-547712902-project-admin Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: d7650ef32dc44e62be85ba219f3c9c31 Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminTestJSON-547712902-project-admin Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: exception: Aggregate 5 could not be found. Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '5'} Jul 20 04:07:46.771316 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:46.772007 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 20 04:07:46.773127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:46.781114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8c3c0f8-1e4a-4205-8d13-066bbc42592c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:46.782891 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c8c3c0f8-1e4a-4205-8d13-066bbc42592c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.047431 Jul 20 04:07:46.807184 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 83/199] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:07:46 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:46.820486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e489d060-6b55-43ed-90c8-a65102ee009c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:46.822075 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:46.822075 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:46.843040 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-e489d060-6b55-43ed-90c8-a65102ee009c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e489d060-6b55-43ed-90c8-a65102ee009c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Request method failure captured: Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139ibMGFpSJCsjgYe1W4aZrxvldg9kWM3OBeaD4F6ZoetBYVczH9nw3QOxO7VH3l4raupV9FAueeIv7L-MLDZ-lNMk3q1dm_3yVGoumt7H_bMW2S0JhP2-3Bp3J-WxqzGpFGQP0yVbGe5uK_Al96yRZBj3htn9OLB8fQ3YG2J5tNKFg Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ed7851f5b5d5481c88603acb96dd9d51 Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:46.861317 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ed7851f5b5d5481c88603acb96dd9d51 Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminTestJSON-547712902-project-admin Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: d7650ef32dc44e62be85ba219f3c9c31 Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminTestJSON-547712902-project-admin Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: exception: Aggregate 5 could not be found. Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '5'} Jul 20 04:07:46.862849 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:46.863532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:46.864547 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:46.865625 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:46.865625 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:46.865625 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:46.865625 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 20 04:07:46.865625 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:46.868538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e489d060-6b55-43ed-90c8-a65102ee009c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:46.872609 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e489d060-6b55-43ed-90c8-a65102ee009c tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.060580 Jul 20 04:07:46.873875 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 84/200] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:46 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:46.893507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b732436e-bfb8-4358-9042-08687a79c4fd tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2068765572", "name": "tempest-test_aggregate-1107732299"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:46.895389 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:46.895389 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:46.896623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-b732436e-bfb8-4358-9042-08687a79c4fd tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Generated uuid 75857ccf-bfe3-4575-8f4f-3aab806c2068 for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:46.963276 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:46.963276 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:46.969969 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b732436e-bfb8-4358-9042-08687a79c4fd tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.082031 Jul 20 04:07:46.974758 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 85/201] 10.222.0.59 () {60 vars in 1164 bytes} [Wed Jul 20 04:07:46 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:46.993949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d31ba781-c199-45a5-a5a4-b2a9698e4cc3 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:46.995762 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:46.995762 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:47.046906 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d955f64e-bd7d-4778-8062-b673f60141a9 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.358755 Jul 20 04:07:47.047916 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 117/202] 10.222.0.59 () {62 vars in 1209 bytes} [Wed Jul 20 04:07:46 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:47.058412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ef079710-2b23-47b0-8d93-22a991f96605 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:47.064913 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.064913 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:47.082813 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d31ba781-c199-45a5-a5a4-b2a9698e4cc3 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.103807 Jul 20 04:07:47.087575 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 86/203] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:46 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:47.110000 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ef079710-2b23-47b0-8d93-22a991f96605 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.055768 Jul 20 04:07:47.112307 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 118/204] 10.222.0.59 () {60 vars in 1189 bytes} [Wed Jul 20 04:07:47 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:07:47.116600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29777f01-dfe4-4d14-b85b-49ee7f0bb8e8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:47.117900 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.117900 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:47.142106 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-29777f01-dfe4-4d14-b85b-49ee7f0bb8e8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 20 04:07:47.150366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c51b38de-5ac6-4408-910f-3af6bcad95ea tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29777f01-dfe4-4d14-b85b-49ee7f0bb8e8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Request method failure captured: Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139ibMGFpSJCsjgYe1W4aZrxvldg9kWM3OBeaD4F6ZoetBYVczH9nw3QOxO7VH3l4raupV9FAueeIv7L-MLDZ-lNMk3q1dm_3yVGoumt7H_bMW2S0JhP2-3Bp3J-WxqzGpFGQP0yVbGe5uK_Al96yRZBj3htn9OLB8fQ3YG2J5tNKFg Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ed7851f5b5d5481c88603acb96dd9d51 Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:47.154863 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ed7851f5b5d5481c88603acb96dd9d51 Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminTestJSON-547712902-project-admin Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: d7650ef32dc44e62be85ba219f3c9c31 Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminTestJSON-547712902-project-admin Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: exception: Aggregate 7 could not be found. Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7'} Jul 20 04:07:47.156409 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:47.157236 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 20 04:07:47.158474 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:47.160622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29777f01-dfe4-4d14-b85b-49ee7f0bb8e8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:47.162279 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-29777f01-dfe4-4d14-b85b-49ee7f0bb8e8 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.073304 Jul 20 04:07:47.163427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c51b38de-5ac6-4408-910f-3af6bcad95ea tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:47.164415 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 87/205] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:07:47 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:47.176606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29ffc32b-7801-4293-93bc-541205b42602 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:47.181353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c51b38de-5ac6-4408-910f-3af6bcad95ea tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:47.182540 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.182540 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:47.184787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c51b38de-5ac6-4408-910f-3af6bcad95ea tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:47.189494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c51b38de-5ac6-4408-910f-3af6bcad95ea tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:47.198983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c51b38de-5ac6-4408-910f-3af6bcad95ea tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:47.228189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29ffc32b-7801-4293-93bc-541205b42602 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:47.230114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29ffc32b-7801-4293-93bc-541205b42602 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:47.487495 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-29ffc32b-7801-4293-93bc-541205b42602 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.321822 Jul 20 04:07:47.488200 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 88/206] 10.222.0.59 () {62 vars in 1231 bytes} [Wed Jul 20 04:07:47 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:47.497774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4f1ddfa-ff43-46fa-9c5c-970477e6f19a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:47.501866 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.501866 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:47.533946 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-b4f1ddfa-ff43-46fa-9c5c-970477e6f19a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4f1ddfa-ff43-46fa-9c5c-970477e6f19a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Request method failure captured: Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139ibMGFpSJCsjgYe1W4aZrxvldg9kWM3OBeaD4F6ZoetBYVczH9nw3QOxO7VH3l4raupV9FAueeIv7L-MLDZ-lNMk3q1dm_3yVGoumt7H_bMW2S0JhP2-3Bp3J-WxqzGpFGQP0yVbGe5uK_Al96yRZBj3htn9OLB8fQ3YG2J5tNKFg Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ed7851f5b5d5481c88603acb96dd9d51 Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:47.535960 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ed7851f5b5d5481c88603acb96dd9d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ed7851f5b5d5481c88603acb96dd9d51 Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-547712902 Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminTestJSON-547712902-project-admin Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: d7650ef32dc44e62be85ba219f3c9c31 Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminTestJSON-547712902-project-admin Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: exception: Aggregate 7 could not be found. Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7'} Jul 20 04:07:47.537111 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:47.537911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:47.538911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:47.540056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:47.540056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:47.540056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:47.540056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 20 04:07:47.540056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:47.546185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4f1ddfa-ff43-46fa-9c5c-970477e6f19a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:47.553066 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b4f1ddfa-ff43-46fa-9c5c-970477e6f19a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.063276 Jul 20 04:07:47.555859 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 89/207] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:47 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:47.564349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-601b5b72-7b71-4517-80c3-8a176f037353 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:47.572448 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.572448 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:47.597398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-601b5b72-7b71-4517-80c3-8a176f037353 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:47.602786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-601b5b72-7b71-4517-80c3-8a176f037353 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:47.720853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c51b38de-5ac6-4408-910f-3af6bcad95ea tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:47.728780 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c51b38de-5ac6-4408-910f-3af6bcad95ea tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1388 microversion: 2.1 time: 0.583573 Jul 20 04:07:47.729359 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 119/208] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:47 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1388 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:47.737938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-43dff416-f1e7-4659-99dc-b29594949e22 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1284381581"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:47.742752 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.742752 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:47.743760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.aggregate [None req-43dff416-f1e7-4659-99dc-b29594949e22 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Generated uuid 6aa9f826-a8c0-4220-9306-1f8f860d9bf1 for aggregate {{(pid=119606) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:47.803790 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-43dff416-f1e7-4659-99dc-b29594949e22 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072405 Jul 20 04:07:47.805018 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 120/209] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:47.821399 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-601b5b72-7b71-4517-80c3-8a176f037353 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.263500 Jul 20 04:07:47.822654 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 90/210] 10.222.0.59 () {62 vars in 1231 bytes} [Wed Jul 20 04:07:47 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:47.833468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-94a2a894-9f20-4952-8a26-15f25fb22850 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:47.834236 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.834236 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:47.837874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d964196d-e902-4c3b-b016-0a881cda0fef tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:47.839799 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.839799 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:47.862094 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d964196d-e902-4c3b-b016-0a881cda0fef tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.033771 Jul 20 04:07:47.867137 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 121/211] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:07:47 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:47.881645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-38a16662-a312-4e93-a609-b3617de4ec6b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:47.892452 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-94a2a894-9f20-4952-8a26-15f25fb22850 tempest-AggregatesAdminTestV241-1682872055 tempest-AggregatesAdminTestV241-1682872055-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.062567 Jul 20 04:07:47.893281 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.893281 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:47.893499 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 91/212] 10.222.0.59 () {60 vars in 1192 bytes} [Wed Jul 20 04:07:47 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:47.914766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a208d3bf-967f-4c0b-8fb3-0e0a917bea73 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-150181509"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:47.916231 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.916231 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:47.918893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-a208d3bf-967f-4c0b-8fb3-0e0a917bea73 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Generated uuid a31b9ae0-ccc0-4cd6-8014-3c756078806f for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:47.947091 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-38a16662-a312-4e93-a609-b3617de4ec6b tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.074702 Jul 20 04:07:47.950049 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 122/213] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:47 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:47.960698 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a208d3bf-967f-4c0b-8fb3-0e0a917bea73 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.049458 Jul 20 04:07:47.969226 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 92/214] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:47 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:47.974764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fa87b191-7b4c-49a4-a7bb-084defc851ba tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:47.975305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf461d0e-7c3c-4c01-9707-58eb709c1577 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:47.976748 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.976748 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:47.978920 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:47.978920 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:47.999417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf461d0e-7c3c-4c01-9707-58eb709c1577 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:47.999583 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fa87b191-7b4c-49a4-a7bb-084defc851ba tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.040203 Jul 20 04:07:48.001313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf461d0e-7c3c-4c01-9707-58eb709c1577 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:48.002534 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 123/215] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:07:47 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:48.018497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-77822107-0270-4f07-bb52-46aacaa91f83 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:48.021794 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.021794 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:48.099234 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-77822107-0270-4f07-bb52-46aacaa91f83 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.092953 Jul 20 04:07:48.101620 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 124/216] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:48 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:48.128243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d4469f05-b6d0-40bc-8f92-bad756406e1d tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1824306251", "availability_zone": "tempest-test_az-65863656"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:48.158342 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.158342 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:48.164585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.aggregate [None req-d4469f05-b6d0-40bc-8f92-bad756406e1d tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Generated uuid 84a3a978-bf81-44df-9a24-8395dd818532 for aggregate {{(pid=119606) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:48.227475 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf461d0e-7c3c-4c01-9707-58eb709c1577 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.255684 Jul 20 04:07:48.228663 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 93/217] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:47 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:48.241325 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d4469f05-b6d0-40bc-8f92-bad756406e1d tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.127769 Jul 20 04:07:48.242148 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 125/218] 10.222.0.59 () {60 vars in 1164 bytes} [Wed Jul 20 04:07:48 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:48.244468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-edcbe091-8a33-481a-ad1a-eeaaf5a7403d tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:48.247160 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.247160 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:48.252756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae1a2324-0a86-4777-ac13-f8001dc4a545 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1824306251_new", "availability_zone": "tempest-test_az-65863656_new"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:48.261360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-edcbe091-8a33-481a-ad1a-eeaaf5a7403d tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:48.262180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-edcbe091-8a33-481a-ad1a-eeaaf5a7403d tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:48.266329 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.266329 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:48.305845 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-edcbe091-8a33-481a-ad1a-eeaaf5a7403d tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] HTTP exception thrown: Aggregate 9 already has host n-h1-760456-11. Jul 20 04:07:48.357313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae1a2324-0a86-4777-ac13-f8001dc4a545 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:48.357870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae1a2324-0a86-4777-ac13-f8001dc4a545 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-edcbe091-8a33-481a-ad1a-eeaaf5a7403d tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Request method failure captured: Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 40 Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139jO6XW7g3YleHIUSQqnriV4Bkqfyhchclgd-PcQeKE0bkAMsRmeyt_CXKzPq5-rPtfY2HNmwVnTMMW26cUGyQEXbzpRB33_zLjAtalxAuLSZm39sWIZIuabN2HlIhseH8L9z_odvhDsa6GQcTgZKzDT12b8wgW_y0SKxrT_ifo0Ps Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:48.388863 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 3f9b5453d4064f30a2eee991a8bf849d Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: {"add_host": {"host": "n-h1-760456-11"}} Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:48.390408 n-d-760456-11 devstack@n-api.service[119605]: exception: Aggregate 9 already has host n-h1-760456-11. Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-760456-11'}}} Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:07:48.391866 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-760456-11-9' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:07:48.393176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:07:48.395722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:07:48.396728 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-760456-11-9' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 7, 48, 294931), 'updated_at': None, 'host': 'n-h1-760456-11', 'aggregate_id': 9}] Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:48.397760 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 9 already has host n-h1-760456-11. Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:48.398863 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 9 already has host n-h1-760456-11. Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:48.399982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:48.401064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 9 already has host n-h1-760456-11. Jul 20 04:07:48.401064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:48.401064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-edcbe091-8a33-481a-ad1a-eeaaf5a7403d tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Returning 409 to user: Aggregate 9 already has host n-h1-760456-11. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:48.401064 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-edcbe091-8a33-481a-ad1a-eeaaf5a7403d tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/9/action" status: 409 len: 96 microversion: 2.1 time: 0.158020 Jul 20 04:07:48.401064 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 94/219] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:48 2022] POST /compute/v2.1/os-aggregates/9/action => generated 96 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Jul 20 04:07:48.404527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e267eac8-9db7-420e-b288-a8289afc6d4f tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:48.405770 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.405770 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:48.431950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e267eac8-9db7-420e-b288-a8289afc6d4f tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:48.434413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e267eac8-9db7-420e-b288-a8289afc6d4f tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:48.442517 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae1a2324-0a86-4777-ac13-f8001dc4a545 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 333 microversion: 2.1 time: 0.193024 Jul 20 04:07:48.443407 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 126/220] 10.222.0.59 () {60 vars in 1172 bytes} [Wed Jul 20 04:07:48 2022] PUT /compute/v2.1/os-aggregates/10 => generated 333 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:48.457176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b171db6a-15d4-46ad-8373-b4c15d874c3e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:48.458846 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.458846 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:48.471524 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b171db6a-15d4-46ad-8373-b4c15d874c3e tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 200 len: 565 microversion: 2.1 time: 0.018981 Jul 20 04:07:48.478142 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 127/221] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:07:48 2022] GET /compute/v2.1/os-aggregates => generated 565 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:48.484375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b216d4ab-3598-4358-8ba7-9a5633dcc01f tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:48.485173 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.485173 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:48.594694 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b216d4ab-3598-4358-8ba7-9a5633dcc01f tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.111922 Jul 20 04:07:48.597242 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 128/222] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:48 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:48.640155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c0786e4-9d23-4ce5-80d0-2b453bdfaced tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2040245326"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:48.648856 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.648856 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:48.656510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.aggregate [None req-2c0786e4-9d23-4ce5-80d0-2b453bdfaced tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Generated uuid cb5b0e4f-4b8c-41b0-83eb-fc1d0f01ea6b for aggregate {{(pid=119606) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:48.715608 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e267eac8-9db7-420e-b288-a8289afc6d4f tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.314911 Jul 20 04:07:48.720523 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 95/223] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Jul 20 04:07:48 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:48.742276 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c0786e4-9d23-4ce5-80d0-2b453bdfaced tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.116090 Jul 20 04:07:48.743522 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 129/224] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:48 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:48.749032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b7947c0d-7d69-42d1-a16f-cfcdf8144e80 req-bf42bfd0-c21a-4a4a-8634-aa0cf89d5c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32096456-698a-47c4-a1e6-061e62a3a8fb", "tag": "122f1c05-dc7d-4076-84e2-d84c89da38b7"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:48.761370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-64580aaf-3a4c-4e00-8234-cf1c98caef9d tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:48.770194 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.770194 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:48.775233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b7947c0d-7d69-42d1-a16f-cfcdf8144e80 req-bf42bfd0-c21a-4a4a-8634-aa0cf89d5c85 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:48.775686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b7947c0d-7d69-42d1-a16f-cfcdf8144e80 req-bf42bfd0-c21a-4a4a-8634-aa0cf89d5c85 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:48.818238 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b7947c0d-7d69-42d1-a16f-cfcdf8144e80 req-bf42bfd0-c21a-4a4a-8634-aa0cf89d5c85 service nova] Creating event network-changed:122f1c05-dc7d-4076-84e2-d84c89da38b7 for instance 32096456-698a-47c4-a1e6-061e62a3a8fb on n-h2-760456-11 Jul 20 04:07:48.856119 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-64580aaf-3a4c-4e00-8234-cf1c98caef9d tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.093714 Jul 20 04:07:48.856695 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b7947c0d-7d69-42d1-a16f-cfcdf8144e80 req-bf42bfd0-c21a-4a4a-8634-aa0cf89d5c85 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132387 Jul 20 04:07:48.858937 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 130/225] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:48 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:48.859696 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 96/226] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:48.878001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-778e004d-a1aa-4f3d-91d0-ee5764f142ce tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:48.879342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-778e004d-a1aa-4f3d-91d0-ee5764f142ce tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:48.879849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-228aea22-9d0b-4b6a-821e-9e6349adf57a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:48.880726 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.880726 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:48.896725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-778e004d-a1aa-4f3d-91d0-ee5764f142ce tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:48.897201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-778e004d-a1aa-4f3d-91d0-ee5764f142ce tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:48.901488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-778e004d-a1aa-4f3d-91d0-ee5764f142ce tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:48.902113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-778e004d-a1aa-4f3d-91d0-ee5764f142ce tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:48.908547 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-228aea22-9d0b-4b6a-821e-9e6349adf57a tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.045258 Jul 20 04:07:48.912185 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 97/227] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:07:48 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:48.930062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a727b479-05e7-47ab-bc41-587d0939d803 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-333290787"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:48.932042 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.932042 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:48.936242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-a727b479-05e7-47ab-bc41-587d0939d803 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Generated uuid 74f91dae-ad0e-4b98-8665-aa1f473cf2a7 for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:48.987552 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a727b479-05e7-47ab-bc41-587d0939d803 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070737 Jul 20 04:07:48.988267 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 98/228] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:48.993030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d11bdbdc-b4b0-4183-b98a-51b54685e146 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:48.998776 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:48.998776 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:49.039744 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d11bdbdc-b4b0-4183-b98a-51b54685e146 tempest-AggregatesAdminTestJSON-547712902 tempest-AggregatesAdminTestJSON-547712902-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.050115 Jul 20 04:07:49.040379 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 99/229] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:48 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:49.340749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-85d7c9f7-35c6-4f7a-8135-79cb71d26d33 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:49.342571 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:49.342571 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:49.343794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-85d7c9f7-35c6-4f7a-8135-79cb71d26d33 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '8f6cb86cbdd249c38e8677f606e9bba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5338c3b3a2d4a09b3e458b8ffd46e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-85d7c9f7-35c6-4f7a-8135-79cb71d26d33 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Request method failure captured: Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 40 Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139gGE-hJygIECkGw-Lg_2U9LI6CMooZWlQR55VUoEXpE0X7RXnKXuBz8Y0SAhAhkq89YJB9AeaEriW51d6Exm9NkSeH_k4dTl2dHIWaYsjmLKK7QsD-7m0fdlo3O0wWYnA0R215O9cjoqv0v_mfvoeoegD88FWv7lfCbDN7r-t-E-0 Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:49.347908 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8f6cb86cbdd249c38e8677f606e9bba8 Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: {"add_host": {"host": "n-h1-760456-11"}} Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:49.349246 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-760456-11'}}} Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:49.349963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:07:49.351039 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.358164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-85d7c9f7-35c6-4f7a-8135-79cb71d26d33 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:49.361470 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-85d7c9f7-35c6-4f7a-8135-79cb71d26d33 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] 10.222.0.59 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.317947 Jul 20 04:07:49.362999 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 100/230] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:07:49 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 322 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:49.380104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7fb08e0c-ba2e-4fbe-9cf0-610fe96b9e6b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:49.381311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7fb08e0c-ba2e-4fbe-9cf0-610fe96b9e6b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:49.382462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-778e004d-a1aa-4f3d-91d0-ee5764f142ce tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:49.398728 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-778e004d-a1aa-4f3d-91d0-ee5764f142ce tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1388 microversion: 2.1 time: 0.537307 Jul 20 04:07:49.399311 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 131/231] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:48 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1388 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:49.403497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7fb08e0c-ba2e-4fbe-9cf0-610fe96b9e6b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:49.404086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7fb08e0c-ba2e-4fbe-9cf0-610fe96b9e6b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:49.404997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7fb08e0c-ba2e-4fbe-9cf0-610fe96b9e6b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:49.405558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7fb08e0c-ba2e-4fbe-9cf0-610fe96b9e6b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:49.409509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86a91ead-da08-43dd-895d-6803bf5444f5 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:49.413622 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:49.413622 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:49.433348 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-7fb08e0c-ba2e-4fbe-9cf0-610fe96b9e6b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] HTTP exception thrown: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:49.441945 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-86a91ead-da08-43dd-895d-6803bf5444f5 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.040873 Jul 20 04:07:49.443719 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 132/232] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:49 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7fb08e0c-ba2e-4fbe-9cf0-610fe96b9e6b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Request method failure captured: Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e HTTP/1.1 Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139fbcilb4IxYX26XLy2JpacZRMQFAjeaQY5EaALF1KTzLRfi0TOnqa0HXEK_FWsniNbekE0m6bi2nkaU4hGzsnaJTCeB7u4Dlt1O5ST0RgoG8QHF2zexfUk1ol4XPwCW-6jfK8pX8KS38lgrUADyaciIKom_-IXBcOSJCbkDQRUusY Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b54ca14804604df88d85aea23b5873d9 Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminTestJSON-1964639519 Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:49.447097 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b54ca14804604df88d85aea23b5873d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b54ca14804604df88d85aea23b5873d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b54ca14804604df88d85aea23b5873d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b54ca14804604df88d85aea23b5873d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminTestJSON-1964639519 Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b54ca14804604df88d85aea23b5873d9 Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1964639519 Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminTestJSON-1964639519-project Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8ee35434e090442e8ee148f66f96afdb Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminTestJSON-1964639519-project Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:49.449165 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e'} Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:49.449854 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:49.451751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.453162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7fb08e0c-ba2e-4fbe-9cf0-610fe96b9e6b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Returning 404 to user: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:49.454386 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7fb08e0c-ba2e-4fbe-9cf0-610fe96b9e6b tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 404 len: 111 microversion: 2.1 time: 0.087409 Jul 20 04:07:49.455726 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 101/233] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:07:49 2022] DELETE /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:49.465296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-478f68f9-b4f9-4154-bd5a-bfc9522b8206 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1286187292"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:49.466665 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:49.466665 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:49.467506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e22b48d0-08af-421f-a57c-c50fa8a64570 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:49.467636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.aggregate [None req-478f68f9-b4f9-4154-bd5a-bfc9522b8206 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Generated uuid a10fd16b-3452-453e-8ba1-a1c31558e857 for aggregate {{(pid=119606) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:49.468597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e22b48d0-08af-421f-a57c-c50fa8a64570 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] [instance: 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:49.471733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=11,nova_api:INSERT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:49.478471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e22b48d0-08af-421f-a57c-c50fa8a64570 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:49.484247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=12,nova_api:INSERT=8,nova_api:UPDATE=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:49.496218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e22b48d0-08af-421f-a57c-c50fa8a64570 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:49.497753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e22b48d0-08af-421f-a57c-c50fa8a64570 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:49.498532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e22b48d0-08af-421f-a57c-c50fa8a64570 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:49.515823 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-478f68f9-b4f9-4154-bd5a-bfc9522b8206 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.058027 Jul 20 04:07:49.518960 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 133/234] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:49.529997 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-e22b48d0-08af-421f-a57c-c50fa8a64570 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] HTTP exception thrown: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e22b48d0-08af-421f-a57c-c50fa8a64570 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Request method failure captured: Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e HTTP/1.1 Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139fbcilb4IxYX26XLy2JpacZRMQFAjeaQY5EaALF1KTzLRfi0TOnqa0HXEK_FWsniNbekE0m6bi2nkaU4hGzsnaJTCeB7u4Dlt1O5ST0RgoG8QHF2zexfUk1ol4XPwCW-6jfK8pX8KS38lgrUADyaciIKom_-IXBcOSJCbkDQRUusY Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b54ca14804604df88d85aea23b5873d9 Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminTestJSON-1964639519 Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:49.532077 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b54ca14804604df88d85aea23b5873d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b54ca14804604df88d85aea23b5873d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b54ca14804604df88d85aea23b5873d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b54ca14804604df88d85aea23b5873d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminTestJSON-1964639519 Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b54ca14804604df88d85aea23b5873d9 Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1964639519 Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminTestJSON-1964639519-project Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8ee35434e090442e8ee148f66f96afdb Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminTestJSON-1964639519-project Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:49.533251 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e'} Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:49.533905 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. Jul 20 04:07:49.535112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.537734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e22b48d0-08af-421f-a57c-c50fa8a64570 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] Returning 404 to user: Instance 4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:49.538839 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e22b48d0-08af-421f-a57c-c50fa8a64570 tempest-AggregatesAdminTestJSON-1964639519 tempest-AggregatesAdminTestJSON-1964639519-project] 10.222.0.59 "GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e" status: 404 len: 111 microversion: 2.1 time: 0.078511 Jul 20 04:07:49.539732 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 102/235] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:49 2022] GET /compute/v2.1/servers/4cd78aa8-bd8e-4b0d-939c-ff392b3e3c2e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:49.544675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6aa4c07-59d7-4b98-b457-7a1aabe1f50a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1356994084"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:49.546950 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:49.546950 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:49.556444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6aa4c07-59d7-4b98-b457-7a1aabe1f50a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:49.557155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6aa4c07-59d7-4b98-b457-7a1aabe1f50a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:49.568189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6aa4c07-59d7-4b98-b457-7a1aabe1f50a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:49.569148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6aa4c07-59d7-4b98-b457-7a1aabe1f50a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:49.580421 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d6aa4c07-59d7-4b98-b457-7a1aabe1f50a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1356994084 could not be found. Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6aa4c07-59d7-4b98-b457-7a1aabe1f50a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Request method failure captured: Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 58 Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi139jO6XW7g3YleHIUSQqnriV4Bkqfyhchclgd-PcQeKE0bkAMsRmeyt_CXKzPq5-rPtfY2HNmwVnTMMW26cUGyQEXbzpRB33_zLjAtalxAuLSZm39sWIZIuabN2HlIhseH8L9z_odvhDsa6GQcTgZKzDT12b8wgW_y0SKxrT_ifo0Ps Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:07:49.582899 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 3f9b5453d4064f30a2eee991a8bf849d Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: {"add_host": {"host": "tempest-nonexist_host-1356994084"}} Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:07:49.584119 n-d-760456-11 devstack@n-api.service[119606]: exception: Compute host tempest-nonexist_host-1356994084 could not be found. Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1356994084'}}} Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1356994084' is not mapped to any cell Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.584851 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 20 04:07:49.585916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1356994084 could not be found. Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1356994084 could not be found. Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.588436 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.591267 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.591267 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.591267 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.591267 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:49.591267 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:49.591267 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1356994084 could not be found. Jul 20 04:07:49.591267 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.591267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6aa4c07-59d7-4b98-b457-7a1aabe1f50a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1356994084 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:49.591267 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d6aa4c07-59d7-4b98-b457-7a1aabe1f50a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.058328 Jul 20 04:07:49.591267 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 134/236] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:07:49 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:49.598408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f013e897-3714-4874-a5ef-27ab95da3997 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:49.599401 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:49.599401 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:49.630975 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f013e897-3714-4874-a5ef-27ab95da3997 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.037662 Jul 20 04:07:49.632137 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 103/237] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:49 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:49.663729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-49ce7caa-afd5-42d1-a459-071cc233d72c tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-49ce7caa-afd5-42d1-a459-071cc233d72c tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Request method failure captured: Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 283 Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139jO6XW7g3YleHIUSQqnriV4Bkqfyhchclgd-PcQeKE0bkAMsRmeyt_CXKzPq5-rPtfY2HNmwVnTMMW26cUGyQEXbzpRB33_zLjAtalxAuLSZm39sWIZIuabN2HlIhseH8L9z_odvhDsa6GQcTgZKzDT12b8wgW_y0SKxrT_ifo0Ps Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:49.672162 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 3f9b5453d4064f30a2eee991a8bf849d Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:07:49.673344 n-d-760456-11 devstack@n-api.service[119605]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:07:49.673956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:07:49.674630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:07:49.675709 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:07:49.676585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:07:49.676585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.676585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-49ce7caa-afd5-42d1-a459-071cc233d72c tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:49.676585 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-49ce7caa-afd5-42d1-a459-071cc233d72c tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.022380 Jul 20 04:07:49.676888 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 104/238] 10.222.0.59 () {60 vars in 1164 bytes} [Wed Jul 20 04:07:49 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:07:49.694657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca2eb954-33ad-4a34-ba4b-740f53322b09 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca2eb954-33ad-4a34-ba4b-740f53322b09 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Request method failure captured: Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 27 Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139jO6XW7g3YleHIUSQqnriV4Bkqfyhchclgd-PcQeKE0bkAMsRmeyt_CXKzPq5-rPtfY2HNmwVnTMMW26cUGyQEXbzpRB33_zLjAtalxAuLSZm39sWIZIuabN2HlIhseH8L9z_odvhDsa6GQcTgZKzDT12b8wgW_y0SKxrT_ifo0Ps Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:49.700485 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 3f9b5453d4064f30a2eee991a8bf849d Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: {"aggregate": {"name": ""}} Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:49.701704 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi '' Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:49.702472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:07:49.703687 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.704818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca2eb954-33ad-4a34-ba4b-740f53322b09 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:49.704818 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ca2eb954-33ad-4a34-ba4b-740f53322b09 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.020938 Jul 20 04:07:49.704818 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 105/239] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:49 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:07:49.716897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36ac1790-66b5-4f5b-95f7-d827abd12d5c tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-930570643"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:49.719927 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:49.719927 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:49.721442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-36ac1790-66b5-4f5b-95f7-d827abd12d5c tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '8f6cb86cbdd249c38e8677f606e9bba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5338c3b3a2d4a09b3e458b8ffd46e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36ac1790-66b5-4f5b-95f7-d827abd12d5c tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Request method failure captured: Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 59 Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139gGE-hJygIECkGw-Lg_2U9LI6CMooZWlQR55VUoEXpE0X7RXnKXuBz8Y0SAhAhkq89YJB9AeaEriW51d6Exm9NkSeH_k4dTl2dHIWaYsjmLKK7QsD-7m0fdlo3O0wWYnA0R215O9cjoqv0v_mfvoeoegD88FWv7lfCbDN7r-t-E-0 Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:49.724096 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8f6cb86cbdd249c38e8677f606e9bba8 Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: {"aggregate": {"name": "tempest-test_aggregate-930570643"}} Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:49.725354 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-930570643'}}} Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:49.726056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:49.727202 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:07:49.730859 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.730859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36ac1790-66b5-4f5b-95f7-d827abd12d5c tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:49.730859 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-36ac1790-66b5-4f5b-95f7-d827abd12d5c tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.015961 Jul 20 04:07:49.730859 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 106/240] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:49 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:49.736259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d8dcc06-fe1c-433b-ae0f-0a72a45d5f46 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1633680316"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:49.738525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-3d8dcc06-fe1c-433b-ae0f-0a72a45d5f46 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Generated uuid 34e8bc50-d891-45ca-bffd-b67ef0b346e9 for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:49.785261 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d8dcc06-fe1c-433b-ae0f-0a72a45d5f46 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052462 Jul 20 04:07:49.786871 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 107/241] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:49.801316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea2c021b-6e08-4334-9e29-c94257dbf77a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1633680316"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:49.802644 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:49.802644 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:49.803543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-ea2c021b-6e08-4334-9e29-c94257dbf77a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Generated uuid 42dd0652-daf3-4761-b799-5ff5a50cc176 for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:49.827207 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-ea2c021b-6e08-4334-9e29-c94257dbf77a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1633680316 already exists. Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea2c021b-6e08-4334-9e29-c94257dbf77a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Request method failure captured: Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 60 Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139jO6XW7g3YleHIUSQqnriV4Bkqfyhchclgd-PcQeKE0bkAMsRmeyt_CXKzPq5-rPtfY2HNmwVnTMMW26cUGyQEXbzpRB33_zLjAtalxAuLSZm39sWIZIuabN2HlIhseH8L9z_odvhDsa6GQcTgZKzDT12b8wgW_y0SKxrT_ifo0Ps Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:49.828947 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 3f9b5453d4064f30a2eee991a8bf849d Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: {"aggregate": {"name": "tempest-test_aggregate-1633680316"}} Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:49.830357 n-d-760456-11 devstack@n-api.service[119605]: exception: Aggregate tempest-test_aggregate-1633680316 already exists. Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1633680316'}}} Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 20 04:07:49.831304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1633680316 already exists. Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:49.832627 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1633680316 already exists. Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1633680316 already exists. Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea2c021b-6e08-4334-9e29-c94257dbf77a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1633680316 already exists. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:49.833918 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ea2c021b-6e08-4334-9e29-c94257dbf77a tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.035273 Jul 20 04:07:49.834826 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 108/242] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:49 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:49.842906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fda2dac1-949a-402d-a9fd-b8e738425502 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:49.843680 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:49.843680 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:49.881383 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fda2dac1-949a-402d-a9fd-b8e738425502 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.041985 Jul 20 04:07:49.883790 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 109/243] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:49 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:49.895496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6b8a8a5-1438-4151-8b4b-611c597a9115 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2032697599"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:49.901003 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:49.901003 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:49.904234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-e6b8a8a5-1438-4151-8b4b-611c597a9115 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Generated uuid afb55b70-01de-40a0-9428-da451dcb9ed7 for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:49.959164 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6b8a8a5-1438-4151-8b4b-611c597a9115 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071019 Jul 20 04:07:49.962527 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 110/244] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:49.974850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26377a79-c92c-4423-b8df-b7653c9d4c45 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:49.976639 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:49.976639 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:49.978039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-26377a79-c92c-4423-b8df-b7653c9d4c45 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '8f6cb86cbdd249c38e8677f606e9bba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5338c3b3a2d4a09b3e458b8ffd46e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26377a79-c92c-4423-b8df-b7653c9d4c45 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Request method failure captured: Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139gGE-hJygIECkGw-Lg_2U9LI6CMooZWlQR55VUoEXpE0X7RXnKXuBz8Y0SAhAhkq89YJB9AeaEriW51d6Exm9NkSeH_k4dTl2dHIWaYsjmLKK7QsD-7m0fdlo3O0wWYnA0R215O9cjoqv0v_mfvoeoegD88FWv7lfCbDN7r-t-E-0 Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:49.983793 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8f6cb86cbdd249c38e8677f606e9bba8 Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:07:49.985050 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '15'} Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:49.985706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:07:49.986872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:49.993406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26377a79-c92c-4423-b8df-b7653c9d4c45 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:49.995730 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-26377a79-c92c-4423-b8df-b7653c9d4c45 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.025197 Jul 20 04:07:50.003589 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 111/245] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:49 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:07:50.010722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3383bd8f-359e-4dc5-9dfb-72b25f6ad441 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:50.087435 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3383bd8f-359e-4dc5-9dfb-72b25f6ad441 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.081009 Jul 20 04:07:50.088875 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 112/246] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:50 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:50.105275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-edd352e7-9941-4522-9cfc-e84745393307 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:50.106883 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.106883 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.122289 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-edd352e7-9941-4522-9cfc-e84745393307 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-edd352e7-9941-4522-9cfc-e84745393307 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Request method failure captured: Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139jO6XW7g3YleHIUSQqnriV4Bkqfyhchclgd-PcQeKE0bkAMsRmeyt_CXKzPq5-rPtfY2HNmwVnTMMW26cUGyQEXbzpRB33_zLjAtalxAuLSZm39sWIZIuabN2HlIhseH8L9z_odvhDsa6GQcTgZKzDT12b8wgW_y0SKxrT_ifo0Ps Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:50.124285 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 3f9b5453d4064f30a2eee991a8bf849d Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: exception: Aggregate -1 could not be found. Jul 20 04:07:50.125517 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '-1'} Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:07:50.126278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.127366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.128595 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:50.128595 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:50.128595 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:50.128595 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:50.128595 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 20 04:07:50.128595 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.132506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-edd352e7-9941-4522-9cfc-e84745393307 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:50.134704 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-edd352e7-9941-4522-9cfc-e84745393307 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.038867 Jul 20 04:07:50.135736 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 113/247] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:50 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:50.146870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2187c49b-ddf0-45e6-8426-83055b475da9 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1053267716"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:50.148179 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.148179 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.149497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-2187c49b-ddf0-45e6-8426-83055b475da9 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Generated uuid 259978e1-a1ab-462e-80d1-f38b13314511 for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:50.191718 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2187c49b-ddf0-45e6-8426-83055b475da9 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049739 Jul 20 04:07:50.200683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93e5a16a-6ec6-44b6-8035-3389736ae303 tempest-QuotaClassesAdmin257Test-984220845 tempest-QuotaClassesAdmin257Test-984220845-project-admin] Calling method '.version_select at 0x7fb8489cfc10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:50.202959 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.202959 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:50.208038 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 114/248] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:50.223791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e2b9935-e6e8-4611-945e-56548b5e27a9 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:50.224877 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.224877 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.225755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5e2b9935-e6e8-4611-945e-56548b5e27a9 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '8f6cb86cbdd249c38e8677f606e9bba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5338c3b3a2d4a09b3e458b8ffd46e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e2b9935-e6e8-4611-945e-56548b5e27a9 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Request method failure captured: Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139gGE-hJygIECkGw-Lg_2U9LI6CMooZWlQR55VUoEXpE0X7RXnKXuBz8Y0SAhAhkq89YJB9AeaEriW51d6Exm9NkSeH_k4dTl2dHIWaYsjmLKK7QsD-7m0fdlo3O0wWYnA0R215O9cjoqv0v_mfvoeoegD88FWv7lfCbDN7r-t-E-0 Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:50.228087 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8f6cb86cbdd249c38e8677f606e9bba8 Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:07:50.229410 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '16'} Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:50.230110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.234712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e2b9935-e6e8-4611-945e-56548b5e27a9 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:50.235851 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5e2b9935-e6e8-4611-945e-56548b5e27a9 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] 10.222.0.59 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.013178 Jul 20 04:07:50.235851 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 115/249] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:50 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:50.237144 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-93e5a16a-6ec6-44b6-8035-3389736ae303 tempest-QuotaClassesAdmin257Test-984220845 tempest-QuotaClassesAdmin257Test-984220845-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.594081 Jul 20 04:07:50.237724 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 135/250] 10.222.0.59 () {60 vars in 1225 bytes} [Wed Jul 20 04:07:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:50.239020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f27c81f5-1ea7-4042-8f28-4ecd6a2e8daa tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:50.239791 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.239791 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.256923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-57e03465-4575-4854-9542-1faf1524835b tempest-QuotaClassesAdmin257Test-984220845 tempest-QuotaClassesAdmin257Test-984220845-project-admin] Action: 'update', calling method: .version_select at 0x7fb842ead550>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:50.259908 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.259908 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:50.274639 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f27c81f5-1ea7-4042-8f28-4ecd6a2e8daa tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.040188 Jul 20 04:07:50.276315 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 116/251] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:50 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:50.303786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c35298f0-ef29-4123-9c59-c23fe7ce4210 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:50.304865 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.304865 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.313776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c35298f0-ef29-4123-9c59-c23fe7ce4210 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c35298f0-ef29-4123-9c59-c23fe7ce4210 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Request method failure captured: Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139jO6XW7g3YleHIUSQqnriV4Bkqfyhchclgd-PcQeKE0bkAMsRmeyt_CXKzPq5-rPtfY2HNmwVnTMMW26cUGyQEXbzpRB33_zLjAtalxAuLSZm39sWIZIuabN2HlIhseH8L9z_odvhDsa6GQcTgZKzDT12b8wgW_y0SKxrT_ifo0Ps Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:50.316115 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 3f9b5453d4064f30a2eee991a8bf849d Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: exception: Aggregate -1 could not be found. Jul 20 04:07:50.317697 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '-1'} Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.318797 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 20 04:07:50.320069 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.323402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c35298f0-ef29-4123-9c59-c23fe7ce4210 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:50.326098 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c35298f0-ef29-4123-9c59-c23fe7ce4210 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040243 Jul 20 04:07:50.327070 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 117/252] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:50 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:50.344829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba70fd1f-a793-4104-8c8a-d6690f32c330 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:50.346806 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.346806 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.349901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ba70fd1f-a793-4104-8c8a-d6690f32c330 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '8f6cb86cbdd249c38e8677f606e9bba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5338c3b3a2d4a09b3e458b8ffd46e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba70fd1f-a793-4104-8c8a-d6690f32c330 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Request method failure captured: Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139gGE-hJygIECkGw-Lg_2U9LI6CMooZWlQR55VUoEXpE0X7RXnKXuBz8Y0SAhAhkq89YJB9AeaEriW51d6Exm9NkSeH_k4dTl2dHIWaYsjmLKK7QsD-7m0fdlo3O0wWYnA0R215O9cjoqv0v_mfvoeoegD88FWv7lfCbDN7r-t-E-0 Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:50.355148 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8f6cb86cbdd249c38e8677f606e9bba8 Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:07:50.356519 n-d-760456-11 devstack@n-api.service[119605]: action_args: {} Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:50.357186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.358370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba70fd1f-a793-4104-8c8a-d6690f32c330 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:50.360003 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ba70fd1f-a793-4104-8c8a-d6690f32c330 tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.025651 Jul 20 04:07:50.360479 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 118/253] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:07:50 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:50.378806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df0a6982-296b-4387-833f-485723a14876 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1539281917"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:50.380471 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.380471 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.381706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-df0a6982-296b-4387-833f-485723a14876 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Generated uuid 4cbc21ba-358e-4513-8830-c79196dfb6d9 for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:50.411965 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-df0a6982-296b-4387-833f-485723a14876 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041982 Jul 20 04:07:50.412818 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 119/254] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:50.415144 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-57e03465-4575-4854-9542-1faf1524835b tempest-QuotaClassesAdmin257Test-984220845 tempest-QuotaClassesAdmin257Test-984220845-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.163893 Jul 20 04:07:50.420380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-700377ef-7345-4380-8b18-c051e973c884 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:50.421186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-700377ef-7345-4380-8b18-c051e973c884 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:50.422692 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 136/255] 10.222.0.59 () {62 vars in 1246 bytes} [Wed Jul 20 04:07:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:50.431445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bf412701-b798-4230-98bd-f78c184651b7 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-760456-11"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:50.433612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-700377ef-7345-4380-8b18-c051e973c884 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:50.434385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-700377ef-7345-4380-8b18-c051e973c884 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:50.437412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-700377ef-7345-4380-8b18-c051e973c884 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:50.438513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-700377ef-7345-4380-8b18-c051e973c884 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:50.445305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf412701-b798-4230-98bd-f78c184651b7 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:50.445565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:50.446038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf412701-b798-4230-98bd-f78c184651b7 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:50.610645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-700377ef-7345-4380-8b18-c051e973c884 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:50.621827 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-700377ef-7345-4380-8b18-c051e973c884 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1388 microversion: 2.1 time: 0.206286 Jul 20 04:07:50.621827 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 120/256] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:50 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1388 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:50.626777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f89139d0-1538-4f5c-a986-7fa6197eeb35 tempest-QuotaClassesAdmin257Test-984220845 tempest-QuotaClassesAdmin257Test-984220845-project-admin] Calling method '.version_select at 0x7fb842eba5e0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:50.627753 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.627753 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.639753 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f89139d0-1538-4f5c-a986-7fa6197eeb35 tempest-QuotaClassesAdmin257Test-984220845 tempest-QuotaClassesAdmin257Test-984220845-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.016994 Jul 20 04:07:50.640219 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bf412701-b798-4230-98bd-f78c184651b7 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.215603 Jul 20 04:07:50.640546 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 121/257] 10.222.0.59 () {60 vars in 1225 bytes} [Wed Jul 20 04:07:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:50.646285 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 137/258] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:07:50 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:50.651934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-be41ac77-1132-49e1-b08f-36b91cb90113 tempest-QuotaClassesAdmin257Test-984220845 tempest-QuotaClassesAdmin257Test-984220845-project-admin] Action: 'update', calling method: .version_select at 0x7fb842e05310>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:50.652950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b5051618-6d45-4b87-a912-208fa9aa3a6b tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-760456-11"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:50.654195 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.654195 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.654463 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.654463 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:50.655350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b5051618-6d45-4b87-a912-208fa9aa3a6b tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '8f6cb86cbdd249c38e8677f606e9bba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5338c3b3a2d4a09b3e458b8ffd46e90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b5051618-6d45-4b87-a912-208fa9aa3a6b tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Request method failure captured: Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 43 Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi139gGE-hJygIECkGw-Lg_2U9LI6CMooZWlQR55VUoEXpE0X7RXnKXuBz8Y0SAhAhkq89YJB9AeaEriW51d6Exm9NkSeH_k4dTl2dHIWaYsjmLKK7QsD-7m0fdlo3O0wWYnA0R215O9cjoqv0v_mfvoeoegD88FWv7lfCbDN7r-t-E-0 Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:50.657251 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c5338c3b3a2d4a09b3e458b8ffd46e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: c5338c3b3a2d4a09b3e458b8ffd46e90 Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368 Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8f6cb86cbdd249c38e8677f606e9bba8 Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557802368-project Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: {"remove_host": {"host": "n-h1-760456-11"}} Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:07:50.658779 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-760456-11'}}} Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:50.659690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:07:50.661016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:50.662981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b5051618-6d45-4b87-a912-208fa9aa3a6b tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:50.662981 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b5051618-6d45-4b87-a912-208fa9aa3a6b tempest-AggregatesAdminNegativeTestJSON-1557802368 tempest-AggregatesAdminNegativeTestJSON-1557802368-project] 10.222.0.59 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.011829 Jul 20 04:07:50.662981 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 138/259] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:07:50 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:50.675655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd3b5c4d-86b5-452a-8263-15d4e0e6fc4b tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-760456-11"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:50.688343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd3b5c4d-86b5-452a-8263-15d4e0e6fc4b tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:50.689062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd3b5c4d-86b5-452a-8263-15d4e0e6fc4b tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:50.761822 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-be41ac77-1132-49e1-b08f-36b91cb90113 tempest-QuotaClassesAdmin257Test-984220845 tempest-QuotaClassesAdmin257Test-984220845-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.113582 Jul 20 04:07:50.762472 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 122/260] 10.222.0.59 () {62 vars in 1246 bytes} [Wed Jul 20 04:07:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:50.844093 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dd3b5c4d-86b5-452a-8263-15d4e0e6fc4b tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.177735 Jul 20 04:07:50.846467 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 139/261] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:07:50 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:50.856354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1291144f-0824-4cf9-877e-7c4bf1f67e70 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:50.857388 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.857388 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.891109 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1291144f-0824-4cf9-877e-7c4bf1f67e70 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.036109 Jul 20 04:07:50.904969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1357804-5280-40d9-84bd-dc1bee3549c2 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-460545895"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:50.907829 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.907829 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:50.909722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.aggregate [None req-d1357804-5280-40d9-84bd-dc1bee3549c2 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Generated uuid 03369744-a171-43f5-b0b5-63da8270416d for aggregate {{(pid=119606) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:07:50.911131 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 123/262] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:50 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 04:07:50.955911 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1357804-5280-40d9-84bd-dc1bee3549c2 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056375 Jul 20 04:07:50.956625 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 140/263] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:07:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:50.967896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-329665e9-b913-4703-94d7-ee6702b80eb0 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:50.969514 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:50.969514 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:50.977953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-329665e9-b913-4703-94d7-ee6702b80eb0 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:50.978828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-329665e9-b913-4703-94d7-ee6702b80eb0 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:50.988768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-329665e9-b913-4703-94d7-ee6702b80eb0 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:50.989798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-329665e9-b913-4703-94d7-ee6702b80eb0 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:50.998733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.compute.aggregates [None req-329665e9-b913-4703-94d7-ee6702b80eb0 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 20 04:07:50.999626 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-329665e9-b913-4703-94d7-ee6702b80eb0 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-329665e9-b913-4703-94d7-ee6702b80eb0 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Request method failure captured: Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 42 Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139jO6XW7g3YleHIUSQqnriV4Bkqfyhchclgd-PcQeKE0bkAMsRmeyt_CXKzPq5-rPtfY2HNmwVnTMMW26cUGyQEXbzpRB33_zLjAtalxAuLSZm39sWIZIuabN2HlIhseH8L9z_odvhDsa6GQcTgZKzDT12b8wgW_y0SKxrT_ifo0Ps Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:07:51.001810 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_80196ef8c8fd4ae6a605513903563aa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 80196ef8c8fd4ae6a605513903563aa2 Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896 Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 3f9b5453d4064f30a2eee991a8bf849d Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: {"remove_host": {"host": "nonexist_host"}} Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:51.003129 n-d-760456-11 devstack@n-api.service[119605]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 20 04:07:51.003886 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 20 04:07:51.005022 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:51.006422 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:51.007553 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:51.007553 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:51.007553 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:51.007553 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:51.007553 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 20 04:07:51.007553 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:51.010909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-329665e9-b913-4703-94d7-ee6702b80eb0 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:51.012165 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-329665e9-b913-4703-94d7-ee6702b80eb0 tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.048933 Jul 20 04:07:51.016727 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 124/264] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:07:50 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:07:51.024981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04b956d8-8712-43fb-b86e-07da1b05507f tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:51.025621 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:51.025621 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:51.066567 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04b956d8-8712-43fb-b86e-07da1b05507f tempest-AggregatesAdminNegativeTestJSON-1584469896 tempest-AggregatesAdminNegativeTestJSON-1584469896-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.044248 Jul 20 04:07:51.067559 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 141/265] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:07:51 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:07:51.642669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fde72395-9e2c-4745-bef4-c6952396e63d tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:51.643838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fde72395-9e2c-4745-bef4-c6952396e63d tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:51.657730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fde72395-9e2c-4745-bef4-c6952396e63d tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:51.658498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fde72395-9e2c-4745-bef4-c6952396e63d tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:51.662115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fde72395-9e2c-4745-bef4-c6952396e63d tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:51.664815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fde72395-9e2c-4745-bef4-c6952396e63d tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:52.353588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fde72395-9e2c-4745-bef4-c6952396e63d tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:52.364938 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fde72395-9e2c-4745-bef4-c6952396e63d tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1388 microversion: 2.1 time: 0.726608 Jul 20 04:07:52.366281 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 125/266] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:51 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1388 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:53.384939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0a59f71d-fa2f-47a9-ace9-ea07c1414c8b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:53.387206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0a59f71d-fa2f-47a9-ace9-ea07c1414c8b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:53.402722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a59f71d-fa2f-47a9-ace9-ea07c1414c8b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:53.403093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a59f71d-fa2f-47a9-ace9-ea07c1414c8b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:53.403898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a59f71d-fa2f-47a9-ace9-ea07c1414c8b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:53.404340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a59f71d-fa2f-47a9-ace9-ea07c1414c8b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:53.640963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0a59f71d-fa2f-47a9-ace9-ea07c1414c8b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:53.653076 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0a59f71d-fa2f-47a9-ace9-ea07c1414c8b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1388 microversion: 2.1 time: 0.272707 Jul 20 04:07:53.653750 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 142/267] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:53 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1388 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:54.677404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7a538392-bc13-42ac-afc9-c251c1032abf tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:54.679145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7a538392-bc13-42ac-afc9-c251c1032abf tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:54.691991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a538392-bc13-42ac-afc9-c251c1032abf tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:54.694530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a538392-bc13-42ac-afc9-c251c1032abf tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:54.696250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a538392-bc13-42ac-afc9-c251c1032abf tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:54.696914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a538392-bc13-42ac-afc9-c251c1032abf tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:54.769718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f47369de-a089-43bd-b367-eaca8065fbec tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Action: 'update', calling method: .version_select at 0x7fb842e02790>, body: {"quota_set": {"ram": "5120"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:54.898380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7a538392-bc13-42ac-afc9-c251c1032abf tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:54.907941 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7a538392-bc13-42ac-afc9-c251c1032abf tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1388 microversion: 2.1 time: 0.241562 Jul 20 04:07:54.908763 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 143/268] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:54 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1388 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:55.392276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6c256b10-7083-4ce8-9952-af93dfb0f1ea req-e2561a7a-e86b-4955-800b-ed8ff5c8c567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32096456-698a-47c4-a1e6-061e62a3a8fb", "name": "network-vif-plugged", "status": "completed", "tag": "122f1c05-dc7d-4076-84e2-d84c89da38b7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:55.403734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6c256b10-7083-4ce8-9952-af93dfb0f1ea req-e2561a7a-e86b-4955-800b-ed8ff5c8c567 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:55.404532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6c256b10-7083-4ce8-9952-af93dfb0f1ea req-e2561a7a-e86b-4955-800b-ed8ff5c8c567 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:55.419036 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6c256b10-7083-4ce8-9952-af93dfb0f1ea req-e2561a7a-e86b-4955-800b-ed8ff5c8c567 service nova] Creating event network-vif-plugged:122f1c05-dc7d-4076-84e2-d84c89da38b7 for instance 32096456-698a-47c4-a1e6-061e62a3a8fb on n-h2-760456-11 Jul 20 04:07:55.425160 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6c256b10-7083-4ce8-9952-af93dfb0f1ea req-e2561a7a-e86b-4955-800b-ed8ff5c8c567 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036769 Jul 20 04:07:55.425994 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 144/269] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:07:55.694597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=75,nova_cell0:UPDATE=12 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:55.697713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f47369de-a089-43bd-b367-eaca8065fbec tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:55.698787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f47369de-a089-43bd-b367-eaca8065fbec tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:55.699872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f47369de-a089-43bd-b367-eaca8065fbec tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:55.700489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f47369de-a089-43bd-b367-eaca8065fbec tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:55.915997 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f47369de-a089-43bd-b367-eaca8065fbec tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/1539c3e55c76490290917b2151819af6" status: 200 len: 240 microversion: 2.36 time: 1.767770 Jul 20 04:07:55.918466 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 126/270] 10.222.0.59 () {62 vars in 1302 bytes} [Wed Jul 20 04:07:54 2022] PUT /compute/v2.1/os-quota-sets/1539c3e55c76490290917b2151819af6 => generated 240 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:55.929384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f4ec29a-f6a3-411c-a575-0a2637418996 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:55.930013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1f4ec29a-f6a3-411c-a575-0a2637418996 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:55.931474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0394915-84f3-45f3-b75f-4509bd81a16c tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Calling method '.version_select at 0x7fb842d0ca60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:55.937689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f4ec29a-f6a3-411c-a575-0a2637418996 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:55.938242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f4ec29a-f6a3-411c-a575-0a2637418996 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:55.939140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f4ec29a-f6a3-411c-a575-0a2637418996 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:55.939711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f4ec29a-f6a3-411c-a575-0a2637418996 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:56.096827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f4ec29a-f6a3-411c-a575-0a2637418996 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:56.105902 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1f4ec29a-f6a3-411c-a575-0a2637418996 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1388 microversion: 2.1 time: 0.180723 Jul 20 04:07:56.107897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 127/271] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:55 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1388 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:56.572703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38a0daad-c3be-453f-8812-00759dfa0300 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Calling method '.version_select at 0x7fb842e02a60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:56.574557 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:56.574557 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:56.576295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-38a0daad-c3be-453f-8812-00759dfa0300 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '6b9bececa0eb41afbefa562cb3158b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013ac2fbc9f84aab97332014e6f7fc4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38a0daad-c3be-453f-8812-00759dfa0300 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Request method failure captured: Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-Zy_a4XXcIWZ0DwMC6HJ6KgZerp2cjR9VPfY_U_Vcmur6tnl2yCh3n8bQgluROtok3x6RX8n3Dv-v5zcfYOgHu4FfI8l3QRa_PaqsvEhNKW7jLn3pbCCZIMltbqiLlklkziYpe2OoKK8Ww23C-ker1qa0YCN0CTFXxY8efe0bj9gA Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 013ac2fbc9f84aab97332014e6f7fc4e Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:56.580098 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 013ac2fbc9f84aab97332014e6f7fc4e Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-HypervisorAdminNegativeTestJSON-159375543-project Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 6b9bececa0eb41afbefa562cb3158b87 Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-159375543-project Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: action_args: {} Jul 20 04:07:56.581303 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:56.582129 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:07:56.583207 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:56.584455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38a0daad-c3be-453f-8812-00759dfa0300 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:56.584455 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-38a0daad-c3be-453f-8812-00759dfa0300 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.379454 Jul 20 04:07:56.584455 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 128/272] 10.222.0.59 () {58 vars in 1166 bytes} [Wed Jul 20 04:07:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 381 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:56.591452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b58accd-64d0-46aa-80ea-6019d8c1747c tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Calling method '.version_select at 0x7fb842c27160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:56.592855 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:56.592855 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:56.594511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b58accd-64d0-46aa-80ea-6019d8c1747c tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '6b9bececa0eb41afbefa562cb3158b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013ac2fbc9f84aab97332014e6f7fc4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b58accd-64d0-46aa-80ea-6019d8c1747c tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Request method failure captured: Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-Zy_a4XXcIWZ0DwMC6HJ6KgZerp2cjR9VPfY_U_Vcmur6tnl2yCh3n8bQgluROtok3x6RX8n3Dv-v5zcfYOgHu4FfI8l3QRa_PaqsvEhNKW7jLn3pbCCZIMltbqiLlklkziYpe2OoKK8Ww23C-ker1qa0YCN0CTFXxY8efe0bj9gA Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 013ac2fbc9f84aab97332014e6f7fc4e Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:56.596704 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 013ac2fbc9f84aab97332014e6f7fc4e Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-HypervisorAdminNegativeTestJSON-159375543-project Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 6b9bececa0eb41afbefa562cb3158b87 Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-159375543-project Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: action_args: {} Jul 20 04:07:56.597845 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:56.598706 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:07:56.599679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:56.601038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b58accd-64d0-46aa-80ea-6019d8c1747c tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:56.601038 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9b58accd-64d0-46aa-80ea-6019d8c1747c tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.012006 Jul 20 04:07:56.601038 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 129/273] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:56 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:56.611885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ecbb78e5-bacf-4eba-ad43-b26835dc8f32 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Calling method '.version_select at 0x7fb842c27160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:56.613187 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:56.613187 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:56.614695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ecbb78e5-bacf-4eba-ad43-b26835dc8f32 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '6b9bececa0eb41afbefa562cb3158b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013ac2fbc9f84aab97332014e6f7fc4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ecbb78e5-bacf-4eba-ad43-b26835dc8f32 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Request method failure captured: Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-Zy_a4XXcIWZ0DwMC6HJ6KgZerp2cjR9VPfY_U_Vcmur6tnl2yCh3n8bQgluROtok3x6RX8n3Dv-v5zcfYOgHu4FfI8l3QRa_PaqsvEhNKW7jLn3pbCCZIMltbqiLlklkziYpe2OoKK8Ww23C-ker1qa0YCN0CTFXxY8efe0bj9gA Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 013ac2fbc9f84aab97332014e6f7fc4e Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:56.616781 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 013ac2fbc9f84aab97332014e6f7fc4e Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-HypervisorAdminNegativeTestJSON-159375543-project Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 6b9bececa0eb41afbefa562cb3158b87 Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-159375543-project Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: action_args: {} Jul 20 04:07:56.618343 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:56.619245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:07:56.621083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:56.623293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ecbb78e5-bacf-4eba-ad43-b26835dc8f32 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:56.624249 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ecbb78e5-bacf-4eba-ad43-b26835dc8f32 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.017206 Jul 20 04:07:56.624765 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 130/274] 10.222.0.59 () {58 vars in 1178 bytes} [Wed Jul 20 04:07:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:56.767706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0394915-84f3-45f3-b75f-4509bd81a16c tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:56.768237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0394915-84f3-45f3-b75f-4509bd81a16c tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:56.769326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0394915-84f3-45f3-b75f-4509bd81a16c tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:56.769892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0394915-84f3-45f3-b75f-4509bd81a16c tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:56.799692 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0394915-84f3-45f3-b75f-4509bd81a16c tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/1539c3e55c76490290917b2151819af6/detail" status: 200 len: 672 microversion: 2.36 time: 0.874634 Jul 20 04:07:56.800342 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 145/275] 10.222.0.59 () {60 vars in 1303 bytes} [Wed Jul 20 04:07:55 2022] GET /compute/v2.1/os-quota-sets/1539c3e55c76490290917b2151819af6/detail => generated 672 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:07:57.072575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4a7c72f0-3d34-474c-a701-677686702abe tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Calling method '.version_select at 0x7fb842eaf8b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:57.075411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a7c72f0-3d34-474c-a701-677686702abe tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:57.075890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a7c72f0-3d34-474c-a701-677686702abe tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:57.094295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a7c72f0-3d34-474c-a701-677686702abe tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:57.094930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a7c72f0-3d34-474c-a701-677686702abe tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:57.106041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a7c72f0-3d34-474c-a701-677686702abe tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:57.106515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a7c72f0-3d34-474c-a701-677686702abe tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:57.112981 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4a7c72f0-3d34-474c-a701-677686702abe tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.482847 Jul 20 04:07:57.113470 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 131/276] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:57.127537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2d89e5bf-5cc1-4832-a8b8-3d61a8cba858 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:57.128461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2d89e5bf-5cc1-4832-a8b8-3d61a8cba858 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:57.132607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83be5eea-fc9c-4964-bf29-2edef3707ea7 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Calling method '.version_select at 0x7fb842e6e3a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:57.134013 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:57.134013 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:57.136268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d89e5bf-5cc1-4832-a8b8-3d61a8cba858 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:57.136483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-83be5eea-fc9c-4964-bf29-2edef3707ea7 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '6b9bececa0eb41afbefa562cb3158b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013ac2fbc9f84aab97332014e6f7fc4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:57.136724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d89e5bf-5cc1-4832-a8b8-3d61a8cba858 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:57.137924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d89e5bf-5cc1-4832-a8b8-3d61a8cba858 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:57.138681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d89e5bf-5cc1-4832-a8b8-3d61a8cba858 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83be5eea-fc9c-4964-bf29-2edef3707ea7 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Request method failure captured: Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-Zy_a4XXcIWZ0DwMC6HJ6KgZerp2cjR9VPfY_U_Vcmur6tnl2yCh3n8bQgluROtok3x6RX8n3Dv-v5zcfYOgHu4FfI8l3QRa_PaqsvEhNKW7jLn3pbCCZIMltbqiLlklkziYpe2OoKK8Ww23C-ker1qa0YCN0CTFXxY8efe0bj9gA Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 013ac2fbc9f84aab97332014e6f7fc4e Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:57.139417 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 013ac2fbc9f84aab97332014e6f7fc4e Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HypervisorAdminNegativeTestJSON-159375543-project Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 6b9bececa0eb41afbefa562cb3158b87 Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-159375543-project Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '1'} Jul 20 04:07:57.140808 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:57.141530 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:07:57.142683 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.144443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83be5eea-fc9c-4964-bf29-2edef3707ea7 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:57.145302 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-83be5eea-fc9c-4964-bf29-2edef3707ea7 tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.025717 Jul 20 04:07:57.145845 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 146/277] 10.222.0.59 () {58 vars in 1172 bytes} [Wed Jul 20 04:07:57 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:57.158128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-008d96a9-fc21-4941-9c93-6cd1e61737f3 tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Calling method '.version_select at 0x7fb842cc8310>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:57.159769 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-008d96a9-fc21-4941-9c93-6cd1e61737f3 tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] HTTP exception thrown: Hypervisor with ID '32d70957-4f43-4a8c-bdf6-9cfe79349c3e' could not be found. Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-008d96a9-fc21-4941-9c93-6cd1e61737f3 tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Request method failure captured: Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hypervisors/32d70957-4f43-4a8c-bdf6-9cfe79349c3e/uptime HTTP/1.1 Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-cymzOotDC7r9SdKxqo5EOHLIwRF7UTZLf7IUGBE5TYoDybJgJk_Gh49WoPiv-a-uNcx8KJJeZWbcNMGsPz6amUm5ZOd6pL9DA4wz76iXXw8__hIq8AlKVDycDdHSvmXQ5J_g1746yY9wlWifKAuzLWOaerepvmSJ8hwnIRHdodWM Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: cacd7cfb49b547a2b75c27a256d1070f Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1186769143 Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:07:57.169760 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cacd7cfb49b547a2b75c27a256d1070f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cacd7cfb49b547a2b75c27a256d1070f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cacd7cfb49b547a2b75c27a256d1070f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cacd7cfb49b547a2b75c27a256d1070f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1186769143 Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: cacd7cfb49b547a2b75c27a256d1070f Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1186769143 Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 55fbbc5e21c44e208f0a918b1e949cf3 Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: exception: Hypervisor with ID '32d70957-4f43-4a8c-bdf6-9cfe79349c3e' could not be found. Jul 20 04:07:57.171047 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '32d70957-4f43-4a8c-bdf6-9cfe79349c3e'} Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '32d70957-4f43-4a8c-bdf6-9cfe79349c3e' Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 20 04:07:57.171757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '32d70957-4f43-4a8c-bdf6-9cfe79349c3e' could not be found. Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:57.172946 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.174038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.174038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:57.174038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:57.174038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:57.174038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:57.174038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '32d70957-4f43-4a8c-bdf6-9cfe79349c3e' could not be found. Jul 20 04:07:57.174038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.174038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-008d96a9-fc21-4941-9c93-6cd1e61737f3 tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Returning 404 to user: Hypervisor with ID '32d70957-4f43-4a8c-bdf6-9cfe79349c3e' could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:57.174038 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-008d96a9-fc21-4941-9c93-6cd1e61737f3 tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/32d70957-4f43-4a8c-bdf6-9cfe79349c3e/uptime" status: 404 len: 123 microversion: 2.1 time: 0.018893 Jul 20 04:07:57.176298 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 147/278] 10.222.0.59 () {58 vars in 1277 bytes} [Wed Jul 20 04:07:57 2022] GET /compute/v2.1/os-hypervisors/32d70957-4f43-4a8c-bdf6-9cfe79349c3e/uptime => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:57.184510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e649d736-59db-48f6-bc58-280baa04c93d tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Calling method '.version_select at 0x7fb842ffdee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:57.185482 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:57.185482 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:57.186641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e649d736-59db-48f6-bc58-280baa04c93d tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:57.187105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e649d736-59db-48f6-bc58-280baa04c93d tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:57.205285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e649d736-59db-48f6-bc58-280baa04c93d tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:57.205756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e649d736-59db-48f6-bc58-280baa04c93d tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:57.218938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e649d736-59db-48f6-bc58-280baa04c93d tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:57.219405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e649d736-59db-48f6-bc58-280baa04c93d tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:57.230733 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e649d736-59db-48f6-bc58-280baa04c93d tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.053108 Jul 20 04:07:57.231547 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 148/279] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:07:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:57.240805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cb2aaee6-644a-4e28-898b-d2d2d3e64ccb tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Calling method '.version_select at 0x7fb842f5dc10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:57.241745 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:57.241745 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:57.242973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cb2aaee6-644a-4e28-898b-d2d2d3e64ccb tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '6b9bececa0eb41afbefa562cb3158b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '013ac2fbc9f84aab97332014e6f7fc4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cb2aaee6-644a-4e28-898b-d2d2d3e64ccb tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Request method failure captured: Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-Zy_a4XXcIWZ0DwMC6HJ6KgZerp2cjR9VPfY_U_Vcmur6tnl2yCh3n8bQgluROtok3x6RX8n3Dv-v5zcfYOgHu4FfI8l3QRa_PaqsvEhNKW7jLn3pbCCZIMltbqiLlklkziYpe2OoKK8Ww23C-ker1qa0YCN0CTFXxY8efe0bj9gA Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 013ac2fbc9f84aab97332014e6f7fc4e Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:57.244660 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_013ac2fbc9f84aab97332014e6f7fc4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 013ac2fbc9f84aab97332014e6f7fc4e Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-159375543 Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HypervisorAdminNegativeTestJSON-159375543-project Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 6b9bececa0eb41afbefa562cb3158b87 Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-159375543-project Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '1'} Jul 20 04:07:57.246595 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:57.247346 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:07:57.251544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.253677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cb2aaee6-644a-4e28-898b-d2d2d3e64ccb tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:57.253677 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cb2aaee6-644a-4e28-898b-d2d2d3e64ccb tempest-HypervisorAdminNegativeTestJSON-159375543 tempest-HypervisorAdminNegativeTestJSON-159375543-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009175 Jul 20 04:07:57.253677 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 149/280] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:07:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:57.255612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0e009309-a4a2-4e2a-982e-c12d32702f3f tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Calling method '.version_select at 0x7fb842d55dc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:57.257478 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-0e009309-a4a2-4e2a-982e-c12d32702f3f tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] HTTP exception thrown: Hypervisor with ID '6ddabbbd-31b0-4724-b282-fc0dac19da6f' could not be found. Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0e009309-a4a2-4e2a-982e-c12d32702f3f tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Request method failure captured: Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hypervisors/6ddabbbd-31b0-4724-b282-fc0dac19da6f HTTP/1.1 Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-cymzOotDC7r9SdKxqo5EOHLIwRF7UTZLf7IUGBE5TYoDybJgJk_Gh49WoPiv-a-uNcx8KJJeZWbcNMGsPz6amUm5ZOd6pL9DA4wz76iXXw8__hIq8AlKVDycDdHSvmXQ5J_g1746yY9wlWifKAuzLWOaerepvmSJ8hwnIRHdodWM Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: cacd7cfb49b547a2b75c27a256d1070f Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1186769143 Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:07:57.259641 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cacd7cfb49b547a2b75c27a256d1070f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cacd7cfb49b547a2b75c27a256d1070f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cacd7cfb49b547a2b75c27a256d1070f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cacd7cfb49b547a2b75c27a256d1070f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1186769143 Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: cacd7cfb49b547a2b75c27a256d1070f Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1186769143 Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 55fbbc5e21c44e208f0a918b1e949cf3 Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: exception: Hypervisor with ID '6ddabbbd-31b0-4724-b282-fc0dac19da6f' could not be found. Jul 20 04:07:57.261777 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '6ddabbbd-31b0-4724-b282-fc0dac19da6f'} Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6ddabbbd-31b0-4724-b282-fc0dac19da6f' Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 20 04:07:57.262472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:07:57.263631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6ddabbbd-31b0-4724-b282-fc0dac19da6f' could not be found. Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6ddabbbd-31b0-4724-b282-fc0dac19da6f' could not be found. Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:57.264676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0e009309-a4a2-4e2a-982e-c12d32702f3f tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] Returning 404 to user: Hypervisor with ID '6ddabbbd-31b0-4724-b282-fc0dac19da6f' could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:57.266239 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0e009309-a4a2-4e2a-982e-c12d32702f3f tempest-HypervisorAdminNegativeTestJSON-1186769143 tempest-HypervisorAdminNegativeTestJSON-1186769143-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/6ddabbbd-31b0-4724-b282-fc0dac19da6f" status: 404 len: 123 microversion: 2.1 time: 0.014107 Jul 20 04:07:57.272879 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 150/281] 10.222.0.59 () {58 vars in 1256 bytes} [Wed Jul 20 04:07:57 2022] GET /compute/v2.1/os-hypervisors/6ddabbbd-31b0-4724-b282-fc0dac19da6f => generated 123 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:57.302851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2d89e5bf-5cc1-4832-a8b8-3d61a8cba858 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:57.311266 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2d89e5bf-5cc1-4832-a8b8-3d61a8cba858 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1388 microversion: 2.1 time: 0.190878 Jul 20 04:07:57.311849 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 132/282] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:57 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1388 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:57.954065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9cce6036-c7d2-4a0f-b644-5b46bcea7e15 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Action: 'update', calling method: .version_select at 0x7fb842d0ca60>, body: {"quota_set": {"ram": "2048"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:58.583525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-57a3aee3-a4b4-4ca4-a877-7f652b576bec tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1369248724", "ram": 512, "vcpus": 1, "disk": 10, "id": 1066723263, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:58.585443 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:58.585443 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:07:58.591422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=10,nova_api:INSERT=6,nova_api:UPDATE=7 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:58.611259 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-57a3aee3-a4b4-4ca4-a877-7f652b576bec tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.520495 Jul 20 04:07:58.611969 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 133/283] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:58 2022] POST /compute/v2.1/flavors => generated 416 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:58.625564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ed6e20e-7e46-433e-b9e1-407297b912dc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:58.626190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8ed6e20e-7e46-433e-b9e1-407297b912dc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:58.633305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ed6e20e-7e46-433e-b9e1-407297b912dc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:58.633761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ed6e20e-7e46-433e-b9e1-407297b912dc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:58.634801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ed6e20e-7e46-433e-b9e1-407297b912dc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:58.635147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ed6e20e-7e46-433e-b9e1-407297b912dc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:58.693617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cce6036-c7d2-4a0f-b644-5b46bcea7e15 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:58.694886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cce6036-c7d2-4a0f-b644-5b46bcea7e15 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:58.696041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cce6036-c7d2-4a0f-b644-5b46bcea7e15 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:58.696553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cce6036-c7d2-4a0f-b644-5b46bcea7e15 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:58.750285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cce6036-c7d2-4a0f-b644-5b46bcea7e15 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:58.750903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cce6036-c7d2-4a0f-b644-5b46bcea7e15 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:58.751728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cce6036-c7d2-4a0f-b644-5b46bcea7e15 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:58.752180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cce6036-c7d2-4a0f-b644-5b46bcea7e15 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:58.785916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8ed6e20e-7e46-433e-b9e1-407297b912dc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:58.794536 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8ed6e20e-7e46-433e-b9e1-407297b912dc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1587 microversion: 2.1 time: 0.176544 Jul 20 04:07:58.800553 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 134/284] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:07:58 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1587 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:58.841971 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9cce6036-c7d2-4a0f-b644-5b46bcea7e15 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/1539c3e55c76490290917b2151819af6?user_id=ef471f029d5746fcaaab1c8239d965e0" status: 200 len: 240 microversion: 2.36 time: 0.891808 Jul 20 04:07:58.842698 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 151/285] 10.222.0.59 () {62 vars in 1383 bytes} [Wed Jul 20 04:07:57 2022] PUT /compute/v2.1/os-quota-sets/1539c3e55c76490290917b2151819af6?user_id=ef471f029d5746fcaaab1c8239d965e0 => generated 240 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:58.849023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0f384b74-d21e-4bf3-bf30-dbc96cf569f7 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:58.849714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0f384b74-d21e-4bf3-bf30-dbc96cf569f7 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:07:58.856393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f384b74-d21e-4bf3-bf30-dbc96cf569f7 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:58.857171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f384b74-d21e-4bf3-bf30-dbc96cf569f7 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:58.858099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f384b74-d21e-4bf3-bf30-dbc96cf569f7 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:07:58.858660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f384b74-d21e-4bf3-bf30-dbc96cf569f7 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:07:58.952902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0f384b74-d21e-4bf3-bf30-dbc96cf569f7 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108792 Jul 20 04:07:58.953499 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 152/286] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:07:58 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:58.963073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e6a70c95-cff5-44ef-944d-f5201925a2a2 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] Calling method '.version_select at 0x7fb842cc8310>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:59.195771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5b9007fd-24ab-49c9-9e98-c19d4861fa93 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:59.208993 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-5b9007fd-24ab-49c9-9e98-c19d4861fa93 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] HTTP exception thrown: Flavor 1066723263 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5b9007fd-24ab-49c9-9e98-c19d4861fa93 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Request method failure captured: Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/flavors/1066723263/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-bpKw1Reby6sFrjstkM0vA8pDjdWLi2PUXYJJrYghFRsQWJcc8dvRQaJ_qDNjfBcb2Xd5xsMkcdrpMPb08z-kpNUMVMdckQFA6a8s5iI1OQutxs79DmRxTwHg3mWbrVoZIDfrdaX5VCHdSSJo4tYgqUE0eWTpIis-SajHuUby68l0 Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 48066cabb803483eb48a7706c09cba7f Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:07:59.211258 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_48066cabb803483eb48a7706c09cba7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 48066cabb803483eb48a7706c09cba7f Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 06dadecbdca349dc9bc4551984583b65 Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:07:59.212615 n-d-760456-11 devstack@n-api.service[119605]: exception: Flavor 1066723263 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'flavor_id': '1066723263', 'id': 'hw:cpu_thread_policy'} Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1066723263 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:59.213234 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.214457 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:59.214457 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:59.214457 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:59.214457 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:07:59.214457 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:07:59.214457 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1066723263 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:07:59.214457 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.217143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5b9007fd-24ab-49c9-9e98-c19d4861fa93 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Returning 404 to user: Flavor 1066723263 has no extra specs with key hw:cpu_thread_policy. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:59.218691 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5b9007fd-24ab-49c9-9e98-c19d4861fa93 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] 10.222.0.59 "GET /compute/v2.1/flavors/1066723263/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.416845 Jul 20 04:07:59.220008 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 135/287] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:07:58 2022] GET /compute/v2.1/flavors/1066723263/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:59.788683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-853184318", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:59.792720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:UPDATE=7,nova_api:DELETE=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:59.797943 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e6a70c95-cff5-44ef-944d-f5201925a2a2 tempest-QuotasAdminTestV236-276539276 tempest-QuotasAdminTestV236-276539276-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/1539c3e55c76490290917b2151819af6?user_id=ef471f029d5746fcaaab1c8239d965e0" status: 200 len: 282 microversion: 2.36 time: 0.843401 Jul 20 04:07:59.798731 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 153/288] 10.222.0.59 () {60 vars in 1363 bytes} [Wed Jul 20 04:07:58 2022] GET /compute/v2.1/os-quota-sets/1539c3e55c76490290917b2151819af6?user_id=ef471f029d5746fcaaab1c8239d965e0 => generated 282 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:07:59.811003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a6287a0-42c1-4dae-b640-5766fd667349 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:59.812678 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:59.812678 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:59.813850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4a6287a0-42c1-4dae-b640-5766fd667349 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '06dadecbdca349dc9bc4551984583b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48066cabb803483eb48a7706c09cba7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a6287a0-42c1-4dae-b640-5766fd667349 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Request method failure captured: Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/flavors/1066723263/os-extra_specs HTTP/1.1 Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 66 Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-bpKw1Reby6sFrjstkM0vA8pDjdWLi2PUXYJJrYghFRsQWJcc8dvRQaJ_qDNjfBcb2Xd5xsMkcdrpMPb08z-kpNUMVMdckQFA6a8s5iI1OQutxs79DmRxTwHg3mWbrVoZIDfrdaX5VCHdSSJo4tYgqUE0eWTpIis-SajHuUby68l0 Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 48066cabb803483eb48a7706c09cba7f Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:59.816069 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_48066cabb803483eb48a7706c09cba7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 48066cabb803483eb48a7706c09cba7f Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 06dadecbdca349dc9bc4551984583b65 Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 20 04:07:59.817506 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'flavor_id': '1066723263', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:59.818324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:07:59.819458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.821516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a6287a0-42c1-4dae-b640-5766fd667349 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:59.822772 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4a6287a0-42c1-4dae-b640-5766fd667349 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] 10.222.0.59 "POST /compute/v2.1/flavors/1066723263/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.017500 Jul 20 04:07:59.824315 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 154/289] 10.222.0.59 () {60 vars in 1223 bytes} [Wed Jul 20 04:07:59 2022] POST /compute/v2.1/flavors/1066723263/os-extra_specs => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:59.838066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d796e5db-5f60-47b4-aa90-a049a83ca0f8 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:59.876879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:07:59.900599 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d796e5db-5f60-47b4-aa90-a049a83ca0f8 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/1066723263/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069206 Jul 20 04:07:59.902939 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 155/290] 10.222.0.59 () {60 vars in 1223 bytes} [Wed Jul 20 04:07:59 2022] POST /compute/v2.1/flavors/1066723263/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:07:59.916799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-070ea7d2-d857-456d-8158-1c3f64113081 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:59.919176 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:07:59.919176 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:07:59.921025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-070ea7d2-d857-456d-8158-1c3f64113081 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '06dadecbdca349dc9bc4551984583b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48066cabb803483eb48a7706c09cba7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-070ea7d2-d857-456d-8158-1c3f64113081 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Request method failure captured: Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-bpKw1Reby6sFrjstkM0vA8pDjdWLi2PUXYJJrYghFRsQWJcc8dvRQaJ_qDNjfBcb2Xd5xsMkcdrpMPb08z-kpNUMVMdckQFA6a8s5iI1OQutxs79DmRxTwHg3mWbrVoZIDfrdaX5VCHdSSJo4tYgqUE0eWTpIis-SajHuUby68l0 Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 48066cabb803483eb48a7706c09cba7f Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:07:59.924873 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_48066cabb803483eb48a7706c09cba7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 48066cabb803483eb48a7706c09cba7f Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 06dadecbdca349dc9bc4551984583b65 Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:07:59.926338 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'flavor_id': '1066723263', 'id': 'hw:numa_nodes'} Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:07:59.927081 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:07:59.928612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-070ea7d2-d857-456d-8158-1c3f64113081 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:07:59.933877 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-070ea7d2-d857-456d-8158-1c3f64113081 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] 10.222.0.59 "DELETE /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015389 Jul 20 04:07:59.933877 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 156/291] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:07:59 2022] DELETE /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:07:59.937742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-23a391c6-b779-4fb8-9d0a-0cd92110b616 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:07:59.998319 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-23a391c6-b779-4fb8-9d0a-0cd92110b616 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/1066723263/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066006 Jul 20 04:07:59.998951 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 157/292] 10.222.0.59 () {60 vars in 1223 bytes} [Wed Jul 20 04:07:59 2022] POST /compute/v2.1/flavors/1066723263/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:08:00.015928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f6bf3e2-bc68-40b6-a486-85c49d013ffc tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:00.019126 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:00.019126 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:00.020402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8f6bf3e2-bc68-40b6-a486-85c49d013ffc tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '06dadecbdca349dc9bc4551984583b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48066cabb803483eb48a7706c09cba7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f6bf3e2-bc68-40b6-a486-85c49d013ffc tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Request method failure captured: Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 22 Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-bpKw1Reby6sFrjstkM0vA8pDjdWLi2PUXYJJrYghFRsQWJcc8dvRQaJ_qDNjfBcb2Xd5xsMkcdrpMPb08z-kpNUMVMdckQFA6a8s5iI1OQutxs79DmRxTwHg3mWbrVoZIDfrdaX5VCHdSSJo4tYgqUE0eWTpIis-SajHuUby68l0 Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 48066cabb803483eb48a7706c09cba7f Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:08:00.024037 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48066cabb803483eb48a7706c09cba7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_48066cabb803483eb48a7706c09cba7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 48066cabb803483eb48a7706c09cba7f Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 06dadecbdca349dc9bc4551984583b65 Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: {"hw:numa_nodes": "1"} Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:00.032528 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'flavor_id': '1066723263', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:08:00.033576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:08:00.034815 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.037992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f6bf3e2-bc68-40b6-a486-85c49d013ffc tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:00.039073 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8f6bf3e2-bc68-40b6-a486-85c49d013ffc tempest-FlavorsExtraSpecsNegativeTestJSON-551723113 tempest-FlavorsExtraSpecsNegativeTestJSON-551723113-project] 10.222.0.59 "PUT /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.031096 Jul 20 04:08:00.045767 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 158/293] 10.222.0.59 () {60 vars in 1264 bytes} [Wed Jul 20 04:08:00 2022] PUT /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes => generated 124 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:00.051676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9918334-07b6-4252-8fbe-4ae796e8df7e tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:00.061987 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e9918334-07b6-4252-8fbe-4ae796e8df7e tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] HTTP exception thrown: Flavor 1066723263 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9918334-07b6-4252-8fbe-4ae796e8df7e tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Request method failure captured: Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/flavors/1066723263/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-e2rpQQSKIPERSY9eZYi392Vm-XL75erh-AQpMGGIhlsL6KATnOLa7ayCbjHW9Cw7Oz73a02xtTp9EkhesAzzNfZuN9C4ydAEUKx5Ik5PoLp8AqnKQt7QgxZxJiLVurU1NghGZE8bH1nNmm3arGOcaWAPtXuBFqO3OQ8LPkf4X8pg Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 38a4afac9add4b6f93b6d64bfebb5afa Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:08:00.063928 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 38a4afac9add4b6f93b6d64bfebb5afa Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 76cd9a4a0b1445c5bcb6aaeea2bc4943 Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:00.067129 n-d-760456-11 devstack@n-api.service[119606]: exception: Flavor 1066723263 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'flavor_id': '1066723263', 'id': 'hw:cpu_thread_policy'} Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1066723263 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:00.068104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.069549 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:00.069549 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:00.069549 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:00.069549 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:00.069549 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:00.069549 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1066723263 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:08:00.069549 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.071325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9918334-07b6-4252-8fbe-4ae796e8df7e tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Returning 404 to user: Flavor 1066723263 has no extra specs with key hw:cpu_thread_policy. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:00.072409 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9918334-07b6-4252-8fbe-4ae796e8df7e tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1066723263/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.025147 Jul 20 04:08:00.073910 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 159/294] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:08:00 2022] DELETE /compute/v2.1/flavors/1066723263/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:00.089525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aff13520-dec0-425c-a212-44c6c981ac67 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:00.094190 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-aff13520-dec0-425c-a212-44c6c981ac67 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aff13520-dec0-425c-a212-44c6c981ac67 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Request method failure captured: Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 27 Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-e2rpQQSKIPERSY9eZYi392Vm-XL75erh-AQpMGGIhlsL6KATnOLa7ayCbjHW9Cw7Oz73a02xtTp9EkhesAzzNfZuN9C4ydAEUKx5Ik5PoLp8AqnKQt7QgxZxJiLVurU1NghGZE8bH1nNmm3arGOcaWAPtXuBFqO3OQ8LPkf4X8pg Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 38a4afac9add4b6f93b6d64bfebb5afa Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:08:00.096312 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 38a4afac9add4b6f93b6d64bfebb5afa Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 76cd9a4a0b1445c5bcb6aaeea2bc4943 Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: {"hw:cpu_policy": "shared"} Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:00.097530 n-d-760456-11 devstack@n-api.service[119606]: exception: Request body and URI mismatch Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'flavor_id': '1066723263', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:00.098367 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:00.099627 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:00.099627 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:00.099627 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 20 04:08:00.099627 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.101391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aff13520-dec0-425c-a212-44c6c981ac67 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:00.112492 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aff13520-dec0-425c-a212-44c6c981ac67 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] 10.222.0.59 "PUT /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.018728 Jul 20 04:08:00.117653 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 160/295] 10.222.0.59 () {60 vars in 1264 bytes} [Wed Jul 20 04:08:00 2022] PUT /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes => generated 73 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:08:00.124519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5968eded-9591-4fbf-b6b4-97ce109ad3f0 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5968eded-9591-4fbf-b6b4-97ce109ad3f0 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Request method failure captured: Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 49 Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-e2rpQQSKIPERSY9eZYi392Vm-XL75erh-AQpMGGIhlsL6KATnOLa7ayCbjHW9Cw7Oz73a02xtTp9EkhesAzzNfZuN9C4ydAEUKx5Ik5PoLp8AqnKQt7QgxZxJiLVurU1NghGZE8bH1nNmm3arGOcaWAPtXuBFqO3OQ8LPkf4X8pg Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 38a4afac9add4b6f93b6d64bfebb5afa Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:08:00.127471 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_38a4afac9add4b6f93b6d64bfebb5afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 38a4afac9add4b6f93b6d64bfebb5afa Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 76cd9a4a0b1445c5bcb6aaeea2bc4943 Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 20 04:08:00.128707 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'flavor_id': '1066723263', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 20 04:08:00.129376 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.131386 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:00.132982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:00.132982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:00.132982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:08:00.132982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:08:00.132982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:08:00.132982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:00.135102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5968eded-9591-4fbf-b6b4-97ce109ad3f0 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:00.136700 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5968eded-9591-4fbf-b6b4-97ce109ad3f0 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] 10.222.0.59 "PUT /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017488 Jul 20 04:08:00.137386 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 161/296] 10.222.0.59 () {60 vars in 1264 bytes} [Wed Jul 20 04:08:00 2022] PUT /compute/v2.1/flavors/1066723263/os-extra_specs/hw:numa_nodes => generated 117 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:08:00.149185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b6584c1-0a6f-4fd4-a378-ffe45e2fd2d6 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:00.150091 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:00.150091 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:00.172020 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4b6584c1-0a6f-4fd4-a378-ffe45e2fd2d6 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1066723263" status: 202 len: 0 microversion: 2.1 time: 0.028152 Jul 20 04:08:00.177173 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 162/297] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:08:00 2022] DELETE /compute/v2.1/flavors/1066723263 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:00.182378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0291920-2454-488a-9aec-8030c4865586 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:00.207730 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0291920-2454-488a-9aec-8030c4865586 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763 tempest-FlavorsExtraSpecsNegativeTestJSON-2024594763-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.028825 Jul 20 04:08:00.208431 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 163/298] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:00 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:00.219489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:00.219980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:00.220492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:00.220897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:00.221354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:00.233728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:00.234174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:00.235338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:00.235908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:00.256732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Getting quotas for project b729031e7ba84401be0ab9da06ae1aa0. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:00.264328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Getting quotas for user 00eb555bda6f4374be55191cc744cd12 and project b729031e7ba84401be0ab9da06ae1aa0. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:00.277935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:00.280404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:00.332482 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d158970c-8910-4cb3-b094-929a57662507 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111320 Jul 20 04:08:00.333652 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 136/299] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:00.346995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6ff0ce16-178f-4160-addb-bcde54c53bbe tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:00.348608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6ff0ce16-178f-4160-addb-bcde54c53bbe tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:00.461370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6ff0ce16-178f-4160-addb-bcde54c53bbe tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:00.487401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:00.497263 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6ff0ce16-178f-4160-addb-bcde54c53bbe tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1219 microversion: 2.1 time: 0.156883 Jul 20 04:08:00.497878 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 164/300] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:00 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:00.855212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fe91f870-7ee3-475f-be03-1660fb7fb11a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:00.856565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fe91f870-7ee3-475f-be03-1660fb7fb11a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:00.873545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe91f870-7ee3-475f-be03-1660fb7fb11a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:00.874467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe91f870-7ee3-475f-be03-1660fb7fb11a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:00.875498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe91f870-7ee3-475f-be03-1660fb7fb11a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:00.876218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe91f870-7ee3-475f-be03-1660fb7fb11a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:01.097766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fe91f870-7ee3-475f-be03-1660fb7fb11a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:01.119359 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fe91f870-7ee3-475f-be03-1660fb7fb11a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 200 len: 1587 microversion: 2.1 time: 0.270005 Jul 20 04:08:01.137904 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 137/301] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:00 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 1587 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:01.526887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-40aff3d8-e192-45f5-ba80-e34619eb9574 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Calling method '.version_select at 0x7fb842c9a5e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:01.528029 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:01.528029 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:01.529201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40aff3d8-e192-45f5-ba80-e34619eb9574 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:01.529660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40aff3d8-e192-45f5-ba80-e34619eb9574 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:01.530502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40aff3d8-e192-45f5-ba80-e34619eb9574 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:01.531181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40aff3d8-e192-45f5-ba80-e34619eb9574 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:01.574722 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-40aff3d8-e192-45f5-ba80-e34619eb9574 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.639070 Jul 20 04:08:01.575326 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 165/302] 10.222.0.59 () {58 vars in 1127 bytes} [Wed Jul 20 04:08:00 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:01.590897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1c8a5822-fe4d-45e4-952a-457981ff460e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:01.591531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1c8a5822-fe4d-45e4-952a-457981ff460e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:01.602674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c8a5822-fe4d-45e4-952a-457981ff460e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:01.603218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c8a5822-fe4d-45e4-952a-457981ff460e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:01.604606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c8a5822-fe4d-45e4-952a-457981ff460e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:01.606190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c8a5822-fe4d-45e4-952a-457981ff460e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:01.725747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1c8a5822-fe4d-45e4-952a-457981ff460e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:01.744491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89ff9ded-2767-47e4-bc50-b733efcd8a8e tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Calling method '.version_select at 0x7fb842dc1c10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:01.752683 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1c8a5822-fe4d-45e4-952a-457981ff460e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1271 microversion: 2.1 time: 0.168736 Jul 20 04:08:01.758022 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 166/303] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:01 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:02.101261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-50e27529-13c9-444b-8e61-9f92fbfe3514 req-1c36a6f4-dd84-43b8-9656-63261e29b9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32096456-698a-47c4-a1e6-061e62a3a8fb", "tag": "122f1c05-dc7d-4076-84e2-d84c89da38b7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:02.113617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-50e27529-13c9-444b-8e61-9f92fbfe3514 req-1c36a6f4-dd84-43b8-9656-63261e29b9d8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.115757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-50e27529-13c9-444b-8e61-9f92fbfe3514 req-1c36a6f4-dd84-43b8-9656-63261e29b9d8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.124224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:02.132395 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-50e27529-13c9-444b-8e61-9f92fbfe3514 req-1c36a6f4-dd84-43b8-9656-63261e29b9d8 service nova] Creating event network-changed:122f1c05-dc7d-4076-84e2-d84c89da38b7 for instance 32096456-698a-47c4-a1e6-061e62a3a8fb on n-h2-760456-11 Jul 20 04:08:02.149574 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-50e27529-13c9-444b-8e61-9f92fbfe3514 req-1c36a6f4-dd84-43b8-9656-63261e29b9d8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389583 Jul 20 04:08:02.151853 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 167/304] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:02.166597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-39be6147-217c-4a87-bc00-36e2c0b5dc22 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Calling method '.version_select at 0x7fb842c9adc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:02.174797 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:02.174797 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:02.177054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39be6147-217c-4a87-bc00-36e2c0b5dc22 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.179504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39be6147-217c-4a87-bc00-36e2c0b5dc22 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.185895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39be6147-217c-4a87-bc00-36e2c0b5dc22 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.186394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39be6147-217c-4a87-bc00-36e2c0b5dc22 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.231055 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-39be6147-217c-4a87-bc00-36e2c0b5dc22 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.076685 Jul 20 04:08:02.239389 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 168/305] 10.222.0.59 () {58 vars in 1138 bytes} [Wed Jul 20 04:08:02 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:02.244168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2e0fa79-ef79-494e-b4c3-e4849c8dcca7 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Calling method '.version_select at 0x7fb842c9a790>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:02.246270 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:02.246270 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:02.247878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2e0fa79-ef79-494e-b4c3-e4849c8dcca7 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.248504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2e0fa79-ef79-494e-b4c3-e4849c8dcca7 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.249523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2e0fa79-ef79-494e-b4c3-e4849c8dcca7 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.251087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2e0fa79-ef79-494e-b4c3-e4849c8dcca7 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.280030 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f2e0fa79-ef79-494e-b4c3-e4849c8dcca7 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.039166 Jul 20 04:08:02.290109 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 169/306] 10.222.0.59 () {58 vars in 1144 bytes} [Wed Jul 20 04:08:02 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:02.299584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4360b03e-dc5a-41ac-9a0a-7248d515c558 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Calling method '.version_select at 0x7fb842c9a040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:02.301085 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:02.301085 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:02.302879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4360b03e-dc5a-41ac-9a0a-7248d515c558 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.303571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4360b03e-dc5a-41ac-9a0a-7248d515c558 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.304758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4360b03e-dc5a-41ac-9a0a-7248d515c558 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.305668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4360b03e-dc5a-41ac-9a0a-7248d515c558 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.336707 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4360b03e-dc5a-41ac-9a0a-7248d515c558 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.045060 Jul 20 04:08:02.349467 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 170/307] 10.222.0.59 () {58 vars in 1127 bytes} [Wed Jul 20 04:08:02 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:02.355315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc96ff78-fa84-48ca-965a-0c3f4fa72f04 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Calling method '.version_select at 0x7fb842c8b550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:02.357907 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:02.357907 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:02.374947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc96ff78-fa84-48ca-965a-0c3f4fa72f04 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.377674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc96ff78-fa84-48ca-965a-0c3f4fa72f04 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.378746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc96ff78-fa84-48ca-965a-0c3f4fa72f04 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.379382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc96ff78-fa84-48ca-965a-0c3f4fa72f04 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.452349 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc96ff78-fa84-48ca-965a-0c3f4fa72f04 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.101358 Jul 20 04:08:02.452990 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 171/308] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:08:02 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:02.471120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ec8fef2-a6ab-46b6-a929-f3c5c531301f tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Calling method '.version_select at 0x7fb842c9a670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:02.474716 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:02.474716 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:02.476909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ec8fef2-a6ab-46b6-a929-f3c5c531301f tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.479310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ec8fef2-a6ab-46b6-a929-f3c5c531301f tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.480615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ec8fef2-a6ab-46b6-a929-f3c5c531301f tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.481087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ec8fef2-a6ab-46b6-a929-f3c5c531301f tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.489011 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89ff9ded-2767-47e4-bc50-b733efcd8a8e tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6" status: 200 len: 371 microversion: 2.1 time: 1.301445 Jul 20 04:08:02.499762 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 138/309] 10.222.0.59 () {58 vars in 1241 bytes} [Wed Jul 20 04:08:01 2022] GET /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 => generated 371 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:08:02.506376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-17e18ade-f9b7-42a6-9cd8-cef47dd09b1d tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Action: 'update', calling method: .version_select at 0x7fb842eaf8b0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:02.539733 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ec8fef2-a6ab-46b6-a929-f3c5c531301f tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.077072 Jul 20 04:08:02.545993 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 172/310] 10.222.0.59 () {58 vars in 1127 bytes} [Wed Jul 20 04:08:02 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:02.552157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f22cfaba-c05a-41eb-aaa8-c554514e4700 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Calling method '.version_select at 0x7fb842d0c430>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:02.552980 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:02.552980 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:02.572265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f22cfaba-c05a-41eb-aaa8-c554514e4700 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.575414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f22cfaba-c05a-41eb-aaa8-c554514e4700 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.608382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f22cfaba-c05a-41eb-aaa8-c554514e4700 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.609141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f22cfaba-c05a-41eb-aaa8-c554514e4700 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.629699 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f22cfaba-c05a-41eb-aaa8-c554514e4700 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-h1-760456-11" status: 200 len: 471 microversion: 2.1 time: 0.083373 Jul 20 04:08:02.630977 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 173/311] 10.222.0.59 () {58 vars in 1172 bytes} [Wed Jul 20 04:08:02 2022] GET /compute/v2.1/os-hosts/n-h1-760456-11 => generated 471 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:08:02.642615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac2d4abc-9b3b-4509-9e6c-38d3bae94385 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Calling method '.version_select at 0x7fb842c9a160>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:02.656613 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:02.656613 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:02.665987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac2d4abc-9b3b-4509-9e6c-38d3bae94385 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.666654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac2d4abc-9b3b-4509-9e6c-38d3bae94385 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.700550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac2d4abc-9b3b-4509-9e6c-38d3bae94385 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.701093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac2d4abc-9b3b-4509-9e6c-38d3bae94385 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.731890 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac2d4abc-9b3b-4509-9e6c-38d3bae94385 tempest-HostsAdminTestJSON-644724625 tempest-HostsAdminTestJSON-644724625-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-h2-760456-11" status: 200 len: 471 microversion: 2.1 time: 0.093848 Jul 20 04:08:02.732506 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 174/312] 10.222.0.59 () {58 vars in 1172 bytes} [Wed Jul 20 04:08:02 2022] GET /compute/v2.1/os-hosts/n-h2-760456-11 => generated 471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:02.770936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f9ff6b2-e821-40ad-8069-3a8ae82cf268 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:02.772044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9f9ff6b2-e821-40ad-8069-3a8ae82cf268 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:02.782687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f9ff6b2-e821-40ad-8069-3a8ae82cf268 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.790013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f9ff6b2-e821-40ad-8069-3a8ae82cf268 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.791143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f9ff6b2-e821-40ad-8069-3a8ae82cf268 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:02.791867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f9ff6b2-e821-40ad-8069-3a8ae82cf268 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:02.966354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9f9ff6b2-e821-40ad-8069-3a8ae82cf268 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:02.974469 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f9ff6b2-e821-40ad-8069-3a8ae82cf268 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1277 microversion: 2.1 time: 0.207943 Jul 20 04:08:02.981203 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 175/313] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:02 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:03.074226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17e18ade-f9b7-42a6-9cd8-cef47dd09b1d tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:03.074703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17e18ade-f9b7-42a6-9cd8-cef47dd09b1d tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:03.076329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17e18ade-f9b7-42a6-9cd8-cef47dd09b1d tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:03.077263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17e18ade-f9b7-42a6-9cd8-cef47dd09b1d tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:03.182974 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-17e18ade-f9b7-42a6-9cd8-cef47dd09b1d tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6" status: 200 len: 328 microversion: 2.1 time: 0.680513 Jul 20 04:08:03.184024 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 139/314] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:08:02 2022] PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 => generated 328 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:03.618132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1681050042", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:03.721924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:04.144517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:04.144954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:04.145439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:04.145859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:04.146299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:04.158619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:04.159646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:04.161229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:04.162817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:04.195271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Getting quotas for project c6a04cf480c24b97bcef31f3cba9f744. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:04.208607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Getting quotas for user e9f224ae2dc24a9fb7caa42c6e20427d and project c6a04cf480c24b97bcef31f3cba9f744. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:04.228070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:04.231539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:04.317632 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b10993d8-345e-4dc3-8fe6-eaa62ca4b7d0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.335426 Jul 20 04:08:04.319307 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 176/315] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:04.326656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd354d2e-227c-4017-8d3f-37576cd3a715 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:04.327592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dd354d2e-227c-4017-8d3f-37576cd3a715 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:04.335684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd354d2e-227c-4017-8d3f-37576cd3a715 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:04.336466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd354d2e-227c-4017-8d3f-37576cd3a715 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:04.337514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd354d2e-227c-4017-8d3f-37576cd3a715 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:04.338312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd354d2e-227c-4017-8d3f-37576cd3a715 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:04.603970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2119563739", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:04.620479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dd354d2e-227c-4017-8d3f-37576cd3a715 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:04.629633 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dd354d2e-227c-4017-8d3f-37576cd3a715 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1319 microversion: 2.1 time: 0.308545 Jul 20 04:08:04.635012 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 177/316] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:04 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:04.652974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-25a05f84-c031-46ba-ac9c-b5f865f319f0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:04.654825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-25a05f84-c031-46ba-ac9c-b5f865f319f0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:04.709975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:04.763485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-25a05f84-c031-46ba-ac9c-b5f865f319f0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:04.771998 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-25a05f84-c031-46ba-ac9c-b5f865f319f0 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1219 microversion: 2.1 time: 0.134499 Jul 20 04:08:04.782200 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 178/317] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:04 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:05.359601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:05.363565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:05.364256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:05.364844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:05.365432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:05.383120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:05.383556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:05.386628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:05.387151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:05.437364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Getting quotas for project 825b325ea59e4a628f2bc92d62f8adb6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:05.446351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Getting quotas for user c53c621b36b24ab495043ef28e414ee6 and project 825b325ea59e4a628f2bc92d62f8adb6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:05.460879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.utils [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] cores quota exceeded for 825b325ea59e4a628f2bc92d62f8adb6, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119605) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:08:05.461754 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Request method failure captured: Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 145 Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-e4XDYKN0il_Pt2Zk3mab5IhZKzKgsKXxJAxwUFIJYHffkAYWvHEvNXuRV-C3lg20SNpYUxT9A10MewGg1051s5EWX28mdSP3bYHTKl4UpFKfdYiGj-MHqnQqnpEN2_dvRGs3fBPxRjGJBqdVP-6W0mbGnfCg0XFU1sLQOrMmN7pk Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 825b325ea59e4a628f2bc92d62f8adb6 Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:08:05.468118 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 825b325ea59e4a628f2bc92d62f8adb6 Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-QuotasAdminNegativeTest-763235633-project Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: c53c621b36b24ab495043ef28e414ee6 Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-QuotasAdminNegativeTest-763235633-project Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2119563739", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} Jul 20 04:08:05.469793 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2119563739', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452'}}} Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:08:05.470646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:05.471678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:05.472898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:05.474215 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:05.474215 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:05.474215 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:05.474215 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:05.474215 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:08:05.474215 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:05.477720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:05.480454 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5654bcef-64f4-4486-a1d7-2cb78a77fdbb tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.679981 Jul 20 04:08:05.492282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1d472c50-78c7-46ed-81cc-c2f481f62851 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Action: 'update', calling method: .version_select at 0x7fb842c08040>, body: {"quota_set": {"cores": 20}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:05.497993 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 140/318] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:03 2022] POST /compute/v2.1/servers => generated 111 bytes in 1698 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:08:05.647019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-78ff1155-4248-46d8-8423-4b4efa47ba10 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:05.647743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-78ff1155-4248-46d8-8423-4b4efa47ba10 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:05.658060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ff1155-4248-46d8-8423-4b4efa47ba10 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:05.659354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ff1155-4248-46d8-8423-4b4efa47ba10 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:05.660426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ff1155-4248-46d8-8423-4b4efa47ba10 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:05.663434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ff1155-4248-46d8-8423-4b4efa47ba10 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:05.832018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-78ff1155-4248-46d8-8423-4b4efa47ba10 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:05.840174 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-78ff1155-4248-46d8-8423-4b4efa47ba10 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1319 microversion: 2.1 time: 0.196977 Jul 20 04:08:05.843238 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 141/319] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:05 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:05.848229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-adcf92e2-dca4-44be-ab5e-334e4bf370ec req-0e80b7f9-d154-4c06-8b88-c93e417c5e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2bc680e-42bb-4811-a347-560765bb4431", "tag": "94c40815-36b7-4821-b4e4-3ab7bcb5c4ff"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:05.880529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-adcf92e2-dca4-44be-ab5e-334e4bf370ec req-0e80b7f9-d154-4c06-8b88-c93e417c5e33 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:05.880969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-adcf92e2-dca4-44be-ab5e-334e4bf370ec req-0e80b7f9-d154-4c06-8b88-c93e417c5e33 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:05.905240 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-adcf92e2-dca4-44be-ab5e-334e4bf370ec req-0e80b7f9-d154-4c06-8b88-c93e417c5e33 service nova] Creating event network-changed:94c40815-36b7-4821-b4e4-3ab7bcb5c4ff for instance f2bc680e-42bb-4811-a347-560765bb4431 on n-h1-760456-11 Jul 20 04:08:05.915058 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-adcf92e2-dca4-44be-ab5e-334e4bf370ec req-0e80b7f9-d154-4c06-8b88-c93e417c5e33 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070221 Jul 20 04:08:05.916281 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 142/320] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:05.937302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10edbb76-b836-4e8e-8a94-8271f7c732d2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:05.938216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10edbb76-b836-4e8e-8a94-8271f7c732d2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:05.947789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10edbb76-b836-4e8e-8a94-8271f7c732d2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:05.948628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10edbb76-b836-4e8e-8a94-8271f7c732d2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:05.949657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10edbb76-b836-4e8e-8a94-8271f7c732d2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:05.950279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10edbb76-b836-4e8e-8a94-8271f7c732d2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:06.039707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:06.059788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d472c50-78c7-46ed-81cc-c2f481f62851 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:06.060249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d472c50-78c7-46ed-81cc-c2f481f62851 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:06.061088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d472c50-78c7-46ed-81cc-c2f481f62851 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:06.061531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d472c50-78c7-46ed-81cc-c2f481f62851 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:06.085564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10edbb76-b836-4e8e-8a94-8271f7c732d2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:06.098018 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10edbb76-b836-4e8e-8a94-8271f7c732d2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1279 microversion: 2.1 time: 0.178880 Jul 20 04:08:06.100097 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 143/321] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:05 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1279 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:06.210564 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1d472c50-78c7-46ed-81cc-c2f481f62851 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6" status: 200 len: 329 microversion: 2.1 time: 0.723018 Jul 20 04:08:06.211211 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 179/322] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:08:05 2022] PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 => generated 329 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:06.225843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-42315b9f-dc31-4db8-a3b1-a67649efdec9 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Calling method '.version_select at 0x7fb842b5f790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:06.755820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c7b1128-1cd2-4af9-9a09-5cef8856c006 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Calling method '.version_select at 0x7fb842c08940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:07.033931 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-42315b9f-dc31-4db8-a3b1-a67649efdec9 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6" status: 200 len: 371 microversion: 2.1 time: 0.815199 Jul 20 04:08:07.034914 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 144/323] 10.222.0.59 () {58 vars in 1241 bytes} [Wed Jul 20 04:08:06 2022] GET /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 => generated 371 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:07.039569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0e6125c8-f304-406d-8eec-9459f7994fb5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:07.040397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0e6125c8-f304-406d-8eec-9459f7994fb5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:07.047288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e6125c8-f304-406d-8eec-9459f7994fb5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:07.047740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e6125c8-f304-406d-8eec-9459f7994fb5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:07.048711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e6125c8-f304-406d-8eec-9459f7994fb5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:07.049318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e6125c8-f304-406d-8eec-9459f7994fb5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:07.230532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0e6125c8-f304-406d-8eec-9459f7994fb5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:07.239579 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0e6125c8-f304-406d-8eec-9459f7994fb5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1319 microversion: 2.1 time: 0.203614 Jul 20 04:08:07.240787 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 145/324] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:07 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:07.254016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f1a2541c-2162-4d03-98e2-076fe2991c36 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Action: 'update', calling method: .version_select at 0x7fb842dc11f0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:07.599097 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c7b1128-1cd2-4af9-9a09-5cef8856c006 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/a10de1d03fc44b368c308bd487808192" status: 200 len: 371 microversion: 2.1 time: 1.253605 Jul 20 04:08:07.599699 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 180/325] 10.222.0.59 () {58 vars in 1241 bytes} [Wed Jul 20 04:08:06 2022] GET /compute/v2.1/os-quota-sets/a10de1d03fc44b368c308bd487808192 => generated 371 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:08:07.618098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1484842-f9b7-410a-b289-fcfae4c687e1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:07.619350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d1484842-f9b7-410a-b289-fcfae4c687e1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:07.633014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1484842-f9b7-410a-b289-fcfae4c687e1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:07.633478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1484842-f9b7-410a-b289-fcfae4c687e1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:07.634278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1484842-f9b7-410a-b289-fcfae4c687e1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:07.636134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1484842-f9b7-410a-b289-fcfae4c687e1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:07.987677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1a2541c-2162-4d03-98e2-076fe2991c36 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:07.988137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1a2541c-2162-4d03-98e2-076fe2991c36 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:07.988972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1a2541c-2162-4d03-98e2-076fe2991c36 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:07.989412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1a2541c-2162-4d03-98e2-076fe2991c36 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.008193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1484842-f9b7-410a-b289-fcfae4c687e1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:08.020680 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1484842-f9b7-410a-b289-fcfae4c687e1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1319 microversion: 2.1 time: 0.409727 Jul 20 04:08:08.022085 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 181/326] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:07 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:08.027122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c13a6665-4799-40fd-926e-93d22accdc3c tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Action: 'update', calling method: .version_select at 0x7fb842c00ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:08.063194 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f1a2541c-2162-4d03-98e2-076fe2991c36 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6" status: 200 len: 328 microversion: 2.1 time: 0.821188 Jul 20 04:08:08.064303 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 146/327] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:08:07 2022] PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 => generated 328 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:08.254129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1523536339", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:08.333892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:08.629280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:08.629806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:08.630291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:08.630799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:08.631467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:08.643063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.643612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.644446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.644936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.675185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Getting quotas for project 825b325ea59e4a628f2bc92d62f8adb6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:08.680596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c13a6665-4799-40fd-926e-93d22accdc3c tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.681117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c13a6665-4799-40fd-926e-93d22accdc3c tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.681474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Getting quotas for user c53c621b36b24ab495043ef28e414ee6 and project 825b325ea59e4a628f2bc92d62f8adb6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:08.682646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c13a6665-4799-40fd-926e-93d22accdc3c tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.683173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c13a6665-4799-40fd-926e-93d22accdc3c tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.699458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.utils [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] instances quota exceeded for 825b325ea59e4a628f2bc92d62f8adb6, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119605) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:08:08.700215 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Request method failure captured: Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 145 Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-e4XDYKN0il_Pt2Zk3mab5IhZKzKgsKXxJAxwUFIJYHffkAYWvHEvNXuRV-C3lg20SNpYUxT9A10MewGg1051s5EWX28mdSP3bYHTKl4UpFKfdYiGj-MHqnQqnpEN2_dvRGs3fBPxRjGJBqdVP-6W0mbGnfCg0XFU1sLQOrMmN7pk Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 825b325ea59e4a628f2bc92d62f8adb6 Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:08:08.703357 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 825b325ea59e4a628f2bc92d62f8adb6 Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-QuotasAdminNegativeTest-763235633-project Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: c53c621b36b24ab495043ef28e414ee6 Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-QuotasAdminNegativeTest-763235633-project Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1523536339", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} Jul 20 04:08:08.704693 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1523536339', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452'}}} Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:08:08.705499 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:08.706668 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:08.708090 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:08.709332 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:08.709332 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:08.709332 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:08.709332 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:08.709332 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:08:08.709332 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:08.710639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:08.712278 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3b91727c-d264-47d4-95a8-819460d0389c tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.462047 Jul 20 04:08:08.713683 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 147/328] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:08 2022] POST /compute/v2.1/servers => generated 119 bytes in 465 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:08:08.719606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-413aba43-2c67-447e-be01-a88c631da2d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:08.720554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-413aba43-2c67-447e-be01-a88c631da2d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:08.727441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-413aba43-2c67-447e-be01-a88c631da2d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.728126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-413aba43-2c67-447e-be01-a88c631da2d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.729285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-413aba43-2c67-447e-be01-a88c631da2d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.730322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-413aba43-2c67-447e-be01-a88c631da2d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.830078 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c13a6665-4799-40fd-926e-93d22accdc3c tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/a10de1d03fc44b368c308bd487808192" status: 200 len: 328 microversion: 2.1 time: 0.806294 Jul 20 04:08:08.834912 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 182/329] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:08:08 2022] PUT /compute/v2.1/os-quota-sets/a10de1d03fc44b368c308bd487808192 => generated 328 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:08.859818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c4dddb9e-4209-47a7-81eb-31256b4f407c req-93b41ba5-4c4b-41c6-b5ee-9c9213df27a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f7fd42-e6f1-4a83-b45d-6575d5f62155", "tag": "72cf5011-e606-4111-9ad5-dd3c2c2b46c4"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:08.871832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c4dddb9e-4209-47a7-81eb-31256b4f407c req-93b41ba5-4c4b-41c6-b5ee-9c9213df27a0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:08.873634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c4dddb9e-4209-47a7-81eb-31256b4f407c req-93b41ba5-4c4b-41c6-b5ee-9c9213df27a0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:08.895530 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c4dddb9e-4209-47a7-81eb-31256b4f407c req-93b41ba5-4c4b-41c6-b5ee-9c9213df27a0 service nova] Creating event network-changed:72cf5011-e606-4111-9ad5-dd3c2c2b46c4 for instance d8f7fd42-e6f1-4a83-b45d-6575d5f62155 on n-h1-760456-11 Jul 20 04:08:08.901463 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c4dddb9e-4209-47a7-81eb-31256b4f407c req-93b41ba5-4c4b-41c6-b5ee-9c9213df27a0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060588 Jul 20 04:08:08.903931 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 183/330] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:08.910238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6fe06235-b9c0-4eb2-ac1b-68e3e05d4b0f tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Action: 'update', calling method: .version_select at 0x7fb842c08160>, body: {"quota_set": {"instances": 10}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:08.943548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-413aba43-2c67-447e-be01-a88c631da2d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:08.952628 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-413aba43-2c67-447e-be01-a88c631da2d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1319 microversion: 2.1 time: 0.237554 Jul 20 04:08:08.961747 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 148/331] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:08 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:09.190293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1819119760", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:09.216768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6fe06235-b9c0-4eb2-ac1b-68e3e05d4b0f tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:09.217257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6fe06235-b9c0-4eb2-ac1b-68e3e05d4b0f tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:09.218016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6fe06235-b9c0-4eb2-ac1b-68e3e05d4b0f tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:09.218484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6fe06235-b9c0-4eb2-ac1b-68e3e05d4b0f tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:09.282128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:09.317253 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6fe06235-b9c0-4eb2-ac1b-68e3e05d4b0f tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6" status: 200 len: 329 microversion: 2.1 time: 0.411649 Jul 20 04:08:09.318200 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 184/332] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:08:08 2022] PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 => generated 329 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:09.325667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06a9e1f9-af8b-4379-8816-2ddc93cd5f10 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:09.350510 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-06a9e1f9-af8b-4379-8816-2ddc93cd5f10 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-quota-sets/a10de1d03fc44b368c308bd487808192" status: 202 len: 0 microversion: 2.1 time: 0.029236 Jul 20 04:08:09.353011 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 185/333] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:08:09 2022] DELETE /compute/v2.1/os-quota-sets/a10de1d03fc44b368c308bd487808192 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:09.365780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-63e31239-14d1-472a-85f9-1ba5ff9e0340 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:09.367605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63e31239-14d1-472a-85f9-1ba5ff9e0340 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:09.387496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63e31239-14d1-472a-85f9-1ba5ff9e0340 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:09.388644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63e31239-14d1-472a-85f9-1ba5ff9e0340 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:09.389491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63e31239-14d1-472a-85f9-1ba5ff9e0340 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:09.389893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63e31239-14d1-472a-85f9-1ba5ff9e0340 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:09.587002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:09.587757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:09.588872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:09.589295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:09.589848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:09.602808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:09.603433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:09.604496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:09.605115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:09.621564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:09.621887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-63e31239-14d1-472a-85f9-1ba5ff9e0340 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:09.629427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:09.631697 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-63e31239-14d1-472a-85f9-1ba5ff9e0340 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1319 microversion: 2.1 time: 0.275136 Jul 20 04:08:09.632953 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 186/334] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:09 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:09.639997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for user e82ac4df5f844ec4996d939efdba9c11 and project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:09.642967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-27b14c37-f282-4964-97ba-8868daf32efd tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Calling method '.version_select at 0x7fb842c08040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:09.659470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:09.666935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:09.721193 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-656b0859-1163-46fe-9ec7-b2e6ff4610f4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766452 Jul 20 04:08:09.722391 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 149/335] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:09.730954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5c94e1a9-1e11-4843-8546-74a3f8bf598f tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Calling method '.version_select at 0x7fb842b5f9d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:09.970656 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-27b14c37-f282-4964-97ba-8868daf32efd tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6" status: 200 len: 371 microversion: 2.1 time: 0.336071 Jul 20 04:08:09.971232 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 187/336] 10.222.0.59 () {58 vars in 1241 bytes} [Wed Jul 20 04:08:09 2022] GET /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 => generated 371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:10.106658 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5c94e1a9-1e11-4843-8546-74a3f8bf598f tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/a10de1d03fc44b368c308bd487808192" status: 200 len: 371 microversion: 2.1 time: 0.382893 Jul 20 04:08:10.108362 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 150/337] 10.222.0.59 () {58 vars in 1241 bytes} [Wed Jul 20 04:08:09 2022] GET /compute/v2.1/os-quota-sets/a10de1d03fc44b368c308bd487808192 => generated 371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:10.116275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f190dc30-c495-4dda-8cf4-f791bf71b359 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:10.117374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f190dc30-c495-4dda-8cf4-f791bf71b359 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:10.204299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f190dc30-c495-4dda-8cf4-f791bf71b359 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:10.214791 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f190dc30-c495-4dda-8cf4-f791bf71b359 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1213 microversion: 2.1 time: 0.104619 Jul 20 04:08:10.217677 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 151/338] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:10 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:10.223631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-547a1d33-15e4-413e-a5cb-5680f7fa1a1f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:10.224246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-547a1d33-15e4-413e-a5cb-5680f7fa1a1f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:10.227401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1934450185", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:10.232164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-547a1d33-15e4-413e-a5cb-5680f7fa1a1f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.232683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-547a1d33-15e4-413e-a5cb-5680f7fa1a1f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:10.233810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-547a1d33-15e4-413e-a5cb-5680f7fa1a1f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.234498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-547a1d33-15e4-413e-a5cb-5680f7fa1a1f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:10.301015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:10.443452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-547a1d33-15e4-413e-a5cb-5680f7fa1a1f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:10.456058 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-547a1d33-15e4-413e-a5cb-5680f7fa1a1f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1319 microversion: 2.1 time: 0.236554 Jul 20 04:08:10.463674 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 152/339] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:10 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:10.471385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-be91769f-5409-4d61-9bcd-6a89ca233960 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Action: 'update', calling method: .version_select at 0x7fb842b5f0d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:10.693057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be91769f-5409-4d61-9bcd-6a89ca233960 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.693505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be91769f-5409-4d61-9bcd-6a89ca233960 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:10.694643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be91769f-5409-4d61-9bcd-6a89ca233960 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.695238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be91769f-5409-4d61-9bcd-6a89ca233960 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:10.748839 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-be91769f-5409-4d61-9bcd-6a89ca233960 tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6" status: 200 len: 325 microversion: 2.1 time: 0.282108 Jul 20 04:08:10.761118 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 153/340] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:08:10 2022] PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 => generated 325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:10.788959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:10.789341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:10.789820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:10.790236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:10.790700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:10.802418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.802879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:10.803696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.804141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:10.822482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Getting quotas for project 0ed9b3e9974a41c888990fe230a2bb7e. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:10.828150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Getting quotas for user 05147b0757b24f7c91b2a47af7ee1fce and project 0ed9b3e9974a41c888990fe230a2bb7e. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:10.842142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:10.844697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:10.893229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e74c71de-4323-4a47-a029-3c7d4ef523af tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Calling method '.version_select at 0x7fb842bfa310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:10.894115 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:10.894115 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:08:10.896874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e74c71de-4323-4a47-a029-3c7d4ef523af tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.897337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e74c71de-4323-4a47-a029-3c7d4ef523af tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:10.901175 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1185a022-f344-4aff-b4e3-ad7026166e55 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928263 Jul 20 04:08:10.902129 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 188/341] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:10.907008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e977272f-0e7e-4de4-9f7f-ce87985e7cf0 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Calling method '.version_select at 0x7fb842c08dc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:10.929173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e74c71de-4323-4a47-a029-3c7d4ef523af tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.930687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e74c71de-4323-4a47-a029-3c7d4ef523af tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:10.962802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e74c71de-4323-4a47-a029-3c7d4ef523af tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.963864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e74c71de-4323-4a47-a029-3c7d4ef523af tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:10.971296 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e74c71de-4323-4a47-a029-3c7d4ef523af tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.220802 Jul 20 04:08:10.972973 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 154/342] 10.222.0.59 () {60 vars in 1186 bytes} [Wed Jul 20 04:08:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:10.978498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e75ba748-4933-4209-a5a0-64a526edd71e tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:10.980227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e75ba748-4933-4209-a5a0-64a526edd71e tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:10.990210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e75ba748-4933-4209-a5a0-64a526edd71e tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.990991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e75ba748-4933-4209-a5a0-64a526edd71e tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:10.993402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e75ba748-4933-4209-a5a0-64a526edd71e tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:10.994056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e75ba748-4933-4209-a5a0-64a526edd71e tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:11.019472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:11.072656 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e977272f-0e7e-4de4-9f7f-ce87985e7cf0 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/6c46edd2c6de426089090487de384f40/defaults" status: 200 len: 371 microversion: 2.1 time: 0.169060 Jul 20 04:08:11.077480 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 189/343] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:08:10 2022] GET /compute/v2.1/os-quota-sets/6c46edd2c6de426089090487de384f40/defaults => generated 371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:11.089937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-897138756", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:11.187550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:11.268061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e75ba748-4933-4209-a5a0-64a526edd71e tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:11.290416 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e75ba748-4933-4209-a5a0-64a526edd71e tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1319 microversion: 2.1 time: 0.316128 Jul 20 04:08:11.301221 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 155/344] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:10 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:11.313583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dad8872a-2a83-4870-8811-917abecdc0ce tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Calling method '.version_select at 0x7fb842b5f310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:11.318956 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:11.318956 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:08:11.324295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dad8872a-2a83-4870-8811-917abecdc0ce tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:11.325928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dad8872a-2a83-4870-8811-917abecdc0ce tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:11.362878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dad8872a-2a83-4870-8811-917abecdc0ce tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:11.363639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dad8872a-2a83-4870-8811-917abecdc0ce tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:11.382831 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dad8872a-2a83-4870-8811-917abecdc0ce tempest-HypervisorAdminV228Test-1603119277 tempest-HypervisorAdminV228Test-1603119277-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.077528 Jul 20 04:08:11.384513 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 156/345] 10.222.0.59 () {60 vars in 1192 bytes} [Wed Jul 20 04:08:11 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:11.409465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1774980025", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:11.513248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:11.619685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:11.620331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:11.620931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:11.621459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:11.622207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:11.643389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:11.645107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:11.647624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:11.648901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:11.700768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Getting quotas for project 825b325ea59e4a628f2bc92d62f8adb6. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:11.707121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Getting quotas for user c53c621b36b24ab495043ef28e414ee6 and project 825b325ea59e4a628f2bc92d62f8adb6. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:11.723723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.utils [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] ram quota exceeded for 825b325ea59e4a628f2bc92d62f8adb6, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119606) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:08:11.725162 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Request method failure captured: Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 144 Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-e4XDYKN0il_Pt2Zk3mab5IhZKzKgsKXxJAxwUFIJYHffkAYWvHEvNXuRV-C3lg20SNpYUxT9A10MewGg1051s5EWX28mdSP3bYHTKl4UpFKfdYiGj-MHqnQqnpEN2_dvRGs3fBPxRjGJBqdVP-6W0mbGnfCg0XFU1sLQOrMmN7pk Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 825b325ea59e4a628f2bc92d62f8adb6 Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:08:11.729737 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 825b325ea59e4a628f2bc92d62f8adb6 Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-QuotasAdminNegativeTest-763235633-project Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: c53c621b36b24ab495043ef28e414ee6 Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-QuotasAdminNegativeTest-763235633-project Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-897138756", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} Jul 20 04:08:11.731360 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-897138756', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452'}}} Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:08:11.732190 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:11.733381 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:11.734773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:11.736961 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:11.736961 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:11.736961 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:11.736961 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:11.736961 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:08:11.736961 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:11.736961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:11.736961 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-956d56e9-1340-4d2c-87b7-1661d782a2c4 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.657014 Jul 20 04:08:11.738428 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 190/346] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:11 2022] POST /compute/v2.1/servers => generated 110 bytes in 660 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:11.746985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aeb0af27-f083-4e18-bc7e-33d6219cd7ed tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:11.748012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aeb0af27-f083-4e18-bc7e-33d6219cd7ed tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:11.755799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aeb0af27-f083-4e18-bc7e-33d6219cd7ed tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:11.756649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aeb0af27-f083-4e18-bc7e-33d6219cd7ed tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:11.757597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aeb0af27-f083-4e18-bc7e-33d6219cd7ed tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:11.758078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aeb0af27-f083-4e18-bc7e-33d6219cd7ed tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:11.839350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aeb0af27-f083-4e18-bc7e-33d6219cd7ed tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:11.847587 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aeb0af27-f083-4e18-bc7e-33d6219cd7ed tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1271 microversion: 2.1 time: 0.107831 Jul 20 04:08:11.858037 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 191/347] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:11 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:11.858037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-436270b9-88b2-4591-b518-e05fe237ef12 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Action: 'update', calling method: .version_select at 0x7fb842c30550>, body: {"quota_set": {"ram": "5120"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:11.888095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:11.888555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:11.889006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:11.889421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:11.889847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:11.906455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:11.907558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:11.908725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:11.909324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:11.935295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Getting quotas for project 0ed9b3e9974a41c888990fe230a2bb7e. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:11.941621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Getting quotas for user 05147b0757b24f7c91b2a47af7ee1fce and project 0ed9b3e9974a41c888990fe230a2bb7e. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:11.959289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:11.962162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:12.043057 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd64bc27-eca5-4d50-86ff-205ad893e5a9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655682 Jul 20 04:08:12.044897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 157/348] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:12.051655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-32901753-3af5-46ff-b81d-c0ae93d6335a tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:12.052344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-32901753-3af5-46ff-b81d-c0ae93d6335a tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:12.061629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32901753-3af5-46ff-b81d-c0ae93d6335a tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.062974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32901753-3af5-46ff-b81d-c0ae93d6335a tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.064516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32901753-3af5-46ff-b81d-c0ae93d6335a tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.065126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32901753-3af5-46ff-b81d-c0ae93d6335a tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.185263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-436270b9-88b2-4591-b518-e05fe237ef12 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.185856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-436270b9-88b2-4591-b518-e05fe237ef12 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.186738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-436270b9-88b2-4591-b518-e05fe237ef12 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.187186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-436270b9-88b2-4591-b518-e05fe237ef12 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.210835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:12.254770 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-436270b9-88b2-4591-b518-e05fe237ef12 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/3e79cfade11d44659369ba545a6d1485" status: 200 len: 328 microversion: 2.1 time: 0.404866 Jul 20 04:08:12.256481 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 192/349] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:08:11 2022] PUT /compute/v2.1/os-quota-sets/3e79cfade11d44659369ba545a6d1485 => generated 328 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:12.263009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8ea55ba4-0935-48ff-94ad-db82cbe8bb6d req-99be1ff0-5670-46ef-b1eb-25426ad7841b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2bc680e-42bb-4811-a347-560765bb4431", "name": "network-vif-plugged", "status": "completed", "tag": "94c40815-36b7-4821-b4e4-3ab7bcb5c4ff"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:12.274041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8ea55ba4-0935-48ff-94ad-db82cbe8bb6d req-99be1ff0-5670-46ef-b1eb-25426ad7841b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.274535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8ea55ba4-0935-48ff-94ad-db82cbe8bb6d req-99be1ff0-5670-46ef-b1eb-25426ad7841b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.290746 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8ea55ba4-0935-48ff-94ad-db82cbe8bb6d req-99be1ff0-5670-46ef-b1eb-25426ad7841b service nova] Creating event network-vif-plugged:94c40815-36b7-4821-b4e4-3ab7bcb5c4ff for instance f2bc680e-42bb-4811-a347-560765bb4431 on n-h1-760456-11 Jul 20 04:08:12.308718 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8ea55ba4-0935-48ff-94ad-db82cbe8bb6d req-99be1ff0-5670-46ef-b1eb-25426ad7841b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051067 Jul 20 04:08:12.315431 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 193/350] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:12.324466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f1927a6-e008-491f-82cc-7ba2fdbe6ddc tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Action: 'update', calling method: .version_select at 0x7fb842c30790>, body: {"quota_set": {"ram": 51200}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:12.377355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-32901753-3af5-46ff-b81d-c0ae93d6335a tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:12.389447 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-32901753-3af5-46ff-b81d-c0ae93d6335a tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1319 microversion: 2.1 time: 0.343272 Jul 20 04:08:12.390459 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 158/351] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:12 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:12.399435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a9ea0c39-46fd-4cd5-a557-c73caf75050d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:12.400073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a9ea0c39-46fd-4cd5-a557-c73caf75050d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:12.551141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f1927a6-e008-491f-82cc-7ba2fdbe6ddc tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.557101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f1927a6-e008-491f-82cc-7ba2fdbe6ddc tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.558377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f1927a6-e008-491f-82cc-7ba2fdbe6ddc tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.560806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f1927a6-e008-491f-82cc-7ba2fdbe6ddc tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.616051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a9ea0c39-46fd-4cd5-a557-c73caf75050d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:12.636550 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a9ea0c39-46fd-4cd5-a557-c73caf75050d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1214 microversion: 2.1 time: 0.240813 Jul 20 04:08:12.642219 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 159/352] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:12 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1214 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:12.669458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b54cf09a-f540-41c1-94a4-9997a1aa54b1 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Calling method '.version_select at 0x7fb842b5f0d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:12.734617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f1927a6-e008-491f-82cc-7ba2fdbe6ddc tempest-QuotasAdminNegativeTest-500895565 tempest-QuotasAdminNegativeTest-500895565-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6" status: 200 len: 329 microversion: 2.1 time: 0.416998 Jul 20 04:08:12.735745 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 194/353] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:08:12 2022] PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 => generated 329 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:12.742602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea230b8f-b388-4efc-a5ef-1e4da9db42c9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:12.743630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea230b8f-b388-4efc-a5ef-1e4da9db42c9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:12.757806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea230b8f-b388-4efc-a5ef-1e4da9db42c9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.758141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea230b8f-b388-4efc-a5ef-1e4da9db42c9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.761129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea230b8f-b388-4efc-a5ef-1e4da9db42c9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.762056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea230b8f-b388-4efc-a5ef-1e4da9db42c9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.802711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b54cf09a-f540-41c1-94a4-9997a1aa54b1 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.803283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b54cf09a-f540-41c1-94a4-9997a1aa54b1 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.804181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b54cf09a-f540-41c1-94a4-9997a1aa54b1 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.804876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b54cf09a-f540-41c1-94a4-9997a1aa54b1 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.839389 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b54cf09a-f540-41c1-94a4-9997a1aa54b1 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/3e79cfade11d44659369ba545a6d1485/detail" status: 200 len: 916 microversion: 2.1 time: 0.195966 Jul 20 04:08:12.841093 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 160/354] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:08:12 2022] GET /compute/v2.1/os-quota-sets/3e79cfade11d44659369ba545a6d1485/detail => generated 916 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:12.847414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-efb8cf99-8eee-4dc1-b856-a72916c58471 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Action: 'update', calling method: .version_select at 0x7fb842e02f70>, body: {"quota_set": {"ram": 0}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:12.852144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-efb8cf99-8eee-4dc1-b856-a72916c58471 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'c53c621b36b24ab495043ef28e414ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825b325ea59e4a628f2bc92d62f8adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-efb8cf99-8eee-4dc1-b856-a72916c58471 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Request method failure captured: Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: request: PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 HTTP/1.1 Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 25 Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-e4XDYKN0il_Pt2Zk3mab5IhZKzKgsKXxJAxwUFIJYHffkAYWvHEvNXuRV-C3lg20SNpYUxT9A10MewGg1051s5EWX28mdSP3bYHTKl4UpFKfdYiGj-MHqnQqnpEN2_dvRGs3fBPxRjGJBqdVP-6W0mbGnfCg0XFU1sLQOrMmN7pk Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 825b325ea59e4a628f2bc92d62f8adb6 Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:08:12.855657 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_825b325ea59e4a628f2bc92d62f8adb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 825b325ea59e4a628f2bc92d62f8adb6 Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-763235633 Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-QuotasAdminNegativeTest-763235633-project Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: c53c621b36b24ab495043ef28e414ee6 Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-QuotasAdminNegativeTest-763235633-project Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: {"quota_set": {"ram": 0}} Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:08:12.856836 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '825b325ea59e4a628f2bc92d62f8adb6', 'body': {'quota_set': {'ram': 0}}} Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:12.857592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:12.858658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:12.861163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:12.861163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:12.861163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:08:12.861163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:08:12.861163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:08:12.861163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:12.861163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-efb8cf99-8eee-4dc1-b856-a72916c58471 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:12.861163 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-efb8cf99-8eee-4dc1-b856-a72916c58471 tempest-QuotasAdminNegativeTest-763235633 tempest-QuotasAdminNegativeTest-763235633-project] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6" status: 403 len: 116 microversion: 2.1 time: 0.015170 Jul 20 04:08:12.861163 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 161/355] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:08:12 2022] PUT /compute/v2.1/os-quota-sets/825b325ea59e4a628f2bc92d62f8adb6 => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:12.866090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-291e8d73-9d05-4666-82fe-c538c20e6173 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:12.866764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-291e8d73-9d05-4666-82fe-c538c20e6173 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:12.875976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-291e8d73-9d05-4666-82fe-c538c20e6173 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.876580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-291e8d73-9d05-4666-82fe-c538c20e6173 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:12.877478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-291e8d73-9d05-4666-82fe-c538c20e6173 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:12.878465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-291e8d73-9d05-4666-82fe-c538c20e6173 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:13.264802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-291e8d73-9d05-4666-82fe-c538c20e6173 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:13.274144 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-291e8d73-9d05-4666-82fe-c538c20e6173 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1313 microversion: 2.1 time: 0.412080 Jul 20 04:08:13.282591 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 162/356] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:12 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:13.287269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9f1d3494-cd0c-4abc-bda4-26aaab7bb917 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Action: 'update', calling method: .version_select at 0x7fb842b5f040>, body: {"quota_set": {"ram": "2048"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:13.340585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ea230b8f-b388-4efc-a5ef-1e4da9db42c9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:13.349974 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea230b8f-b388-4efc-a5ef-1e4da9db42c9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1319 microversion: 2.1 time: 0.612810 Jul 20 04:08:13.350593 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 195/357] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:12 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1319 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:13.415857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ddda44ea-c9bb-4c43-a797-c544efc6bb3d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:13.419191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ddda44ea-c9bb-4c43-a797-c544efc6bb3d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:13.436429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ddda44ea-c9bb-4c43-a797-c544efc6bb3d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:13.438041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ddda44ea-c9bb-4c43-a797-c544efc6bb3d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:13.439482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ddda44ea-c9bb-4c43-a797-c544efc6bb3d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:13.440862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ddda44ea-c9bb-4c43-a797-c544efc6bb3d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:13.816203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f1d3494-cd0c-4abc-bda4-26aaab7bb917 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:13.817812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f1d3494-cd0c-4abc-bda4-26aaab7bb917 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:13.819464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f1d3494-cd0c-4abc-bda4-26aaab7bb917 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:13.820557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f1d3494-cd0c-4abc-bda4-26aaab7bb917 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:13.868484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f1d3494-cd0c-4abc-bda4-26aaab7bb917 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:13.869194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f1d3494-cd0c-4abc-bda4-26aaab7bb917 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:13.871491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f1d3494-cd0c-4abc-bda4-26aaab7bb917 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:13.872101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f1d3494-cd0c-4abc-bda4-26aaab7bb917 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:13.990232 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9f1d3494-cd0c-4abc-bda4-26aaab7bb917 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/3e79cfade11d44659369ba545a6d1485?user_id=095f162a37ea422f828bb377b740a507" status: 200 len: 328 microversion: 2.1 time: 0.706143 Jul 20 04:08:13.991183 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 163/358] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:08:13 2022] PUT /compute/v2.1/os-quota-sets/3e79cfade11d44659369ba545a6d1485?user_id=095f162a37ea422f828bb377b740a507 => generated 328 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:13.998792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-614135e1-75ba-4126-a5ae-e295a9905297 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:13.999509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-614135e1-75ba-4126-a5ae-e295a9905297 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:14.009173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-614135e1-75ba-4126-a5ae-e295a9905297 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:14.010599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-614135e1-75ba-4126-a5ae-e295a9905297 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:14.012225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-614135e1-75ba-4126-a5ae-e295a9905297 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:14.012898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-614135e1-75ba-4126-a5ae-e295a9905297 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:14.121367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ddda44ea-c9bb-4c43-a797-c544efc6bb3d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:14.142303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-614135e1-75ba-4126-a5ae-e295a9905297 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:14.145793 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ddda44ea-c9bb-4c43-a797-c544efc6bb3d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1319 microversion: 2.1 time: 0.741316 Jul 20 04:08:14.153035 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-614135e1-75ba-4126-a5ae-e295a9905297 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1272 microversion: 2.1 time: 0.158275 Jul 20 04:08:14.154748 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 196/360] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:13 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1319 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:14.163991 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 164/359] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:13 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:14.168000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-00f5f571-60ff-45a5-a8ae-6af3b9a03a58 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Calling method '.version_select at 0x7fb842c30700>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:14.301871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f3ef618-cfe2-4a4d-ab81-90cf3e894b50 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:14.303650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8f3ef618-cfe2-4a4d-ab81-90cf3e894b50 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:14.315966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f3ef618-cfe2-4a4d-ab81-90cf3e894b50 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:14.316663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f3ef618-cfe2-4a4d-ab81-90cf3e894b50 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:14.317611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f3ef618-cfe2-4a4d-ab81-90cf3e894b50 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:14.318502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f3ef618-cfe2-4a4d-ab81-90cf3e894b50 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:14.507465 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-00f5f571-60ff-45a5-a8ae-6af3b9a03a58 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/3e79cfade11d44659369ba545a6d1485?user_id=095f162a37ea422f828bb377b740a507" status: 200 len: 370 microversion: 2.1 time: 0.349198 Jul 20 04:08:14.512065 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 197/361] 10.222.0.59 () {58 vars in 1322 bytes} [Wed Jul 20 04:08:14 2022] GET /compute/v2.1/os-quota-sets/3e79cfade11d44659369ba545a6d1485?user_id=095f162a37ea422f828bb377b740a507 => generated 370 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:14.520635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0131077c-56e9-41b2-84be-88247bd0a1f7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:14.521325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0131077c-56e9-41b2-84be-88247bd0a1f7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:14.531727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0131077c-56e9-41b2-84be-88247bd0a1f7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:14.532184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0131077c-56e9-41b2-84be-88247bd0a1f7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:14.533243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0131077c-56e9-41b2-84be-88247bd0a1f7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:14.533794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0131077c-56e9-41b2-84be-88247bd0a1f7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:14.795587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8f3ef618-cfe2-4a4d-ab81-90cf3e894b50 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:14.813021 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8f3ef618-cfe2-4a4d-ab81-90cf3e894b50 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1313 microversion: 2.1 time: 0.517089 Jul 20 04:08:14.814148 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 165/362] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:14 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:14.931452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0131077c-56e9-41b2-84be-88247bd0a1f7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:14.944126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-beecc179-c09e-4528-b0a5-64c009e40341 req-89556848-946e-4cd3-827b-bb2a9e3e098e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca69cf0f-51e1-44c3-b6c7-909906c86a98", "tag": "5bb8310e-d16c-408e-835c-86dc238bca54"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:14.957340 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0131077c-56e9-41b2-84be-88247bd0a1f7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1319 microversion: 2.1 time: 0.441959 Jul 20 04:08:14.957929 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 198/363] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:14 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:14.967283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:14.972819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-beecc179-c09e-4528-b0a5-64c009e40341 req-89556848-946e-4cd3-827b-bb2a9e3e098e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:14.974015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-beecc179-c09e-4528-b0a5-64c009e40341 req-89556848-946e-4cd3-827b-bb2a9e3e098e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:14.986562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bbd5a52e-78c9-48c5-aa51-b23b9b2e3fab tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Calling method '.version_select at 0x7fb842b965e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:15.047137 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-beecc179-c09e-4528-b0a5-64c009e40341 req-89556848-946e-4cd3-827b-bb2a9e3e098e service nova] Creating event network-changed:5bb8310e-d16c-408e-835c-86dc238bca54 for instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 on n-h2-760456-11 Jul 20 04:08:15.073194 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-beecc179-c09e-4528-b0a5-64c009e40341 req-89556848-946e-4cd3-827b-bb2a9e3e098e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129412 Jul 20 04:08:15.079431 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 166/364] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:15.184833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7c6aad3-a878-4151-8e58-3e143793f8e0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:15.185553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b7c6aad3-a878-4151-8e58-3e143793f8e0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:15.210803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7c6aad3-a878-4151-8e58-3e143793f8e0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:15.212393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7c6aad3-a878-4151-8e58-3e143793f8e0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:15.213334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7c6aad3-a878-4151-8e58-3e143793f8e0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:15.214115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7c6aad3-a878-4151-8e58-3e143793f8e0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:15.562067 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bbd5a52e-78c9-48c5-aa51-b23b9b2e3fab tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/6c46edd2c6de426089090487de384f40/defaults" status: 200 len: 371 microversion: 2.1 time: 0.579287 Jul 20 04:08:15.562570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b7c6aad3-a878-4151-8e58-3e143793f8e0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:15.573418 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 199/365] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:08:14 2022] GET /compute/v2.1/os-quota-sets/6c46edd2c6de426089090487de384f40/defaults => generated 371 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:08:15.577532 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b7c6aad3-a878-4151-8e58-3e143793f8e0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1272 microversion: 2.1 time: 0.404868 Jul 20 04:08:15.585498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0a607cc-53a2-42bd-b735-357d5399c337 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:15.588697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e0a607cc-53a2-42bd-b735-357d5399c337 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:15.590455 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 167/366] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:15 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1272 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:15.601869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b89ebdc-0a78-4532-b359-e43e8810b1ad tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Action: 'update', calling method: .version_select at 0x7fb842c278b0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:15.603908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0a607cc-53a2-42bd-b735-357d5399c337 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:15.608084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0a607cc-53a2-42bd-b735-357d5399c337 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:15.610190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0a607cc-53a2-42bd-b735-357d5399c337 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:15.610820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0a607cc-53a2-42bd-b735-357d5399c337 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:15.954975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e0a607cc-53a2-42bd-b735-357d5399c337 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:15.965946 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0a607cc-53a2-42bd-b735-357d5399c337 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1469 microversion: 2.1 time: 0.391325 Jul 20 04:08:15.967462 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 200/367] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:15 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1469 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:15.986595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-bd50433f-6a7b-470a-bf61-35c951ada378 req-e5164767-d5ff-4b8e-9d5d-2d9d9d46c9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f7fd42-e6f1-4a83-b45d-6575d5f62155", "name": "network-vif-plugged", "status": "completed", "tag": "72cf5011-e606-4111-9ad5-dd3c2c2b46c4"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:16.012054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bd50433f-6a7b-470a-bf61-35c951ada378 req-e5164767-d5ff-4b8e-9d5d-2d9d9d46c9f2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:16.013440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bd50433f-6a7b-470a-bf61-35c951ada378 req-e5164767-d5ff-4b8e-9d5d-2d9d9d46c9f2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:16.052146 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-bd50433f-6a7b-470a-bf61-35c951ada378 req-e5164767-d5ff-4b8e-9d5d-2d9d9d46c9f2 service nova] Creating event network-vif-plugged:72cf5011-e606-4111-9ad5-dd3c2c2b46c4 for instance d8f7fd42-e6f1-4a83-b45d-6575d5f62155 on n-h1-760456-11 Jul 20 04:08:16.067588 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-bd50433f-6a7b-470a-bf61-35c951ada378 req-e5164767-d5ff-4b8e-9d5d-2d9d9d46c9f2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095406 Jul 20 04:08:16.074810 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 201/368] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:16.082480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7bf5c756-1df7-4696-b9cf-c22ab0801e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:16.086353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7bf5c756-1df7-4696-b9cf-c22ab0801e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:16.121286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bf5c756-1df7-4696-b9cf-c22ab0801e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:16.125830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bf5c756-1df7-4696-b9cf-c22ab0801e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:16.131943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bf5c756-1df7-4696-b9cf-c22ab0801e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:16.135709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bf5c756-1df7-4696-b9cf-c22ab0801e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:16.161561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:16.313276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b89ebdc-0a78-4532-b359-e43e8810b1ad tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:16.316642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b89ebdc-0a78-4532-b359-e43e8810b1ad tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:16.317501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b89ebdc-0a78-4532-b359-e43e8810b1ad tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:16.317957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b89ebdc-0a78-4532-b359-e43e8810b1ad tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:16.364503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=28 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:16.513774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:16.561330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7bf5c756-1df7-4696-b9cf-c22ab0801e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:16.575554 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7bf5c756-1df7-4696-b9cf-c22ab0801e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1313 microversion: 2.1 time: 0.499202 Jul 20 04:08:16.579774 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 202/369] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:16 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:16.599885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f6c9d6c5-2372-47a8-b59e-a1ecc93727b2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:16.600308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f6c9d6c5-2372-47a8-b59e-a1ecc93727b2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:16.624989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6c9d6c5-2372-47a8-b59e-a1ecc93727b2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:16.626053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6c9d6c5-2372-47a8-b59e-a1ecc93727b2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:16.630810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6c9d6c5-2372-47a8-b59e-a1ecc93727b2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:16.631633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6c9d6c5-2372-47a8-b59e-a1ecc93727b2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:16.713746 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3b89ebdc-0a78-4532-b359-e43e8810b1ad tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/6c46edd2c6de426089090487de384f40" status: 200 len: 329 microversion: 2.1 time: 1.121749 Jul 20 04:08:16.719652 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 168/370] 10.222.0.59 () {60 vars in 1262 bytes} [Wed Jul 20 04:08:15 2022] PUT /compute/v2.1/os-quota-sets/6c46edd2c6de426089090487de384f40 => generated 329 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:16.905581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f6c9d6c5-2372-47a8-b59e-a1ecc93727b2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:16.913725 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f6c9d6c5-2372-47a8-b59e-a1ecc93727b2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1319 microversion: 2.1 time: 0.332614 Jul 20 04:08:16.914641 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 203/371] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:16 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:16.930272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b3091106-2994-45b8-8ff5-592d2d3da712 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:16.931831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b3091106-2994-45b8-8ff5-592d2d3da712 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:16.938540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3091106-2994-45b8-8ff5-592d2d3da712 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:16.939265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3091106-2994-45b8-8ff5-592d2d3da712 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:16.940277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3091106-2994-45b8-8ff5-592d2d3da712 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:16.940915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3091106-2994-45b8-8ff5-592d2d3da712 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:17.004384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a979e8c8-74f8-4539-8af7-a4718757d62f tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:17.005213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a979e8c8-74f8-4539-8af7-a4718757d62f tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:17.021642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a979e8c8-74f8-4539-8af7-a4718757d62f tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:17.023681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a979e8c8-74f8-4539-8af7-a4718757d62f tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:17.024858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a979e8c8-74f8-4539-8af7-a4718757d62f tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:17.027797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a979e8c8-74f8-4539-8af7-a4718757d62f tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:17.125496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a979e8c8-74f8-4539-8af7-a4718757d62f tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:08:17.223674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b3091106-2994-45b8-8ff5-592d2d3da712 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:17.236741 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b3091106-2994-45b8-8ff5-592d2d3da712 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1314 microversion: 2.1 time: 0.310544 Jul 20 04:08:17.237339 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 204/372] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:16 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:17.253201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3ca5476a-7440-4d15-97a9-cbe59d88e0f8 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Action: 'update', calling method: .version_select at 0x7fb842b93160>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:17.403284 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a979e8c8-74f8-4539-8af7-a4718757d62f tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] 10.222.0.59 "DELETE /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 204 len: 0 microversion: 2.1 time: 0.682291 Jul 20 04:08:17.404404 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 169/373] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:08:16 2022] DELETE /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:08:17.413379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-690be67c-4f53-4ba4-8c73-83a2ef3eb11c req-e84fe8a0-0015-469d-903a-97c1e76fa739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "288f952b-81ce-419b-9907-96b8b0db1d30", "tag": "c9911200-3c1e-4fb4-81b5-e7aed1a55549"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:17.440514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-690be67c-4f53-4ba4-8c73-83a2ef3eb11c req-e84fe8a0-0015-469d-903a-97c1e76fa739 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:17.440989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-690be67c-4f53-4ba4-8c73-83a2ef3eb11c req-e84fe8a0-0015-469d-903a-97c1e76fa739 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:17.470055 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-690be67c-4f53-4ba4-8c73-83a2ef3eb11c req-e84fe8a0-0015-469d-903a-97c1e76fa739 service nova] Creating event network-changed:c9911200-3c1e-4fb4-81b5-e7aed1a55549 for instance 288f952b-81ce-419b-9907-96b8b0db1d30 on n-h1-760456-11 Jul 20 04:08:17.479949 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-690be67c-4f53-4ba4-8c73-83a2ef3eb11c req-e84fe8a0-0015-469d-903a-97c1e76fa739 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072839 Jul 20 04:08:17.483286 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 170/374] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:17.489307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ce71e87-b163-4919-9d4f-e0a5514d63ad tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:17.496059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ce71e87-b163-4919-9d4f-e0a5514d63ad tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:17.515705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ce71e87-b163-4919-9d4f-e0a5514d63ad tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:17.515705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ce71e87-b163-4919-9d4f-e0a5514d63ad tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:17.516993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ce71e87-b163-4919-9d4f-e0a5514d63ad tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:17.517424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ce71e87-b163-4919-9d4f-e0a5514d63ad tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:17.699724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3ca5476a-7440-4d15-97a9-cbe59d88e0f8 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:17.700866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3ca5476a-7440-4d15-97a9-cbe59d88e0f8 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:17.701902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3ca5476a-7440-4d15-97a9-cbe59d88e0f8 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:17.702594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3ca5476a-7440-4d15-97a9-cbe59d88e0f8 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:17.716935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=38 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:17.849197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ce71e87-b163-4919-9d4f-e0a5514d63ad tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:17.861226 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ce71e87-b163-4919-9d4f-e0a5514d63ad tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1475 microversion: 2.1 time: 0.373549 Jul 20 04:08:17.861831 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 171/375] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:17 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1475 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:17.877214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6196146d-ece8-46b2-8f2b-6e4c64750bca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:17.878534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6196146d-ece8-46b2-8f2b-6e4c64750bca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:17.888012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6196146d-ece8-46b2-8f2b-6e4c64750bca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:17.889045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6196146d-ece8-46b2-8f2b-6e4c64750bca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:17.890472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6196146d-ece8-46b2-8f2b-6e4c64750bca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:17.891032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6196146d-ece8-46b2-8f2b-6e4c64750bca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:18.039527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=13,nova_api:UPDATE=11 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:18.119946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:18.162450 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3ca5476a-7440-4d15-97a9-cbe59d88e0f8 tempest-QuotasAdminTestJSON-1082483427 tempest-QuotasAdminTestJSON-1082483427-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/6c46edd2c6de426089090487de384f40" status: 200 len: 329 microversion: 2.1 time: 0.919069 Jul 20 04:08:18.170729 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 205/376] 10.222.0.59 () {60 vars in 1262 bytes} [Wed Jul 20 04:08:17 2022] PUT /compute/v2.1/os-quota-sets/6c46edd2c6de426089090487de384f40 => generated 329 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:18.176439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dff79fa2-4ae1-4960-82c6-a4a7fe6d06ef tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:18.177181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dff79fa2-4ae1-4960-82c6-a4a7fe6d06ef tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:18.185077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff79fa2-4ae1-4960-82c6-a4a7fe6d06ef tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:18.185575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff79fa2-4ae1-4960-82c6-a4a7fe6d06ef tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:18.186625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff79fa2-4ae1-4960-82c6-a4a7fe6d06ef tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:18.187085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff79fa2-4ae1-4960-82c6-a4a7fe6d06ef tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:18.239428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6196146d-ece8-46b2-8f2b-6e4c64750bca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:18.254659 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6196146d-ece8-46b2-8f2b-6e4c64750bca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1313 microversion: 2.1 time: 0.390522 Jul 20 04:08:18.270364 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 172/377] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:17 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:18.287982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-de58992a-0cf8-4892-87f1-65143ccccef4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:18.288782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-de58992a-0cf8-4892-87f1-65143ccccef4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:18.302054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de58992a-0cf8-4892-87f1-65143ccccef4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:18.302483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de58992a-0cf8-4892-87f1-65143ccccef4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:18.312375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de58992a-0cf8-4892-87f1-65143ccccef4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:18.313122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de58992a-0cf8-4892-87f1-65143ccccef4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:18.455667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dff79fa2-4ae1-4960-82c6-a4a7fe6d06ef tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:18.466104 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dff79fa2-4ae1-4960-82c6-a4a7fe6d06ef tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1469 microversion: 2.1 time: 0.294119 Jul 20 04:08:18.475722 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 206/378] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:18 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1469 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:18.571946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-de58992a-0cf8-4892-87f1-65143ccccef4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:18.582070 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-de58992a-0cf8-4892-87f1-65143ccccef4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1314 microversion: 2.1 time: 0.322818 Jul 20 04:08:18.583330 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 173/379] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:18 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:18.933021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1326530664", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": "none"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:18.949064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1164643681", "block_migration": true, "disk_over_commit": false}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:18.950695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:18.965398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:18.968584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:18.971473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:18.972949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.019256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:19.019754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:19.020238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:19.020887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:19.021483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:19.051693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.052162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.052980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.053430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.076116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Getting quotas for project cba4b4dc0aab4299b5ea38e7a5ea9ac0. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:19.084095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Getting quotas for user 76255b848a8a4e98a68bf3db12b03de4 and project cba4b4dc0aab4299b5ea38e7a5ea9ac0. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:19.100312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:19.102671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:19.121534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lazy-loading 'flavor' on Instance uuid d8f7fd42-e6f1-4a83-b45d-6575d5f62155 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:08:19.158511 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-630fd2eb-673b-484f-a375-ea3bbda4ff82 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.680351 Jul 20 04:08:19.164604 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 207/380] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:08:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:08:19.177338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-daac910e-9711-46bd-a0bc-99f81a297d41 req-7db18339-56c5-4170-9727-5cdddd3d6342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd5b910-66f3-4c35-a756-3ebed020fd24", "tag": "2d98b0d3-c15e-4d7c-9b95-395b92468eb4"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:19.189851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-daac910e-9711-46bd-a0bc-99f81a297d41 req-7db18339-56c5-4170-9727-5cdddd3d6342 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.190427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-daac910e-9711-46bd-a0bc-99f81a297d41 req-7db18339-56c5-4170-9727-5cdddd3d6342 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.202132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Going to try to live migrate instance to tempest-host-1164643681 {{(pid=119605) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:08:19.212111 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] HTTP exception thrown: Compute host tempest-host-1164643681 could not be found. Jul 20 04:08:19.212329 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-daac910e-9711-46bd-a0bc-99f81a297d41 req-7db18339-56c5-4170-9727-5cdddd3d6342 service nova] Creating event network-changed:2d98b0d3-c15e-4d7c-9b95-395b92468eb4 for instance 5cd5b910-66f3-4c35-a756-3ebed020fd24 on n-h2-760456-11 Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Request method failure captured: Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155/action HTTP/1.1 Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 107 Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-ililKgiULSKB9yI65n2FEZEqCjcdRvtg10zeiQQT3h_0JqgLYdB-m1pe7hXUBKVTEucYXFI78VE1-sCErNt9CsbzG9or5bwLWq7XkWHVY563ovIBFZN5Nq-jODrd8tIcPiqzA1qzKsnWutqIm5ZzxLdvmWqn8wyGWgXQqYWiQfv4 Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 966acfca1fb3493692d3af2edd786255 Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-LiveMigrationNegativeTest-838468959 Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:08:19.217001 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/966acfca1fb3493692d3af2edd786255"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/966acfca1fb3493692d3af2edd786255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/966acfca1fb3493692d3af2edd786255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_966acfca1fb3493692d3af2edd786255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-LiveMigrationNegativeTest-838468959 Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 966acfca1fb3493692d3af2edd786255 Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-838468959 Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-LiveMigrationNegativeTest-838468959-project-admin Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 129e2ccccf2746119c270c47182b275f Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-LiveMigrationNegativeTest-838468959-project-admin Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: {"os-migrateLive": {"host": "tempest-host-1164643681", "block_migration": true, "disk_over_commit": false}} Jul 20 04:08:19.218564 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: exception: Compute host tempest-host-1164643681 could not be found. Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'd8f7fd42-e6f1-4a83-b45d-6575d5f62155', 'body': {'os-migrateLive': {'host': 'tempest-host-1164643681', 'block_migration': True, 'disk_over_commit': False}}} Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:08:19.219389 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1164643681 could not be found. Jul 20 04:08:19.220689 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1164643681 could not be found. Jul 20 04:08:19.222025 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1164643681 could not be found. Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Returning 400 to user: Compute host tempest-host-1164643681 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6bb28ea5-adb5-482b-a605-231a88e0179a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155/action" status: 400 len: 100 microversion: 2.1 time: 0.634095 Jul 20 04:08:19.223610 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 174/381] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Jul 20 04:08:18 2022] POST /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155/action => generated 100 bytes in 639 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:08:19.228193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0eab18e9-a437-4259-a401-833f0eca15b3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:19.229732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0eab18e9-a437-4259-a401-833f0eca15b3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:19.232235 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-daac910e-9711-46bd-a0bc-99f81a297d41 req-7db18339-56c5-4170-9727-5cdddd3d6342 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064704 Jul 20 04:08:19.234927 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 208/382] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:19.238449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0eab18e9-a437-4259-a401-833f0eca15b3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.239048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0eab18e9-a437-4259-a401-833f0eca15b3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.240170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0eab18e9-a437-4259-a401-833f0eca15b3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.240617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0eab18e9-a437-4259-a401-833f0eca15b3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.243817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9fc13219-36b6-4bf2-8be7-718ee182fe4f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:19.263859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9fc13219-36b6-4bf2-8be7-718ee182fe4f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:19.389768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9fc13219-36b6-4bf2-8be7-718ee182fe4f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:19.399232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9fc13219-36b6-4bf2-8be7-718ee182fe4f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:19.403174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9fc13219-36b6-4bf2-8be7-718ee182fe4f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:19.411913 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9fc13219-36b6-4bf2-8be7-718ee182fe4f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "PUT /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1359 microversion: 2.75 time: 0.175271 Jul 20 04:08:19.412842 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 209/383] 10.222.0.59 () {62 vars in 1296 bytes} [Wed Jul 20 04:08:19 2022] PUT /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:19.433440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-34ba7999-1bfd-4219-aea6-6722ac1ebbe8 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:19.434190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-34ba7999-1bfd-4219-aea6-6722ac1ebbe8 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:19.442379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34ba7999-1bfd-4219-aea6-6722ac1ebbe8 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.443010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34ba7999-1bfd-4219-aea6-6722ac1ebbe8 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.443889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34ba7999-1bfd-4219-aea6-6722ac1ebbe8 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.444440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34ba7999-1bfd-4219-aea6-6722ac1ebbe8 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.484537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0eab18e9-a437-4259-a401-833f0eca15b3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:19.497632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:19.508641 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0eab18e9-a437-4259-a401-833f0eca15b3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1475 microversion: 2.1 time: 0.284102 Jul 20 04:08:19.509234 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 175/384] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:19 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1475 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:19.523520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-67f70ec9-5875-49fd-8bce-d444e934a312 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:19.524340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-67f70ec9-5875-49fd-8bce-d444e934a312 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:19.537468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67f70ec9-5875-49fd-8bce-d444e934a312 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.538190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67f70ec9-5875-49fd-8bce-d444e934a312 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.539515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67f70ec9-5875-49fd-8bce-d444e934a312 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.540178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67f70ec9-5875-49fd-8bce-d444e934a312 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.662639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-34ba7999-1bfd-4219-aea6-6722ac1ebbe8 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:19.672517 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-34ba7999-1bfd-4219-aea6-6722ac1ebbe8 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1469 microversion: 2.1 time: 0.243500 Jul 20 04:08:19.676477 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 210/385] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:19 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:19.725187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3493566b-01e5-4800-a781-83c41589d26f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:19.725832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3493566b-01e5-4800-a781-83c41589d26f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:19.893160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3493566b-01e5-4800-a781-83c41589d26f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:19.931618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3493566b-01e5-4800-a781-83c41589d26f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:19.941258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3493566b-01e5-4800-a781-83c41589d26f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:19.951987 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3493566b-01e5-4800-a781-83c41589d26f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1359 microversion: 2.75 time: 0.250865 Jul 20 04:08:19.965856 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 211/386] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:19 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1359 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:19.977717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0a8fb5f-3486-4112-bf43-434f7a398e88 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:19.980518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-67f70ec9-5875-49fd-8bce-d444e934a312 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:19.983586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d0a8fb5f-3486-4112-bf43-434f7a398e88 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:19.990532 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-67f70ec9-5875-49fd-8bce-d444e934a312 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1313 microversion: 2.1 time: 0.470763 Jul 20 04:08:19.998168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0a8fb5f-3486-4112-bf43-434f7a398e88 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.998663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0a8fb5f-3486-4112-bf43-434f7a398e88 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:19.999460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0a8fb5f-3486-4112-bf43-434f7a398e88 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:19.999811 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 176/387] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:19 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:20.000674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0a8fb5f-3486-4112-bf43-434f7a398e88 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:20.005212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-886895429", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:20.094699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:20.334784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d0a8fb5f-3486-4112-bf43-434f7a398e88 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:20.353051 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d0a8fb5f-3486-4112-bf43-434f7a398e88 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1314 microversion: 2.1 time: 0.385938 Jul 20 04:08:20.363584 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 212/388] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:19 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:20.709988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-688452488", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:20.742956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:20.743378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:20.744579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:20.745191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:20.745775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:20.755097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:20.755958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:20.757289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:20.757941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:20.773257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:20.788722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Getting quotas for project c6a04cf480c24b97bcef31f3cba9f744. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:20.797492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Getting quotas for user e9f224ae2dc24a9fb7caa42c6e20427d and project c6a04cf480c24b97bcef31f3cba9f744. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:20.815835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:20.820382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:20.932989 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-77c7bde2-0ab6-4cad-809b-e0b4c94414fc tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927524 Jul 20 04:08:20.935293 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 177/389] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:20.943311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a40acfb4-577b-440b-8aca-087ccdfaa935 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:20.944085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a40acfb4-577b-440b-8aca-087ccdfaa935 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:20.997145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a40acfb4-577b-440b-8aca-087ccdfaa935 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:20.998171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a40acfb4-577b-440b-8aca-087ccdfaa935 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.000309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a40acfb4-577b-440b-8aca-087ccdfaa935 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.000760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a40acfb4-577b-440b-8aca-087ccdfaa935 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.117295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:21.118814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:21.119868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:21.120385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:21.120808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:21.133268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.133730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.135434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.135866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.155892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a40acfb4-577b-440b-8aca-087ccdfaa935 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:21.162146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Getting quotas for project 630a6840350545b297f7acdc4de59765. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:21.169653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Getting quotas for user 8081d25eaba743f69815051eec36d2a3 and project 630a6840350545b297f7acdc4de59765. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:21.170924 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a40acfb4-577b-440b-8aca-087ccdfaa935 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1433 microversion: 2.1 time: 0.231667 Jul 20 04:08:21.171835 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 178/390] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:20 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1433 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:21.185923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-67b41069-e1bb-4bb5-8456-c4c17c01b2a7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:21.186576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-67b41069-e1bb-4bb5-8456-c4c17c01b2a7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:21.209229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:21.214851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:21.288823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-67b41069-e1bb-4bb5-8456-c4c17c01b2a7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:21.289946 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f20be72-4a91-4c6b-b46a-5c846bdd5c8c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927044 Jul 20 04:08:21.293106 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 213/391] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:21.301955 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-67b41069-e1bb-4bb5-8456-c4c17c01b2a7 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1218 microversion: 2.1 time: 0.128154 Jul 20 04:08:21.305251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2d21287f-b55a-43ca-b088-58aae1463a8c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:21.306123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2d21287f-b55a-43ca-b088-58aae1463a8c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:21.308040 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 179/392] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:21 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:21.320427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-103a3e75-d3d1-47a0-8584-90da4b9a2431 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:21.320611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d21287f-b55a-43ca-b088-58aae1463a8c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.320981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d21287f-b55a-43ca-b088-58aae1463a8c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.321638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-103a3e75-d3d1-47a0-8584-90da4b9a2431 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:21.321790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d21287f-b55a-43ca-b088-58aae1463a8c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.322748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d21287f-b55a-43ca-b088-58aae1463a8c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.330393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-103a3e75-d3d1-47a0-8584-90da4b9a2431 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.330854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-103a3e75-d3d1-47a0-8584-90da4b9a2431 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.332753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-103a3e75-d3d1-47a0-8584-90da4b9a2431 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.333204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-103a3e75-d3d1-47a0-8584-90da4b9a2431 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.480975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d21287f-b55a-43ca-b088-58aae1463a8c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:21.491751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d21287f-b55a-43ca-b088-58aae1463a8c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:21.493326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d21287f-b55a-43ca-b088-58aae1463a8c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:21.499596 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2d21287f-b55a-43ca-b088-58aae1463a8c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1417 microversion: 2.75 time: 0.205391 Jul 20 04:08:21.500629 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 214/393] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:21 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1417 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:21.505758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4e51b7b6-6cd6-49db-942c-7acb89a07937 req-3448fba3-b9dc-44d7-940f-8018b97a6dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2bc680e-42bb-4811-a347-560765bb4431", "name": "network-vif-deleted", "tag": "94c40815-36b7-4821-b4e4-3ab7bcb5c4ff"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:21.515829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4e51b7b6-6cd6-49db-942c-7acb89a07937 req-3448fba3-b9dc-44d7-940f-8018b97a6dc8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.516203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4e51b7b6-6cd6-49db-942c-7acb89a07937 req-3448fba3-b9dc-44d7-940f-8018b97a6dc8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.531815 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4e51b7b6-6cd6-49db-942c-7acb89a07937 req-3448fba3-b9dc-44d7-940f-8018b97a6dc8 service nova] Creating event network-vif-deleted:94c40815-36b7-4821-b4e4-3ab7bcb5c4ff for instance f2bc680e-42bb-4811-a347-560765bb4431 on n-h1-760456-11 Jul 20 04:08:21.540517 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4e51b7b6-6cd6-49db-942c-7acb89a07937 req-3448fba3-b9dc-44d7-940f-8018b97a6dc8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037564 Jul 20 04:08:21.549463 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 215/394] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:21.556621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5985a1b0-de9b-4c78-9b32-2815514d47c6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:21.558053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5985a1b0-de9b-4c78-9b32-2815514d47c6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:21.646947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-103a3e75-d3d1-47a0-8584-90da4b9a2431 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:21.663266 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-103a3e75-d3d1-47a0-8584-90da4b9a2431 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1313 microversion: 2.1 time: 0.353646 Jul 20 04:08:21.673576 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 180/395] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:21 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:21.679520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0923388f-e16c-4639-9562-46c04710cec5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:21.680383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0923388f-e16c-4639-9562-46c04710cec5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:21.687469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0923388f-e16c-4639-9562-46c04710cec5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.688267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0923388f-e16c-4639-9562-46c04710cec5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.689273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0923388f-e16c-4639-9562-46c04710cec5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.689926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0923388f-e16c-4639-9562-46c04710cec5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:21.693195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5985a1b0-de9b-4c78-9b32-2815514d47c6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:21.708544 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5985a1b0-de9b-4c78-9b32-2815514d47c6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1221 microversion: 2.1 time: 0.154433 Jul 20 04:08:21.712062 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 216/396] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:21 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:21.953911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-182ae3f2-d38a-43de-b129-d2ba808cd953 req-388a520c-d7f9-4242-b377-c0a102c090c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca69cf0f-51e1-44c3-b6c7-909906c86a98", "name": "network-vif-plugged", "status": "completed", "tag": "5bb8310e-d16c-408e-835c-86dc238bca54"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:21.972203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-182ae3f2-d38a-43de-b129-d2ba808cd953 req-388a520c-d7f9-4242-b377-c0a102c090c8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:21.973125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-182ae3f2-d38a-43de-b129-d2ba808cd953 req-388a520c-d7f9-4242-b377-c0a102c090c8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.008801 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-182ae3f2-d38a-43de-b129-d2ba808cd953 req-388a520c-d7f9-4242-b377-c0a102c090c8 service nova] Creating event network-vif-plugged:5bb8310e-d16c-408e-835c-86dc238bca54 for instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 on n-h2-760456-11 Jul 20 04:08:22.014156 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-182ae3f2-d38a-43de-b129-d2ba808cd953 req-388a520c-d7f9-4242-b377-c0a102c090c8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064148 Jul 20 04:08:22.015259 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 217/397] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:22.135578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0923388f-e16c-4639-9562-46c04710cec5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:22.145914 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0923388f-e16c-4639-9562-46c04710cec5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1314 microversion: 2.1 time: 0.470891 Jul 20 04:08:22.149992 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 181/398] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:21 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:22.190743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:22.191895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:22.204836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.206776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.207783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.208758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.273236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.273948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.274602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lazy-loading 'fault' on Instance uuid f2bc680e-42bb-4811-a347-560765bb4431 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:08:22.325197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-09cafb07-1ee4-4006-9b1e-e06e49fb4b65 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:22.326629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-09cafb07-1ee4-4006-9b1e-e06e49fb4b65 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:22.336716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:22.337683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cafb07-1ee4-4006-9b1e-e06e49fb4b65 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.338942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cafb07-1ee4-4006-9b1e-e06e49fb4b65 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.339948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cafb07-1ee4-4006-9b1e-e06e49fb4b65 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.340674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cafb07-1ee4-4006-9b1e-e06e49fb4b65 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.346185 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-95757fc5-6ec8-40bb-8d60-c09adf0e21a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 200 len: 1309 microversion: 2.1 time: 0.160700 Jul 20 04:08:22.347590 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 218/399] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:22 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 1309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:22.454800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-09cafb07-1ee4-4006-9b1e-e06e49fb4b65 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:22.464614 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-09cafb07-1ee4-4006-9b1e-e06e49fb4b65 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1270 microversion: 2.1 time: 0.145588 Jul 20 04:08:22.465212 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 182/400] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:22 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1270 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:22.519947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b61343ad-a8f4-4ee4-be68-1da67b34dd5e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:22.520632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b61343ad-a8f4-4ee4-be68-1da67b34dd5e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:22.527343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b61343ad-a8f4-4ee4-be68-1da67b34dd5e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.527802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b61343ad-a8f4-4ee4-be68-1da67b34dd5e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.528572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b61343ad-a8f4-4ee4-be68-1da67b34dd5e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.529025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b61343ad-a8f4-4ee4-be68-1da67b34dd5e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.595993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b61343ad-a8f4-4ee4-be68-1da67b34dd5e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:22.605301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b61343ad-a8f4-4ee4-be68-1da67b34dd5e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:22.608309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b61343ad-a8f4-4ee4-be68-1da67b34dd5e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:22.615442 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b61343ad-a8f4-4ee4-be68-1da67b34dd5e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1417 microversion: 2.75 time: 0.099449 Jul 20 04:08:22.616020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 219/401] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:22 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1417 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:08:22.680315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-03c286f3-82e9-4ae7-80d4-6e09b0f609cd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:22.680930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-03c286f3-82e9-4ae7-80d4-6e09b0f609cd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:22.687079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c286f3-82e9-4ae7-80d4-6e09b0f609cd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.687540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c286f3-82e9-4ae7-80d4-6e09b0f609cd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.688310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c286f3-82e9-4ae7-80d4-6e09b0f609cd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.688746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c286f3-82e9-4ae7-80d4-6e09b0f609cd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.726474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-66cd54fd-201f-40a4-bc81-ec91ab86a427 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:22.731165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-66cd54fd-201f-40a4-bc81-ec91ab86a427 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:22.740809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-66cd54fd-201f-40a4-bc81-ec91ab86a427 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.747203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-66cd54fd-201f-40a4-bc81-ec91ab86a427 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.748213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-66cd54fd-201f-40a4-bc81-ec91ab86a427 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:22.750155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-66cd54fd-201f-40a4-bc81-ec91ab86a427 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:22.992278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-03c286f3-82e9-4ae7-80d4-6e09b0f609cd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:23.000828 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-03c286f3-82e9-4ae7-80d4-6e09b0f609cd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1313 microversion: 2.1 time: 0.324433 Jul 20 04:08:23.001413 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 183/402] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:22 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:23.084958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-66cd54fd-201f-40a4-bc81-ec91ab86a427 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:23.093283 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-66cd54fd-201f-40a4-bc81-ec91ab86a427 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1217 microversion: 2.1 time: 0.370697 Jul 20 04:08:23.094221 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 220/403] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:22 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1217 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:23.167632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-189fa090-f56e-4daa-88b2-34cd3efcf0bf tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:23.168344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-189fa090-f56e-4daa-88b2-34cd3efcf0bf tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:23.176389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-189fa090-f56e-4daa-88b2-34cd3efcf0bf tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:23.176389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-189fa090-f56e-4daa-88b2-34cd3efcf0bf tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:23.176389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-189fa090-f56e-4daa-88b2-34cd3efcf0bf tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:23.176663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-189fa090-f56e-4daa-88b2-34cd3efcf0bf tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:23.364424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c7b41c6-be9d-4b9e-a408-7cb912f102a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:23.365648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5c7b41c6-be9d-4b9e-a408-7cb912f102a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:23.372486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c7b41c6-be9d-4b9e-a408-7cb912f102a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:23.373251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c7b41c6-be9d-4b9e-a408-7cb912f102a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:23.374519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c7b41c6-be9d-4b9e-a408-7cb912f102a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:23.375164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c7b41c6-be9d-4b9e-a408-7cb912f102a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:23.391733 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5c7b41c6-be9d-4b9e-a408-7cb912f102a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] HTTP exception thrown: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c7b41c6-be9d-4b9e-a408-7cb912f102a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Request method failure captured: Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 HTTP/1.1 Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-cS1PKOO3w0IVDjUHsszaPc6318Zi0bgqQFq1C4C2qXV0KopawsPPj0zf2A-2iLKoqlcOJ7Oi3UoW8t2IwsY3Tbp0LaSeFTKuB_6GFoS20MRVPWwWVEIPQuKPI-GNG9yRlL8o1z-MhAdQSMmjuFXacWTFgHeQjp3XIiQOCkOGrDik Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:08:23.394329 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 00eb555bda6f4374be55191cc744cd12 Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:23.395873 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'f2bc680e-42bb-4811-a347-560765bb4431'} Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:23.396718 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:23.398049 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:23.401529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c7b41c6-be9d-4b9e-a408-7cb912f102a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Returning 404 to user: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:23.402659 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5c7b41c6-be9d-4b9e-a408-7cb912f102a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 404 len: 111 microversion: 2.1 time: 0.042338 Jul 20 04:08:23.414141 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 221/404] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:23 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:08:23.481601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-189fa090-f56e-4daa-88b2-34cd3efcf0bf tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:23.482768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-65c452b4-1d68-4283-96a8-98569f43658d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:23.484556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-65c452b4-1d68-4283-96a8-98569f43658d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:23.491115 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-189fa090-f56e-4daa-88b2-34cd3efcf0bf tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1314 microversion: 2.1 time: 0.327690 Jul 20 04:08:23.497031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65c452b4-1d68-4283-96a8-98569f43658d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:23.497601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65c452b4-1d68-4283-96a8-98569f43658d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:23.499476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65c452b4-1d68-4283-96a8-98569f43658d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:23.503163 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 184/405] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:23 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:23.504874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65c452b4-1d68-4283-96a8-98569f43658d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:23.633383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1045047734", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:23.726617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-65c452b4-1d68-4283-96a8-98569f43658d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:23.784783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:23.785836 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-65c452b4-1d68-4283-96a8-98569f43658d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1276 microversion: 2.1 time: 0.306476 Jul 20 04:08:23.803892 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 222/406] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:23 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1276 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:23.831395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cafaee52-d76e-4f14-a69d-3a26a1495b7d tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:23.835366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cafaee52-d76e-4f14-a69d-3a26a1495b7d tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:23.858155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=87,nova_api:INSERT=9 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:23.865926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cafaee52-d76e-4f14-a69d-3a26a1495b7d tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:23.866735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cafaee52-d76e-4f14-a69d-3a26a1495b7d tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:23.868059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cafaee52-d76e-4f14-a69d-3a26a1495b7d tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:23.873712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cafaee52-d76e-4f14-a69d-3a26a1495b7d tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.088504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cafaee52-d76e-4f14-a69d-3a26a1495b7d tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:24.099090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cafaee52-d76e-4f14-a69d-3a26a1495b7d tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:24.102519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cafaee52-d76e-4f14-a69d-3a26a1495b7d tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:24.118815 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cafaee52-d76e-4f14-a69d-3a26a1495b7d tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1438 microversion: 2.75 time: 0.311946 Jul 20 04:08:24.119496 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 223/407] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:23 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1438 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:24.142831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0450e8d3-01b0-4fc0-8619-3ce3ec59b350 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:24.143671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0450e8d3-01b0-4fc0-8619-3ce3ec59b350 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:24.153082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0450e8d3-01b0-4fc0-8619-3ce3ec59b350 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.153836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0450e8d3-01b0-4fc0-8619-3ce3ec59b350 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.154951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0450e8d3-01b0-4fc0-8619-3ce3ec59b350 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.155512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0450e8d3-01b0-4fc0-8619-3ce3ec59b350 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.297273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0450e8d3-01b0-4fc0-8619-3ce3ec59b350 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:24.305651 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0450e8d3-01b0-4fc0-8619-3ce3ec59b350 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1463 microversion: 2.1 time: 0.171699 Jul 20 04:08:24.306333 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 224/408] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:24 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1463 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:24.311630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-cacf4719-9966-4999-b30e-9eb50cb09e39 req-cf123cce-9434-4bdb-b12b-5f9ba89ff61a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288f952b-81ce-419b-9907-96b8b0db1d30", "name": "network-vif-plugged", "status": "completed", "tag": "c9911200-3c1e-4fb4-81b5-e7aed1a55549"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:24.320269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cacf4719-9966-4999-b30e-9eb50cb09e39 req-cf123cce-9434-4bdb-b12b-5f9ba89ff61a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.320748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cacf4719-9966-4999-b30e-9eb50cb09e39 req-cf123cce-9434-4bdb-b12b-5f9ba89ff61a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.332548 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-cacf4719-9966-4999-b30e-9eb50cb09e39 req-cf123cce-9434-4bdb-b12b-5f9ba89ff61a service nova] Creating event network-vif-plugged:c9911200-3c1e-4fb4-81b5-e7aed1a55549 for instance 288f952b-81ce-419b-9907-96b8b0db1d30 on n-h1-760456-11 Jul 20 04:08:24.337408 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-cacf4719-9966-4999-b30e-9eb50cb09e39 req-cf123cce-9434-4bdb-b12b-5f9ba89ff61a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029376 Jul 20 04:08:24.339052 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 225/409] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:24.345875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c185059-ffcc-4cd4-afde-f4861c02e209 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:24.345875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5c185059-ffcc-4cd4-afde-f4861c02e209 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:24.352190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c185059-ffcc-4cd4-afde-f4861c02e209 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.353114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c185059-ffcc-4cd4-afde-f4861c02e209 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.362714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c185059-ffcc-4cd4-afde-f4861c02e209 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.363790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c185059-ffcc-4cd4-afde-f4861c02e209 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.420329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:24.422472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:24.422711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:24.423096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:24.423578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:24.425672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=17,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:24.442678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.443580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.444648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.445588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.459873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5c185059-ffcc-4cd4-afde-f4861c02e209 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:24.464553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:24.473739 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5c185059-ffcc-4cd4-afde-f4861c02e209 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1279 microversion: 2.1 time: 0.132348 Jul 20 04:08:24.479170 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 226/410] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:24 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1279 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:24.512310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Getting quotas for project b729031e7ba84401be0ab9da06ae1aa0. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:24.522050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Getting quotas for user 00eb555bda6f4374be55191cc744cd12 and project b729031e7ba84401be0ab9da06ae1aa0. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:24.547291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:24.550079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:24.630526 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-46f15c04-cad2-4699-b10d-105e86ae2df8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004481 Jul 20 04:08:24.638448 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 185/411] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:08:24.643741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:24.645805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:24.652992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.653668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.655334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.656192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.717033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dfc8428d-3263-4c2e-8907-12670635fff6 tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Action: 'update', calling method: .version_select at 0x7fb842b101f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:24.777317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:24.778407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:24.779178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:24.780016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:24.780658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:24.840838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfc8428d-3263-4c2e-8907-12670635fff6 tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.843079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfc8428d-3263-4c2e-8907-12670635fff6 tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.843986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfc8428d-3263-4c2e-8907-12670635fff6 tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.846960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfc8428d-3263-4c2e-8907-12670635fff6 tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.923493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:24.937101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.937972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.939264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:24.940049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:24.952399 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dfc8428d-3263-4c2e-8907-12670635fff6 tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/fd22a7b5efed49b2919c213716e2832d" status: 200 len: 148 microversion: 2.57 time: 0.471889 Jul 20 04:08:24.958145 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 227/412] 10.222.0.59 () {62 vars in 1302 bytes} [Wed Jul 20 04:08:24 2022] PUT /compute/v2.1/os-quota-sets/fd22a7b5efed49b2919c213716e2832d => generated 148 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:25.125786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-29b42d54-0861-4871-bf14-650aae2c0d9f tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:25.126493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-29b42d54-0861-4871-bf14-650aae2c0d9f tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:25.133593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29b42d54-0861-4871-bf14-650aae2c0d9f tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.134063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29b42d54-0861-4871-bf14-650aae2c0d9f tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.135481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29b42d54-0861-4871-bf14-650aae2c0d9f tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.136164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29b42d54-0861-4871-bf14-650aae2c0d9f tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.442156 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-29b42d54-0861-4871-bf14-650aae2c0d9f tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1616 microversion: 2.1 time: 0.482855 Jul 20 04:08:25.443062 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 228/413] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:24 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1616 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:25.447446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:25.458870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:25.462101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db7e73dc-e38c-4916-a94b-533a418d0a1e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:25.463773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:25.465600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-db7e73dc-e38c-4916-a94b-533a418d0a1e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:25.476731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db7e73dc-e38c-4916-a94b-533a418d0a1e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.477464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db7e73dc-e38c-4916-a94b-533a418d0a1e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.480030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db7e73dc-e38c-4916-a94b-533a418d0a1e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.480683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db7e73dc-e38c-4916-a94b-533a418d0a1e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.482177 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7c026563-63ec-48c5-8c31-3196f1602367 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "POST /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee/action" status: 202 len: 1495 microversion: 2.75 time: 0.841351 Jul 20 04:08:25.484593 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 186/414] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:08:24 2022] POST /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee/action => generated 1495 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:08:25.505221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-22300427-15e1-46ce-adf8-e4915ad9dd2c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:25.511458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22300427-15e1-46ce-adf8-e4915ad9dd2c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:25.533407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22300427-15e1-46ce-adf8-e4915ad9dd2c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.533871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22300427-15e1-46ce-adf8-e4915ad9dd2c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.534696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22300427-15e1-46ce-adf8-e4915ad9dd2c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.535792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22300427-15e1-46ce-adf8-e4915ad9dd2c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.675754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-db7e73dc-e38c-4916-a94b-533a418d0a1e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:25.684593 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-db7e73dc-e38c-4916-a94b-533a418d0a1e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1314 microversion: 2.1 time: 0.232726 Jul 20 04:08:25.685408 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 229/415] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:25 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:25.691196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1ea8efbf-3026-4e9c-b69e-5ae0d2e9bd6a tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:25.691886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1ea8efbf-3026-4e9c-b69e-5ae0d2e9bd6a tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:25.694365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-22300427-15e1-46ce-adf8-e4915ad9dd2c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:25.699490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ea8efbf-3026-4e9c-b69e-5ae0d2e9bd6a tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.700173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ea8efbf-3026-4e9c-b69e-5ae0d2e9bd6a tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.701024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ea8efbf-3026-4e9c-b69e-5ae0d2e9bd6a tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.701528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ea8efbf-3026-4e9c-b69e-5ae0d2e9bd6a tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.702718 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-22300427-15e1-46ce-adf8-e4915ad9dd2c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1216 microversion: 2.1 time: 0.215498 Jul 20 04:08:25.714840 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 187/416] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:25 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1216 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:25.722523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e448f292-22d0-4897-8b87-117747b0969a tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Calling method '.version_select at 0x7fb842a79ee0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:25.822179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e448f292-22d0-4897-8b87-117747b0969a tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.822998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e448f292-22d0-4897-8b87-117747b0969a tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.824028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e448f292-22d0-4897-8b87-117747b0969a tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.824791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e448f292-22d0-4897-8b87-117747b0969a tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.847743 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e448f292-22d0-4897-8b87-117747b0969a tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/fd22a7b5efed49b2919c213716e2832d/detail" status: 200 len: 463 microversion: 2.57 time: 0.130934 Jul 20 04:08:25.848713 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 188/417] 10.222.0.59 () {60 vars in 1303 bytes} [Wed Jul 20 04:08:25 2022] GET /compute/v2.1/os-quota-sets/fd22a7b5efed49b2919c213716e2832d/detail => generated 463 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:25.854043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c5ae4d8-ec6e-4a94-9cf4-5ef4accd5673 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:25.854938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c5ae4d8-ec6e-4a94-9cf4-5ef4accd5673 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:25.865824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5ae4d8-ec6e-4a94-9cf4-5ef4accd5673 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.866569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5ae4d8-ec6e-4a94-9cf4-5ef4accd5673 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.867553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5ae4d8-ec6e-4a94-9cf4-5ef4accd5673 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.868192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5ae4d8-ec6e-4a94-9cf4-5ef4accd5673 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.886187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1ea8efbf-3026-4e9c-b69e-5ae0d2e9bd6a tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:25.905503 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1ea8efbf-3026-4e9c-b69e-5ae0d2e9bd6a tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1318 microversion: 2.1 time: 0.218797 Jul 20 04:08:25.906615 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 230/418] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:25 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:25.919170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-16280444-90fb-4ac7-a537-5d6be325f68b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:25.919861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-16280444-90fb-4ac7-a537-5d6be325f68b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:25.929438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16280444-90fb-4ac7-a537-5d6be325f68b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.929910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16280444-90fb-4ac7-a537-5d6be325f68b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:25.932094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16280444-90fb-4ac7-a537-5d6be325f68b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:25.939190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16280444-90fb-4ac7-a537-5d6be325f68b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.010330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c5ae4d8-ec6e-4a94-9cf4-5ef4accd5673 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '76ca70f286324a98b7589d76b890fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d1c878f033455faa4920d840e07769', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:26.011317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c5ae4d8-ec6e-4a94-9cf4-5ef4accd5673 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] flavor_id is None. Assuming migration. {{(pid=119605) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:08:26.012355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c5ae4d8-ec6e-4a94-9cf4-5ef4accd5673 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119605) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:08:26.042090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-16280444-90fb-4ac7-a537-5d6be325f68b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:26.052223 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-16280444-90fb-4ac7-a537-5d6be325f68b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1279 microversion: 2.1 time: 0.144107 Jul 20 04:08:26.052812 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 231/419] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:25 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1279 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:26.067611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31ef224c-bc51-41b4-820f-97a3f3b2fe03 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:26.068614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31ef224c-bc51-41b4-820f-97a3f3b2fe03 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:26.077667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31ef224c-bc51-41b4-820f-97a3f3b2fe03 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.079411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31ef224c-bc51-41b4-820f-97a3f3b2fe03 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.080546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31ef224c-bc51-41b4-820f-97a3f3b2fe03 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.081205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31ef224c-bc51-41b4-820f-97a3f3b2fe03 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.162963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31ef224c-bc51-41b4-820f-97a3f3b2fe03 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:26.176239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31ef224c-bc51-41b4-820f-97a3f3b2fe03 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:26.179714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31ef224c-bc51-41b4-820f-97a3f3b2fe03 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:26.195338 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31ef224c-bc51-41b4-820f-97a3f3b2fe03 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.141463 Jul 20 04:08:26.200510 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 232/420] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:26 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:26.208741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2db8df4c-3679-4df4-9e83-bf737cb4b3ee tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Action: 'update', calling method: .version_select at 0x7fb842b1a8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:26.319986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2db8df4c-3679-4df4-9e83-bf737cb4b3ee tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.320436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2db8df4c-3679-4df4-9e83-bf737cb4b3ee tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.321375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2db8df4c-3679-4df4-9e83-bf737cb4b3ee tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.321667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2db8df4c-3679-4df4-9e83-bf737cb4b3ee tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.376071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2db8df4c-3679-4df4-9e83-bf737cb4b3ee tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.376660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2db8df4c-3679-4df4-9e83-bf737cb4b3ee tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.377550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2db8df4c-3679-4df4-9e83-bf737cb4b3ee tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.378050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2db8df4c-3679-4df4-9e83-bf737cb4b3ee tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.453240 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2db8df4c-3679-4df4-9e83-bf737cb4b3ee tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/fd22a7b5efed49b2919c213716e2832d?user_id=324512d4f95b42d1b05df146b8e98902" status: 200 len: 148 microversion: 2.57 time: 0.251341 Jul 20 04:08:26.454229 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 233/421] 10.222.0.59 () {62 vars in 1383 bytes} [Wed Jul 20 04:08:26 2022] PUT /compute/v2.1/os-quota-sets/fd22a7b5efed49b2919c213716e2832d?user_id=324512d4f95b42d1b05df146b8e98902 => generated 148 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:26.464032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5cc3f947-8212-4302-9f6a-62965d6f7387 req-1f35c186-d539-4f5c-bd02-4b8c4499621a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd5b910-66f3-4c35-a756-3ebed020fd24", "name": "network-vif-plugged", "status": "completed", "tag": "2d98b0d3-c15e-4d7c-9b95-395b92468eb4"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:26.475024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5cc3f947-8212-4302-9f6a-62965d6f7387 req-1f35c186-d539-4f5c-bd02-4b8c4499621a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.476422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5cc3f947-8212-4302-9f6a-62965d6f7387 req-1f35c186-d539-4f5c-bd02-4b8c4499621a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.510531 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5cc3f947-8212-4302-9f6a-62965d6f7387 req-1f35c186-d539-4f5c-bd02-4b8c4499621a service nova] Creating event network-vif-plugged:2d98b0d3-c15e-4d7c-9b95-395b92468eb4 for instance 5cd5b910-66f3-4c35-a756-3ebed020fd24 on n-h2-760456-11 Jul 20 04:08:26.518519 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5cc3f947-8212-4302-9f6a-62965d6f7387 req-1f35c186-d539-4f5c-bd02-4b8c4499621a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062754 Jul 20 04:08:26.519647 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 234/422] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:26.527781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f0110a1-b5f0-4038-b17f-df8149842ce0 tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] Calling method '.version_select at 0x7fb842c9a9d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:26.647511 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c5ae4d8-ec6e-4a94-9cf4-5ef4accd5673 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98/action" status: 202 len: 0 microversion: 2.1 time: 0.797153 Jul 20 04:08:26.648925 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 189/423] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:08:25 2022] POST /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:26.655889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e8eb7be2-1c78-4930-9004-c258be9c4fb6 req-cd84c0d5-f327-4f41-96af-8040197f54e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b8793e-4343-4e34-97ac-bc439e52ad49", "tag": "81efc81c-d84d-4d76-9ba7-dc811cf57a09"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:26.665778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e8eb7be2-1c78-4930-9004-c258be9c4fb6 req-cd84c0d5-f327-4f41-96af-8040197f54e9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.666829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e8eb7be2-1c78-4930-9004-c258be9c4fb6 req-cd84c0d5-f327-4f41-96af-8040197f54e9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.683994 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e8eb7be2-1c78-4930-9004-c258be9c4fb6 req-cd84c0d5-f327-4f41-96af-8040197f54e9 service nova] Creating event network-changed:81efc81c-d84d-4d76-9ba7-dc811cf57a09 for instance c6b8793e-4343-4e34-97ac-bc439e52ad49 on n-h2-760456-11 Jul 20 04:08:26.690989 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e8eb7be2-1c78-4930-9004-c258be9c4fb6 req-cd84c0d5-f327-4f41-96af-8040197f54e9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040279 Jul 20 04:08:26.692105 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 190/424] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:26.696605 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f0110a1-b5f0-4038-b17f-df8149842ce0 tempest-QuotasAdminTestV257-783232452 tempest-QuotasAdminTestV257-783232452-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/fd22a7b5efed49b2919c213716e2832d?user_id=324512d4f95b42d1b05df146b8e98902" status: 200 len: 190 microversion: 2.57 time: 0.172745 Jul 20 04:08:26.700654 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 235/425] 10.222.0.59 () {60 vars in 1363 bytes} [Wed Jul 20 04:08:26 2022] GET /compute/v2.1/os-quota-sets/fd22a7b5efed49b2919c213716e2832d?user_id=324512d4f95b42d1b05df146b8e98902 => generated 190 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:26.708641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa02e9e3-4973-4c66-8888-95a4f543e562 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:26.709631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aa02e9e3-4973-4c66-8888-95a4f543e562 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:26.717743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c0f8b964-8fe8-4007-b35f-d87493055763 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:26.718601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c0f8b964-8fe8-4007-b35f-d87493055763 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:26.719349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa02e9e3-4973-4c66-8888-95a4f543e562 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.719963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa02e9e3-4973-4c66-8888-95a4f543e562 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.721059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa02e9e3-4973-4c66-8888-95a4f543e562 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.721942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa02e9e3-4973-4c66-8888-95a4f543e562 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.753334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c0f8b964-8fe8-4007-b35f-d87493055763 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.754470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c0f8b964-8fe8-4007-b35f-d87493055763 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:26.755436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c0f8b964-8fe8-4007-b35f-d87493055763 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:26.755891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c0f8b964-8fe8-4007-b35f-d87493055763 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:27.220456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aa02e9e3-4973-4c66-8888-95a4f543e562 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:27.223922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c0f8b964-8fe8-4007-b35f-d87493055763 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:27.242892 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aa02e9e3-4973-4c66-8888-95a4f543e562 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1472 microversion: 2.1 time: 0.549225 Jul 20 04:08:27.254227 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c0f8b964-8fe8-4007-b35f-d87493055763 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1314 microversion: 2.1 time: 0.539541 Jul 20 04:08:27.254475 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 191/426] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:26 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1472 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:27.268731 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 236/427] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:26 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:27.276018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9df8602-1a76-4739-870f-d5b42af8f427 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:27.286335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-22113f3f-b111-414b-a7db-f0647f0e4fac tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:27.292221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-22113f3f-b111-414b-a7db-f0647f0e4fac tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:27.292885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b9df8602-1a76-4739-870f-d5b42af8f427 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:27.311881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9df8602-1a76-4739-870f-d5b42af8f427 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:27.312507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9df8602-1a76-4739-870f-d5b42af8f427 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:27.314093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9df8602-1a76-4739-870f-d5b42af8f427 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:27.314093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9df8602-1a76-4739-870f-d5b42af8f427 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:27.317128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22113f3f-b111-414b-a7db-f0647f0e4fac tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:27.317588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22113f3f-b111-414b-a7db-f0647f0e4fac tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:27.319394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:27.328169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22113f3f-b111-414b-a7db-f0647f0e4fac tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:27.328675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22113f3f-b111-414b-a7db-f0647f0e4fac tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:27.471194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b9df8602-1a76-4739-870f-d5b42af8f427 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:27.486612 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b9df8602-1a76-4739-870f-d5b42af8f427 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1278 microversion: 2.1 time: 0.230859 Jul 20 04:08:27.487516 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 192/428] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:27 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:27.501627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f1d37222-e540-4add-b435-def6956cd842 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:27.502513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f1d37222-e540-4add-b435-def6956cd842 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:27.509796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1d37222-e540-4add-b435-def6956cd842 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:27.512207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1d37222-e540-4add-b435-def6956cd842 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:27.512945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1d37222-e540-4add-b435-def6956cd842 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:27.513489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1d37222-e540-4add-b435-def6956cd842 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:27.592027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-22113f3f-b111-414b-a7db-f0647f0e4fac tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:27.610372 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-22113f3f-b111-414b-a7db-f0647f0e4fac tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1318 microversion: 2.1 time: 0.338983 Jul 20 04:08:27.614943 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 237/429] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:27 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:27.625303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b466c8ff-f568-45ab-9920-adbb47e60200 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:27.630192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b466c8ff-f568-45ab-9920-adbb47e60200 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:27.665296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b466c8ff-f568-45ab-9920-adbb47e60200 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:27.668093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b466c8ff-f568-45ab-9920-adbb47e60200 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:27.670092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b466c8ff-f568-45ab-9920-adbb47e60200 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:27.673123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b466c8ff-f568-45ab-9920-adbb47e60200 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:27.833685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f1d37222-e540-4add-b435-def6956cd842 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:27.843208 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f1d37222-e540-4add-b435-def6956cd842 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1321 microversion: 2.1 time: 0.354629 Jul 20 04:08:27.846172 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 193/430] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:27 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:27.866379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b466c8ff-f568-45ab-9920-adbb47e60200 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:27.877455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b466c8ff-f568-45ab-9920-adbb47e60200 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:27.879040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b466c8ff-f568-45ab-9920-adbb47e60200 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:27.891776 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b466c8ff-f568-45ab-9920-adbb47e60200 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.276176 Jul 20 04:08:27.909952 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 238/431] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:27 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:28.262505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4409c922-29e4-4011-8d8a-2d5ce2a1399a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:28.263269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4409c922-29e4-4011-8d8a-2d5ce2a1399a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:28.270018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4409c922-29e4-4011-8d8a-2d5ce2a1399a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:28.270729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4409c922-29e4-4011-8d8a-2d5ce2a1399a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:28.271279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4409c922-29e4-4011-8d8a-2d5ce2a1399a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:28.271838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4409c922-29e4-4011-8d8a-2d5ce2a1399a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:28.278767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b508e925-6434-45b6-bcd4-5128e8ff37d1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:28.280988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b508e925-6434-45b6-bcd4-5128e8ff37d1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:28.288063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b508e925-6434-45b6-bcd4-5128e8ff37d1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:28.289821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b508e925-6434-45b6-bcd4-5128e8ff37d1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:28.292553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b508e925-6434-45b6-bcd4-5128e8ff37d1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:28.293490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b508e925-6434-45b6-bcd4-5128e8ff37d1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:28.574197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b508e925-6434-45b6-bcd4-5128e8ff37d1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:28.584319 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b508e925-6434-45b6-bcd4-5128e8ff37d1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1314 microversion: 2.1 time: 0.311040 Jul 20 04:08:28.585299 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 239/432] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:28 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:28.598777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-19b40f58-9e33-4aa1-975c-a4587f24eef7 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:28.599445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-19b40f58-9e33-4aa1-975c-a4587f24eef7 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:28.607119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19b40f58-9e33-4aa1-975c-a4587f24eef7 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:28.607958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19b40f58-9e33-4aa1-975c-a4587f24eef7 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:28.609295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19b40f58-9e33-4aa1-975c-a4587f24eef7 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:28.609896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19b40f58-9e33-4aa1-975c-a4587f24eef7 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:28.658647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4409c922-29e4-4011-8d8a-2d5ce2a1399a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:28.673159 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4409c922-29e4-4011-8d8a-2d5ce2a1399a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1472 microversion: 2.1 time: 0.415511 Jul 20 04:08:28.676150 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 194/433] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:28 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1472 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:28.691407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d62d5d8a-9736-4390-842d-241257f96841 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:28.694101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d62d5d8a-9736-4390-842d-241257f96841 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:28.703295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d62d5d8a-9736-4390-842d-241257f96841 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:28.703936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d62d5d8a-9736-4390-842d-241257f96841 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:28.705019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d62d5d8a-9736-4390-842d-241257f96841 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:28.705652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d62d5d8a-9736-4390-842d-241257f96841 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:28.903903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d62d5d8a-9736-4390-842d-241257f96841 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:28.918692 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d62d5d8a-9736-4390-842d-241257f96841 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1318 microversion: 2.1 time: 0.241369 Jul 20 04:08:28.919873 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 195/434] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:28 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:28.935961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-38dcefaf-7e18-40cd-b310-3090b3a3395d req-cdf78485-e62b-4359-94e3-a6da5df0731f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c35632-c082-43bc-9d83-85fa2dce4b5b", "tag": "b2614c31-c7d5-4301-a795-1c1713809906"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:28.948000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-38dcefaf-7e18-40cd-b310-3090b3a3395d req-cdf78485-e62b-4359-94e3-a6da5df0731f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:28.950303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-38dcefaf-7e18-40cd-b310-3090b3a3395d req-cdf78485-e62b-4359-94e3-a6da5df0731f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:28.967600 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-38dcefaf-7e18-40cd-b310-3090b3a3395d req-cdf78485-e62b-4359-94e3-a6da5df0731f service nova] Creating event network-changed:b2614c31-c7d5-4301-a795-1c1713809906 for instance 76c35632-c082-43bc-9d83-85fa2dce4b5b on n-h2-760456-11 Jul 20 04:08:28.973330 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-38dcefaf-7e18-40cd-b310-3090b3a3395d req-cdf78485-e62b-4359-94e3-a6da5df0731f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052155 Jul 20 04:08:28.974112 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 196/435] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:28.982454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48a05917-daa0-4814-9391-d117a4baa101 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:28.983536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-48a05917-daa0-4814-9391-d117a4baa101 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:28.990238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-19b40f58-9e33-4aa1-975c-a4587f24eef7 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:29.001400 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-19b40f58-9e33-4aa1-975c-a4587f24eef7 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1320 microversion: 2.1 time: 0.413739 Jul 20 04:08:29.002569 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 240/436] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:28 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1320 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:29.010809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c6d9a5c8-d3eb-47ea-8041-63591a0792bd tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:29.011663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c6d9a5c8-d3eb-47ea-8041-63591a0792bd tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:29.019070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48a05917-daa0-4814-9391-d117a4baa101 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:29.019589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6d9a5c8-d3eb-47ea-8041-63591a0792bd tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:29.019745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48a05917-daa0-4814-9391-d117a4baa101 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:29.020052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6d9a5c8-d3eb-47ea-8041-63591a0792bd tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:29.021113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48a05917-daa0-4814-9391-d117a4baa101 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:29.021315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6d9a5c8-d3eb-47ea-8041-63591a0792bd tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:29.021569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48a05917-daa0-4814-9391-d117a4baa101 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:29.022091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6d9a5c8-d3eb-47ea-8041-63591a0792bd tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:29.139513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6d9a5c8-d3eb-47ea-8041-63591a0792bd tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:29.151057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6d9a5c8-d3eb-47ea-8041-63591a0792bd tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:29.164364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6d9a5c8-d3eb-47ea-8041-63591a0792bd tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:29.173694 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c6d9a5c8-d3eb-47ea-8041-63591a0792bd tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.169460 Jul 20 04:08:29.175433 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 241/437] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:29 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:29.244663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-48a05917-daa0-4814-9391-d117a4baa101 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:29.253088 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48a05917-daa0-4814-9391-d117a4baa101 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1321 microversion: 2.1 time: 0.277574 Jul 20 04:08:29.253674 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 197/438] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:28 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:29.266560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9d1e88b7-150c-41af-ae70-17c2169fa83b req-c6f67e6f-81a0-4336-b4f6-11a38047ae85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284", "tag": "3769d39d-a19f-4221-8839-d0d84ab04601"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:29.276354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9d1e88b7-150c-41af-ae70-17c2169fa83b req-c6f67e6f-81a0-4336-b4f6-11a38047ae85 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:29.276740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9d1e88b7-150c-41af-ae70-17c2169fa83b req-c6f67e6f-81a0-4336-b4f6-11a38047ae85 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:29.293257 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9d1e88b7-150c-41af-ae70-17c2169fa83b req-c6f67e6f-81a0-4336-b4f6-11a38047ae85 service nova] Creating event network-changed:3769d39d-a19f-4221-8839-d0d84ab04601 for instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 on n-h1-760456-11 Jul 20 04:08:29.298195 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9d1e88b7-150c-41af-ae70-17c2169fa83b req-c6f67e6f-81a0-4336-b4f6-11a38047ae85 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036961 Jul 20 04:08:29.299100 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 242/439] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:29.602310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-889cf2c2-90c3-4db4-afc1-9d3520f026a5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:29.603277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-889cf2c2-90c3-4db4-afc1-9d3520f026a5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:29.610161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-889cf2c2-90c3-4db4-afc1-9d3520f026a5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:29.610980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-889cf2c2-90c3-4db4-afc1-9d3520f026a5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:29.613022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-889cf2c2-90c3-4db4-afc1-9d3520f026a5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:29.613676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-889cf2c2-90c3-4db4-afc1-9d3520f026a5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:29.694822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62fe66b1-c553-471d-bbb3-3dbcc80b9ed8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:29.695533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-62fe66b1-c553-471d-bbb3-3dbcc80b9ed8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:29.705064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62fe66b1-c553-471d-bbb3-3dbcc80b9ed8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:29.706507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62fe66b1-c553-471d-bbb3-3dbcc80b9ed8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:29.707397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62fe66b1-c553-471d-bbb3-3dbcc80b9ed8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:29.707853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62fe66b1-c553-471d-bbb3-3dbcc80b9ed8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.025408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-62fe66b1-c553-471d-bbb3-3dbcc80b9ed8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:30.033340 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62fe66b1-c553-471d-bbb3-3dbcc80b9ed8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1472 microversion: 2.1 time: 0.343207 Jul 20 04:08:30.034191 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 243/440] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:29 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1472 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:30.050762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-870eab6c-721b-4599-8357-a53b13b0ff66 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:30.052169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-870eab6c-721b-4599-8357-a53b13b0ff66 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:30.062536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-870eab6c-721b-4599-8357-a53b13b0ff66 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:30.064123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-870eab6c-721b-4599-8357-a53b13b0ff66 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.064992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-870eab6c-721b-4599-8357-a53b13b0ff66 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:30.065705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-870eab6c-721b-4599-8357-a53b13b0ff66 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.341131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-889cf2c2-90c3-4db4-afc1-9d3520f026a5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:30.349358 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-889cf2c2-90c3-4db4-afc1-9d3520f026a5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1464 microversion: 2.1 time: 0.751077 Jul 20 04:08:30.350067 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 198/441] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:29 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1464 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:30.355083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0c3a82bd-f279-4403-9cbb-17c590de220e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:30.355936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0c3a82bd-f279-4403-9cbb-17c590de220e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:30.363993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c3a82bd-f279-4403-9cbb-17c590de220e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:30.364982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c3a82bd-f279-4403-9cbb-17c590de220e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.365887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c3a82bd-f279-4403-9cbb-17c590de220e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:30.366542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c3a82bd-f279-4403-9cbb-17c590de220e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.374406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-870eab6c-721b-4599-8357-a53b13b0ff66 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:30.382789 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-870eab6c-721b-4599-8357-a53b13b0ff66 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1318 microversion: 2.1 time: 0.347307 Jul 20 04:08:30.393692 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 244/442] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:30 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:30.398864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ffb0ef90-4fd3-4fe6-8b17-e8a452864df2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:30.399899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ffb0ef90-4fd3-4fe6-8b17-e8a452864df2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:30.407278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffb0ef90-4fd3-4fe6-8b17-e8a452864df2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:30.407887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffb0ef90-4fd3-4fe6-8b17-e8a452864df2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.408932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffb0ef90-4fd3-4fe6-8b17-e8a452864df2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:30.410053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffb0ef90-4fd3-4fe6-8b17-e8a452864df2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.685722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ffb0ef90-4fd3-4fe6-8b17-e8a452864df2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:30.695488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ffb0ef90-4fd3-4fe6-8b17-e8a452864df2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:30.699108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ffb0ef90-4fd3-4fe6-8b17-e8a452864df2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:30.704456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ffb0ef90-4fd3-4fe6-8b17-e8a452864df2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.309318 Jul 20 04:08:30.717753 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 245/443] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:30 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:30.724361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e78b68fb-2218-43bc-8a46-e09e7d0ca455 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:30.725158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e78b68fb-2218-43bc-8a46-e09e7d0ca455 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:30.735859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e78b68fb-2218-43bc-8a46-e09e7d0ca455 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:30.736564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e78b68fb-2218-43bc-8a46-e09e7d0ca455 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.737558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e78b68fb-2218-43bc-8a46-e09e7d0ca455 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:30.738149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e78b68fb-2218-43bc-8a46-e09e7d0ca455 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.752699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0c3a82bd-f279-4403-9cbb-17c590de220e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:30.773624 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0c3a82bd-f279-4403-9cbb-17c590de220e tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1320 microversion: 2.1 time: 0.422228 Jul 20 04:08:30.778564 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 199/444] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:30 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1320 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:30.785519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16d76de4-7c2d-464e-8ebc-7c28388de432 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:30.788476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16d76de4-7c2d-464e-8ebc-7c28388de432 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:30.798450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16d76de4-7c2d-464e-8ebc-7c28388de432 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:30.798917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16d76de4-7c2d-464e-8ebc-7c28388de432 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.799708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16d76de4-7c2d-464e-8ebc-7c28388de432 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:30.800155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16d76de4-7c2d-464e-8ebc-7c28388de432 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:30.945612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e78b68fb-2218-43bc-8a46-e09e7d0ca455 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:30.950966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:30.956660 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e78b68fb-2218-43bc-8a46-e09e7d0ca455 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1321 microversion: 2.1 time: 0.236803 Jul 20 04:08:30.957362 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 246/445] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:30 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:31.054616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1a16323-b8f3-4189-89fe-c69eeddf7782 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:31.055694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d1a16323-b8f3-4189-89fe-c69eeddf7782 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:31.063795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1a16323-b8f3-4189-89fe-c69eeddf7782 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:31.064337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1a16323-b8f3-4189-89fe-c69eeddf7782 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:31.065250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1a16323-b8f3-4189-89fe-c69eeddf7782 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:31.065769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1a16323-b8f3-4189-89fe-c69eeddf7782 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:31.210945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1a16323-b8f3-4189-89fe-c69eeddf7782 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:31.219499 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1a16323-b8f3-4189-89fe-c69eeddf7782 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1472 microversion: 2.1 time: 0.170678 Jul 20 04:08:31.222309 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 247/446] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:31 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1472 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:31.272093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-16d76de4-7c2d-464e-8ebc-7c28388de432 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:31.282428 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16d76de4-7c2d-464e-8ebc-7c28388de432 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1463 microversion: 2.1 time: 0.502441 Jul 20 04:08:31.283114 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 200/447] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:30 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1463 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:31.403938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc9c48b7-f1e7-4528-90e9-78fd44bfe922 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:31.403938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc9c48b7-f1e7-4528-90e9-78fd44bfe922 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:31.411069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc9c48b7-f1e7-4528-90e9-78fd44bfe922 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:31.411069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc9c48b7-f1e7-4528-90e9-78fd44bfe922 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:31.411942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc9c48b7-f1e7-4528-90e9-78fd44bfe922 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:31.412477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc9c48b7-f1e7-4528-90e9-78fd44bfe922 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:31.530506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-180332240", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "288f952b-81ce-419b-9907-96b8b0db1d30"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:31.586419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:31.609742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc9c48b7-f1e7-4528-90e9-78fd44bfe922 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:31.621324 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc9c48b7-f1e7-4528-90e9-78fd44bfe922 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1318 microversion: 2.1 time: 0.223996 Jul 20 04:08:31.632301 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 248/448] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:31 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:31.724705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72aa43d2-a12d-4127-96fb-5938becc3133 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:31.725368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-72aa43d2-a12d-4127-96fb-5938becc3133 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:31.729823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:31.733533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aa43d2-a12d-4127-96fb-5938becc3133 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:31.734865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aa43d2-a12d-4127-96fb-5938becc3133 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:31.735889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aa43d2-a12d-4127-96fb-5938becc3133 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:31.736553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aa43d2-a12d-4127-96fb-5938becc3133 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:31.812428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72aa43d2-a12d-4127-96fb-5938becc3133 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:31.820861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72aa43d2-a12d-4127-96fb-5938becc3133 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:31.822970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72aa43d2-a12d-4127-96fb-5938becc3133 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:31.827786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:31.828479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:31.828995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:31.829591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:31.829711 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72aa43d2-a12d-4127-96fb-5938becc3133 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.108859 Jul 20 04:08:31.830298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:31.830432 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 249/449] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:31 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:08:31.834903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8d6a192-f3b4-4697-8a83-2b7b8d3883a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:31.835630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f8d6a192-f3b4-4697-8a83-2b7b8d3883a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:31.841427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:31.842099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8d6a192-f3b4-4697-8a83-2b7b8d3883a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:31.842440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:31.842558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8d6a192-f3b4-4697-8a83-2b7b8d3883a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:31.843230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8d6a192-f3b4-4697-8a83-2b7b8d3883a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:31.843681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8d6a192-f3b4-4697-8a83-2b7b8d3883a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:31.843973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:31.844655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:31.868445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Getting quotas for project 0ed9b3e9974a41c888990fe230a2bb7e. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:31.875948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Getting quotas for user 05147b0757b24f7c91b2a47af7ee1fce and project 0ed9b3e9974a41c888990fe230a2bb7e. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:31.890921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:31.893524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:31.950029 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e16f1fc4-91e5-43a7-9e84-172889b9557c tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.423582 Jul 20 04:08:31.954357 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 201/450] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:08:31.965933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d64ba3bf-39f3-4e93-bf65-f50d6eeb6609 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:31.967519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d64ba3bf-39f3-4e93-bf65-f50d6eeb6609 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:32.035146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d64ba3bf-39f3-4e93-bf65-f50d6eeb6609 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:32.044389 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d64ba3bf-39f3-4e93-bf65-f50d6eeb6609 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1213 microversion: 2.1 time: 0.084387 Jul 20 04:08:32.047437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f8d6a192-f3b4-4697-8a83-2b7b8d3883a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:32.055068 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 202/451] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:31 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:32.059907 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f8d6a192-f3b4-4697-8a83-2b7b8d3883a5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1320 microversion: 2.1 time: 0.228314 Jul 20 04:08:32.060839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1095eba4-c96d-4f42-a673-9a707088cdd7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:32.061467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1095eba4-c96d-4f42-a673-9a707088cdd7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:32.062397 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 250/452] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:31 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:32.078135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1095eba4-c96d-4f42-a673-9a707088cdd7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:32.078727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1095eba4-c96d-4f42-a673-9a707088cdd7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:32.079392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1095eba4-c96d-4f42-a673-9a707088cdd7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:32.079916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1095eba4-c96d-4f42-a673-9a707088cdd7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:32.240586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1095eba4-c96d-4f42-a673-9a707088cdd7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:32.246589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d07e64cc-dd50-4d55-a026-1bcf5c80272b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:32.247161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d07e64cc-dd50-4d55-a026-1bcf5c80272b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:32.257599 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1095eba4-c96d-4f42-a673-9a707088cdd7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1321 microversion: 2.1 time: 0.201331 Jul 20 04:08:32.260790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d07e64cc-dd50-4d55-a026-1bcf5c80272b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:32.261236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d07e64cc-dd50-4d55-a026-1bcf5c80272b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:32.262023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d07e64cc-dd50-4d55-a026-1bcf5c80272b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:32.262511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d07e64cc-dd50-4d55-a026-1bcf5c80272b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:32.266854 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 203/453] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:32 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:32.407043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d07e64cc-dd50-4d55-a026-1bcf5c80272b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:32.416983 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d07e64cc-dd50-4d55-a026-1bcf5c80272b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1472 microversion: 2.1 time: 0.182736 Jul 20 04:08:32.418060 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 251/454] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:32 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:32.640734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1c9c0630-4f5d-4466-98c6-1063310472e5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:32.641356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1c9c0630-4f5d-4466-98c6-1063310472e5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:32.649873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c9c0630-4f5d-4466-98c6-1063310472e5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:32.650844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2102116718", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:32.652074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c9c0630-4f5d-4466-98c6-1063310472e5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:32.659465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c9c0630-4f5d-4466-98c6-1063310472e5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:32.661450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c9c0630-4f5d-4466-98c6-1063310472e5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:32.710416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:32.806762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1c9c0630-4f5d-4466-98c6-1063310472e5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:32.814451 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1c9c0630-4f5d-4466-98c6-1063310472e5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1318 microversion: 2.1 time: 0.178463 Jul 20 04:08:32.815027 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 252/455] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:32 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:32.849399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-90786c95-a320-41cc-a05f-ae55093f5697 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:32.849962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-90786c95-a320-41cc-a05f-ae55093f5697 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:32.856401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90786c95-a320-41cc-a05f-ae55093f5697 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:32.856874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90786c95-a320-41cc-a05f-ae55093f5697 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:32.857645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90786c95-a320-41cc-a05f-ae55093f5697 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:32.858100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90786c95-a320-41cc-a05f-ae55093f5697 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:32.906238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:32.906842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:32.907382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:32.907855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:32.908334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:32.917943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:32.918428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:32.919237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:32.920034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:32.923746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90786c95-a320-41cc-a05f-ae55093f5697 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:32.933001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90786c95-a320-41cc-a05f-ae55093f5697 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:32.934721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90786c95-a320-41cc-a05f-ae55093f5697 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:32.937962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:32.939579 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-90786c95-a320-41cc-a05f-ae55093f5697 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.094170 Jul 20 04:08:32.940645 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 253/456] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:32 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:08:32.948813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:32.965870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:32.968394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:33.014575 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a09b2be6-61c0-482d-aaf2-d8e38896e746 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491246 Jul 20 04:08:33.015884 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 204/457] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:08:33.025824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a204954a-13a1-4075-9fd7-02ae31f8ff6e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:33.026712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a204954a-13a1-4075-9fd7-02ae31f8ff6e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:33.064141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a1b5b842-30f3-41eb-bac6-6b92b172ae08 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:33.064876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a1b5b842-30f3-41eb-bac6-6b92b172ae08 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:33.071961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1b5b842-30f3-41eb-bac6-6b92b172ae08 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.072696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1b5b842-30f3-41eb-bac6-6b92b172ae08 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.073752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1b5b842-30f3-41eb-bac6-6b92b172ae08 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.074228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1b5b842-30f3-41eb-bac6-6b92b172ae08 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.148916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a204954a-13a1-4075-9fd7-02ae31f8ff6e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:33.163159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a1b5b842-30f3-41eb-bac6-6b92b172ae08 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:33.163786 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a204954a-13a1-4075-9fd7-02ae31f8ff6e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1217 microversion: 2.1 time: 0.141833 Jul 20 04:08:33.164379 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 254/458] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:33 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:33.171288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-34fd5cb0-67d6-46a7-8800-a0cd7d197acd tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:33.173596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-34fd5cb0-67d6-46a7-8800-a0cd7d197acd tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:33.174546 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a1b5b842-30f3-41eb-bac6-6b92b172ae08 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1273 microversion: 2.1 time: 0.115218 Jul 20 04:08:33.175701 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 205/459] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:33 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:33.190842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34fd5cb0-67d6-46a7-8800-a0cd7d197acd tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.191617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34fd5cb0-67d6-46a7-8800-a0cd7d197acd tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.192594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34fd5cb0-67d6-46a7-8800-a0cd7d197acd tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.193220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34fd5cb0-67d6-46a7-8800-a0cd7d197acd tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.274774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5155c6e4-9e4a-4de3-8a00-4c2f0d8b913a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:33.276680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5155c6e4-9e4a-4de3-8a00-4c2f0d8b913a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:33.284382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5155c6e4-9e4a-4de3-8a00-4c2f0d8b913a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.284881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5155c6e4-9e4a-4de3-8a00-4c2f0d8b913a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.285665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5155c6e4-9e4a-4de3-8a00-4c2f0d8b913a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.286460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5155c6e4-9e4a-4de3-8a00-4c2f0d8b913a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.487818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5155c6e4-9e4a-4de3-8a00-4c2f0d8b913a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:33.488420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-34fd5cb0-67d6-46a7-8800-a0cd7d197acd tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:33.497704 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-34fd5cb0-67d6-46a7-8800-a0cd7d197acd tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1320 microversion: 2.1 time: 0.331898 Jul 20 04:08:33.502886 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5155c6e4-9e4a-4de3-8a00-4c2f0d8b913a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1321 microversion: 2.1 time: 0.228445 Jul 20 04:08:33.503644 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 206/461] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:33 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:33.504478 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 255/461] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:33 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1320 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:33.517245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-79cf7209-0205-4a7a-89b4-66a6583241e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:33.518229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-79cf7209-0205-4a7a-89b4-66a6583241e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:33.525576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79cf7209-0205-4a7a-89b4-66a6583241e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.525744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79cf7209-0205-4a7a-89b4-66a6583241e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.527199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79cf7209-0205-4a7a-89b4-66a6583241e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.527663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79cf7209-0205-4a7a-89b4-66a6583241e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.656872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-64c8d22b-450f-478a-9d17-9b45dee2833e req-1a06d983-fee3-4e34-9aa3-0d3298720e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b8793e-4343-4e34-97ac-bc439e52ad49", "name": "network-vif-plugged", "status": "completed", "tag": "81efc81c-d84d-4d76-9ba7-dc811cf57a09"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:33.674822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-64c8d22b-450f-478a-9d17-9b45dee2833e req-1a06d983-fee3-4e34-9aa3-0d3298720e16 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.675304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-64c8d22b-450f-478a-9d17-9b45dee2833e req-1a06d983-fee3-4e34-9aa3-0d3298720e16 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.690123 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-64c8d22b-450f-478a-9d17-9b45dee2833e req-1a06d983-fee3-4e34-9aa3-0d3298720e16 service nova] Creating event network-vif-plugged:81efc81c-d84d-4d76-9ba7-dc811cf57a09 for instance c6b8793e-4343-4e34-97ac-bc439e52ad49 on n-h2-760456-11 Jul 20 04:08:33.697681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-79cf7209-0205-4a7a-89b4-66a6583241e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:33.708034 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-79cf7209-0205-4a7a-89b4-66a6583241e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.203306 Jul 20 04:08:33.716976 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-64c8d22b-450f-478a-9d17-9b45dee2833e req-1a06d983-fee3-4e34-9aa3-0d3298720e16 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066341 Jul 20 04:08:33.718920 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 256/462] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:33.719316 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 207/463] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:33 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:33.833276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c655cc8a-da11-4ace-a6e9-ddcb1b99e041 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:33.833971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c655cc8a-da11-4ace-a6e9-ddcb1b99e041 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:33.843668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c655cc8a-da11-4ace-a6e9-ddcb1b99e041 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.844510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c655cc8a-da11-4ace-a6e9-ddcb1b99e041 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.845300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c655cc8a-da11-4ace-a6e9-ddcb1b99e041 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.845938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c655cc8a-da11-4ace-a6e9-ddcb1b99e041 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.961546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d983fad-3569-4830-a318-c098ae283206 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:33.962163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d983fad-3569-4830-a318-c098ae283206 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:33.965212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:33.971012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d983fad-3569-4830-a318-c098ae283206 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.971464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d983fad-3569-4830-a318-c098ae283206 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:33.972235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d983fad-3569-4830-a318-c098ae283206 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:33.972938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d983fad-3569-4830-a318-c098ae283206 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.043136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d983fad-3569-4830-a318-c098ae283206 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:34.061514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d983fad-3569-4830-a318-c098ae283206 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:34.063646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d983fad-3569-4830-a318-c098ae283206 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:34.066136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c655cc8a-da11-4ace-a6e9-ddcb1b99e041 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:34.069414 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d983fad-3569-4830-a318-c098ae283206 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.111894 Jul 20 04:08:34.083014 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 208/464] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:33 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:34.089627 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c655cc8a-da11-4ace-a6e9-ddcb1b99e041 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1318 microversion: 2.1 time: 0.260972 Jul 20 04:08:34.090581 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 257/465] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:33 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:34.182073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-03c49619-b293-4dc1-b067-6abdb5c1270f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:34.183213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-03c49619-b293-4dc1-b067-6abdb5c1270f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:34.193054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7da59f2a-82d9-4a47-a614-017c1aa90173 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:34.193964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7da59f2a-82d9-4a47-a614-017c1aa90173 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:34.207767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7da59f2a-82d9-4a47-a614-017c1aa90173 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:34.209734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c49619-b293-4dc1-b067-6abdb5c1270f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:34.210028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7da59f2a-82d9-4a47-a614-017c1aa90173 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.211612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c49619-b293-4dc1-b067-6abdb5c1270f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.212631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7da59f2a-82d9-4a47-a614-017c1aa90173 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:34.213200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7da59f2a-82d9-4a47-a614-017c1aa90173 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.214862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c49619-b293-4dc1-b067-6abdb5c1270f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:34.215322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c49619-b293-4dc1-b067-6abdb5c1270f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.326631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-03c49619-b293-4dc1-b067-6abdb5c1270f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:34.335771 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-03c49619-b293-4dc1-b067-6abdb5c1270f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1269 microversion: 2.1 time: 0.158173 Jul 20 04:08:34.342742 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 209/466] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:34 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:34.475038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7da59f2a-82d9-4a47-a614-017c1aa90173 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:34.483811 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7da59f2a-82d9-4a47-a614-017c1aa90173 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1313 microversion: 2.1 time: 0.294902 Jul 20 04:08:34.493525 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 258/467] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:34 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:34.515247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b1598131-3442-4c30-b1e2-5c3d934bffb3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:34.516568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b1598131-3442-4c30-b1e2-5c3d934bffb3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:34.522218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b8b39f8-622e-4bcd-8f96-9e41d4c413cd tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:34.522924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b8b39f8-622e-4bcd-8f96-9e41d4c413cd tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:34.528859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1598131-3442-4c30-b1e2-5c3d934bffb3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:34.529320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1598131-3442-4c30-b1e2-5c3d934bffb3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.530103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1598131-3442-4c30-b1e2-5c3d934bffb3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:34.530866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1598131-3442-4c30-b1e2-5c3d934bffb3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.532008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b8b39f8-622e-4bcd-8f96-9e41d4c413cd tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:34.532465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b8b39f8-622e-4bcd-8f96-9e41d4c413cd tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.533894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b8b39f8-622e-4bcd-8f96-9e41d4c413cd tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:34.534475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b8b39f8-622e-4bcd-8f96-9e41d4c413cd tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.663566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b1598131-3442-4c30-b1e2-5c3d934bffb3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:34.671743 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b1598131-3442-4c30-b1e2-5c3d934bffb3 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1320 microversion: 2.1 time: 0.160295 Jul 20 04:08:34.672124 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 210/468] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:34 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:34.724986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eda6c047-c009-45ef-bdf4-b7676baab296 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:34.725625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eda6c047-c009-45ef-bdf4-b7676baab296 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:34.732743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eda6c047-c009-45ef-bdf4-b7676baab296 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:34.733199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eda6c047-c009-45ef-bdf4-b7676baab296 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.734007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eda6c047-c009-45ef-bdf4-b7676baab296 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:34.734500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eda6c047-c009-45ef-bdf4-b7676baab296 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:34.744784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b8b39f8-622e-4bcd-8f96-9e41d4c413cd tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:34.752708 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b8b39f8-622e-4bcd-8f96-9e41d4c413cd tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1321 microversion: 2.1 time: 0.235643 Jul 20 04:08:34.763822 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 259/469] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:34 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:34.924010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eda6c047-c009-45ef-bdf4-b7676baab296 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:34.930130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:34.940614 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eda6c047-c009-45ef-bdf4-b7676baab296 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.219506 Jul 20 04:08:34.942415 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 211/470] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:34 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:35.091400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-74f2a17c-f9ae-4511-ab0d-63aad4630891 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:35.092091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-74f2a17c-f9ae-4511-ab0d-63aad4630891 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:35.108182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6cd1ddf-4ce0-4498-aed7-2c7f1ceb45bf tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:35.108844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a6cd1ddf-4ce0-4498-aed7-2c7f1ceb45bf tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:35.115406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74f2a17c-f9ae-4511-ab0d-63aad4630891 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.116013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74f2a17c-f9ae-4511-ab0d-63aad4630891 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.116812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74f2a17c-f9ae-4511-ab0d-63aad4630891 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.117248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74f2a17c-f9ae-4511-ab0d-63aad4630891 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.123060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6cd1ddf-4ce0-4498-aed7-2c7f1ceb45bf tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.123819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6cd1ddf-4ce0-4498-aed7-2c7f1ceb45bf tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.124792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6cd1ddf-4ce0-4498-aed7-2c7f1ceb45bf tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.125418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6cd1ddf-4ce0-4498-aed7-2c7f1ceb45bf tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.257337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-74f2a17c-f9ae-4511-ab0d-63aad4630891 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:35.268695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-74f2a17c-f9ae-4511-ab0d-63aad4630891 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:35.270612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-74f2a17c-f9ae-4511-ab0d-63aad4630891 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:35.279796 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-74f2a17c-f9ae-4511-ab0d-63aad4630891 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.192994 Jul 20 04:08:35.280724 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 260/471] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:35 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:35.300589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-239f447b-8ecb-4776-8899-30e958feb467 req-e49493b0-76ef-45aa-9c8a-ce7ff7101102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b11eea-02b0-428a-9a50-5f6f38367827", "tag": "3e9ba8b7-25c0-45f1-82ec-641a51172265"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:35.326724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-239f447b-8ecb-4776-8899-30e958feb467 req-e49493b0-76ef-45aa-9c8a-ce7ff7101102 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.327254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-239f447b-8ecb-4776-8899-30e958feb467 req-e49493b0-76ef-45aa-9c8a-ce7ff7101102 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.354386 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-239f447b-8ecb-4776-8899-30e958feb467 req-e49493b0-76ef-45aa-9c8a-ce7ff7101102 service nova] Creating event network-changed:3e9ba8b7-25c0-45f1-82ec-641a51172265 for instance 83b11eea-02b0-428a-9a50-5f6f38367827 on n-h1-760456-11 Jul 20 04:08:35.360065 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-239f447b-8ecb-4776-8899-30e958feb467 req-e49493b0-76ef-45aa-9c8a-ce7ff7101102 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078057 Jul 20 04:08:35.366609 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 261/472] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:35.372519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-581ed2c6-3ac3-49fd-aa08-c7b768861ff2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:35.373324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-581ed2c6-3ac3-49fd-aa08-c7b768861ff2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:35.397912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-581ed2c6-3ac3-49fd-aa08-c7b768861ff2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.397912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-581ed2c6-3ac3-49fd-aa08-c7b768861ff2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.399281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-581ed2c6-3ac3-49fd-aa08-c7b768861ff2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.399959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-581ed2c6-3ac3-49fd-aa08-c7b768861ff2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.408151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a6cd1ddf-4ce0-4498-aed7-2c7f1ceb45bf tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:35.417213 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a6cd1ddf-4ce0-4498-aed7-2c7f1ceb45bf tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1318 microversion: 2.1 time: 0.314203 Jul 20 04:08:35.428943 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 212/473] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:35 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:35.507550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38732385-d710-45dd-865c-2a277e32ac5b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:35.508627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-581ed2c6-3ac3-49fd-aa08-c7b768861ff2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:35.516296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-38732385-d710-45dd-865c-2a277e32ac5b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:35.528654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38732385-d710-45dd-865c-2a277e32ac5b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.529243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38732385-d710-45dd-865c-2a277e32ac5b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.530212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38732385-d710-45dd-865c-2a277e32ac5b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.531327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38732385-d710-45dd-865c-2a277e32ac5b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.532471 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-581ed2c6-3ac3-49fd-aa08-c7b768861ff2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1275 microversion: 2.1 time: 0.164126 Jul 20 04:08:35.533403 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 262/474] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:35 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:35.688485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c7024be4-929f-413d-8686-654b7889513c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:35.689153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c7024be4-929f-413d-8686-654b7889513c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:35.695375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7024be4-929f-413d-8686-654b7889513c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.698545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7024be4-929f-413d-8686-654b7889513c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.699843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7024be4-929f-413d-8686-654b7889513c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.700736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7024be4-929f-413d-8686-654b7889513c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.829843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-38732385-d710-45dd-865c-2a277e32ac5b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:35.837658 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-38732385-d710-45dd-865c-2a277e32ac5b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1313 microversion: 2.1 time: 0.339763 Jul 20 04:08:35.845474 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 213/475] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:35 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:35.860302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1b5c1ae9-9be5-472c-9b8e-99c3b1ba8f61 req-0d1b3d6d-ce8f-4ae9-aaeb-9a5c0a834ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284", "name": "network-vif-plugged", "status": "completed", "tag": "3769d39d-a19f-4221-8839-d0d84ab04601"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:35.871879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1b5c1ae9-9be5-472c-9b8e-99c3b1ba8f61 req-0d1b3d6d-ce8f-4ae9-aaeb-9a5c0a834ccf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.872372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1b5c1ae9-9be5-472c-9b8e-99c3b1ba8f61 req-0d1b3d6d-ce8f-4ae9-aaeb-9a5c0a834ccf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.885548 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1b5c1ae9-9be5-472c-9b8e-99c3b1ba8f61 req-0d1b3d6d-ce8f-4ae9-aaeb-9a5c0a834ccf service nova] Creating event network-vif-plugged:3769d39d-a19f-4221-8839-d0d84ab04601 for instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 on n-h1-760456-11 Jul 20 04:08:35.890743 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1b5c1ae9-9be5-472c-9b8e-99c3b1ba8f61 req-0d1b3d6d-ce8f-4ae9-aaeb-9a5c0a834ccf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044093 Jul 20 04:08:35.891350 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 214/476] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:35.896359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ddc2c64-fa12-4641-9ed0-cc9257ba58ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:35.897062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ddc2c64-fa12-4641-9ed0-cc9257ba58ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:35.904271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ddc2c64-fa12-4641-9ed0-cc9257ba58ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.904727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ddc2c64-fa12-4641-9ed0-cc9257ba58ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.905907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ddc2c64-fa12-4641-9ed0-cc9257ba58ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.906408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ddc2c64-fa12-4641-9ed0-cc9257ba58ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.949067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c7024be4-929f-413d-8686-654b7889513c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:35.960103 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c7024be4-929f-413d-8686-654b7889513c tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1320 microversion: 2.1 time: 0.275353 Jul 20 04:08:35.970590 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 263/477] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:35 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:35.975826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2653ce69-f600-4bb4-bf4d-3a2fbc2d9af5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:35.976452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2653ce69-f600-4bb4-bf4d-3a2fbc2d9af5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:35.983303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2653ce69-f600-4bb4-bf4d-3a2fbc2d9af5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.983908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2653ce69-f600-4bb4-bf4d-3a2fbc2d9af5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:35.984709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2653ce69-f600-4bb4-bf4d-3a2fbc2d9af5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:35.985240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2653ce69-f600-4bb4-bf4d-3a2fbc2d9af5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.153573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2653ce69-f600-4bb4-bf4d-3a2fbc2d9af5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:36.160337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5ddc2c64-fa12-4641-9ed0-cc9257ba58ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:36.161749 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2653ce69-f600-4bb4-bf4d-3a2fbc2d9af5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.189806 Jul 20 04:08:36.162866 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 264/478] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:35 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:36.169935 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ddc2c64-fa12-4641-9ed0-cc9257ba58ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1321 microversion: 2.1 time: 0.277365 Jul 20 04:08:36.171102 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 215/479] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:35 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:36.301199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fa4af12d-9472-4c0c-9f85-435b11820d64 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:36.301909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fa4af12d-9472-4c0c-9f85-435b11820d64 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:36.312936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa4af12d-9472-4c0c-9f85-435b11820d64 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.313389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa4af12d-9472-4c0c-9f85-435b11820d64 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.314200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa4af12d-9472-4c0c-9f85-435b11820d64 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.314658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa4af12d-9472-4c0c-9f85-435b11820d64 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.390507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fa4af12d-9472-4c0c-9f85-435b11820d64 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:36.392935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:36.393961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:36.403474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fa4af12d-9472-4c0c-9f85-435b11820d64 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:36.405023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fa4af12d-9472-4c0c-9f85-435b11820d64 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:36.410759 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fa4af12d-9472-4c0c-9f85-435b11820d64 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.113468 Jul 20 04:08:36.411772 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 265/480] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:36 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:36.440894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2db1df44-26d0-41b7-91c4-067ad105aa5d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:36.441707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2db1df44-26d0-41b7-91c4-067ad105aa5d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:36.450971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2db1df44-26d0-41b7-91c4-067ad105aa5d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.451591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2db1df44-26d0-41b7-91c4-067ad105aa5d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.452903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2db1df44-26d0-41b7-91c4-067ad105aa5d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.453352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2db1df44-26d0-41b7-91c4-067ad105aa5d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.550811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5b72e1c8-b317-4d78-92e0-abfdca337541 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:36.551749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5b72e1c8-b317-4d78-92e0-abfdca337541 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:36.559144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b72e1c8-b317-4d78-92e0-abfdca337541 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.559662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b72e1c8-b317-4d78-92e0-abfdca337541 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.560452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b72e1c8-b317-4d78-92e0-abfdca337541 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.560997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b72e1c8-b317-4d78-92e0-abfdca337541 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.701255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b72e1c8-b317-4d78-92e0-abfdca337541 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:36.708398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2db1df44-26d0-41b7-91c4-067ad105aa5d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:36.709099 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5b72e1c8-b317-4d78-92e0-abfdca337541 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1317 microversion: 2.1 time: 0.162409 Jul 20 04:08:36.709951 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 266/481] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:36 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:36.717255 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2db1df44-26d0-41b7-91c4-067ad105aa5d tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1467 microversion: 2.1 time: 0.281000 Jul 20 04:08:36.724764 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 216/482] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:36 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1467 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:36.738130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d7248a22-9bac-4b68-b6b2-a3e4662afa15 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:36.738691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d7248a22-9bac-4b68-b6b2-a3e4662afa15 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:36.745061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7248a22-9bac-4b68-b6b2-a3e4662afa15 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.745514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7248a22-9bac-4b68-b6b2-a3e4662afa15 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.746300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7248a22-9bac-4b68-b6b2-a3e4662afa15 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.746743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7248a22-9bac-4b68-b6b2-a3e4662afa15 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.809640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-d7248a22-9bac-4b68-b6b2-a3e4662afa15 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lazy-loading 'flavor' on Instance uuid c6b8793e-4343-4e34-97ac-bc439e52ad49 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:08:36.855481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-751b0e15-b202-469f-9552-ae23756f59ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:36.856799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-751b0e15-b202-469f-9552-ae23756f59ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:36.864302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-751b0e15-b202-469f-9552-ae23756f59ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.865459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-751b0e15-b202-469f-9552-ae23756f59ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.867665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-751b0e15-b202-469f-9552-ae23756f59ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.869246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-751b0e15-b202-469f-9552-ae23756f59ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.934355 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d7248a22-9bac-4b68-b6b2-a3e4662afa15 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49/action" status: 202 len: 0 microversion: 2.1 time: 0.199761 Jul 20 04:08:36.935595 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 267/483] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:08:36 2022] POST /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:36.944663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b6e39f31-90cc-48df-8244-b23452d480bb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:36.945831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b6e39f31-90cc-48df-8244-b23452d480bb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:36.953374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6e39f31-90cc-48df-8244-b23452d480bb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.954002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6e39f31-90cc-48df-8244-b23452d480bb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:36.954701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6e39f31-90cc-48df-8244-b23452d480bb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:36.955455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6e39f31-90cc-48df-8244-b23452d480bb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.136954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b6e39f31-90cc-48df-8244-b23452d480bb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:37.143011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-751b0e15-b202-469f-9552-ae23756f59ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:37.144760 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b6e39f31-90cc-48df-8244-b23452d480bb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1475 microversion: 2.1 time: 0.205229 Jul 20 04:08:37.156541 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 268/484] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:36 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1475 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:37.156541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49e59382-b485-4fb4-b127-7ae011275272 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:37.156541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-49e59382-b485-4fb4-b127-7ae011275272 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:37.161200 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-751b0e15-b202-469f-9552-ae23756f59ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1313 microversion: 2.1 time: 0.310300 Jul 20 04:08:37.162120 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 217/485] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:36 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:37.168283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49e59382-b485-4fb4-b127-7ae011275272 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.168742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49e59382-b485-4fb4-b127-7ae011275272 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.173353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49e59382-b485-4fb4-b127-7ae011275272 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.174329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49e59382-b485-4fb4-b127-7ae011275272 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.181825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-72dddb3c-8cd9-4f65-b1d5-eeb54df0e307 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:37.182624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-72dddb3c-8cd9-4f65-b1d5-eeb54df0e307 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:37.189397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72dddb3c-8cd9-4f65-b1d5-eeb54df0e307 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.189955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72dddb3c-8cd9-4f65-b1d5-eeb54df0e307 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.190860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72dddb3c-8cd9-4f65-b1d5-eeb54df0e307 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.191376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72dddb3c-8cd9-4f65-b1d5-eeb54df0e307 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.315412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-49e59382-b485-4fb4-b127-7ae011275272 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:37.323609 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-49e59382-b485-4fb4-b127-7ae011275272 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1320 microversion: 2.1 time: 0.176778 Jul 20 04:08:37.329416 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 269/486] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:37 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:37.330906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1eca7f6-ebd3-4572-aa19-1138457bf8ca tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:37.331540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1eca7f6-ebd3-4572-aa19-1138457bf8ca tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:37.338430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1eca7f6-ebd3-4572-aa19-1138457bf8ca tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.339064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1eca7f6-ebd3-4572-aa19-1138457bf8ca tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.339875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1eca7f6-ebd3-4572-aa19-1138457bf8ca tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.340317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1eca7f6-ebd3-4572-aa19-1138457bf8ca tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.503245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a1eca7f6-ebd3-4572-aa19-1138457bf8ca tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:37.517618 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1eca7f6-ebd3-4572-aa19-1138457bf8ca tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1321 microversion: 2.1 time: 0.192009 Jul 20 04:08:37.518207 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 270/487] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:37 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:37.522886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f1f0f35e-7ed2-4354-9d4d-f25efbc63086 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:37.523498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f1f0f35e-7ed2-4354-9d4d-f25efbc63086 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:37.536267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1f0f35e-7ed2-4354-9d4d-f25efbc63086 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.536755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1f0f35e-7ed2-4354-9d4d-f25efbc63086 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.537587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1f0f35e-7ed2-4354-9d4d-f25efbc63086 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.538057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1f0f35e-7ed2-4354-9d4d-f25efbc63086 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.621455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f1f0f35e-7ed2-4354-9d4d-f25efbc63086 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:37.631050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f1f0f35e-7ed2-4354-9d4d-f25efbc63086 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:37.633217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f1f0f35e-7ed2-4354-9d4d-f25efbc63086 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:37.639896 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f1f0f35e-7ed2-4354-9d4d-f25efbc63086 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.120576 Jul 20 04:08:37.640966 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 271/488] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:37 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:37.704794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5a353d46-cdca-4125-ae42-7bb4cbb49b7d req-2776112d-e71c-4122-9f2e-91acc2260f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc16be0b-acc6-4bec-997a-2f0026a5500e", "tag": "bd25208d-66ad-4a91-a9ef-2368928833ad"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:37.714024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5a353d46-cdca-4125-ae42-7bb4cbb49b7d req-2776112d-e71c-4122-9f2e-91acc2260f3d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.714511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5a353d46-cdca-4125-ae42-7bb4cbb49b7d req-2776112d-e71c-4122-9f2e-91acc2260f3d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.730522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-72dddb3c-8cd9-4f65-b1d5-eeb54df0e307 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:37.743399 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5a353d46-cdca-4125-ae42-7bb4cbb49b7d req-2776112d-e71c-4122-9f2e-91acc2260f3d service nova] Creating event network-changed:bd25208d-66ad-4a91-a9ef-2368928833ad for instance cc16be0b-acc6-4bec-997a-2f0026a5500e on n-h2-760456-11 Jul 20 04:08:37.752296 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5a353d46-cdca-4125-ae42-7bb4cbb49b7d req-2776112d-e71c-4122-9f2e-91acc2260f3d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056155 Jul 20 04:08:37.754270 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-72dddb3c-8cd9-4f65-b1d5-eeb54df0e307 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.576173 Jul 20 04:08:37.765405 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 272/490] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:37.765988 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 218/490] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:37 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:37.766092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5f6181d8-a824-4a78-b343-d3e55dd0c1da tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:37.766092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5f6181d8-a824-4a78-b343-d3e55dd0c1da tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:37.771483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f6181d8-a824-4a78-b343-d3e55dd0c1da tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.771937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f6181d8-a824-4a78-b343-d3e55dd0c1da tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.772708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f6181d8-a824-4a78-b343-d3e55dd0c1da tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.773146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f6181d8-a824-4a78-b343-d3e55dd0c1da tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.911633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b5fd412f-df33-4e75-b0ab-c65d4c191c62 req-98c0a042-e475-4f1b-98ab-6cf765201068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c35632-c082-43bc-9d83-85fa2dce4b5b", "name": "network-vif-plugged", "status": "completed", "tag": "b2614c31-c7d5-4301-a795-1c1713809906"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:37.921669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b5fd412f-df33-4e75-b0ab-c65d4c191c62 req-98c0a042-e475-4f1b-98ab-6cf765201068 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:37.922501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b5fd412f-df33-4e75-b0ab-c65d4c191c62 req-98c0a042-e475-4f1b-98ab-6cf765201068 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:37.933835 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b5fd412f-df33-4e75-b0ab-c65d4c191c62 req-98c0a042-e475-4f1b-98ab-6cf765201068 service nova] Creating event network-vif-plugged:b2614c31-c7d5-4301-a795-1c1713809906 for instance 76c35632-c082-43bc-9d83-85fa2dce4b5b on n-h2-760456-11 Jul 20 04:08:37.938872 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b5fd412f-df33-4e75-b0ab-c65d4c191c62 req-98c0a042-e475-4f1b-98ab-6cf765201068 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036150 Jul 20 04:08:37.939585 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 219/491] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:08:37.940591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5f6181d8-a824-4a78-b343-d3e55dd0c1da tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:37.949845 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5f6181d8-a824-4a78-b343-d3e55dd0c1da tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1317 microversion: 2.1 time: 0.192259 Jul 20 04:08:37.950749 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 273/492] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:37 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:38.050434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-509dd52d-eef1-4cb4-85f9-1e0255d1b5fd tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:38.051031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-509dd52d-eef1-4cb4-85f9-1e0255d1b5fd tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:38.057800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-509dd52d-eef1-4cb4-85f9-1e0255d1b5fd tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.058493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-509dd52d-eef1-4cb4-85f9-1e0255d1b5fd tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.059269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-509dd52d-eef1-4cb4-85f9-1e0255d1b5fd tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.059717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-509dd52d-eef1-4cb4-85f9-1e0255d1b5fd tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.085898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-509dd52d-eef1-4cb4-85f9-1e0255d1b5fd tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:08:38.168921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0d798760-3fa3-4282-a8b1-1e52691e2371 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:38.169629 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-509dd52d-eef1-4cb4-85f9-1e0255d1b5fd tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "DELETE /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 204 len: 0 microversion: 2.1 time: 0.123116 Jul 20 04:08:38.170230 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 220/493] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:08:38 2022] DELETE /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:08:38.178734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0d798760-3fa3-4282-a8b1-1e52691e2371 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:38.189733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f7a71328-a4cf-4cc2-9def-65b54a52519f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:38.190705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f7a71328-a4cf-4cc2-9def-65b54a52519f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:38.197805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d798760-3fa3-4282-a8b1-1e52691e2371 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.198335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d798760-3fa3-4282-a8b1-1e52691e2371 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.199136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d798760-3fa3-4282-a8b1-1e52691e2371 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.199582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d798760-3fa3-4282-a8b1-1e52691e2371 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.203786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7a71328-a4cf-4cc2-9def-65b54a52519f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.204166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7a71328-a4cf-4cc2-9def-65b54a52519f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.204961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7a71328-a4cf-4cc2-9def-65b54a52519f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.205401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7a71328-a4cf-4cc2-9def-65b54a52519f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.386124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0d798760-3fa3-4282-a8b1-1e52691e2371 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:38.398340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f7a71328-a4cf-4cc2-9def-65b54a52519f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:38.403559 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0d798760-3fa3-4282-a8b1-1e52691e2371 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1458 microversion: 2.1 time: 0.243756 Jul 20 04:08:38.407263 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f7a71328-a4cf-4cc2-9def-65b54a52519f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1313 microversion: 2.1 time: 0.222434 Jul 20 04:08:38.407849 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 221/494] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:38 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:38.412511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a468f2c0-28ae-466c-bc0f-65936f706da5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:38.413285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a468f2c0-28ae-466c-bc0f-65936f706da5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:38.418839 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 274/495] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:38 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1458 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:38.422272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a468f2c0-28ae-466c-bc0f-65936f706da5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.430365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1084233015", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "1576664184", "adminPass": "***", "networks": [{"uuid": "959e7597-ad54-4e7a-82f9-9bba1080a6fa"}], "security_groups": [{"name": "tempest-securitygroup--1996471354"}], "key_name": "tempest-keypair-295056878", "user_data": "}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:38.431992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a468f2c0-28ae-466c-bc0f-65936f706da5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.434513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a468f2c0-28ae-466c-bc0f-65936f706da5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.435167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a468f2c0-28ae-466c-bc0f-65936f706da5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.575070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] validate_networks() for [('959e7597-ad54-4e7a-82f9-9bba1080a6fa', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:38.678865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a468f2c0-28ae-466c-bc0f-65936f706da5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:38.688904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a468f2c0-28ae-466c-bc0f-65936f706da5 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1469 microversion: 2.1 time: 0.279839 Jul 20 04:08:38.690048 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 222/496] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:38 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1469 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:38.694771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-db5c3bc9-8254-4aa4-ae86-1f1381b2f28a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:38.695685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-db5c3bc9-8254-4aa4-ae86-1f1381b2f28a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:38.703690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db5c3bc9-8254-4aa4-ae86-1f1381b2f28a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.704145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db5c3bc9-8254-4aa4-ae86-1f1381b2f28a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.704922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db5c3bc9-8254-4aa4-ae86-1f1381b2f28a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.705362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db5c3bc9-8254-4aa4-ae86-1f1381b2f28a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.957305 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-db5c3bc9-8254-4aa4-ae86-1f1381b2f28a tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1611 microversion: 2.1 time: 0.265651 Jul 20 04:08:38.969877 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 223/497] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:38 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1611 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:38.975099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4c52499f-e00b-4ad1-bff5-4c0dc53cac1e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:38.975799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4c52499f-e00b-4ad1-bff5-4c0dc53cac1e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:38.983245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c52499f-e00b-4ad1-bff5-4c0dc53cac1e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.983724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c52499f-e00b-4ad1-bff5-4c0dc53cac1e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:38.984507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c52499f-e00b-4ad1-bff5-4c0dc53cac1e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:38.984952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c52499f-e00b-4ad1-bff5-4c0dc53cac1e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.125089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4c52499f-e00b-4ad1-bff5-4c0dc53cac1e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:39.133971 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4c52499f-e00b-4ad1-bff5-4c0dc53cac1e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1321 microversion: 2.1 time: 0.162782 Jul 20 04:08:39.135113 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 224/498] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:38 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:39.148727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5eee21a5-fa2b-4502-8dfe-0741b163ff1f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:39.149337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5eee21a5-fa2b-4502-8dfe-0741b163ff1f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:39.156073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5eee21a5-fa2b-4502-8dfe-0741b163ff1f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.156526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5eee21a5-fa2b-4502-8dfe-0741b163ff1f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.157303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5eee21a5-fa2b-4502-8dfe-0741b163ff1f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.157743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5eee21a5-fa2b-4502-8dfe-0741b163ff1f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.222155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5eee21a5-fa2b-4502-8dfe-0741b163ff1f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:39.231472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5eee21a5-fa2b-4502-8dfe-0741b163ff1f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:39.233036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5eee21a5-fa2b-4502-8dfe-0741b163ff1f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:39.238216 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5eee21a5-fa2b-4502-8dfe-0741b163ff1f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.093323 Jul 20 04:08:39.238817 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 225/499] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:39 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:39.241836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:39.242315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:39.242781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:39.243208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:39.243953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:39.245271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56f8c621-2292-428f-b2b0-03f3c8a23176 tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:39.246672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-56f8c621-2292-428f-b2b0-03f3c8a23176 tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:39.253329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56f8c621-2292-428f-b2b0-03f3c8a23176 tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.253783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56f8c621-2292-428f-b2b0-03f3c8a23176 tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.254589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56f8c621-2292-428f-b2b0-03f3c8a23176 tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.255062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56f8c621-2292-428f-b2b0-03f3c8a23176 tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.260284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.260840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.261738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.262270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.280972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Getting quotas for project e4208e8570ad4fc597f5cc44f7785171. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:39.286817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Getting quotas for user c5dc8e2f30ce43ebb7919cdd1ab417ef and project e4208e8570ad4fc597f5cc44f7785171. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:39.300068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:39.302766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:39.327881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:39.342879 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-56f8c621-2292-428f-b2b0-03f3c8a23176 tempest-DeleteServersAdminTestJSON-1109422917 tempest-DeleteServersAdminTestJSON-1109422917-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284/action" status: 202 len: 0 microversion: 2.1 time: 0.102678 Jul 20 04:08:39.346336 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 226/500] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:08:39 2022] POST /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:39.349286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cbe00e61-29cd-431e-bbf8-cf7bb9ebe35d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:39.349974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cbe00e61-29cd-431e-bbf8-cf7bb9ebe35d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:39.356714 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-30c41726-f5e1-497c-bbfd-56fcec6b5214 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.932659 Jul 20 04:08:39.357687 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 275/501] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:39.363101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9659655-404a-4714-a7e8-fb13637f158b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:39.363729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c9659655-404a-4714-a7e8-fb13637f158b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:39.373934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9659655-404a-4714-a7e8-fb13637f158b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.374368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbe00e61-29cd-431e-bbf8-cf7bb9ebe35d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.374866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbe00e61-29cd-431e-bbf8-cf7bb9ebe35d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.375668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbe00e61-29cd-431e-bbf8-cf7bb9ebe35d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.376116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbe00e61-29cd-431e-bbf8-cf7bb9ebe35d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.378444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9659655-404a-4714-a7e8-fb13637f158b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.379520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9659655-404a-4714-a7e8-fb13637f158b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.379984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9659655-404a-4714-a7e8-fb13637f158b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.578141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c9659655-404a-4714-a7e8-fb13637f158b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:39.585426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cbe00e61-29cd-431e-bbf8-cf7bb9ebe35d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:39.593128 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c9659655-404a-4714-a7e8-fb13637f158b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1317 microversion: 2.1 time: 0.234180 Jul 20 04:08:39.602490 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 276/502] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:39 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:39.602653 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cbe00e61-29cd-431e-bbf8-cf7bb9ebe35d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.250165 Jul 20 04:08:39.602755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b02676a-fd8a-4aac-956f-3de653e92861 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:39.602755 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:39.602755 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:39.603806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b02676a-fd8a-4aac-956f-3de653e92861 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.604206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b02676a-fd8a-4aac-956f-3de653e92861 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.605659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b02676a-fd8a-4aac-956f-3de653e92861 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.606106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b02676a-fd8a-4aac-956f-3de653e92861 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.613954 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 227/503] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:39 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:39.619182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:39.621901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:39.635795 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b02676a-fd8a-4aac-956f-3de653e92861 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040346 Jul 20 04:08:39.637190 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 277/504] 10.222.0.59 () {58 vars in 1175 bytes} [Wed Jul 20 04:08:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:39.640366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.640832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.641668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.642114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.643270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fce0d066-b64e-48cc-81f1-c81ac6620076 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:39.644153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fce0d066-b64e-48cc-81f1-c81ac6620076 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:39.709344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fce0d066-b64e-48cc-81f1-c81ac6620076 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:39.716416 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fce0d066-b64e-48cc-81f1-c81ac6620076 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1264 microversion: 2.1 time: 0.077936 Jul 20 04:08:39.722219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.722928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.723678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lazy-loading 'fault' on Instance uuid a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:08:39.728856 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 278/505] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:39 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1264 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:39.734171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d92db12b-e662-4093-8879-b7d52674bbea tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:39.735054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d92db12b-e662-4093-8879-b7d52674bbea tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:39.743007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d92db12b-e662-4093-8879-b7d52674bbea tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.744510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d92db12b-e662-4093-8879-b7d52674bbea tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.745732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d92db12b-e662-4093-8879-b7d52674bbea tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.746524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d92db12b-e662-4093-8879-b7d52674bbea tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.920133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d92db12b-e662-4093-8879-b7d52674bbea tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:39.928505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:39.934025 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d92db12b-e662-4093-8879-b7d52674bbea tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1313 microversion: 2.1 time: 0.203666 Jul 20 04:08:39.934918 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 279/506] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:39 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:39.938223 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b755002e-eef7-4099-8af7-976db0673394 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1452 microversion: 2.1 time: 0.322979 Jul 20 04:08:39.939268 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 228/507] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:39 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1452 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:39.941785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-760456-11", "block_migration": true, "disk_over_commit": false}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:39.943020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:39.961636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2fb51e42-585f-43f6-8d1c-b41fddf5b42f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:39.963822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2fb51e42-585f-43f6-8d1c-b41fddf5b42f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:39.964933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.965404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.966205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.966681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.971140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2fb51e42-585f-43f6-8d1c-b41fddf5b42f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.971600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2fb51e42-585f-43f6-8d1c-b41fddf5b42f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:39.972439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2fb51e42-585f-43f6-8d1c-b41fddf5b42f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:39.972827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2fb51e42-585f-43f6-8d1c-b41fddf5b42f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.002475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2fb51e42-585f-43f6-8d1c-b41fddf5b42f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:08:40.081846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Lazy-loading 'flavor' on Instance uuid c6b8793e-4343-4e34-97ac-bc439e52ad49 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:08:40.114671 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance c6b8793e-4343-4e34-97ac-bc439e52ad49 while it is in vm_state suspended Jul 20 04:08:40.116906 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2fb51e42-585f-43f6-8d1c-b41fddf5b42f tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 204 len: 0 microversion: 2.1 time: 0.158160 Jul 20 04:08:40.117904 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 229/508] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:08:39 2022] DELETE /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Request method failure captured: Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49/action HTTP/1.1 Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 98 Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-ililKgiULSKB9yI65n2FEZEqCjcdRvtg10zeiQQT3h_0JqgLYdB-m1pe7hXUBKVTEucYXFI78VE1-sCErNt9CsbzG9or5bwLWq7XkWHVY563ovIBFZN5Nq-jODrd8tIcPiqzA1qzKsnWutqIm5ZzxLdvmWqn8wyGWgXQqYWiQfv4 Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 966acfca1fb3493692d3af2edd786255 Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-LiveMigrationNegativeTest-838468959 Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:08:40.119253 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/966acfca1fb3493692d3af2edd786255"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/966acfca1fb3493692d3af2edd786255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/966acfca1fb3493692d3af2edd786255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_966acfca1fb3493692d3af2edd786255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-LiveMigrationNegativeTest-838468959 Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 966acfca1fb3493692d3af2edd786255 Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-838468959 Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-LiveMigrationNegativeTest-838468959-project-admin Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 129e2ccccf2746119c270c47182b275f Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-LiveMigrationNegativeTest-838468959-project-admin Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: {"os-migrateLive": {"host": "n-h1-760456-11", "block_migration": true, "disk_over_commit": false}} Jul 20 04:08:40.120677 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: exception: Cannot 'os-migrateLive' instance c6b8793e-4343-4e34-97ac-bc439e52ad49 while it is in vm_state suspended Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'c6b8793e-4343-4e34-97ac-bc439e52ad49', 'body': {'os-migrateLive': {'host': 'n-h1-760456-11', 'block_migration': True, 'disk_over_commit': False}}} Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:08:40.121393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c6b8793e-4343-4e34-97ac-bc439e52ad49 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:40.122512 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance c6b8793e-4343-4e34-97ac-bc439e52ad49 while it is in vm_state suspended Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance c6b8793e-4343-4e34-97ac-bc439e52ad49 while it is in vm_state suspended Jul 20 04:08:40.125880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:40.126859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance c6b8793e-4343-4e34-97ac-bc439e52ad49 while it is in vm_state suspended {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:40.126859 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6b856ae2-e0e0-461e-bd02-38c21a6324f4 tempest-LiveMigrationNegativeTest-838468959 tempest-LiveMigrationNegativeTest-838468959-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49/action" status: 409 len: 155 microversion: 2.1 time: 0.184475 Jul 20 04:08:40.130788 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 280/509] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:08:39 2022] POST /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49/action => generated 155 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:08:40.132358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:40.133495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:40.143076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.143076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.144163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5f3c82d1-4844-4a1c-beea-2d9815d36cc2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:40.145035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5f3c82d1-4844-4a1c-beea-2d9815d36cc2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:40.147041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.147598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.155374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f3c82d1-4844-4a1c-beea-2d9815d36cc2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.156092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f3c82d1-4844-4a1c-beea-2d9815d36cc2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.157161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f3c82d1-4844-4a1c-beea-2d9815d36cc2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.157695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f3c82d1-4844-4a1c-beea-2d9815d36cc2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.190591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5f3c82d1-4844-4a1c-beea-2d9815d36cc2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:08:40.198858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.199318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.199774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lazy-loading 'fault' on Instance uuid a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:08:40.262275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:40.272609 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5f3c82d1-4844-4a1c-beea-2d9815d36cc2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 204 len: 0 microversion: 2.1 time: 0.132921 Jul 20 04:08:40.273191 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 281/510] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:08:40 2022] DELETE /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:08:40.278740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f75dfaa2-eb6c-483d-8784-33935c934a96 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:40.279434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f75dfaa2-eb6c-483d-8784-33935c934a96 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:40.285293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f75dfaa2-eb6c-483d-8784-33935c934a96 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.285759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f75dfaa2-eb6c-483d-8784-33935c934a96 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.286530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f75dfaa2-eb6c-483d-8784-33935c934a96 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.286966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f75dfaa2-eb6c-483d-8784-33935c934a96 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.291147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:40.317132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:40.325845 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cfda8dc4-8fbe-40a8-85b3-63b848475eda tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1458 microversion: 2.1 time: 0.201870 Jul 20 04:08:40.326578 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 230/511] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:40 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1458 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:40.331271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2aec46c-8e97-4645-94be-9736e7fbe436 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:40.331957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c2aec46c-8e97-4645-94be-9736e7fbe436 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:40.337959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2aec46c-8e97-4645-94be-9736e7fbe436 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.338530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2aec46c-8e97-4645-94be-9736e7fbe436 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.339380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2aec46c-8e97-4645-94be-9736e7fbe436 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.339828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2aec46c-8e97-4645-94be-9736e7fbe436 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.410011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2aec46c-8e97-4645-94be-9736e7fbe436 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:40.420140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2aec46c-8e97-4645-94be-9736e7fbe436 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:40.421717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2aec46c-8e97-4645-94be-9736e7fbe436 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:40.427318 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c2aec46c-8e97-4645-94be-9736e7fbe436 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.099704 Jul 20 04:08:40.428146 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 231/512] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:40 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:40.433105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b94cfd0-1b79-4d44-bda4-75cb95a9744f tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:40.433722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9b94cfd0-1b79-4d44-bda4-75cb95a9744f tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:40.440153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b94cfd0-1b79-4d44-bda4-75cb95a9744f tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.440604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b94cfd0-1b79-4d44-bda4-75cb95a9744f tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.441394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b94cfd0-1b79-4d44-bda4-75cb95a9744f tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.441831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b94cfd0-1b79-4d44-bda4-75cb95a9744f tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.581342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b94cfd0-1b79-4d44-bda4-75cb95a9744f tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:40.589709 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9b94cfd0-1b79-4d44-bda4-75cb95a9744f tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1464 microversion: 2.1 time: 0.160814 Jul 20 04:08:40.590301 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 232/513] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:40 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:40.609932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-286b58b5-0108-4e6e-b29d-2ba19c1fbfd9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:40.610593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-286b58b5-0108-4e6e-b29d-2ba19c1fbfd9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:40.616549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-286b58b5-0108-4e6e-b29d-2ba19c1fbfd9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.616989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-286b58b5-0108-4e6e-b29d-2ba19c1fbfd9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.617747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-286b58b5-0108-4e6e-b29d-2ba19c1fbfd9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.618182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-286b58b5-0108-4e6e-b29d-2ba19c1fbfd9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.621496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f75dfaa2-eb6c-483d-8784-33935c934a96 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:40.629155 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f75dfaa2-eb6c-483d-8784-33935c934a96 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1321 microversion: 2.1 time: 0.354709 Jul 20 04:08:40.630124 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 282/514] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:40 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:40.635435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5b539919-1626-4bdb-87e2-647500ad683e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:40.636126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5b539919-1626-4bdb-87e2-647500ad683e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:40.642636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b539919-1626-4bdb-87e2-647500ad683e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.643174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b539919-1626-4bdb-87e2-647500ad683e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.644027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b539919-1626-4bdb-87e2-647500ad683e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.644541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b539919-1626-4bdb-87e2-647500ad683e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.751973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-286b58b5-0108-4e6e-b29d-2ba19c1fbfd9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:40.759895 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-286b58b5-0108-4e6e-b29d-2ba19c1fbfd9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1317 microversion: 2.1 time: 0.153582 Jul 20 04:08:40.760387 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 233/515] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:40 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:40.764839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10ecb171-03e3-4ce7-ba0c-625848164333 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:40.765478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10ecb171-03e3-4ce7-ba0c-625848164333 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:40.773498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10ecb171-03e3-4ce7-ba0c-625848164333 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.773947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10ecb171-03e3-4ce7-ba0c-625848164333 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.774798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10ecb171-03e3-4ce7-ba0c-625848164333 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.775277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10ecb171-03e3-4ce7-ba0c-625848164333 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.778227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b539919-1626-4bdb-87e2-647500ad683e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:40.785739 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5b539919-1626-4bdb-87e2-647500ad683e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.154649 Jul 20 04:08:40.786335 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 283/516] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:40 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:40.839310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10ecb171-03e3-4ce7-ba0c-625848164333 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:40.847847 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10ecb171-03e3-4ce7-ba0c-625848164333 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1316 microversion: 2.1 time: 0.086514 Jul 20 04:08:40.848407 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 234/517] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:40 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1316 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:40.951979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9cc0fd98-b4a7-483c-8e74-71d11bcdf51b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:40.952594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9cc0fd98-b4a7-483c-8e74-71d11bcdf51b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:40.958671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cc0fd98-b4a7-483c-8e74-71d11bcdf51b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.959131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cc0fd98-b4a7-483c-8e74-71d11bcdf51b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:40.959969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cc0fd98-b4a7-483c-8e74-71d11bcdf51b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:40.960416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cc0fd98-b4a7-483c-8e74-71d11bcdf51b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.090798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9cc0fd98-b4a7-483c-8e74-71d11bcdf51b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:41.098144 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9cc0fd98-b4a7-483c-8e74-71d11bcdf51b tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1313 microversion: 2.1 time: 0.150101 Jul 20 04:08:41.098809 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 284/518] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:40 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:41.344254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:41.344964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:41.351470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.352039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.352976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.353510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.385053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.385503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.385970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lazy-loading 'fault' on Instance uuid a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:08:41.446537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-994bd6a8-2400-41e5-9586-6169f926a438 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:41.449220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-994bd6a8-2400-41e5-9586-6169f926a438 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:41.458939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-994bd6a8-2400-41e5-9586-6169f926a438 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.459527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-994bd6a8-2400-41e5-9586-6169f926a438 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.461036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-994bd6a8-2400-41e5-9586-6169f926a438 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.461622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-994bd6a8-2400-41e5-9586-6169f926a438 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.537571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-994bd6a8-2400-41e5-9586-6169f926a438 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:41.547272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-994bd6a8-2400-41e5-9586-6169f926a438 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:41.549167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-994bd6a8-2400-41e5-9586-6169f926a438 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:41.555866 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-994bd6a8-2400-41e5-9586-6169f926a438 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.113190 Jul 20 04:08:41.556612 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 285/519] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:41 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:41.576133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6c1f08c8-6e76-4eea-b1e0-ea7397970b58 req-0b0fe192-e999-4bdf-9ab9-2c07ccd9aaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b11eea-02b0-428a-9a50-5f6f38367827", "name": "network-vif-plugged", "status": "completed", "tag": "3e9ba8b7-25c0-45f1-82ec-641a51172265"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:41.584034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6c1f08c8-6e76-4eea-b1e0-ea7397970b58 req-0b0fe192-e999-4bdf-9ab9-2c07ccd9aaa6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.584576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6c1f08c8-6e76-4eea-b1e0-ea7397970b58 req-0b0fe192-e999-4bdf-9ab9-2c07ccd9aaa6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.601720 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6c1f08c8-6e76-4eea-b1e0-ea7397970b58 req-0b0fe192-e999-4bdf-9ab9-2c07ccd9aaa6 service nova] Creating event network-vif-plugged:3e9ba8b7-25c0-45f1-82ec-641a51172265 for instance 83b11eea-02b0-428a-9a50-5f6f38367827 on n-h1-760456-11 Jul 20 04:08:41.607955 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6c1f08c8-6e76-4eea-b1e0-ea7397970b58 req-0b0fe192-e999-4bdf-9ab9-2c07ccd9aaa6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038217 Jul 20 04:08:41.609054 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 286/520] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:41.613782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9307418-1158-4e4c-bacf-4a5618bcece5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:41.614514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e9307418-1158-4e4c-bacf-4a5618bcece5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:41.620882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9307418-1158-4e4c-bacf-4a5618bcece5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.621342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9307418-1158-4e4c-bacf-4a5618bcece5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.622120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9307418-1158-4e4c-bacf-4a5618bcece5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.622593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9307418-1158-4e4c-bacf-4a5618bcece5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.662657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:41.670468 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-835ccbb7-1cc7-4e1f-bd44-9caf7b46528d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1458 microversion: 2.1 time: 0.330120 Jul 20 04:08:41.671050 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 235/521] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:41 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1458 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:41.685477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f82e71e-b32c-4785-ba9c-f62e60692f4a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:41.686092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f82e71e-b32c-4785-ba9c-f62e60692f4a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:41.691981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f82e71e-b32c-4785-ba9c-f62e60692f4a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.692428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f82e71e-b32c-4785-ba9c-f62e60692f4a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.693193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f82e71e-b32c-4785-ba9c-f62e60692f4a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.693639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f82e71e-b32c-4785-ba9c-f62e60692f4a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.760426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e9307418-1158-4e4c-bacf-4a5618bcece5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:41.769069 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9307418-1158-4e4c-bacf-4a5618bcece5 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1464 microversion: 2.1 time: 0.159262 Jul 20 04:08:41.769752 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 287/522] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:41 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:41.776625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e30927f-7b23-44f0-8808-4625b06aefc0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:41.777351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3e30927f-7b23-44f0-8808-4625b06aefc0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:41.783313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e30927f-7b23-44f0-8808-4625b06aefc0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.783769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e30927f-7b23-44f0-8808-4625b06aefc0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.784541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e30927f-7b23-44f0-8808-4625b06aefc0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:41.784987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e30927f-7b23-44f0-8808-4625b06aefc0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:41.969418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f82e71e-b32c-4785-ba9c-f62e60692f4a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:41.981549 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f82e71e-b32c-4785-ba9c-f62e60692f4a tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1471 microversion: 2.1 time: 0.300406 Jul 20 04:08:41.994613 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 236/523] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:41 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:42.000978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-af675afb-6995-48ed-b76b-82e99100d68d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:42.000978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-af675afb-6995-48ed-b76b-82e99100d68d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:42.006403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3e30927f-7b23-44f0-8808-4625b06aefc0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:42.013653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af675afb-6995-48ed-b76b-82e99100d68d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:42.014143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af675afb-6995-48ed-b76b-82e99100d68d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:42.015268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af675afb-6995-48ed-b76b-82e99100d68d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:42.015713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af675afb-6995-48ed-b76b-82e99100d68d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:42.016693 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3e30927f-7b23-44f0-8808-4625b06aefc0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1317 microversion: 2.1 time: 0.243989 Jul 20 04:08:42.017785 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 288/524] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:41 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:42.023846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b851302-e18a-4549-bf08-ca9aa217090e tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:42.024626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b851302-e18a-4549-bf08-ca9aa217090e tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:42.035723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b851302-e18a-4549-bf08-ca9aa217090e tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:42.037688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b851302-e18a-4549-bf08-ca9aa217090e tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:42.041186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b851302-e18a-4549-bf08-ca9aa217090e tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:42.043476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b851302-e18a-4549-bf08-ca9aa217090e tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:42.201983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b851302-e18a-4549-bf08-ca9aa217090e tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:42.210093 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b851302-e18a-4549-bf08-ca9aa217090e tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1324 microversion: 2.1 time: 0.191018 Jul 20 04:08:42.220700 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 289/525] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:42 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1324 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:42.359137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-af675afb-6995-48ed-b76b-82e99100d68d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:42.385276 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-af675afb-6995-48ed-b76b-82e99100d68d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.401849 Jul 20 04:08:42.386845 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 237/526] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:41 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:42.396443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-17dbf299-9325-4e5a-a321-80409608c95e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:42.397130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-17dbf299-9325-4e5a-a321-80409608c95e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:42.412993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17dbf299-9325-4e5a-a321-80409608c95e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:42.413447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17dbf299-9325-4e5a-a321-80409608c95e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:42.421339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17dbf299-9325-4e5a-a321-80409608c95e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:42.421803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17dbf299-9325-4e5a-a321-80409608c95e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:42.426758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9eafc5ac-4e43-425d-bba6-48ba664c0d6b tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:42.427379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9eafc5ac-4e43-425d-bba6-48ba664c0d6b tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] [instance: 0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:42.448020 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-9eafc5ac-4e43-425d-bba6-48ba664c0d6b tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] HTTP exception thrown: Instance 0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df could not be found. Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9eafc5ac-4e43-425d-bba6-48ba664c0d6b tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Request method failure captured: Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df/action HTTP/1.1 Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 15 Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-zVhkxkcGc6ksPswVwKbGcyYv1ie1_2AKROrVjFO7NcfuX2oi58J-nIvZccq_lXArWWQWXqiNd13VC1YhlZr2F9vBt9EngMA7llkAhnie2fOEl1mpKemFuh6T5miEIJnUQwW7lOw0nS7igWS4rAVk2_8qnVj6gqREC8qCS1lClF5A Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: f62093bb50234aeabc90e2e7a81e7d84 Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:08:42.449736 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: f62093bb50234aeabc90e2e7a81e7d84 Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersAdminNegativeTestJSON-709480980-project-admin Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: fedd7bfc3d894d519910a510b6305c88 Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersAdminNegativeTestJSON-709480980-project-admin Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: {"migrate": {}} Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:42.451001 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df could not be found. Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df', 'body': {'migrate': {}}} Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df could not be found. Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:42.451785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df could not be found. Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df could not be found. Jul 20 04:08:42.453166 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:42.454399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9eafc5ac-4e43-425d-bba6-48ba664c0d6b tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Returning 404 to user: Instance 0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:42.454399 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9eafc5ac-4e43-425d-bba6-48ba664c0d6b tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df/action" status: 404 len: 111 microversion: 2.1 time: 0.229477 Jul 20 04:08:42.467367 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 290/527] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:08:42 2022] POST /compute/v2.1/servers/0dfc9a4d-ecb8-4a50-b353-8e19e7c7b2df/action => generated 111 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:42.564896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-972189725", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:42.689927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:42.928631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=11 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:42.958811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=49 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:43.239985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-17dbf299-9325-4e5a-a321-80409608c95e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:43.269398 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-17dbf299-9325-4e5a-a321-80409608c95e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1313 microversion: 2.1 time: 0.878415 Jul 20 04:08:43.270645 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 238/528] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:42 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1313 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:43.286832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1b103bab-12c6-4520-bfbf-f96d92784810 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:43.287778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1b103bab-12c6-4520-bfbf-f96d92784810 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:43.304614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b103bab-12c6-4520-bfbf-f96d92784810 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:43.305077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b103bab-12c6-4520-bfbf-f96d92784810 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:43.305913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b103bab-12c6-4520-bfbf-f96d92784810 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:43.309920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b103bab-12c6-4520-bfbf-f96d92784810 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:43.766903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1b103bab-12c6-4520-bfbf-f96d92784810 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:43.783368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1b103bab-12c6-4520-bfbf-f96d92784810 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:43.786232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1b103bab-12c6-4520-bfbf-f96d92784810 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:43.802972 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1b103bab-12c6-4520-bfbf-f96d92784810 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.531055 Jul 20 04:08:43.806036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:43.815853 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 239/529] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:43 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:43.819923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:43.823109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:43.823358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:43.824994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:43.825615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:43.826765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:43.852677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:43.856124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:43.860114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:43.862241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:43.864275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:43.864730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:43.869451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:43.869451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:43.920170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Getting quotas for project 630a6840350545b297f7acdc4de59765. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:43.933714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Getting quotas for user 8081d25eaba743f69815051eec36d2a3 and project 630a6840350545b297f7acdc4de59765. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:43.969473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:43.974703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:44.053467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:44.053933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:44.054460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lazy-loading 'fault' on Instance uuid a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:08:44.073625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:44.105992 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-63b60233-7e96-4d7a-907e-0e5e4bbfeadf tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545655 Jul 20 04:08:44.106676 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 291/530] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:08:44.124775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0e771d8-e7c2-4eb9-bc2d-2cc2f5f3ecab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:44.125650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d0e771d8-e7c2-4eb9-bc2d-2cc2f5f3ecab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:44.149039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0e771d8-e7c2-4eb9-bc2d-2cc2f5f3ecab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:44.149492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0e771d8-e7c2-4eb9-bc2d-2cc2f5f3ecab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:44.162772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0e771d8-e7c2-4eb9-bc2d-2cc2f5f3ecab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:44.163514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0e771d8-e7c2-4eb9-bc2d-2cc2f5f3ecab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:44.365562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00eb555bda6f4374be55191cc744cd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729031e7ba84401be0ab9da06ae1aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:44.385735 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e3a77309-ea4d-42d0-9123-71102ae99041 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 200 len: 1288 microversion: 2.1 time: 0.573300 Jul 20 04:08:44.389564 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 240/531] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:43 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 1288 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:44.398318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-59985b58-d8d3-48a5-9c49-668a0f711988 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:44.400732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-59985b58-d8d3-48a5-9c49-668a0f711988 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:44.423366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59985b58-d8d3-48a5-9c49-668a0f711988 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:44.424090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59985b58-d8d3-48a5-9c49-668a0f711988 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:44.426288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59985b58-d8d3-48a5-9c49-668a0f711988 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:44.428906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59985b58-d8d3-48a5-9c49-668a0f711988 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:44.754532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-59985b58-d8d3-48a5-9c49-668a0f711988 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:44.768691 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-59985b58-d8d3-48a5-9c49-668a0f711988 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1317 microversion: 2.1 time: 0.377689 Jul 20 04:08:44.771164 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 241/532] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:44 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:44.797983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8593cafd-9291-4ecb-b09e-106a5a328f5f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:44.802240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8593cafd-9291-4ecb-b09e-106a5a328f5f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:44.816736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8593cafd-9291-4ecb-b09e-106a5a328f5f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:44.819819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8593cafd-9291-4ecb-b09e-106a5a328f5f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:44.824019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8593cafd-9291-4ecb-b09e-106a5a328f5f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:44.824655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8593cafd-9291-4ecb-b09e-106a5a328f5f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:44.892319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d0e771d8-e7c2-4eb9-bc2d-2cc2f5f3ecab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:44.911784 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d0e771d8-e7c2-4eb9-bc2d-2cc2f5f3ecab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1464 microversion: 2.1 time: 0.801079 Jul 20 04:08:44.912651 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 292/533] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:44 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1464 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:44.923022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1f482b87-c95f-462c-968d-6ccfc8ca55c6 req-95b2ef17-349a-4f73-9316-0536f3e438fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32096456-698a-47c4-a1e6-061e62a3a8fb", "name": "network-vif-deleted", "tag": "122f1c05-dc7d-4076-84e2-d84c89da38b7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:44.965705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1f482b87-c95f-462c-968d-6ccfc8ca55c6 req-95b2ef17-349a-4f73-9316-0536f3e438fd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:44.966518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1f482b87-c95f-462c-968d-6ccfc8ca55c6 req-95b2ef17-349a-4f73-9316-0536f3e438fd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.010850 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1f482b87-c95f-462c-968d-6ccfc8ca55c6 req-95b2ef17-349a-4f73-9316-0536f3e438fd service nova] Creating event network-vif-deleted:122f1c05-dc7d-4076-84e2-d84c89da38b7 for instance 32096456-698a-47c4-a1e6-061e62a3a8fb on n-h2-760456-11 Jul 20 04:08:45.019121 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1f482b87-c95f-462c-968d-6ccfc8ca55c6 req-95b2ef17-349a-4f73-9316-0536f3e438fd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104561 Jul 20 04:08:45.020381 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 293/534] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:45.032036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-81474c4c-8347-4188-8afa-7dbe19060dd8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:45.033101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-81474c4c-8347-4188-8afa-7dbe19060dd8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:45.053039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81474c4c-8347-4188-8afa-7dbe19060dd8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.053993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81474c4c-8347-4188-8afa-7dbe19060dd8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.055823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81474c4c-8347-4188-8afa-7dbe19060dd8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.056867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81474c4c-8347-4188-8afa-7dbe19060dd8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.283026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8593cafd-9291-4ecb-b09e-106a5a328f5f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:45.290873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8593cafd-9291-4ecb-b09e-106a5a328f5f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1390 microversion: 2.1 time: 0.505043 Jul 20 04:08:45.291593 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 242/535] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:44 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1390 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:45.295966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4e242953-3d0b-4362-af55-2d39f025dbb5 req-e69b0cab-7beb-48b6-8c49-1409fc42e9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284", "name": "network-vif-deleted", "tag": "3769d39d-a19f-4221-8839-d0d84ab04601"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:45.303793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4e242953-3d0b-4362-af55-2d39f025dbb5 req-e69b0cab-7beb-48b6-8c49-1409fc42e9a9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.304212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4e242953-3d0b-4362-af55-2d39f025dbb5 req-e69b0cab-7beb-48b6-8c49-1409fc42e9a9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.316925 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4e242953-3d0b-4362-af55-2d39f025dbb5 req-e69b0cab-7beb-48b6-8c49-1409fc42e9a9 service nova] Creating event network-vif-deleted:3769d39d-a19f-4221-8839-d0d84ab04601 for instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 on n-h1-760456-11 Jul 20 04:08:45.326768 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4e242953-3d0b-4362-af55-2d39f025dbb5 req-e69b0cab-7beb-48b6-8c49-1409fc42e9a9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033943 Jul 20 04:08:45.331328 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 243/536] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:45.343382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-034a0e2e-32bf-4224-b360-6ea79b0c3f17 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:45.344485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-034a0e2e-32bf-4224-b360-6ea79b0c3f17 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:45.352530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:45.356008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-034a0e2e-32bf-4224-b360-6ea79b0c3f17 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.356478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-034a0e2e-32bf-4224-b360-6ea79b0c3f17 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.357282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-034a0e2e-32bf-4224-b360-6ea79b0c3f17 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.357700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-034a0e2e-32bf-4224-b360-6ea79b0c3f17 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.402825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-81474c4c-8347-4188-8afa-7dbe19060dd8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:45.411567 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-81474c4c-8347-4188-8afa-7dbe19060dd8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.389085 Jul 20 04:08:45.422373 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 294/537] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:45 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:45.422373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b0095459-cb43-404e-a8e3-f1c2f265566e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:45.422373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b0095459-cb43-404e-a8e3-f1c2f265566e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:45.440197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-034a0e2e-32bf-4224-b360-6ea79b0c3f17 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:45.447472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0095459-cb43-404e-a8e3-f1c2f265566e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.448344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0095459-cb43-404e-a8e3-f1c2f265566e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.449776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-034a0e2e-32bf-4224-b360-6ea79b0c3f17 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1217 microversion: 2.1 time: 0.116438 Jul 20 04:08:45.450753 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 244/538] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:45 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:45.456068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f95df4b-1d67-49dd-985e-12b433a021ae tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:45.456685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f95df4b-1d67-49dd-985e-12b433a021ae tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:45.463783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f95df4b-1d67-49dd-985e-12b433a021ae tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.464256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f95df4b-1d67-49dd-985e-12b433a021ae tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.465409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f95df4b-1d67-49dd-985e-12b433a021ae tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.465849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f95df4b-1d67-49dd-985e-12b433a021ae tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.467701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0095459-cb43-404e-a8e3-f1c2f265566e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.468173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0095459-cb43-404e-a8e3-f1c2f265566e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.563069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f95df4b-1d67-49dd-985e-12b433a021ae tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:45.572622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f95df4b-1d67-49dd-985e-12b433a021ae tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:45.574429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f95df4b-1d67-49dd-985e-12b433a021ae tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:45.580326 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f95df4b-1d67-49dd-985e-12b433a021ae tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.128433 Jul 20 04:08:45.580908 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 245/539] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:45 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:45.585532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48d01642-f9ea-4173-b225-ef6b688b28d0 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:45.586130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-48d01642-f9ea-4173-b225-ef6b688b28d0 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:45.592952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48d01642-f9ea-4173-b225-ef6b688b28d0 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.593403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48d01642-f9ea-4173-b225-ef6b688b28d0 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.594182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48d01642-f9ea-4173-b225-ef6b688b28d0 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.594676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48d01642-f9ea-4173-b225-ef6b688b28d0 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.609694 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-48d01642-f9ea-4173-b225-ef6b688b28d0 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] HTTP exception thrown: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48d01642-f9ea-4173-b225-ef6b688b28d0 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Request method failure captured: Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 HTTP/1.1 Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-cS1PKOO3w0IVDjUHsszaPc6318Zi0bgqQFq1C4C2qXV0KopawsPPj0zf2A-2iLKoqlcOJ7Oi3UoW8t2IwsY3Tbp0LaSeFTKuB_6GFoS20MRVPWwWVEIPQuKPI-GNG9yRlL8o1z-MhAdQSMmjuFXacWTFgHeQjp3XIiQOCkOGrDik Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:08:45.611508 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 00eb555bda6f4374be55191cc744cd12 Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.612789 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284'} Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:45.613507 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.614743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.616051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48d01642-f9ea-4173-b225-ef6b688b28d0 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Returning 404 to user: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:45.616051 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48d01642-f9ea-4173-b225-ef6b688b28d0 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 404 len: 111 microversion: 2.1 time: 0.031055 Jul 20 04:08:45.616051 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 246/540] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:45 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:45.623450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-437188d3-5ddb-4402-af7c-44df8f2e4560 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:45.623952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-437188d3-5ddb-4402-af7c-44df8f2e4560 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:45.630400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-437188d3-5ddb-4402-af7c-44df8f2e4560 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.630899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-437188d3-5ddb-4402-af7c-44df8f2e4560 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.632418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-437188d3-5ddb-4402-af7c-44df8f2e4560 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.632586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-437188d3-5ddb-4402-af7c-44df8f2e4560 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.648041 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-437188d3-5ddb-4402-af7c-44df8f2e4560 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] HTTP exception thrown: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-437188d3-5ddb-4402-af7c-44df8f2e4560 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Request method failure captured: Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 HTTP/1.1 Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-cS1PKOO3w0IVDjUHsszaPc6318Zi0bgqQFq1C4C2qXV0KopawsPPj0zf2A-2iLKoqlcOJ7Oi3UoW8t2IwsY3Tbp0LaSeFTKuB_6GFoS20MRVPWwWVEIPQuKPI-GNG9yRlL8o1z-MhAdQSMmjuFXacWTFgHeQjp3XIiQOCkOGrDik Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:08:45.651938 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 00eb555bda6f4374be55191cc744cd12 Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.653452 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284'} Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:45.654779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.656114 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.657551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-437188d3-5ddb-4402-af7c-44df8f2e4560 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Returning 404 to user: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:45.657551 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-437188d3-5ddb-4402-af7c-44df8f2e4560 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 404 len: 111 microversion: 2.1 time: 0.033561 Jul 20 04:08:45.657551 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 247/541] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:08:45 2022] DELETE /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:08:45.663264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58289b0b-3f9b-4db9-b8ca-aadcbd7a09d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:45.663561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-58289b0b-3f9b-4db9-b8ca-aadcbd7a09d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:45.670742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58289b0b-3f9b-4db9-b8ca-aadcbd7a09d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.671345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58289b0b-3f9b-4db9-b8ca-aadcbd7a09d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.673240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58289b0b-3f9b-4db9-b8ca-aadcbd7a09d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.673637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58289b0b-3f9b-4db9-b8ca-aadcbd7a09d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.689351 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-58289b0b-3f9b-4db9-b8ca-aadcbd7a09d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] HTTP exception thrown: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58289b0b-3f9b-4db9-b8ca-aadcbd7a09d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Request method failure captured: Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 HTTP/1.1 Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-cS1PKOO3w0IVDjUHsszaPc6318Zi0bgqQFq1C4C2qXV0KopawsPPj0zf2A-2iLKoqlcOJ7Oi3UoW8t2IwsY3Tbp0LaSeFTKuB_6GFoS20MRVPWwWVEIPQuKPI-GNG9yRlL8o1z-MhAdQSMmjuFXacWTFgHeQjp3XIiQOCkOGrDik Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:08:45.690966 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 00eb555bda6f4374be55191cc744cd12 Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.692497 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284'} Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:45.693378 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. Jul 20 04:08:45.695124 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.697077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58289b0b-3f9b-4db9-b8ca-aadcbd7a09d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Returning 404 to user: Instance a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:45.697077 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-58289b0b-3f9b-4db9-b8ca-aadcbd7a09d8 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284" status: 404 len: 111 microversion: 2.1 time: 0.033716 Jul 20 04:08:45.697077 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 248/542] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:45 2022] GET /compute/v2.1/servers/a65d15e8-bfe8-4c7f-8e4c-f5ecabf94284 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:45.701036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3b065a7-b8ee-4525-a505-dadb32ee920d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:45.701541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e3b065a7-b8ee-4525-a505-dadb32ee920d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:45.707817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3b065a7-b8ee-4525-a505-dadb32ee920d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.708269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3b065a7-b8ee-4525-a505-dadb32ee920d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.709325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3b065a7-b8ee-4525-a505-dadb32ee920d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.709951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3b065a7-b8ee-4525-a505-dadb32ee920d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.717658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0095459-cb43-404e-a8e3-f1c2f265566e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:45.725065 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-e3b065a7-b8ee-4525-a505-dadb32ee920d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] HTTP exception thrown: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3b065a7-b8ee-4525-a505-dadb32ee920d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Request method failure captured: Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 HTTP/1.1 Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-cS1PKOO3w0IVDjUHsszaPc6318Zi0bgqQFq1C4C2qXV0KopawsPPj0zf2A-2iLKoqlcOJ7Oi3UoW8t2IwsY3Tbp0LaSeFTKuB_6GFoS20MRVPWwWVEIPQuKPI-GNG9yRlL8o1z-MhAdQSMmjuFXacWTFgHeQjp3XIiQOCkOGrDik Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:08:45.726727 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 00eb555bda6f4374be55191cc744cd12 Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:45.728692 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'f2bc680e-42bb-4811-a347-560765bb4431'} Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:45.729717 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:45.731142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.732771 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b0095459-cb43-404e-a8e3-f1c2f265566e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1463 microversion: 2.1 time: 0.310909 Jul 20 04:08:45.732937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3b065a7-b8ee-4525-a505-dadb32ee920d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Returning 404 to user: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:45.733040 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 295/543] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:45 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1463 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:45.733127 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e3b065a7-b8ee-4525-a505-dadb32ee920d tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 404 len: 111 microversion: 2.1 time: 0.031885 Jul 20 04:08:45.733127 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 249/544] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:08:45 2022] DELETE /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:45.755700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-91a1d7d3-2bae-477b-b648-b57f8175ef18 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:45.756591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-91a1d7d3-2bae-477b-b648-b57f8175ef18 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] [instance: f2bc680e-42bb-4811-a347-560765bb4431] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:45.766365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a1d7d3-2bae-477b-b648-b57f8175ef18 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.767019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a1d7d3-2bae-477b-b648-b57f8175ef18 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.767820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a1d7d3-2bae-477b-b648-b57f8175ef18 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.768269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a1d7d3-2bae-477b-b648-b57f8175ef18 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.787920 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-91a1d7d3-2bae-477b-b648-b57f8175ef18 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] HTTP exception thrown: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-91a1d7d3-2bae-477b-b648-b57f8175ef18 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Request method failure captured: Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 HTTP/1.1 Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-cS1PKOO3w0IVDjUHsszaPc6318Zi0bgqQFq1C4C2qXV0KopawsPPj0zf2A-2iLKoqlcOJ7Oi3UoW8t2IwsY3Tbp0LaSeFTKuB_6GFoS20MRVPWwWVEIPQuKPI-GNG9yRlL8o1z-MhAdQSMmjuFXacWTFgHeQjp3XIiQOCkOGrDik Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:08:45.789901 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b729031e7ba84401be0ab9da06ae1aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: b729031e7ba84401be0ab9da06ae1aa0 Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1624059345 Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 00eb555bda6f4374be55191cc744cd12 Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersAdminTestJSON-1624059345-project Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:45.791734 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'f2bc680e-42bb-4811-a347-560765bb4431'} Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:45.792529 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. Jul 20 04:08:45.793659 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:45.797584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-91a1d7d3-2bae-477b-b648-b57f8175ef18 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] Returning 404 to user: Instance f2bc680e-42bb-4811-a347-560765bb4431 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:45.797584 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-91a1d7d3-2bae-477b-b648-b57f8175ef18 tempest-DeleteServersAdminTestJSON-1624059345 tempest-DeleteServersAdminTestJSON-1624059345-project] 10.222.0.59 "GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431" status: 404 len: 111 microversion: 2.1 time: 0.051547 Jul 20 04:08:45.797584 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 296/545] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:45 2022] GET /compute/v2.1/servers/f2bc680e-42bb-4811-a347-560765bb4431 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:45.808495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f17d49cd-e3de-4f27-aa0c-605c7e1e5c49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:45.809130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f17d49cd-e3de-4f27-aa0c-605c7e1e5c49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:45.826640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f17d49cd-e3de-4f27-aa0c-605c7e1e5c49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.827107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f17d49cd-e3de-4f27-aa0c-605c7e1e5c49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.828081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f17d49cd-e3de-4f27-aa0c-605c7e1e5c49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:45.828669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f17d49cd-e3de-4f27-aa0c-605c7e1e5c49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:45.975451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0202cac7-7b32-4394-a8f9-c864d9f30140 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:46.000363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0202cac7-7b32-4394-a8f9-c864d9f30140 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Searching by: {'deleted': False, 'project_id': 'f729753ceae8439f87568f78922d63eb'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:08:46.023188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0202cac7-7b32-4394-a8f9-c864d9f30140 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.023643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0202cac7-7b32-4394-a8f9-c864d9f30140 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.028411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0202cac7-7b32-4394-a8f9-c864d9f30140 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.031311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0202cac7-7b32-4394-a8f9-c864d9f30140 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.114387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f17d49cd-e3de-4f27-aa0c-605c7e1e5c49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:46.128308 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f17d49cd-e3de-4f27-aa0c-605c7e1e5c49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1317 microversion: 2.1 time: 0.333605 Jul 20 04:08:46.129410 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 297/546] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:45 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:46.144561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:46.159961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:46.185219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.185680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.192318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.195841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.308154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.310030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.313511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lazy-loading 'fault' on Instance uuid c6b8793e-4343-4e34-97ac-bc439e52ad49 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:08:46.390707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:46.404661 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-89808907-69af-4a98-b98d-4fce6a89dbfe tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 200 len: 1308 microversion: 2.1 time: 0.270619 Jul 20 04:08:46.414774 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 298/547] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:46 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:46.420391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-fe0eff5e-9330-47e9-b194-ad744412734d req-8ae1e34c-73a8-48ed-b148-cd1e021017b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc16be0b-acc6-4bec-997a-2f0026a5500e", "name": "network-vif-plugged", "status": "completed", "tag": "bd25208d-66ad-4a91-a9ef-2368928833ad"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:46.430950 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0202cac7-7b32-4394-a8f9-c864d9f30140 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.682392 Jul 20 04:08:46.433008 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 250/548] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:45 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:46.447152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a9657a0b-4960-45cf-9132-55dfa47c8e39 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:46.447505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fe0eff5e-9330-47e9-b194-ad744412734d req-8ae1e34c-73a8-48ed-b148-cd1e021017b6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.451426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fe0eff5e-9330-47e9-b194-ad744412734d req-8ae1e34c-73a8-48ed-b148-cd1e021017b6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.454316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a9657a0b-4960-45cf-9132-55dfa47c8e39 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:46.477231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9657a0b-4960-45cf-9132-55dfa47c8e39 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.478538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9657a0b-4960-45cf-9132-55dfa47c8e39 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.481218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9657a0b-4960-45cf-9132-55dfa47c8e39 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.481846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9657a0b-4960-45cf-9132-55dfa47c8e39 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.488699 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-fe0eff5e-9330-47e9-b194-ad744412734d req-8ae1e34c-73a8-48ed-b148-cd1e021017b6 service nova] Creating event network-vif-plugged:bd25208d-66ad-4a91-a9ef-2368928833ad for instance cc16be0b-acc6-4bec-997a-2f0026a5500e on n-h2-760456-11 Jul 20 04:08:46.498474 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-fe0eff5e-9330-47e9-b194-ad744412734d req-8ae1e34c-73a8-48ed-b148-cd1e021017b6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088985 Jul 20 04:08:46.501797 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 299/549] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:46.532981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a63006ae-99a7-4eb5-a6dd-8d30a96812a4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:46.537411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a63006ae-99a7-4eb5-a6dd-8d30a96812a4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:46.556330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a63006ae-99a7-4eb5-a6dd-8d30a96812a4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.556922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a63006ae-99a7-4eb5-a6dd-8d30a96812a4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.557818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a63006ae-99a7-4eb5-a6dd-8d30a96812a4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.558445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a63006ae-99a7-4eb5-a6dd-8d30a96812a4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.797293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a63006ae-99a7-4eb5-a6dd-8d30a96812a4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:46.808288 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a63006ae-99a7-4eb5-a6dd-8d30a96812a4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.303770 Jul 20 04:08:46.808883 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 300/550] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:46 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:46.813724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e99b0e8-4187-4bfe-b4ed-30349dcbaad9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:46.818944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e99b0e8-4187-4bfe-b4ed-30349dcbaad9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Searching by: {'deleted': False} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:08:46.825640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e99b0e8-4187-4bfe-b4ed-30349dcbaad9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.826695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e99b0e8-4187-4bfe-b4ed-30349dcbaad9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.827808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e99b0e8-4187-4bfe-b4ed-30349dcbaad9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:46.828784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e99b0e8-4187-4bfe-b4ed-30349dcbaad9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:46.958034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-2e99b0e8-4187-4bfe-b4ed-30349dcbaad9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:08:47.031093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a9657a0b-4960-45cf-9132-55dfa47c8e39 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:47.046492 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a9657a0b-4960-45cf-9132-55dfa47c8e39 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1390 microversion: 2.1 time: 0.612374 Jul 20 04:08:47.047081 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 251/551] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:46 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1390 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:47.061089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0554c143-bbad-4d2a-a34b-825beb64627d tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:47.064508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0554c143-bbad-4d2a-a34b-825beb64627d tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:47.083281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0554c143-bbad-4d2a-a34b-825beb64627d tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.083732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0554c143-bbad-4d2a-a34b-825beb64627d tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.084761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0554c143-bbad-4d2a-a34b-825beb64627d tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.085409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0554c143-bbad-4d2a-a34b-825beb64627d tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.100366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e99b0e8-4187-4bfe-b4ed-30349dcbaad9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.101133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e99b0e8-4187-4bfe-b4ed-30349dcbaad9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.236010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0554c143-bbad-4d2a-a34b-825beb64627d tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:47.247803 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0554c143-bbad-4d2a-a34b-825beb64627d tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1279 microversion: 2.1 time: 0.188096 Jul 20 04:08:47.248641 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 252/552] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:47 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:47.254541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6681521e-2e35-489b-afa2-ce909cd9ffa2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:47.255152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6681521e-2e35-489b-afa2-ce909cd9ffa2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:47.261869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6681521e-2e35-489b-afa2-ce909cd9ffa2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.262350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6681521e-2e35-489b-afa2-ce909cd9ffa2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.263151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6681521e-2e35-489b-afa2-ce909cd9ffa2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.263719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6681521e-2e35-489b-afa2-ce909cd9ffa2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.375450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6681521e-2e35-489b-afa2-ce909cd9ffa2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:47.402636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6681521e-2e35-489b-afa2-ce909cd9ffa2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:47.404745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6681521e-2e35-489b-afa2-ce909cd9ffa2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:47.413136 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6681521e-2e35-489b-afa2-ce909cd9ffa2 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.163356 Jul 20 04:08:47.414300 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 253/553] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:47 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:47.419594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-684572b6-c961-44cb-be40-2fbca8be3e4a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:47.420427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-684572b6-c961-44cb-be40-2fbca8be3e4a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:47.429847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-684572b6-c961-44cb-be40-2fbca8be3e4a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.431425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-684572b6-c961-44cb-be40-2fbca8be3e4a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.432671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-684572b6-c961-44cb-be40-2fbca8be3e4a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.433357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-684572b6-c961-44cb-be40-2fbca8be3e4a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.795386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-684572b6-c961-44cb-be40-2fbca8be3e4a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:47.804482 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-684572b6-c961-44cb-be40-2fbca8be3e4a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1317 microversion: 2.1 time: 0.388904 Jul 20 04:08:47.805326 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 254/554] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:47 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:47.812119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-757d0311-2293-4873-8e7d-f3357c214284 req-ff7ee9b2-808d-4722-b188-c4acc33cb60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b8793e-4343-4e34-97ac-bc439e52ad49", "name": "network-vif-deleted", "tag": "81efc81c-d84d-4d76-9ba7-dc811cf57a09"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:47.823012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-757d0311-2293-4873-8e7d-f3357c214284 req-ff7ee9b2-808d-4722-b188-c4acc33cb60f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.823466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-757d0311-2293-4873-8e7d-f3357c214284 req-ff7ee9b2-808d-4722-b188-c4acc33cb60f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.836131 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-757d0311-2293-4873-8e7d-f3357c214284 req-ff7ee9b2-808d-4722-b188-c4acc33cb60f service nova] Creating event network-vif-deleted:81efc81c-d84d-4d76-9ba7-dc811cf57a09 for instance c6b8793e-4343-4e34-97ac-bc439e52ad49 on n-h2-760456-11 Jul 20 04:08:47.842233 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-757d0311-2293-4873-8e7d-f3357c214284 req-ff7ee9b2-808d-4722-b188-c4acc33cb60f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 Jul 20 04:08:47.843016 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 255/555] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:47.848939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-6f6b4c9d-4f81-420e-b193-dfcc2edd6c4a req-fe7aa2a3-14e2-48b0-8efa-b627a7aa8eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b088ee6-9cad-4386-9ea8-795cd04ee72f", "tag": "52b1fb30-5320-4d6d-b7c9-22304fb2cd16"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:47.859408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6f6b4c9d-4f81-420e-b193-dfcc2edd6c4a req-fe7aa2a3-14e2-48b0-8efa-b627a7aa8eb3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.859683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6f6b4c9d-4f81-420e-b193-dfcc2edd6c4a req-fe7aa2a3-14e2-48b0-8efa-b627a7aa8eb3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.874349 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6f6b4c9d-4f81-420e-b193-dfcc2edd6c4a req-fe7aa2a3-14e2-48b0-8efa-b627a7aa8eb3 service nova] Creating event network-changed:52b1fb30-5320-4d6d-b7c9-22304fb2cd16 for instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f on n-h1-760456-11 Jul 20 04:08:47.889916 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-6f6b4c9d-4f81-420e-b193-dfcc2edd6c4a req-fe7aa2a3-14e2-48b0-8efa-b627a7aa8eb3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044530 Jul 20 04:08:47.891285 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 256/556] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:47.897255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43ab6e00-67a2-412f-84e4-ec828a5c17c2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:47.899212 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e99b0e8-4187-4bfe-b4ed-30349dcbaad9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 15537 microversion: 2.1 time: 1.088845 Jul 20 04:08:47.899785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43ab6e00-67a2-412f-84e4-ec828a5c17c2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: c6b8793e-4343-4e34-97ac-bc439e52ad49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:47.909554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43ab6e00-67a2-412f-84e4-ec828a5c17c2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.910015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43ab6e00-67a2-412f-84e4-ec828a5c17c2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.910967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43ab6e00-67a2-412f-84e4-ec828a5c17c2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.911408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43ab6e00-67a2-412f-84e4-ec828a5c17c2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.914559 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 301/557] 10.222.0.59 () {58 vars in 1170 bytes} [Wed Jul 20 04:08:46 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 15537 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:47.932403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a59ba110-712f-4973-8fe4-c01e5f37333d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:47.933101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a59ba110-712f-4973-8fe4-c01e5f37333d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:47.936185 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-43ab6e00-67a2-412f-84e4-ec828a5c17c2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] HTTP exception thrown: Instance c6b8793e-4343-4e34-97ac-bc439e52ad49 could not be found. Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43ab6e00-67a2-412f-84e4-ec828a5c17c2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Request method failure captured: Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 HTTP/1.1 Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-f5X5S2kAf-cvMUYN-gqmTD_vN22iByleLzUxWLCWf5QTIp6zIsDusKLywk4uL2jj-bw-8VNAOJGIJIFjdlIf3Fnl4mBoWmhT08HPbHwl-6prOKrqb9V4kOZJqOEob-igpHTiNKadxB2OKpHDFSuCUN1RnBtJ0oPSH_TxsJDGGRL4 Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: c6a04cf480c24b97bcef31f3cba9f744 Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-LiveMigrationNegativeTest-287126646 Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:08:47.938269 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c6a04cf480c24b97bcef31f3cba9f744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c6a04cf480c24b97bcef31f3cba9f744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c6a04cf480c24b97bcef31f3cba9f744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c6a04cf480c24b97bcef31f3cba9f744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-LiveMigrationNegativeTest-287126646 Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: c6a04cf480c24b97bcef31f3cba9f744 Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-287126646 Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-LiveMigrationNegativeTest-287126646-project Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e9f224ae2dc24a9fb7caa42c6e20427d Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-LiveMigrationNegativeTest-287126646-project Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c6b8793e-4343-4e34-97ac-bc439e52ad49 could not be found. Jul 20 04:08:47.939806 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c6b8793e-4343-4e34-97ac-bc439e52ad49'} Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6b8793e-4343-4e34-97ac-bc439e52ad49 could not be found. Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:47.940615 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6b8793e-4343-4e34-97ac-bc439e52ad49 could not be found. Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6b8793e-4343-4e34-97ac-bc439e52ad49 could not be found. Jul 20 04:08:47.941880 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:47.944259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43ab6e00-67a2-412f-84e4-ec828a5c17c2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Returning 404 to user: Instance c6b8793e-4343-4e34-97ac-bc439e52ad49 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:47.945260 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43ab6e00-67a2-412f-84e4-ec828a5c17c2 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49" status: 404 len: 111 microversion: 2.1 time: 0.052896 Jul 20 04:08:47.946555 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 257/558] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:47 2022] GET /compute/v2.1/servers/c6b8793e-4343-4e34-97ac-bc439e52ad49 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:47.952041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a59ba110-712f-4973-8fe4-c01e5f37333d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.952508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a59ba110-712f-4973-8fe4-c01e5f37333d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.952862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b04cfe59-4f48-4068-bbd8-b401af5632ac tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:47.953297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a59ba110-712f-4973-8fe4-c01e5f37333d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.953741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a59ba110-712f-4973-8fe4-c01e5f37333d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.957626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b04cfe59-4f48-4068-bbd8-b401af5632ac tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Searching by: {'deleted': False, 'project_id': 'f729753ceae8439f87568f78922d63eb'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:08:47.965472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b04cfe59-4f48-4068-bbd8-b401af5632ac tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.966325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b04cfe59-4f48-4068-bbd8-b401af5632ac tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.967326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b04cfe59-4f48-4068-bbd8-b401af5632ac tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:47.967980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b04cfe59-4f48-4068-bbd8-b401af5632ac tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:47.984697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:48.012137 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b04cfe59-4f48-4068-bbd8-b401af5632ac tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail?tenant_id=0ed9b3e9974a41c888990fe230a2bb7e" status: 200 len: 15 microversion: 2.1 time: 0.063437 Jul 20 04:08:48.013348 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 258/559] 10.222.0.59 () {58 vars in 1230 bytes} [Wed Jul 20 04:08:47 2022] GET /compute/v2.1/servers/detail?tenant_id=0ed9b3e9974a41c888990fe230a2bb7e => generated 15 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:48.047228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73e06663-902f-4650-9270-8453b133bdab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:48.047837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-73e06663-902f-4650-9270-8453b133bdab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:48.059254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73e06663-902f-4650-9270-8453b133bdab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.059660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73e06663-902f-4650-9270-8453b133bdab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.060443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73e06663-902f-4650-9270-8453b133bdab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.060880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73e06663-902f-4650-9270-8453b133bdab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.124257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-73e06663-902f-4650-9270-8453b133bdab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:08:48.169840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a59ba110-712f-4973-8fe4-c01e5f37333d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:48.179452 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a59ba110-712f-4973-8fe4-c01e5f37333d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.263128 Jul 20 04:08:48.182580 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 302/560] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:47 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:48.193793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9057d956-ed0f-47bf-a87e-1cb277c69c21 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:48.202659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9057d956-ed0f-47bf-a87e-1cb277c69c21 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Searching by: {'tenant_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'deleted': False} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:08:48.208302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9057d956-ed0f-47bf-a87e-1cb277c69c21 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.209738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9057d956-ed0f-47bf-a87e-1cb277c69c21 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.215967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9057d956-ed0f-47bf-a87e-1cb277c69c21 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.216780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9057d956-ed0f-47bf-a87e-1cb277c69c21 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.291776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-73e06663-902f-4650-9270-8453b133bdab tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 204 len: 0 microversion: 2.1 time: 0.276553 Jul 20 04:08:48.292468 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 259/561] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:08:48 2022] DELETE /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:08:48.307104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-54a27c37-4c92-4fda-80e2-a1970492a2f0 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:48.307249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-54a27c37-4c92-4fda-80e2-a1970492a2f0 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:48.314532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a27c37-4c92-4fda-80e2-a1970492a2f0 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.314995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a27c37-4c92-4fda-80e2-a1970492a2f0 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.315784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a27c37-4c92-4fda-80e2-a1970492a2f0 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.316447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a27c37-4c92-4fda-80e2-a1970492a2f0 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.365679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-9057d956-ed0f-47bf-a87e-1cb277c69c21 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:08:48.436094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=64 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:48.457600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9057d956-ed0f-47bf-a87e-1cb277c69c21 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.458149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9057d956-ed0f-47bf-a87e-1cb277c69c21 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.504022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-54a27c37-4c92-4fda-80e2-a1970492a2f0 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:48.514855 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-54a27c37-4c92-4fda-80e2-a1970492a2f0 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1390 microversion: 2.1 time: 0.221221 Jul 20 04:08:48.515809 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 260/562] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:48 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1390 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:48.530572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b53e8413-3c58-486a-b757-543f48cc0340 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:48.531183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b53e8413-3c58-486a-b757-543f48cc0340 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:48.537396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b53e8413-3c58-486a-b757-543f48cc0340 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.537844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b53e8413-3c58-486a-b757-543f48cc0340 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.538643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b53e8413-3c58-486a-b757-543f48cc0340 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.539073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b53e8413-3c58-486a-b757-543f48cc0340 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.582725 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9057d956-ed0f-47bf-a87e-1cb277c69c21 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0ed9b3e9974a41c888990fe230a2bb7e" status: 200 len: 4832 microversion: 2.1 time: 0.398872 Jul 20 04:08:48.583332 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 303/563] 10.222.0.59 () {58 vars in 1256 bytes} [Wed Jul 20 04:08:48 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0ed9b3e9974a41c888990fe230a2bb7e => generated 4832 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:48.590536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-570532a5-9da7-4fa0-9202-c83c37ec4ae1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:48.591377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-570532a5-9da7-4fa0-9202-c83c37ec4ae1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:48.599628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-570532a5-9da7-4fa0-9202-c83c37ec4ae1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.600086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-570532a5-9da7-4fa0-9202-c83c37ec4ae1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.600871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-570532a5-9da7-4fa0-9202-c83c37ec4ae1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.601349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-570532a5-9da7-4fa0-9202-c83c37ec4ae1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.686005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b53e8413-3c58-486a-b757-543f48cc0340 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:48.693817 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b53e8413-3c58-486a-b757-543f48cc0340 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1321 microversion: 2.1 time: 0.167403 Jul 20 04:08:48.694418 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 261/564] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:48 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:48.700555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d0e46ad-b5f8-4a59-be63-ba03f86224f1 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:48.701166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d0e46ad-b5f8-4a59-be63-ba03f86224f1 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:48.707150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d0e46ad-b5f8-4a59-be63-ba03f86224f1 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.707605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d0e46ad-b5f8-4a59-be63-ba03f86224f1 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.708369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d0e46ad-b5f8-4a59-be63-ba03f86224f1 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.709629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d0e46ad-b5f8-4a59-be63-ba03f86224f1 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.714494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:48.745870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-570532a5-9da7-4fa0-9202-c83c37ec4ae1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:48.754325 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-570532a5-9da7-4fa0-9202-c83c37ec4ae1 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1475 microversion: 2.1 time: 0.169617 Jul 20 04:08:48.754946 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 304/565] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:48 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1475 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:48.762542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7eb293d8-ac46-46e0-b894-eec76a84e7ef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:48.765745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7eb293d8-ac46-46e0-b894-eec76a84e7ef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Searching by: {'tenant_id': 'f729753ceae8439f87568f78922d63eb', 'deleted': False} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:08:48.770865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7eb293d8-ac46-46e0-b894-eec76a84e7ef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.771322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7eb293d8-ac46-46e0-b894-eec76a84e7ef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.772136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7eb293d8-ac46-46e0-b894-eec76a84e7ef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.772579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7eb293d8-ac46-46e0-b894-eec76a84e7ef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.783519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3d0e46ad-b5f8-4a59-be63-ba03f86224f1 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:48.793181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3d0e46ad-b5f8-4a59-be63-ba03f86224f1 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:48.794738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3d0e46ad-b5f8-4a59-be63-ba03f86224f1 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:48.802376 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d0e46ad-b5f8-4a59-be63-ba03f86224f1 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.106785 Jul 20 04:08:48.802947 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 262/566] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:48 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:48.803908 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7eb293d8-ac46-46e0-b894-eec76a84e7ef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f729753ceae8439f87568f78922d63eb" status: 200 len: 15 microversion: 2.1 time: 0.047879 Jul 20 04:08:48.804751 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 305/567] 10.222.0.59 () {58 vars in 1256 bytes} [Wed Jul 20 04:08:48 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f729753ceae8439f87568f78922d63eb => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:48.821070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40315626-7748-4605-a43f-2b4db887555f tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:48.823675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-117a32a7-ad7b-4ab0-aae2-bacbac638240 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:48.824393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-117a32a7-ad7b-4ab0-aae2-bacbac638240 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:48.825023 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40315626-7748-4605-a43f-2b4db887555f tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.007537 Jul 20 04:08:48.825716 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 263/568] 10.222.0.59 () {58 vars in 1188 bytes} [Wed Jul 20 04:08:48 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:48.830982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-117a32a7-ad7b-4ab0-aae2-bacbac638240 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.831446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-117a32a7-ad7b-4ab0-aae2-bacbac638240 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.832226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-117a32a7-ad7b-4ab0-aae2-bacbac638240 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.832672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-117a32a7-ad7b-4ab0-aae2-bacbac638240 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.841400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-52648cf5-47cc-41cf-89ba-4b2ef4e1baa8 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:48.842357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-52648cf5-47cc-41cf-89ba-4b2ef4e1baa8 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:48.848394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52648cf5-47cc-41cf-89ba-4b2ef4e1baa8 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.848752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52648cf5-47cc-41cf-89ba-4b2ef4e1baa8 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.849515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52648cf5-47cc-41cf-89ba-4b2ef4e1baa8 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.850001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52648cf5-47cc-41cf-89ba-4b2ef4e1baa8 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.934588 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-52648cf5-47cc-41cf-89ba-4b2ef4e1baa8 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action" status: 202 len: 0 microversion: 2.1 time: 0.097044 Jul 20 04:08:48.935640 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 264/569] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:08:48 2022] POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:08:48.943567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-309ce04a-d624-44d3-a933-5ce05100ea80 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:48.946958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-309ce04a-d624-44d3-a933-5ce05100ea80 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:48.947759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-309ce04a-d624-44d3-a933-5ce05100ea80 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:08:48.954624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-309ce04a-d624-44d3-a933-5ce05100ea80 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.955070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-309ce04a-d624-44d3-a933-5ce05100ea80 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.955854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-309ce04a-d624-44d3-a933-5ce05100ea80 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:48.956292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-309ce04a-d624-44d3-a933-5ce05100ea80 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:48.974863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-117a32a7-ad7b-4ab0-aae2-bacbac638240 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:48.984770 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-117a32a7-ad7b-4ab0-aae2-bacbac638240 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1466 microversion: 2.1 time: 0.166402 Jul 20 04:08:48.985550 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 306/570] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:48 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1466 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:49.046375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-309ce04a-d624-44d3-a933-5ce05100ea80 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:08:49.154057 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-309ce04a-d624-44d3-a933-5ce05100ea80 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.214029 Jul 20 04:08:49.154715 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 265/571] 10.222.0.59 () {58 vars in 1149 bytes} [Wed Jul 20 04:08:48 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:49.165544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f8fc0d12-117a-4d03-bac6-d4d7d075baef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:49.166538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f8fc0d12-117a-4d03-bac6-d4d7d075baef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:49.172474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8fc0d12-117a-4d03-bac6-d4d7d075baef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.172926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8fc0d12-117a-4d03-bac6-d4d7d075baef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.174034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8fc0d12-117a-4d03-bac6-d4d7d075baef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.174531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8fc0d12-117a-4d03-bac6-d4d7d075baef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.256745 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f8fc0d12-117a-4d03-bac6-d4d7d075baef tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action" status: 202 len: 0 microversion: 2.1 time: 0.094759 Jul 20 04:08:49.257383 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 266/572] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:08:49 2022] POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:08:49.263420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-00c5eb4d-0655-4f44-b5e3-9157095d362e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:49.264041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-00c5eb4d-0655-4f44-b5e3-9157095d362e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:49.269924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00c5eb4d-0655-4f44-b5e3-9157095d362e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.270613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00c5eb4d-0655-4f44-b5e3-9157095d362e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.271568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00c5eb4d-0655-4f44-b5e3-9157095d362e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.272169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00c5eb4d-0655-4f44-b5e3-9157095d362e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.299600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a30296a1-3b01-4d6f-ab6f-b91a7af68282 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:49.300294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a30296a1-3b01-4d6f-ab6f-b91a7af68282 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:49.307468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a30296a1-3b01-4d6f-ab6f-b91a7af68282 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.308149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a30296a1-3b01-4d6f-ab6f-b91a7af68282 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.309105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a30296a1-3b01-4d6f-ab6f-b91a7af68282 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.309708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a30296a1-3b01-4d6f-ab6f-b91a7af68282 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.416564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-00c5eb4d-0655-4f44-b5e3-9157095d362e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:49.424025 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-00c5eb4d-0655-4f44-b5e3-9157095d362e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1477 microversion: 2.1 time: 0.165475 Jul 20 04:08:49.425029 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 267/573] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:49 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1477 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:49.429031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-52b00012-e709-4e65-927a-9c7985db8dca tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:49.429647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-52b00012-e709-4e65-927a-9c7985db8dca tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:49.436570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52b00012-e709-4e65-927a-9c7985db8dca tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.436969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52b00012-e709-4e65-927a-9c7985db8dca tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.437827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52b00012-e709-4e65-927a-9c7985db8dca tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.438309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52b00012-e709-4e65-927a-9c7985db8dca tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.638066 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a30296a1-3b01-4d6f-ab6f-b91a7af68282 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1619 microversion: 2.1 time: 0.638871 Jul 20 04:08:49.639813 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 307/574] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:48 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1619 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:49.644498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9553f6d5-33aa-4b29-bc73-ef45c5612728 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:49.645402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9553f6d5-33aa-4b29-bc73-ef45c5612728 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:49.655428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9553f6d5-33aa-4b29-bc73-ef45c5612728 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.655935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9553f6d5-33aa-4b29-bc73-ef45c5612728 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.657389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9553f6d5-33aa-4b29-bc73-ef45c5612728 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.658744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9553f6d5-33aa-4b29-bc73-ef45c5612728 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.811551 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-52b00012-e709-4e65-927a-9c7985db8dca tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1616 microversion: 2.1 time: 0.385784 Jul 20 04:08:49.812438 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 268/575] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:49 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1616 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:49.817182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-631cfa7b-eb40-4e51-93a8-30a8d31c836b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Action: 'create', calling method: .version_select at 0x7fb8425feca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2103316072", "policies": ["affinity"]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:49.825000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9553f6d5-33aa-4b29-bc73-ef45c5612728 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:49.833372 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9553f6d5-33aa-4b29-bc73-ef45c5612728 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1390 microversion: 2.1 time: 0.192527 Jul 20 04:08:49.842956 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 308/576] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:49 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1390 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:49.842956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4682f1dd-60f6-4c7c-a0b9-07c4e95bbb81 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:49.842956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4682f1dd-60f6-4c7c-a0b9-07c4e95bbb81 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:49.848189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4682f1dd-60f6-4c7c-a0b9-07c4e95bbb81 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.848647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4682f1dd-60f6-4c7c-a0b9-07c4e95bbb81 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.849433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4682f1dd-60f6-4c7c-a0b9-07c4e95bbb81 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.849875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4682f1dd-60f6-4c7c-a0b9-07c4e95bbb81 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.851307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-631cfa7b-eb40-4e51-93a8-30a8d31c836b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:49.857647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-631cfa7b-eb40-4e51-93a8-30a8d31c836b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:49.940237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-631cfa7b-eb40-4e51-93a8-30a8d31c836b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:49.955405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-631cfa7b-eb40-4e51-93a8-30a8d31c836b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:49.972641 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-631cfa7b-eb40-4e51-93a8-30a8d31c836b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.158780 Jul 20 04:08:49.973986 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 269/577] 10.222.0.59 () {60 vars in 1173 bytes} [Wed Jul 20 04:08:49 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:49.980305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-431f480a-83ec-485a-83d0-eece44dd33b9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:49.981247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-431f480a-83ec-485a-83d0-eece44dd33b9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:49.992472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-431f480a-83ec-485a-83d0-eece44dd33b9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.993840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-431f480a-83ec-485a-83d0-eece44dd33b9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:49.995841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-431f480a-83ec-485a-83d0-eece44dd33b9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:49.997106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-431f480a-83ec-485a-83d0-eece44dd33b9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:50.099350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4682f1dd-60f6-4c7c-a0b9-07c4e95bbb81 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:50.108853 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4682f1dd-60f6-4c7c-a0b9-07c4e95bbb81 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1321 microversion: 2.1 time: 0.273825 Jul 20 04:08:50.118720 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 309/578] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:49 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:50.125681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-831684da-3df6-4872-a842-b1622c2a871e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:50.126566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-831684da-3df6-4872-a842-b1622c2a871e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:50.134678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-831684da-3df6-4872-a842-b1622c2a871e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:50.135145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-831684da-3df6-4872-a842-b1622c2a871e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:50.135939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-831684da-3df6-4872-a842-b1622c2a871e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:50.136386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-831684da-3df6-4872-a842-b1622c2a871e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:50.208017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-831684da-3df6-4872-a842-b1622c2a871e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:50.217163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-831684da-3df6-4872-a842-b1622c2a871e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:50.218697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-831684da-3df6-4872-a842-b1622c2a871e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:50.224273 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-831684da-3df6-4872-a842-b1622c2a871e tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.104174 Jul 20 04:08:50.224884 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 310/579] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:50 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:50.230291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c96bd3a1-abe3-41ff-b80d-cb57a9adf93b tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:50.230912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c96bd3a1-abe3-41ff-b80d-cb57a9adf93b tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:50.237203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c96bd3a1-abe3-41ff-b80d-cb57a9adf93b tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:50.237653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c96bd3a1-abe3-41ff-b80d-cb57a9adf93b tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:50.238491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c96bd3a1-abe3-41ff-b80d-cb57a9adf93b tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:50.238928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c96bd3a1-abe3-41ff-b80d-cb57a9adf93b tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:50.375404 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c96bd3a1-abe3-41ff-b80d-cb57a9adf93b tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1616 microversion: 2.1 time: 0.149440 Jul 20 04:08:50.376053 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 311/580] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:50 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1616 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:50.501611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-431f480a-83ec-485a-83d0-eece44dd33b9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:50.513425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f88e3a01-49de-46dd-a7aa-d6c9e3de0f06 tempest-FlavorsV255TestJSON-2006813003 tempest-FlavorsV255TestJSON-2006813003-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1366797623", "id": 1117919849, "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:50.517442 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:50.517442 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:50.521497 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-431f480a-83ec-485a-83d0-eece44dd33b9 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1475 microversion: 2.1 time: 0.545867 Jul 20 04:08:50.522086 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 270/581] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:49 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1475 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:50.536745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1212998103", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "43b90a72-1e93-4b1d-846d-9e78f147e47a"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:50.548784 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f88e3a01-49de-46dd-a7aa-d6c9e3de0f06 tempest-FlavorsV255TestJSON-2006813003 tempest-FlavorsV255TestJSON-2006813003-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.171510 Jul 20 04:08:50.549375 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 312/582] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:08:50 2022] POST /compute/v2.1/flavors => generated 449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:50.553993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-983415a4-618b-41cc-9fa7-3e06055b24a9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:50.565606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-983415a4-618b-41cc-9fa7-3e06055b24a9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Searching by: {'host': 'n-h1-760456-11', 'deleted': False} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:08:50.571961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-983415a4-618b-41cc-9fa7-3e06055b24a9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:50.572592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-983415a4-618b-41cc-9fa7-3e06055b24a9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:50.573853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-983415a4-618b-41cc-9fa7-3e06055b24a9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:50.574512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-983415a4-618b-41cc-9fa7-3e06055b24a9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:50.607328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:50.683652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-983415a4-618b-41cc-9fa7-3e06055b24a9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:08:50.776675 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-983415a4-618b-41cc-9fa7-3e06055b24a9 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers?host=n-h1-760456-11&all_tenants=1" status: 200 len: 1984 microversion: 2.1 time: 0.225936 Jul 20 04:08:50.784677 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 313/583] 10.222.0.59 () {58 vars in 1191 bytes} [Wed Jul 20 04:08:50 2022] GET /compute/v2.1/servers?host=n-h1-760456-11&all_tenants=1 => generated 1984 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:50.784677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b387703c-60d1-4c78-8e50-02cfce40a764 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:50.784677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b387703c-60d1-4c78-8e50-02cfce40a764 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:50.792234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b387703c-60d1-4c78-8e50-02cfce40a764 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:50.792551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b387703c-60d1-4c78-8e50-02cfce40a764 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:50.793293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b387703c-60d1-4c78-8e50-02cfce40a764 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:50.793784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b387703c-60d1-4c78-8e50-02cfce40a764 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.063986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:51.064418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:51.064900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:51.065315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:51.065726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:51.092432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.093150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.094154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.094799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.114459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:51.123529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:51.133253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:51.153247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Going to run 2 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:08:51.156024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 062ae2d5-b44a-4064-aef7-0ab665ad2f5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:51.169414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b387703c-60d1-4c78-8e50-02cfce40a764 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:51.179073 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b387703c-60d1-4c78-8e50-02cfce40a764 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1476 microversion: 2.1 time: 0.400133 Jul 20 04:08:51.180189 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 314/584] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:50 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1476 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:51.203939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119605) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 20 04:08:51.228289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:51.236004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:51.301876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:51.309086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:51.328245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04fb8cfd-02b7-4c4b-bd26-812a1157d75c tempest-FlavorsV255TestJSON-1120852918 tempest-FlavorsV255TestJSON-1120852918-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:51.329516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=062ae2d5-b44a-4064-aef7-0ab665ad2f5c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:08:51.338873 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04fb8cfd-02b7-4c4b-bd26-812a1157d75c tempest-FlavorsV255TestJSON-1120852918 tempest-FlavorsV255TestJSON-1120852918-project] 10.222.0.59 "GET /compute/v2.1/flavors/1117919849" status: 200 len: 449 microversion: 2.55 time: 0.155838 Jul 20 04:08:51.340422 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 315/585] 10.222.0.59 () {60 vars in 1198 bytes} [Wed Jul 20 04:08:51 2022] GET /compute/v2.1/flavors/1117919849 => generated 449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:51.345221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e724752c-d41e-445e-a8c8-a9c4aa7e3796 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:51.352045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e724752c-d41e-445e-a8c8-a9c4aa7e3796 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:08:51.356850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:51.367632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e724752c-d41e-445e-a8c8-a9c4aa7e3796 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.369079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e724752c-d41e-445e-a8c8-a9c4aa7e3796 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.370217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e724752c-d41e-445e-a8c8-a9c4aa7e3796 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.370836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e724752c-d41e-445e-a8c8-a9c4aa7e3796 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.400385 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e724752c-d41e-445e-a8c8-a9c4aa7e3796 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.057820 Jul 20 04:08:51.401517 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 316/586] 10.222.0.59 () {58 vars in 1195 bytes} [Wed Jul 20 04:08:51 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:08:51.409877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:51.411910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2fb33c07-c8f2-40da-bf18-b36ae6ec1c20 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:51.412857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2fb33c07-c8f2-40da-bf18-b36ae6ec1c20 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:51.416532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:51.420178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fb33c07-c8f2-40da-bf18-b36ae6ec1c20 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.420862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fb33c07-c8f2-40da-bf18-b36ae6ec1c20 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.422086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fb33c07-c8f2-40da-bf18-b36ae6ec1c20 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.422720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fb33c07-c8f2-40da-bf18-b36ae6ec1c20 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.466841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:08:51.472032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:08:51.508842 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a681adca-a619-40c7-8dfe-f3cfd5e67651 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.985603 Jul 20 04:08:51.510443 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 271/587] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:50 2022] POST /compute/v2.1/servers => generated 32 bytes in 988 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:08:51.516674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-67e4b569-cb41-4a40-b6c3-13787bcec10d req-55b9721b-1bc7-47fb-969a-27ad928fd176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce", "tag": "ea703066-f1db-43b5-b21f-a36b77b5d994"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:51.528442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-67e4b569-cb41-4a40-b6c3-13787bcec10d req-55b9721b-1bc7-47fb-969a-27ad928fd176 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.528882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-67e4b569-cb41-4a40-b6c3-13787bcec10d req-55b9721b-1bc7-47fb-969a-27ad928fd176 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.541126 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-67e4b569-cb41-4a40-b6c3-13787bcec10d req-55b9721b-1bc7-47fb-969a-27ad928fd176 service nova] Creating event network-changed:ea703066-f1db-43b5-b21f-a36b77b5d994 for instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce on n-h2-760456-11 Jul 20 04:08:51.546431 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-67e4b569-cb41-4a40-b6c3-13787bcec10d req-55b9721b-1bc7-47fb-969a-27ad928fd176 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034666 Jul 20 04:08:51.547637 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 272/588] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:51.554176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-42a1da09-c9be-40a9-a3cb-dc8526b68dd6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:51.555118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-42a1da09-c9be-40a9-a3cb-dc8526b68dd6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:51.562960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42a1da09-c9be-40a9-a3cb-dc8526b68dd6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.563742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42a1da09-c9be-40a9-a3cb-dc8526b68dd6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.564775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42a1da09-c9be-40a9-a3cb-dc8526b68dd6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.565362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42a1da09-c9be-40a9-a3cb-dc8526b68dd6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.904027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-42a1da09-c9be-40a9-a3cb-dc8526b68dd6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:51.914148 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-42a1da09-c9be-40a9-a3cb-dc8526b68dd6 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1321 microversion: 2.1 time: 0.365131 Jul 20 04:08:51.919222 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 273/589] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:51 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:51.925106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a0ee527a-ae81-47d2-ae02-1fbb1de1c9bc tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:51.926286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a0ee527a-ae81-47d2-ae02-1fbb1de1c9bc tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:51.936815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0ee527a-ae81-47d2-ae02-1fbb1de1c9bc tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.937663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0ee527a-ae81-47d2-ae02-1fbb1de1c9bc tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:51.939043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0ee527a-ae81-47d2-ae02-1fbb1de1c9bc tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:51.940155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0ee527a-ae81-47d2-ae02-1fbb1de1c9bc tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.015165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2fb33c07-c8f2-40da-bf18-b36ae6ec1c20 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:52.042321 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2fb33c07-c8f2-40da-bf18-b36ae6ec1c20 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1390 microversion: 2.1 time: 0.639164 Jul 20 04:08:52.042814 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 317/590] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:51 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1390 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:52.045127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a0ee527a-ae81-47d2-ae02-1fbb1de1c9bc tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:52.060009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a0ee527a-ae81-47d2-ae02-1fbb1de1c9bc tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:52.063580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a0ee527a-ae81-47d2-ae02-1fbb1de1c9bc tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:52.072424 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a0ee527a-ae81-47d2-ae02-1fbb1de1c9bc tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.151381 Jul 20 04:08:52.073598 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 274/591] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:51 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:52.091415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-55ee51a4-4422-4ae9-8129-4ce0b1c5efcc tempest-FlavorsV255TestJSON-2006813003 tempest-FlavorsV255TestJSON-2006813003-project-admin] Action: 'update', calling method: .version_select at 0x7fb849127310>, body: {"flavor": {"description": "new"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:52.094966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d84ad13-9311-4ea5-b724-83cf4a7e3183 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:52.096104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7d84ad13-9311-4ea5-b724-83cf4a7e3183 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:52.118456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d84ad13-9311-4ea5-b724-83cf4a7e3183 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.118999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d84ad13-9311-4ea5-b724-83cf4a7e3183 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.120087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d84ad13-9311-4ea5-b724-83cf4a7e3183 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.122604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d84ad13-9311-4ea5-b724-83cf4a7e3183 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.130944 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:52.130944 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:52.174984 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-55ee51a4-4422-4ae9-8129-4ce0b1c5efcc tempest-FlavorsV255TestJSON-2006813003 tempest-FlavorsV255TestJSON-2006813003-project-admin] 10.222.0.59 "PUT /compute/v2.1/flavors/1117919849" status: 200 len: 450 microversion: 2.55 time: 0.106476 Jul 20 04:08:52.177093 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 318/592] 10.222.0.59 () {62 vars in 1218 bytes} [Wed Jul 20 04:08:52 2022] PUT /compute/v2.1/flavors/1117919849 => generated 450 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:08:52.184230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-183ed683-463c-48b2-bde4-750c19092fa5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:52.187915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-183ed683-463c-48b2-bde4-750c19092fa5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:52.188851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-183ed683-463c-48b2-bde4-750c19092fa5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Searching by: {'deleted': False, 'project_id': '95231a9d82164f88b1c6ff355679d292'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:08:52.227124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-183ed683-463c-48b2-bde4-750c19092fa5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.228014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-183ed683-463c-48b2-bde4-750c19092fa5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.229056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-183ed683-463c-48b2-bde4-750c19092fa5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.231491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-183ed683-463c-48b2-bde4-750c19092fa5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.295850 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7d84ad13-9311-4ea5-b724-83cf4a7e3183 tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action" status: 202 len: 0 microversion: 2.1 time: 0.219676 Jul 20 04:08:52.300233 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 275/593] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:08:52 2022] POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:08:52.311554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4daeac41-057c-4b4f-bf69-01dc7f75b444 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:52.312359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4daeac41-057c-4b4f-bf69-01dc7f75b444 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:52.318429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4daeac41-057c-4b4f-bf69-01dc7f75b444 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.319037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4daeac41-057c-4b4f-bf69-01dc7f75b444 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.320323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4daeac41-057c-4b4f-bf69-01dc7f75b444 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.320771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4daeac41-057c-4b4f-bf69-01dc7f75b444 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.405839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4daeac41-057c-4b4f-bf69-01dc7f75b444 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f224ae2dc24a9fb7caa42c6e20427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a04cf480c24b97bcef31f3cba9f744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:52.416708 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4daeac41-057c-4b4f-bf69-01dc7f75b444 tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 200 len: 1433 microversion: 2.1 time: 0.113933 Jul 20 04:08:52.426658 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 276/594] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:52 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 1433 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:52.432606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-178a58da-43ee-4055-b36d-4f95647d589a tempest-FlavorsV255TestJSON-1120852918 tempest-FlavorsV255TestJSON-1120852918-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:52.478240 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-178a58da-43ee-4055-b36d-4f95647d589a tempest-FlavorsV255TestJSON-1120852918 tempest-FlavorsV255TestJSON-1120852918-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 6592 microversion: 2.55 time: 0.045330 Jul 20 04:08:52.479632 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 277/595] 10.222.0.59 () {60 vars in 1186 bytes} [Wed Jul 20 04:08:52 2022] GET /compute/v2.1/flavors/detail => generated 6592 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:52.485953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c207650c-f876-4c9d-b282-df2f39e89f69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:52.486837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c207650c-f876-4c9d-b282-df2f39e89f69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:52.494338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c207650c-f876-4c9d-b282-df2f39e89f69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.496097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c207650c-f876-4c9d-b282-df2f39e89f69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.499701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c207650c-f876-4c9d-b282-df2f39e89f69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.500784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c207650c-f876-4c9d-b282-df2f39e89f69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.530603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:52.580605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-183ed683-463c-48b2-bde4-750c19092fa5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:08:52.694306 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-183ed683-463c-48b2-bde4-750c19092fa5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.515592 Jul 20 04:08:52.700909 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 319/596] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:08:52 2022] GET /compute/v2.1/servers => generated 1004 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:52.706084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-fc9e3107-59c2-4eb9-bfdc-62328bda74af req-a1b33df6-e59e-4401-aab7-37f1f18a2bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca69cf0f-51e1-44c3-b6c7-909906c86a98", "name": "network-vif-unplugged", "status": "completed", "tag": "5bb8310e-d16c-408e-835c-86dc238bca54"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:52.715966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fc9e3107-59c2-4eb9-bfdc-62328bda74af req-a1b33df6-e59e-4401-aab7-37f1f18a2bbb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.715966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fc9e3107-59c2-4eb9-bfdc-62328bda74af req-a1b33df6-e59e-4401-aab7-37f1f18a2bbb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.730871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c207650c-f876-4c9d-b282-df2f39e89f69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:52.740976 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c207650c-f876-4c9d-b282-df2f39e89f69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1476 microversion: 2.1 time: 0.259965 Jul 20 04:08:52.742149 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-fc9e3107-59c2-4eb9-bfdc-62328bda74af req-a1b33df6-e59e-4401-aab7-37f1f18a2bbb service nova] Creating event network-vif-unplugged:5bb8310e-d16c-408e-835c-86dc238bca54 for instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 on n-h1-760456-11 Jul 20 04:08:52.744014 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 278/597] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:52 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:52.750725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:52.752605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:52.761077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.761924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.762957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.763604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.776627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-fc9e3107-59c2-4eb9-bfdc-62328bda74af req-a1b33df6-e59e-4401-aab7-37f1f18a2bbb service nova] Instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:08:52.800081 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-fc9e3107-59c2-4eb9-bfdc-62328bda74af req-a1b33df6-e59e-4401-aab7-37f1f18a2bbb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097556 Jul 20 04:08:52.807077 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 320/598] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:52.812480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ee4004c-2b2b-4cd3-9d95-deb1fa8a5236 tempest-FlavorsV255TestJSON-1120852918 tempest-FlavorsV255TestJSON-1120852918-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:52.834824 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ee4004c-2b2b-4cd3-9d95-deb1fa8a5236 tempest-FlavorsV255TestJSON-1120852918 tempest-FlavorsV255TestJSON-1120852918-project] 10.222.0.59 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.55 time: 0.025548 Jul 20 04:08:52.844173 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 321/599] 10.222.0.59 () {60 vars in 1165 bytes} [Wed Jul 20 04:08:52 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:52.844173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9256da20-37a5-45d9-8e4c-f0c92bfe6f07 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:52.844173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9256da20-37a5-45d9-8e4c-f0c92bfe6f07 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:52.850028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9256da20-37a5-45d9-8e4c-f0c92bfe6f07 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.850529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9256da20-37a5-45d9-8e4c-f0c92bfe6f07 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.851319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9256da20-37a5-45d9-8e4c-f0c92bfe6f07 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.851767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9256da20-37a5-45d9-8e4c-f0c92bfe6f07 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.864665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:08:52.865085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:08:52.865718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:08:52.866134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:08:52.866627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:08:52.920732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9256da20-37a5-45d9-8e4c-f0c92bfe6f07 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:52.930019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:52.930288 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9256da20-37a5-45d9-8e4c-f0c92bfe6f07 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1223 microversion: 2.1 time: 0.091329 Jul 20 04:08:52.930288 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 322/600] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:52 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:52.934949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8850f019-95b5-4a92-ba4d-392d56e9f3de tempest-FlavorsV255TestJSON-2006813003 tempest-FlavorsV255TestJSON-2006813003-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:52.935803 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:52.935803 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:08:52.945097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.945667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.947312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.947312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.956240 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8850f019-95b5-4a92-ba4d-392d56e9f3de tempest-FlavorsV255TestJSON-2006813003 tempest-FlavorsV255TestJSON-2006813003-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1117919849" status: 202 len: 0 microversion: 2.55 time: 0.024677 Jul 20 04:08:52.961366 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 323/601] 10.222.0.59 () {60 vars in 1201 bytes} [Wed Jul 20 04:08:52 2022] DELETE /compute/v2.1/flavors/1117919849 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:08:52.966317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9bb2c550-0c0c-46b0-ae61-55647ce82213 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:52.967314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9bb2c550-0c0c-46b0-ae61-55647ce82213 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:52.974399 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-828d0081-0924-424a-b34e-aad65129c625 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action" status: 202 len: 1067 microversion: 2.1 time: 0.227625 Jul 20 04:08:52.975352 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 279/602] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:08:52 2022] POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action => generated 1067 bytes in 229 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:08:52.977047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bb2c550-0c0c-46b0-ae61-55647ce82213 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.979248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bb2c550-0c0c-46b0-ae61-55647ce82213 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.980388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-61c2b085-5db3-4788-8a77-69143874c473 tempest-FlavorsV255TestJSON-2006813003 tempest-FlavorsV255TestJSON-2006813003-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:52.980532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bb2c550-0c0c-46b0-ae61-55647ce82213 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:52.981092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bb2c550-0c0c-46b0-ae61-55647ce82213 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:52.986163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:53.003317 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-61c2b085-5db3-4788-8a77-69143874c473 tempest-FlavorsV255TestJSON-2006813003 tempest-FlavorsV255TestJSON-2006813003-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 6152 microversion: 2.55 time: 0.026864 Jul 20 04:08:53.003897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 280/603] 10.222.0.59 () {60 vars in 1186 bytes} [Wed Jul 20 04:08:52 2022] GET /compute/v2.1/flavors/detail => generated 6152 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:53.033326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3a46fe79-15de-4a63-b0cb-203e5586879f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:53.034219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3a46fe79-15de-4a63-b0cb-203e5586879f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:53.071025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a46fe79-15de-4a63-b0cb-203e5586879f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.074083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a46fe79-15de-4a63-b0cb-203e5586879f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.075352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a46fe79-15de-4a63-b0cb-203e5586879f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.078552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a46fe79-15de-4a63-b0cb-203e5586879f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.359591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9bb2c550-0c0c-46b0-ae61-55647ce82213 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:53.373673 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9bb2c550-0c0c-46b0-ae61-55647ce82213 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1321 microversion: 2.1 time: 0.413371 Jul 20 04:08:53.377253 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 324/604] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:52 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1321 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:53.390213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7dcdf87a-e078-48f7-8db0-1ea1cc141a24 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:53.394563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7dcdf87a-e078-48f7-8db0-1ea1cc141a24 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:53.416301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dcdf87a-e078-48f7-8db0-1ea1cc141a24 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.418219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dcdf87a-e078-48f7-8db0-1ea1cc141a24 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.420662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dcdf87a-e078-48f7-8db0-1ea1cc141a24 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.423049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dcdf87a-e078-48f7-8db0-1ea1cc141a24 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.722434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7dcdf87a-e078-48f7-8db0-1ea1cc141a24 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:53.729090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3a46fe79-15de-4a63-b0cb-203e5586879f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:53.731201 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7dcdf87a-e078-48f7-8db0-1ea1cc141a24 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1390 microversion: 2.1 time: 0.352273 Jul 20 04:08:53.740783 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3a46fe79-15de-4a63-b0cb-203e5586879f tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1471 microversion: 2.1 time: 0.735588 Jul 20 04:08:53.741298 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 281/605] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:53 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1471 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:53.751203 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 325/606] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:53 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1390 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:53.759797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-46839ee6-e4b5-4e22-be13-7ac8a5ade1d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:53.763854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd9d3049-f3aa-46a2-b4e9-aa39ce018efb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:53.764032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-46839ee6-e4b5-4e22-be13-7ac8a5ade1d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:53.764943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dd9d3049-f3aa-46a2-b4e9-aa39ce018efb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] [instance: d8f7fd42-e6f1-4a83-b45d-6575d5f62155] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:53.773728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd9d3049-f3aa-46a2-b4e9-aa39ce018efb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.776322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd9d3049-f3aa-46a2-b4e9-aa39ce018efb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.777298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd9d3049-f3aa-46a2-b4e9-aa39ce018efb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.781122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46839ee6-e4b5-4e22-be13-7ac8a5ade1d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.781546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd9d3049-f3aa-46a2-b4e9-aa39ce018efb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.781680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46839ee6-e4b5-4e22-be13-7ac8a5ade1d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.782387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46839ee6-e4b5-4e22-be13-7ac8a5ade1d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.782834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46839ee6-e4b5-4e22-be13-7ac8a5ade1d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.812060 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-dd9d3049-f3aa-46a2-b4e9-aa39ce018efb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] HTTP exception thrown: Instance d8f7fd42-e6f1-4a83-b45d-6575d5f62155 could not be found. Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd9d3049-f3aa-46a2-b4e9-aa39ce018efb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Request method failure captured: Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 HTTP/1.1 Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-f5X5S2kAf-cvMUYN-gqmTD_vN22iByleLzUxWLCWf5QTIp6zIsDusKLywk4uL2jj-bw-8VNAOJGIJIFjdlIf3Fnl4mBoWmhT08HPbHwl-6prOKrqb9V4kOZJqOEob-igpHTiNKadxB2OKpHDFSuCUN1RnBtJ0oPSH_TxsJDGGRL4 Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: c6a04cf480c24b97bcef31f3cba9f744 Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-LiveMigrationNegativeTest-287126646 Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:08:53.813768 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c6a04cf480c24b97bcef31f3cba9f744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c6a04cf480c24b97bcef31f3cba9f744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c6a04cf480c24b97bcef31f3cba9f744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c6a04cf480c24b97bcef31f3cba9f744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-LiveMigrationNegativeTest-287126646 Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: c6a04cf480c24b97bcef31f3cba9f744 Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-287126646 Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-LiveMigrationNegativeTest-287126646-project Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e9f224ae2dc24a9fb7caa42c6e20427d Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-LiveMigrationNegativeTest-287126646-project Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance d8f7fd42-e6f1-4a83-b45d-6575d5f62155 could not be found. Jul 20 04:08:53.815281 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'd8f7fd42-e6f1-4a83-b45d-6575d5f62155'} Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f7fd42-e6f1-4a83-b45d-6575d5f62155 could not be found. Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:53.816963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f7fd42-e6f1-4a83-b45d-6575d5f62155 could not be found. Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f7fd42-e6f1-4a83-b45d-6575d5f62155 could not be found. Jul 20 04:08:53.818237 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:53.820389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd9d3049-f3aa-46a2-b4e9-aa39ce018efb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] Returning 404 to user: Instance d8f7fd42-e6f1-4a83-b45d-6575d5f62155 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:53.820389 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dd9d3049-f3aa-46a2-b4e9-aa39ce018efb tempest-LiveMigrationNegativeTest-287126646 tempest-LiveMigrationNegativeTest-287126646-project] 10.222.0.59 "GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155" status: 404 len: 111 microversion: 2.1 time: 0.065528 Jul 20 04:08:53.820389 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 326/607] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:53 2022] GET /compute/v2.1/servers/d8f7fd42-e6f1-4a83-b45d-6575d5f62155 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:53.833115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a2bd1fef-6c93-469d-81d9-fa5ccb9ce2bb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:53.833762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a2bd1fef-6c93-469d-81d9-fa5ccb9ce2bb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:53.849870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2bd1fef-6c93-469d-81d9-fa5ccb9ce2bb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.850353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2bd1fef-6c93-469d-81d9-fa5ccb9ce2bb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.851145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2bd1fef-6c93-469d-81d9-fa5ccb9ce2bb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.851586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2bd1fef-6c93-469d-81d9-fa5ccb9ce2bb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.882912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-46839ee6-e4b5-4e22-be13-7ac8a5ade1d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:53.894413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-46839ee6-e4b5-4e22-be13-7ac8a5ade1d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:53.899584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-46839ee6-e4b5-4e22-be13-7ac8a5ade1d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:53.910103 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-46839ee6-e4b5-4e22-be13-7ac8a5ade1d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.166852 Jul 20 04:08:53.911526 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 282/608] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:53 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:53.952555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b2b72ce5-9e03-452a-b627-1181e7c029a2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:53.953741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b2b72ce5-9e03-452a-b627-1181e7c029a2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:53.964168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2b72ce5-9e03-452a-b627-1181e7c029a2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.965914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2b72ce5-9e03-452a-b627-1181e7c029a2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:53.967417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2b72ce5-9e03-452a-b627-1181e7c029a2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:53.968335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2b72ce5-9e03-452a-b627-1181e7c029a2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.050943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b2b72ce5-9e03-452a-b627-1181e7c029a2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:54.060460 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b2b72ce5-9e03-452a-b627-1181e7c029a2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1271 microversion: 2.1 time: 0.115808 Jul 20 04:08:54.061346 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 283/609] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:53 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:54.067408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-23a35816-4654-4786-b226-29ecf9f39215 req-aa212c40-87d2-4dc9-beca-ff9394b0c776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b088ee6-9cad-4386-9ea8-795cd04ee72f", "name": "network-vif-plugged", "status": "completed", "tag": "52b1fb30-5320-4d6d-b7c9-22304fb2cd16"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:54.079231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-23a35816-4654-4786-b226-29ecf9f39215 req-aa212c40-87d2-4dc9-beca-ff9394b0c776 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:54.079231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-23a35816-4654-4786-b226-29ecf9f39215 req-aa212c40-87d2-4dc9-beca-ff9394b0c776 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.092095 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-23a35816-4654-4786-b226-29ecf9f39215 req-aa212c40-87d2-4dc9-beca-ff9394b0c776 service nova] Creating event network-vif-plugged:52b1fb30-5320-4d6d-b7c9-22304fb2cd16 for instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f on n-h1-760456-11 Jul 20 04:08:54.097823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-23a35816-4654-4786-b226-29ecf9f39215 req-aa212c40-87d2-4dc9-beca-ff9394b0c776 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 Jul 20 04:08:54.099030 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 284/610] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:54.392539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-537e6139-8a42-4869-b3cb-36c92dc5642c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:54.393263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-537e6139-8a42-4869-b3cb-36c92dc5642c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:54.396513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:54.411641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-537e6139-8a42-4869-b3cb-36c92dc5642c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:54.412402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-537e6139-8a42-4869-b3cb-36c92dc5642c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.413830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-537e6139-8a42-4869-b3cb-36c92dc5642c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:54.414582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-537e6139-8a42-4869-b3cb-36c92dc5642c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.476400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a2bd1fef-6c93-469d-81d9-fa5ccb9ce2bb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:54.496729 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a2bd1fef-6c93-469d-81d9-fa5ccb9ce2bb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1476 microversion: 2.1 time: 0.672856 Jul 20 04:08:54.497933 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 327/611] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:53 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1476 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:54.749261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4457de82-8b04-44c0-8131-6a617e99af01 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:54.750152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4457de82-8b04-44c0-8131-6a617e99af01 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:54.757178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4457de82-8b04-44c0-8131-6a617e99af01 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:54.758002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4457de82-8b04-44c0-8131-6a617e99af01 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.759936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4457de82-8b04-44c0-8131-6a617e99af01 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:54.761033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4457de82-8b04-44c0-8131-6a617e99af01 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.859097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-537e6139-8a42-4869-b3cb-36c92dc5642c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:54.870381 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-537e6139-8a42-4869-b3cb-36c92dc5642c tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1321 microversion: 2.1 time: 0.482926 Jul 20 04:08:54.882448 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 285/612] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:54 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1321 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:54.888865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8786ebea-8e51-4115-9cf9-6b5410227e78 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:54.889483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8786ebea-8e51-4115-9cf9-6b5410227e78 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:54.897058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8786ebea-8e51-4115-9cf9-6b5410227e78 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:54.898271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8786ebea-8e51-4115-9cf9-6b5410227e78 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.899125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8786ebea-8e51-4115-9cf9-6b5410227e78 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:54.900226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8786ebea-8e51-4115-9cf9-6b5410227e78 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:54.969590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4457de82-8b04-44c0-8131-6a617e99af01 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:54.980128 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4457de82-8b04-44c0-8131-6a617e99af01 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1390 microversion: 2.1 time: 0.233995 Jul 20 04:08:54.980739 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 328/613] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:54 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:54.985913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5c48eade-d3e3-4769-963c-95161cb8fa79 req-5a5b2a3f-bee3-4902-a258-2c459e6034d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f7fd42-e6f1-4a83-b45d-6575d5f62155", "name": "network-vif-deleted", "tag": "72cf5011-e606-4111-9ad5-dd3c2c2b46c4"}, {"name": "network-changed", "server_uuid": "ca69cf0f-51e1-44c3-b6c7-909906c86a98", "tag": "5bb8310e-d16c-408e-835c-86dc238bca54"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:55.003825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5c48eade-d3e3-4769-963c-95161cb8fa79 req-5a5b2a3f-bee3-4902-a258-2c459e6034d9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.004683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5c48eade-d3e3-4769-963c-95161cb8fa79 req-5a5b2a3f-bee3-4902-a258-2c459e6034d9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.032469 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5c48eade-d3e3-4769-963c-95161cb8fa79 req-5a5b2a3f-bee3-4902-a258-2c459e6034d9 service nova] Creating event network-vif-deleted:72cf5011-e606-4111-9ad5-dd3c2c2b46c4 for instance d8f7fd42-e6f1-4a83-b45d-6575d5f62155 on n-h1-760456-11 Jul 20 04:08:55.033411 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5c48eade-d3e3-4769-963c-95161cb8fa79 req-5a5b2a3f-bee3-4902-a258-2c459e6034d9 service nova] Creating event network-changed:5bb8310e-d16c-408e-835c-86dc238bca54 for instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 on n-h1-760456-11 Jul 20 04:08:55.040264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-5c48eade-d3e3-4769-963c-95161cb8fa79 req-5a5b2a3f-bee3-4902-a258-2c459e6034d9 service nova] Instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:08:55.054377 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5c48eade-d3e3-4769-963c-95161cb8fa79 req-5a5b2a3f-bee3-4902-a258-2c459e6034d9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071958 Jul 20 04:08:55.055664 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 329/614] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:55.061913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9aab170-a821-4bee-a709-4cc1283a2152 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:55.063323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e9aab170-a821-4bee-a709-4cc1283a2152 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:55.072423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9aab170-a821-4bee-a709-4cc1283a2152 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.073612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9aab170-a821-4bee-a709-4cc1283a2152 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.074685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9aab170-a821-4bee-a709-4cc1283a2152 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.075329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9aab170-a821-4bee-a709-4cc1283a2152 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.162134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e9aab170-a821-4bee-a709-4cc1283a2152 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:55.175922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e9aab170-a821-4bee-a709-4cc1283a2152 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:55.179623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e9aab170-a821-4bee-a709-4cc1283a2152 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:55.198044 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9aab170-a821-4bee-a709-4cc1283a2152 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.140389 Jul 20 04:08:55.199686 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 330/615] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:55 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:55.217537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-df19e976-b199-491d-b2fa-23f7c35f930e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:55.219232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-df19e976-b199-491d-b2fa-23f7c35f930e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:55.228411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df19e976-b199-491d-b2fa-23f7c35f930e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.229447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df19e976-b199-491d-b2fa-23f7c35f930e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.231265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df19e976-b199-491d-b2fa-23f7c35f930e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.234625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df19e976-b199-491d-b2fa-23f7c35f930e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.303701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-df19e976-b199-491d-b2fa-23f7c35f930e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:55.313617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-df19e976-b199-491d-b2fa-23f7c35f930e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1277 microversion: 2.1 time: 0.112422 Jul 20 04:08:55.324442 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 331/616] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:55 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:55.514584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-448ad896-85c0-4adb-aabe-36008625064c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:55.515343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-448ad896-85c0-4adb-aabe-36008625064c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:55.522030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-448ad896-85c0-4adb-aabe-36008625064c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.522517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-448ad896-85c0-4adb-aabe-36008625064c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.523309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-448ad896-85c0-4adb-aabe-36008625064c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.523754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-448ad896-85c0-4adb-aabe-36008625064c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.610206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8786ebea-8e51-4115-9cf9-6b5410227e78 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:55.620625 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8786ebea-8e51-4115-9cf9-6b5410227e78 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1471 microversion: 2.1 time: 0.735912 Jul 20 04:08:55.621530 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 286/617] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:54 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1471 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:55.725933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-448ad896-85c0-4adb-aabe-36008625064c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:55.736957 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-448ad896-85c0-4adb-aabe-36008625064c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1474 microversion: 2.1 time: 0.226342 Jul 20 04:08:55.737967 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 332/618] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:55 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1474 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:08:55.888638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-618cd0b6-b726-4ca1-af5e-2b0fe0ddbcab tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:55.890149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-618cd0b6-b726-4ca1-af5e-2b0fe0ddbcab tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:55.909542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-618cd0b6-b726-4ca1-af5e-2b0fe0ddbcab tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.910748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-618cd0b6-b726-4ca1-af5e-2b0fe0ddbcab tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.912294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-618cd0b6-b726-4ca1-af5e-2b0fe0ddbcab tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:55.916538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-618cd0b6-b726-4ca1-af5e-2b0fe0ddbcab tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:55.999170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37ecffc3-bde0-4711-999c-01d6ea5f9989 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:55.999736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37ecffc3-bde0-4711-999c-01d6ea5f9989 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:56.008374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37ecffc3-bde0-4711-999c-01d6ea5f9989 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.010530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37ecffc3-bde0-4711-999c-01d6ea5f9989 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.012107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37ecffc3-bde0-4711-999c-01d6ea5f9989 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.012571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37ecffc3-bde0-4711-999c-01d6ea5f9989 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.257978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-37ecffc3-bde0-4711-999c-01d6ea5f9989 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:56.271221 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37ecffc3-bde0-4711-999c-01d6ea5f9989 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1390 microversion: 2.1 time: 0.276851 Jul 20 04:08:56.272924 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 333/619] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:55 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1390 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:56.289556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9bc1eec9-ebbe-4523-8329-b1c288faf7a0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:56.298845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9bc1eec9-ebbe-4523-8329-b1c288faf7a0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:56.307878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bc1eec9-ebbe-4523-8329-b1c288faf7a0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.308581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bc1eec9-ebbe-4523-8329-b1c288faf7a0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.309640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bc1eec9-ebbe-4523-8329-b1c288faf7a0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.310119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bc1eec9-ebbe-4523-8329-b1c288faf7a0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.353506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-618cd0b6-b726-4ca1-af5e-2b0fe0ddbcab tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:56.365803 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-618cd0b6-b726-4ca1-af5e-2b0fe0ddbcab tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1321 microversion: 2.1 time: 0.481176 Jul 20 04:08:56.375505 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 287/620] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:55 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:56.377632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bb99fd89-6082-4df4-840d-da26ea224788 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:56.379087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bb99fd89-6082-4df4-840d-da26ea224788 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:56.391775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9bc1eec9-ebbe-4523-8329-b1c288faf7a0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:56.398828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb99fd89-6082-4df4-840d-da26ea224788 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.400041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb99fd89-6082-4df4-840d-da26ea224788 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.400862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb99fd89-6082-4df4-840d-da26ea224788 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.401297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb99fd89-6082-4df4-840d-da26ea224788 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.405788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9bc1eec9-ebbe-4523-8329-b1c288faf7a0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:56.408136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9bc1eec9-ebbe-4523-8329-b1c288faf7a0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:56.427810 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9bc1eec9-ebbe-4523-8329-b1c288faf7a0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.153204 Jul 20 04:08:56.433038 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 334/621] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:56 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:56.507232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bb99fd89-6082-4df4-840d-da26ea224788 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:56.521632 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bb99fd89-6082-4df4-840d-da26ea224788 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1277 microversion: 2.1 time: 0.152483 Jul 20 04:08:56.525269 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 288/622] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:56 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:56.637924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8b7d4296-3d33-45b4-a6b5-20079be03d91 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:56.638790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8b7d4296-3d33-45b4-a6b5-20079be03d91 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:56.651229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b7d4296-3d33-45b4-a6b5-20079be03d91 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.651692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b7d4296-3d33-45b4-a6b5-20079be03d91 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.655021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b7d4296-3d33-45b4-a6b5-20079be03d91 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.657592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b7d4296-3d33-45b4-a6b5-20079be03d91 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.755820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-42e12592-f451-4fc4-a82d-73ed2ff981a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:56.757299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-42e12592-f451-4fc4-a82d-73ed2ff981a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:56.764089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42e12592-f451-4fc4-a82d-73ed2ff981a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.765203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42e12592-f451-4fc4-a82d-73ed2ff981a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.766276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42e12592-f451-4fc4-a82d-73ed2ff981a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:56.766934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42e12592-f451-4fc4-a82d-73ed2ff981a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:56.913614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8b7d4296-3d33-45b4-a6b5-20079be03d91 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:56.924713 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8b7d4296-3d33-45b4-a6b5-20079be03d91 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1471 microversion: 2.1 time: 0.291267 Jul 20 04:08:56.935640 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 335/623] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:56 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:57.115963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0265c21e-11b2-45a0-aa95-c689222ba351 tempest-FlavorsV2NegativeTest-1893913886 tempest-FlavorsV2NegativeTest-1893913886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.134396 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0265c21e-11b2-45a0-aa95-c689222ba351 tempest-FlavorsV2NegativeTest-1893913886 tempest-FlavorsV2NegativeTest-1893913886-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.205877 Jul 20 04:08:57.145775 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 336/624] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:08:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:57.251338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-42e12592-f451-4fc4-a82d-73ed2ff981a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:57.262786 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-42e12592-f451-4fc4-a82d-73ed2ff981a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1474 microversion: 2.1 time: 0.511068 Jul 20 04:08:57.279532 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 289/625] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:56 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1474 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:57.290846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a346c61d-6360-40df-aea0-9aa35bcc6a1a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.291790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a346c61d-6360-40df-aea0-9aa35bcc6a1a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:57.311544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a346c61d-6360-40df-aea0-9aa35bcc6a1a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:57.312013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a346c61d-6360-40df-aea0-9aa35bcc6a1a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:57.323273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a346c61d-6360-40df-aea0-9aa35bcc6a1a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:57.324888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a346c61d-6360-40df-aea0-9aa35bcc6a1a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:57.386570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-61577ccb-72ce-44cb-b285-efbd38f6640b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.387865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-61577ccb-72ce-44cb-b285-efbd38f6640b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:57.398804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61577ccb-72ce-44cb-b285-efbd38f6640b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:57.400890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61577ccb-72ce-44cb-b285-efbd38f6640b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:57.404768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61577ccb-72ce-44cb-b285-efbd38f6640b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:57.405462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61577ccb-72ce-44cb-b285-efbd38f6640b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:57.658330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a346c61d-6360-40df-aea0-9aa35bcc6a1a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:57.675992 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a346c61d-6360-40df-aea0-9aa35bcc6a1a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1589 microversion: 2.1 time: 0.389679 Jul 20 04:08:57.689240 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 337/626] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1589 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:57.701638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fd73e402-f576-4417-bee7-38269662fd91 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.703357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fd73e402-f576-4417-bee7-38269662fd91 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:57.721290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd73e402-f576-4417-bee7-38269662fd91 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:57.724228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd73e402-f576-4417-bee7-38269662fd91 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:57.725525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd73e402-f576-4417-bee7-38269662fd91 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:57.726980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd73e402-f576-4417-bee7-38269662fd91 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:57.849117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fd73e402-f576-4417-bee7-38269662fd91 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:57.863674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fd73e402-f576-4417-bee7-38269662fd91 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:57.868420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fd73e402-f576-4417-bee7-38269662fd91 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:57.882984 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fd73e402-f576-4417-bee7-38269662fd91 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1447 microversion: 2.75 time: 0.199691 Jul 20 04:08:57.885826 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 338/627] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1447 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:57.897343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ab3aa057-fc8e-4a7c-ba00-b152554861ca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:57.898382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ab3aa057-fc8e-4a7c-ba00-b152554861ca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:57.919927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab3aa057-fc8e-4a7c-ba00-b152554861ca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:57.921233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab3aa057-fc8e-4a7c-ba00-b152554861ca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:57.924623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab3aa057-fc8e-4a7c-ba00-b152554861ca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:57.925272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab3aa057-fc8e-4a7c-ba00-b152554861ca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:58.189946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ab3aa057-fc8e-4a7c-ba00-b152554861ca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:58.207912 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ab3aa057-fc8e-4a7c-ba00-b152554861ca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.311739 Jul 20 04:08:58.208586 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 339/628] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:58.232030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-75692777-ada6-4693-881f-d0cc8d63e666 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.232643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-75692777-ada6-4693-881f-d0cc8d63e666 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:58.251409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75692777-ada6-4693-881f-d0cc8d63e666 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:58.251863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75692777-ada6-4693-881f-d0cc8d63e666 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:58.253073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75692777-ada6-4693-881f-d0cc8d63e666 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:58.253529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75692777-ada6-4693-881f-d0cc8d63e666 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:58.387714 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-75692777-ada6-4693-881f-d0cc8d63e666 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165717 Jul 20 04:08:58.394289 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 340/629] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:58.400911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-adfbd912-c2fb-45df-87d6-323c2714eb46 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.402426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-adfbd912-c2fb-45df-87d6-323c2714eb46 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:58.421369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adfbd912-c2fb-45df-87d6-323c2714eb46 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:58.421369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adfbd912-c2fb-45df-87d6-323c2714eb46 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:58.421701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adfbd912-c2fb-45df-87d6-323c2714eb46 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:58.422365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adfbd912-c2fb-45df-87d6-323c2714eb46 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:58.430225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-61577ccb-72ce-44cb-b285-efbd38f6640b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:58.444232 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-61577ccb-72ce-44cb-b285-efbd38f6640b tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1321 microversion: 2.1 time: 1.064721 Jul 20 04:08:58.445732 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 290/630] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:57 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1321 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:58.454190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:58.459312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c2cdcd5d-3d44-4c9a-80e1-11c04322415a req-c289a570-610f-42f9-aacd-6dc8e3f18acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce", "name": "network-vif-plugged", "status": "completed", "tag": "ea703066-f1db-43b5-b21f-a36b77b5d994"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:58.477827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c2cdcd5d-3d44-4c9a-80e1-11c04322415a req-c289a570-610f-42f9-aacd-6dc8e3f18acf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:58.478290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c2cdcd5d-3d44-4c9a-80e1-11c04322415a req-c289a570-610f-42f9-aacd-6dc8e3f18acf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:58.494576 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c2cdcd5d-3d44-4c9a-80e1-11c04322415a req-c289a570-610f-42f9-aacd-6dc8e3f18acf service nova] Creating event network-vif-plugged:ea703066-f1db-43b5-b21f-a36b77b5d994 for instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce on n-h2-760456-11 Jul 20 04:08:58.499677 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c2cdcd5d-3d44-4c9a-80e1-11c04322415a req-c289a570-610f-42f9-aacd-6dc8e3f18acf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052131 Jul 20 04:08:58.500941 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 291/631] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:58.522052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ede4ebd-3760-4105-b3b2-3c6b974b5f17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:58.525268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4ede4ebd-3760-4105-b3b2-3c6b974b5f17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:58.548321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ede4ebd-3760-4105-b3b2-3c6b974b5f17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:58.549117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ede4ebd-3760-4105-b3b2-3c6b974b5f17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:58.551551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ede4ebd-3760-4105-b3b2-3c6b974b5f17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:58.552162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ede4ebd-3760-4105-b3b2-3c6b974b5f17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:58.709663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-adfbd912-c2fb-45df-87d6-323c2714eb46 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:58.721897 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-adfbd912-c2fb-45df-87d6-323c2714eb46 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1471 microversion: 2.1 time: 0.326156 Jul 20 04:08:58.723495 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 341/632] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1471 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:58.729023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9f09283-4ee9-43d6-939c-12a2f1db914c tempest-FlavorsV2NegativeTest-1893913886 tempest-FlavorsV2NegativeTest-1893913886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1535179190", "imageRef": "09008999-5208-45bf-abd3-8d38ba163a73", "flavorRef": "452"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:58.810062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-e9f09283-4ee9-43d6-939c-12a2f1db914c tempest-FlavorsV2NegativeTest-1893913886 tempest-FlavorsV2NegativeTest-1893913886-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:08:59.003552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4ede4ebd-3760-4105-b3b2-3c6b974b5f17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:59.012067 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ede4ebd-3760-4105-b3b2-3c6b974b5f17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1474 microversion: 2.1 time: 0.509593 Jul 20 04:08:59.013191 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 292/633] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:58 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1474 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:59.026982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-713e1bf9-d185-4df6-89fb-39381af46cd0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.027902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-713e1bf9-d185-4df6-89fb-39381af46cd0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:59.036191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-713e1bf9-d185-4df6-89fb-39381af46cd0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.036878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-713e1bf9-d185-4df6-89fb-39381af46cd0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.038780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-713e1bf9-d185-4df6-89fb-39381af46cd0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.039401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-713e1bf9-d185-4df6-89fb-39381af46cd0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.171076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-713e1bf9-d185-4df6-89fb-39381af46cd0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:59.180251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-713e1bf9-d185-4df6-89fb-39381af46cd0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:59.182901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-713e1bf9-d185-4df6-89fb-39381af46cd0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:59.188301 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-713e1bf9-d185-4df6-89fb-39381af46cd0 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1465 microversion: 2.75 time: 0.173800 Jul 20 04:08:59.201361 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 293/634] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1465 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:08:59.258226 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e9f09283-4ee9-43d6-939c-12a2f1db914c tempest-FlavorsV2NegativeTest-1893913886 tempest-FlavorsV2NegativeTest-1893913886-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9f09283-4ee9-43d6-939c-12a2f1db914c tempest-FlavorsV2NegativeTest-1893913886 tempest-FlavorsV2NegativeTest-1893913886-project] Request method failure captured: Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 143 Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13_YOX7B7XU1pn0J7Dt0EgAQYUTL_z5-Nco6hcCAwtHXSMrfAE-orDuBMqB4b65UWGa-TDIsMoA3smyXc9iR96c3564cAJD9ZTvLd3LhP44J5boKgBFN73g63ByxKIFh0vAj9X1Z9dxpxJfarPq7JotE_67PPI41p9lVKtYhufOFw2E Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: fad03179c434432ca865a481cc43c0cf Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsV2NegativeTest-1893913886 Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:08:59.263073 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fad03179c434432ca865a481cc43c0cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fad03179c434432ca865a481cc43c0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fad03179c434432ca865a481cc43c0cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fad03179c434432ca865a481cc43c0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsV2NegativeTest-1893913886 Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: fad03179c434432ca865a481cc43c0cf Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1893913886 Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsV2NegativeTest-1893913886-project Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: d033f8402a1b4d4ca5928bdbdead760d Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsV2NegativeTest-1893913886-project Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1535179190", "imageRef": "09008999-5208-45bf-abd3-8d38ba163a73", "flavorRef": "452"}} Jul 20 04:08:59.264684 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: exception: Flavor's memory is too small for requested image. Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1535179190', 'imageRef': '09008999-5208-45bf-abd3-8d38ba163a73', 'flavorRef': '452'}}} Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:59.265781 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:59.269362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:59.270842 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:59.270842 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:59.270842 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:08:59.270842 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:08:59.270842 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 20 04:08:59.270842 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:08:59.277935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9f09283-4ee9-43d6-939c-12a2f1db914c tempest-FlavorsV2NegativeTest-1893913886 tempest-FlavorsV2NegativeTest-1893913886-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:59.279649 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9f09283-4ee9-43d6-939c-12a2f1db914c tempest-FlavorsV2NegativeTest-1893913886 tempest-FlavorsV2NegativeTest-1893913886-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.554514 Jul 20 04:08:59.283132 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 342/635] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:08:58 2022] POST /compute/v2.1/servers => generated 93 bytes in 558 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:08:59.301307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d885de60-fe5a-466f-883e-59da95d35c72 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.303817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d885de60-fe5a-466f-883e-59da95d35c72 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:59.314579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d885de60-fe5a-466f-883e-59da95d35c72 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.314921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d885de60-fe5a-466f-883e-59da95d35c72 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.316070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d885de60-fe5a-466f-883e-59da95d35c72 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.317998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d885de60-fe5a-466f-883e-59da95d35c72 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.377896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-919ad1f1-496f-495d-b843-50c9f7d351d2 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Calling method '.version_select at 0x7fb842529790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.379017 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:59.379017 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:08:59.380536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-919ad1f1-496f-495d-b843-50c9f7d351d2 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.381495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-919ad1f1-496f-495d-b843-50c9f7d351d2 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.413586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-919ad1f1-496f-495d-b843-50c9f7d351d2 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.419675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-919ad1f1-496f-495d-b843-50c9f7d351d2 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.434120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-919ad1f1-496f-495d-b843-50c9f7d351d2 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.435419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-919ad1f1-496f-495d-b843-50c9f7d351d2 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.443201 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-919ad1f1-496f-495d-b843-50c9f7d351d2 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.239727 Jul 20 04:08:59.444406 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 294/636] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:59.465955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5dba6ffb-cd16-4878-9a41-38ead792bf09 req-be38bebb-9e68-4bef-b36c-c4f924fc8944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "808c1a0c-c593-4ae9-8816-bd7d884a7943", "tag": "514d5015-3418-492f-a8e4-09fc0c38b9b9"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:08:59.477131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5dba6ffb-cd16-4878-9a41-38ead792bf09 req-be38bebb-9e68-4bef-b36c-c4f924fc8944 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.477922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5dba6ffb-cd16-4878-9a41-38ead792bf09 req-be38bebb-9e68-4bef-b36c-c4f924fc8944 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.491274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:08:59.494097 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5dba6ffb-cd16-4878-9a41-38ead792bf09 req-be38bebb-9e68-4bef-b36c-c4f924fc8944 service nova] Creating event network-changed:514d5015-3418-492f-a8e4-09fc0c38b9b9 for instance 808c1a0c-c593-4ae9-8816-bd7d884a7943 on n-h2-760456-11 Jul 20 04:08:59.500396 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5dba6ffb-cd16-4878-9a41-38ead792bf09 req-be38bebb-9e68-4bef-b36c-c4f924fc8944 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054360 Jul 20 04:08:59.501506 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 295/637] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:08:59.729301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e267a7aa-3568-479e-9c34-8633a3dab34d tempest-HypervisorAdminNegativeUnderV252Test-1133762826 tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project] Calling method '.version_select at 0x7fb842529940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.730178 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:08:59.730178 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:08:59.731403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e267a7aa-3568-479e-9c34-8633a3dab34d tempest-HypervisorAdminNegativeUnderV252Test-1133762826 tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'ad684a9718d545c4ae8e568d755d9f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cf6759daf94d11a62a289da64ebe6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e267a7aa-3568-479e-9c34-8633a3dab34d tempest-HypervisorAdminNegativeUnderV252Test-1133762826 tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project] Request method failure captured: Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-hypervisors/n-h1-760456-11/search HTTP/1.1 Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13_aIjiJcMwMMzE6opqEaoeWmiEu_J3Gz_h8PgC1KYgWiSwsn3lRVFEW40VGkzd-s3udtjqfARxiM4KCKpWAHNqr-Iy-Lu3Mop3CjgmjaZ3CNLbdvrAa16LAVFYoSLHpWaC_kaQbvwxaw4xQny11jV2eRu0oo-28JKicS39qJy2xjac Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: c3cf6759daf94d11a62a289da64ebe6e Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1133762826 Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:08:59.733213 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c3cf6759daf94d11a62a289da64ebe6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c3cf6759daf94d11a62a289da64ebe6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c3cf6759daf94d11a62a289da64ebe6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c3cf6759daf94d11a62a289da64ebe6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1133762826 Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: c3cf6759daf94d11a62a289da64ebe6e Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1133762826 Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: ad684a9718d545c4ae8e568d755d9f17 Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:08:59.734567 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'n-h1-760456-11'} Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:08:59.735466 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:08:59.736977 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:08:59.739345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e267a7aa-3568-479e-9c34-8633a3dab34d tempest-HypervisorAdminNegativeUnderV252Test-1133762826 tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:08:59.747491 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e267a7aa-3568-479e-9c34-8633a3dab34d tempest-HypervisorAdminNegativeUnderV252Test-1133762826 tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/n-h1-760456-11/search" status: 403 len: 117 microversion: 2.1 time: 0.244586 Jul 20 04:08:59.748071 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 296/638] 10.222.0.59 () {58 vars in 1211 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/os-hypervisors/n-h1-760456-11/search => generated 117 bytes in 246 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:08:59.762490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-108e1bb1-6b29-490f-9440-60972ee75530 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.762753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-108e1bb1-6b29-490f-9440-60972ee75530 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:59.781005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d885de60-fe5a-466f-883e-59da95d35c72 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:08:59.786948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-108e1bb1-6b29-490f-9440-60972ee75530 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.788307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-108e1bb1-6b29-490f-9440-60972ee75530 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.790842 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d885de60-fe5a-466f-883e-59da95d35c72 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.505086 Jul 20 04:08:59.791490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-108e1bb1-6b29-490f-9440-60972ee75530 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.792057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-108e1bb1-6b29-490f-9440-60972ee75530 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.794505 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 343/639] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:08:59.801033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-36266c82-8b2d-4f98-af26-14371926c50a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:08:59.803606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-36266c82-8b2d-4f98-af26-14371926c50a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:08:59.821244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36266c82-8b2d-4f98-af26-14371926c50a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.822024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36266c82-8b2d-4f98-af26-14371926c50a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.823036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36266c82-8b2d-4f98-af26-14371926c50a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:08:59.824052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36266c82-8b2d-4f98-af26-14371926c50a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:08:59.830700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:00.294586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-108e1bb1-6b29-490f-9440-60972ee75530 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:00.306136 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-108e1bb1-6b29-490f-9440-60972ee75530 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1321 microversion: 2.1 time: 0.550165 Jul 20 04:09:00.318036 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 297/640] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:00.324100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-249acaa2-71ef-4123-a2c2-54fa3c16cff1 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Calling method '.version_select at 0x7fb8425feaf0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.325026 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:00.325026 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:09:00.347760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-249acaa2-71ef-4123-a2c2-54fa3c16cff1 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.353180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-249acaa2-71ef-4123-a2c2-54fa3c16cff1 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.376322 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-249acaa2-71ef-4123-a2c2-54fa3c16cff1 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-249acaa2-71ef-4123-a2c2-54fa3c16cff1 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Request method failure captured: Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13_byP1fEF9y7X_MlE7VcJmk3ReSrPrJ5H1_9YM0QQxbgtXPqDHphgYKdIwaJAz2TWRzRFRtwyJgqoWpBTAe2QOpJghxsessigWn0eaTqDko9orNH4A90jPVjEmjtdLnaaWze4zAnFG8_6vrgmUF7Vg1h3QA5goI-Gk-3MGMapD9Oxs Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 67338b5e3dda4d69b4c92f7fbf9310d6 Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1139901641 Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:09:00.384125 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/67338b5e3dda4d69b4c92f7fbf9310d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/67338b5e3dda4d69b4c92f7fbf9310d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/67338b5e3dda4d69b4c92f7fbf9310d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_67338b5e3dda4d69b4c92f7fbf9310d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1139901641 Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 67338b5e3dda4d69b4c92f7fbf9310d6 Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1139901641 Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: ae11413381ac49e9be56a44bc7ab3048 Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:09:00.385514 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:00.386306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:00.387463 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:00.387463 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:00.387463 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:00.387463 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:09:00.387463 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:00.387463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-249acaa2-71ef-4123-a2c2-54fa3c16cff1 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:00.387463 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-249acaa2-71ef-4123-a2c2-54fa3c16cff1 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.066503 Jul 20 04:09:00.387463 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 298/641] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:00.408383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-905f8c4e-51ce-40e4-b246-6bc94a3ff043 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.410090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-905f8c4e-51ce-40e4-b246-6bc94a3ff043 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:00.430560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-905f8c4e-51ce-40e4-b246-6bc94a3ff043 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.433848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-905f8c4e-51ce-40e4-b246-6bc94a3ff043 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.434922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-905f8c4e-51ce-40e4-b246-6bc94a3ff043 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.436808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-905f8c4e-51ce-40e4-b246-6bc94a3ff043 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.648240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-36266c82-8b2d-4f98-af26-14371926c50a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:00.662362 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-36266c82-8b2d-4f98-af26-14371926c50a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1471 microversion: 2.1 time: 0.865037 Jul 20 04:09:00.673566 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 344/642] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:08:59 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1471 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:00.680033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-faa65042-38d0-4d3f-af22-886c6b8ba6d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.681074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-faa65042-38d0-4d3f-af22-886c6b8ba6d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:00.689332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faa65042-38d0-4d3f-af22-886c6b8ba6d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.690486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faa65042-38d0-4d3f-af22-886c6b8ba6d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.691779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faa65042-38d0-4d3f-af22-886c6b8ba6d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.692684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faa65042-38d0-4d3f-af22-886c6b8ba6d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.795534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-faa65042-38d0-4d3f-af22-886c6b8ba6d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:00.806415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-faa65042-38d0-4d3f-af22-886c6b8ba6d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:00.808311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-faa65042-38d0-4d3f-af22-886c6b8ba6d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:00.814216 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-faa65042-38d0-4d3f-af22-886c6b8ba6d7 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1453 microversion: 2.75 time: 0.139494 Jul 20 04:09:00.827122 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 345/643] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:00.827122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-faef4c9c-d941-40c0-82da-ef216fdf7f5f tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Calling method '.version_select at 0x7fb842acce50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.827122 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:00.827122 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:09:00.827122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faef4c9c-d941-40c0-82da-ef216fdf7f5f tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.827683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faef4c9c-d941-40c0-82da-ef216fdf7f5f tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.840667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faef4c9c-d941-40c0-82da-ef216fdf7f5f tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.841234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faef4c9c-d941-40c0-82da-ef216fdf7f5f tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.855023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faef4c9c-d941-40c0-82da-ef216fdf7f5f tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.855577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faef4c9c-d941-40c0-82da-ef216fdf7f5f tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.862604 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-faef4c9c-d941-40c0-82da-ef216fdf7f5f tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.046374 Jul 20 04:09:00.868320 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 346/644] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:00.873136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-888385b9-b68f-4fcb-9347-9b5553f4f0e3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:00.873956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-888385b9-b68f-4fcb-9347-9b5553f4f0e3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:00.880877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-888385b9-b68f-4fcb-9347-9b5553f4f0e3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.881793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-888385b9-b68f-4fcb-9347-9b5553f4f0e3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:00.882816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-888385b9-b68f-4fcb-9347-9b5553f4f0e3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:00.883473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-888385b9-b68f-4fcb-9347-9b5553f4f0e3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.037026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-905f8c4e-51ce-40e4-b246-6bc94a3ff043 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.045390 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-905f8c4e-51ce-40e4-b246-6bc94a3ff043 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1471 microversion: 2.1 time: 0.657989 Jul 20 04:09:01.046309 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 299/645] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1471 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:01.062989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ab93dd5a-a9bd-43bd-bdf8-16a4085e4a26 tempest-HypervisorAdminNegativeUnderV252Test-1133762826 tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project] Calling method '.version_select at 0x7fb8424e6e50>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.064180 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:01.064180 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:09:01.066072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ab93dd5a-a9bd-43bd-bdf8-16a4085e4a26 tempest-HypervisorAdminNegativeUnderV252Test-1133762826 tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'ad684a9718d545c4ae8e568d755d9f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cf6759daf94d11a62a289da64ebe6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ab93dd5a-a9bd-43bd-bdf8-16a4085e4a26 tempest-HypervisorAdminNegativeUnderV252Test-1133762826 tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project] Request method failure captured: Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13_aIjiJcMwMMzE6opqEaoeWmiEu_J3Gz_h8PgC1KYgWiSwsn3lRVFEW40VGkzd-s3udtjqfARxiM4KCKpWAHNqr-Iy-Lu3Mop3CjgmjaZ3CNLbdvrAa16LAVFYoSLHpWaC_kaQbvwxaw4xQny11jV2eRu0oo-28JKicS39qJy2xjac Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: c3cf6759daf94d11a62a289da64ebe6e Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1133762826 Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:09:01.069377 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c3cf6759daf94d11a62a289da64ebe6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c3cf6759daf94d11a62a289da64ebe6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c3cf6759daf94d11a62a289da64ebe6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c3cf6759daf94d11a62a289da64ebe6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1133762826 Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: c3cf6759daf94d11a62a289da64ebe6e Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1133762826 Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: ad684a9718d545c4ae8e568d755d9f17 Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:09:01.070729 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1'} Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:09:01.072127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:09:01.073224 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.075732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ab93dd5a-a9bd-43bd-bdf8-16a4085e4a26 tempest-HypervisorAdminNegativeUnderV252Test-1133762826 tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.077427 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ab93dd5a-a9bd-43bd-bdf8-16a4085e4a26 tempest-HypervisorAdminNegativeUnderV252Test-1133762826 tempest-HypervisorAdminNegativeUnderV252Test-1133762826-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.029362 Jul 20 04:09:01.079060 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 300/646] 10.222.0.59 () {58 vars in 1175 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:01.084948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f7814f14-215b-4753-b4da-79d6c01fe634 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.085873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f7814f14-215b-4753-b4da-79d6c01fe634 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:01.094320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7814f14-215b-4753-b4da-79d6c01fe634 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.095686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7814f14-215b-4753-b4da-79d6c01fe634 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.097237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7814f14-215b-4753-b4da-79d6c01fe634 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.097915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7814f14-215b-4753-b4da-79d6c01fe634 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.121423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:01.156747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-888385b9-b68f-4fcb-9347-9b5553f4f0e3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.169283 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-888385b9-b68f-4fcb-9347-9b5553f4f0e3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.299825 Jul 20 04:09:01.179881 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 347/647] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:00 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:01.185330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b359b783-93e4-4713-91f9-5169403197b0 req-e2c23b99-42eb-4daa-be8b-a693e00592fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b088ee6-9cad-4386-9ea8-795cd04ee72f", "tag": "52b1fb30-5320-4d6d-b7c9-22304fb2cd16"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:01.194685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b359b783-93e4-4713-91f9-5169403197b0 req-e2c23b99-42eb-4daa-be8b-a693e00592fa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.195657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b359b783-93e4-4713-91f9-5169403197b0 req-e2c23b99-42eb-4daa-be8b-a693e00592fa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.212329 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b359b783-93e4-4713-91f9-5169403197b0 req-e2c23b99-42eb-4daa-be8b-a693e00592fa service nova] Creating event network-changed:52b1fb30-5320-4d6d-b7c9-22304fb2cd16 for instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f on n-h1-760456-11 Jul 20 04:09:01.218367 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b359b783-93e4-4713-91f9-5169403197b0 req-e2c23b99-42eb-4daa-be8b-a693e00592fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036622 Jul 20 04:09:01.219247 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 348/648] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:01.225922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bb15b537-fdb7-4c75-b421-bad8095a31c0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:01.226941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bb15b537-fdb7-4c75-b421-bad8095a31c0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:01.234837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb15b537-fdb7-4c75-b421-bad8095a31c0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.235619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb15b537-fdb7-4c75-b421-bad8095a31c0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.236748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb15b537-fdb7-4c75-b421-bad8095a31c0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.237428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb15b537-fdb7-4c75-b421-bad8095a31c0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.343052 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bb15b537-fdb7-4c75-b421-bad8095a31c0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98/action" status: 204 len: 0 microversion: 2.1 time: 0.120900 Jul 20 04:09:01.344597 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 349/649] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:09:01 2022] POST /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98/action => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:09:01.351869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be81abef-b1dc-4c38-aae6-d6803a5e7239 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Calling method '.version_select at 0x7fb842a3a550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.359466 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:01.359466 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:09:01.361377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f7814f14-215b-4753-b4da-79d6c01fe634 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.364959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be81abef-b1dc-4c38-aae6-d6803a5e7239 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.365612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be81abef-b1dc-4c38-aae6-d6803a5e7239 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.385613 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f7814f14-215b-4753-b4da-79d6c01fe634 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1589 microversion: 2.1 time: 0.305229 Jul 20 04:09:01.389598 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 301/650] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1589 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:01.400006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1353892b-577b-4d7c-a07f-8aa33e3da3a4 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.402148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1353892b-577b-4d7c-a07f-8aa33e3da3a4 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:01.402889 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-be81abef-b1dc-4c38-aae6-d6803a5e7239 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] HTTP exception thrown: No hypervisor matching '5d481947-355d-4f03-a6f9-97375b06f6f2' could be found. Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be81abef-b1dc-4c38-aae6-d6803a5e7239 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Request method failure captured: Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-hypervisors/5d481947-355d-4f03-a6f9-97375b06f6f2/servers HTTP/1.1 Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13_byP1fEF9y7X_MlE7VcJmk3ReSrPrJ5H1_9YM0QQxbgtXPqDHphgYKdIwaJAz2TWRzRFRtwyJgqoWpBTAe2QOpJghxsessigWn0eaTqDko9orNH4A90jPVjEmjtdLnaaWze4zAnFG8_6vrgmUF7Vg1h3QA5goI-Gk-3MGMapD9Oxs Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 67338b5e3dda4d69b4c92f7fbf9310d6 Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1139901641 Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:09:01.409868 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/67338b5e3dda4d69b4c92f7fbf9310d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/67338b5e3dda4d69b4c92f7fbf9310d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/67338b5e3dda4d69b4c92f7fbf9310d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_67338b5e3dda4d69b4c92f7fbf9310d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1139901641 Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 67338b5e3dda4d69b4c92f7fbf9310d6 Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1139901641 Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: ae11413381ac49e9be56a44bc7ab3048 Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: exception: No hypervisor matching '5d481947-355d-4f03-a6f9-97375b06f6f2' could be found. Jul 20 04:09:01.412345 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '5d481947-355d-4f03-a6f9-97375b06f6f2'} Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5d481947-355d-4f03-a6f9-97375b06f6f2' could be found. Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.413569 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:01.415112 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:01.415112 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:01.415112 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:01.415112 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:01.415112 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5d481947-355d-4f03-a6f9-97375b06f6f2' could be found. Jul 20 04:09:01.415112 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:01.415112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be81abef-b1dc-4c38-aae6-d6803a5e7239 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] Returning 404 to user: No hypervisor matching '5d481947-355d-4f03-a6f9-97375b06f6f2' could be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:01.415112 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-be81abef-b1dc-4c38-aae6-d6803a5e7239 tempest-HypervisorAdminNegativeUnderV252Test-1139901641 tempest-HypervisorAdminNegativeUnderV252Test-1139901641-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/5d481947-355d-4f03-a6f9-97375b06f6f2/servers" status: 404 len: 123 microversion: 2.1 time: 0.067104 Jul 20 04:09:01.416588 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 350/651] 10.222.0.59 () {58 vars in 1280 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/os-hypervisors/5d481947-355d-4f03-a6f9-97375b06f6f2/servers => generated 123 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:01.424867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1353892b-577b-4d7c-a07f-8aa33e3da3a4 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.427491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1353892b-577b-4d7c-a07f-8aa33e3da3a4 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.429971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1353892b-577b-4d7c-a07f-8aa33e3da3a4 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.431480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1353892b-577b-4d7c-a07f-8aa33e3da3a4 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.433727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7862a6a0-9512-4525-8536-fb75534878e3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.434576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7862a6a0-9512-4525-8536-fb75534878e3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:01.448601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7862a6a0-9512-4525-8536-fb75534878e3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.452598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7862a6a0-9512-4525-8536-fb75534878e3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.454333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7862a6a0-9512-4525-8536-fb75534878e3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.455652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7862a6a0-9512-4525-8536-fb75534878e3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.509922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=30 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:01.740820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1353892b-577b-4d7c-a07f-8aa33e3da3a4 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.764930 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1353892b-577b-4d7c-a07f-8aa33e3da3a4 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1471 microversion: 2.1 time: 0.371665 Jul 20 04:09:01.765554 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 302/652] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1471 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:01.770137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3125fdc9-5dde-4ffd-9eb7-2a05297b4749 req-6ba913b9-c972-4124-87ff-2e915cb35889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062ae2d5-b44a-4064-aef7-0ab665ad2f5c", "tag": "6f8db406-db7c-4124-b75e-47dbe2c90aab"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:01.784397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3125fdc9-5dde-4ffd-9eb7-2a05297b4749 req-6ba913b9-c972-4124-87ff-2e915cb35889 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.785134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3125fdc9-5dde-4ffd-9eb7-2a05297b4749 req-6ba913b9-c972-4124-87ff-2e915cb35889 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.813588 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3125fdc9-5dde-4ffd-9eb7-2a05297b4749 req-6ba913b9-c972-4124-87ff-2e915cb35889 service nova] Creating event network-changed:6f8db406-db7c-4124-b75e-47dbe2c90aab for instance 062ae2d5-b44a-4064-aef7-0ab665ad2f5c on n-h2-760456-11 Jul 20 04:09:01.823489 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3125fdc9-5dde-4ffd-9eb7-2a05297b4749 req-6ba913b9-c972-4124-87ff-2e915cb35889 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055542 Jul 20 04:09:01.824394 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 303/653] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:01.833420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fd4766c-e96f-494c-967f-88bc50b17965 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:01.834511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1fd4766c-e96f-494c-967f-88bc50b17965 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:01.847137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fd4766c-e96f-494c-967f-88bc50b17965 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.847887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fd4766c-e96f-494c-967f-88bc50b17965 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.848964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fd4766c-e96f-494c-967f-88bc50b17965 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.851611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fd4766c-e96f-494c-967f-88bc50b17965 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.888144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7862a6a0-9512-4525-8536-fb75534878e3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:01.901759 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7862a6a0-9512-4525-8536-fb75534878e3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1471 microversion: 2.1 time: 0.481659 Jul 20 04:09:01.904568 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 351/654] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1471 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:01.924521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d65161d4-433a-49be-853c-150953fedef1 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:01.925222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d65161d4-433a-49be-853c-150953fedef1 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:01.934567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d65161d4-433a-49be-853c-150953fedef1 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.935286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d65161d4-433a-49be-853c-150953fedef1 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.936410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d65161d4-433a-49be-853c-150953fedef1 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:01.937069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d65161d4-433a-49be-853c-150953fedef1 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:01.990455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-d65161d4-433a-49be-853c-150953fedef1 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lazy-loading 'flavor' on Instance uuid dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:02.108067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1fd4766c-e96f-494c-967f-88bc50b17965 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:02.120177 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1fd4766c-e96f-494c-967f-88bc50b17965 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1477 microversion: 2.1 time: 0.288497 Jul 20 04:09:02.134775 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 304/655] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:01 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:02.144221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f3165d5-a794-42ac-866b-f11250c90747 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:02.145083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f3165d5-a794-42ac-866b-f11250c90747 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:02.152812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d65161d4-433a-49be-853c-150953fedef1 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce/action" status: 202 len: 0 microversion: 2.1 time: 0.232942 Jul 20 04:09:02.155381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f3165d5-a794-42ac-866b-f11250c90747 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.158900 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 352/656] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:09:01 2022] POST /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:02.162853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f3165d5-a794-42ac-866b-f11250c90747 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.164654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f3165d5-a794-42ac-866b-f11250c90747 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.167172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f3165d5-a794-42ac-866b-f11250c90747 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.179465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-46830f7c-d921-4e61-ac0d-10eeed9dc768 req-dbb7e85b-e127-4286-b53a-2aca714fdb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca69cf0f-51e1-44c3-b6c7-909906c86a98", "name": "network-vif-plugged", "status": "completed", "tag": "5bb8310e-d16c-408e-835c-86dc238bca54"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:02.201344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-46830f7c-d921-4e61-ac0d-10eeed9dc768 req-dbb7e85b-e127-4286-b53a-2aca714fdb06 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.202739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-46830f7c-d921-4e61-ac0d-10eeed9dc768 req-dbb7e85b-e127-4286-b53a-2aca714fdb06 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.229939 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-46830f7c-d921-4e61-ac0d-10eeed9dc768 req-dbb7e85b-e127-4286-b53a-2aca714fdb06 service nova] Creating event network-vif-plugged:5bb8310e-d16c-408e-835c-86dc238bca54 for instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 on n-h1-760456-11 Jul 20 04:09:02.249377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-46830f7c-d921-4e61-ac0d-10eeed9dc768 req-dbb7e85b-e127-4286-b53a-2aca714fdb06 service nova] Instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:09:02.265902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-46830f7c-d921-4e61-ac0d-10eeed9dc768 req-dbb7e85b-e127-4286-b53a-2aca714fdb06 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102495 Jul 20 04:09:02.281268 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 353/657] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:02.283646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=18 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:02.292086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7d9b273-5784-4616-b41d-6b97c4cea817 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:02.294194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7d9b273-5784-4616-b41d-6b97c4cea817 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:02.296090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f3165d5-a794-42ac-866b-f11250c90747 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:02.303726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7d9b273-5784-4616-b41d-6b97c4cea817 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.304196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7d9b273-5784-4616-b41d-6b97c4cea817 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.304996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7d9b273-5784-4616-b41d-6b97c4cea817 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.306674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7d9b273-5784-4616-b41d-6b97c4cea817 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.319362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f3165d5-a794-42ac-866b-f11250c90747 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:02.321990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f3165d5-a794-42ac-866b-f11250c90747 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:02.328717 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f3165d5-a794-42ac-866b-f11250c90747 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1453 microversion: 2.75 time: 0.192290 Jul 20 04:09:02.330002 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 305/658] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:02 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:02.337239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d96588df-5308-4eba-817e-b16d8a8caeef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:02.338269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d96588df-5308-4eba-817e-b16d8a8caeef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:02.345080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d96588df-5308-4eba-817e-b16d8a8caeef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.345858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d96588df-5308-4eba-817e-b16d8a8caeef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.347034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d96588df-5308-4eba-817e-b16d8a8caeef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.348188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d96588df-5308-4eba-817e-b16d8a8caeef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.699976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d96588df-5308-4eba-817e-b16d8a8caeef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:02.715218 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d96588df-5308-4eba-817e-b16d8a8caeef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.383867 Jul 20 04:09:02.716650 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 306/659] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:02 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:02.926732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-af51db30-5901-49fc-aa74-e6100b3145d9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:02.927851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-af51db30-5901-49fc-aa74-e6100b3145d9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:02.939408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af51db30-5901-49fc-aa74-e6100b3145d9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.939876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af51db30-5901-49fc-aa74-e6100b3145d9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:02.941361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af51db30-5901-49fc-aa74-e6100b3145d9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:02.942443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af51db30-5901-49fc-aa74-e6100b3145d9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:03.166784 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7d9b273-5784-4616-b41d-6b97c4cea817 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1632 microversion: 2.1 time: 0.881760 Jul 20 04:09:03.167453 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 354/660] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:02 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1632 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:03.178476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e5ed19e-5664-4688-ba27-8bbd6587a4eb tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:03.179143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e5ed19e-5664-4688-ba27-8bbd6587a4eb tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:03.197985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e5ed19e-5664-4688-ba27-8bbd6587a4eb tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:03.199165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e5ed19e-5664-4688-ba27-8bbd6587a4eb tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:03.201439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e5ed19e-5664-4688-ba27-8bbd6587a4eb tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:03.203392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e5ed19e-5664-4688-ba27-8bbd6587a4eb tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:03.375857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e5ed19e-5664-4688-ba27-8bbd6587a4eb tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:03.386578 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e5ed19e-5664-4688-ba27-8bbd6587a4eb tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1477 microversion: 2.1 time: 0.216820 Jul 20 04:09:03.387818 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 355/661] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:03 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:03.403605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca8a8366-6325-4c1c-972a-003532ba7fc4 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:03.404225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ca8a8366-6325-4c1c-972a-003532ba7fc4 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:03.409073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-af51db30-5901-49fc-aa74-e6100b3145d9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:03.418070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca8a8366-6325-4c1c-972a-003532ba7fc4 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:03.418568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca8a8366-6325-4c1c-972a-003532ba7fc4 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:03.420812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca8a8366-6325-4c1c-972a-003532ba7fc4 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:03.421478 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-af51db30-5901-49fc-aa74-e6100b3145d9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1471 microversion: 2.1 time: 0.499794 Jul 20 04:09:03.421993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca8a8366-6325-4c1c-972a-003532ba7fc4 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:03.423134 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 307/662] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:02 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1471 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:03.545550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ca8a8366-6325-4c1c-972a-003532ba7fc4 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:03.562227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ca8a8366-6325-4c1c-972a-003532ba7fc4 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:03.564249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ca8a8366-6325-4c1c-972a-003532ba7fc4 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:03.573347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:03.576121 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ca8a8366-6325-4c1c-972a-003532ba7fc4 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1453 microversion: 2.75 time: 0.177759 Jul 20 04:09:03.578152 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 356/663] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:03 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:03.734723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5b3fcf3a-34a0-49d0-a4a7-936650542a26 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:03.737465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5b3fcf3a-34a0-49d0-a4a7-936650542a26 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:03.749827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5b3fcf3a-34a0-49d0-a4a7-936650542a26 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:03.750777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5b3fcf3a-34a0-49d0-a4a7-936650542a26 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:03.752651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5b3fcf3a-34a0-49d0-a4a7-936650542a26 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:03.753431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5b3fcf3a-34a0-49d0-a4a7-936650542a26 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:04.185140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8ea52272-36bd-4010-a0a1-01798fd6bef6 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:04.185876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8ea52272-36bd-4010-a0a1-01798fd6bef6 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:04.212575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ea52272-36bd-4010-a0a1-01798fd6bef6 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:04.213415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ea52272-36bd-4010-a0a1-01798fd6bef6 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:04.214391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ea52272-36bd-4010-a0a1-01798fd6bef6 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:04.214995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ea52272-36bd-4010-a0a1-01798fd6bef6 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:04.265981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5b3fcf3a-34a0-49d0-a4a7-936650542a26 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:04.273944 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5b3fcf3a-34a0-49d0-a4a7-936650542a26 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.543175 Jul 20 04:09:04.280284 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 308/664] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:03 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:04.329520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-15d16c5d-554c-466f-8e77-ec34f25cdce6 req-066e93ba-f409-4d62-afcb-8f3a8ef90e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288f952b-81ce-419b-9907-96b8b0db1d30", "name": "network-vif-unplugged", "status": "completed", "tag": "c9911200-3c1e-4fb4-81b5-e7aed1a55549"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:04.350197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-15d16c5d-554c-466f-8e77-ec34f25cdce6 req-066e93ba-f409-4d62-afcb-8f3a8ef90e4f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:04.351019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-15d16c5d-554c-466f-8e77-ec34f25cdce6 req-066e93ba-f409-4d62-afcb-8f3a8ef90e4f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:04.373594 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-15d16c5d-554c-466f-8e77-ec34f25cdce6 req-066e93ba-f409-4d62-afcb-8f3a8ef90e4f service nova] Creating event network-vif-unplugged:c9911200-3c1e-4fb4-81b5-e7aed1a55549 for instance 288f952b-81ce-419b-9907-96b8b0db1d30 on n-h1-760456-11 Jul 20 04:09:04.379268 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-15d16c5d-554c-466f-8e77-ec34f25cdce6 req-066e93ba-f409-4d62-afcb-8f3a8ef90e4f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053418 Jul 20 04:09:04.380126 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 309/665] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:09:04.405622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01122a77-c6df-4f4d-b344-e3a05772e6f1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:04.406719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-01122a77-c6df-4f4d-b344-e3a05772e6f1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:04.417111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01122a77-c6df-4f4d-b344-e3a05772e6f1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:04.420299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01122a77-c6df-4f4d-b344-e3a05772e6f1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:04.425151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01122a77-c6df-4f4d-b344-e3a05772e6f1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:04.425765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01122a77-c6df-4f4d-b344-e3a05772e6f1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:04.664020 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8ea52272-36bd-4010-a0a1-01798fd6bef6 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1615 microversion: 2.1 time: 0.482882 Jul 20 04:09:04.664679 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 357/666] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:04 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1615 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:04.672952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d8e0fd1-3c7c-4253-b6f0-61757757a314 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:04.675744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d8e0fd1-3c7c-4253-b6f0-61757757a314 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:04.690807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d8e0fd1-3c7c-4253-b6f0-61757757a314 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:04.691275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d8e0fd1-3c7c-4253-b6f0-61757757a314 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:04.692078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d8e0fd1-3c7c-4253-b6f0-61757757a314 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:04.692521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d8e0fd1-3c7c-4253-b6f0-61757757a314 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:04.909014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-01122a77-c6df-4f4d-b344-e3a05772e6f1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:04.923013 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01122a77-c6df-4f4d-b344-e3a05772e6f1 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1477 microversion: 2.1 time: 0.521659 Jul 20 04:09:04.923599 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 310/667] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:04 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1477 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:04.928274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd93c3b9-11eb-425c-b5b8-47c6e2d0fbb6 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:04.928876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd93c3b9-11eb-425c-b5b8-47c6e2d0fbb6 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:04.947639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd93c3b9-11eb-425c-b5b8-47c6e2d0fbb6 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:04.948318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd93c3b9-11eb-425c-b5b8-47c6e2d0fbb6 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:04.949439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd93c3b9-11eb-425c-b5b8-47c6e2d0fbb6 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:04.950025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd93c3b9-11eb-425c-b5b8-47c6e2d0fbb6 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:05.047417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d8e0fd1-3c7c-4253-b6f0-61757757a314 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:05.058977 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d8e0fd1-3c7c-4253-b6f0-61757757a314 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1471 microversion: 2.1 time: 0.389647 Jul 20 04:09:05.059580 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 358/668] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:04 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1471 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:05.083236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7cd64695-d9aa-4d06-9255-ec16bd99e685 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:05.084448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7cd64695-d9aa-4d06-9255-ec16bd99e685 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:05.117093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7cd64695-d9aa-4d06-9255-ec16bd99e685 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:05.117717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7cd64695-d9aa-4d06-9255-ec16bd99e685 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:05.120821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7cd64695-d9aa-4d06-9255-ec16bd99e685 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:05.123944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7cd64695-d9aa-4d06-9255-ec16bd99e685 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:05.235118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:05.242674 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-7cd64695-d9aa-4d06-9255-ec16bd99e685 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] HTTP exception thrown: Cannot 'migrate' instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce while it is in vm_state suspended Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7cd64695-d9aa-4d06-9255-ec16bd99e685 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Request method failure captured: Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce/action HTTP/1.1 Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 15 Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-zVhkxkcGc6ksPswVwKbGcyYv1ie1_2AKROrVjFO7NcfuX2oi58J-nIvZccq_lXArWWQWXqiNd13VC1YhlZr2F9vBt9EngMA7llkAhnie2fOEl1mpKemFuh6T5miEIJnUQwW7lOw0nS7igWS4rAVk2_8qnVj6gqREC8qCS1lClF5A Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: f62093bb50234aeabc90e2e7a81e7d84 Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:09:05.244983 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: f62093bb50234aeabc90e2e7a81e7d84 Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersAdminNegativeTestJSON-709480980-project-admin Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: fedd7bfc3d894d519910a510b6305c88 Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersAdminNegativeTestJSON-709480980-project-admin Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: {"migrate": {}} Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:09:05.246668 n-d-760456-11 devstack@n-api.service[119606]: exception: Cannot 'migrate' instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce while it is in vm_state suspended Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce', 'body': {'migrate': {}}} Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce in vm_state suspended. Cannot resize while the instance is in this state. Jul 20 04:09:05.247708 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce while it is in vm_state suspended Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.249088 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:05.250585 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:05.250585 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:05.250585 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:05.250585 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:05.250585 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce while it is in vm_state suspended Jul 20 04:09:05.250585 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.255465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7cd64695-d9aa-4d06-9255-ec16bd99e685 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Returning 409 to user: Cannot 'migrate' instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce while it is in vm_state suspended {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:05.257107 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7cd64695-d9aa-4d06-9255-ec16bd99e685 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce/action" status: 409 len: 148 microversion: 2.1 time: 0.184012 Jul 20 04:09:05.258936 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 359/669] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:09:05 2022] POST /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce/action => generated 148 bytes in 198 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:05.275015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da3239d9-e81d-4d11-963c-9486f6368a80 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da3239d9-e81d-4d11-963c-9486f6368a80 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Request method failure captured: Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b/action HTTP/1.1 Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 39 Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-zVhkxkcGc6ksPswVwKbGcyYv1ie1_2AKROrVjFO7NcfuX2oi58J-nIvZccq_lXArWWQWXqiNd13VC1YhlZr2F9vBt9EngMA7llkAhnie2fOEl1mpKemFuh6T5miEIJnUQwW7lOw0nS7igWS4rAVk2_8qnVj6gqREC8qCS1lClF5A Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: f62093bb50234aeabc90e2e7a81e7d84 Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:09:05.278689 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: f62093bb50234aeabc90e2e7a81e7d84 Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersAdminNegativeTestJSON-709480980-project-admin Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: fedd7bfc3d894d519910a510b6305c88 Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersAdminNegativeTestJSON-709480980-project-admin Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: {"os-resetState": {"state": "invalid"}} Jul 20 04:09:05.279987 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '76c35632-c082-43bc-9d83-85fa2dce4b5b', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:05.280706 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:09:05.281977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:09:05.283415 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.283799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da3239d9-e81d-4d11-963c-9486f6368a80 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:05.284682 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-da3239d9-e81d-4d11-963c-9486f6368a80 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b/action" status: 400 len: 144 microversion: 2.1 time: 0.017788 Jul 20 04:09:05.299019 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 360/670] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:09:05 2022] POST /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b/action => generated 144 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:09:05.313319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d946f1c-8913-4a3c-be5b-3a2cb9d77768 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:05.314363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7d946f1c-8913-4a3c-be5b-3a2cb9d77768 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:05.332124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d946f1c-8913-4a3c-be5b-3a2cb9d77768 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:05.333116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d946f1c-8913-4a3c-be5b-3a2cb9d77768 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:05.334855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d946f1c-8913-4a3c-be5b-3a2cb9d77768 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:05.335503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d946f1c-8913-4a3c-be5b-3a2cb9d77768 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:05.551675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd93c3b9-11eb-425c-b5b8-47c6e2d0fbb6 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:05.566324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd93c3b9-11eb-425c-b5b8-47c6e2d0fbb6 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:05.568062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd93c3b9-11eb-425c-b5b8-47c6e2d0fbb6 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:05.574195 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd93c3b9-11eb-425c-b5b8-47c6e2d0fbb6 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1438 microversion: 2.75 time: 0.649507 Jul 20 04:09:05.577543 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 311/671] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:04 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1438 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:05.582614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7328089b-bdc9-47e9-bc32-6f522d16e6f9 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7328089b-bdc9-47e9-bc32-6f522d16e6f9 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Request method failure captured: Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b/action HTTP/1.1 Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 31 Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-zVhkxkcGc6ksPswVwKbGcyYv1ie1_2AKROrVjFO7NcfuX2oi58J-nIvZccq_lXArWWQWXqiNd13VC1YhlZr2F9vBt9EngMA7llkAhnie2fOEl1mpKemFuh6T5miEIJnUQwW7lOw0nS7igWS4rAVk2_8qnVj6gqREC8qCS1lClF5A Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: f62093bb50234aeabc90e2e7a81e7d84 Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:09:05.588938 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: f62093bb50234aeabc90e2e7a81e7d84 Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersAdminNegativeTestJSON-709480980-project-admin Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: fedd7bfc3d894d519910a510b6305c88 Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersAdminNegativeTestJSON-709480980-project-admin Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: {"os-resetState": {"state": 1}} Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:09:05.590237 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '76c35632-c082-43bc-9d83-85fa2dce4b5b', 'body': {'os-resetState': {'state': 1}}} Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 1 Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:05.591176 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:09:05.593152 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:05.595729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7328089b-bdc9-47e9-bc32-6f522d16e6f9 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:05.596691 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7328089b-bdc9-47e9-bc32-6f522d16e6f9 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b/action" status: 400 len: 120 microversion: 2.1 time: 0.017749 Jul 20 04:09:05.599620 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 312/672] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:09:05 2022] POST /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b/action => generated 120 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:09:05.885921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:05.887740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:05.895949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:05.896775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:05.898205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:05.903094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.023082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:06.023700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:06.023918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:06.024500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:06.025087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:06.114543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:06.133376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7d946f1c-8913-4a3c-be5b-3a2cb9d77768 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:06.136629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.139664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.143560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.145149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.145992 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d946f1c-8913-4a3c-be5b-3a2cb9d77768 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.845433 Jul 20 04:09:06.157870 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 361/673] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:05 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:06.163067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-950987f1-4ee8-4089-9291-281f7529de15 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:06.171896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-950987f1-4ee8-4089-9291-281f7529de15 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Failed to fetch instance by id 999 {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:09:06.172768 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-950987f1-4ee8-4089-9291-281f7529de15 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-950987f1-4ee8-4089-9291-281f7529de15 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Request method failure captured: Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 37 Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-zVhkxkcGc6ksPswVwKbGcyYv1ie1_2AKROrVjFO7NcfuX2oi58J-nIvZccq_lXArWWQWXqiNd13VC1YhlZr2F9vBt9EngMA7llkAhnie2fOEl1mpKemFuh6T5miEIJnUQwW7lOw0nS7igWS4rAVk2_8qnVj6gqREC8qCS1lClF5A Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: f62093bb50234aeabc90e2e7a81e7d84 Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:09:06.176204 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f62093bb50234aeabc90e2e7a81e7d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: f62093bb50234aeabc90e2e7a81e7d84 Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-709480980 Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersAdminNegativeTestJSON-709480980-project-admin Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: fedd7bfc3d894d519910a510b6305c88 Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersAdminNegativeTestJSON-709480980-project-admin Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: {"os-resetState": {"state": "error"}} Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:09:06.177500 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 999 could not be found. Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:09:06.178712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 20 04:09:06.180637 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:06.193259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-950987f1-4ee8-4089-9291-281f7529de15 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:06.196898 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-950987f1-4ee8-4089-9291-281f7529de15 tempest-ServersAdminNegativeTestJSON-709480980 tempest-ServersAdminNegativeTestJSON-709480980-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.035414 Jul 20 04:09:06.201701 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 362/674] 10.222.0.59 () {60 vars in 1178 bytes} [Wed Jul 20 04:09:06 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:09:06.207147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0e1ccbc4-7400-4b6b-8170-904d59c188e9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:06.207880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0e1ccbc4-7400-4b6b-8170-904d59c188e9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:06.223406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0e1ccbc4-7400-4b6b-8170-904d59c188e9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.224062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0e1ccbc4-7400-4b6b-8170-904d59c188e9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.226158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0e1ccbc4-7400-4b6b-8170-904d59c188e9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.230891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0e1ccbc4-7400-4b6b-8170-904d59c188e9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.439609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:06.535694 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-54406401-fa3a-41fe-8bd3-9e40ddc4c27a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee/action" status: 202 len: 1944 microversion: 2.75 time: 0.934933 Jul 20 04:09:06.536409 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 313/675] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:09:05 2022] POST /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee/action => generated 1944 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:09:06.541982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4419cb59-bcb8-4e93-8473-880e226e454f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:06.542855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4419cb59-bcb8-4e93-8473-880e226e454f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:06.554210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4419cb59-bcb8-4e93-8473-880e226e454f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.556914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4419cb59-bcb8-4e93-8473-880e226e454f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.563826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4419cb59-bcb8-4e93-8473-880e226e454f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.565513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4419cb59-bcb8-4e93-8473-880e226e454f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.792481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4419cb59-bcb8-4e93-8473-880e226e454f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:06.796992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:06.810776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4419cb59-bcb8-4e93-8473-880e226e454f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1471 microversion: 2.1 time: 0.272705 Jul 20 04:09:06.812156 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 314/676] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:06 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:06.815294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0e1ccbc4-7400-4b6b-8170-904d59c188e9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:06.828665 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0e1ccbc4-7400-4b6b-8170-904d59c188e9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1477 microversion: 2.1 time: 0.624319 Jul 20 04:09:06.828920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-54a60e4d-302a-4fc7-a5f9-108c01acdab7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:06.829422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-54a60e4d-302a-4fc7-a5f9-108c01acdab7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:06.829539 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 363/677] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:06 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1477 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:06.838636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d4d53a8f-e587-477e-a70d-1cb798c86fe4 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:06.845936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d4d53a8f-e587-477e-a70d-1cb798c86fe4 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:06.846540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a60e4d-302a-4fc7-a5f9-108c01acdab7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.846996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a60e4d-302a-4fc7-a5f9-108c01acdab7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.849462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a60e4d-302a-4fc7-a5f9-108c01acdab7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.850081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a60e4d-302a-4fc7-a5f9-108c01acdab7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.873278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4d53a8f-e587-477e-a70d-1cb798c86fe4 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.883011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4d53a8f-e587-477e-a70d-1cb798c86fe4 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:06.884091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-54a60e4d-302a-4fc7-a5f9-108c01acdab7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:09:06.884785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4d53a8f-e587-477e-a70d-1cb798c86fe4 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:06.885350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4d53a8f-e587-477e-a70d-1cb798c86fe4 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.063343 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-54a60e4d-302a-4fc7-a5f9-108c01acdab7 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 204 len: 0 microversion: 2.1 time: 0.246471 Jul 20 04:09:07.064365 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 315/678] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:09:06 2022] DELETE /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:09:07.073378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ff194aac-f78f-4566-a078-fb22e8ef39ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.074154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ff194aac-f78f-4566-a078-fb22e8ef39ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:07.082030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff194aac-f78f-4566-a078-fb22e8ef39ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.082801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff194aac-f78f-4566-a078-fb22e8ef39ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.084210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff194aac-f78f-4566-a078-fb22e8ef39ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.084793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff194aac-f78f-4566-a078-fb22e8ef39ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.088417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-d4d53a8f-e587-477e-a70d-1cb798c86fe4 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:07.200028 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d4d53a8f-e587-477e-a70d-1cb798c86fe4 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.368527 Jul 20 04:09:07.201130 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 364/679] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:06 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:07.212022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e512fd3e-54ba-4d9d-87c9-757c6381a4be tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.212910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e512fd3e-54ba-4d9d-87c9-757c6381a4be tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:07.222320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e512fd3e-54ba-4d9d-87c9-757c6381a4be tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.223737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e512fd3e-54ba-4d9d-87c9-757c6381a4be tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.225204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e512fd3e-54ba-4d9d-87c9-757c6381a4be tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.226220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e512fd3e-54ba-4d9d-87c9-757c6381a4be tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.256344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ff194aac-f78f-4566-a078-fb22e8ef39ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:07.267788 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ff194aac-f78f-4566-a078-fb22e8ef39ff tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1468 microversion: 2.1 time: 0.198706 Jul 20 04:09:07.275218 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 316/680] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:07 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:07.536252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e512fd3e-54ba-4d9d-87c9-757c6381a4be tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:07.553178 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e512fd3e-54ba-4d9d-87c9-757c6381a4be tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.344494 Jul 20 04:09:07.554091 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 365/681] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:07 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:07.829168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4797e32d-068a-4410-a8bf-93b8d8c4c5d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.829783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4797e32d-068a-4410-a8bf-93b8d8c4c5d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:07.836762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4797e32d-068a-4410-a8bf-93b8d8c4c5d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.837980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4797e32d-068a-4410-a8bf-93b8d8c4c5d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.839527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4797e32d-068a-4410-a8bf-93b8d8c4c5d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.841697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4797e32d-068a-4410-a8bf-93b8d8c4c5d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.854492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-24780426-7cde-4e46-a65b-42fd171f0ff9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:07.863883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-24780426-7cde-4e46-a65b-42fd171f0ff9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:07.890919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24780426-7cde-4e46-a65b-42fd171f0ff9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.891519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24780426-7cde-4e46-a65b-42fd171f0ff9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:07.892531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24780426-7cde-4e46-a65b-42fd171f0ff9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:07.893082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24780426-7cde-4e46-a65b-42fd171f0ff9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.309437 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4797e32d-068a-4410-a8bf-93b8d8c4c5d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:08.326169 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4797e32d-068a-4410-a8bf-93b8d8c4c5d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1463 microversion: 2.1 time: 0.501052 Jul 20 04:09:08.339118 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 317/682] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:07 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1463 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:08.351715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ddd99aaf-bb74-4c90-8f26-8ef578812e81 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:08.353956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ddd99aaf-bb74-4c90-8f26-8ef578812e81 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:08.364564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddd99aaf-bb74-4c90-8f26-8ef578812e81 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.365348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddd99aaf-bb74-4c90-8f26-8ef578812e81 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.367273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddd99aaf-bb74-4c90-8f26-8ef578812e81 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.370158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddd99aaf-bb74-4c90-8f26-8ef578812e81 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.389831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-24780426-7cde-4e46-a65b-42fd171f0ff9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:08.400683 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-24780426-7cde-4e46-a65b-42fd171f0ff9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1477 microversion: 2.1 time: 0.555795 Jul 20 04:09:08.405459 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 366/683] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:07 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1477 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:08.420941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6069e2dc-ddf1-492f-a1df-921e194722bb tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:08.426904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6069e2dc-ddf1-492f-a1df-921e194722bb tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:08.441766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6069e2dc-ddf1-492f-a1df-921e194722bb tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.442572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6069e2dc-ddf1-492f-a1df-921e194722bb tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.443578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6069e2dc-ddf1-492f-a1df-921e194722bb tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.444226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6069e2dc-ddf1-492f-a1df-921e194722bb tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.585845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-ddd99aaf-bb74-4c90-8f26-8ef578812e81 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:08.633936 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ddd99aaf-bb74-4c90-8f26-8ef578812e81 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.291261 Jul 20 04:09:08.636279 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 318/684] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:08 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:08.645703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-46f69bf3-a199-43a9-ae96-7d7abfacacf0 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:08.648229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-46f69bf3-a199-43a9-ae96-7d7abfacacf0 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:08.664964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f69bf3-a199-43a9-ae96-7d7abfacacf0 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.665424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f69bf3-a199-43a9-ae96-7d7abfacacf0 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.673410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f69bf3-a199-43a9-ae96-7d7abfacacf0 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.673898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f69bf3-a199-43a9-ae96-7d7abfacacf0 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.892380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6069e2dc-ddf1-492f-a1df-921e194722bb tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:08.904228 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6069e2dc-ddf1-492f-a1df-921e194722bb tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1468 microversion: 2.1 time: 0.497116 Jul 20 04:09:08.915986 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 367/685] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:08 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1468 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:08.924245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2357edc8-2e99-41af-9bb9-cf1ecb41706e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:08.936654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2357edc8-2e99-41af-9bb9-cf1ecb41706e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:08.960332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2357edc8-2e99-41af-9bb9-cf1ecb41706e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.962376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2357edc8-2e99-41af-9bb9-cf1ecb41706e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:08.965697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2357edc8-2e99-41af-9bb9-cf1ecb41706e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:08.968272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2357edc8-2e99-41af-9bb9-cf1ecb41706e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.036639 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-46f69bf3-a199-43a9-ae96-7d7abfacacf0 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1616 microversion: 2.1 time: 0.399083 Jul 20 04:09:09.039997 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 319/686] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:08 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1616 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:09.056918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b6eb5b7e-892a-496a-a7c1-f2686f176a4e req-81ec613c-1a57-40f6-a3d0-1b6783ff690c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288f952b-81ce-419b-9907-96b8b0db1d30", "name": "network-vif-plugged", "status": "completed", "tag": "c9911200-3c1e-4fb4-81b5-e7aed1a55549"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:09.080070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b6eb5b7e-892a-496a-a7c1-f2686f176a4e req-81ec613c-1a57-40f6-a3d0-1b6783ff690c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.080752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b6eb5b7e-892a-496a-a7c1-f2686f176a4e req-81ec613c-1a57-40f6-a3d0-1b6783ff690c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.113197 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b6eb5b7e-892a-496a-a7c1-f2686f176a4e req-81ec613c-1a57-40f6-a3d0-1b6783ff690c service nova] Creating event network-vif-plugged:c9911200-3c1e-4fb4-81b5-e7aed1a55549 for instance 288f952b-81ce-419b-9907-96b8b0db1d30 on n-h1-760456-11 Jul 20 04:09:09.120850 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b6eb5b7e-892a-496a-a7c1-f2686f176a4e req-81ec613c-1a57-40f6-a3d0-1b6783ff690c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075354 Jul 20 04:09:09.121476 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 320/687] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:09.169745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2f3b57f8-fe60-4380-8e08-86422f5c67a3 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '.version_select at 0x7fb8424d5ee0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:09.176275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f3b57f8-fe60-4380-8e08-86422f5c67a3 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.177617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f3b57f8-fe60-4380-8e08-86422f5c67a3 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.221299 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2f3b57f8-fe60-4380-8e08-86422f5c67a3 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.097044 Jul 20 04:09:09.222458 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 321/688] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:09:09 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:09.380404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2357edc8-2e99-41af-9bb9-cf1ecb41706e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:09.395448 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2357edc8-2e99-41af-9bb9-cf1ecb41706e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.477655 Jul 20 04:09:09.411845 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 368/689] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:08 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:09.421105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4598e970-9d88-4933-9fc9-9d81f281bcee tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:09.421854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4598e970-9d88-4933-9fc9-9d81f281bcee tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:09.433273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-364298430", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:09.456042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4598e970-9d88-4933-9fc9-9d81f281bcee tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.457504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4598e970-9d88-4933-9fc9-9d81f281bcee tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.462374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4598e970-9d88-4933-9fc9-9d81f281bcee tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.463742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4598e970-9d88-4933-9fc9-9d81f281bcee tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.549998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:09:09.923187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4598e970-9d88-4933-9fc9-9d81f281bcee tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:09.933331 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4598e970-9d88-4933-9fc9-9d81f281bcee tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1477 microversion: 2.1 time: 0.516042 Jul 20 04:09:09.933928 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 322/690] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:09 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1477 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:09.948093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7aebd5d2-a871-4642-992d-55e706d9bf56 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:09.952173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7aebd5d2-a871-4642-992d-55e706d9bf56 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:09.969115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7aebd5d2-a871-4642-992d-55e706d9bf56 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.969837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7aebd5d2-a871-4642-992d-55e706d9bf56 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:09.971076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7aebd5d2-a871-4642-992d-55e706d9bf56 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:09.971710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7aebd5d2-a871-4642-992d-55e706d9bf56 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.109961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-7aebd5d2-a871-4642-992d-55e706d9bf56 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:10.172425 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7aebd5d2-a871-4642-992d-55e706d9bf56 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.237355 Jul 20 04:09:10.189457 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 323/691] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:09 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:10.207991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7a749908-7c82-4b8a-a445-ffdae9024ce5 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:10.215501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7a749908-7c82-4b8a-a445-ffdae9024ce5 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:10.227961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a749908-7c82-4b8a-a445-ffdae9024ce5 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:10.228638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a749908-7c82-4b8a-a445-ffdae9024ce5 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.229601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a749908-7c82-4b8a-a445-ffdae9024ce5 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:10.230206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a749908-7c82-4b8a-a445-ffdae9024ce5 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.451140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7a749908-7c82-4b8a-a445-ffdae9024ce5 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:10.466166 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7a749908-7c82-4b8a-a445-ffdae9024ce5 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 200 len: 1426 microversion: 2.1 time: 0.275499 Jul 20 04:09:10.474290 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 324/692] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:10 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 1426 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:10.479629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7da9d30e-5fe1-4475-8552-9dd5b5cf8cb6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:10.485025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7da9d30e-5fe1-4475-8552-9dd5b5cf8cb6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:10.497933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7da9d30e-5fe1-4475-8552-9dd5b5cf8cb6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:10.498430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7da9d30e-5fe1-4475-8552-9dd5b5cf8cb6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.506880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7da9d30e-5fe1-4475-8552-9dd5b5cf8cb6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:10.507350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7da9d30e-5fe1-4475-8552-9dd5b5cf8cb6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.556324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:10.558678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:10.559376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:10.559951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:10.560531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:10.593543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:10.594562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.595679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:10.600454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.653984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:10.668245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for user e82ac4df5f844ec4996d939efdba9c11 and project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:10.705435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:09:10.708226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:09:10.825513 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3026e78e-e184-4205-a8ff-e03f026ae164 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.401138 Jul 20 04:09:10.832255 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 369/693] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:09:10.848196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8932225f-2abe-4677-896a-362ba5a1fda0 req-1e453dd7-96d7-433e-9b6b-b35cf58c5a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce", "name": "network-vif-deleted", "tag": "ea703066-f1db-43b5-b21f-a36b77b5d994"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:10.902521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8932225f-2abe-4677-896a-362ba5a1fda0 req-1e453dd7-96d7-433e-9b6b-b35cf58c5a82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:10.902922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8932225f-2abe-4677-896a-362ba5a1fda0 req-1e453dd7-96d7-433e-9b6b-b35cf58c5a82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:10.934611 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8932225f-2abe-4677-896a-362ba5a1fda0 req-1e453dd7-96d7-433e-9b6b-b35cf58c5a82 service nova] Creating event network-vif-deleted:ea703066-f1db-43b5-b21f-a36b77b5d994 for instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce on n-h2-760456-11 Jul 20 04:09:10.947366 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8932225f-2abe-4677-896a-362ba5a1fda0 req-1e453dd7-96d7-433e-9b6b-b35cf58c5a82 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113624 Jul 20 04:09:10.950978 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 370/694] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:10.962089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ea3c96b-e2cf-4443-8058-bd676fc654d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:10.970781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2ea3c96b-e2cf-4443-8058-bd676fc654d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:11.105044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7da9d30e-5fe1-4475-8552-9dd5b5cf8cb6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:11.117225 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7da9d30e-5fe1-4475-8552-9dd5b5cf8cb6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.641507 Jul 20 04:09:11.124506 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 325/695] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:10 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:11.132480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a953e33a-c2fc-4070-8c52-5d83ffabcf17 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.134984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a953e33a-c2fc-4070-8c52-5d83ffabcf17 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:11.160256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a953e33a-c2fc-4070-8c52-5d83ffabcf17 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.163045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a953e33a-c2fc-4070-8c52-5d83ffabcf17 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.165827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a953e33a-c2fc-4070-8c52-5d83ffabcf17 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.168717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a953e33a-c2fc-4070-8c52-5d83ffabcf17 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.203631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2ea3c96b-e2cf-4443-8058-bd676fc654d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:11.221926 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ea3c96b-e2cf-4443-8058-bd676fc654d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1212 microversion: 2.1 time: 0.260688 Jul 20 04:09:11.223014 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 371/696] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:10 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1212 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:11.238289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4cb88ab1-b6a2-4323-939a-7f26e3bb7ccc tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.238974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4cb88ab1-b6a2-4323-939a-7f26e3bb7ccc tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:11.267372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cb88ab1-b6a2-4323-939a-7f26e3bb7ccc tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.272159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cb88ab1-b6a2-4323-939a-7f26e3bb7ccc tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.273123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cb88ab1-b6a2-4323-939a-7f26e3bb7ccc tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.273589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cb88ab1-b6a2-4323-939a-7f26e3bb7ccc tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.547704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-4cb88ab1-b6a2-4323-939a-7f26e3bb7ccc tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:11.560366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a953e33a-c2fc-4070-8c52-5d83ffabcf17 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:11.572500 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4cb88ab1-b6a2-4323-939a-7f26e3bb7ccc tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.345978 Jul 20 04:09:11.573042 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a953e33a-c2fc-4070-8c52-5d83ffabcf17 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1463 microversion: 2.1 time: 0.444454 Jul 20 04:09:11.573587 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 326/697] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1463 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:11.582366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-bf1230eb-f1ed-4748-8933-30a00db45571 req-35a679de-119d-4459-9535-999d34d69aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808c1a0c-c593-4ae9-8816-bd7d884a7943", "name": "network-vif-plugged", "status": "completed", "tag": "514d5015-3418-492f-a8e4-09fc0c38b9b9"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:11.595678 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 372/698] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:11.609306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-de9a6a7c-669e-465c-8793-2fddc746f597 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.611377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-de9a6a7c-669e-465c-8793-2fddc746f597 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:11.623292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-de9a6a7c-669e-465c-8793-2fddc746f597 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.625330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bf1230eb-f1ed-4748-8933-30a00db45571 req-35a679de-119d-4459-9535-999d34d69aca service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.626301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bf1230eb-f1ed-4748-8933-30a00db45571 req-35a679de-119d-4459-9535-999d34d69aca service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.629564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-de9a6a7c-669e-465c-8793-2fddc746f597 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.630724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-de9a6a7c-669e-465c-8793-2fddc746f597 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.633981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-de9a6a7c-669e-465c-8793-2fddc746f597 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.656688 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-bf1230eb-f1ed-4748-8933-30a00db45571 req-35a679de-119d-4459-9535-999d34d69aca service nova] Creating event network-vif-plugged:514d5015-3418-492f-a8e4-09fc0c38b9b9 for instance 808c1a0c-c593-4ae9-8816-bd7d884a7943 on n-h2-760456-11 Jul 20 04:09:11.667785 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-bf1230eb-f1ed-4748-8933-30a00db45571 req-35a679de-119d-4459-9535-999d34d69aca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092893 Jul 20 04:09:11.669120 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-de9a6a7c-669e-465c-8793-2fddc746f597 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] HTTP exception thrown: Instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce could not be found. Jul 20 04:09:11.670138 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 327/699] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-de9a6a7c-669e-465c-8793-2fddc746f597 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Request method failure captured: Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce HTTP/1.1 Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-y0OMD6Z89ORTn4VpsZUsT0KlZZ0WIGVyNKHGH6PufNilMNeeB-GQyfdvjRJ4z7gVBjkvVfBzCtb4A0Fr-X97xpgyx0SDKsL8yjjyAryDOTAP4yaNgKk0Zibjd9kwsbuHFeZ40Pz7L0-WBEFJbOrcnTsWJJ3u9wekguC3egMMucXk Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 630a6840350545b297f7acdc4de59765 Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-963763775 Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:09:11.675036 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/630a6840350545b297f7acdc4de59765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/630a6840350545b297f7acdc4de59765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/630a6840350545b297f7acdc4de59765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_630a6840350545b297f7acdc4de59765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersAdminNegativeTestJSON-963763775 Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 630a6840350545b297f7acdc4de59765 Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-963763775 Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersAdminNegativeTestJSON-963763775-project Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8081d25eaba743f69815051eec36d2a3 Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersAdminNegativeTestJSON-963763775-project Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce could not be found. Jul 20 04:09:11.676422 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce'} Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce could not be found. Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:11.677619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce could not be found. Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce could not be found. Jul 20 04:09:11.678805 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:11.683736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-de9a6a7c-669e-465c-8793-2fddc746f597 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Returning 404 to user: Instance dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:11.685619 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-de9a6a7c-669e-465c-8793-2fddc746f597 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce" status: 404 len: 111 microversion: 2.1 time: 0.087644 Jul 20 04:09:11.688228 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 373/700] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/servers/dfa50b59-9cd9-4c36-b5f2-ce5bf4326fce => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:11.689838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-208d9e55-a1e8-4881-af92-8a13d4204a14 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.709841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37aeb80c-9439-4774-a8a2-51a3c801db12 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:11.710561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-208d9e55-a1e8-4881-af92-8a13d4204a14 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:11.719535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37aeb80c-9439-4774-a8a2-51a3c801db12 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:11.732654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:11.738783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-208d9e55-a1e8-4881-af92-8a13d4204a14 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.743240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-208d9e55-a1e8-4881-af92-8a13d4204a14 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.744717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-208d9e55-a1e8-4881-af92-8a13d4204a14 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.745329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-208d9e55-a1e8-4881-af92-8a13d4204a14 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.747485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37aeb80c-9439-4774-a8a2-51a3c801db12 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.749756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37aeb80c-9439-4774-a8a2-51a3c801db12 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.753603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37aeb80c-9439-4774-a8a2-51a3c801db12 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:11.756582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37aeb80c-9439-4774-a8a2-51a3c801db12 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:11.846777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37aeb80c-9439-4774-a8a2-51a3c801db12 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:09:12.038599 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37aeb80c-9439-4774-a8a2-51a3c801db12 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "DELETE /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 204 len: 0 microversion: 2.1 time: 0.335571 Jul 20 04:09:12.041347 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 374/701] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:09:11 2022] DELETE /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:09:12.052200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d5c44d2-f996-4755-b6a2-7ba3e4afaf39 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:12.052743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7d5c44d2-f996-4755-b6a2-7ba3e4afaf39 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:12.064719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d5c44d2-f996-4755-b6a2-7ba3e4afaf39 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.065330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d5c44d2-f996-4755-b6a2-7ba3e4afaf39 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.066919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d5c44d2-f996-4755-b6a2-7ba3e4afaf39 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.067405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d5c44d2-f996-4755-b6a2-7ba3e4afaf39 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.265066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-208d9e55-a1e8-4881-af92-8a13d4204a14 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:12.275149 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-208d9e55-a1e8-4881-af92-8a13d4204a14 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1463 microversion: 2.1 time: 0.603533 Jul 20 04:09:12.280554 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 328/702] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:11 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1463 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:12.292464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-154d607b-d939-49b8-a721-70113986d8a6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:12.293620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-154d607b-d939-49b8-a721-70113986d8a6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:12.324276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-154d607b-d939-49b8-a721-70113986d8a6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.326954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-154d607b-d939-49b8-a721-70113986d8a6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.327973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-154d607b-d939-49b8-a721-70113986d8a6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.328595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-154d607b-d939-49b8-a721-70113986d8a6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.452054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7d5c44d2-f996-4755-b6a2-7ba3e4afaf39 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:12.462979 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d5c44d2-f996-4755-b6a2-7ba3e4afaf39 tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1477 microversion: 2.1 time: 0.416996 Jul 20 04:09:12.474423 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 375/703] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:12 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1477 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:12.481412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9933f98a-4d43-441a-b310-870afc39f1ba tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:12.482028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9933f98a-4d43-441a-b310-870afc39f1ba tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:12.488573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9933f98a-4d43-441a-b310-870afc39f1ba tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.489029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9933f98a-4d43-441a-b310-870afc39f1ba tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.489874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9933f98a-4d43-441a-b310-870afc39f1ba tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.490377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9933f98a-4d43-441a-b310-870afc39f1ba tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.637098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9933f98a-4d43-441a-b310-870afc39f1ba tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:12.640457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-154d607b-d939-49b8-a721-70113986d8a6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:12.664813 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-154d607b-d939-49b8-a721-70113986d8a6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.382281 Jul 20 04:09:12.665462 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9933f98a-4d43-441a-b310-870afc39f1ba tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1264 microversion: 2.1 time: 0.185667 Jul 20 04:09:12.669176 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 376/704] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:12 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:12.670614 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 329/705] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:12 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:12.682864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:12.685908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:12.686581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c010561a-7217-423b-b93b-e2dd349c891c tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:12.687558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c010561a-7217-423b-b93b-e2dd349c891c tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:12.711963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c010561a-7217-423b-b93b-e2dd349c891c tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.712817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c010561a-7217-423b-b93b-e2dd349c891c tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.714558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.715706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c010561a-7217-423b-b93b-e2dd349c891c tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.717173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.718749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c010561a-7217-423b-b93b-e2dd349c891c tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.722325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:12.724939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:12.872966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:12.873694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:12.874381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:12.875191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:12.876055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:12.937532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-c010561a-7217-423b-b93b-e2dd349c891c tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:12.949629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:12.978656 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c010561a-7217-423b-b93b-e2dd349c891c tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.305257 Jul 20 04:09:12.979919 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 330/706] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:12 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:13.046559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:13.074536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:13.084573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.085076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.085879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.086636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.144184 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9c1b5b06-d8d2-4e61-8c97-a5d2b08b37cc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action" status: 202 len: 1067 microversion: 2.1 time: 0.473666 Jul 20 04:09:13.149519 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 377/707] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:09:12 2022] POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action => generated 1067 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:09:13.163435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e083d74b-1124-4343-acee-92b633a4d1fd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:13.164067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e083d74b-1124-4343-acee-92b633a4d1fd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:13.175298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e083d74b-1124-4343-acee-92b633a4d1fd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.175753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e083d74b-1124-4343-acee-92b633a4d1fd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.177720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e083d74b-1124-4343-acee-92b633a4d1fd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.177918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e083d74b-1124-4343-acee-92b633a4d1fd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.482434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-941e49b1-a86d-436d-8c3b-3b507a9d571e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:13.484144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-941e49b1-a86d-436d-8c3b-3b507a9d571e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:13.505295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-941e49b1-a86d-436d-8c3b-3b507a9d571e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.507189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-941e49b1-a86d-436d-8c3b-3b507a9d571e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.520357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-941e49b1-a86d-436d-8c3b-3b507a9d571e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.521440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-941e49b1-a86d-436d-8c3b-3b507a9d571e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.699913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e083d74b-1124-4343-acee-92b633a4d1fd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:13.711335 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e083d74b-1124-4343-acee-92b633a4d1fd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.553704 Jul 20 04:09:13.723021 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 331/708] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:13 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:13.728629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-306055de-ad99-420c-a702-16114b0b519c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:13.729516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-306055de-ad99-420c-a702-16114b0b519c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:13.738137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-306055de-ad99-420c-a702-16114b0b519c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.738782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-306055de-ad99-420c-a702-16114b0b519c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.739756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-306055de-ad99-420c-a702-16114b0b519c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.740298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-306055de-ad99-420c-a702-16114b0b519c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.903686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-306055de-ad99-420c-a702-16114b0b519c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:13.913531 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-306055de-ad99-420c-a702-16114b0b519c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1319 microversion: 2.1 time: 0.188804 Jul 20 04:09:13.925810 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 332/709] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:13 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:13.932356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ccdfe7b0-264e-4a78-b393-b10d7cf46018 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:13.933000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ccdfe7b0-264e-4a78-b393-b10d7cf46018 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:13.941575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7b0-264e-4a78-b393-b10d7cf46018 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.941575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7b0-264e-4a78-b393-b10d7cf46018 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:13.942433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7b0-264e-4a78-b393-b10d7cf46018 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:13.943284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7b0-264e-4a78-b393-b10d7cf46018 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:14.045936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ccdfe7b0-264e-4a78-b393-b10d7cf46018 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:14.056920 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ccdfe7b0-264e-4a78-b393-b10d7cf46018 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1270 microversion: 2.1 time: 0.129951 Jul 20 04:09:14.066565 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 333/710] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:13 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1270 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:14.171526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-72f27491-10bd-4d8d-8fd7-7ab5e53ad6a7 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Action: 'create', calling method: .version_select at 0x7fb8425fea60>, body: {"pool": null} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:14.248894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-941e49b1-a86d-436d-8c3b-3b507a9d571e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8081d25eaba743f69815051eec36d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630a6840350545b297f7acdc4de59765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:14.261715 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-941e49b1-a86d-436d-8c3b-3b507a9d571e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 200 len: 1477 microversion: 2.1 time: 0.784704 Jul 20 04:09:14.263659 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 378/711] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:13 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 1477 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:14.269522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-49c02ba7-97ef-4325-9b78-aa0886a8ca58 req-8276a28b-83cb-4b36-a05d-bec2c9568ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062ae2d5-b44a-4064-aef7-0ab665ad2f5c", "name": "network-vif-plugged", "status": "completed", "tag": "6f8db406-db7c-4124-b75e-47dbe2c90aab"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:14.281259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-49c02ba7-97ef-4325-9b78-aa0886a8ca58 req-8276a28b-83cb-4b36-a05d-bec2c9568ea9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:14.281942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-49c02ba7-97ef-4325-9b78-aa0886a8ca58 req-8276a28b-83cb-4b36-a05d-bec2c9568ea9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:14.297037 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-49c02ba7-97ef-4325-9b78-aa0886a8ca58 req-8276a28b-83cb-4b36-a05d-bec2c9568ea9 service nova] Creating event network-vif-plugged:6f8db406-db7c-4124-b75e-47dbe2c90aab for instance 062ae2d5-b44a-4064-aef7-0ab665ad2f5c on n-h2-760456-11 Jul 20 04:09:14.302838 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-49c02ba7-97ef-4325-9b78-aa0886a8ca58 req-8276a28b-83cb-4b36-a05d-bec2c9568ea9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037734 Jul 20 04:09:14.304111 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 379/712] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:14.310589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc0d0e76-65b0-4b4b-a218-ba5535b057b3 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:14.311494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc0d0e76-65b0-4b4b-a218-ba5535b057b3 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:14.318473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc0d0e76-65b0-4b4b-a218-ba5535b057b3 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:14.319183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc0d0e76-65b0-4b4b-a218-ba5535b057b3 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:14.320084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc0d0e76-65b0-4b4b-a218-ba5535b057b3 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:14.320690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc0d0e76-65b0-4b4b-a218-ba5535b057b3 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:14.556993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-bc0d0e76-65b0-4b4b-a218-ba5535b057b3 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:14.623215 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc0d0e76-65b0-4b4b-a218-ba5535b057b3 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.318038 Jul 20 04:09:14.624008 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 380/713] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:14 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:14.737174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-988281ca-6bc0-455f-8c28-04bfb6910f4a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:14.737812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-988281ca-6bc0-455f-8c28-04bfb6910f4a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:14.759294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-988281ca-6bc0-455f-8c28-04bfb6910f4a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:14.761022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-988281ca-6bc0-455f-8c28-04bfb6910f4a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:14.763072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-988281ca-6bc0-455f-8c28-04bfb6910f4a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:14.763778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-988281ca-6bc0-455f-8c28-04bfb6910f4a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:15.454774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-988281ca-6bc0-455f-8c28-04bfb6910f4a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:15.467748 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-988281ca-6bc0-455f-8c28-04bfb6910f4a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.742469 Jul 20 04:09:15.470721 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 381/714] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:14 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:15.489546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8aeb4b2d-e1c6-4dc3-8a44-5fdf04a51c67 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:15.491062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8aeb4b2d-e1c6-4dc3-8a44-5fdf04a51c67 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:15.500745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aeb4b2d-e1c6-4dc3-8a44-5fdf04a51c67 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:15.502842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aeb4b2d-e1c6-4dc3-8a44-5fdf04a51c67 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:15.505778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aeb4b2d-e1c6-4dc3-8a44-5fdf04a51c67 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:15.507119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aeb4b2d-e1c6-4dc3-8a44-5fdf04a51c67 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.411635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8aeb4b2d-e1c6-4dc3-8a44-5fdf04a51c67 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:16.425146 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8aeb4b2d-e1c6-4dc3-8a44-5fdf04a51c67 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1469 microversion: 2.1 time: 0.951648 Jul 20 04:09:16.426015 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 382/715] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:15 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1469 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:16.439520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-98662f42-bf4a-41f3-ac8d-238c083a5801 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:16.452219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-98662f42-bf4a-41f3-ac8d-238c083a5801 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:16.465179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98662f42-bf4a-41f3-ac8d-238c083a5801 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.467356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98662f42-bf4a-41f3-ac8d-238c083a5801 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:16.469613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98662f42-bf4a-41f3-ac8d-238c083a5801 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:16.471806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98662f42-bf4a-41f3-ac8d-238c083a5801 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.063394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-98662f42-bf4a-41f3-ac8d-238c083a5801 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:17.080288 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-98662f42-bf4a-41f3-ac8d-238c083a5801 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1312 microversion: 2.1 time: 0.652708 Jul 20 04:09:17.083028 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 383/716] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:16 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1312 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:17.097868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f249c96d-1786-432f-95af-cc97ce58508e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.099036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f249c96d-1786-432f-95af-cc97ce58508e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] [instance: 76c35632-c082-43bc-9d83-85fa2dce4b5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:17.127734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f249c96d-1786-432f-95af-cc97ce58508e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.130513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f249c96d-1786-432f-95af-cc97ce58508e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.133749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f249c96d-1786-432f-95af-cc97ce58508e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.139548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f249c96d-1786-432f-95af-cc97ce58508e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.199270 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-f249c96d-1786-432f-95af-cc97ce58508e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] HTTP exception thrown: Instance 76c35632-c082-43bc-9d83-85fa2dce4b5b could not be found. Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f249c96d-1786-432f-95af-cc97ce58508e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Request method failure captured: Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b HTTP/1.1 Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-y0OMD6Z89ORTn4VpsZUsT0KlZZ0WIGVyNKHGH6PufNilMNeeB-GQyfdvjRJ4z7gVBjkvVfBzCtb4A0Fr-X97xpgyx0SDKsL8yjjyAryDOTAP4yaNgKk0Zibjd9kwsbuHFeZ40Pz7L0-WBEFJbOrcnTsWJJ3u9wekguC3egMMucXk Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 630a6840350545b297f7acdc4de59765 Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-963763775 Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:09:17.201280 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/630a6840350545b297f7acdc4de59765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/630a6840350545b297f7acdc4de59765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/630a6840350545b297f7acdc4de59765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_630a6840350545b297f7acdc4de59765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersAdminNegativeTestJSON-963763775 Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 630a6840350545b297f7acdc4de59765 Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-963763775 Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersAdminNegativeTestJSON-963763775-project Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8081d25eaba743f69815051eec36d2a3 Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersAdminNegativeTestJSON-963763775-project Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 76c35632-c082-43bc-9d83-85fa2dce4b5b could not be found. Jul 20 04:09:17.202713 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '76c35632-c082-43bc-9d83-85fa2dce4b5b'} Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c35632-c082-43bc-9d83-85fa2dce4b5b could not be found. Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:17.203417 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c35632-c082-43bc-9d83-85fa2dce4b5b could not be found. Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c35632-c082-43bc-9d83-85fa2dce4b5b could not be found. Jul 20 04:09:17.204573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:17.210808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f249c96d-1786-432f-95af-cc97ce58508e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] Returning 404 to user: Instance 76c35632-c082-43bc-9d83-85fa2dce4b5b could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:17.212637 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f249c96d-1786-432f-95af-cc97ce58508e tempest-ServersAdminNegativeTestJSON-963763775 tempest-ServersAdminNegativeTestJSON-963763775-project] 10.222.0.59 "GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b" status: 404 len: 111 microversion: 2.1 time: 0.128394 Jul 20 04:09:17.213417 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 384/717] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/servers/76c35632-c082-43bc-9d83-85fa2dce4b5b => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:17.224373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4f0eb3a8-e6eb-4788-a633-51b460732db1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.225163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4f0eb3a8-e6eb-4788-a633-51b460732db1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:17.231959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f0eb3a8-e6eb-4788-a633-51b460732db1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.232565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f0eb3a8-e6eb-4788-a633-51b460732db1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.242520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f0eb3a8-e6eb-4788-a633-51b460732db1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.243255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f0eb3a8-e6eb-4788-a633-51b460732db1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.444020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-4f0eb3a8-e6eb-4788-a633-51b460732db1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:17.468358 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4f0eb3a8-e6eb-4788-a633-51b460732db1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.253002 Jul 20 04:09:17.469031 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 385/718] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:17.474993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ff87c32d-53df-4489-af7c-52fabacb48dd req-5c325c07-2e49-4383-ac23-26f67c32299b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c35632-c082-43bc-9d83-85fa2dce4b5b", "name": "network-vif-deleted", "tag": "b2614c31-c7d5-4301-a795-1c1713809906"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:17.483504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ff87c32d-53df-4489-af7c-52fabacb48dd req-5c325c07-2e49-4383-ac23-26f67c32299b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.484112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ff87c32d-53df-4489-af7c-52fabacb48dd req-5c325c07-2e49-4383-ac23-26f67c32299b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.498391 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ff87c32d-53df-4489-af7c-52fabacb48dd req-5c325c07-2e49-4383-ac23-26f67c32299b service nova] Creating event network-vif-deleted:b2614c31-c7d5-4301-a795-1c1713809906 for instance 76c35632-c082-43bc-9d83-85fa2dce4b5b on n-h2-760456-11 Jul 20 04:09:17.504059 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ff87c32d-53df-4489-af7c-52fabacb48dd req-5c325c07-2e49-4383-ac23-26f67c32299b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033818 Jul 20 04:09:17.506831 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 386/719] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:17.515161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-13eb40be-7bf9-4809-8dbd-9726e9e59664 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.516088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-13eb40be-7bf9-4809-8dbd-9726e9e59664 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 062ae2d5-b44a-4064-aef7-0ab665ad2f5c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:17.529716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13eb40be-7bf9-4809-8dbd-9726e9e59664 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.530460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13eb40be-7bf9-4809-8dbd-9726e9e59664 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.531733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13eb40be-7bf9-4809-8dbd-9726e9e59664 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.532420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13eb40be-7bf9-4809-8dbd-9726e9e59664 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.543755 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-72f27491-10bd-4d8d-8fd7-7ab5e53ad6a7 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.481088 Jul 20 04:09:17.552117 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 334/720] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:09:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:17.575187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2790d23a-0f7c-480b-9295-1f089fa427f0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:17.576698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2790d23a-0f7c-480b-9295-1f089fa427f0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:17.588385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2790d23a-0f7c-480b-9295-1f089fa427f0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.589357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2790d23a-0f7c-480b-9295-1f089fa427f0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.590623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2790d23a-0f7c-480b-9295-1f089fa427f0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.591778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2790d23a-0f7c-480b-9295-1f089fa427f0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.791492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2790d23a-0f7c-480b-9295-1f089fa427f0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:17.800385 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2790d23a-0f7c-480b-9295-1f089fa427f0 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.245122 Jul 20 04:09:17.801224 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 335/721] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:17.807721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-45cdeb44-ed6d-471b-8916-b15900d11de9 req-59f2cae5-c97d-4eb6-a20f-06a22f1d2939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd68e268-5eaa-42cd-a269-14daad8c8dd4", "tag": "6442fb08-15c8-4951-a0ab-5f5aca7f5482"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:17.818463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-45cdeb44-ed6d-471b-8916-b15900d11de9 req-59f2cae5-c97d-4eb6-a20f-06a22f1d2939 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:17.818910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-45cdeb44-ed6d-471b-8916-b15900d11de9 req-59f2cae5-c97d-4eb6-a20f-06a22f1d2939 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:17.831927 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-45cdeb44-ed6d-471b-8916-b15900d11de9 req-59f2cae5-c97d-4eb6-a20f-06a22f1d2939 service nova] Creating event network-changed:6442fb08-15c8-4951-a0ab-5f5aca7f5482 for instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 on n-h1-760456-11 Jul 20 04:09:17.838204 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-45cdeb44-ed6d-471b-8916-b15900d11de9 req-59f2cae5-c97d-4eb6-a20f-06a22f1d2939 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035476 Jul 20 04:09:17.838844 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 336/722] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:17.850416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cd88b0be-7cbf-46e8-9cba-790a8c5b5ef7 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Action: 'create', calling method: .version_select at 0x7fb8424e6a60>, body: {"pool": null} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:18.002362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-13eb40be-7bf9-4809-8dbd-9726e9e59664 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:18.021087 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-13eb40be-7bf9-4809-8dbd-9726e9e59664 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c" status: 200 len: 1469 microversion: 2.1 time: 0.512825 Jul 20 04:09:18.022006 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 387/723] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:17 2022] GET /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c => generated 1469 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:18.041568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:18.050559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:18.051593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Searching by: {'reservation_id': 'r-ummohhi0', 'deleted': False, 'project_id': '95231a9d82164f88b1c6ff355679d292'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:09:18.058898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:18.059451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:18.060350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:18.060897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:18.275898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:09:18.377115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:18.386824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:18.390410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:18.786704 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-89573fd7-677c-4990-8e78-fce155589ac2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?reservation_id=r-ummohhi0" status: 200 len: 2931 microversion: 2.1 time: 0.750289 Jul 20 04:09:18.805806 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 388/724] 10.222.0.59 () {58 vars in 1196 bytes} [Wed Jul 20 04:09:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ummohhi0 => generated 2931 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:18.805806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97254c9d-7a33-4a1b-a88c-5a6d5fad62a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:18.805806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97254c9d-7a33-4a1b-a88c-5a6d5fad62a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:18.815497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97254c9d-7a33-4a1b-a88c-5a6d5fad62a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:18.815965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97254c9d-7a33-4a1b-a88c-5a6d5fad62a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:18.821678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97254c9d-7a33-4a1b-a88c-5a6d5fad62a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:18.822151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97254c9d-7a33-4a1b-a88c-5a6d5fad62a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.101065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97254c9d-7a33-4a1b-a88c-5a6d5fad62a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:19.115862 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97254c9d-7a33-4a1b-a88c-5a6d5fad62a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1312 microversion: 2.1 time: 0.321329 Jul 20 04:09:19.116771 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 389/725] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:18 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1312 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:19.121958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d366181c-cb3b-4175-978f-2bd70e5aa706 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:19.122914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d366181c-cb3b-4175-978f-2bd70e5aa706 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:19.143045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:19.148387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d366181c-cb3b-4175-978f-2bd70e5aa706 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.152500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d366181c-cb3b-4175-978f-2bd70e5aa706 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.154674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d366181c-cb3b-4175-978f-2bd70e5aa706 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.157592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d366181c-cb3b-4175-978f-2bd70e5aa706 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.255389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-d366181c-cb3b-4175-978f-2bd70e5aa706 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:19.280303 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d366181c-cb3b-4175-978f-2bd70e5aa706 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.162354 Jul 20 04:09:19.281595 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 390/726] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:19 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:19.286217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8e33f3f0-3a01-4b77-898b-3e21acfc437c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:19.341267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.compute.server_groups [None req-8e33f3f0-3a01-4b77-898b-3e21acfc437c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Querying cell 0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) for 2 instances {{(pid=119606) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:09:19.342091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e33f3f0-3a01-4b77-898b-3e21acfc437c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.342565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e33f3f0-3a01-4b77-898b-3e21acfc437c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.422097 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8e33f3f0-3a01-4b77-898b-3e21acfc437c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups/43b90a72-1e93-4b1d-846d-9e78f147e47a" status: 200 len: 266 microversion: 2.1 time: 0.139202 Jul 20 04:09:19.422831 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 391/727] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:09:19 2022] GET /compute/v2.1/os-server-groups/43b90a72-1e93-4b1d-846d-9e78f147e47a => generated 266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:19.440864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0eee43c1-4b23-497d-aaf8-d51901495c44 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:19.441978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0eee43c1-4b23-497d-aaf8-d51901495c44 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:19.448890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0eee43c1-4b23-497d-aaf8-d51901495c44 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.449699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0eee43c1-4b23-497d-aaf8-d51901495c44 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.450738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0eee43c1-4b23-497d-aaf8-d51901495c44 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.452554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0eee43c1-4b23-497d-aaf8-d51901495c44 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.626176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0eee43c1-4b23-497d-aaf8-d51901495c44 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:19.637768 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0eee43c1-4b23-497d-aaf8-d51901495c44 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.202460 Jul 20 04:09:19.638687 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 392/728] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:19 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:19.643530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc48d343-26c8-4bf2-8fe7-aa32585eda6c tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:19.644301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc48d343-26c8-4bf2-8fe7-aa32585eda6c tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] [instance: 062ae2d5-b44a-4064-aef7-0ab665ad2f5c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:19.651009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc48d343-26c8-4bf2-8fe7-aa32585eda6c tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.651682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc48d343-26c8-4bf2-8fe7-aa32585eda6c tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.652800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc48d343-26c8-4bf2-8fe7-aa32585eda6c tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:19.653398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc48d343-26c8-4bf2-8fe7-aa32585eda6c tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:19.758286 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cd88b0be-7cbf-46e8-9cba-790a8c5b5ef7 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.917819 Jul 20 04:09:19.759394 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 337/729] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:09:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:19.770151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34f9af3d-ccf5-470e-8d1f-eda2d89f7a0d tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Action: 'create', calling method: .version_select at 0x7fb842a79ee0>, body: {"pool": null} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:20.130810 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc48d343-26c8-4bf2-8fe7-aa32585eda6c tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c" status: 200 len: 1622 microversion: 2.1 time: 0.490990 Jul 20 04:09:20.142538 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 393/730] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:19 2022] GET /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c => generated 1622 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:20.149086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4cdebe29-f18c-4247-b968-1b3a27b3a3d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:20.150656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4cdebe29-f18c-4247-b968-1b3a27b3a3d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:20.159446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cdebe29-f18c-4247-b968-1b3a27b3a3d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:20.160079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cdebe29-f18c-4247-b968-1b3a27b3a3d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:20.162743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cdebe29-f18c-4247-b968-1b3a27b3a3d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:20.163525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cdebe29-f18c-4247-b968-1b3a27b3a3d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:20.217421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:20.722474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4cdebe29-f18c-4247-b968-1b3a27b3a3d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:20.777058 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4cdebe29-f18c-4247-b968-1b3a27b3a3d3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1312 microversion: 2.1 time: 0.632207 Jul 20 04:09:20.778968 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 394/731] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:20 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1312 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:20.791908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f20a61bb-43b7-48ea-ace1-7b68dd364643 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:20.792709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f20a61bb-43b7-48ea-ace1-7b68dd364643 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:20.799967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f20a61bb-43b7-48ea-ace1-7b68dd364643 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:20.800852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f20a61bb-43b7-48ea-ace1-7b68dd364643 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:20.801787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f20a61bb-43b7-48ea-ace1-7b68dd364643 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:20.802426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f20a61bb-43b7-48ea-ace1-7b68dd364643 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:21.227958 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f20a61bb-43b7-48ea-ace1-7b68dd364643 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 200 len: 1622 microversion: 2.1 time: 0.439653 Jul 20 04:09:21.254452 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 395/732] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:20 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 1622 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:21.260138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a433fc48-339d-4b42-8e02-67f76717b072 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:21.262857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a433fc48-339d-4b42-8e02-67f76717b072 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:21.281451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a433fc48-339d-4b42-8e02-67f76717b072 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:21.292346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a433fc48-339d-4b42-8e02-67f76717b072 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:21.293882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a433fc48-339d-4b42-8e02-67f76717b072 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:21.295032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a433fc48-339d-4b42-8e02-67f76717b072 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:21.443901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-a433fc48-339d-4b42-8e02-67f76717b072 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:21.471901 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a433fc48-339d-4b42-8e02-67f76717b072 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.220168 Jul 20 04:09:21.472850 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 396/733] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:21 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:21.478837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26bb0ec5-a875-46a5-b83b-954156a174ed tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:21.479682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26bb0ec5-a875-46a5-b83b-954156a174ed tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:21.486711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26bb0ec5-a875-46a5-b83b-954156a174ed tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:21.487604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26bb0ec5-a875-46a5-b83b-954156a174ed tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:21.488822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26bb0ec5-a875-46a5-b83b-954156a174ed tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:21.489461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26bb0ec5-a875-46a5-b83b-954156a174ed tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:21.733094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-26bb0ec5-a875-46a5-b83b-954156a174ed tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:21.743388 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26bb0ec5-a875-46a5-b83b-954156a174ed tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.268171 Jul 20 04:09:21.743973 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 397/734] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:21 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:21.749219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-71b45bf8-89e3-4cd8-8485-cb0a61e8e89f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Action: 'create', calling method: .version_select at 0x7fb842c1f310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-598305074", "policies": ["anti-affinity"]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:21.766286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-71b45bf8-89e3-4cd8-8485-cb0a61e8e89f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:21.789818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-71b45bf8-89e3-4cd8-8485-cb0a61e8e89f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:21.865826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-71b45bf8-89e3-4cd8-8485-cb0a61e8e89f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:21.874656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-71b45bf8-89e3-4cd8-8485-cb0a61e8e89f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:21.889639 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-71b45bf8-89e3-4cd8-8485-cb0a61e8e89f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.144570 Jul 20 04:09:21.890900 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 398/735] 10.222.0.59 () {60 vars in 1173 bytes} [Wed Jul 20 04:09:21 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:21.989953 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-34f9af3d-ccf5-470e-8d1f-eda2d89f7a0d tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.223899 Jul 20 04:09:21.994813 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 338/736] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:09:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:09:22.000446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9694f7f9-1aa7-4307-89e7-25aad56afe2e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:22.001485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9694f7f9-1aa7-4307-89e7-25aad56afe2e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:22.011129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9694f7f9-1aa7-4307-89e7-25aad56afe2e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.013288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9694f7f9-1aa7-4307-89e7-25aad56afe2e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.015230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9694f7f9-1aa7-4307-89e7-25aad56afe2e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.016895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9694f7f9-1aa7-4307-89e7-25aad56afe2e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.157180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fd67b49c-5ad5-4522-b224-15db62175a44 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:22.159782 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:22.159782 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:09:22.166726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd67b49c-5ad5-4522-b224-15db62175a44 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.167200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd67b49c-5ad5-4522-b224-15db62175a44 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.168079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd67b49c-5ad5-4522-b224-15db62175a44 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.168515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd67b49c-5ad5-4522-b224-15db62175a44 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.205102 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fd67b49c-5ad5-4522-b224-15db62175a44 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.312916 Jul 20 04:09:22.212324 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 399/737] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:09:21 2022] GET /compute/v2.1/os-services => generated 949 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:22.212743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-34c7dd15-284f-4f73-9f03-05e36e11e0ba tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Action: 'create', calling method: .version_select at 0x7fb842d37e50>, body: {"pool": null} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:22.291185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9694f7f9-1aa7-4307-89e7-25aad56afe2e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:22.299236 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9694f7f9-1aa7-4307-89e7-25aad56afe2e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1312 microversion: 2.1 time: 0.302908 Jul 20 04:09:22.300435 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 339/738] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:21 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1312 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:22.306565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1109358487", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ce3b350e-4517-4aab-9a1b-07c66910c1cb"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:22.373825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:09:22.642821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:22.643267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:22.644055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:22.644760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:22.645183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:22.665411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.666441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.670872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:22.674845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:22.704207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:22.714958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:22.737966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Going to run 2 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:09:22.740929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:09:22.801700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:22.810721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:22.855883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:22.861229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:22.881866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=2d7c31d1-d04a-443f-a3e2-c0aac27ac60f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:09:22.939789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:22.945453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:22.987727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:22.994660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:23.035607 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d735112-dcf4-4054-b83b-2131e0bd3c52 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.733991 Jul 20 04:09:23.038051 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 340/739] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:09:23.054004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-82bfd02a-461f-400f-b987-9421a9b04e87 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:23.063020 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:23.063020 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:09:23.068456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82bfd02a-461f-400f-b987-9421a9b04e87 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.069211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82bfd02a-461f-400f-b987-9421a9b04e87 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.070525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82bfd02a-461f-400f-b987-9421a9b04e87 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.074023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82bfd02a-461f-400f-b987-9421a9b04e87 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.127296 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-82bfd02a-461f-400f-b987-9421a9b04e87 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?host=n-d-760456-11" status: 200 len: 581 microversion: 2.1 time: 0.087955 Jul 20 04:09:23.134850 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 341/740] 10.222.0.59 () {58 vars in 1173 bytes} [Wed Jul 20 04:09:23 2022] GET /compute/v2.1/os-services?host=n-d-760456-11 => generated 581 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:23.134850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-18cff302-0484-47f6-be36-d0fcb66acfaf tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:23.134850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-18cff302-0484-47f6-be36-d0fcb66acfaf tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:23.144156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18cff302-0484-47f6-be36-d0fcb66acfaf tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.144615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18cff302-0484-47f6-be36-d0fcb66acfaf tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.146066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18cff302-0484-47f6-be36-d0fcb66acfaf tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.146547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18cff302-0484-47f6-be36-d0fcb66acfaf tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.268202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-18cff302-0484-47f6-be36-d0fcb66acfaf tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:23.295234 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-18cff302-0484-47f6-be36-d0fcb66acfaf tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.165375 Jul 20 04:09:23.296454 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 342/741] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:23 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:23.301876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-41b63161-4d48-4cfc-b35e-32a1da8d775d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:23.302611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-41b63161-4d48-4cfc-b35e-32a1da8d775d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:23.318289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41b63161-4d48-4cfc-b35e-32a1da8d775d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.318797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41b63161-4d48-4cfc-b35e-32a1da8d775d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.320766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41b63161-4d48-4cfc-b35e-32a1da8d775d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.321395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41b63161-4d48-4cfc-b35e-32a1da8d775d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.559839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-41b63161-4d48-4cfc-b35e-32a1da8d775d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:23.570600 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-41b63161-4d48-4cfc-b35e-32a1da8d775d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.272812 Jul 20 04:09:23.571237 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 343/742] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:23 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:23.579070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7536a408-82b8-4b69-b44d-0684b468ceaf tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:23.588161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7536a408-82b8-4b69-b44d-0684b468ceaf tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:23.589262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7536a408-82b8-4b69-b44d-0684b468ceaf tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Searching by: {'deleted': False, 'project_id': '95231a9d82164f88b1c6ff355679d292'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:09:23.592500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:23.615882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7536a408-82b8-4b69-b44d-0684b468ceaf tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.616336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7536a408-82b8-4b69-b44d-0684b468ceaf tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.618517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7536a408-82b8-4b69-b44d-0684b468ceaf tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.618997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7536a408-82b8-4b69-b44d-0684b468ceaf tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.721032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-7536a408-82b8-4b69-b44d-0684b468ceaf tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:09:23.797250 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7536a408-82b8-4b69-b44d-0684b468ceaf tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.222110 Jul 20 04:09:23.802341 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 344/743] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:09:23 2022] GET /compute/v2.1/servers => generated 1666 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:23.803292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-492cc2ba-f4b9-46d7-8fa2-215fbd9f847b tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:23.804754 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:23.804754 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:09:23.806481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-492cc2ba-f4b9-46d7-8fa2-215fbd9f847b tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.806945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-492cc2ba-f4b9-46d7-8fa2-215fbd9f847b tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.807980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-492cc2ba-f4b9-46d7-8fa2-215fbd9f847b tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.808298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-492cc2ba-f4b9-46d7-8fa2-215fbd9f847b tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.834195 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-492cc2ba-f4b9-46d7-8fa2-215fbd9f847b tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.034616 Jul 20 04:09:23.835178 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 345/744] 10.222.0.59 () {58 vars in 1175 bytes} [Wed Jul 20 04:09:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:23.840611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10ad81ef-e3c4-4513-8abb-203af26d5bae tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:23.840806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10ad81ef-e3c4-4513-8abb-203af26d5bae tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:23.849113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10ad81ef-e3c4-4513-8abb-203af26d5bae tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.849626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10ad81ef-e3c4-4513-8abb-203af26d5bae tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:23.850619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10ad81ef-e3c4-4513-8abb-203af26d5bae tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:23.851276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10ad81ef-e3c4-4513-8abb-203af26d5bae tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.026043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10ad81ef-e3c4-4513-8abb-203af26d5bae tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:24.035722 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10ad81ef-e3c4-4513-8abb-203af26d5bae tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1312 microversion: 2.1 time: 0.199301 Jul 20 04:09:24.036315 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 346/745] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:23 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:24.053222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-74dd94b3-543d-4e9d-acea-e9813fbc6abb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.053904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-74dd94b3-543d-4e9d-acea-e9813fbc6abb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:24.152198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-74dd94b3-543d-4e9d-acea-e9813fbc6abb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:24.162033 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-74dd94b3-543d-4e9d-acea-e9813fbc6abb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1219 microversion: 2.1 time: 0.115028 Jul 20 04:09:24.181618 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 347/746] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:24 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:24.187436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-12a1a1d8-10a6-4b7b-9e80-8b4958edb8f0 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.189066 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:24.189066 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:09:24.191011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12a1a1d8-10a6-4b7b-9e80-8b4958edb8f0 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.195521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12a1a1d8-10a6-4b7b-9e80-8b4958edb8f0 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.207214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12a1a1d8-10a6-4b7b-9e80-8b4958edb8f0 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.209893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12a1a1d8-10a6-4b7b-9e80-8b4958edb8f0 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.268965 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-12a1a1d8-10a6-4b7b-9e80-8b4958edb8f0 tempest-ServicesAdminTestJSON-257592627 tempest-ServicesAdminTestJSON-257592627-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.085901 Jul 20 04:09:24.270043 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 348/747] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:09:24 2022] GET /compute/v2.1/os-services => generated 949 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:24.316911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c930726b-1948-4741-840c-496d0907f6f5 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.317574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c930726b-1948-4741-840c-496d0907f6f5 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:24.349711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c930726b-1948-4741-840c-496d0907f6f5 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.350291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c930726b-1948-4741-840c-496d0907f6f5 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.352379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c930726b-1948-4741-840c-496d0907f6f5 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.354907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c930726b-1948-4741-840c-496d0907f6f5 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.526977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-c930726b-1948-4741-840c-496d0907f6f5 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:24.575883 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c930726b-1948-4741-840c-496d0907f6f5 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.262579 Jul 20 04:09:24.578030 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 349/748] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:24 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:09:24.603355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f685e02c-897d-4baa-8041-a846e5236d5e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:24.603703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f685e02c-897d-4baa-8041-a846e5236d5e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:24.615637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f685e02c-897d-4baa-8041-a846e5236d5e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.618241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f685e02c-897d-4baa-8041-a846e5236d5e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.620560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f685e02c-897d-4baa-8041-a846e5236d5e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.622341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f685e02c-897d-4baa-8041-a846e5236d5e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.808775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f685e02c-897d-4baa-8041-a846e5236d5e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:24.822029 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f685e02c-897d-4baa-8041-a846e5236d5e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.228095 Jul 20 04:09:24.822029 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 350/749] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:24 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:24.872945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-9065cbab-88f0-42ae-a3cd-6bd62a4f7eab req-0ccba990-2f7e-4bbd-a483-70da7d2440b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd68e268-5eaa-42cd-a269-14daad8c8dd4", "name": "network-vif-plugged", "status": "completed", "tag": "6442fb08-15c8-4951-a0ab-5f5aca7f5482"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:24.920042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9065cbab-88f0-42ae-a3cd-6bd62a4f7eab req-0ccba990-2f7e-4bbd-a483-70da7d2440b0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:24.925066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9065cbab-88f0-42ae-a3cd-6bd62a4f7eab req-0ccba990-2f7e-4bbd-a483-70da7d2440b0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:24.951967 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-9065cbab-88f0-42ae-a3cd-6bd62a4f7eab req-0ccba990-2f7e-4bbd-a483-70da7d2440b0 service nova] Creating event network-vif-plugged:6442fb08-15c8-4951-a0ab-5f5aca7f5482 for instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 on n-h1-760456-11 Jul 20 04:09:24.959956 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-9065cbab-88f0-42ae-a3cd-6bd62a4f7eab req-0ccba990-2f7e-4bbd-a483-70da7d2440b0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090855 Jul 20 04:09:24.962461 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 351/750] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:25.059718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c05ec401-0621-4657-bc5a-79851a2e949c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:25.061858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c05ec401-0621-4657-bc5a-79851a2e949c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:25.075580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c05ec401-0621-4657-bc5a-79851a2e949c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.076306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c05ec401-0621-4657-bc5a-79851a2e949c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.077271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c05ec401-0621-4657-bc5a-79851a2e949c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.078125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c05ec401-0621-4657-bc5a-79851a2e949c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.553842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c05ec401-0621-4657-bc5a-79851a2e949c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:25.562742 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c05ec401-0621-4657-bc5a-79851a2e949c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1312 microversion: 2.1 time: 0.513431 Jul 20 04:09:25.573832 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 352/751] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:25 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1312 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:25.579426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f08948e5-4df5-42bb-91b9-f90a138389cb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:25.580224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f08948e5-4df5-42bb-91b9-f90a138389cb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:25.586721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f08948e5-4df5-42bb-91b9-f90a138389cb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.587420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f08948e5-4df5-42bb-91b9-f90a138389cb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.588361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f08948e5-4df5-42bb-91b9-f90a138389cb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.588955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f08948e5-4df5-42bb-91b9-f90a138389cb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.697544 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-34c7dd15-284f-4f73-9f03-05e36e11e0ba tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.490008 Jul 20 04:09:25.705004 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 400/752] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:09:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:25.711785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0f1a12cd-53c3-4199-8b6d-1ed25ab117df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:25.715918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0f1a12cd-53c3-4199-8b6d-1ed25ab117df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:25.727534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f1a12cd-53c3-4199-8b6d-1ed25ab117df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.728003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f1a12cd-53c3-4199-8b6d-1ed25ab117df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.728955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f1a12cd-53c3-4199-8b6d-1ed25ab117df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.729801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f1a12cd-53c3-4199-8b6d-1ed25ab117df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.764135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f08948e5-4df5-42bb-91b9-f90a138389cb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:25.774525 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f08948e5-4df5-42bb-91b9-f90a138389cb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1277 microversion: 2.1 time: 0.199251 Jul 20 04:09:25.775116 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 353/753] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:25 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:25.788176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40b0e886-42e9-4347-8012-a8f4e4e54ad6 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Calling method '.version_select at 0x7fb842449dc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:25.903144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-0f1a12cd-53c3-4199-8b6d-1ed25ab117df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:25.943916 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0f1a12cd-53c3-4199-8b6d-1ed25ab117df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.237481 Jul 20 04:09:25.952331 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 401/754] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:25 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:25.963721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c2a745be-31ab-492a-8657-80c586f56a87 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:25.965179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c2a745be-31ab-492a-8657-80c586f56a87 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:25.972985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2a745be-31ab-492a-8657-80c586f56a87 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.974206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2a745be-31ab-492a-8657-80c586f56a87 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:25.975533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2a745be-31ab-492a-8657-80c586f56a87 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:25.976169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2a745be-31ab-492a-8657-80c586f56a87 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:26.107254 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40b0e886-42e9-4347-8012-a8f4e4e54ad6 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips/fd373190-df48-481d-b9e8-c927da41b5e6" status: 200 len: 141 microversion: 2.1 time: 0.326326 Jul 20 04:09:26.112776 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 354/755] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:09:25 2022] GET /compute/v2.1/os-floating-ips/fd373190-df48-481d-b9e8-c927da41b5e6 => generated 141 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:26.130821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f844dd18-8f70-4206-a013-a39148b4c1f9 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Calling method '.version_select at 0x7fb8424d53a0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:26.623444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c2a745be-31ab-492a-8657-80c586f56a87 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:26.637719 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c2a745be-31ab-492a-8657-80c586f56a87 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.683337 Jul 20 04:09:26.642189 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 402/756] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:25 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:26.655172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2cfe8888-4c60-4500-8278-523f236ec609 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:26.656562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2cfe8888-4c60-4500-8278-523f236ec609 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:26.672233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2cfe8888-4c60-4500-8278-523f236ec609 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:26.674357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2cfe8888-4c60-4500-8278-523f236ec609 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:26.675715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2cfe8888-4c60-4500-8278-523f236ec609 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:26.676459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2cfe8888-4c60-4500-8278-523f236ec609 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.183398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2cfe8888-4c60-4500-8278-523f236ec609 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:27.194990 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2cfe8888-4c60-4500-8278-523f236ec609 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1312 microversion: 2.1 time: 0.550889 Jul 20 04:09:27.195655 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 403/757] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:26 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1312 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:27.215970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f35b314b-35b5-43c9-9745-cf44904354c4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:27.216589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f35b314b-35b5-43c9-9745-cf44904354c4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:27.250797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f35b314b-35b5-43c9-9745-cf44904354c4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.251556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f35b314b-35b5-43c9-9745-cf44904354c4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.252491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f35b314b-35b5-43c9-9745-cf44904354c4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.254108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f35b314b-35b5-43c9-9745-cf44904354c4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.604722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f35b314b-35b5-43c9-9745-cf44904354c4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:27.615431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f35b314b-35b5-43c9-9745-cf44904354c4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1277 microversion: 2.1 time: 0.403280 Jul 20 04:09:27.616729 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 404/758] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:27 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1277 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:27.622669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7dc8a3c5-3910-464b-b3ad-a908f4ac49b6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:27.624283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7dc8a3c5-3910-464b-b3ad-a908f4ac49b6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:27.632009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dc8a3c5-3910-464b-b3ad-a908f4ac49b6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.633378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dc8a3c5-3910-464b-b3ad-a908f4ac49b6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.634410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dc8a3c5-3910-464b-b3ad-a908f4ac49b6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.635456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dc8a3c5-3910-464b-b3ad-a908f4ac49b6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.750574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-7dc8a3c5-3910-464b-b3ad-a908f4ac49b6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:27.776628 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7dc8a3c5-3910-464b-b3ad-a908f4ac49b6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.157550 Jul 20 04:09:27.777232 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 405/759] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:27 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:27.786111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d667544b-aec5-48f3-9366-dc8499dd95b7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:27.787652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d667544b-aec5-48f3-9366-dc8499dd95b7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:27.799883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d667544b-aec5-48f3-9366-dc8499dd95b7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.800970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d667544b-aec5-48f3-9366-dc8499dd95b7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:27.803349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d667544b-aec5-48f3-9366-dc8499dd95b7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:27.804315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d667544b-aec5-48f3-9366-dc8499dd95b7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:28.272777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d667544b-aec5-48f3-9366-dc8499dd95b7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:28.287142 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d667544b-aec5-48f3-9366-dc8499dd95b7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.505780 Jul 20 04:09:28.287946 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 406/760] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:27 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:28.291001 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f844dd18-8f70-4206-a013-a39148b4c1f9 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/fd373190-df48-481d-b9e8-c927da41b5e6" status: 202 len: 0 microversion: 2.1 time: 2.169152 Jul 20 04:09:28.292793 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 355/761] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:09:26 2022] DELETE /compute/v2.1/os-floating-ips/fd373190-df48-481d-b9e8-c927da41b5e6 => generated 0 bytes in 2172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:09:28.300307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea301b1d-9f70-40c7-ba3b-1bcc8e3430e8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:28.307209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea301b1d-9f70-40c7-ba3b-1bcc8e3430e8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:28.312924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2042ea23-b85d-45e6-a0ce-1179f487f122 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Calling method '.version_select at 0x7fb842b5f310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:28.326303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea301b1d-9f70-40c7-ba3b-1bcc8e3430e8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:28.330122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea301b1d-9f70-40c7-ba3b-1bcc8e3430e8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:28.331326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea301b1d-9f70-40c7-ba3b-1bcc8e3430e8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:28.332007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea301b1d-9f70-40c7-ba3b-1bcc8e3430e8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.264051 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2042ea23-b85d-45e6-a0ce-1179f487f122 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.964333 Jul 20 04:09:29.264648 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 356/762] 10.222.0.59 () {58 vars in 1163 bytes} [Wed Jul 20 04:09:28 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:09:29.271738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01e20847-382f-4bf5-9400-c5f9be06825c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:29.272730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-01e20847-382f-4bf5-9400-c5f9be06825c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:29.272973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ea301b1d-9f70-40c7-ba3b-1bcc8e3430e8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:29.281426 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea301b1d-9f70-40c7-ba3b-1bcc8e3430e8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1462 microversion: 2.1 time: 0.992177 Jul 20 04:09:29.284238 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 407/763] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:28 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1462 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:29.292477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a38be7df-dd9a-4d09-a8cd-25ed71c928e2 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:29.293135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a38be7df-dd9a-4d09-a8cd-25ed71c928e2 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:29.299835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01e20847-382f-4bf5-9400-c5f9be06825c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.304105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01e20847-382f-4bf5-9400-c5f9be06825c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.307201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01e20847-382f-4bf5-9400-c5f9be06825c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.307845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01e20847-382f-4bf5-9400-c5f9be06825c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.311589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a38be7df-dd9a-4d09-a8cd-25ed71c928e2 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.312285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a38be7df-dd9a-4d09-a8cd-25ed71c928e2 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.315031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a38be7df-dd9a-4d09-a8cd-25ed71c928e2 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.315645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a38be7df-dd9a-4d09-a8cd-25ed71c928e2 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.374641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:29.462088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-a38be7df-dd9a-4d09-a8cd-25ed71c928e2 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:29.497469 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a38be7df-dd9a-4d09-a8cd-25ed71c928e2 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.210885 Jul 20 04:09:29.498549 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 408/764] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:29 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:29.504356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f37300ca-162c-4c91-9e8a-95d4eddfc8f8 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Calling method '.version_select at 0x7fb842c3f8b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:29.896214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-01e20847-382f-4bf5-9400-c5f9be06825c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:29.916824 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01e20847-382f-4bf5-9400-c5f9be06825c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1319 microversion: 2.1 time: 0.649912 Jul 20 04:09:29.924938 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 357/765] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:29 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1319 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:29.935374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:29.937224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:29.951530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.952192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.953383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:29.954005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:29.998642 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f37300ca-162c-4c91-9e8a-95d4eddfc8f8 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.498120 Jul 20 04:09:29.999480 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 409/766] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:09:29 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:30.010849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fc9135b8-869e-4938-ad8e-0015edc92eca tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:30.012343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fc9135b8-869e-4938-ad8e-0015edc92eca tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:30.022915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc9135b8-869e-4938-ad8e-0015edc92eca tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.026161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc9135b8-869e-4938-ad8e-0015edc92eca tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.027587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc9135b8-869e-4938-ad8e-0015edc92eca tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.029495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc9135b8-869e-4938-ad8e-0015edc92eca tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.184451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:30.192867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Old instance type m1.heat2, new instance type m1.heat {{(pid=119605) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:09:30.205325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:30.205325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:30.205325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:30.205325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:30.205325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:30.366384 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d5a3460c-d361-4e4f-84e5-fe7c2124dadc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4/action" status: 202 len: 0 microversion: 2.1 time: 0.437934 Jul 20 04:09:30.371788 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 358/767] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:09:29 2022] POST /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:30.378452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-6c52d887-7d89-49ab-9f59-403dbefb952d req-45f339a7-2976-4248-8677-d70c8cc25a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d7c31d1-d04a-443f-a3e2-c0aac27ac60f", "tag": "fbee6877-612d-4443-9f16-5173fc6e0c75"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:30.392249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6c52d887-7d89-49ab-9f59-403dbefb952d req-45f339a7-2976-4248-8677-d70c8cc25a3f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.397608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6c52d887-7d89-49ab-9f59-403dbefb952d req-45f339a7-2976-4248-8677-d70c8cc25a3f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.418479 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6c52d887-7d89-49ab-9f59-403dbefb952d req-45f339a7-2976-4248-8677-d70c8cc25a3f service nova] Creating event network-changed:fbee6877-612d-4443-9f16-5173fc6e0c75 for instance 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f on n-h2-760456-11 Jul 20 04:09:30.435322 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-6c52d887-7d89-49ab-9f59-403dbefb952d req-45f339a7-2976-4248-8677-d70c8cc25a3f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061855 Jul 20 04:09:30.436338 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 359/768] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:30.447688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5795b1cf-ca88-4e44-b60b-cd821f523440 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Calling method '.version_select at 0x7fb8424e6a60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:30.659587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fc9135b8-869e-4938-ad8e-0015edc92eca tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:30.669531 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fc9135b8-869e-4938-ad8e-0015edc92eca tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.668402 Jul 20 04:09:30.678831 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 410/769] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:29 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:30.678831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50643d62-007a-4247-9d5a-8e040868d873 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:30.678831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-50643d62-007a-4247-9d5a-8e040868d873 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:30.684993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50643d62-007a-4247-9d5a-8e040868d873 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.685933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50643d62-007a-4247-9d5a-8e040868d873 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:30.686241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50643d62-007a-4247-9d5a-8e040868d873 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:30.688127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50643d62-007a-4247-9d5a-8e040868d873 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.012150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-50643d62-007a-4247-9d5a-8e040868d873 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:31.032847 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-50643d62-007a-4247-9d5a-8e040868d873 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1471 microversion: 2.1 time: 0.360882 Jul 20 04:09:31.034755 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 411/770] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:30 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:31.041734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-aee06399-c5d9-4ed9-8ca0-4ae9cb260a86 req-da0c78b2-82cb-4313-96cb-283ed0ce67f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be", "tag": "44018208-b4ae-4293-8a0f-afbf74fba179"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:31.051892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-aee06399-c5d9-4ed9-8ca0-4ae9cb260a86 req-da0c78b2-82cb-4313-96cb-283ed0ce67f7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.052694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-aee06399-c5d9-4ed9-8ca0-4ae9cb260a86 req-da0c78b2-82cb-4313-96cb-283ed0ce67f7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.074475 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-aee06399-c5d9-4ed9-8ca0-4ae9cb260a86 req-da0c78b2-82cb-4313-96cb-283ed0ce67f7 service nova] Creating event network-changed:44018208-b4ae-4293-8a0f-afbf74fba179 for instance 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be on n-h1-760456-11 Jul 20 04:09:31.083061 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-aee06399-c5d9-4ed9-8ca0-4ae9cb260a86 req-da0c78b2-82cb-4313-96cb-283ed0ce67f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045527 Jul 20 04:09:31.085231 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 412/771] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:31.092975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-27462c8e-2b93-4541-baf9-ac6f57d8a8df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:31.094059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-27462c8e-2b93-4541-baf9-ac6f57d8a8df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:31.105966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27462c8e-2b93-4541-baf9-ac6f57d8a8df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.106946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27462c8e-2b93-4541-baf9-ac6f57d8a8df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.108824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27462c8e-2b93-4541-baf9-ac6f57d8a8df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.110269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27462c8e-2b93-4541-baf9-ac6f57d8a8df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.412044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-27462c8e-2b93-4541-baf9-ac6f57d8a8df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:31.442692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:31.455431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-27462c8e-2b93-4541-baf9-ac6f57d8a8df tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.367298 Jul 20 04:09:31.467213 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 413/772] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:31 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:31.475758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ad55926f-cdfa-40ee-a056-78f19ad51797 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:31.477592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ad55926f-cdfa-40ee-a056-78f19ad51797 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:31.483953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad55926f-cdfa-40ee-a056-78f19ad51797 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.484424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad55926f-cdfa-40ee-a056-78f19ad51797 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.485427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad55926f-cdfa-40ee-a056-78f19ad51797 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.486361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad55926f-cdfa-40ee-a056-78f19ad51797 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.775446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ad55926f-cdfa-40ee-a056-78f19ad51797 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:31.791040 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ad55926f-cdfa-40ee-a056-78f19ad51797 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1319 microversion: 2.1 time: 0.322617 Jul 20 04:09:31.791844 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 414/773] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:31 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:31.797010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6cc53d4c-2c74-4da6-82c9-90d9dbfe56e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:31.801791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6cc53d4c-2c74-4da6-82c9-90d9dbfe56e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:31.811728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cc53d4c-2c74-4da6-82c9-90d9dbfe56e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.812479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cc53d4c-2c74-4da6-82c9-90d9dbfe56e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.814452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cc53d4c-2c74-4da6-82c9-90d9dbfe56e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:31.815074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cc53d4c-2c74-4da6-82c9-90d9dbfe56e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:31.884689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=18 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:32.024674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6cc53d4c-2c74-4da6-82c9-90d9dbfe56e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:32.035782 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6cc53d4c-2c74-4da6-82c9-90d9dbfe56e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.242112 Jul 20 04:09:32.048154 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 415/774] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:31 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:32.053423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e3b8a903-9fd5-4e88-b9a7-313a700f7480 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:32.055258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e3b8a903-9fd5-4e88-b9a7-313a700f7480 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:32.063802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3b8a903-9fd5-4e88-b9a7-313a700f7480 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:32.064926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3b8a903-9fd5-4e88-b9a7-313a700f7480 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:32.066058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3b8a903-9fd5-4e88-b9a7-313a700f7480 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:32.066541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3b8a903-9fd5-4e88-b9a7-313a700f7480 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:32.185601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:32.301930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e3b8a903-9fd5-4e88-b9a7-313a700f7480 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:32.313529 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e3b8a903-9fd5-4e88-b9a7-313a700f7480 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1471 microversion: 2.1 time: 0.263833 Jul 20 04:09:32.323609 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 416/775] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:32 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1471 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:32.470691 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5795b1cf-ca88-4e44-b60b-cd821f523440 tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/db3c06ee-acd2-424f-840c-dbedce21c456" status: 202 len: 0 microversion: 2.1 time: 2.032723 Jul 20 04:09:32.473704 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 360/776] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:09:30 2022] DELETE /compute/v2.1/os-floating-ips/db3c06ee-acd2-424f-840c-dbedce21c456 => generated 0 bytes in 2037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:32.480356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1e236060-0b4f-4743-81e5-3cb19d829e0b tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:32.482181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1e236060-0b4f-4743-81e5-3cb19d829e0b tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:32.490403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e236060-0b4f-4743-81e5-3cb19d829e0b tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:32.491370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e236060-0b4f-4743-81e5-3cb19d829e0b tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:32.492856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e236060-0b4f-4743-81e5-3cb19d829e0b tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:32.493529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e236060-0b4f-4743-81e5-3cb19d829e0b tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:32.531631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-327685762", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "aca274f9-d664-47a2-aeef-a3985bda5141"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:32.584647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-1e236060-0b4f-4743-81e5-3cb19d829e0b tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:32.596341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] validate_networks() for [('aca274f9-d664-47a2-aeef-a3985bda5141', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:09:32.607029 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1e236060-0b4f-4743-81e5-3cb19d829e0b tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.131899 Jul 20 04:09:32.619776 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 361/777] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:32 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:32.625855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd2298f4-2a44-4011-a798-e5d90fba992b tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Calling method '.version_select at 0x7fb84231a550>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:33.236483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:33.237027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:33.237555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:33.238173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:33.238840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:33.250340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.260398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.261345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.263022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.288052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Getting quotas for project 1ec8a3f7a123436c825135d50dd93865. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:33.298761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Getting quotas for user 04547e35c8c541af914c30e9083cda85 and project 1ec8a3f7a123436c825135d50dd93865. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:33.333831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:33.337280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:09:33.345059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:09:33.420548 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e67e19bb-d5e0-46c9-b3ee-0abb097ae405 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082278 Jul 20 04:09:33.421550 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 417/778] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:09:33.426714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4600e3c0-05e8-4eee-9d91-3670222ede0c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:33.427346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4600e3c0-05e8-4eee-9d91-3670222ede0c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:33.441413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4600e3c0-05e8-4eee-9d91-3670222ede0c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.441914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4600e3c0-05e8-4eee-9d91-3670222ede0c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.442789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4600e3c0-05e8-4eee-9d91-3670222ede0c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.443239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4600e3c0-05e8-4eee-9d91-3670222ede0c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.832223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4600e3c0-05e8-4eee-9d91-3670222ede0c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:33.842538 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4600e3c0-05e8-4eee-9d91-3670222ede0c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1319 microversion: 2.1 time: 0.419675 Jul 20 04:09:33.856923 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 418/779] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:33 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:33.863401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-880db1dd-2dc0-40da-9e22-01302a0db682 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:33.864821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-880db1dd-2dc0-40da-9e22-01302a0db682 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:33.874665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-880db1dd-2dc0-40da-9e22-01302a0db682 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.875572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-880db1dd-2dc0-40da-9e22-01302a0db682 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:33.877143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-880db1dd-2dc0-40da-9e22-01302a0db682 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:33.877779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-880db1dd-2dc0-40da-9e22-01302a0db682 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.157171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=24 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:34.245226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=10 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:34.487602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-880db1dd-2dc0-40da-9e22-01302a0db682 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:34.497883 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-880db1dd-2dc0-40da-9e22-01302a0db682 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.639283 Jul 20 04:09:34.499347 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 419/780] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:33 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:34.505545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4dd643e0-2d25-4d03-b68a-bb1d8a10bbda tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:34.507034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4dd643e0-2d25-4d03-b68a-bb1d8a10bbda tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:34.517628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dd643e0-2d25-4d03-b68a-bb1d8a10bbda tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.518820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dd643e0-2d25-4d03-b68a-bb1d8a10bbda tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.520101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dd643e0-2d25-4d03-b68a-bb1d8a10bbda tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.521419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dd643e0-2d25-4d03-b68a-bb1d8a10bbda tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.836470 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd2298f4-2a44-4011-a798-e5d90fba992b tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/c8bdec77-98c3-4bf3-a442-33ecff81a375" status: 202 len: 0 microversion: 2.1 time: 2.216128 Jul 20 04:09:34.838761 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 362/781] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:09:32 2022] DELETE /compute/v2.1/os-floating-ips/c8bdec77-98c3-4bf3-a442-33ecff81a375 => generated 0 bytes in 2218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:34.844222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d7df2b31-3bc2-4673-b640-d6bb05f37409 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:34.845035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d7df2b31-3bc2-4673-b640-d6bb05f37409 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:34.849029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4dd643e0-2d25-4d03-b68a-bb1d8a10bbda tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:34.852018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7df2b31-3bc2-4673-b640-d6bb05f37409 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.852626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7df2b31-3bc2-4673-b640-d6bb05f37409 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.853421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7df2b31-3bc2-4673-b640-d6bb05f37409 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.853866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7df2b31-3bc2-4673-b640-d6bb05f37409 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.860265 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4dd643e0-2d25-4d03-b68a-bb1d8a10bbda tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1471 microversion: 2.1 time: 0.359108 Jul 20 04:09:34.861566 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 420/782] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:34 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1471 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:34.866186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26acd580-dec1-4a4d-ae4f-393805bad795 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:34.867606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26acd580-dec1-4a4d-ae4f-393805bad795 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:34.874546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26acd580-dec1-4a4d-ae4f-393805bad795 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.875197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26acd580-dec1-4a4d-ae4f-393805bad795 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.876063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26acd580-dec1-4a4d-ae4f-393805bad795 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:34.876574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26acd580-dec1-4a4d-ae4f-393805bad795 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:34.968421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-26acd580-dec1-4a4d-ae4f-393805bad795 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:34.981356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d7df2b31-3bc2-4673-b640-d6bb05f37409 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:34.996113 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d7df2b31-3bc2-4673-b640-d6bb05f37409 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1262 microversion: 2.1 time: 0.155859 Jul 20 04:09:35.006276 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 363/783] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:34 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:35.011506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c1d87a48-d518-4fb6-9f87-24e651f6cedc tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] Calling method '.version_select at 0x7fb842449c10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:35.030875 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26acd580-dec1-4a4d-ae4f-393805bad795 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.167901 Jul 20 04:09:35.045298 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 421/784] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:34 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:35.050833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d9b1f60-91e9-4a4f-8716-81c8297f01c2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:35.051747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7d9b1f60-91e9-4a4f-8716-81c8297f01c2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:35.060637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d9b1f60-91e9-4a4f-8716-81c8297f01c2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.064251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d9b1f60-91e9-4a4f-8716-81c8297f01c2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.065364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d9b1f60-91e9-4a4f-8716-81c8297f01c2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.065974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d9b1f60-91e9-4a4f-8716-81c8297f01c2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.239023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7d9b1f60-91e9-4a4f-8716-81c8297f01c2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:35.248881 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d9b1f60-91e9-4a4f-8716-81c8297f01c2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1319 microversion: 2.1 time: 0.202034 Jul 20 04:09:35.260179 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 422/785] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:35 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:35.516087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6183179c-3040-46af-99da-dd8590a6d140 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:35.516817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6183179c-3040-46af-99da-dd8590a6d140 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:35.524873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6183179c-3040-46af-99da-dd8590a6d140 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.526349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6183179c-3040-46af-99da-dd8590a6d140 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.527247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6183179c-3040-46af-99da-dd8590a6d140 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.528024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6183179c-3040-46af-99da-dd8590a6d140 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.752647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6183179c-3040-46af-99da-dd8590a6d140 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:35.762754 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6183179c-3040-46af-99da-dd8590a6d140 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.251070 Jul 20 04:09:35.763982 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 423/786] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:35 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:35.880328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d368d2f-99f4-4e7e-bab4-544ec703cfdd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:35.880911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7d368d2f-99f4-4e7e-bab4-544ec703cfdd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:35.887744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d368d2f-99f4-4e7e-bab4-544ec703cfdd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.888200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d368d2f-99f4-4e7e-bab4-544ec703cfdd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:35.889186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d368d2f-99f4-4e7e-bab4-544ec703cfdd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:35.889636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d368d2f-99f4-4e7e-bab4-544ec703cfdd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.093465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7d368d2f-99f4-4e7e-bab4-544ec703cfdd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:36.103283 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d368d2f-99f4-4e7e-bab4-544ec703cfdd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.226717 Jul 20 04:09:36.113060 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 424/787] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:35 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:36.113060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9938d54e-d9de-4a62-97b4-8ecc68ded729 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.113060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9938d54e-d9de-4a62-97b4-8ecc68ded729 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:36.116564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9938d54e-d9de-4a62-97b4-8ecc68ded729 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.117293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9938d54e-d9de-4a62-97b4-8ecc68ded729 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.118119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9938d54e-d9de-4a62-97b4-8ecc68ded729 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.118789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9938d54e-d9de-4a62-97b4-8ecc68ded729 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.239643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9938d54e-d9de-4a62-97b4-8ecc68ded729 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:36.256991 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9938d54e-d9de-4a62-97b4-8ecc68ded729 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1268 microversion: 2.1 time: 0.151017 Jul 20 04:09:36.258426 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 425/788] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:36 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:36.273617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a384fbd1-5011-4f8e-acf9-6aa0c238bdee tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.274746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a384fbd1-5011-4f8e-acf9-6aa0c238bdee tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:36.282324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a384fbd1-5011-4f8e-acf9-6aa0c238bdee tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.283798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a384fbd1-5011-4f8e-acf9-6aa0c238bdee tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.284933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a384fbd1-5011-4f8e-acf9-6aa0c238bdee tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.285619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a384fbd1-5011-4f8e-acf9-6aa0c238bdee tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.407004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-a384fbd1-5011-4f8e-acf9-6aa0c238bdee tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:36.431524 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a384fbd1-5011-4f8e-acf9-6aa0c238bdee tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.163090 Jul 20 04:09:36.444729 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 426/789] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:36 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:36.447718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-25967826-a104-492c-8b29-bb50602b98d8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.448603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-25967826-a104-492c-8b29-bb50602b98d8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:36.458566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25967826-a104-492c-8b29-bb50602b98d8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.459395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25967826-a104-492c-8b29-bb50602b98d8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.461106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25967826-a104-492c-8b29-bb50602b98d8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.462673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25967826-a104-492c-8b29-bb50602b98d8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.635464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-25967826-a104-492c-8b29-bb50602b98d8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:36.655213 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-25967826-a104-492c-8b29-bb50602b98d8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1319 microversion: 2.1 time: 0.212083 Jul 20 04:09:36.656410 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 427/790] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:36 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:36.782935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-138ef45e-f0ca-4b55-a07c-ca52c786549d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:36.785083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-138ef45e-f0ca-4b55-a07c-ca52c786549d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:36.793897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-138ef45e-f0ca-4b55-a07c-ca52c786549d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.794917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-138ef45e-f0ca-4b55-a07c-ca52c786549d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:36.795920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-138ef45e-f0ca-4b55-a07c-ca52c786549d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:36.796551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-138ef45e-f0ca-4b55-a07c-ca52c786549d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.033121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-138ef45e-f0ca-4b55-a07c-ca52c786549d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:37.058834 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-138ef45e-f0ca-4b55-a07c-ca52c786549d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.281534 Jul 20 04:09:37.063509 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 428/791] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:36 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:37.081034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-34598097-6653-4efe-9ae0-fc41538360fd req-57661da0-b7fc-4290-af4b-1c6c3e979679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7c31d1-d04a-443f-a3e2-c0aac27ac60f", "name": "network-vif-plugged", "status": "completed", "tag": "fbee6877-612d-4443-9f16-5173fc6e0c75"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:37.097573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-34598097-6653-4efe-9ae0-fc41538360fd req-57661da0-b7fc-4290-af4b-1c6c3e979679 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.098029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-34598097-6653-4efe-9ae0-fc41538360fd req-57661da0-b7fc-4290-af4b-1c6c3e979679 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.129424 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-34598097-6653-4efe-9ae0-fc41538360fd req-57661da0-b7fc-4290-af4b-1c6c3e979679 service nova] Creating event network-vif-plugged:fbee6877-612d-4443-9f16-5173fc6e0c75 for instance 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f on n-h2-760456-11 Jul 20 04:09:37.139673 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-34598097-6653-4efe-9ae0-fc41538360fd req-57661da0-b7fc-4290-af4b-1c6c3e979679 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060069 Jul 20 04:09:37.141789 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 429/792] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:37.157203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4594a606-cf97-4a51-9853-78db448dd11c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:37.162989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4594a606-cf97-4a51-9853-78db448dd11c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:37.179953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4594a606-cf97-4a51-9853-78db448dd11c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.180716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4594a606-cf97-4a51-9853-78db448dd11c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.182413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4594a606-cf97-4a51-9853-78db448dd11c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.183635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4594a606-cf97-4a51-9853-78db448dd11c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.231245 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c1d87a48-d518-4fb6-9f87-24e651f6cedc tempest-FloatingIPDetailsTestJSON-714987796 tempest-FloatingIPDetailsTestJSON-714987796-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/e5ac3975-323f-4691-a441-198f487f77a7" status: 202 len: 0 microversion: 2.1 time: 2.222146 Jul 20 04:09:37.236818 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 364/793] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:09:35 2022] DELETE /compute/v2.1/os-floating-ips/e5ac3975-323f-4691-a441-198f487f77a7 => generated 0 bytes in 2229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:37.277397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a01ea4d9-b8c3-40ae-bc3c-733d571e21e2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:37.278408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a01ea4d9-b8c3-40ae-bc3c-733d571e21e2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:37.287834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a01ea4d9-b8c3-40ae-bc3c-733d571e21e2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.293244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a01ea4d9-b8c3-40ae-bc3c-733d571e21e2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.294497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a01ea4d9-b8c3-40ae-bc3c-733d571e21e2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.295171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a01ea4d9-b8c3-40ae-bc3c-733d571e21e2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.935426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a01ea4d9-b8c3-40ae-bc3c-733d571e21e2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:37.949101 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a01ea4d9-b8c3-40ae-bc3c-733d571e21e2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1310 microversion: 2.1 time: 0.676614 Jul 20 04:09:37.951463 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 365/794] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:37 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1310 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:37.953247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4594a606-cf97-4a51-9853-78db448dd11c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:37.962514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5d640523-6659-4b13-98a9-609d8fbe5ed6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:37.963219 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4594a606-cf97-4a51-9853-78db448dd11c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.819041 Jul 20 04:09:37.963814 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 430/795] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:37 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:37.964324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5d640523-6659-4b13-98a9-609d8fbe5ed6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:37.974443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0b83b237-7ca8-4541-8b5b-8cd43d6291d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:37.975361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0b83b237-7ca8-4541-8b5b-8cd43d6291d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:37.985541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d640523-6659-4b13-98a9-609d8fbe5ed6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.987180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d640523-6659-4b13-98a9-609d8fbe5ed6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.988797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b83b237-7ca8-4541-8b5b-8cd43d6291d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.989472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d640523-6659-4b13-98a9-609d8fbe5ed6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.990059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d640523-6659-4b13-98a9-609d8fbe5ed6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.991438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b83b237-7ca8-4541-8b5b-8cd43d6291d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:37.996205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b83b237-7ca8-4541-8b5b-8cd43d6291d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:37.996826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b83b237-7ca8-4541-8b5b-8cd43d6291d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:38.009460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:38.158709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-5d640523-6659-4b13-98a9-609d8fbe5ed6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:38.198549 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5d640523-6659-4b13-98a9-609d8fbe5ed6 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1931 microversion: 2.75 time: 0.244101 Jul 20 04:09:38.201429 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 366/796] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:37 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1931 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:38.215939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc85f994-a8b5-4d5f-ba05-7983b3631f4e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:38.216131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cc85f994-a8b5-4d5f-ba05-7983b3631f4e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:38.230020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc85f994-a8b5-4d5f-ba05-7983b3631f4e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:38.239873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc85f994-a8b5-4d5f-ba05-7983b3631f4e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:38.240927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc85f994-a8b5-4d5f-ba05-7983b3631f4e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:38.241373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc85f994-a8b5-4d5f-ba05-7983b3631f4e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:38.501971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0b83b237-7ca8-4541-8b5b-8cd43d6291d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:38.511737 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0b83b237-7ca8-4541-8b5b-8cd43d6291d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1319 microversion: 2.1 time: 0.546858 Jul 20 04:09:38.512322 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 431/797] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:37 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:38.583871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cc85f994-a8b5-4d5f-ba05-7983b3631f4e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:38.596609 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cc85f994-a8b5-4d5f-ba05-7983b3631f4e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.393906 Jul 20 04:09:38.599476 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 367/798] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:38 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:38.974503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7448fc1c-da2e-4344-a222-86c9ed350791 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:38.977141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7448fc1c-da2e-4344-a222-86c9ed350791 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:38.984800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f2507444-e2b4-48f6-9624-e595a4f8329b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:38.986400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f2507444-e2b4-48f6-9624-e595a4f8329b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:39.014878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2507444-e2b4-48f6-9624-e595a4f8329b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.017198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7448fc1c-da2e-4344-a222-86c9ed350791 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.018010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2507444-e2b4-48f6-9624-e595a4f8329b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.019417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2507444-e2b4-48f6-9624-e595a4f8329b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.038181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7448fc1c-da2e-4344-a222-86c9ed350791 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.040423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7448fc1c-da2e-4344-a222-86c9ed350791 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.041841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7448fc1c-da2e-4344-a222-86c9ed350791 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.046974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2507444-e2b4-48f6-9624-e595a4f8329b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.488292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f2507444-e2b4-48f6-9624-e595a4f8329b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:39.511828 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f2507444-e2b4-48f6-9624-e595a4f8329b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.530167 Jul 20 04:09:39.524621 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 368/799] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:38 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:39.529826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2419cdf7-09e5-4114-858f-e5cf1bc65456 req-299b16b6-7e41-40fb-9bf8-e8ea59005e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be", "name": "network-vif-plugged", "status": "completed", "tag": "44018208-b4ae-4293-8a0f-afbf74fba179"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:39.565084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2419cdf7-09e5-4114-858f-e5cf1bc65456 req-299b16b6-7e41-40fb-9bf8-e8ea59005e8d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.566838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2419cdf7-09e5-4114-858f-e5cf1bc65456 req-299b16b6-7e41-40fb-9bf8-e8ea59005e8d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.588006 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2419cdf7-09e5-4114-858f-e5cf1bc65456 req-299b16b6-7e41-40fb-9bf8-e8ea59005e8d service nova] Creating event network-vif-plugged:44018208-b4ae-4293-8a0f-afbf74fba179 for instance 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be on n-h1-760456-11 Jul 20 04:09:39.608401 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2419cdf7-09e5-4114-858f-e5cf1bc65456 req-299b16b6-7e41-40fb-9bf8-e8ea59005e8d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077672 Jul 20 04:09:39.613414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 369/800] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:39.629898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1191e703-157f-49a5-af37-ef6cfc9c20f1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:39.631774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1191e703-157f-49a5-af37-ef6cfc9c20f1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:39.642517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1191e703-157f-49a5-af37-ef6cfc9c20f1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.643276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1191e703-157f-49a5-af37-ef6cfc9c20f1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.644243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1191e703-157f-49a5-af37-ef6cfc9c20f1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.645123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1191e703-157f-49a5-af37-ef6cfc9c20f1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.747953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7448fc1c-da2e-4344-a222-86c9ed350791 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:39.758230 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7448fc1c-da2e-4344-a222-86c9ed350791 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1310 microversion: 2.1 time: 0.790415 Jul 20 04:09:39.762994 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 432/801] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:38 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1310 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:39.767988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2838c5bd-a16b-44ac-8fe3-8e263ea080ec req-a221baaa-24fc-4e93-94e3-04da1aecc89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd742b1-082a-4a00-b6af-75b41ac08235", "tag": "0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:39.790917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2838c5bd-a16b-44ac-8fe3-8e263ea080ec req-a221baaa-24fc-4e93-94e3-04da1aecc89c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.795173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2838c5bd-a16b-44ac-8fe3-8e263ea080ec req-a221baaa-24fc-4e93-94e3-04da1aecc89c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.796321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-1191e703-157f-49a5-af37-ef6cfc9c20f1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:39.816822 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2838c5bd-a16b-44ac-8fe3-8e263ea080ec req-a221baaa-24fc-4e93-94e3-04da1aecc89c service nova] Creating event network-changed:0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e for instance 0dd742b1-082a-4a00-b6af-75b41ac08235 on n-h2-760456-11 Jul 20 04:09:39.833112 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2838c5bd-a16b-44ac-8fe3-8e263ea080ec req-a221baaa-24fc-4e93-94e3-04da1aecc89c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068472 Jul 20 04:09:39.834567 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1191e703-157f-49a5-af37-ef6cfc9c20f1 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1937 microversion: 2.75 time: 0.219780 Jul 20 04:09:39.834749 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 433/802] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:39.837990 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 370/803] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:39 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1937 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:39.842854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f73c850c-20ae-44a3-a539-0793d7a1c9f6 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:39.848571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f73c850c-20ae-44a3-a539-0793d7a1c9f6 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:39.850602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-791f90c6-37c7-4ef1-9574-273481073d78 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:39.852268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-791f90c6-37c7-4ef1-9574-273481073d78 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:39.862286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f73c850c-20ae-44a3-a539-0793d7a1c9f6 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.862506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-791f90c6-37c7-4ef1-9574-273481073d78 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.862965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-791f90c6-37c7-4ef1-9574-273481073d78 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.863760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-791f90c6-37c7-4ef1-9574-273481073d78 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.864209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-791f90c6-37c7-4ef1-9574-273481073d78 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.874061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f73c850c-20ae-44a3-a539-0793d7a1c9f6 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:39.875425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f73c850c-20ae-44a3-a539-0793d7a1c9f6 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:39.876097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f73c850c-20ae-44a3-a539-0793d7a1c9f6 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.129929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f73c850c-20ae-44a3-a539-0793d7a1c9f6 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:40.142940 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f73c850c-20ae-44a3-a539-0793d7a1c9f6 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.303469 Jul 20 04:09:40.143814 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 371/804] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:39 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:40.401061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-791f90c6-37c7-4ef1-9574-273481073d78 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:40.413903 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-791f90c6-37c7-4ef1-9574-273481073d78 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1319 microversion: 2.1 time: 0.576201 Jul 20 04:09:40.415386 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 434/805] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:39 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:40.531307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-622fcc5e-5a79-45db-b1a3-e26df598df89 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.532092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-622fcc5e-5a79-45db-b1a3-e26df598df89 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:40.542094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-622fcc5e-5a79-45db-b1a3-e26df598df89 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.542913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-622fcc5e-5a79-45db-b1a3-e26df598df89 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.544103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-622fcc5e-5a79-45db-b1a3-e26df598df89 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.544762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-622fcc5e-5a79-45db-b1a3-e26df598df89 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.761126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-622fcc5e-5a79-45db-b1a3-e26df598df89 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:40.775096 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-622fcc5e-5a79-45db-b1a3-e26df598df89 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.248754 Jul 20 04:09:40.784143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9098ade-2ead-493e-ad08-214dfe0523c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.785319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9098ade-2ead-493e-ad08-214dfe0523c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:40.801022 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 372/806] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:40 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:40.803085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9098ade-2ead-493e-ad08-214dfe0523c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.803774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9098ade-2ead-493e-ad08-214dfe0523c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.805650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9098ade-2ead-493e-ad08-214dfe0523c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.806280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9098ade-2ead-493e-ad08-214dfe0523c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.858384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36e074d6-becb-42bb-8dc8-a090fcfae30a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:40.858992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-36e074d6-becb-42bb-8dc8-a090fcfae30a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:40.867088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36e074d6-becb-42bb-8dc8-a090fcfae30a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.867653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36e074d6-becb-42bb-8dc8-a090fcfae30a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.868447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36e074d6-becb-42bb-8dc8-a090fcfae30a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:40.869143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36e074d6-becb-42bb-8dc8-a090fcfae30a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:40.954164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-36e074d6-becb-42bb-8dc8-a090fcfae30a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:40.972913 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-36e074d6-becb-42bb-8dc8-a090fcfae30a tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1937 microversion: 2.75 time: 0.119202 Jul 20 04:09:40.973508 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 373/807] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:40 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1937 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:09:41.160823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-12fd2154-2eae-4880-95d1-9bc893d7dcdd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:41.161444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-12fd2154-2eae-4880-95d1-9bc893d7dcdd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:41.168234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12fd2154-2eae-4880-95d1-9bc893d7dcdd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.168695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12fd2154-2eae-4880-95d1-9bc893d7dcdd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.169568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12fd2154-2eae-4880-95d1-9bc893d7dcdd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.170260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12fd2154-2eae-4880-95d1-9bc893d7dcdd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.371411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-12fd2154-2eae-4880-95d1-9bc893d7dcdd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:41.376825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9098ade-2ead-493e-ad08-214dfe0523c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:41.382149 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-12fd2154-2eae-4880-95d1-9bc893d7dcdd tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.222973 Jul 20 04:09:41.391638 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 374/808] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:41 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:41.396851 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9098ade-2ead-493e-ad08-214dfe0523c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1310 microversion: 2.1 time: 0.620239 Jul 20 04:09:41.407185 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 435/809] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:40 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1310 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:09:41.436447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c343c27-ba9a-4827-af33-e8cbd80e84bc tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:41.437059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8c343c27-ba9a-4827-af33-e8cbd80e84bc tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:41.444554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c343c27-ba9a-4827-af33-e8cbd80e84bc tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.445210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c343c27-ba9a-4827-af33-e8cbd80e84bc tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.446167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c343c27-ba9a-4827-af33-e8cbd80e84bc tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.446823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c343c27-ba9a-4827-af33-e8cbd80e84bc tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.667779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8c343c27-ba9a-4827-af33-e8cbd80e84bc tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:41.672113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:41.676408 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c343c27-ba9a-4827-af33-e8cbd80e84bc tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1319 microversion: 2.1 time: 0.243903 Jul 20 04:09:41.677547 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 375/810] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:41 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:41.807428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7decd9d2-0880-4c89-a0b0-e9dc9029b772 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:41.808049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7decd9d2-0880-4c89-a0b0-e9dc9029b772 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:41.815146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7decd9d2-0880-4c89-a0b0-e9dc9029b772 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.815943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7decd9d2-0880-4c89-a0b0-e9dc9029b772 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.816965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7decd9d2-0880-4c89-a0b0-e9dc9029b772 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:41.817480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7decd9d2-0880-4c89-a0b0-e9dc9029b772 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:41.994560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-281924da-dfe1-478a-a0c8-de5be590f749 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:41.995175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-281924da-dfe1-478a-a0c8-de5be590f749 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:42.003170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-281924da-dfe1-478a-a0c8-de5be590f749 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.003627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-281924da-dfe1-478a-a0c8-de5be590f749 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.004420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-281924da-dfe1-478a-a0c8-de5be590f749 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.004861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-281924da-dfe1-478a-a0c8-de5be590f749 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.116053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-281924da-dfe1-478a-a0c8-de5be590f749 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] Lazy-loading 'services' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:42.152137 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-281924da-dfe1-478a-a0c8-de5be590f749 tempest-ServersAdmin275Test-1185963347 tempest-ServersAdmin275Test-1185963347-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1922 microversion: 2.75 time: 0.161465 Jul 20 04:09:42.154329 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 376/811] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:41 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1922 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:42.185572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6252181b-58e9-4837-9075-94866031ff0c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:42.186294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6252181b-58e9-4837-9075-94866031ff0c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:42.194093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6252181b-58e9-4837-9075-94866031ff0c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.195367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6252181b-58e9-4837-9075-94866031ff0c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.199993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6252181b-58e9-4837-9075-94866031ff0c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.200900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6252181b-58e9-4837-9075-94866031ff0c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.234501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6252181b-58e9-4837-9075-94866031ff0c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:09:42.337521 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6252181b-58e9-4837-9075-94866031ff0c tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "DELETE /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 204 len: 0 microversion: 2.75 time: 0.156220 Jul 20 04:09:42.338344 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 377/812] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:09:42 2022] DELETE /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:09:42.344648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7decd9d2-0880-4c89-a0b0-e9dc9029b772 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:42.354592 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7decd9d2-0880-4c89-a0b0-e9dc9029b772 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.551503 Jul 20 04:09:42.365196 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 436/813] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:41 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:42.365501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bee668ff-7aa5-44bf-9024-d2efb5792408 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:42.365501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bee668ff-7aa5-44bf-9024-d2efb5792408 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:42.371032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bee668ff-7aa5-44bf-9024-d2efb5792408 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.373828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bee668ff-7aa5-44bf-9024-d2efb5792408 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.374690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bee668ff-7aa5-44bf-9024-d2efb5792408 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.375129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bee668ff-7aa5-44bf-9024-d2efb5792408 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.430396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd4e1506-2198-4fdd-ac00-2ca03a886927 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:42.431688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dd4e1506-2198-4fdd-ac00-2ca03a886927 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:42.443454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd4e1506-2198-4fdd-ac00-2ca03a886927 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.444285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd4e1506-2198-4fdd-ac00-2ca03a886927 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.446851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd4e1506-2198-4fdd-ac00-2ca03a886927 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.447556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd4e1506-2198-4fdd-ac00-2ca03a886927 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.457491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bee668ff-7aa5-44bf-9024-d2efb5792408 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:42.467775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bee668ff-7aa5-44bf-9024-d2efb5792408 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:42.469458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bee668ff-7aa5-44bf-9024-d2efb5792408 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:42.476747 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bee668ff-7aa5-44bf-9024-d2efb5792408 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1444 microversion: 2.75 time: 0.133343 Jul 20 04:09:42.489496 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 378/814] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:42 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1444 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:09:42.494638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-41b7d1a2-4f0e-483e-9f06-7f89cb10ed6d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:42.495551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-41b7d1a2-4f0e-483e-9f06-7f89cb10ed6d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:42.503311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41b7d1a2-4f0e-483e-9f06-7f89cb10ed6d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.504099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41b7d1a2-4f0e-483e-9f06-7f89cb10ed6d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.505238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41b7d1a2-4f0e-483e-9f06-7f89cb10ed6d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.505887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41b7d1a2-4f0e-483e-9f06-7f89cb10ed6d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.739572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-41b7d1a2-4f0e-483e-9f06-7f89cb10ed6d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:42.748063 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-41b7d1a2-4f0e-483e-9f06-7f89cb10ed6d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1310 microversion: 2.1 time: 0.268073 Jul 20 04:09:42.748655 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 379/815] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:42 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1310 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:42.775283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43e7c0f8-540b-45bb-b7b4-cf688a4e431c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:42.776175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43e7c0f8-540b-45bb-b7b4-cf688a4e431c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:42.789808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43e7c0f8-540b-45bb-b7b4-cf688a4e431c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.790438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43e7c0f8-540b-45bb-b7b4-cf688a4e431c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.791249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43e7c0f8-540b-45bb-b7b4-cf688a4e431c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:42.791912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43e7c0f8-540b-45bb-b7b4-cf688a4e431c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:42.988468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dd4e1506-2198-4fdd-ac00-2ca03a886927 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:42.997341 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dd4e1506-2198-4fdd-ac00-2ca03a886927 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.596572 Jul 20 04:09:43.000884 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 437/816] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:42 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:43.053564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-43e7c0f8-540b-45bb-b7b4-cf688a4e431c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:43.062129 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43e7c0f8-540b-45bb-b7b4-cf688a4e431c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1469 microversion: 2.1 time: 0.299125 Jul 20 04:09:43.068151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-849519e0-d17d-4e5e-b548-e13d366e7bde tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb84236cc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-418028416", "description": "tempest-description-853031539"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:43.086231 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 380/817] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:42 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1469 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:43.092810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4247e582-ca52-44a5-b38e-1fe5a5a204e9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:43.094007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4247e582-ca52-44a5-b38e-1fe5a5a204e9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:43.113359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4247e582-ca52-44a5-b38e-1fe5a5a204e9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.115883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4247e582-ca52-44a5-b38e-1fe5a5a204e9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.117047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4247e582-ca52-44a5-b38e-1fe5a5a204e9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.117502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4247e582-ca52-44a5-b38e-1fe5a5a204e9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.277020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:43.325041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:43.350438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4247e582-ca52-44a5-b38e-1fe5a5a204e9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:43.359394 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4247e582-ca52-44a5-b38e-1fe5a5a204e9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f" status: 200 len: 1468 microversion: 2.1 time: 0.271876 Jul 20 04:09:43.359989 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 381/818] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:43 2022] GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f => generated 1468 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:43.379714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b934d687-829c-42d3-bac4-33c9f7eb4940 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:43.381757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b934d687-829c-42d3-bac4-33c9f7eb4940 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:43.391198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b934d687-829c-42d3-bac4-33c9f7eb4940 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.391929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b934d687-829c-42d3-bac4-33c9f7eb4940 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.393019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b934d687-829c-42d3-bac4-33c9f7eb4940 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.393601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b934d687-829c-42d3-bac4-33c9f7eb4940 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.465410 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-849519e0-d17d-4e5e-b548-e13d366e7bde tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.463207 Jul 20 04:09:43.474285 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 438/819] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:09:43 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:43.479536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:43.483918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:43.485124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Searching by: {'reservation_id': 'r-sxcc2s1m', 'deleted': False, 'project_id': '95231a9d82164f88b1c6ff355679d292'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:09:43.495029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.495885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.496933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.497602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.557716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b934d687-829c-42d3-bac4-33c9f7eb4940 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:43.568712 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b934d687-829c-42d3-bac4-33c9f7eb4940 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.194937 Jul 20 04:09:43.568856 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 382/820] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:43 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:43.574474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8775b761-9300-46d6-883b-428a0af9a94c tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb84226eb80>, body: {"security_group_rule": {"parent_group_id": "14afee9d-0aad-4ba6-bb45-2b4faf278fab", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:43.628874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:09:43.721834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:43.733037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.733645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.821435 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8775b761-9300-46d6-883b-428a0af9a94c tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.251346 Jul 20 04:09:43.822492 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 383/821] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:09:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:43.829764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8aafa464-40c7-4e70-8e56-efe067938e3a tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:43.833920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8aafa464-40c7-4e70-8e56-efe067938e3a tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:43.858112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8aafa464-40c7-4e70-8e56-efe067938e3a tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.859393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8aafa464-40c7-4e70-8e56-efe067938e3a tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.860618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8aafa464-40c7-4e70-8e56-efe067938e3a tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:43.861280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8aafa464-40c7-4e70-8e56-efe067938e3a tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:43.988949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8aafa464-40c7-4e70-8e56-efe067938e3a tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:43.998999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8aafa464-40c7-4e70-8e56-efe067938e3a tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:44.000796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8aafa464-40c7-4e70-8e56-efe067938e3a tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:44.007603 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8aafa464-40c7-4e70-8e56-efe067938e3a tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1444 microversion: 2.75 time: 0.183695 Jul 20 04:09:44.009719 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 384/822] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:43 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1444 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:44.021549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38f22a60-d149-46f2-873b-1257e26ddd22 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:44.022676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-38f22a60-d149-46f2-873b-1257e26ddd22 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:44.026732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:44.043707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f22a60-d149-46f2-873b-1257e26ddd22 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.044665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f22a60-d149-46f2-873b-1257e26ddd22 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.046502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f22a60-d149-46f2-873b-1257e26ddd22 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.047449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f22a60-d149-46f2-873b-1257e26ddd22 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.219844 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1cfa17f9-97b8-4a1f-b6e9-c0bb3837a8b6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?reservation_id=r-sxcc2s1m" status: 200 len: 2930 microversion: 2.1 time: 0.739085 Jul 20 04:09:44.221794 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 439/823] 10.222.0.59 () {58 vars in 1196 bytes} [Wed Jul 20 04:09:43 2022] GET /compute/v2.1/servers/detail?reservation_id=r-sxcc2s1m => generated 2930 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:44.235441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-12a64f06-042f-4708-9a87-8e18f70df3a4 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb842317820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-117085136", "description": "tempest-description-1002531845"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:44.542621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-38f22a60-d149-46f2-873b-1257e26ddd22 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:44.558343 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-38f22a60-d149-46f2-873b-1257e26ddd22 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1310 microversion: 2.1 time: 0.547245 Jul 20 04:09:44.567404 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 385/824] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:44 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1310 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:44.576603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-28ff5ee6-7905-4153-8877-730161438d56 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:44.580444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-28ff5ee6-7905-4153-8877-730161438d56 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:44.600397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28ff5ee6-7905-4153-8877-730161438d56 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.601484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28ff5ee6-7905-4153-8877-730161438d56 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.602309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28ff5ee6-7905-4153-8877-730161438d56 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.602753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28ff5ee6-7905-4153-8877-730161438d56 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.604695 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-12a64f06-042f-4708-9a87-8e18f70df3a4 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.378046 Jul 20 04:09:44.614633 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 440/825] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:09:44 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:44.614633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b632583e-898e-49ef-aab6-4637d7aba4e8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:44.654314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.compute.server_groups [None req-b632583e-898e-49ef-aab6-4637d7aba4e8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Querying cell 0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) for 2 instances {{(pid=119606) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:09:44.655199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b632583e-898e-49ef-aab6-4637d7aba4e8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.655732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b632583e-898e-49ef-aab6-4637d7aba4e8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.703231 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b632583e-898e-49ef-aab6-4637d7aba4e8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups/ce3b350e-4517-4aab-9a1b-07c66910c1cb" status: 200 len: 270 microversion: 2.1 time: 0.092595 Jul 20 04:09:44.715695 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 441/826] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:09:44 2022] GET /compute/v2.1/os-server-groups/ce3b350e-4517-4aab-9a1b-07c66910c1cb => generated 270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:44.716240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-60e3d986-e3c2-4c8f-bdd0-90064122de92 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:44.716877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-60e3d986-e3c2-4c8f-bdd0-90064122de92 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:44.736131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60e3d986-e3c2-4c8f-bdd0-90064122de92 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.736653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60e3d986-e3c2-4c8f-bdd0-90064122de92 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.737401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60e3d986-e3c2-4c8f-bdd0-90064122de92 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.737850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60e3d986-e3c2-4c8f-bdd0-90064122de92 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.904562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-28ff5ee6-7905-4153-8877-730161438d56 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:44.922068 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-28ff5ee6-7905-4153-8877-730161438d56 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.361417 Jul 20 04:09:44.922775 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 386/827] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:44 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:44.936534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-60e3d986-e3c2-4c8f-bdd0-90064122de92 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:44.941062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f25d829a-c720-4a2e-ae2e-a9c29280bcde tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb84231ac10>, body: {"security_group_rule": {"parent_group_id": "5182a60d-b208-4d02-9759-b631ccbf587e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:44.948712 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-60e3d986-e3c2-4c8f-bdd0-90064122de92 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.236318 Jul 20 04:09:44.958678 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 442/828] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:44 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:44.958678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b447a511-ea98-4754-89c8-1f13b26d4fbb tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:44.958678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b447a511-ea98-4754-89c8-1f13b26d4fbb tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] [instance: 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:44.965271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b447a511-ea98-4754-89c8-1f13b26d4fbb tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.966070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b447a511-ea98-4754-89c8-1f13b26d4fbb tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:44.968060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b447a511-ea98-4754-89c8-1f13b26d4fbb tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:44.968735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b447a511-ea98-4754-89c8-1f13b26d4fbb tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.290844 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f25d829a-c720-4a2e-ae2e-a9c29280bcde tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.366273 Jul 20 04:09:45.300041 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 387/829] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:09:44 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:45.305569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-636c39eb-b9ff-4fdf-ad2c-a197f80b4edc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:45.307106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-636c39eb-b9ff-4fdf-ad2c-a197f80b4edc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:45.315988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-636c39eb-b9ff-4fdf-ad2c-a197f80b4edc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.316799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-636c39eb-b9ff-4fdf-ad2c-a197f80b4edc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.317878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-636c39eb-b9ff-4fdf-ad2c-a197f80b4edc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.318883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-636c39eb-b9ff-4fdf-ad2c-a197f80b4edc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.351919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-636c39eb-b9ff-4fdf-ad2c-a197f80b4edc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:09:45.448935 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-636c39eb-b9ff-4fdf-ad2c-a197f80b4edc tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 204 len: 0 microversion: 2.1 time: 0.147214 Jul 20 04:09:45.449599 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 388/830] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:09:45 2022] DELETE /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:09:45.457989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1adc3d07-55f9-435f-baf9-bf507bc0b2c9 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:45.458743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1adc3d07-55f9-435f-baf9-bf507bc0b2c9 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:45.465905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1adc3d07-55f9-435f-baf9-bf507bc0b2c9 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.466412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1adc3d07-55f9-435f-baf9-bf507bc0b2c9 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.467205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1adc3d07-55f9-435f-baf9-bf507bc0b2c9 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.467640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1adc3d07-55f9-435f-baf9-bf507bc0b2c9 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.560223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1adc3d07-55f9-435f-baf9-bf507bc0b2c9 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:45.571442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1adc3d07-55f9-435f-baf9-bf507bc0b2c9 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:45.573398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1adc3d07-55f9-435f-baf9-bf507bc0b2c9 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:45.580316 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1adc3d07-55f9-435f-baf9-bf507bc0b2c9 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1444 microversion: 2.75 time: 0.126738 Jul 20 04:09:45.581211 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 389/831] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:45 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1444 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:45.598909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d74e391a-c819-449f-9d15-ade44be25d6c req-e4f0b4ea-ce8e-4c21-8d87-50d90ff608ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd742b1-082a-4a00-b6af-75b41ac08235", "name": "network-vif-plugged", "status": "completed", "tag": "0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:45.603731 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b447a511-ea98-4754-89c8-1f13b26d4fbb tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f" status: 200 len: 1621 microversion: 2.1 time: 0.651268 Jul 20 04:09:45.605013 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 443/832] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:44 2022] GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f => generated 1621 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:45.609119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d74e391a-c819-449f-9d15-ade44be25d6c req-e4f0b4ea-ce8e-4c21-8d87-50d90ff608ef service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.609686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d74e391a-c819-449f-9d15-ade44be25d6c req-e4f0b4ea-ce8e-4c21-8d87-50d90ff608ef service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.610982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1effc9e-a540-41b3-bf73-4c0a1278a9fc tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb842355820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-270976724", "description": "tempest-description-288986400"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:45.622968 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d74e391a-c819-449f-9d15-ade44be25d6c req-e4f0b4ea-ce8e-4c21-8d87-50d90ff608ef service nova] Creating event network-vif-plugged:0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e for instance 0dd742b1-082a-4a00-b6af-75b41ac08235 on n-h2-760456-11 Jul 20 04:09:45.641518 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d74e391a-c819-449f-9d15-ade44be25d6c req-e4f0b4ea-ce8e-4c21-8d87-50d90ff608ef service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058539 Jul 20 04:09:45.643483 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 390/833] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:45.659341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01d5fdba-0792-4bc8-ad6b-9dd53145767a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:45.660279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-01d5fdba-0792-4bc8-ad6b-9dd53145767a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:45.669680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01d5fdba-0792-4bc8-ad6b-9dd53145767a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.670304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01d5fdba-0792-4bc8-ad6b-9dd53145767a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.671197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01d5fdba-0792-4bc8-ad6b-9dd53145767a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.671758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01d5fdba-0792-4bc8-ad6b-9dd53145767a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.700279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:45.948266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-01d5fdba-0792-4bc8-ad6b-9dd53145767a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:45.956139 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01d5fdba-0792-4bc8-ad6b-9dd53145767a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1714 microversion: 2.1 time: 0.311417 Jul 20 04:09:45.956679 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 391/834] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:45 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1714 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:45.962530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7a50b1b7-df87-4494-87fa-a1bb0c6ed1eb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:45.963373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7a50b1b7-df87-4494-87fa-a1bb0c6ed1eb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:45.969336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a50b1b7-df87-4494-87fa-a1bb0c6ed1eb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.969786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a50b1b7-df87-4494-87fa-a1bb0c6ed1eb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:45.970585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a50b1b7-df87-4494-87fa-a1bb0c6ed1eb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:45.971034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a50b1b7-df87-4494-87fa-a1bb0c6ed1eb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.026370 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1effc9e-a540-41b3-bf73-4c0a1278a9fc tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.419397 Jul 20 04:09:46.028788 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 444/835] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:09:45 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:46.037396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-81392f70-2bee-4375-a86e-53926e2b386f tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:46.039735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-81392f70-2bee-4375-a86e-53926e2b386f tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:46.052224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81392f70-2bee-4375-a86e-53926e2b386f tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.053082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81392f70-2bee-4375-a86e-53926e2b386f tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.054901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81392f70-2bee-4375-a86e-53926e2b386f tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.055737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81392f70-2bee-4375-a86e-53926e2b386f tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.122709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7a50b1b7-df87-4494-87fa-a1bb0c6ed1eb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:46.135150 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7a50b1b7-df87-4494-87fa-a1bb0c6ed1eb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1310 microversion: 2.1 time: 0.177232 Jul 20 04:09:46.167343 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 392/836] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:45 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1310 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:46.173177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2aee3301-59cd-42e1-afbd-8318608787e3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:46.173965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2aee3301-59cd-42e1-afbd-8318608787e3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:46.182652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2aee3301-59cd-42e1-afbd-8318608787e3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.183432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2aee3301-59cd-42e1-afbd-8318608787e3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.184351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2aee3301-59cd-42e1-afbd-8318608787e3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.184863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2aee3301-59cd-42e1-afbd-8318608787e3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.245631 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-81392f70-2bee-4375-a86e-53926e2b386f tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 200 len: 1622 microversion: 2.1 time: 0.215445 Jul 20 04:09:46.262536 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 445/837] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:46 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 1622 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:46.270619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c4eabcd-3715-4a6e-b907-ee8552bd1536 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:46.271496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5c4eabcd-3715-4a6e-b907-ee8552bd1536 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:46.279123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c4eabcd-3715-4a6e-b907-ee8552bd1536 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.279769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c4eabcd-3715-4a6e-b907-ee8552bd1536 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.280848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c4eabcd-3715-4a6e-b907-ee8552bd1536 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.281432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c4eabcd-3715-4a6e-b907-ee8552bd1536 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.456195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2aee3301-59cd-42e1-afbd-8318608787e3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:46.470885 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2aee3301-59cd-42e1-afbd-8318608787e3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1472 microversion: 2.1 time: 0.296199 Jul 20 04:09:46.471534 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 393/838] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:46 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1472 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:46.485381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b99dc83c-d7a9-4439-87b1-0ae80b90b1c3 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb842701700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1152668091", "description": "tempest-description-1163151831"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:46.519577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5c4eabcd-3715-4a6e-b907-ee8552bd1536 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:46.530167 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5c4eabcd-3715-4a6e-b907-ee8552bd1536 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.265695 Jul 20 04:09:46.530708 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 446/839] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:46 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:46.535425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-52590837", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "cc16be0b-acc6-4bec-997a-2f0026a5500e"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:46.614538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:09:46.828689 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b99dc83c-d7a9-4439-87b1-0ae80b90b1c3 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.355932 Jul 20 04:09:46.830645 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 394/840] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:09:46 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:46.842697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9f21922e-fd22-4edf-8780-577daaea6774 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:46.845616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9f21922e-fd22-4edf-8780-577daaea6774 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:46.860998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f21922e-fd22-4edf-8780-577daaea6774 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.861750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f21922e-fd22-4edf-8780-577daaea6774 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.862781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f21922e-fd22-4edf-8780-577daaea6774 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.864393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f21922e-fd22-4edf-8780-577daaea6774 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.865769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:46.866454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:46.868113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:46.868664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:46.869192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:46.893557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.894346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.895750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:46.896300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:46.926196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:46.932565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:46.949122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:09:46.951651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:09:46.965310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9f21922e-fd22-4edf-8780-577daaea6774 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:46.982445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9f21922e-fd22-4edf-8780-577daaea6774 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:46.989832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9f21922e-fd22-4edf-8780-577daaea6774 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:46.999605 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9f21922e-fd22-4edf-8780-577daaea6774 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1444 microversion: 2.75 time: 0.167502 Jul 20 04:09:47.007658 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 395/841] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:46 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1444 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:47.017189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-20179dd7-eb43-4cfa-8144-48fa3f2ec726 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb842371310>, body: {"security_group_rule": {"parent_group_id": "f428e768-f63b-47c2-b24a-9f2396f89350", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5eeb21e4-92d6-4a23-ae88-ec44e430cccd"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:47.052812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-913fb044-04dd-4b93-b45f-a6bf8a1ad76f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520828 Jul 20 04:09:47.055541 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 447/842] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:09:47.088683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c1fc0575-6221-4e48-a60e-20e643b9e890 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:47.097040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c1fc0575-6221-4e48-a60e-20e643b9e890 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:47.111933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1fc0575-6221-4e48-a60e-20e643b9e890 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.113100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1fc0575-6221-4e48-a60e-20e643b9e890 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.114111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1fc0575-6221-4e48-a60e-20e643b9e890 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.114751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1fc0575-6221-4e48-a60e-20e643b9e890 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.572972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c1fc0575-6221-4e48-a60e-20e643b9e890 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:47.586962 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c1fc0575-6221-4e48-a60e-20e643b9e890 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1714 microversion: 2.1 time: 0.519192 Jul 20 04:09:47.587581 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 448/843] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:47 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1714 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:47.597415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-57d57ee1-08ea-4a08-a5f4-811ae79ca91c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:47.599419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-57d57ee1-08ea-4a08-a5f4-811ae79ca91c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:47.682141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-57d57ee1-08ea-4a08-a5f4-811ae79ca91c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:47.691404 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-57d57ee1-08ea-4a08-a5f4-811ae79ca91c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1215 microversion: 2.1 time: 0.102512 Jul 20 04:09:47.692254 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 449/844] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:47 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:47.697862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b8c12eb-f9c8-45de-9c43-0c84e6d81ddc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:47.698509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3b8c12eb-f9c8-45de-9c43-0c84e6d81ddc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:47.704860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b8c12eb-f9c8-45de-9c43-0c84e6d81ddc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.705323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b8c12eb-f9c8-45de-9c43-0c84e6d81ddc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.706100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b8c12eb-f9c8-45de-9c43-0c84e6d81ddc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.706570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b8c12eb-f9c8-45de-9c43-0c84e6d81ddc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.873479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3b8c12eb-f9c8-45de-9c43-0c84e6d81ddc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:47.886921 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b8c12eb-f9c8-45de-9c43-0c84e6d81ddc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1492 microversion: 2.1 time: 0.193528 Jul 20 04:09:47.889365 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 450/845] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:47 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1492 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:47.897719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50d3d1bb-7a7d-4f71-a15d-f2c23bd48516 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:47.900302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-50d3d1bb-7a7d-4f71-a15d-f2c23bd48516 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:47.912237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50d3d1bb-7a7d-4f71-a15d-f2c23bd48516 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.914114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50d3d1bb-7a7d-4f71-a15d-f2c23bd48516 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.915887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50d3d1bb-7a7d-4f71-a15d-f2c23bd48516 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.917729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50d3d1bb-7a7d-4f71-a15d-f2c23bd48516 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.959562 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-20179dd7-eb43-4cfa-8144-48fa3f2ec726 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.949885 Jul 20 04:09:47.960321 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 396/846] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:09:47 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:47.980637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9f50f9c2-a29f-4919-950c-b4f312355cb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:47.981306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9f50f9c2-a29f-4919-950c-b4f312355cb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:47.989572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f50f9c2-a29f-4919-950c-b4f312355cb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.990013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f50f9c2-a29f-4919-950c-b4f312355cb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:47.990826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f50f9c2-a29f-4919-950c-b4f312355cb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:47.994696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f50f9c2-a29f-4919-950c-b4f312355cb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.090471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-50d3d1bb-7a7d-4f71-a15d-f2c23bd48516 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:48.104240 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-50d3d1bb-7a7d-4f71-a15d-f2c23bd48516 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1478 microversion: 2.1 time: 0.212563 Jul 20 04:09:48.115493 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 451/847] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:47 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1478 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:48.166120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9f50f9c2-a29f-4919-950c-b4f312355cb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:48.173839 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9f50f9c2-a29f-4919-950c-b4f312355cb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.211602 Jul 20 04:09:48.174445 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 397/848] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:47 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:48.179276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fa5884d-fc20-48d6-bef0-3ba3e6441c54 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb8428c0280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-882639115", "description": "tempest-description-1163658590"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:48.368783 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1fa5884d-fc20-48d6-bef0-3ba3e6441c54 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.193091 Jul 20 04:09:48.369692 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 398/849] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:09:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:48.374962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:48.375752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:48.386306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.386768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.387959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.388656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.456202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.457221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.458157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lazy-loading 'fault' on Instance uuid eb3bcd60-e5cb-402b-8e01-f0014ea76fee {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:48.478818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b2c503d-5574-4fca-a23f-35e66b88cd87 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:48.480367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b2c503d-5574-4fca-a23f-35e66b88cd87 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:48.487803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b2c503d-5574-4fca-a23f-35e66b88cd87 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.488776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b2c503d-5574-4fca-a23f-35e66b88cd87 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.489760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b2c503d-5574-4fca-a23f-35e66b88cd87 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.490223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b2c503d-5574-4fca-a23f-35e66b88cd87 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.528225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:48.545116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:48.547004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76255b848a8a4e98a68bf3db12b03de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4b4dc0aab4299b5ea38e7a5ea9ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:48.552848 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f466e8e3-42c5-45dc-8496-f339abbba60f tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 200 len: 1449 microversion: 2.75 time: 0.181943 Jul 20 04:09:48.553662 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 399/850] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:48 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 1449 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:09:48.571423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3492b13-4fdc-454c-89d3-fd6e3a1684a8 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb842205f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-570072185", "description": "tempest-description-367847675"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:48.801206 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3492b13-4fdc-454c-89d3-fd6e3a1684a8 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.245036 Jul 20 04:09:48.802372 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 400/851] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:09:48 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:48.808668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a4ca610a-7bc7-4207-8e5d-e452cb52d48a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:48.809450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a4ca610a-7bc7-4207-8e5d-e452cb52d48a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:48.824327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4ca610a-7bc7-4207-8e5d-e452cb52d48a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.824892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4ca610a-7bc7-4207-8e5d-e452cb52d48a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.825816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4ca610a-7bc7-4207-8e5d-e452cb52d48a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.826398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4ca610a-7bc7-4207-8e5d-e452cb52d48a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.860430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:48.862709 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b2c503d-5574-4fca-a23f-35e66b88cd87 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1645 microversion: 2.1 time: 0.746100 Jul 20 04:09:48.878655 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 452/852] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:48 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1645 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:48.885321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0764854a-fa8c-45d2-b5a7-f416da8982cd tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:48.886141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0764854a-fa8c-45d2-b5a7-f416da8982cd tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:48.904068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0764854a-fa8c-45d2-b5a7-f416da8982cd tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.904531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0764854a-fa8c-45d2-b5a7-f416da8982cd tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:48.905406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0764854a-fa8c-45d2-b5a7-f416da8982cd tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:48.906043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0764854a-fa8c-45d2-b5a7-f416da8982cd tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.014950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a4ca610a-7bc7-4207-8e5d-e452cb52d48a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:49.024925 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a4ca610a-7bc7-4207-8e5d-e452cb52d48a tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1714 microversion: 2.1 time: 0.221315 Jul 20 04:09:49.025756 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 401/853] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:48 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1714 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:49.033083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b3c140a-4359-4fc6-b0a9-cfe74a21c0e0 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb84226e0d0>, body: {"security_group_rule": {"parent_group_id": "ce1a24e1-59a1-46ee-9340-bae8fb7b74b0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "aae615ac-cb3e-4d69-931d-b5e634238c4f"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:49.090195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0764854a-fa8c-45d2-b5a7-f416da8982cd tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:49.098670 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0764854a-fa8c-45d2-b5a7-f416da8982cd tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1211 microversion: 2.1 time: 0.218566 Jul 20 04:09:49.099688 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 453/854] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:48 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1211 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:49.105519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-014d6fc8-a67e-4748-aa3f-74e5900549c5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:49.106630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-014d6fc8-a67e-4748-aa3f-74e5900549c5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:49.113426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-014d6fc8-a67e-4748-aa3f-74e5900549c5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.114027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-014d6fc8-a67e-4748-aa3f-74e5900549c5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.114941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-014d6fc8-a67e-4748-aa3f-74e5900549c5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.115518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-014d6fc8-a67e-4748-aa3f-74e5900549c5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.302417 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8b3c140a-4359-4fc6-b0a9-cfe74a21c0e0 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.275633 Jul 20 04:09:49.312648 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 402/855] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:09:49 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:49.322488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5bea0649-b9ea-4a6d-8c53-5f0f222b23e5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:49.323640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5bea0649-b9ea-4a6d-8c53-5f0f222b23e5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:49.335754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bea0649-b9ea-4a6d-8c53-5f0f222b23e5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.336509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bea0649-b9ea-4a6d-8c53-5f0f222b23e5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.337887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bea0649-b9ea-4a6d-8c53-5f0f222b23e5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.338707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bea0649-b9ea-4a6d-8c53-5f0f222b23e5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.505714 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-014d6fc8-a67e-4748-aa3f-74e5900549c5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1645 microversion: 2.1 time: 0.404703 Jul 20 04:09:49.506579 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 454/856] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:49 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1645 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:49.521114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2f7e4d33-8577-473f-abe9-e4026743543a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:49.521761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f7e4d33-8577-473f-abe9-e4026743543a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:49.533801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f7e4d33-8577-473f-abe9-e4026743543a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.534341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f7e4d33-8577-473f-abe9-e4026743543a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.535299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f7e4d33-8577-473f-abe9-e4026743543a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.535808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f7e4d33-8577-473f-abe9-e4026743543a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.653455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5bea0649-b9ea-4a6d-8c53-5f0f222b23e5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:49.661830 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5bea0649-b9ea-4a6d-8c53-5f0f222b23e5 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1478 microversion: 2.1 time: 0.347327 Jul 20 04:09:49.662754 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 403/857] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:49 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1478 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:49.668349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c7a08865-ea5e-4d1d-8a08-afff00fbb373 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb8428c0280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:49.814209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2f7e4d33-8577-473f-abe9-e4026743543a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:49.824033 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2f7e4d33-8577-473f-abe9-e4026743543a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.311829 Jul 20 04:09:49.825733 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 455/858] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:49 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:49.842872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3de9e1ec-f042-4ec1-bc31-8433b1ae72bf tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:49.844050 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:49.844050 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:09:49.845158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3de9e1ec-f042-4ec1-bc31-8433b1ae72bf tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.845719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3de9e1ec-f042-4ec1-bc31-8433b1ae72bf tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.860830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3de9e1ec-f042-4ec1-bc31-8433b1ae72bf tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.862914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3de9e1ec-f042-4ec1-bc31-8433b1ae72bf tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.890402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:49.912301 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3de9e1ec-f042-4ec1-bc31-8433b1ae72bf tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.085438 Jul 20 04:09:49.914711 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 456/859] 10.222.0.59 () {58 vars in 1175 bytes} [Wed Jul 20 04:09:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:49.921887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8fadb611-a8d9-4ff1-91a5-991e5ad84c90 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:49.922963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8fadb611-a8d9-4ff1-91a5-991e5ad84c90 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] [instance: eb3bcd60-e5cb-402b-8e01-f0014ea76fee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:49.931973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fadb611-a8d9-4ff1-91a5-991e5ad84c90 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.932899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fadb611-a8d9-4ff1-91a5-991e5ad84c90 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.934219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fadb611-a8d9-4ff1-91a5-991e5ad84c90 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:49.934914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fadb611-a8d9-4ff1-91a5-991e5ad84c90 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:49.953576 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-8fadb611-a8d9-4ff1-91a5-991e5ad84c90 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] HTTP exception thrown: Instance eb3bcd60-e5cb-402b-8e01-f0014ea76fee could not be found. Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8fadb611-a8d9-4ff1-91a5-991e5ad84c90 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Request method failure captured: Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee HTTP/1.1 Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-wCEvC6C9ezjsdGtQirK4yAAa8icOwshA8Ps2zADSSNX0IcyXuFHkcxAsFGy0R1c_BsRoyUr_ZtcYv0Ew54jo5jS1v5VA783xl3OKs7SVfmduD3bT1pq08nvsfu7s7ZaMRXppB5SSutxapdm_FXOCI2E8xVaWY-55E2tEUOmkrYQY Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.75 Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: cba4b4dc0aab4299b5ea38e7a5ea9ac0 Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersAdmin275Test-1978861074 Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:09:49.956726 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cba4b4dc0aab4299b5ea38e7a5ea9ac0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cba4b4dc0aab4299b5ea38e7a5ea9ac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cba4b4dc0aab4299b5ea38e7a5ea9ac0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cba4b4dc0aab4299b5ea38e7a5ea9ac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersAdmin275Test-1978861074 Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: cba4b4dc0aab4299b5ea38e7a5ea9ac0 Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersAdmin275Test-1978861074 Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersAdmin275Test-1978861074-project Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 76255b848a8a4e98a68bf3db12b03de4 Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersAdmin275Test-1978861074-project Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance eb3bcd60-e5cb-402b-8e01-f0014ea76fee could not be found. Jul 20 04:09:49.958167 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'eb3bcd60-e5cb-402b-8e01-f0014ea76fee'} Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3bcd60-e5cb-402b-8e01-f0014ea76fee could not be found. Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:49.958958 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3bcd60-e5cb-402b-8e01-f0014ea76fee could not be found. Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3bcd60-e5cb-402b-8e01-f0014ea76fee could not be found. Jul 20 04:09:49.961775 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:49.965319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8fadb611-a8d9-4ff1-91a5-991e5ad84c90 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] Returning 404 to user: Instance eb3bcd60-e5cb-402b-8e01-f0014ea76fee could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:49.966198 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8fadb611-a8d9-4ff1-91a5-991e5ad84c90 tempest-ServersAdmin275Test-1978861074 tempest-ServersAdmin275Test-1978861074-project] 10.222.0.59 "GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee" status: 404 len: 111 microversion: 2.75 time: 0.050179 Jul 20 04:09:49.966942 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 457/860] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:09:49 2022] GET /compute/v2.1/servers/eb3bcd60-e5cb-402b-8e01-f0014ea76fee => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:09:49.986510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-20ec8d8a-9d2a-423c-bd69-548d33de0e17 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-760456-11", "block_migration": true, "disk_over_commit": false}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:49.987677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-20ec8d8a-9d2a-423c-bd69-548d33de0e17 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:50.001972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20ec8d8a-9d2a-423c-bd69-548d33de0e17 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:50.002457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20ec8d8a-9d2a-423c-bd69-548d33de0e17 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:50.003261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20ec8d8a-9d2a-423c-bd69-548d33de0e17 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:50.003699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20ec8d8a-9d2a-423c-bd69-548d33de0e17 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:50.060288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-20ec8d8a-9d2a-423c-bd69-548d33de0e17 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lazy-loading 'flavor' on Instance uuid 0dd742b1-082a-4a00-b6af-75b41ac08235 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:09:50.084863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-20ec8d8a-9d2a-423c-bd69-548d33de0e17 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Going to try to live migrate instance to n-h1-760456-11 {{(pid=119606) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:09:50.164607 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c7a08865-ea5e-4d1d-8a08-afff00fbb373 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/aae615ac-cb3e-4d69-931d-b5e634238c4f" status: 202 len: 0 microversion: 2.1 time: 0.499903 Jul 20 04:09:50.165191 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 404/861] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:09:49 2022] DELETE /compute/v2.1/os-security-groups/aae615ac-cb3e-4d69-931d-b5e634238c4f => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:50.177979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa145de6-3f8d-46eb-9dad-ddb2dd60579f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:50.186059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fa145de6-3f8d-46eb-9dad-ddb2dd60579f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:50.198206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa145de6-3f8d-46eb-9dad-ddb2dd60579f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:50.199610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa145de6-3f8d-46eb-9dad-ddb2dd60579f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:50.201566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa145de6-3f8d-46eb-9dad-ddb2dd60579f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:50.205117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa145de6-3f8d-46eb-9dad-ddb2dd60579f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:50.411984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fa145de6-3f8d-46eb-9dad-ddb2dd60579f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5dc8e2f30ce43ebb7919cdd1ab417ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4208e8570ad4fc597f5cc44f7785171', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:50.423230 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa145de6-3f8d-46eb-9dad-ddb2dd60579f tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 200 len: 1646 microversion: 2.1 time: 0.256685 Jul 20 04:09:50.428023 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 405/862] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:50 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 1646 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:50.439327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-643748be-8ef6-41ec-bacd-ad51b19662c9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:50.440031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-643748be-8ef6-41ec-bacd-ad51b19662c9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:50.466693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-643748be-8ef6-41ec-bacd-ad51b19662c9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:50.467551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-643748be-8ef6-41ec-bacd-ad51b19662c9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:50.468747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-643748be-8ef6-41ec-bacd-ad51b19662c9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:50.469200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-643748be-8ef6-41ec-bacd-ad51b19662c9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:50.651933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-643748be-8ef6-41ec-bacd-ad51b19662c9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:50.691676 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-643748be-8ef6-41ec-bacd-ad51b19662c9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1273 microversion: 2.1 time: 0.256136 Jul 20 04:09:50.704106 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 406/863] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:50 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:50.712250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c5b48069-390c-4cc2-a52d-b5219b92aacd tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb842449c10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:51.290750 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c5b48069-390c-4cc2-a52d-b5219b92aacd tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/ce1a24e1-59a1-46ee-9340-bae8fb7b74b0" status: 200 len: 247 microversion: 2.1 time: 0.589469 Jul 20 04:09:51.292426 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 407/864] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:09:50 2022] GET /compute/v2.1/os-security-groups/ce1a24e1-59a1-46ee-9340-bae8fb7b74b0 => generated 247 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:51.297885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e9612d4b-720f-4120-afe5-fa1ae7b3e7d7 req-f3b92f76-c810-4dde-b94f-b0940874e0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b088ee6-9cad-4386-9ea8-795cd04ee72f", "name": "network-vif-deleted", "tag": "52b1fb30-5320-4d6d-b7c9-22304fb2cd16"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:51.327476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e9612d4b-720f-4120-afe5-fa1ae7b3e7d7 req-f3b92f76-c810-4dde-b94f-b0940874e0aa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:51.331053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e9612d4b-720f-4120-afe5-fa1ae7b3e7d7 req-f3b92f76-c810-4dde-b94f-b0940874e0aa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:51.378218 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e9612d4b-720f-4120-afe5-fa1ae7b3e7d7 req-f3b92f76-c810-4dde-b94f-b0940874e0aa service nova] Creating event network-vif-deleted:52b1fb30-5320-4d6d-b7c9-22304fb2cd16 for instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f on n-h1-760456-11 Jul 20 04:09:51.396412 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e9612d4b-720f-4120-afe5-fa1ae7b3e7d7 req-f3b92f76-c810-4dde-b94f-b0940874e0aa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101575 Jul 20 04:09:51.403366 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 408/865] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:51.423346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b815ffd-9c87-49be-8a17-8fd5de65d863 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:51.426990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3b815ffd-9c87-49be-8a17-8fd5de65d863 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:51.445291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b815ffd-9c87-49be-8a17-8fd5de65d863 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:51.449279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b815ffd-9c87-49be-8a17-8fd5de65d863 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:51.450130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b815ffd-9c87-49be-8a17-8fd5de65d863 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:51.452738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b815ffd-9c87-49be-8a17-8fd5de65d863 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:51.787788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3b815ffd-9c87-49be-8a17-8fd5de65d863 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:51.798302 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3b815ffd-9c87-49be-8a17-8fd5de65d863 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1478 microversion: 2.1 time: 0.390189 Jul 20 04:09:51.798908 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 409/866] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:51 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1478 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:51.807247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba4f16d9-b1b8-4ac5-8fec-686dfe291de0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:51.807866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ba4f16d9-b1b8-4ac5-8fec-686dfe291de0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:51.825035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba4f16d9-b1b8-4ac5-8fec-686dfe291de0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:51.827423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba4f16d9-b1b8-4ac5-8fec-686dfe291de0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:51.828851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba4f16d9-b1b8-4ac5-8fec-686dfe291de0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:51.830482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba4f16d9-b1b8-4ac5-8fec-686dfe291de0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:52.093260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ba4f16d9-b1b8-4ac5-8fec-686dfe291de0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:52.103259 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ba4f16d9-b1b8-4ac5-8fec-686dfe291de0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.302001 Jul 20 04:09:52.117401 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 410/867] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:51 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:52.127358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-48e49939-db40-4f9b-8a48-7d43957f9e00 req-c0d89924-9fcb-4487-bef4-6e331efd169f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288f952b-81ce-419b-9907-96b8b0db1d30", "name": "network-vif-unplugged", "status": "completed", "tag": "c9911200-3c1e-4fb4-81b5-e7aed1a55549"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:52.150350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-48e49939-db40-4f9b-8a48-7d43957f9e00 req-c0d89924-9fcb-4487-bef4-6e331efd169f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:52.153008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-48e49939-db40-4f9b-8a48-7d43957f9e00 req-c0d89924-9fcb-4487-bef4-6e331efd169f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:52.184840 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-48e49939-db40-4f9b-8a48-7d43957f9e00 req-c0d89924-9fcb-4487-bef4-6e331efd169f service nova] Creating event network-vif-unplugged:c9911200-3c1e-4fb4-81b5-e7aed1a55549 for instance 288f952b-81ce-419b-9907-96b8b0db1d30 on n-h1-760456-11 Jul 20 04:09:52.191428 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-48e49939-db40-4f9b-8a48-7d43957f9e00 req-c0d89924-9fcb-4487-bef4-6e331efd169f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071993 Jul 20 04:09:52.192567 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 411/868] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:52.199020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dc87592e-e2bb-4351-8a67-883cc0010b0a tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb842b5fca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-159065405", "description": "tempest-description-1026797641"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:52.724271 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dc87592e-e2bb-4351-8a67-883cc0010b0a tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.530378 Jul 20 04:09:52.725134 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 412/869] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:09:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:52.731032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d80cb43-b11b-406c-ba8d-6509caa4a576 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:52.732371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d80cb43-b11b-406c-ba8d-6509caa4a576 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:52.748811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d80cb43-b11b-406c-ba8d-6509caa4a576 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:52.749918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d80cb43-b11b-406c-ba8d-6509caa4a576 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:52.751205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d80cb43-b11b-406c-ba8d-6509caa4a576 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:52.751918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d80cb43-b11b-406c-ba8d-6509caa4a576 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:52.774602 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-3d80cb43-b11b-406c-ba8d-6509caa4a576 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] HTTP exception thrown: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d80cb43-b11b-406c-ba8d-6509caa4a576 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Request method failure captured: Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f HTTP/1.1 Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139wXtKo4wlcaRodC-PDxerIJLWLxQv3_ne6eDlLoWTKdtE4yBOdxLjRFh-28hDbxPIAbF6mfr8z6kT7EZxjHCO5y4FK5O36sPd1V-3lfUfvF6Ogt_3ka-MLH-qvR_M3cC-VKFaZsk7Tj69aOu6zTKEEFEGexl2q04lRewSn6DySAus Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:09:52.787025 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: c5dc8e2f30ce43ebb7919cdd1ab417ef Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:09:52.788906 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4b088ee6-9cad-4386-9ea8-795cd04ee72f'} Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:52.789864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:09:52.791102 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:52.796659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d80cb43-b11b-406c-ba8d-6509caa4a576 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Returning 404 to user: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:52.798666 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d80cb43-b11b-406c-ba8d-6509caa4a576 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 404 len: 111 microversion: 2.1 time: 0.072107 Jul 20 04:09:52.806020 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 413/870] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:52 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:52.816604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-db32c129-256b-4500-ade2-1f83f15dcb11 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:52.817622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-db32c129-256b-4500-ade2-1f83f15dcb11 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:52.829312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db32c129-256b-4500-ade2-1f83f15dcb11 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:52.830319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db32c129-256b-4500-ade2-1f83f15dcb11 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:52.831960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db32c129-256b-4500-ade2-1f83f15dcb11 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:52.833159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db32c129-256b-4500-ade2-1f83f15dcb11 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:53.129544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-db32c129-256b-4500-ade2-1f83f15dcb11 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:53.170992 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-db32c129-256b-4500-ade2-1f83f15dcb11 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1315 microversion: 2.1 time: 0.363372 Jul 20 04:09:53.172505 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 414/871] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:52 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:53.185911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d4d92cb-5d7b-45f5-967f-dbc5685efbe0 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb84231adc0>, body: {"security_group_rule": {"parent_group_id": "6fc8432f-bcae-4296-8fd6-458b60177a41", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:53.619768 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7d4d92cb-5d7b-45f5-967f-dbc5685efbe0 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.444928 Jul 20 04:09:53.625068 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 415/872] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:09:53 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:53.631226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-234e67f4-f6dc-42f3-b20c-056918a9323b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.632152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-234e67f4-f6dc-42f3-b20c-056918a9323b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:53.640352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-234e67f4-f6dc-42f3-b20c-056918a9323b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:53.641164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-234e67f4-f6dc-42f3-b20c-056918a9323b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:53.642217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-234e67f4-f6dc-42f3-b20c-056918a9323b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:53.642963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-234e67f4-f6dc-42f3-b20c-056918a9323b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:53.664966 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-234e67f4-f6dc-42f3-b20c-056918a9323b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] HTTP exception thrown: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-234e67f4-f6dc-42f3-b20c-056918a9323b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Request method failure captured: Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb HTTP/1.1 Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139wXtKo4wlcaRodC-PDxerIJLWLxQv3_ne6eDlLoWTKdtE4yBOdxLjRFh-28hDbxPIAbF6mfr8z6kT7EZxjHCO5y4FK5O36sPd1V-3lfUfvF6Ogt_3ka-MLH-qvR_M3cC-VKFaZsk7Tj69aOu6zTKEEFEGexl2q04lRewSn6DySAus Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:09:53.667320 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: c5dc8e2f30ce43ebb7919cdd1ab417ef Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:09:53.669068 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '32096456-698a-47c4-a1e6-061e62a3a8fb'} Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:53.670181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:09:53.671778 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:53.674653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-234e67f4-f6dc-42f3-b20c-056918a9323b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Returning 404 to user: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:53.675797 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-234e67f4-f6dc-42f3-b20c-056918a9323b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "DELETE /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 404 len: 111 microversion: 2.1 time: 0.049466 Jul 20 04:09:53.681882 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 416/873] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:09:53 2022] DELETE /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:53.690069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a59cdfb2-f54b-40ec-af95-a636d76d7752 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.691096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a59cdfb2-f54b-40ec-af95-a636d76d7752 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:53.717010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a59cdfb2-f54b-40ec-af95-a636d76d7752 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:53.717735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a59cdfb2-f54b-40ec-af95-a636d76d7752 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:53.718828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a59cdfb2-f54b-40ec-af95-a636d76d7752 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:53.719454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a59cdfb2-f54b-40ec-af95-a636d76d7752 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:53.763218 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-20ec8d8a-9d2a-423c-bd69-548d33de0e17 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235/action" status: 202 len: 0 microversion: 2.1 time: 3.794568 Jul 20 04:09:53.765068 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 458/874] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:09:49 2022] POST /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235/action => generated 0 bytes in 3797 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:53.775443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c08ae4c1-e0fb-4e87-bff4-206c661e7608 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:53.777752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c08ae4c1-e0fb-4e87-bff4-206c661e7608 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:53.804995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c08ae4c1-e0fb-4e87-bff4-206c661e7608 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:53.806824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c08ae4c1-e0fb-4e87-bff4-206c661e7608 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:53.808496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c08ae4c1-e0fb-4e87-bff4-206c661e7608 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:53.827422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c08ae4c1-e0fb-4e87-bff4-206c661e7608 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.509599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a59cdfb2-f54b-40ec-af95-a636d76d7752 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:54.520457 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a59cdfb2-f54b-40ec-af95-a636d76d7752 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1478 microversion: 2.1 time: 0.837061 Jul 20 04:09:54.534770 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 417/875] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:53 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1478 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:54.545492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48c74446-1374-4e77-87b1-b60dc679e092 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Action: 'create', calling method: .version_select at 0x7fb842205790>, body: {"security_group_rule": {"parent_group_id": "6fc8432f-bcae-4296-8fd6-458b60177a41", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:54.619461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c08ae4c1-e0fb-4e87-bff4-206c661e7608 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:54.629416 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c08ae4c1-e0fb-4e87-bff4-206c661e7608 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.862855 Jul 20 04:09:54.637363 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 459/876] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:53 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:54.644297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3873fb03-1502-4da7-80c8-d0d00863181b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:54.645282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3873fb03-1502-4da7-80c8-d0d00863181b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:54.661806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3873fb03-1502-4da7-80c8-d0d00863181b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.665566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3873fb03-1502-4da7-80c8-d0d00863181b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.671634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3873fb03-1502-4da7-80c8-d0d00863181b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.672385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3873fb03-1502-4da7-80c8-d0d00863181b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.711688 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3873fb03-1502-4da7-80c8-d0d00863181b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] HTTP exception thrown: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3873fb03-1502-4da7-80c8-d0d00863181b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Request method failure captured: Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb HTTP/1.1 Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi139wXtKo4wlcaRodC-PDxerIJLWLxQv3_ne6eDlLoWTKdtE4yBOdxLjRFh-28hDbxPIAbF6mfr8z6kT7EZxjHCO5y4FK5O36sPd1V-3lfUfvF6Ogt_3ka-MLH-qvR_M3cC-VKFaZsk7Tj69aOu6zTKEEFEGexl2q04lRewSn6DySAus Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:09:54.716195 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: c5dc8e2f30ce43ebb7919cdd1ab417ef Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:09:54.717804 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '32096456-698a-47c4-a1e6-061e62a3a8fb'} Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:54.718703 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:09:54.720109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:09:54.723197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3873fb03-1502-4da7-80c8-d0d00863181b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Returning 404 to user: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:54.731523 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3873fb03-1502-4da7-80c8-d0d00863181b tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 404 len: 111 microversion: 2.1 time: 0.092727 Jul 20 04:09:54.739415 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 460/877] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:54 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:54.745581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-252cfafe-3ca4-41bc-9c1f-5c0b71e44853 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:54.749929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-252cfafe-3ca4-41bc-9c1f-5c0b71e44853 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:54.766145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-252cfafe-3ca4-41bc-9c1f-5c0b71e44853 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.767328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-252cfafe-3ca4-41bc-9c1f-5c0b71e44853 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:54.768398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-252cfafe-3ca4-41bc-9c1f-5c0b71e44853 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:54.769103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-252cfafe-3ca4-41bc-9c1f-5c0b71e44853 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:55.266471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-252cfafe-3ca4-41bc-9c1f-5c0b71e44853 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:55.276237 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-252cfafe-3ca4-41bc-9c1f-5c0b71e44853 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 0.535325 Jul 20 04:09:55.280197 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 461/878] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:54 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:55.297074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-899e5bd9-423b-439d-9ab5-7ef19c3b364e req-62b52d07-c9d3-4ca9-8a79-286b89d0c563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec4b278f-a380-46e4-8d3f-216258883086", "tag": "8c4921df-07be-4e19-a80a-939084fe95a2"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:55.328769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-899e5bd9-423b-439d-9ab5-7ef19c3b364e req-62b52d07-c9d3-4ca9-8a79-286b89d0c563 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:55.329791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-899e5bd9-423b-439d-9ab5-7ef19c3b364e req-62b52d07-c9d3-4ca9-8a79-286b89d0c563 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:55.347581 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-899e5bd9-423b-439d-9ab5-7ef19c3b364e req-62b52d07-c9d3-4ca9-8a79-286b89d0c563 service nova] Creating event network-changed:8c4921df-07be-4e19-a80a-939084fe95a2 for instance ec4b278f-a380-46e4-8d3f-216258883086 on n-h1-760456-11 Jul 20 04:09:55.356084 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-899e5bd9-423b-439d-9ab5-7ef19c3b364e req-62b52d07-c9d3-4ca9-8a79-286b89d0c563 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074271 Jul 20 04:09:55.359878 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 462/879] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:55.368141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c7f72fd6-51ec-4bfe-adab-2a9ccbb67dc2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:55.369235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c7f72fd6-51ec-4bfe-adab-2a9ccbb67dc2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:55.379311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7f72fd6-51ec-4bfe-adab-2a9ccbb67dc2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:55.386237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7f72fd6-51ec-4bfe-adab-2a9ccbb67dc2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:55.392340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7f72fd6-51ec-4bfe-adab-2a9ccbb67dc2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:55.392801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7f72fd6-51ec-4bfe-adab-2a9ccbb67dc2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:55.454353 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48c74446-1374-4e77-87b1-b60dc679e092 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.917613 Jul 20 04:09:55.455172 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 418/880] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:09:54 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:55.463869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f633a25b-a6b4-4e45-8a70-eb9dc8ef9984 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '.version_select at 0x7fb842235ee0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:55.517251 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f633a25b-a6b4-4e45-8a70-eb9dc8ef9984 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-295056878" status: 202 len: 0 microversion: 2.1 time: 0.060366 Jul 20 04:09:55.523613 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 419/881] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 04:09:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-295056878 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:55.542401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-477eb649-ca78-4f5f-8158-7b252c52b3ca req-7dda4cc6-ab53-4f61-8b46-783909881e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288f952b-81ce-419b-9907-96b8b0db1d30", "name": "network-vif-plugged", "status": "completed", "tag": "c9911200-3c1e-4fb4-81b5-e7aed1a55549"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:55.560876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-477eb649-ca78-4f5f-8158-7b252c52b3ca req-7dda4cc6-ab53-4f61-8b46-783909881e17 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:55.561825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-477eb649-ca78-4f5f-8158-7b252c52b3ca req-7dda4cc6-ab53-4f61-8b46-783909881e17 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:55.582352 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-477eb649-ca78-4f5f-8158-7b252c52b3ca req-7dda4cc6-ab53-4f61-8b46-783909881e17 service nova] Creating event network-vif-plugged:c9911200-3c1e-4fb4-81b5-e7aed1a55549 for instance 288f952b-81ce-419b-9907-96b8b0db1d30 on n-h1-760456-11 Jul 20 04:09:55.591851 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-477eb649-ca78-4f5f-8158-7b252c52b3ca req-7dda4cc6-ab53-4f61-8b46-783909881e17 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066168 Jul 20 04:09:55.593948 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 420/882] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:55.603210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-734f6f5c-1303-47ee-9e32-4484f2ca2ee9 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb84226ea60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:55.726358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c7f72fd6-51ec-4bfe-adab-2a9ccbb67dc2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:55.738450 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c7f72fd6-51ec-4bfe-adab-2a9ccbb67dc2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1315 microversion: 2.1 time: 0.376273 Jul 20 04:09:55.750330 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 463/883] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:55 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:55.755754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ef3b6358-5a01-4367-a11f-9257e8a081be tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:55.757449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ef3b6358-5a01-4367-a11f-9257e8a081be tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:55.764936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef3b6358-5a01-4367-a11f-9257e8a081be tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:55.765656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef3b6358-5a01-4367-a11f-9257e8a081be tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:55.766667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef3b6358-5a01-4367-a11f-9257e8a081be tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:55.768339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef3b6358-5a01-4367-a11f-9257e8a081be tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.008116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ef3b6358-5a01-4367-a11f-9257e8a081be tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:56.022133 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ef3b6358-5a01-4367-a11f-9257e8a081be tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1478 microversion: 2.1 time: 0.270100 Jul 20 04:09:56.034479 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 464/884] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:55 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1478 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:56.041945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-53cde51a-deaa-41e1-b0c3-aaf2badac9ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:56.043245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-53cde51a-deaa-41e1-b0c3-aaf2badac9ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:56.052638 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-734f6f5c-1303-47ee-9e32-4484f2ca2ee9 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/6fc8432f-bcae-4296-8fd6-458b60177a41" status: 200 len: 664 microversion: 2.1 time: 0.455832 Jul 20 04:09:56.053526 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 421/885] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:09:55 2022] GET /compute/v2.1/os-security-groups/6fc8432f-bcae-4296-8fd6-458b60177a41 => generated 664 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:56.054674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53cde51a-deaa-41e1-b0c3-aaf2badac9ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.055142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53cde51a-deaa-41e1-b0c3-aaf2badac9ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.056183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53cde51a-deaa-41e1-b0c3-aaf2badac9ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.056972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53cde51a-deaa-41e1-b0c3-aaf2badac9ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.065062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-63fd85b0-52fd-4ea0-8d7d-1cf70a0619cf tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb842449160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:56.332598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-53cde51a-deaa-41e1-b0c3-aaf2badac9ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:56.344090 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-53cde51a-deaa-41e1-b0c3-aaf2badac9ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.307813 Jul 20 04:09:56.356948 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 465/886] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:56 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:56.363297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-007bbe40-595c-4a0a-be7c-4756b55c9177 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:56.364216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-007bbe40-595c-4a0a-be7c-4756b55c9177 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:56.380477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-007bbe40-595c-4a0a-be7c-4756b55c9177 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.381526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-007bbe40-595c-4a0a-be7c-4756b55c9177 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.382703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-007bbe40-595c-4a0a-be7c-4756b55c9177 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.386541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-007bbe40-595c-4a0a-be7c-4756b55c9177 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.930308 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-63fd85b0-52fd-4ea0-8d7d-1cf70a0619cf tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-group-rules/a85c1914-5106-4c6d-817f-e9dce6787fad" status: 202 len: 0 microversion: 2.1 time: 0.868915 Jul 20 04:09:56.932049 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 422/887] 10.222.0.59 () {58 vars in 1286 bytes} [Wed Jul 20 04:09:56 2022] DELETE /compute/v2.1/os-security-group-rules/a85c1914-5106-4c6d-817f-e9dce6787fad => generated 0 bytes in 871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:56.939031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-360d3b62-66e0-4f54-9947-f1e3b692ea4f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:56.940755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-360d3b62-66e0-4f54-9947-f1e3b692ea4f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:56.948570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-360d3b62-66e0-4f54-9947-f1e3b692ea4f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.949126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-360d3b62-66e0-4f54-9947-f1e3b692ea4f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:56.950577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-360d3b62-66e0-4f54-9947-f1e3b692ea4f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:56.951160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-360d3b62-66e0-4f54-9947-f1e3b692ea4f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.072971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-007bbe40-595c-4a0a-be7c-4756b55c9177 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:57.088839 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-007bbe40-595c-4a0a-be7c-4756b55c9177 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 0.730184 Jul 20 04:09:57.090022 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 466/888] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:56 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:57.230946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-360d3b62-66e0-4f54-9947-f1e3b692ea4f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:57.240482 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-360d3b62-66e0-4f54-9947-f1e3b692ea4f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1315 microversion: 2.1 time: 0.306842 Jul 20 04:09:57.242913 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 423/889] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:56 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:57.248690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6a8517ca-f81d-4492-8c68-ea3ce7538cbb tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb842371d30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:57.290169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8281c47d-e62c-465d-adb6-5c247ab7e9c5 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:57.292043 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:57.292043 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:09:57.293801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8281c47d-e62c-465d-adb6-5c247ab7e9c5 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.294361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8281c47d-e62c-465d-adb6-5c247ab7e9c5 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.295531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8281c47d-e62c-465d-adb6-5c247ab7e9c5 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.296201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8281c47d-e62c-465d-adb6-5c247ab7e9c5 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.325910 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8281c47d-e62c-465d-adb6-5c247ab7e9c5 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.234557 Jul 20 04:09:57.335056 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 467/890] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:09:57 2022] GET /compute/v2.1/os-services => generated 949 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:57.358136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-46dd1863-7bcd-4924-a2cf-c7034fd47593 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:57.360173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-46dd1863-7bcd-4924-a2cf-c7034fd47593 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:57.373805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46dd1863-7bcd-4924-a2cf-c7034fd47593 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.374808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46dd1863-7bcd-4924-a2cf-c7034fd47593 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.376050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46dd1863-7bcd-4924-a2cf-c7034fd47593 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.376685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46dd1863-7bcd-4924-a2cf-c7034fd47593 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.686413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=10 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:57.899909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-46dd1863-7bcd-4924-a2cf-c7034fd47593 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:57.907473 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-46dd1863-7bcd-4924-a2cf-c7034fd47593 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1478 microversion: 2.1 time: 0.571101 Jul 20 04:09:57.908041 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 468/891] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:57 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1478 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:57.922779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-632e1441-0f1b-456f-ad7b-8324423e973e tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:57.924057 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:57.924057 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:09:57.925309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-632e1441-0f1b-456f-ad7b-8324423e973e tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.925768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-632e1441-0f1b-456f-ad7b-8324423e973e tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.926612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-632e1441-0f1b-456f-ad7b-8324423e973e tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.927058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-632e1441-0f1b-456f-ad7b-8324423e973e tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.953554 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-632e1441-0f1b-456f-ad7b-8324423e973e tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.034341 Jul 20 04:09:57.954478 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 469/892] 10.222.0.59 () {58 vars in 1169 bytes} [Wed Jul 20 04:09:57 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:57.959281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-796e590e-2f27-41c2-a091-08b359f682eb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:57.962475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-796e590e-2f27-41c2-a091-08b359f682eb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:57.969022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-796e590e-2f27-41c2-a091-08b359f682eb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.969731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-796e590e-2f27-41c2-a091-08b359f682eb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:57.970550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-796e590e-2f27-41c2-a091-08b359f682eb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:57.971150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-796e590e-2f27-41c2-a091-08b359f682eb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.015654 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6a8517ca-f81d-4492-8c68-ea3ce7538cbb tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/6fc8432f-bcae-4296-8fd6-458b60177a41" status: 202 len: 0 microversion: 2.1 time: 0.771494 Jul 20 04:09:58.020403 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 424/893] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:09:57 2022] DELETE /compute/v2.1/os-security-groups/6fc8432f-bcae-4296-8fd6-458b60177a41 => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:58.026068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-39e52ec0-cdc0-4f80-9f10-8cfe33274345 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.027204 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:58.027204 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:09:58.047898 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-39e52ec0-cdc0-4f80-9f10-8cfe33274345 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/691925149" status: 202 len: 0 microversion: 2.1 time: 0.025963 Jul 20 04:09:58.048965 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 425/894] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:09:58 2022] DELETE /compute/v2.1/flavors/691925149 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:58.054811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7e2598f7-316b-44c6-9371-ef59f34b8f02 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.058980 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:58.058980 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:09:58.066998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e2598f7-316b-44c6-9371-ef59f34b8f02 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.068058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e2598f7-316b-44c6-9371-ef59f34b8f02 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.069524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e2598f7-316b-44c6-9371-ef59f34b8f02 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.070193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e2598f7-316b-44c6-9371-ef59f34b8f02 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.087690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:58.129036 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7e2598f7-316b-44c6-9371-ef59f34b8f02 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.078676 Jul 20 04:09:58.132835 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 426/895] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:09:58 2022] GET /compute/v2.1/os-services => generated 949 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:58.138429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9690029c-bbfb-4c98-8d36-8ebac028c233 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb84226e0d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.170232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG neutronclient.v2_0.client [None req-9690029c-bbfb-4c98-8d36-8ebac028c233 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aae615ac-cb3e-4d69-931d-b5e634238c4f does not exist", "detail": ""}} {{(pid=119605) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:09:58.170894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.security_group_api [None req-9690029c-bbfb-4c98-8d36-8ebac028c233 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Neutron security group aae615ac-cb3e-4d69-931d-b5e634238c4f not found {{(pid=119605) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:09:58.171410 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-9690029c-bbfb-4c98-8d36-8ebac028c233 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] HTTP exception thrown: Security group aae615ac-cb3e-4d69-931d-b5e634238c4f does not exist Jul 20 04:09:58.171410 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-82ede3b9-d39d-4ee5-805e-8922fa822153'] Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9690029c-bbfb-4c98-8d36-8ebac028c233 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Request method failure captured: Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-security-groups/aae615ac-cb3e-4d69-931d-b5e634238c4f HTTP/1.1 Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14AG4-sC0_cjezQO63I5ZqMER2Xz_An1EuU2yiJ3cYnGhRVhSufHJXUto8IMR-_PJ-zTIfg85bNG3Y2c06pqTQK-xQRwh6qiEa5_b-PIxtz0Yb4PSwFd8xQguPl-x0ErBaYfELlZXdnTmhp1K_ign63rB2tFaiPlqM-mAWHfqNtjm7g Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 97bfdd2a15b74c37b4cf7001215b4f0a Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-519889157 Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:09:58.185047 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/97bfdd2a15b74c37b4cf7001215b4f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/97bfdd2a15b74c37b4cf7001215b4f0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/97bfdd2a15b74c37b4cf7001215b4f0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_97bfdd2a15b74c37b4cf7001215b4f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupRulesTestJSON-519889157 Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 97bfdd2a15b74c37b4cf7001215b4f0a Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-519889157 Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupRulesTestJSON-519889157-project Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: fa8e2e3d48354a66ad0d5255407c78d7 Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupRulesTestJSON-519889157-project Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: exception: Security group aae615ac-cb3e-4d69-931d-b5e634238c4f does not exist Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-82ede3b9-d39d-4ee5-805e-8922fa822153'] Jul 20 04:09:58.186770 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'aae615ac-cb3e-4d69-931d-b5e634238c4f'} Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:09:58.187727 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aae615ac-cb3e-4d69-931d-b5e634238c4f does not exist Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82ede3b9-d39d-4ee5-805e-8922fa822153'] Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:09:58.189242 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aae615ac-cb3e-4d69-931d-b5e634238c4f does not exist Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82ede3b9-d39d-4ee5-805e-8922fa822153'] Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aae615ac-cb3e-4d69-931d-b5e634238c4f does not exist Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82ede3b9-d39d-4ee5-805e-8922fa822153'] Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.191678 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aae615ac-cb3e-4d69-931d-b5e634238c4f does not exist Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82ede3b9-d39d-4ee5-805e-8922fa822153'] Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9690029c-bbfb-4c98-8d36-8ebac028c233 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Returning 404 to user: Security group aae615ac-cb3e-4d69-931d-b5e634238c4f does not exist Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-82ede3b9-d39d-4ee5-805e-8922fa822153'] {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9690029c-bbfb-4c98-8d36-8ebac028c233 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/aae615ac-cb3e-4d69-931d-b5e634238c4f" status: 404 len: 194 microversion: 2.1 time: 0.052503 Jul 20 04:09:58.193172 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 427/896] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:09:58 2022] DELETE /compute/v2.1/os-security-groups/aae615ac-cb3e-4d69-931d-b5e634238c4f => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:09:58.198408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa0c4324-687d-4933-ad8d-632452ff2118 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.243256 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aa0c4324-687d-4933-ad8d-632452ff2118 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.051663 Jul 20 04:09:58.249140 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 428/897] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:58 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:58.265923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-069a409b-187d-4aab-9fee-538e8b4f5985 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.266895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-069a409b-187d-4aab-9fee-538e8b4f5985 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:58.274532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-069a409b-187d-4aab-9fee-538e8b4f5985 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.274992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-069a409b-187d-4aab-9fee-538e8b4f5985 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.275782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-069a409b-187d-4aab-9fee-538e8b4f5985 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.276221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-069a409b-187d-4aab-9fee-538e8b4f5985 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.441793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-796e590e-2f27-41c2-a091-08b359f682eb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:58.468897 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-796e590e-2f27-41c2-a091-08b359f682eb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.506649 Jul 20 04:09:58.469553 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 470/898] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:57 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:58.484623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9d2a2ecc-8470-4264-85a7-451714bd131b tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.486069 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:58.486069 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:09:58.487450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d2a2ecc-8470-4264-85a7-451714bd131b tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.487899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d2a2ecc-8470-4264-85a7-451714bd131b tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.488809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d2a2ecc-8470-4264-85a7-451714bd131b tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.489250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d2a2ecc-8470-4264-85a7-451714bd131b tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.571533 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9d2a2ecc-8470-4264-85a7-451714bd131b tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?host=n-d-760456-11&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.100806 Jul 20 04:09:58.580464 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 471/899] 10.222.0.59 () {58 vars in 1195 bytes} [Wed Jul 20 04:09:58 2022] GET /compute/v2.1/os-services?host=n-d-760456-11&binary=xxx => generated 16 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:09:58.589582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-153b53f9-72d0-4799-af55-587275fd6a29 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb8429cfa60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.596072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-069a409b-187d-4aab-9fee-538e8b4f5985 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:58.610160 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-069a409b-187d-4aab-9fee-538e8b4f5985 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 0.358780 Jul 20 04:09:58.615033 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 429/900] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:58 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:58.637245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a2f7338-570d-49fa-962e-f473aa1a0ef4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.640425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2a2f7338-570d-49fa-962e-f473aa1a0ef4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:58.653929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a2f7338-570d-49fa-962e-f473aa1a0ef4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.654912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a2f7338-570d-49fa-962e-f473aa1a0ef4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.655928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a2f7338-570d-49fa-962e-f473aa1a0ef4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.656623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a2f7338-570d-49fa-962e-f473aa1a0ef4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.902433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2a2f7338-570d-49fa-962e-f473aa1a0ef4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:58.914886 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a2f7338-570d-49fa-962e-f473aa1a0ef4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1315 microversion: 2.1 time: 0.297734 Jul 20 04:09:58.916467 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 430/901] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:58 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:58.921227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7190d734-87a6-4222-94e6-09d4fa92b1c4 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.922505 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:58.922505 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:09:58.947490 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7190d734-87a6-4222-94e6-09d4fa92b1c4 tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1576664184" status: 202 len: 0 microversion: 2.1 time: 0.026251 Jul 20 04:09:58.951140 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 431/902] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:09:58 2022] DELETE /compute/v2.1/flavors/1576664184 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:58.958181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c3440e4-f2df-473c-b5d7-81998d5604f1 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:58.959917 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:58.959917 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:09:58.961181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c3440e4-f2df-473c-b5d7-81998d5604f1 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.961634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c3440e4-f2df-473c-b5d7-81998d5604f1 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.963080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c3440e4-f2df-473c-b5d7-81998d5604f1 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:58.963679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c3440e4-f2df-473c-b5d7-81998d5604f1 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:58.991997 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c3440e4-f2df-473c-b5d7-81998d5604f1 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.039255 Jul 20 04:09:58.992609 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 432/903] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:09:58 2022] GET /compute/v2.1/os-services => generated 949 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:09:59.018604 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-153b53f9-72d0-4799-af55-587275fd6a29 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/ce1a24e1-59a1-46ee-9340-bae8fb7b74b0" status: 202 len: 0 microversion: 2.1 time: 0.436153 Jul 20 04:09:59.019476 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 472/904] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:09:58 2022] DELETE /compute/v2.1/os-security-groups/ce1a24e1-59a1-46ee-9340-bae8fb7b74b0 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:59.028394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e32544ec-f496-4ba6-b6d4-67b6046851e4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:59.029848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e32544ec-f496-4ba6-b6d4-67b6046851e4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:09:59.040763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e32544ec-f496-4ba6-b6d4-67b6046851e4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.041281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e32544ec-f496-4ba6-b6d4-67b6046851e4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.042214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e32544ec-f496-4ba6-b6d4-67b6046851e4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.042690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e32544ec-f496-4ba6-b6d4-67b6046851e4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.047140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:59.092092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1057777283", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "8ef25bc8-09e8-4802-9a88-9466c2609da2"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:59.189817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] validate_networks() for [('8ef25bc8-09e8-4802-9a88-9466c2609da2', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:09:59.357476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e32544ec-f496-4ba6-b6d4-67b6046851e4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:09:59.371342 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e32544ec-f496-4ba6-b6d4-67b6046851e4 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1463 microversion: 2.1 time: 0.349519 Jul 20 04:09:59.372461 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 473/905] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:09:59 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1463 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:59.384900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0a2d95ed-763d-4fb6-88e4-22400f27f3bf tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:59.435594 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0a2d95ed-763d-4fb6-88e4-22400f27f3bf tempest-ServersWithSpecificFlavorTestJSON-136666678 tempest-ServersWithSpecificFlavorTestJSON-136666678-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061756 Jul 20 04:09:59.450420 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 474/906] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:09:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:09:59.455179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4879abb0-c846-4aa1-98cb-6a4c1b90ddc4 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:59.460862 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:09:59.460862 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:09:59.462676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4879abb0-c846-4aa1-98cb-6a4c1b90ddc4 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.463333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4879abb0-c846-4aa1-98cb-6a4c1b90ddc4 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.464325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4879abb0-c846-4aa1-98cb-6a4c1b90ddc4 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.465797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4879abb0-c846-4aa1-98cb-6a4c1b90ddc4 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.496484 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4879abb0-c846-4aa1-98cb-6a4c1b90ddc4 tempest-ServicesAdminNegativeTestJSON-2079579619 tempest-ServicesAdminNegativeTestJSON-2079579619-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.054256 Jul 20 04:09:59.497609 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 475/907] 10.222.0.59 () {58 vars in 1197 bytes} [Wed Jul 20 04:09:59 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:09:59.504921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b84cfe4f-ab8e-4aef-a19c-04460fc298ec tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb842215040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:09:59.803585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:09:59.804897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:09:59.806614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:09:59.807307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:09:59.807919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:09:59.839012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.839839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.841478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.842301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.863216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:09:59.885703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Getting quotas for project d95803bcc72643c995784af8507117b3. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:09:59.911808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Getting quotas for user 8aad902393614d1fae3d0f5bf5456c06 and project d95803bcc72643c995784af8507117b3. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:09:59.920997 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b84cfe4f-ab8e-4aef-a19c-04460fc298ec tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/5eeb21e4-92d6-4a23-ae88-ec44e430cccd" status: 202 len: 0 microversion: 2.1 time: 0.421669 Jul 20 04:09:59.922034 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 476/908] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:09:59 2022] DELETE /compute/v2.1/os-security-groups/5eeb21e4-92d6-4a23-ae88-ec44e430cccd => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:09:59.927442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-cd11ea76-57f5-4556-93e5-908e50dc4b7d req-be84cead-657c-452f-851d-3f65791fba60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd742b1-082a-4a00-b6af-75b41ac08235", "name": "network-vif-unplugged", "status": "completed", "tag": "0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:09:59.939915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:09:59.942936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:09:59.957382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cd11ea76-57f5-4556-93e5-908e50dc4b7d req-be84cead-657c-452f-851d-3f65791fba60 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:09:59.965807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cd11ea76-57f5-4556-93e5-908e50dc4b7d req-be84cead-657c-452f-851d-3f65791fba60 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:09:59.993325 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-cd11ea76-57f5-4556-93e5-908e50dc4b7d req-be84cead-657c-452f-851d-3f65791fba60 service nova] Creating event network-vif-unplugged:0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e for instance 0dd742b1-082a-4a00-b6af-75b41ac08235 on n-h2-760456-11 Jul 20 04:10:00.001638 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-cd11ea76-57f5-4556-93e5-908e50dc4b7d req-be84cead-657c-452f-851d-3f65791fba60 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077149 Jul 20 04:10:00.006890 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 477/909] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:00.013472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f9576977-79df-4328-805b-ab7da4b35b5f tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:00.014946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f9576977-79df-4328-805b-ab7da4b35b5f tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:00.022829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9576977-79df-4328-805b-ab7da4b35b5f tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.023701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9576977-79df-4328-805b-ab7da4b35b5f tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.024817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9576977-79df-4328-805b-ab7da4b35b5f tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.025481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9576977-79df-4328-805b-ab7da4b35b5f tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.029984 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7305a866-70fa-424d-b361-45a63e608083 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036123 Jul 20 04:10:00.030713 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 433/910] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:00.042223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d4decf6-eec7-443a-9c70-2d3446eeb094 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:00.045224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8d4decf6-eec7-443a-9c70-2d3446eeb094 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:00.063213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d4decf6-eec7-443a-9c70-2d3446eeb094 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.066143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d4decf6-eec7-443a-9c70-2d3446eeb094 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.067218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d4decf6-eec7-443a-9c70-2d3446eeb094 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.070453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d4decf6-eec7-443a-9c70-2d3446eeb094 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.105647 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8d4decf6-eec7-443a-9c70-2d3446eeb094 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] HTTP exception thrown: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d4decf6-eec7-443a-9c70-2d3446eeb094 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Request method failure captured: Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f HTTP/1.1 Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139wXtKo4wlcaRodC-PDxerIJLWLxQv3_ne6eDlLoWTKdtE4yBOdxLjRFh-28hDbxPIAbF6mfr8z6kT7EZxjHCO5y4FK5O36sPd1V-3lfUfvF6Ogt_3ka-MLH-qvR_M3cC-VKFaZsk7Tj69aOu6zTKEEFEGexl2q04lRewSn6DySAus Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:10:00.112123 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: c5dc8e2f30ce43ebb7919cdd1ab417ef Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:10:00.113712 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4b088ee6-9cad-4386-9ea8-795cd04ee72f'} Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:00.114700 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:10:00.116742 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:00.119089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d4decf6-eec7-443a-9c70-2d3446eeb094 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Returning 404 to user: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:00.123231 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8d4decf6-eec7-443a-9c70-2d3446eeb094 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 404 len: 111 microversion: 2.1 time: 0.088631 Jul 20 04:10:00.129194 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 434/911] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:00 2022] DELETE /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:00.135343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-98c3aa39-7e74-48ba-a6d2-0a92e6d94b24 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:00.135966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-98c3aa39-7e74-48ba-a6d2-0a92e6d94b24 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:00.154834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98c3aa39-7e74-48ba-a6d2-0a92e6d94b24 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.157476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98c3aa39-7e74-48ba-a6d2-0a92e6d94b24 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.158340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98c3aa39-7e74-48ba-a6d2-0a92e6d94b24 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.158781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98c3aa39-7e74-48ba-a6d2-0a92e6d94b24 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.177889 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f9576977-79df-4328-805b-ab7da4b35b5f tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action" status: 202 len: 0 microversion: 2.1 time: 0.168565 Jul 20 04:10:00.182926 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 478/912] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:00 2022] POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:00.436797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86f00567-cf17-4620-9f79-fd6b517f5228 tempest-ServicesAdminNegativeTestJSON-1342507299 tempest-ServicesAdminNegativeTestJSON-1342507299-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:00.439343 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:00.439343 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:00.440815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-86f00567-cf17-4620-9f79-fd6b517f5228 tempest-ServicesAdminNegativeTestJSON-1342507299 tempest-ServicesAdminNegativeTestJSON-1342507299-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ab0e366b6a034ad399074de7413f6818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6037509efc0e48c5b9686d5a39bc0ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86f00567-cf17-4620-9f79-fd6b517f5228 tempest-ServicesAdminNegativeTestJSON-1342507299 tempest-ServicesAdminNegativeTestJSON-1342507299-project] Request method failure captured: Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ATsNcFJ9CUvF8thZ-qacT6qBaORsXEVuZyOgwSSFJbgZxNiAGBrPeEVT_MQ5YlvEaYkk2PzbXjsCD6TlQ4yWnbJ_WwPE4yAgwAkd1grojc-UEFRdYpSNsk0fZ1dLDSKo9L7TcA17AJ81S5Z_uOewvU82OxFmnGqg3WcmKApNkGUls Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 6037509efc0e48c5b9686d5a39bc0ff3 Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1342507299 Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:10:00.443961 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6037509efc0e48c5b9686d5a39bc0ff3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6037509efc0e48c5b9686d5a39bc0ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6037509efc0e48c5b9686d5a39bc0ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6037509efc0e48c5b9686d5a39bc0ff3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1342507299 Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 6037509efc0e48c5b9686d5a39bc0ff3 Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1342507299 Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServicesAdminNegativeTestJSON-1342507299-project Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: ab0e366b6a034ad399074de7413f6818 Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1342507299-project Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:10:00.445663 n-d-760456-11 devstack@n-api.service[119606]: action_args: {} Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:00.446465 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:10:00.447646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:00.450601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86f00567-cf17-4620-9f79-fd6b517f5228 tempest-ServicesAdminNegativeTestJSON-1342507299 tempest-ServicesAdminNegativeTestJSON-1342507299-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:00.452141 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-86f00567-cf17-4620-9f79-fd6b517f5228 tempest-ServicesAdminNegativeTestJSON-1342507299 tempest-ServicesAdminNegativeTestJSON-1342507299-project] 10.222.0.59 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.270659 Jul 20 04:10:00.456666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-98c3aa39-7e74-48ba-a6d2-0a92e6d94b24 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:00.465555 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 479/913] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:10:00 2022] GET /compute/v2.1/os-services => generated 112 bytes in 283 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:00.469394 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-98c3aa39-7e74-48ba-a6d2-0a92e6d94b24 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.338870 Jul 20 04:10:00.471073 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 435/914] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:00 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:00.476861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c31cc2c3-7b1d-4901-a05f-bee8074c5d20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:00.477950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c31cc2c3-7b1d-4901-a05f-bee8074c5d20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:00.487529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d488420-203f-4710-a7d4-c20622c488f9 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb84226e040>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:00.503972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c31cc2c3-7b1d-4901-a05f-bee8074c5d20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.506269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c31cc2c3-7b1d-4901-a05f-bee8074c5d20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.508903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c31cc2c3-7b1d-4901-a05f-bee8074c5d20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.509933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c31cc2c3-7b1d-4901-a05f-bee8074c5d20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.872049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c31cc2c3-7b1d-4901-a05f-bee8074c5d20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:00.882915 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c31cc2c3-7b1d-4901-a05f-bee8074c5d20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 0.411265 Jul 20 04:10:00.883733 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 480/915] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:00 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:00.888479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc068d3f-f799-4c49-89e0-2f2abe56520c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:00.889305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc068d3f-f799-4c49-89e0-2f2abe56520c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:00.897914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc068d3f-f799-4c49-89e0-2f2abe56520c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.898742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc068d3f-f799-4c49-89e0-2f2abe56520c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.899773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc068d3f-f799-4c49-89e0-2f2abe56520c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:00.900498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc068d3f-f799-4c49-89e0-2f2abe56520c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:00.950413 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d488420-203f-4710-a7d4-c20622c488f9 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/f428e768-f63b-47c2-b24a-9f2396f89350" status: 202 len: 0 microversion: 2.1 time: 0.477688 Jul 20 04:10:00.951230 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 436/916] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:10:00 2022] DELETE /compute/v2.1/os-security-groups/f428e768-f63b-47c2-b24a-9f2396f89350 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:00.977760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6a3813fe-88a8-4f87-81a3-1bde8798ff4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:00.978840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6a3813fe-88a8-4f87-81a3-1bde8798ff4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:01.021113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a3813fe-88a8-4f87-81a3-1bde8798ff4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.041069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a3813fe-88a8-4f87-81a3-1bde8798ff4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.045451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a3813fe-88a8-4f87-81a3-1bde8798ff4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.045967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a3813fe-88a8-4f87-81a3-1bde8798ff4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.200621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc068d3f-f799-4c49-89e0-2f2abe56520c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:01.208930 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc068d3f-f799-4c49-89e0-2f2abe56520c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1315 microversion: 2.1 time: 0.323954 Jul 20 04:10:01.209513 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 481/917] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:00 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:01.210215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6a3813fe-88a8-4f87-81a3-1bde8798ff4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:01.225530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5140fc7f-605c-49d2-9e41-80fc4a2b6cab tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:01.226084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5140fc7f-605c-49d2-9e41-80fc4a2b6cab tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 4b088ee6-9cad-4386-9ea8-795cd04ee72f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:01.227270 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6a3813fe-88a8-4f87-81a3-1bde8798ff4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1212 microversion: 2.1 time: 0.274308 Jul 20 04:10:01.230619 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 437/918] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:00 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1212 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:01.235475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-31ba3c7e-8687-493f-8bd1-7187c5ad9a1a tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:01.238888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-31ba3c7e-8687-493f-8bd1-7187c5ad9a1a tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:01.248365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5140fc7f-605c-49d2-9e41-80fc4a2b6cab tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.248852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5140fc7f-605c-49d2-9e41-80fc4a2b6cab tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.249659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5140fc7f-605c-49d2-9e41-80fc4a2b6cab tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.250116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5140fc7f-605c-49d2-9e41-80fc4a2b6cab tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.258687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31ba3c7e-8687-493f-8bd1-7187c5ad9a1a tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.259493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31ba3c7e-8687-493f-8bd1-7187c5ad9a1a tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.262883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31ba3c7e-8687-493f-8bd1-7187c5ad9a1a tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.265719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31ba3c7e-8687-493f-8bd1-7187c5ad9a1a tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.288954 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5140fc7f-605c-49d2-9e41-80fc4a2b6cab tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] HTTP exception thrown: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5140fc7f-605c-49d2-9e41-80fc4a2b6cab tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Request method failure captured: Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f HTTP/1.1 Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi139wXtKo4wlcaRodC-PDxerIJLWLxQv3_ne6eDlLoWTKdtE4yBOdxLjRFh-28hDbxPIAbF6mfr8z6kT7EZxjHCO5y4FK5O36sPd1V-3lfUfvF6Ogt_3ka-MLH-qvR_M3cC-VKFaZsk7Tj69aOu6zTKEEFEGexl2q04lRewSn6DySAus Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:10:01.290537 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: c5dc8e2f30ce43ebb7919cdd1ab417ef Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:10:01.291830 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4b088ee6-9cad-4386-9ea8-795cd04ee72f'} Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:01.292579 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. Jul 20 04:10:01.293741 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:01.294829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5140fc7f-605c-49d2-9e41-80fc4a2b6cab tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Returning 404 to user: Instance 4b088ee6-9cad-4386-9ea8-795cd04ee72f could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:01.294829 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5140fc7f-605c-49d2-9e41-80fc4a2b6cab tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f" status: 404 len: 111 microversion: 2.1 time: 0.070611 Jul 20 04:10:01.294829 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 482/919] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:01 2022] GET /compute/v2.1/servers/4b088ee6-9cad-4386-9ea8-795cd04ee72f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:01.307557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0158928a-f12a-402c-adcc-67d5d0b562da tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb84221fdc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:01.313536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31ba3c7e-8687-493f-8bd1-7187c5ad9a1a tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.314603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31ba3c7e-8687-493f-8bd1-7187c5ad9a1a tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.315282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-31ba3c7e-8687-493f-8bd1-7187c5ad9a1a tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lazy-loading 'fault' on Instance uuid 288f952b-81ce-419b-9907-96b8b0db1d30 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:01.543217 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-31ba3c7e-8687-493f-8bd1-7187c5ad9a1a tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1599 microversion: 2.1 time: 0.311252 Jul 20 04:10:01.544938 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 438/920] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:01 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1599 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:01.553979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-08b4eca6-7c8d-4b4b-85d3-8e31ae1ebcda req-fc2b95ae-7b85-45e8-9643-9805367d1ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec4b278f-a380-46e4-8d3f-216258883086", "name": "network-vif-plugged", "status": "completed", "tag": "8c4921df-07be-4e19-a80a-939084fe95a2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:01.576705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-08b4eca6-7c8d-4b4b-85d3-8e31ae1ebcda req-fc2b95ae-7b85-45e8-9643-9805367d1ee2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.577456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-08b4eca6-7c8d-4b4b-85d3-8e31ae1ebcda req-fc2b95ae-7b85-45e8-9643-9805367d1ee2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.596620 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-08b4eca6-7c8d-4b4b-85d3-8e31ae1ebcda req-fc2b95ae-7b85-45e8-9643-9805367d1ee2 service nova] Creating event network-vif-plugged:8c4921df-07be-4e19-a80a-939084fe95a2 for instance ec4b278f-a380-46e4-8d3f-216258883086 on n-h1-760456-11 Jul 20 04:10:01.597777 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0158928a-f12a-402c-adcc-67d5d0b562da tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/5182a60d-b208-4d02-9759-b631ccbf587e" status: 202 len: 0 microversion: 2.1 time: 0.304206 Jul 20 04:10:01.598381 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 483/921] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:10:01 2022] DELETE /compute/v2.1/os-security-groups/5182a60d-b208-4d02-9759-b631ccbf587e => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:01.603494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5ea7fa67-cd28-45e4-b31c-0e0f9931fa6c tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:01.608145 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-08b4eca6-7c8d-4b4b-85d3-8e31ae1ebcda req-fc2b95ae-7b85-45e8-9643-9805367d1ee2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059870 Jul 20 04:10:01.609023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5ea7fa67-cd28-45e4-b31c-0e0f9931fa6c tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:01.610018 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 439/922] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:01.617436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26774e62-4d90-4605-b69c-9853bd4839c4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:01.618486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-26774e62-4d90-4605-b69c-9853bd4839c4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:01.627630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ea7fa67-cd28-45e4-b31c-0e0f9931fa6c tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.630837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26774e62-4d90-4605-b69c-9853bd4839c4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.634480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26774e62-4d90-4605-b69c-9853bd4839c4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.635627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26774e62-4d90-4605-b69c-9853bd4839c4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.636639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26774e62-4d90-4605-b69c-9853bd4839c4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.636760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ea7fa67-cd28-45e4-b31c-0e0f9931fa6c tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.644627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ea7fa67-cd28-45e4-b31c-0e0f9931fa6c tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.661331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ea7fa67-cd28-45e4-b31c-0e0f9931fa6c tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.748703 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5ea7fa67-cd28-45e4-b31c-0e0f9931fa6c tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] HTTP exception thrown: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5ea7fa67-cd28-45e4-b31c-0e0f9931fa6c tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Request method failure captured: Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb HTTP/1.1 Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi139wXtKo4wlcaRodC-PDxerIJLWLxQv3_ne6eDlLoWTKdtE4yBOdxLjRFh-28hDbxPIAbF6mfr8z6kT7EZxjHCO5y4FK5O36sPd1V-3lfUfvF6Ogt_3ka-MLH-qvR_M3cC-VKFaZsk7Tj69aOu6zTKEEFEGexl2q04lRewSn6DySAus Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:10:01.750386 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: c5dc8e2f30ce43ebb7919cdd1ab417ef Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:10:01.751705 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '32096456-698a-47c4-a1e6-061e62a3a8fb'} Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:01.752477 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:10:01.753680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:01.754940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5ea7fa67-cd28-45e4-b31c-0e0f9931fa6c tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Returning 404 to user: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:01.754940 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5ea7fa67-cd28-45e4-b31c-0e0f9931fa6c tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "DELETE /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 404 len: 111 microversion: 2.1 time: 0.152305 Jul 20 04:10:01.754940 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 484/923] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:01 2022] DELETE /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:01.776693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-90b92d45-27b9-48bb-b79d-0df5e5a4c9ed tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:01.777773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-90b92d45-27b9-48bb-b79d-0df5e5a4c9ed tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:01.785194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90b92d45-27b9-48bb-b79d-0df5e5a4c9ed tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.785889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90b92d45-27b9-48bb-b79d-0df5e5a4c9ed tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.786907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90b92d45-27b9-48bb-b79d-0df5e5a4c9ed tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:01.787561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90b92d45-27b9-48bb-b79d-0df5e5a4c9ed tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:01.935571 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-90b92d45-27b9-48bb-b79d-0df5e5a4c9ed tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action" status: 202 len: 0 microversion: 2.1 time: 0.170693 Jul 20 04:10:01.936226 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 485/924] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:01 2022] POST /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:01.947210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b86baa3-7efd-467c-a54f-1179705bbd72 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] Calling method '.version_select at 0x7fb842c1f550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:01.954466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-26774e62-4d90-4605-b69c-9853bd4839c4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:01.982605 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-26774e62-4d90-4605-b69c-9853bd4839c4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.367088 Jul 20 04:10:01.987764 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 440/925] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:01 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:02.004610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fe41ed0-704f-42f2-a681-1712296711f4 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:02.006284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1fe41ed0-704f-42f2-a681-1712296711f4 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] [instance: 32096456-698a-47c4-a1e6-061e62a3a8fb] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:02.024187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fe41ed0-704f-42f2-a681-1712296711f4 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.025304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fe41ed0-704f-42f2-a681-1712296711f4 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.027296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fe41ed0-704f-42f2-a681-1712296711f4 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.030319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fe41ed0-704f-42f2-a681-1712296711f4 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.068230 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-1fe41ed0-704f-42f2-a681-1712296711f4 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] HTTP exception thrown: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fe41ed0-704f-42f2-a681-1712296711f4 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Request method failure captured: Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb HTTP/1.1 Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi139wXtKo4wlcaRodC-PDxerIJLWLxQv3_ne6eDlLoWTKdtE4yBOdxLjRFh-28hDbxPIAbF6mfr8z6kT7EZxjHCO5y4FK5O36sPd1V-3lfUfvF6Ogt_3ka-MLH-qvR_M3cC-VKFaZsk7Tj69aOu6zTKEEFEGexl2q04lRewSn6DySAus Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:10:02.070149 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e4208e8570ad4fc597f5cc44f7785171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e4208e8570ad4fc597f5cc44f7785171 Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443 Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: c5dc8e2f30ce43ebb7919cdd1ab417ef Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1731223443-project Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:10:02.071463 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '32096456-698a-47c4-a1e6-061e62a3a8fb'} Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:02.072189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. Jul 20 04:10:02.073385 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:02.074496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fe41ed0-704f-42f2-a681-1712296711f4 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] Returning 404 to user: Instance 32096456-698a-47c4-a1e6-061e62a3a8fb could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:02.078814 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1fe41ed0-704f-42f2-a681-1712296711f4 tempest-ServersWithSpecificFlavorTestJSON-1731223443 tempest-ServersWithSpecificFlavorTestJSON-1731223443-project] 10.222.0.59 "GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb" status: 404 len: 111 microversion: 2.1 time: 0.087621 Jul 20 04:10:02.079742 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 441/926] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:01 2022] GET /compute/v2.1/servers/32096456-698a-47c4-a1e6-061e62a3a8fb => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:02.090705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35f49379-f5c4-4ced-b57e-db5fa78b429a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:02.091399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-35f49379-f5c4-4ced-b57e-db5fa78b429a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:02.106638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f49379-f5c4-4ced-b57e-db5fa78b429a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.108937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f49379-f5c4-4ced-b57e-db5fa78b429a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.110170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f49379-f5c4-4ced-b57e-db5fa78b429a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.111212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f49379-f5c4-4ced-b57e-db5fa78b429a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.439007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-35f49379-f5c4-4ced-b57e-db5fa78b429a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:02.448006 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-35f49379-f5c4-4ced-b57e-db5fa78b429a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 0.367138 Jul 20 04:10:02.454053 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 442/927] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:02 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:02.459276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a9fcad3-894b-4173-a92c-fd886748d5af tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:02.462676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0a9fcad3-894b-4173-a92c-fd886748d5af tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:02.477387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a9fcad3-894b-4173-a92c-fd886748d5af tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.478186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a9fcad3-894b-4173-a92c-fd886748d5af tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.479282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a9fcad3-894b-4173-a92c-fd886748d5af tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.483394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a9fcad3-894b-4173-a92c-fd886748d5af tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.590539 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4b86baa3-7efd-467c-a54f-1179705bbd72 tempest-SecurityGroupRulesTestJSON-519889157 tempest-SecurityGroupRulesTestJSON-519889157-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/14afee9d-0aad-4ba6-bb45-2b4faf278fab" status: 202 len: 0 microversion: 2.1 time: 0.650651 Jul 20 04:10:02.591488 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 486/928] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:10:01 2022] DELETE /compute/v2.1/os-security-groups/14afee9d-0aad-4ba6-bb45-2b4faf278fab => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:02.597062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-70bf085d-ace2-4bd9-9dd5-662b2ee5fbf1 req-bd7da3db-3bf6-457c-b173-4ceaed9550e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd742b1-082a-4a00-b6af-75b41ac08235", "tag": "0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:02.619063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-70bf085d-ace2-4bd9-9dd5-662b2ee5fbf1 req-bd7da3db-3bf6-457c-b173-4ceaed9550e1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.623008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-70bf085d-ace2-4bd9-9dd5-662b2ee5fbf1 req-bd7da3db-3bf6-457c-b173-4ceaed9550e1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.647816 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-70bf085d-ace2-4bd9-9dd5-662b2ee5fbf1 req-bd7da3db-3bf6-457c-b173-4ceaed9550e1 service nova] Creating event network-changed:0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e for instance 0dd742b1-082a-4a00-b6af-75b41ac08235 on n-h2-760456-11 Jul 20 04:10:02.658164 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-70bf085d-ace2-4bd9-9dd5-662b2ee5fbf1 req-bd7da3db-3bf6-457c-b173-4ceaed9550e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061395 Jul 20 04:10:02.661554 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 487/929] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:02.676602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ebf943d-dff8-4067-9278-f53811a9469d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:02.678492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2ebf943d-dff8-4067-9278-f53811a9469d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:02.691987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ebf943d-dff8-4067-9278-f53811a9469d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.693614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ebf943d-dff8-4067-9278-f53811a9469d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:02.701578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ebf943d-dff8-4067-9278-f53811a9469d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:02.702879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ebf943d-dff8-4067-9278-f53811a9469d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.013791 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a9fcad3-894b-4173-a92c-fd886748d5af tempest-ServersAdminTestJSON-603305145 tempest-ServersAdminTestJSON-603305145-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1616 microversion: 2.1 time: 0.558358 Jul 20 04:10:03.018786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2ebf943d-dff8-4067-9278-f53811a9469d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:03.027950 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 443/930] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:02 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1616 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:03.030418 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ebf943d-dff8-4067-9278-f53811a9469d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1315 microversion: 2.1 time: 0.364651 Jul 20 04:10:03.031996 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 488/931] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:02 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:03.040426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1b016a01-d2a2-4711-89df-bb278182ccfd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:03.041998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1b016a01-d2a2-4711-89df-bb278182ccfd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:03.047161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-14086216-f11a-420e-8c94-53fe8667685f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:03.047785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-14086216-f11a-420e-8c94-53fe8667685f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:03.050217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b016a01-d2a2-4711-89df-bb278182ccfd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.051026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b016a01-d2a2-4711-89df-bb278182ccfd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.052843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b016a01-d2a2-4711-89df-bb278182ccfd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.055047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14086216-f11a-420e-8c94-53fe8667685f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.055502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14086216-f11a-420e-8c94-53fe8667685f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.055904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b016a01-d2a2-4711-89df-bb278182ccfd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.056474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14086216-f11a-420e-8c94-53fe8667685f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.056909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14086216-f11a-420e-8c94-53fe8667685f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.252521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-14086216-f11a-420e-8c94-53fe8667685f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:03.262238 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-14086216-f11a-420e-8c94-53fe8667685f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1266 microversion: 2.1 time: 0.233066 Jul 20 04:10:03.280627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1b016a01-d2a2-4711-89df-bb278182ccfd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:03.289451 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 444/932] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:03 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:03.293562 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1b016a01-d2a2-4711-89df-bb278182ccfd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.259998 Jul 20 04:10:03.309022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-65c42386-ad39-4ff9-855c-bcef0ee32370 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:03.309450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-65c42386-ad39-4ff9-855c-bcef0ee32370 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:03.309960 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 489/933] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:03 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:03.316154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65c42386-ad39-4ff9-855c-bcef0ee32370 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.316800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65c42386-ad39-4ff9-855c-bcef0ee32370 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.317587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65c42386-ad39-4ff9-855c-bcef0ee32370 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.318030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65c42386-ad39-4ff9-855c-bcef0ee32370 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.344834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-65c42386-ad39-4ff9-855c-bcef0ee32370 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:10:03.454461 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-65c42386-ad39-4ff9-855c-bcef0ee32370 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "DELETE /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 204 len: 0 microversion: 2.1 time: 0.162723 Jul 20 04:10:03.458328 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 445/934] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:03 2022] DELETE /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:10:03.465527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0342e68-46e1-45cc-bde5-76bf77f800ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:03.466080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d0342e68-46e1-45cc-bde5-76bf77f800ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:03.482275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0342e68-46e1-45cc-bde5-76bf77f800ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.483288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0342e68-46e1-45cc-bde5-76bf77f800ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.483543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a2fc5499-0a90-43cd-8849-f5a2b5703ee0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:03.484326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a2fc5499-0a90-43cd-8849-f5a2b5703ee0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:03.484537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0342e68-46e1-45cc-bde5-76bf77f800ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.485688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0342e68-46e1-45cc-bde5-76bf77f800ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.492726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2fc5499-0a90-43cd-8849-f5a2b5703ee0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.493153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2fc5499-0a90-43cd-8849-f5a2b5703ee0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.494323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2fc5499-0a90-43cd-8849-f5a2b5703ee0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:03.495163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2fc5499-0a90-43cd-8849-f5a2b5703ee0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:03.759394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d0342e68-46e1-45cc-bde5-76bf77f800ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:03.768474 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d0342e68-46e1-45cc-bde5-76bf77f800ad tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1469 microversion: 2.1 time: 0.308593 Jul 20 04:10:03.778727 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 490/935] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:03 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:04.049553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-087accc4-e189-4fc0-b290-d24740380ac0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:04.050176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-087accc4-e189-4fc0-b290-d24740380ac0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:04.057477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-087accc4-e189-4fc0-b290-d24740380ac0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:04.057977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-087accc4-e189-4fc0-b290-d24740380ac0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:04.058747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-087accc4-e189-4fc0-b290-d24740380ac0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:04.059381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-087accc4-e189-4fc0-b290-d24740380ac0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:04.079835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a2fc5499-0a90-43cd-8849-f5a2b5703ee0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:04.092952 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a2fc5499-0a90-43cd-8849-f5a2b5703ee0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 0.620801 Jul 20 04:10:04.093874 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 446/936] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:03 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:04.290172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-61e3cc3b-5b5b-4a21-9a82-10d6d951b6b4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:04.290994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-61e3cc3b-5b5b-4a21-9a82-10d6d951b6b4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:04.299911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61e3cc3b-5b5b-4a21-9a82-10d6d951b6b4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:04.300484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61e3cc3b-5b5b-4a21-9a82-10d6d951b6b4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:04.302560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61e3cc3b-5b5b-4a21-9a82-10d6d951b6b4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:04.303032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61e3cc3b-5b5b-4a21-9a82-10d6d951b6b4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:04.378980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-087accc4-e189-4fc0-b290-d24740380ac0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:04.399254 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-087accc4-e189-4fc0-b290-d24740380ac0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1465 microversion: 2.1 time: 0.352803 Jul 20 04:10:04.402708 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 491/937] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:04 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1465 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:04.418622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4814b8fa-9c23-44cd-a4c6-9c04177bacb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:04.419406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4814b8fa-9c23-44cd-a4c6-9c04177bacb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:04.427006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4814b8fa-9c23-44cd-a4c6-9c04177bacb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:04.428051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4814b8fa-9c23-44cd-a4c6-9c04177bacb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:04.429570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4814b8fa-9c23-44cd-a4c6-9c04177bacb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:04.430203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4814b8fa-9c23-44cd-a4c6-9c04177bacb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:04.933113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-61e3cc3b-5b5b-4a21-9a82-10d6d951b6b4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:04.959767 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-61e3cc3b-5b5b-4a21-9a82-10d6d951b6b4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1308 microversion: 2.1 time: 0.680598 Jul 20 04:10:04.969732 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 447/938] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:04 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1308 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:04.980944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4021162f-194b-4d54-b146-16088a97c219 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:04.981566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4021162f-194b-4d54-b146-16088a97c219 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:04.995206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4814b8fa-9c23-44cd-a4c6-9c04177bacb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:05.003591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4021162f-194b-4d54-b146-16088a97c219 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.003740 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4814b8fa-9c23-44cd-a4c6-9c04177bacb3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.599105 Jul 20 04:10:05.004099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4021162f-194b-4d54-b146-16088a97c219 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.008906 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 492/939] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:04 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:05.016730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4021162f-194b-4d54-b146-16088a97c219 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.017490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4021162f-194b-4d54-b146-16088a97c219 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.026585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3010aa68-5e91-4498-9d7a-ad4e039c6da3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:05.027462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3010aa68-5e91-4498-9d7a-ad4e039c6da3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:05.033894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3010aa68-5e91-4498-9d7a-ad4e039c6da3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.034624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3010aa68-5e91-4498-9d7a-ad4e039c6da3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.035617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3010aa68-5e91-4498-9d7a-ad4e039c6da3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.038755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3010aa68-5e91-4498-9d7a-ad4e039c6da3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.377966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3010aa68-5e91-4498-9d7a-ad4e039c6da3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:05.389315 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3010aa68-5e91-4498-9d7a-ad4e039c6da3 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1469 microversion: 2.1 time: 0.378913 Jul 20 04:10:05.400414 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 493/940] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:05 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1469 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:05.405261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d7ef0343-7556-4c38-a991-1178d3713040 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:05.405885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d7ef0343-7556-4c38-a991-1178d3713040 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:05.413665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7ef0343-7556-4c38-a991-1178d3713040 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.414125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7ef0343-7556-4c38-a991-1178d3713040 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.415460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7ef0343-7556-4c38-a991-1178d3713040 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.415968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7ef0343-7556-4c38-a991-1178d3713040 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.527493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:05.543209 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4021162f-194b-4d54-b146-16088a97c219 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1618 microversion: 2.1 time: 0.571996 Jul 20 04:10:05.544166 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 448/941] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:04 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1618 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:05.679270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1591997499", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["cc16be0b-acc6-4bec-997a-2f0026a5500e"]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:05.771518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:05.947601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d7ef0343-7556-4c38-a991-1178d3713040 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:05.955602 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d7ef0343-7556-4c38-a991-1178d3713040 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 0.554030 Jul 20 04:10:05.965345 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 494/942] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:05 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:05.984576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a48261d0-c4b1-463b-b2a6-48f8e2898d7f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:05.985514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a48261d0-c4b1-463b-b2a6-48f8e2898d7f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:05.992838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a48261d0-c4b1-463b-b2a6-48f8e2898d7f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.993550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a48261d0-c4b1-463b-b2a6-48f8e2898d7f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:05.994778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a48261d0-c4b1-463b-b2a6-48f8e2898d7f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:05.995387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a48261d0-c4b1-463b-b2a6-48f8e2898d7f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.019717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:06.384155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a48261d0-c4b1-463b-b2a6-48f8e2898d7f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:06.395432 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a48261d0-c4b1-463b-b2a6-48f8e2898d7f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1308 microversion: 2.1 time: 0.415974 Jul 20 04:10:06.396337 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 495/943] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:05 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1308 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:06.402532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cf8f2eee-abef-4150-ac79-e4361530bc6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:06.404062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cf8f2eee-abef-4150-ac79-e4361530bc6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:06.413204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf8f2eee-abef-4150-ac79-e4361530bc6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.414317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf8f2eee-abef-4150-ac79-e4361530bc6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.415582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf8f2eee-abef-4150-ac79-e4361530bc6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.416184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf8f2eee-abef-4150-ac79-e4361530bc6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.523147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:06.524207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:06.525136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:06.525776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:06.527668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:06.538758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.540106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.541296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.541746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.583478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:06.605508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:06.652408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:06.655113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:06.772588 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-260f5b28-d2ad-41b4-82b8-0c1402ec6d47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098108 Jul 20 04:10:06.778519 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 449/944] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:10:06.784244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d39d70a-cfb0-4b01-96cc-77e74dae30e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:06.784871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d39d70a-cfb0-4b01-96cc-77e74dae30e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:06.802129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d39d70a-cfb0-4b01-96cc-77e74dae30e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.802689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d39d70a-cfb0-4b01-96cc-77e74dae30e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:06.804037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d39d70a-cfb0-4b01-96cc-77e74dae30e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:06.804490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d39d70a-cfb0-4b01-96cc-77e74dae30e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.047427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d39d70a-cfb0-4b01-96cc-77e74dae30e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:07.058894 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d39d70a-cfb0-4b01-96cc-77e74dae30e2 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1427 microversion: 2.1 time: 0.278500 Jul 20 04:10:07.062501 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 450/945] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:06 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1427 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:07.079629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-9ad810fd-3e81-4637-b0f9-aa08773caa3e req-737d0e57-c6ab-4081-8a85-85767ff8046e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd742b1-082a-4a00-b6af-75b41ac08235", "name": "network-vif-unplugged", "status": "completed", "tag": "0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:07.101313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9ad810fd-3e81-4637-b0f9-aa08773caa3e req-737d0e57-c6ab-4081-8a85-85767ff8046e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.107635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9ad810fd-3e81-4637-b0f9-aa08773caa3e req-737d0e57-c6ab-4081-8a85-85767ff8046e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.149560 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-9ad810fd-3e81-4637-b0f9-aa08773caa3e req-737d0e57-c6ab-4081-8a85-85767ff8046e service nova] Creating event network-vif-unplugged:0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e for instance 0dd742b1-082a-4a00-b6af-75b41ac08235 on n-h2-760456-11 Jul 20 04:10:07.154931 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-9ad810fd-3e81-4637-b0f9-aa08773caa3e req-737d0e57-c6ab-4081-8a85-85767ff8046e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090078 Jul 20 04:10:07.155931 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 451/946] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:07.164474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e1ca5a19-43ff-4b46-88de-25a9d2709b71 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.172273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e1ca5a19-43ff-4b46-88de-25a9d2709b71 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:07.272433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cf8f2eee-abef-4150-ac79-e4361530bc6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:07.286324 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cf8f2eee-abef-4150-ac79-e4361530bc6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.888857 Jul 20 04:10:07.287333 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 496/947] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:06 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:07.295070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31a39432-8f97-4d1d-9dea-0c6f24940a2d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.297173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31a39432-8f97-4d1d-9dea-0c6f24940a2d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:07.309643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31a39432-8f97-4d1d-9dea-0c6f24940a2d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.323860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31a39432-8f97-4d1d-9dea-0c6f24940a2d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.325489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31a39432-8f97-4d1d-9dea-0c6f24940a2d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.326128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31a39432-8f97-4d1d-9dea-0c6f24940a2d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.421054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e1ca5a19-43ff-4b46-88de-25a9d2709b71 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:07.445823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e1ca5a19-43ff-4b46-88de-25a9d2709b71 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1217 microversion: 2.1 time: 0.285703 Jul 20 04:10:07.446610 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 452/948] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:07 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1217 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:07.457168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-44772e0f-c15e-4362-b93f-c9eb732404ac req-2ec75c74-de99-4a7b-9141-b2202a216578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b11eea-02b0-428a-9a50-5f6f38367827", "name": "network-vif-deleted", "tag": "3e9ba8b7-25c0-45f1-82ec-641a51172265"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:07.485646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-44772e0f-c15e-4362-b93f-c9eb732404ac req-2ec75c74-de99-4a7b-9141-b2202a216578 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.486836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-44772e0f-c15e-4362-b93f-c9eb732404ac req-2ec75c74-de99-4a7b-9141-b2202a216578 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.516567 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-44772e0f-c15e-4362-b93f-c9eb732404ac req-2ec75c74-de99-4a7b-9141-b2202a216578 service nova] Creating event network-vif-deleted:3e9ba8b7-25c0-45f1-82ec-641a51172265 for instance 83b11eea-02b0-428a-9a50-5f6f38367827 on n-h1-760456-11 Jul 20 04:10:07.536445 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-44772e0f-c15e-4362-b93f-c9eb732404ac req-2ec75c74-de99-4a7b-9141-b2202a216578 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088037 Jul 20 04:10:07.538090 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 453/949] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:07.546998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-212c4981-5246-4fa5-a6bd-df1ad5beeca9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:07.547967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-212c4981-5246-4fa5-a6bd-df1ad5beeca9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:07.562766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-212c4981-5246-4fa5-a6bd-df1ad5beeca9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.563495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-212c4981-5246-4fa5-a6bd-df1ad5beeca9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.564839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-212c4981-5246-4fa5-a6bd-df1ad5beeca9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:07.567374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-212c4981-5246-4fa5-a6bd-df1ad5beeca9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:07.797520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31a39432-8f97-4d1d-9dea-0c6f24940a2d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:07.807088 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31a39432-8f97-4d1d-9dea-0c6f24940a2d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 0.517553 Jul 20 04:10:07.807688 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 497/950] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:07 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:08.080369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:08.081673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:08.089779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.090382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.091590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.092119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.152177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.152919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.153550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lazy-loading 'fault' on Instance uuid 83b11eea-02b0-428a-9a50-5f6f38367827 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:08.253905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:08.275277 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1b16619a-3e97-4926-9671-4b64456099b9 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 200 len: 1303 microversion: 2.1 time: 0.199307 Jul 20 04:10:08.277608 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 498/951] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:08 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 1303 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:08.304110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d9f4718a-71e6-43c3-a65a-09beb71f624b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:08.308082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d9f4718a-71e6-43c3-a65a-09beb71f624b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:08.325587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9f4718a-71e6-43c3-a65a-09beb71f624b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.326300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9f4718a-71e6-43c3-a65a-09beb71f624b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.327500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9f4718a-71e6-43c3-a65a-09beb71f624b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.328468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9f4718a-71e6-43c3-a65a-09beb71f624b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.614716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d9f4718a-71e6-43c3-a65a-09beb71f624b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:08.633517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-212c4981-5246-4fa5-a6bd-df1ad5beeca9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:08.642455 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-212c4981-5246-4fa5-a6bd-df1ad5beeca9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1308 microversion: 2.1 time: 1.102626 Jul 20 04:10:08.645984 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 454/952] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:07 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1308 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:08.666211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43c9572c-6cfd-497e-a7f8-f00260430e1f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:08.668047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43c9572c-6cfd-497e-a7f8-f00260430e1f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:08.669968 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d9f4718a-71e6-43c3-a65a-09beb71f624b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1476 microversion: 2.1 time: 0.370078 Jul 20 04:10:08.670617 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 499/953] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:08 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:08.677537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43c9572c-6cfd-497e-a7f8-f00260430e1f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.678814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43c9572c-6cfd-497e-a7f8-f00260430e1f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.680080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43c9572c-6cfd-497e-a7f8-f00260430e1f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.680741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43c9572c-6cfd-497e-a7f8-f00260430e1f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.829876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ef60b20-c6cb-4a34-a341-92ff43f0481e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:08.830818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2ef60b20-c6cb-4a34-a341-92ff43f0481e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:08.836918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-43c9572c-6cfd-497e-a7f8-f00260430e1f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:08.839866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef60b20-c6cb-4a34-a341-92ff43f0481e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.840872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef60b20-c6cb-4a34-a341-92ff43f0481e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.841681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef60b20-c6cb-4a34-a341-92ff43f0481e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:08.842331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef60b20-c6cb-4a34-a341-92ff43f0481e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:08.849538 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43c9572c-6cfd-497e-a7f8-f00260430e1f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1213 microversion: 2.1 time: 0.190197 Jul 20 04:10:08.853322 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 455/954] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:08 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:09.197876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e215b3c5-af7d-4eb6-81e4-f9c22d3a90a8 req-5fb176e4-c584-4d67-a6cc-a70958f7b5cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea8ba299-71a7-44ca-94d0-574109f98bc2", "tag": "dbd9f7bb-f31e-478b-8b04-2621b3d9428a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:09.222927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e215b3c5-af7d-4eb6-81e4-f9c22d3a90a8 req-5fb176e4-c584-4d67-a6cc-a70958f7b5cc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.224804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e215b3c5-af7d-4eb6-81e4-f9c22d3a90a8 req-5fb176e4-c584-4d67-a6cc-a70958f7b5cc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.263592 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e215b3c5-af7d-4eb6-81e4-f9c22d3a90a8 req-5fb176e4-c584-4d67-a6cc-a70958f7b5cc service nova] Creating event network-changed:dbd9f7bb-f31e-478b-8b04-2621b3d9428a for instance ea8ba299-71a7-44ca-94d0-574109f98bc2 on n-h2-760456-11 Jul 20 04:10:09.278706 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e215b3c5-af7d-4eb6-81e4-f9c22d3a90a8 req-5fb176e4-c584-4d67-a6cc-a70958f7b5cc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102032 Jul 20 04:10:09.283106 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 456/955] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:09.305451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-81fc58af-ec98-465e-8239-434c54c2d40a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:09.306457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-81fc58af-ec98-465e-8239-434c54c2d40a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 83b11eea-02b0-428a-9a50-5f6f38367827] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:09.324377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81fc58af-ec98-465e-8239-434c54c2d40a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.325328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81fc58af-ec98-465e-8239-434c54c2d40a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.327646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81fc58af-ec98-465e-8239-434c54c2d40a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.329383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81fc58af-ec98-465e-8239-434c54c2d40a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.364593 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-81fc58af-ec98-465e-8239-434c54c2d40a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] HTTP exception thrown: Instance 83b11eea-02b0-428a-9a50-5f6f38367827 could not be found. Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-81fc58af-ec98-465e-8239-434c54c2d40a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Request method failure captured: Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 HTTP/1.1 Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-orH6NSMyqer_TE9r6ZdcprWsiALOq5oY8yHyicHUa-Hl9nAoqALrd5PYcJcV1Q3Voq3_Xf4dW_2jvB4-uXrwrarO8CQJejs7t6fRNe-pBBmSa7az_rslrLTvt-zact6-37RC2iUUXEJGU8AY-bI9ftWDv2ug67PE0UomEJJ3ERzc Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 0ed9b3e9974a41c888990fe230a2bb7e Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersAdminTestJSON-1734864371 Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:10:09.367220 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersAdminTestJSON-1734864371 Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 0ed9b3e9974a41c888990fe230a2bb7e Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersAdminTestJSON-1734864371 Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersAdminTestJSON-1734864371-project Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 05147b0757b24f7c91b2a47af7ee1fce Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersAdminTestJSON-1734864371-project Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 83b11eea-02b0-428a-9a50-5f6f38367827 could not be found. Jul 20 04:10:09.368803 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '83b11eea-02b0-428a-9a50-5f6f38367827'} Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b11eea-02b0-428a-9a50-5f6f38367827 could not be found. Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:09.369718 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b11eea-02b0-428a-9a50-5f6f38367827 could not be found. Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b11eea-02b0-428a-9a50-5f6f38367827 could not be found. Jul 20 04:10:09.372471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:09.373742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-81fc58af-ec98-465e-8239-434c54c2d40a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Returning 404 to user: Instance 83b11eea-02b0-428a-9a50-5f6f38367827 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:09.373742 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-81fc58af-ec98-465e-8239-434c54c2d40a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827" status: 404 len: 111 microversion: 2.1 time: 0.077891 Jul 20 04:10:09.373742 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 457/956] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:09 2022] GET /compute/v2.1/servers/83b11eea-02b0-428a-9a50-5f6f38367827 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:09.389823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f50c9b51-303b-4925-8810-a57d690981da tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:09.390362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f50c9b51-303b-4925-8810-a57d690981da tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:09.406144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f50c9b51-303b-4925-8810-a57d690981da tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.406637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f50c9b51-303b-4925-8810-a57d690981da tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.411995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f50c9b51-303b-4925-8810-a57d690981da tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.416655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f50c9b51-303b-4925-8810-a57d690981da tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.474769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=14 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:09.479867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f50c9b51-303b-4925-8810-a57d690981da tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:10:09.661522 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f50c9b51-303b-4925-8810-a57d690981da tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 204 len: 0 microversion: 2.1 time: 0.287870 Jul 20 04:10:09.663677 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 458/957] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:09 2022] DELETE /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:10:09.671592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6a6f3d2a-4c37-49fd-a66c-67862b368545 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:09.674979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6a6f3d2a-4c37-49fd-a66c-67862b368545 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:09.688181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a6f3d2a-4c37-49fd-a66c-67862b368545 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.694438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a6f3d2a-4c37-49fd-a66c-67862b368545 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.695516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a6f3d2a-4c37-49fd-a66c-67862b368545 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.696123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a6f3d2a-4c37-49fd-a66c-67862b368545 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.849626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2ef60b20-c6cb-4a34-a341-92ff43f0481e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:09.862204 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ef60b20-c6cb-4a34-a341-92ff43f0481e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 1.039247 Jul 20 04:10:09.866872 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 500/958] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:08 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:09.889477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c3ab9ca5-f54b-4cc8-be9b-f2c18a52146d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:09.890809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c3ab9ca5-f54b-4cc8-be9b-f2c18a52146d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:09.903552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3ab9ca5-f54b-4cc8-be9b-f2c18a52146d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.904523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3ab9ca5-f54b-4cc8-be9b-f2c18a52146d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:09.905552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3ab9ca5-f54b-4cc8-be9b-f2c18a52146d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:09.906206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3ab9ca5-f54b-4cc8-be9b-f2c18a52146d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:10.069310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6a6f3d2a-4c37-49fd-a66c-67862b368545 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:10.082722 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6a6f3d2a-4c37-49fd-a66c-67862b368545 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1308 microversion: 2.1 time: 0.412632 Jul 20 04:10:10.084744 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 459/959] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:09 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:10.096343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c6d3a7ff-fe16-4e8b-8dbb-8bf5f113ef5f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:10.098546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c6d3a7ff-fe16-4e8b-8dbb-8bf5f113ef5f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:10.118020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6d3a7ff-fe16-4e8b-8dbb-8bf5f113ef5f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:10.118749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6d3a7ff-fe16-4e8b-8dbb-8bf5f113ef5f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:10.119871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6d3a7ff-fe16-4e8b-8dbb-8bf5f113ef5f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:10.120475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6d3a7ff-fe16-4e8b-8dbb-8bf5f113ef5f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:10.473838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c6d3a7ff-fe16-4e8b-8dbb-8bf5f113ef5f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:10.484735 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c6d3a7ff-fe16-4e8b-8dbb-8bf5f113ef5f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1475 microversion: 2.1 time: 0.397049 Jul 20 04:10:10.495354 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 460/960] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:10 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1475 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:10.501178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-93d3f582-0bbe-427f-b329-f1b89cb66f15 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:10.502225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-93d3f582-0bbe-427f-b329-f1b89cb66f15 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:10.510721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93d3f582-0bbe-427f-b329-f1b89cb66f15 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:10.511742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93d3f582-0bbe-427f-b329-f1b89cb66f15 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:10.512947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93d3f582-0bbe-427f-b329-f1b89cb66f15 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:10.513604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93d3f582-0bbe-427f-b329-f1b89cb66f15 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:10.616413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-93d3f582-0bbe-427f-b329-f1b89cb66f15 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:10.639357 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-93d3f582-0bbe-427f-b329-f1b89cb66f15 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1275 microversion: 2.1 time: 0.142173 Jul 20 04:10:10.641314 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 461/961] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:10 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:10.699055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c3ab9ca5-f54b-4cc8-be9b-f2c18a52146d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:10.714787 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c3ab9ca5-f54b-4cc8-be9b-f2c18a52146d tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1470 microversion: 2.1 time: 0.845216 Jul 20 04:10:10.715999 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 501/962] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:09 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1470 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:10.722455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-07fce84c-666e-47f3-a43b-52b327a0c1b6 req-47379704-5ea1-4f28-9523-e8de0410057c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd68e268-5eaa-42cd-a269-14daad8c8dd4", "name": "network-vif-unplugged", "status": "completed", "tag": "6442fb08-15c8-4951-a0ab-5f5aca7f5482"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:10.735383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-07fce84c-666e-47f3-a43b-52b327a0c1b6 req-47379704-5ea1-4f28-9523-e8de0410057c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:10.736096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-07fce84c-666e-47f3-a43b-52b327a0c1b6 req-47379704-5ea1-4f28-9523-e8de0410057c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:10.809898 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-07fce84c-666e-47f3-a43b-52b327a0c1b6 req-47379704-5ea1-4f28-9523-e8de0410057c service nova] Creating event network-vif-unplugged:6442fb08-15c8-4951-a0ab-5f5aca7f5482 for instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 on n-h2-760456-11 Jul 20 04:10:10.825827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-07fce84c-666e-47f3-a43b-52b327a0c1b6 req-47379704-5ea1-4f28-9523-e8de0410057c service nova] Instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:10:10.839872 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-07fce84c-666e-47f3-a43b-52b327a0c1b6 req-47379704-5ea1-4f28-9523-e8de0410057c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121253 Jul 20 04:10:10.840825 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 462/963] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:10.882676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bb07804b-4122-4f7a-a8ef-23c22f4d729a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:10.883550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bb07804b-4122-4f7a-a8ef-23c22f4d729a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:10.890627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb07804b-4122-4f7a-a8ef-23c22f4d729a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:10.891384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb07804b-4122-4f7a-a8ef-23c22f4d729a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:10.892413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb07804b-4122-4f7a-a8ef-23c22f4d729a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:10.893072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb07804b-4122-4f7a-a8ef-23c22f4d729a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:11.102454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ede826ce-9931-461f-99e9-6409f18f2a07 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:11.103516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ede826ce-9931-461f-99e9-6409f18f2a07 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:11.117557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ede826ce-9931-461f-99e9-6409f18f2a07 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:11.117934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ede826ce-9931-461f-99e9-6409f18f2a07 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:11.118754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ede826ce-9931-461f-99e9-6409f18f2a07 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:11.119202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ede826ce-9931-461f-99e9-6409f18f2a07 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:11.464337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ede826ce-9931-461f-99e9-6409f18f2a07 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:11.469531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bb07804b-4122-4f7a-a8ef-23c22f4d729a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:11.486056 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ede826ce-9931-461f-99e9-6409f18f2a07 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1308 microversion: 2.1 time: 0.388605 Jul 20 04:10:11.486871 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bb07804b-4122-4f7a-a8ef-23c22f4d729a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 0.606336 Jul 20 04:10:11.498205 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 502/964] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:10 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:11.503603 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 463/965] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:11 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:11.505065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da27e019-e9e2-48c2-a18f-fdc03aa59238 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:11.505906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-da27e019-e9e2-48c2-a18f-fdc03aa59238 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:11.514042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da27e019-e9e2-48c2-a18f-fdc03aa59238 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:11.514856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da27e019-e9e2-48c2-a18f-fdc03aa59238 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:11.515871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da27e019-e9e2-48c2-a18f-fdc03aa59238 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:11.516528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da27e019-e9e2-48c2-a18f-fdc03aa59238 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:11.666816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3bef904d-6213-4c0e-b7c4-87e3a67a4f0a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:11.667452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3bef904d-6213-4c0e-b7c4-87e3a67a4f0a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:11.675406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:11.688328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bef904d-6213-4c0e-b7c4-87e3a67a4f0a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:11.689064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bef904d-6213-4c0e-b7c4-87e3a67a4f0a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:11.692361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bef904d-6213-4c0e-b7c4-87e3a67a4f0a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:11.692833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bef904d-6213-4c0e-b7c4-87e3a67a4f0a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:12.104759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3bef904d-6213-4c0e-b7c4-87e3a67a4f0a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:12.119292 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3bef904d-6213-4c0e-b7c4-87e3a67a4f0a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1275 microversion: 2.1 time: 0.460695 Jul 20 04:10:12.121191 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 464/966] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:11 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1275 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:12.129603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7a404fd1-42f0-415f-b95d-6a5e0c61a291 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:12.130522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7a404fd1-42f0-415f-b95d-6a5e0c61a291 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:12.150522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a404fd1-42f0-415f-b95d-6a5e0c61a291 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:12.150984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a404fd1-42f0-415f-b95d-6a5e0c61a291 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:12.151845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a404fd1-42f0-415f-b95d-6a5e0c61a291 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:12.152233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a404fd1-42f0-415f-b95d-6a5e0c61a291 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:12.519893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-da27e019-e9e2-48c2-a18f-fdc03aa59238 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:12.532269 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-da27e019-e9e2-48c2-a18f-fdc03aa59238 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1475 microversion: 2.1 time: 1.032609 Jul 20 04:10:12.551432 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 503/967] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:11 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1475 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:12.571006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72b048c8-86a4-4122-87b9-9c434b25ee20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:12.571831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-72b048c8-86a4-4122-87b9-9c434b25ee20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:12.589687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:12.591950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72b048c8-86a4-4122-87b9-9c434b25ee20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:12.592735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72b048c8-86a4-4122-87b9-9c434b25ee20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:12.594532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72b048c8-86a4-4122-87b9-9c434b25ee20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:12.595347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72b048c8-86a4-4122-87b9-9c434b25ee20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:12.782472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7a404fd1-42f0-415f-b95d-6a5e0c61a291 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:12.796573 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7a404fd1-42f0-415f-b95d-6a5e0c61a291 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1470 microversion: 2.1 time: 0.674113 Jul 20 04:10:12.798141 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 465/968] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:12 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1470 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:12.805250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2c15f8c0-3872-4757-8a22-62969867e029 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:12.806416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2c15f8c0-3872-4757-8a22-62969867e029 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:12.829970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c15f8c0-3872-4757-8a22-62969867e029 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:12.830868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c15f8c0-3872-4757-8a22-62969867e029 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:12.832193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c15f8c0-3872-4757-8a22-62969867e029 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:12.833903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c15f8c0-3872-4757-8a22-62969867e029 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:13.035475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72b048c8-86a4-4122-87b9-9c434b25ee20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:13.054125 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72b048c8-86a4-4122-87b9-9c434b25ee20 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1502 microversion: 2.1 time: 0.500842 Jul 20 04:10:13.064838 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 504/969] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:12 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1502 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:13.141128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f0dee002-9b0f-409b-a13f-3b451065a562 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:13.148085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f0dee002-9b0f-409b-a13f-3b451065a562 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:13.157437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0dee002-9b0f-409b-a13f-3b451065a562 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:13.158170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0dee002-9b0f-409b-a13f-3b451065a562 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:13.159502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0dee002-9b0f-409b-a13f-3b451065a562 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:13.160136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0dee002-9b0f-409b-a13f-3b451065a562 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:13.297451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2c15f8c0-3872-4757-8a22-62969867e029 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:13.305060 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2c15f8c0-3872-4757-8a22-62969867e029 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1308 microversion: 2.1 time: 0.505560 Jul 20 04:10:13.314602 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 466/970] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:12 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:13.550804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a2be411-e816-49fb-b637-0b66a7c3c774 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:13.551482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2a2be411-e816-49fb-b637-0b66a7c3c774 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:13.562541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a2be411-e816-49fb-b637-0b66a7c3c774 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:13.563003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a2be411-e816-49fb-b637-0b66a7c3c774 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:13.563936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a2be411-e816-49fb-b637-0b66a7c3c774 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:13.564240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a2be411-e816-49fb-b637-0b66a7c3c774 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:13.789857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f0dee002-9b0f-409b-a13f-3b451065a562 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:13.798639 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f0dee002-9b0f-409b-a13f-3b451065a562 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.664910 Jul 20 04:10:13.808160 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 505/971] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:13 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:13.824003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31d5bf52-b651-4b3f-9c24-916d76918e8a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:13.824549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31d5bf52-b651-4b3f-9c24-916d76918e8a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:13.831597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d5bf52-b651-4b3f-9c24-916d76918e8a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:13.832052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d5bf52-b651-4b3f-9c24-916d76918e8a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:13.832836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d5bf52-b651-4b3f-9c24-916d76918e8a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:13.833344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d5bf52-b651-4b3f-9c24-916d76918e8a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:13.994974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31d5bf52-b651-4b3f-9c24-916d76918e8a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:14.015880 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31d5bf52-b651-4b3f-9c24-916d76918e8a tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1428 microversion: 2.1 time: 0.195642 Jul 20 04:10:14.029638 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 506/972] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:13 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1428 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:14.062116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2a2be411-e816-49fb-b637-0b66a7c3c774 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:14.074997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a8663ded-6a54-47a4-b81d-b045bdf5f82d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:14.075647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a8663ded-6a54-47a4-b81d-b045bdf5f82d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:14.076197 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a2be411-e816-49fb-b637-0b66a7c3c774 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1475 microversion: 2.1 time: 0.529156 Jul 20 04:10:14.089461 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 467/973] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:13 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1475 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:14.092989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8663ded-6a54-47a4-b81d-b045bdf5f82d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.093757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8663ded-6a54-47a4-b81d-b045bdf5f82d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.095981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8663ded-6a54-47a4-b81d-b045bdf5f82d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.096720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8663ded-6a54-47a4-b81d-b045bdf5f82d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.124516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b434da4b-84f3-476c-95cd-c14ef8b0349c req-5bc13fa8-b646-4ca3-89d4-3215dee6fe93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd5b910-66f3-4c35-a756-3ebed020fd24", "name": "network-vif-deleted", "tag": "2d98b0d3-c15e-4d7c-9b95-395b92468eb4"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:14.165183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b434da4b-84f3-476c-95cd-c14ef8b0349c req-5bc13fa8-b646-4ca3-89d4-3215dee6fe93 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.166796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b434da4b-84f3-476c-95cd-c14ef8b0349c req-5bc13fa8-b646-4ca3-89d4-3215dee6fe93 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.240781 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b434da4b-84f3-476c-95cd-c14ef8b0349c req-5bc13fa8-b646-4ca3-89d4-3215dee6fe93 service nova] Creating event network-vif-deleted:2d98b0d3-c15e-4d7c-9b95-395b92468eb4 for instance 5cd5b910-66f3-4c35-a756-3ebed020fd24 on n-h2-760456-11 Jul 20 04:10:14.271465 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b434da4b-84f3-476c-95cd-c14ef8b0349c req-5bc13fa8-b646-4ca3-89d4-3215dee6fe93 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155277 Jul 20 04:10:14.277823 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 468/974] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:10:14.315392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3161d47d-70a2-4e3d-b3d9-2f81cbfd368c req-d2a9383c-e8b2-4d24-bfe1-a3417392fbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8ba299-71a7-44ca-94d0-574109f98bc2", "name": "network-vif-plugged", "status": "completed", "tag": "dbd9f7bb-f31e-478b-8b04-2621b3d9428a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:14.335534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3161d47d-70a2-4e3d-b3d9-2f81cbfd368c req-d2a9383c-e8b2-4d24-bfe1-a3417392fbe1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.337468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3161d47d-70a2-4e3d-b3d9-2f81cbfd368c req-d2a9383c-e8b2-4d24-bfe1-a3417392fbe1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.352199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:14.388568 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3161d47d-70a2-4e3d-b3d9-2f81cbfd368c req-d2a9383c-e8b2-4d24-bfe1-a3417392fbe1 service nova] Creating event network-vif-plugged:dbd9f7bb-f31e-478b-8b04-2621b3d9428a for instance ea8ba299-71a7-44ca-94d0-574109f98bc2 on n-h2-760456-11 Jul 20 04:10:14.400609 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3161d47d-70a2-4e3d-b3d9-2f81cbfd368c req-d2a9383c-e8b2-4d24-bfe1-a3417392fbe1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116175 Jul 20 04:10:14.402202 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 469/975] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:14.410227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6f1b5f2-5109-4354-87f3-b3979c9779a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:14.411941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6f1b5f2-5109-4354-87f3-b3979c9779a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:14.420708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6f1b5f2-5109-4354-87f3-b3979c9779a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.421568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6f1b5f2-5109-4354-87f3-b3979c9779a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.422676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6f1b5f2-5109-4354-87f3-b3979c9779a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.423494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6f1b5f2-5109-4354-87f3-b3979c9779a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.765290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f6f1b5f2-5109-4354-87f3-b3979c9779a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:14.775710 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6f1b5f2-5109-4354-87f3-b3979c9779a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1308 microversion: 2.1 time: 0.371790 Jul 20 04:10:14.778610 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 470/976] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:14 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:14.825048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d5816bd5-4d85-4e47-b7ac-3c6be95bc830 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:14.825673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d5816bd5-4d85-4e47-b7ac-3c6be95bc830 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:14.851497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5816bd5-4d85-4e47-b7ac-3c6be95bc830 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.851950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5816bd5-4d85-4e47-b7ac-3c6be95bc830 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:14.855983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5816bd5-4d85-4e47-b7ac-3c6be95bc830 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:14.858740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5816bd5-4d85-4e47-b7ac-3c6be95bc830 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.141387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d5816bd5-4d85-4e47-b7ac-3c6be95bc830 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:15.154271 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d5816bd5-4d85-4e47-b7ac-3c6be95bc830 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.332642 Jul 20 04:10:15.165680 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 471/977] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:14 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:15.171110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:15.171955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:15.178630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.179356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.180733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.181343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.230347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.230723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.231187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lazy-loading 'fault' on Instance uuid 5cd5b910-66f3-4c35-a756-3ebed020fd24 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:15.317425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:15.334648 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4fafae94-e07a-45f1-b8e0-623529cc9246 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 200 len: 1304 microversion: 2.1 time: 0.166469 Jul 20 04:10:15.335821 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 472/978] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:15 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 1304 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:15.344283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-419e790e-c5c0-4ce6-8630-99ed4165b728 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:15.345187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-419e790e-c5c0-4ce6-8630-99ed4165b728 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:15.368497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-419e790e-c5c0-4ce6-8630-99ed4165b728 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.370292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-419e790e-c5c0-4ce6-8630-99ed4165b728 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.374502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-419e790e-c5c0-4ce6-8630-99ed4165b728 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.375213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-419e790e-c5c0-4ce6-8630-99ed4165b728 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.554962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-419e790e-c5c0-4ce6-8630-99ed4165b728 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:15.564248 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-419e790e-c5c0-4ce6-8630-99ed4165b728 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1475 microversion: 2.1 time: 0.226997 Jul 20 04:10:15.565186 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 473/979] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:15 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1475 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:15.594016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a8663ded-6a54-47a4-b81d-b045bdf5f82d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:15.605685 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a8663ded-6a54-47a4-b81d-b045bdf5f82d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1492 microversion: 2.1 time: 1.536987 Jul 20 04:10:15.618708 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 507/980] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:14 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1492 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:15.623109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d51eda7f-3b76-4ba5-9707-7d0f6a6cdb89 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '.version_select at 0x7fb842205790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:15.625706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d51eda7f-3b76-4ba5-9707-7d0f6a6cdb89 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.626413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d51eda7f-3b76-4ba5-9707-7d0f6a6cdb89 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.637562 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d51eda7f-3b76-4ba5-9707-7d0f6a6cdb89 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 1203 microversion: 2.1 time: 0.018048 Jul 20 04:10:15.638174 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 474/981] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:10:15 2022] GET /compute/v2.1/os-migrations => generated 1203 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:15.654825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8a19581f-3dbc-4450-babb-bde78c3e5ec2 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:15.656090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8a19581f-3dbc-4450-babb-bde78c3e5ec2 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:15.666420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a19581f-3dbc-4450-babb-bde78c3e5ec2 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.667110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a19581f-3dbc-4450-babb-bde78c3e5ec2 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.668702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a19581f-3dbc-4450-babb-bde78c3e5ec2 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.669421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a19581f-3dbc-4450-babb-bde78c3e5ec2 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.795435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c33bb338-ab86-4819-adc0-1bb9615a561f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:15.796043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c33bb338-ab86-4819-adc0-1bb9615a561f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:15.809296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c33bb338-ab86-4819-adc0-1bb9615a561f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.810176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c33bb338-ab86-4819-adc0-1bb9615a561f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:15.811492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c33bb338-ab86-4819-adc0-1bb9615a561f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:15.812101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c33bb338-ab86-4819-adc0-1bb9615a561f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.174446 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8a19581f-3dbc-4450-babb-bde78c3e5ec2 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1645 microversion: 2.1 time: 0.520407 Jul 20 04:10:16.179738 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 508/982] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:15 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1645 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:16.201328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b3d3207c-825d-4f58-ad40-5a999a080cd4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:16.202467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b3d3207c-825d-4f58-ad40-5a999a080cd4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:16.220226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3d3207c-825d-4f58-ad40-5a999a080cd4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.227003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3d3207c-825d-4f58-ad40-5a999a080cd4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.227857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3d3207c-825d-4f58-ad40-5a999a080cd4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.228314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3d3207c-825d-4f58-ad40-5a999a080cd4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.441623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c33bb338-ab86-4819-adc0-1bb9615a561f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:16.461412 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c33bb338-ab86-4819-adc0-1bb9615a561f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1308 microversion: 2.1 time: 0.672533 Jul 20 04:10:16.462693 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 475/983] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:15 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1308 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:16.473764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6684ecf5-c1b1-4398-8af1-211244d69762 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:16.475286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6684ecf5-c1b1-4398-8af1-211244d69762 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 5cd5b910-66f3-4c35-a756-3ebed020fd24] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:16.489797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6684ecf5-c1b1-4398-8af1-211244d69762 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.490611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6684ecf5-c1b1-4398-8af1-211244d69762 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.493875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6684ecf5-c1b1-4398-8af1-211244d69762 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.494661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6684ecf5-c1b1-4398-8af1-211244d69762 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.521426 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-6684ecf5-c1b1-4398-8af1-211244d69762 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] HTTP exception thrown: Instance 5cd5b910-66f3-4c35-a756-3ebed020fd24 could not be found. Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6684ecf5-c1b1-4398-8af1-211244d69762 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Request method failure captured: Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 HTTP/1.1 Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-orH6NSMyqer_TE9r6ZdcprWsiALOq5oY8yHyicHUa-Hl9nAoqALrd5PYcJcV1Q3Voq3_Xf4dW_2jvB4-uXrwrarO8CQJejs7t6fRNe-pBBmSa7az_rslrLTvt-zact6-37RC2iUUXEJGU8AY-bI9ftWDv2ug67PE0UomEJJ3ERzc Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 0ed9b3e9974a41c888990fe230a2bb7e Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersAdminTestJSON-1734864371 Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:10:16.536095 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersAdminTestJSON-1734864371 Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 0ed9b3e9974a41c888990fe230a2bb7e Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersAdminTestJSON-1734864371 Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersAdminTestJSON-1734864371-project Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 05147b0757b24f7c91b2a47af7ee1fce Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersAdminTestJSON-1734864371-project Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 5cd5b910-66f3-4c35-a756-3ebed020fd24 could not be found. Jul 20 04:10:16.538477 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '5cd5b910-66f3-4c35-a756-3ebed020fd24'} Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd5b910-66f3-4c35-a756-3ebed020fd24 could not be found. Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:16.539366 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd5b910-66f3-4c35-a756-3ebed020fd24 could not be found. Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd5b910-66f3-4c35-a756-3ebed020fd24 could not be found. Jul 20 04:10:16.541014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:16.542501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6684ecf5-c1b1-4398-8af1-211244d69762 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Returning 404 to user: Instance 5cd5b910-66f3-4c35-a756-3ebed020fd24 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:16.542501 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6684ecf5-c1b1-4398-8af1-211244d69762 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24" status: 404 len: 111 microversion: 2.1 time: 0.074056 Jul 20 04:10:16.542501 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 476/984] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:16 2022] GET /compute/v2.1/servers/5cd5b910-66f3-4c35-a756-3ebed020fd24 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:16.545323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-35836b18-75f1-4b33-80e5-0e6b83e56df1 req-d6f8fd75-a4bf-4f16-871d-b751cac1d5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd68e268-5eaa-42cd-a269-14daad8c8dd4", "tag": "6442fb08-15c8-4951-a0ab-5f5aca7f5482"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:16.559562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:16.570387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-35836b18-75f1-4b33-80e5-0e6b83e56df1 req-d6f8fd75-a4bf-4f16-871d-b751cac1d5a8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:16.570824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-35836b18-75f1-4b33-80e5-0e6b83e56df1 req-d6f8fd75-a4bf-4f16-871d-b751cac1d5a8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:16.615058 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-35836b18-75f1-4b33-80e5-0e6b83e56df1 req-d6f8fd75-a4bf-4f16-871d-b751cac1d5a8 service nova] Creating event network-changed:6442fb08-15c8-4951-a0ab-5f5aca7f5482 for instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 on n-h2-760456-11 Jul 20 04:10:16.623027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-35836b18-75f1-4b33-80e5-0e6b83e56df1 req-d6f8fd75-a4bf-4f16-871d-b751cac1d5a8 service nova] Instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:10:16.656334 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-35836b18-75f1-4b33-80e5-0e6b83e56df1 req-d6f8fd75-a4bf-4f16-871d-b751cac1d5a8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114872 Jul 20 04:10:16.657508 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 477/985] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:16.664567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-216249268", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "aca274f9-d664-47a2-aeef-a3985bda5141"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:16.739791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] validate_networks() for [('aca274f9-d664-47a2-aeef-a3985bda5141', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:17.206284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b3d3207c-825d-4f58-ad40-5a999a080cd4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:17.218937 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b3d3207c-825d-4f58-ad40-5a999a080cd4 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 1.037529 Jul 20 04:10:17.221675 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 509/986] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:16 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:17.228369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-18b9441c-16d3-48fa-8ba6-b3b8e2f647fc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:17.229218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-18b9441c-16d3-48fa-8ba6-b3b8e2f647fc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:17.246484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18b9441c-16d3-48fa-8ba6-b3b8e2f647fc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.247959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18b9441c-16d3-48fa-8ba6-b3b8e2f647fc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.249013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18b9441c-16d3-48fa-8ba6-b3b8e2f647fc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.249699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18b9441c-16d3-48fa-8ba6-b3b8e2f647fc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.309921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-18b9441c-16d3-48fa-8ba6-b3b8e2f647fc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:10:17.374574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:17.437527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=14 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:17.482656 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-18b9441c-16d3-48fa-8ba6-b3b8e2f647fc tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "DELETE /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 204 len: 0 microversion: 2.1 time: 0.259273 Jul 20 04:10:17.486523 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 510/987] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:10:17 2022] DELETE /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:10:17.504196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce10492d-1ddd-409a-b187-4b27a05a37c1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:17.505090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce10492d-1ddd-409a-b187-4b27a05a37c1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:17.514889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce10492d-1ddd-409a-b187-4b27a05a37c1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.515456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce10492d-1ddd-409a-b187-4b27a05a37c1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:17.516278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce10492d-1ddd-409a-b187-4b27a05a37c1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:17.516707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce10492d-1ddd-409a-b187-4b27a05a37c1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.200811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:18.201289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:18.201690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:18.202099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:18.202553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:18.226467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.226908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.227975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.228657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.274109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Getting quotas for project 1ec8a3f7a123436c825135d50dd93865. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:18.282747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Getting quotas for user 04547e35c8c541af914c30e9083cda85 and project 1ec8a3f7a123436c825135d50dd93865. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:18.323409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:18.326985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:18.327382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce10492d-1ddd-409a-b187-4b27a05a37c1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:18.339145 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce10492d-1ddd-409a-b187-4b27a05a37c1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1473 microversion: 2.1 time: 0.851086 Jul 20 04:10:18.348575 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 511/988] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:17 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1473 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:18.355439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e5cd9c53-3ebb-4c13-b6fb-e20fe5df0bc1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:18.357013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e5cd9c53-3ebb-4c13-b6fb-e20fe5df0bc1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:18.370930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5cd9c53-3ebb-4c13-b6fb-e20fe5df0bc1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.371714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5cd9c53-3ebb-4c13-b6fb-e20fe5df0bc1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.374956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5cd9c53-3ebb-4c13-b6fb-e20fe5df0bc1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.375596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5cd9c53-3ebb-4c13-b6fb-e20fe5df0bc1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.414833 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-06ec90cf-9475-464e-ad76-744d3c5adbad tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755872 Jul 20 04:10:18.421083 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 478/989] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:18.427420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-098bb195-5598-453f-a632-d8e99d5db788 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:18.428955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-098bb195-5598-453f-a632-d8e99d5db788 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:18.435970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-098bb195-5598-453f-a632-d8e99d5db788 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.436748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-098bb195-5598-453f-a632-d8e99d5db788 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.437763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-098bb195-5598-453f-a632-d8e99d5db788 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.438445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-098bb195-5598-453f-a632-d8e99d5db788 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.801886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-098bb195-5598-453f-a632-d8e99d5db788 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:18.823027 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-098bb195-5598-453f-a632-d8e99d5db788 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1469 microversion: 2.1 time: 0.400403 Jul 20 04:10:18.826621 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 479/990] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:18 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1469 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:18.833178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-8e24a729-98d7-4d65-8af6-ae2801d435bd req-ad1b32b5-0ed0-4d4c-90be-fbd8066da789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab536ec-6bd0-4380-b23c-56154cfafbad", "tag": "873e2fdf-83fa-49db-a423-2fcca74c2a46"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:18.871336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8e24a729-98d7-4d65-8af6-ae2801d435bd req-ad1b32b5-0ed0-4d4c-90be-fbd8066da789 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.872936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8e24a729-98d7-4d65-8af6-ae2801d435bd req-ad1b32b5-0ed0-4d4c-90be-fbd8066da789 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.904856 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8e24a729-98d7-4d65-8af6-ae2801d435bd req-ad1b32b5-0ed0-4d4c-90be-fbd8066da789 service nova] Creating event network-changed:873e2fdf-83fa-49db-a423-2fcca74c2a46 for instance 1ab536ec-6bd0-4380-b23c-56154cfafbad on n-h1-760456-11 Jul 20 04:10:18.916498 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-8e24a729-98d7-4d65-8af6-ae2801d435bd req-ad1b32b5-0ed0-4d4c-90be-fbd8066da789 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086809 Jul 20 04:10:18.925679 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 480/991] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:18.932892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-166e7717-572e-45e6-b474-5168c4e062e6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:18.943778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-166e7717-572e-45e6-b474-5168c4e062e6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:18.960999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-166e7717-572e-45e6-b474-5168c4e062e6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.961457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-166e7717-572e-45e6-b474-5168c4e062e6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:18.962478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-166e7717-572e-45e6-b474-5168c4e062e6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:18.963079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-166e7717-572e-45e6-b474-5168c4e062e6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.617531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-166e7717-572e-45e6-b474-5168c4e062e6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:19.633470 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-166e7717-572e-45e6-b474-5168c4e062e6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.706099 Jul 20 04:10:19.647070 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 481/992] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:18 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:19.657301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d1c18bf-f757-441c-89f6-ae341141e732 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:19.658541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9d1c18bf-f757-441c-89f6-ae341141e732 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:19.671840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d1c18bf-f757-441c-89f6-ae341141e732 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.672523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d1c18bf-f757-441c-89f6-ae341141e732 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.673562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d1c18bf-f757-441c-89f6-ae341141e732 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.674220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d1c18bf-f757-441c-89f6-ae341141e732 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.784942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9d1c18bf-f757-441c-89f6-ae341141e732 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:19.796215 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9d1c18bf-f757-441c-89f6-ae341141e732 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1206 microversion: 2.1 time: 0.147526 Jul 20 04:10:19.810725 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 482/993] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:19 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1206 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:19.827184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2eb304ba-d868-45c3-9b77-72fdf0f8842c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:19.828022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2eb304ba-d868-45c3-9b77-72fdf0f8842c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:19.836050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2eb304ba-d868-45c3-9b77-72fdf0f8842c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.836742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2eb304ba-d868-45c3-9b77-72fdf0f8842c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.837744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2eb304ba-d868-45c3-9b77-72fdf0f8842c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.838439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2eb304ba-d868-45c3-9b77-72fdf0f8842c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.842608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e5cd9c53-3ebb-4c13-b6fb-e20fe5df0bc1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:19.857136 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e5cd9c53-3ebb-4c13-b6fb-e20fe5df0bc1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1488 microversion: 2.1 time: 1.507134 Jul 20 04:10:19.858876 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 512/994] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:18 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1488 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:19.867105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e8c1a4f-2fcc-4b1d-b95f-87551ea081e7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:19.873152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e8c1a4f-2fcc-4b1d-b95f-87551ea081e7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:19.890622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e8c1a4f-2fcc-4b1d-b95f-87551ea081e7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.893625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e8c1a4f-2fcc-4b1d-b95f-87551ea081e7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:19.898705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e8c1a4f-2fcc-4b1d-b95f-87551ea081e7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:19.899335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e8c1a4f-2fcc-4b1d-b95f-87551ea081e7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.171211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2eb304ba-d868-45c3-9b77-72fdf0f8842c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:20.183254 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2eb304ba-d868-45c3-9b77-72fdf0f8842c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1470 microversion: 2.1 time: 0.369904 Jul 20 04:10:20.197625 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 483/995] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:19 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1470 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:20.203865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b91feb71-b08e-440f-b289-cbc8a0931617 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.204622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b91feb71-b08e-440f-b289-cbc8a0931617 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:20.213318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b91feb71-b08e-440f-b289-cbc8a0931617 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.217468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b91feb71-b08e-440f-b289-cbc8a0931617 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.221884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b91feb71-b08e-440f-b289-cbc8a0931617 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.223123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b91feb71-b08e-440f-b289-cbc8a0931617 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.342473 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b91feb71-b08e-440f-b289-cbc8a0931617 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2/action" status: 202 len: 0 microversion: 2.1 time: 0.141896 Jul 20 04:10:20.347193 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 484/996] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:20.358745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7687cafb-6044-4c28-9648-58f5172f33a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:20.359483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7687cafb-6044-4c28-9648-58f5172f33a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:20.370243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7687cafb-6044-4c28-9648-58f5172f33a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.371539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7687cafb-6044-4c28-9648-58f5172f33a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.373931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7687cafb-6044-4c28-9648-58f5172f33a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.374680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7687cafb-6044-4c28-9648-58f5172f33a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.541317 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7687cafb-6044-4c28-9648-58f5172f33a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4/action" status: 204 len: 0 microversion: 2.1 time: 0.191468 Jul 20 04:10:20.542519 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 485/997] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:20 2022] POST /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4/action => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:10:20.549276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-08cf6fbc-60c8-49b1-a7a0-49fd33de95c0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.550129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-08cf6fbc-60c8-49b1-a7a0-49fd33de95c0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:20.571574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08cf6fbc-60c8-49b1-a7a0-49fd33de95c0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.575208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08cf6fbc-60c8-49b1-a7a0-49fd33de95c0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.576055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08cf6fbc-60c8-49b1-a7a0-49fd33de95c0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.576498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08cf6fbc-60c8-49b1-a7a0-49fd33de95c0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.682553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e8c1a4f-2fcc-4b1d-b95f-87551ea081e7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:20.714783 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e8c1a4f-2fcc-4b1d-b95f-87551ea081e7 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1469 microversion: 2.1 time: 0.851075 Jul 20 04:10:20.715855 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 513/998] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:19 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1469 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:20.728820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca448fbf-3716-4ca3-9d6d-7b17262e1865 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.732101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ca448fbf-3716-4ca3-9d6d-7b17262e1865 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:20.745725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca448fbf-3716-4ca3-9d6d-7b17262e1865 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.746476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca448fbf-3716-4ca3-9d6d-7b17262e1865 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.747523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca448fbf-3716-4ca3-9d6d-7b17262e1865 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.748300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca448fbf-3716-4ca3-9d6d-7b17262e1865 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.955528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-08cf6fbc-60c8-49b1-a7a0-49fd33de95c0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:20.967748 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-08cf6fbc-60c8-49b1-a7a0-49fd33de95c0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1493 microversion: 2.1 time: 0.423043 Jul 20 04:10:20.981258 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 486/999] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:20 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1493 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:20.988688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-db5497fb-5340-4c60-826b-3706bb7f4088 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:20.989221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-db5497fb-5340-4c60-826b-3706bb7f4088 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:20.995625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db5497fb-5340-4c60-826b-3706bb7f4088 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.996078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db5497fb-5340-4c60-826b-3706bb7f4088 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:20.996848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db5497fb-5340-4c60-826b-3706bb7f4088 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:20.997282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db5497fb-5340-4c60-826b-3706bb7f4088 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.001332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:21.267620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-db5497fb-5340-4c60-826b-3706bb7f4088 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:21.276533 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-db5497fb-5340-4c60-826b-3706bb7f4088 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.294185 Jul 20 04:10:21.286454 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 487/1000] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:20 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:21.291590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d2aeb38-62c7-405d-bb66-35ddbcf1bdb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:21.292215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9d2aeb38-62c7-405d-bb66-35ddbcf1bdb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:21.298612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d2aeb38-62c7-405d-bb66-35ddbcf1bdb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.299072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d2aeb38-62c7-405d-bb66-35ddbcf1bdb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.299917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d2aeb38-62c7-405d-bb66-35ddbcf1bdb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.300362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d2aeb38-62c7-405d-bb66-35ddbcf1bdb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.371479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9d2aeb38-62c7-405d-bb66-35ddbcf1bdb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:21.380262 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9d2aeb38-62c7-405d-bb66-35ddbcf1bdb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1268 microversion: 2.1 time: 0.092513 Jul 20 04:10:21.391491 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 488/1001] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:21 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1268 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:21.397392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-cec5ca74-492a-4529-98d5-c0143d85c1a2 req-839f5436-e7a1-454f-a071-bcede2780114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288f952b-81ce-419b-9907-96b8b0db1d30", "name": "network-vif-deleted", "tag": "c9911200-3c1e-4fb4-81b5-e7aed1a55549"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:21.406536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cec5ca74-492a-4529-98d5-c0143d85c1a2 req-839f5436-e7a1-454f-a071-bcede2780114 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.406991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cec5ca74-492a-4529-98d5-c0143d85c1a2 req-839f5436-e7a1-454f-a071-bcede2780114 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.420779 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-cec5ca74-492a-4529-98d5-c0143d85c1a2 req-839f5436-e7a1-454f-a071-bcede2780114 service nova] Creating event network-vif-deleted:c9911200-3c1e-4fb4-81b5-e7aed1a55549 for instance 288f952b-81ce-419b-9907-96b8b0db1d30 on n-h1-760456-11 Jul 20 04:10:21.426230 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-cec5ca74-492a-4529-98d5-c0143d85c1a2 req-839f5436-e7a1-454f-a071-bcede2780114 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033245 Jul 20 04:10:21.427189 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 489/1002] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:21.562202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ca448fbf-3716-4ca3-9d6d-7b17262e1865 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:21.580923 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ca448fbf-3716-4ca3-9d6d-7b17262e1865 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1470 microversion: 2.1 time: 0.863456 Jul 20 04:10:21.598228 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 514/1003] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:20 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1470 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:21.733947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df027e62-fa26-43a3-ab35-3748fefd2070 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:21.734715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-df027e62-fa26-43a3-ab35-3748fefd2070 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:21.741822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-47de3949-418b-4462-9753-19f5168b34c3 req-65978f47-b963-4570-a9f4-208b37913c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd68e268-5eaa-42cd-a269-14daad8c8dd4", "name": "network-vif-plugged", "status": "completed", "tag": "6442fb08-15c8-4951-a0ab-5f5aca7f5482"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:21.748302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df027e62-fa26-43a3-ab35-3748fefd2070 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.748765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df027e62-fa26-43a3-ab35-3748fefd2070 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.750618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df027e62-fa26-43a3-ab35-3748fefd2070 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.754027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df027e62-fa26-43a3-ab35-3748fefd2070 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.759557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-47de3949-418b-4462-9753-19f5168b34c3 req-65978f47-b963-4570-a9f4-208b37913c8e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:21.759894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-47de3949-418b-4462-9753-19f5168b34c3 req-65978f47-b963-4570-a9f4-208b37913c8e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:21.791430 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-47de3949-418b-4462-9753-19f5168b34c3 req-65978f47-b963-4570-a9f4-208b37913c8e service nova] Creating event network-vif-plugged:6442fb08-15c8-4951-a0ab-5f5aca7f5482 for instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 on n-h2-760456-11 Jul 20 04:10:21.808180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-47de3949-418b-4462-9753-19f5168b34c3 req-65978f47-b963-4570-a9f4-208b37913c8e service nova] Instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:10:21.842407 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-47de3949-418b-4462-9753-19f5168b34c3 req-65978f47-b963-4570-a9f4-208b37913c8e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104480 Jul 20 04:10:21.843655 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 515/1004] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:10:21.938439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df027e62-fa26-43a3-ab35-3748fefd2070 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147b0757b24f7c91b2a47af7ee1fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed9b3e9974a41c888990fe230a2bb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:21.966824 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-df027e62-fa26-43a3-ab35-3748fefd2070 tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 200 len: 1427 microversion: 2.1 time: 0.233442 Jul 20 04:10:21.980420 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 490/1005] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:21 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 1427 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:21.996236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8bf5381f-cf58-4c48-aa70-5928d042283d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:21.999295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8bf5381f-cf58-4c48-aa70-5928d042283d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:22.016990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bf5381f-cf58-4c48-aa70-5928d042283d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.018414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bf5381f-cf58-4c48-aa70-5928d042283d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.020956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bf5381f-cf58-4c48-aa70-5928d042283d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.022511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bf5381f-cf58-4c48-aa70-5928d042283d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.295015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7726d8c0-471d-48d7-bfaf-f7818ecb5d61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:22.295953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7726d8c0-471d-48d7-bfaf-f7818ecb5d61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:22.312115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7726d8c0-471d-48d7-bfaf-f7818ecb5d61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.312936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7726d8c0-471d-48d7-bfaf-f7818ecb5d61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.314115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7726d8c0-471d-48d7-bfaf-f7818ecb5d61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.314789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7726d8c0-471d-48d7-bfaf-f7818ecb5d61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.384790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8bf5381f-cf58-4c48-aa70-5928d042283d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:22.397246 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8bf5381f-cf58-4c48-aa70-5928d042283d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 200 len: 1473 microversion: 2.1 time: 0.407375 Jul 20 04:10:22.398927 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 516/1006] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:21 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 1473 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:22.405477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-67e66b41-7737-49ab-8605-4dbdb03795f2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:22.406412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-67e66b41-7737-49ab-8605-4dbdb03795f2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:22.416662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67e66b41-7737-49ab-8605-4dbdb03795f2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.417360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67e66b41-7737-49ab-8605-4dbdb03795f2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.419405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67e66b41-7737-49ab-8605-4dbdb03795f2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.420039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67e66b41-7737-49ab-8605-4dbdb03795f2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.798391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-67e66b41-7737-49ab-8605-4dbdb03795f2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:22.810644 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-67e66b41-7737-49ab-8605-4dbdb03795f2 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 0.408813 Jul 20 04:10:22.812999 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 517/1007] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:22 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:22.819205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e53de4ce-99c4-410d-8847-09f94907155c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-462626798"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:22.826069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e53de4ce-99c4-410d-8847-09f94907155c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:22.842222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e53de4ce-99c4-410d-8847-09f94907155c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.843948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e53de4ce-99c4-410d-8847-09f94907155c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:22.844938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e53de4ce-99c4-410d-8847-09f94907155c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:22.846769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e53de4ce-99c4-410d-8847-09f94907155c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.023323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7726d8c0-471d-48d7-bfaf-f7818ecb5d61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:23.030392 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7726d8c0-471d-48d7-bfaf-f7818ecb5d61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.740297 Jul 20 04:10:23.043600 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 491/1008] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:22 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:23.060052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e4c1772-99ff-4eb4-9c2c-3bc4a2959393 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:23.060759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6e4c1772-99ff-4eb4-9c2c-3bc4a2959393 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:23.068884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e4c1772-99ff-4eb4-9c2c-3bc4a2959393 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:23.069345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e4c1772-99ff-4eb4-9c2c-3bc4a2959393 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.070146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e4c1772-99ff-4eb4-9c2c-3bc4a2959393 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:23.070620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e4c1772-99ff-4eb4-9c2c-3bc4a2959393 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.379728 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e53de4ce-99c4-410d-8847-09f94907155c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2/action" status: 202 len: 0 microversion: 2.1 time: 0.563713 Jul 20 04:10:23.381365 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 518/1009] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:22 2022] POST /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:10:23.390063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e58cc600-f1ac-4d3a-9104-db8b21f9015e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:23.391024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e58cc600-f1ac-4d3a-9104-db8b21f9015e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] [instance: 288f952b-81ce-419b-9907-96b8b0db1d30] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:23.399496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e58cc600-f1ac-4d3a-9104-db8b21f9015e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:23.400589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e58cc600-f1ac-4d3a-9104-db8b21f9015e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.401535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e58cc600-f1ac-4d3a-9104-db8b21f9015e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:23.402456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e58cc600-f1ac-4d3a-9104-db8b21f9015e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.423365 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e58cc600-f1ac-4d3a-9104-db8b21f9015e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] HTTP exception thrown: Instance 288f952b-81ce-419b-9907-96b8b0db1d30 could not be found. Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e58cc600-f1ac-4d3a-9104-db8b21f9015e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Request method failure captured: Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 HTTP/1.1 Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-orH6NSMyqer_TE9r6ZdcprWsiALOq5oY8yHyicHUa-Hl9nAoqALrd5PYcJcV1Q3Voq3_Xf4dW_2jvB4-uXrwrarO8CQJejs7t6fRNe-pBBmSa7az_rslrLTvt-zact6-37RC2iUUXEJGU8AY-bI9ftWDv2ug67PE0UomEJJ3ERzc Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 0ed9b3e9974a41c888990fe230a2bb7e Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersAdminTestJSON-1734864371 Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:10:23.425869 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ed9b3e9974a41c888990fe230a2bb7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersAdminTestJSON-1734864371 Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 0ed9b3e9974a41c888990fe230a2bb7e Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersAdminTestJSON-1734864371 Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersAdminTestJSON-1734864371-project Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 05147b0757b24f7c91b2a47af7ee1fce Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersAdminTestJSON-1734864371-project Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 288f952b-81ce-419b-9907-96b8b0db1d30 could not be found. Jul 20 04:10:23.427249 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '288f952b-81ce-419b-9907-96b8b0db1d30'} Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 288f952b-81ce-419b-9907-96b8b0db1d30 could not be found. Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:23.428281 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 288f952b-81ce-419b-9907-96b8b0db1d30 could not be found. Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 288f952b-81ce-419b-9907-96b8b0db1d30 could not be found. Jul 20 04:10:23.429506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:23.432776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e58cc600-f1ac-4d3a-9104-db8b21f9015e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] Returning 404 to user: Instance 288f952b-81ce-419b-9907-96b8b0db1d30 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:23.434154 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e58cc600-f1ac-4d3a-9104-db8b21f9015e tempest-ServersAdminTestJSON-1734864371 tempest-ServersAdminTestJSON-1734864371-project] 10.222.0.59 "GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30" status: 404 len: 111 microversion: 2.1 time: 0.051116 Jul 20 04:10:23.435377 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 519/1010] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:23 2022] GET /compute/v2.1/servers/288f952b-81ce-419b-9907-96b8b0db1d30 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:23.442578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-718850ed-3238-4da8-af72-4a56ce4caebf tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8421e7e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:23.483777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6e4c1772-99ff-4eb4-9c2c-3bc4a2959393 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:23.493718 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6e4c1772-99ff-4eb4-9c2c-3bc4a2959393 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1470 microversion: 2.1 time: 0.447566 Jul 20 04:10:23.496347 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 492/1011] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:23 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:23.517098 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-718850ed-3238-4da8-af72-4a56ce4caebf tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.080276 Jul 20 04:10:23.519806 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 520/1012] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:23 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:23.828774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07bc6846-e440-415a-97c2-da384ed533c4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:23.829700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-07bc6846-e440-415a-97c2-da384ed533c4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:23.860574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07bc6846-e440-415a-97c2-da384ed533c4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:23.861041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07bc6846-e440-415a-97c2-da384ed533c4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:23.861845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07bc6846-e440-415a-97c2-da384ed533c4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:23.862314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07bc6846-e440-415a-97c2-da384ed533c4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.053844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dcc6f00a-5ae6-49e7-b73d-cd208dddf6d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:24.054766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dcc6f00a-5ae6-49e7-b73d-cd208dddf6d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:24.068725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcc6f00a-5ae6-49e7-b73d-cd208dddf6d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.070902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcc6f00a-5ae6-49e7-b73d-cd208dddf6d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.071759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcc6f00a-5ae6-49e7-b73d-cd208dddf6d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.072210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcc6f00a-5ae6-49e7-b73d-cd208dddf6d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.569106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dcc6f00a-5ae6-49e7-b73d-cd208dddf6d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:24.579316 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dcc6f00a-5ae6-49e7-b73d-cd208dddf6d3 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.531016 Jul 20 04:10:24.582405 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 521/1013] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:24 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:24.589402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d995bfb2-b193-4b21-b09e-168800100f6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:24.595579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d995bfb2-b193-4b21-b09e-168800100f6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:24.607889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d995bfb2-b193-4b21-b09e-168800100f6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.608634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d995bfb2-b193-4b21-b09e-168800100f6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.609944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d995bfb2-b193-4b21-b09e-168800100f6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.610626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d995bfb2-b193-4b21-b09e-168800100f6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.863756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d995bfb2-b193-4b21-b09e-168800100f6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:24.878478 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d995bfb2-b193-4b21-b09e-168800100f6c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1462 microversion: 2.1 time: 0.293170 Jul 20 04:10:24.879835 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 522/1014] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:24 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1462 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:24.885775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-07bc6846-e440-415a-97c2-da384ed533c4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:24.894278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4d1bd2b4-e792-4e0a-b2c2-7f718f3b6259 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8421e5940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:24.896165 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-07bc6846-e440-415a-97c2-da384ed533c4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 1.072671 Jul 20 04:10:24.902578 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 493/1015] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:23 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:24.913374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e48c1b1f-b0aa-4f52-9eb1-d06fdea0884d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:24.913940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e48c1b1f-b0aa-4f52-9eb1-d06fdea0884d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:24.935011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e48c1b1f-b0aa-4f52-9eb1-d06fdea0884d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.935838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e48c1b1f-b0aa-4f52-9eb1-d06fdea0884d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.936986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e48c1b1f-b0aa-4f52-9eb1-d06fdea0884d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:24.939249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e48c1b1f-b0aa-4f52-9eb1-d06fdea0884d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:24.969663 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4d1bd2b4-e792-4e0a-b2c2-7f718f3b6259 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.088541 Jul 20 04:10:24.979668 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 523/1016] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:24 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:25.503742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f2896be0-5c49-48cc-9ba9-2a861c276051 req-541afa6c-a894-43a5-8f1b-676ca1b480bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23765b5-80ca-4a5d-bd2e-480d92222c04", "tag": "40f5fbe1-7bda-48e3-886f-5b7124d37017"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:25.539821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f2896be0-5c49-48cc-9ba9-2a861c276051 req-541afa6c-a894-43a5-8f1b-676ca1b480bc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.540279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f2896be0-5c49-48cc-9ba9-2a861c276051 req-541afa6c-a894-43a5-8f1b-676ca1b480bc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.567120 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f2896be0-5c49-48cc-9ba9-2a861c276051 req-541afa6c-a894-43a5-8f1b-676ca1b480bc service nova] Creating event network-changed:40f5fbe1-7bda-48e3-886f-5b7124d37017 for instance a23765b5-80ca-4a5d-bd2e-480d92222c04 on n-h2-760456-11 Jul 20 04:10:25.587878 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f2896be0-5c49-48cc-9ba9-2a861c276051 req-541afa6c-a894-43a5-8f1b-676ca1b480bc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081952 Jul 20 04:10:25.590589 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 524/1017] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:25.591398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e48c1b1f-b0aa-4f52-9eb1-d06fdea0884d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:25.603608 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e48c1b1f-b0aa-4f52-9eb1-d06fdea0884d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1462 microversion: 2.1 time: 0.699740 Jul 20 04:10:25.604579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26db7f76-b1da-4646-86e0-553aece467f5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:25.605448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26db7f76-b1da-4646-86e0-553aece467f5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:25.609440 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 494/1018] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:24 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1462 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:25.621862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26db7f76-b1da-4646-86e0-553aece467f5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.622990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26db7f76-b1da-4646-86e0-553aece467f5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.629925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26db7f76-b1da-4646-86e0-553aece467f5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.637813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-786117f2-7558-4989-8d20-bbbd1c85085a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'create', calling method: .version_select at 0x7fb84226e1f0>, body: {"keypair": {"name": "tempest-keypair-73540090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgiNq3rSH7qrbr+DJRInB8EtHjGmcmVqnMRmrVHD61otNXoJD6vtNoFlG6oeQ9e1ouRC0YySVsjMPcFzQXymK7Co/3cmKQ9JvgSkFzOlpo4wdthsCAb/G4Uv+nasG3axQ=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:25.640382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26db7f76-b1da-4646-86e0-553aece467f5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.715710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-786117f2-7558-4989-8d20-bbbd1c85085a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:25.735150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-786117f2-7558-4989-8d20-bbbd1c85085a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for user e82ac4df5f844ec4996d939efdba9c11 and project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:25.796547 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-786117f2-7558-4989-8d20-bbbd1c85085a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.167543 Jul 20 04:10:25.802414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 495/1019] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:10:25 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:10:25.916242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bc2fe642-33de-4350-84bd-1df7d2f729d6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:25.917768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bc2fe642-33de-4350-84bd-1df7d2f729d6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:25.931710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc2fe642-33de-4350-84bd-1df7d2f729d6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.933455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc2fe642-33de-4350-84bd-1df7d2f729d6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.935108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc2fe642-33de-4350-84bd-1df7d2f729d6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:25.936813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc2fe642-33de-4350-84bd-1df7d2f729d6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:25.997708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-26db7f76-b1da-4646-86e0-553aece467f5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:26.019765 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26db7f76-b1da-4646-86e0-553aece467f5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.424469 Jul 20 04:10:26.026532 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 525/1020] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:25 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:26.032193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0404f96b-cdfa-445e-8c65-fb6c3ee7d241 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8421f1c10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:26.123798 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0404f96b-cdfa-445e-8c65-fb6c3ee7d241 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.095706 Jul 20 04:10:26.124541 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 526/1021] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:26 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:27.012593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc2fe642-33de-4350-84bd-1df7d2f729d6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:27.023646 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bc2fe642-33de-4350-84bd-1df7d2f729d6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 1.112463 Jul 20 04:10:27.024251 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 496/1022] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:25 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:27.043606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e8e9008-3e39-4c87-abc1-78acf99ac22f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:27.044337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e8e9008-3e39-4c87-abc1-78acf99ac22f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:27.053346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e8e9008-3e39-4c87-abc1-78acf99ac22f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.053846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e8e9008-3e39-4c87-abc1-78acf99ac22f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.054671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e8e9008-3e39-4c87-abc1-78acf99ac22f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:27.055112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e8e9008-3e39-4c87-abc1-78acf99ac22f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:27.138775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b0c763a2-2168-4a64-948a-fe594b7b408c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842205f70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:27.206024 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b0c763a2-2168-4a64-948a-fe594b7b408c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.070871 Jul 20 04:10:27.206648 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 497/1023] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:27 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:27.516169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e8e9008-3e39-4c87-abc1-78acf99ac22f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:27.547900 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e8e9008-3e39-4c87-abc1-78acf99ac22f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.508593 Jul 20 04:10:27.548502 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 527/1024] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:27 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:28.048639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-215fc86f-28a7-43a6-bf7e-77882547b7f6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:28.051796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-215fc86f-28a7-43a6-bf7e-77882547b7f6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:28.065773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-215fc86f-28a7-43a6-bf7e-77882547b7f6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.066654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-215fc86f-28a7-43a6-bf7e-77882547b7f6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.067695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-215fc86f-28a7-43a6-bf7e-77882547b7f6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.070889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-215fc86f-28a7-43a6-bf7e-77882547b7f6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.219626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e6036ca-072f-4268-bd72-7d24088db9dc tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842d55790>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:28.248744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:28.343244 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3e6036ca-072f-4268-bd72-7d24088db9dc tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.127208 Jul 20 04:10:28.345386 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 528/1025] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:28 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:28.565183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-63265e67-3a2f-406c-93f7-4eae34c782b2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:28.567354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63265e67-3a2f-406c-93f7-4eae34c782b2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:28.586968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63265e67-3a2f-406c-93f7-4eae34c782b2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.587827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63265e67-3a2f-406c-93f7-4eae34c782b2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.589024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63265e67-3a2f-406c-93f7-4eae34c782b2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:28.598998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63265e67-3a2f-406c-93f7-4eae34c782b2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:28.991296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-63265e67-3a2f-406c-93f7-4eae34c782b2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:29.004413 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-63265e67-3a2f-406c-93f7-4eae34c782b2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.443225 Jul 20 04:10:29.004997 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 529/1026] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:28 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:29.039099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-215fc86f-28a7-43a6-bf7e-77882547b7f6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:29.049841 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-215fc86f-28a7-43a6-bf7e-77882547b7f6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 1.006473 Jul 20 04:10:29.059980 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 498/1027] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:28 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:29.358217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17d802f6-79a2-40f4-86c3-b52b3776b69a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8421f1c10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:29.429167 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-17d802f6-79a2-40f4-86c3-b52b3776b69a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.075051 Jul 20 04:10:29.451748 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 530/1028] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:29 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:30.025897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84bcebe7-b2ac-4c17-97a1-c3ba1c06ba0f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:30.027378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-84bcebe7-b2ac-4c17-97a1-c3ba1c06ba0f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:30.041847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84bcebe7-b2ac-4c17-97a1-c3ba1c06ba0f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:30.044783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84bcebe7-b2ac-4c17-97a1-c3ba1c06ba0f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:30.046280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84bcebe7-b2ac-4c17-97a1-c3ba1c06ba0f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:30.048420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84bcebe7-b2ac-4c17-97a1-c3ba1c06ba0f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:30.074044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a4754c4-8346-4f2c-93f3-6260261a900b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:30.074707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1a4754c4-8346-4f2c-93f3-6260261a900b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:30.095726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a4754c4-8346-4f2c-93f3-6260261a900b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:30.096177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a4754c4-8346-4f2c-93f3-6260261a900b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:30.096969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a4754c4-8346-4f2c-93f3-6260261a900b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:30.106013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a4754c4-8346-4f2c-93f3-6260261a900b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:30.980057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-84bcebe7-b2ac-4c17-97a1-c3ba1c06ba0f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:30.998978 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-84bcebe7-b2ac-4c17-97a1-c3ba1c06ba0f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.980397 Jul 20 04:10:31.000203 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 499/1029] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:30 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:31.019216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a4754c4-8346-4f2c-93f3-6260261a900b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:31.034161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:31.035843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5bca6fe3-6f93-4fd6-b15d-810809a4d3a9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842106940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:31.065234 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a4754c4-8346-4f2c-93f3-6260261a900b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 0.994885 Jul 20 04:10:31.082173 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 531/1030] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:30 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:31.136078 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5bca6fe3-6f93-4fd6-b15d-810809a4d3a9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.134309 Jul 20 04:10:31.137632 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 500/1031] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:31 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:32.019733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-af76c57e-1b1f-4e01-a647-d82b3535af1a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.021032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-af76c57e-1b1f-4e01-a647-d82b3535af1a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:32.041637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af76c57e-1b1f-4e01-a647-d82b3535af1a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.044352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af76c57e-1b1f-4e01-a647-d82b3535af1a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.048091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af76c57e-1b1f-4e01-a647-d82b3535af1a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.050064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af76c57e-1b1f-4e01-a647-d82b3535af1a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.101579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-acfc2965-07f3-4739-bb31-9410033ea764 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.103227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-acfc2965-07f3-4739-bb31-9410033ea764 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:32.119166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acfc2965-07f3-4739-bb31-9410033ea764 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.120321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acfc2965-07f3-4739-bb31-9410033ea764 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.122314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acfc2965-07f3-4739-bb31-9410033ea764 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:32.123097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acfc2965-07f3-4739-bb31-9410033ea764 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:32.419680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-acfc2965-07f3-4739-bb31-9410033ea764 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:32.463924 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-acfc2965-07f3-4739-bb31-9410033ea764 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 0.368321 Jul 20 04:10:32.465811 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 501/1032] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:32.486159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-abab54bc-e4f8-42c3-b4cd-98c9e9b10339 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb84226ea60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:32.598056 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-abab54bc-e4f8-42c3-b4cd-98c9e9b10339 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.130897 Jul 20 04:10:32.599891 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 502/1033] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:32.803125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-af76c57e-1b1f-4e01-a647-d82b3535af1a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:32.852364 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-af76c57e-1b1f-4e01-a647-d82b3535af1a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.823155 Jul 20 04:10:32.863101 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 532/1034] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:32 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:33.009774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-dde7987e-0deb-4cfe-a3eb-4d3313c498b0 req-f41b1730-e015-4b06-ac7d-f4bfe7faeb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8ba299-71a7-44ca-94d0-574109f98bc2", "name": "network-vif-plugged", "status": "completed", "tag": "dbd9f7bb-f31e-478b-8b04-2621b3d9428a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:33.054642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-dde7987e-0deb-4cfe-a3eb-4d3313c498b0 req-f41b1730-e015-4b06-ac7d-f4bfe7faeb29 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:33.055952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-dde7987e-0deb-4cfe-a3eb-4d3313c498b0 req-f41b1730-e015-4b06-ac7d-f4bfe7faeb29 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:33.109368 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-dde7987e-0deb-4cfe-a3eb-4d3313c498b0 req-f41b1730-e015-4b06-ac7d-f4bfe7faeb29 service nova] Creating event network-vif-plugged:dbd9f7bb-f31e-478b-8b04-2621b3d9428a for instance ea8ba299-71a7-44ca-94d0-574109f98bc2 on n-h2-760456-11 Jul 20 04:10:33.127512 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-dde7987e-0deb-4cfe-a3eb-4d3313c498b0 req-f41b1730-e015-4b06-ac7d-f4bfe7faeb29 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122111 Jul 20 04:10:33.135574 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 503/1035] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:33.489518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-923d8ba5-46c4-4a7e-8f16-f73358ce1fa1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:33.492156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-923d8ba5-46c4-4a7e-8f16-f73358ce1fa1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:33.522778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-923d8ba5-46c4-4a7e-8f16-f73358ce1fa1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:33.523431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-923d8ba5-46c4-4a7e-8f16-f73358ce1fa1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:33.524397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-923d8ba5-46c4-4a7e-8f16-f73358ce1fa1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:33.525380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-923d8ba5-46c4-4a7e-8f16-f73358ce1fa1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:33.613459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c6061115-7a36-4b50-bcb4-c4613b9e3bb5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842449280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:33.675289 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c6061115-7a36-4b50-bcb4-c4613b9e3bb5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.066761 Jul 20 04:10:33.676675 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 504/1036] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:33 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:33.869791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-af60a553-418b-4cb6-973b-008745c2bf23 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:33.870949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-af60a553-418b-4cb6-973b-008745c2bf23 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:33.886693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af60a553-418b-4cb6-973b-008745c2bf23 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:33.889030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af60a553-418b-4cb6-973b-008745c2bf23 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:33.890098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af60a553-418b-4cb6-973b-008745c2bf23 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:33.890793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af60a553-418b-4cb6-973b-008745c2bf23 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:34.345458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-af60a553-418b-4cb6-973b-008745c2bf23 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:34.355123 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-af60a553-418b-4cb6-973b-008745c2bf23 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 0.489980 Jul 20 04:10:34.358624 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 505/1037] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:33 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:34.689195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7eea9cb9-65c8-4748-9f61-ad6535b1c044 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842117a60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:34.807258 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7eea9cb9-65c8-4748-9f61-ad6535b1c044 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.121122 Jul 20 04:10:34.807892 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 506/1038] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:34 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:35.096825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-923d8ba5-46c4-4a7e-8f16-f73358ce1fa1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:35.110199 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-923d8ba5-46c4-4a7e-8f16-f73358ce1fa1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 1.632340 Jul 20 04:10:35.119758 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 533/1039] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:33 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:35.347138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5502f564-b867-4cf6-935d-dd42f44db6b9 req-d21967e2-a742-4271-8268-907da90e0d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab536ec-6bd0-4380-b23c-56154cfafbad", "name": "network-vif-plugged", "status": "completed", "tag": "873e2fdf-83fa-49db-a423-2fcca74c2a46"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:35.361902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:35.363993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5502f564-b867-4cf6-935d-dd42f44db6b9 req-d21967e2-a742-4271-8268-907da90e0d82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:35.364438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5502f564-b867-4cf6-935d-dd42f44db6b9 req-d21967e2-a742-4271-8268-907da90e0d82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:35.376177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ade33ad5-c827-4b4e-bcc5-005c67b200fb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.376824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ade33ad5-c827-4b4e-bcc5-005c67b200fb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:35.392559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ade33ad5-c827-4b4e-bcc5-005c67b200fb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:35.393019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ade33ad5-c827-4b4e-bcc5-005c67b200fb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:35.393807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ade33ad5-c827-4b4e-bcc5-005c67b200fb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:35.411023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ade33ad5-c827-4b4e-bcc5-005c67b200fb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:35.441806 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5502f564-b867-4cf6-935d-dd42f44db6b9 req-d21967e2-a742-4271-8268-907da90e0d82 service nova] Creating event network-vif-plugged:873e2fdf-83fa-49db-a423-2fcca74c2a46 for instance 1ab536ec-6bd0-4380-b23c-56154cfafbad on n-h1-760456-11 Jul 20 04:10:35.508169 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5502f564-b867-4cf6-935d-dd42f44db6b9 req-d21967e2-a742-4271-8268-907da90e0d82 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142284 Jul 20 04:10:35.510664 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 507/1040] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:10:35.833606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d37c3df9-3182-4a84-ac6e-a1669e41b4fb tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842106c10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:35.845631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=10 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:35.925279 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d37c3df9-3182-4a84-ac6e-a1669e41b4fb tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.107922 Jul 20 04:10:35.926855 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 508/1041] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:35 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:36.136405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-93b12ac5-8106-4114-9fd3-2a443c4ce6aa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:36.137564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-93b12ac5-8106-4114-9fd3-2a443c4ce6aa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:36.153167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93b12ac5-8106-4114-9fd3-2a443c4ce6aa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:36.154151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93b12ac5-8106-4114-9fd3-2a443c4ce6aa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:36.155251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93b12ac5-8106-4114-9fd3-2a443c4ce6aa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:36.157685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93b12ac5-8106-4114-9fd3-2a443c4ce6aa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:36.673615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-93b12ac5-8106-4114-9fd3-2a443c4ce6aa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:36.702935 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-93b12ac5-8106-4114-9fd3-2a443c4ce6aa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 0.570347 Jul 20 04:10:36.710090 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 509/1042] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:36 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:37.194394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ade33ad5-c827-4b4e-bcc5-005c67b200fb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:37.206463 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ade33ad5-c827-4b4e-bcc5-005c67b200fb tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1317 microversion: 2.1 time: 1.835007 Jul 20 04:10:37.207059 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 534/1043] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:35 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1317 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:10:37.228578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8257b742-6ac6-4ced-a673-12b7efedfd44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842163b80>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:37.317954 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8257b742-6ac6-4ced-a673-12b7efedfd44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.101732 Jul 20 04:10:37.318819 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 535/1044] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:37 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:37.322118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c583b7af-0c7d-40e1-8e6e-4e557d52ad6e tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2021670263", "id": 490627744, "os-flavor-access:is_public": "False"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:37.324054 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:37.324054 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:10:37.328601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e15d9b88-0de5-4fa9-8b0c-6326b4039551 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '.version_select at 0x7fb842163430>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:37.335649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e15d9b88-0de5-4fa9-8b0c-6326b4039551 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:37.342615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e15d9b88-0de5-4fa9-8b0c-6326b4039551 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:37.361753 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c583b7af-0c7d-40e1-8e6e-4e557d52ad6e tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.527157 Jul 20 04:10:37.363122 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 510/1045] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:36 2022] POST /compute/v2.1/flavors => generated 436 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:37.384277 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e15d9b88-0de5-4fa9-8b0c-6326b4039551 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 1198 microversion: 2.1 time: 0.064193 Jul 20 04:10:37.384924 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 536/1046] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:10:37 2022] GET /compute/v2.1/os-migrations => generated 1198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:37.410170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08fc1524-f0b3-4a8a-8279-69d835d81fab tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:37.425053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1cca767d-9917-450e-8f94-68d910da249d tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "14bed34727bc43508d085440b20acdd5"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:37.430126 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:37.430126 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:10:37.441454 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08fc1524-f0b3-4a8a-8279-69d835d81fab tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032709 Jul 20 04:10:37.445519 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 537/1047] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:10:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:37.467494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2cd7a439-8fde-45f5-82ca-675048f3e6a8 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-402444391", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:37.495924 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:37.495924 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:37.561658 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2cd7a439-8fde-45f5-82ca-675048f3e6a8 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.107161 Jul 20 04:10:37.562292 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 538/1048] 10.222.0.59 () {60 vars in 1145 bytes} [Wed Jul 20 04:10:37 2022] POST /compute/v2.1/flavors => generated 498 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:37.591768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-24e386e6-fa75-4955-a977-479b4685b641 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:37.625169 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-24e386e6-fa75-4955-a977-479b4685b641 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.055762 Jul 20 04:10:37.634756 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 539/1049] 10.222.0.59 () {58 vars in 1181 bytes} [Wed Jul 20 04:10:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:37.719546 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1cca767d-9917-450e-8f94-68d910da249d tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/490627744/action" status: 200 len: 96 microversion: 2.1 time: 0.332463 Jul 20 04:10:37.720833 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 511/1050] 10.222.0.59 () {60 vars in 1196 bytes} [Wed Jul 20 04:10:37 2022] POST /compute/v2.1/flavors/490627744/action => generated 96 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:37.741497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e641b591-9d09-4b76-ae82-7b021759d5ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:37.742537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e641b591-9d09-4b76-ae82-7b021759d5ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:37.758502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e641b591-9d09-4b76-ae82-7b021759d5ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:37.760880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e641b591-9d09-4b76-ae82-7b021759d5ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:37.764079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e641b591-9d09-4b76-ae82-7b021759d5ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:37.766407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e641b591-9d09-4b76-ae82-7b021759d5ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:37.819934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c0c4b6a5-e563-47b4-b504-8f88c06b8a8b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Calling method '.version_select at 0x7fb842c1f550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:37.856785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-c0c4b6a5-e563-47b4-b504-8f88c06b8a8b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4fd9614e-5fe5-4525-ae21-480f18f6ac70 does not exist", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:10:37.857418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.security_group_api [None req-c0c4b6a5-e563-47b4-b504-8f88c06b8a8b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Neutron security group 4fd9614e-5fe5-4525-ae21-480f18f6ac70 not found {{(pid=119606) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:10:37.857958 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-c0c4b6a5-e563-47b4-b504-8f88c06b8a8b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] HTTP exception thrown: Security group 4fd9614e-5fe5-4525-ae21-480f18f6ac70 does not exist Jul 20 04:10:37.857958 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-f75ee49a-980f-4073-b11b-a7cd96de8896'] Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c0c4b6a5-e563-47b4-b504-8f88c06b8a8b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Request method failure captured: Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-security-groups/4fd9614e-5fe5-4525-ae21-480f18f6ac70 HTTP/1.1 Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14A9Nhhzqzqy6wcKnAPfNFyGndd9F8NY0uWYSvv35OVNrKfHj1qzit929IZSxCnYt-wxPFuHrVwfF46BQ1rZ3Y3C8ThjR4_Wiuabfm6x-XAQ88gT0PFYsw-XSLvXYu-tXjoiV7mOwn0se3thskm2LFEMXEKsdXHyYK17M7eGhQzPyGY Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a65ce07993414eabbf78ddb9571336d0 Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:10:37.863639 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a65ce07993414eabbf78ddb9571336d0 Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupsNegativeTestJSON-245522766-project Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: be28473714534cc5ae0a345070ea508e Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-245522766-project Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: exception: Security group 4fd9614e-5fe5-4525-ae21-480f18f6ac70 does not exist Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-f75ee49a-980f-4073-b11b-a7cd96de8896'] Jul 20 04:10:37.865912 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4fd9614e-5fe5-4525-ae21-480f18f6ac70'} Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:37.866878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4fd9614e-5fe5-4525-ae21-480f18f6ac70 does not exist Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f75ee49a-980f-4073-b11b-a7cd96de8896'] Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:10:37.868018 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4fd9614e-5fe5-4525-ae21-480f18f6ac70 does not exist Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f75ee49a-980f-4073-b11b-a7cd96de8896'] Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4fd9614e-5fe5-4525-ae21-480f18f6ac70 does not exist Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f75ee49a-980f-4073-b11b-a7cd96de8896'] Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:37.869123 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:37.870471 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:37.870471 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:37.870471 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:37.870471 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:37.870471 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4fd9614e-5fe5-4525-ae21-480f18f6ac70 does not exist Jul 20 04:10:37.870471 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f75ee49a-980f-4073-b11b-a7cd96de8896'] Jul 20 04:10:37.870471 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:37.870471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c0c4b6a5-e563-47b4-b504-8f88c06b8a8b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Returning 404 to user: Security group 4fd9614e-5fe5-4525-ae21-480f18f6ac70 does not exist Jul 20 04:10:37.870471 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-f75ee49a-980f-4073-b11b-a7cd96de8896'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:37.879071 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c0c4b6a5-e563-47b4-b504-8f88c06b8a8b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/4fd9614e-5fe5-4525-ae21-480f18f6ac70" status: 404 len: 194 microversion: 2.1 time: 0.195094 Jul 20 04:10:37.879071 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 540/1051] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:10:37 2022] DELETE /compute/v2.1/os-security-groups/4fd9614e-5fe5-4525-ae21-480f18f6ac70 => generated 194 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:37.893129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93c44f10-650c-4936-865c-869c436dc78f tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "14bed34727bc43508d085440b20acdd5"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:37.894389 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:37.894389 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:38.069531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e641b591-9d09-4b76-ae82-7b021759d5ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:38.077900 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e641b591-9d09-4b76-ae82-7b021759d5ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 0.352694 Jul 20 04:10:38.079050 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 512/1052] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:37 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:38.084215 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d1b87d6f-934c-4e16-9605-574b685841db tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003899 Jul 20 04:10:38.085314 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 513/1053] 10.222.0.59 () {58 vars in 1163 bytes} [Wed Jul 20 04:10:38 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:10:38.089964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-771893996", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "d58c74e9-1b39-41fd-98a4-32662fbf74ee"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:38.095938 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-93c44f10-650c-4936-865c-869c436dc78f tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project 14bed34727bc43508d085440b20acdd5 combination. Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93c44f10-650c-4936-865c-869c436dc78f tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Request method failure captured: Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/flavors/490627744/action HTTP/1.1 Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 67 Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14A7YASDi6Fkj10Q1HBHYVitpEvmYW5uZgJ6IcFas-5-Ai8rJM8RAz51S7nORr3RUCXpzRPGUZaPwhAcGvBT-raLHAUToj1xi3-hpKbrLqpwowskZ0Uz6bAU6sHwW9CpUgl1UXaEkgtS1QhWJTy18Ni7cs51CDT91OiGl1Jh7pZVnQs Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 56afb99dc6df41e097fd2194ae68f0da Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-545961111 Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:10:38.123909 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-545961111 Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 56afb99dc6df41e097fd2194ae68f0da Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-545961111 Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 13c36d7894784552a65720142af69a17 Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: {"addTenantAccess": {"tenant": "14bed34727bc43508d085440b20acdd5"}} Jul 20 04:10:38.125360 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: exception: Flavor access already exists for flavor 34 and project 14bed34727bc43508d085440b20acdd5 combination. Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '490627744', 'body': {'addTenantAccess': {'tenant': '14bed34727bc43508d085440b20acdd5'}}} Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:10:38.128075 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34-14bed34727bc43508d085440b20acdd5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:10:38.129200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:10:38.131197 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:10:38.133000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34-14bed34727bc43508d085440b20acdd5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 10, 38, 80759), 'updated_at': None, 'flavor_id': 34, 'project_id': '14bed34727bc43508d085440b20acdd5'}] Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:38.134078 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 34 and project 14bed34727bc43508d085440b20acdd5 combination. Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:38.139773 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 34 and project 14bed34727bc43508d085440b20acdd5 combination. Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:38.142618 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:38.144558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 34 and project 14bed34727bc43508d085440b20acdd5 combination. Jul 20 04:10:38.144558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:38.148521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93c44f10-650c-4936-865c-869c436dc78f tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project 14bed34727bc43508d085440b20acdd5 combination. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:38.149654 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-93c44f10-650c-4936-865c-869c436dc78f tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/490627744/action" status: 409 len: 152 microversion: 2.1 time: 0.270056 Jul 20 04:10:38.153580 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 541/1054] 10.222.0.59 () {60 vars in 1196 bytes} [Wed Jul 20 04:10:37 2022] POST /compute/v2.1/flavors/490627744/action => generated 152 bytes in 273 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:38.168899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1f27932d-3f81-4ea1-88bd-bcb0063e7214 tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Calling method '.version_select at 0x7fb841ed4d30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:38.179504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:39.124562 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1f27932d-3f81-4ea1-88bd-bcb0063e7214 tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.969534 Jul 20 04:10:39.154034 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 542/1055] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:10:38 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:39.173438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-45eeb103-561a-4f00-a507-19a7eb41bdd2 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "14bed34727bc43508d085440b20acdd5"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:39.199613 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:39.199613 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:39.396465 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-45eeb103-561a-4f00-a507-19a7eb41bdd2 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/490627744/action" status: 200 len: 21 microversion: 2.1 time: 0.233648 Jul 20 04:10:39.397654 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 543/1056] 10.222.0.59 () {60 vars in 1196 bytes} [Wed Jul 20 04:10:39 2022] POST /compute/v2.1/flavors/490627744/action => generated 21 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:39.420598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9bc21718-24d0-47fe-84cc-efa6ce14781b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:39.424285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9bc21718-24d0-47fe-84cc-efa6ce14781b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:39.484210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bc21718-24d0-47fe-84cc-efa6ce14781b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:39.508208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bc21718-24d0-47fe-84cc-efa6ce14781b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:39.514092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bc21718-24d0-47fe-84cc-efa6ce14781b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:39.529345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bc21718-24d0-47fe-84cc-efa6ce14781b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:40.109046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:40.110205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:40.112625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:40.113305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:40.113935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:40.140594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:40.141389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:40.142781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:40.143465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:40.198208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:40.216051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for user e82ac4df5f844ec4996d939efdba9c11 and project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:40.247161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:40.259692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:40.403089 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f00fd664-724e-45f8-8d42-5c089e72ce12 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.313502 Jul 20 04:10:40.408925 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 514/1057] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:40.424654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e7172b87-6882-4b42-aada-263088979afa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842117280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:41.107702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9bc21718-24d0-47fe-84cc-efa6ce14781b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:41.117968 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9bc21718-24d0-47fe-84cc-efa6ce14781b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1466 microversion: 2.1 time: 1.718990 Jul 20 04:10:41.120810 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 544/1058] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:39 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1466 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:41.125690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-74a219fc-f0e4-4d60-82e2-b507ae26a837 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:41.150967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-74a219fc-f0e4-4d60-82e2-b507ae26a837 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:41.191315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74a219fc-f0e4-4d60-82e2-b507ae26a837 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.191766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74a219fc-f0e4-4d60-82e2-b507ae26a837 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:41.192681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74a219fc-f0e4-4d60-82e2-b507ae26a837 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:41.199273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74a219fc-f0e4-4d60-82e2-b507ae26a837 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:42.263414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-74a219fc-f0e4-4d60-82e2-b507ae26a837 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:42.276911 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-74a219fc-f0e4-4d60-82e2-b507ae26a837 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 1.154796 Jul 20 04:10:42.292392 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 545/1059] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:41 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:42.322357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4c085839-7467-4168-b572-5e59359edeac tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Calling method '.version_select at 0x7fb841ed48b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:42.742484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-4c085839-7467-4168-b572-5e59359edeac tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:10:42.743426 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-4c085839-7467-4168-b572-5e59359edeac tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 20 04:10:42.743426 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-4cd9126a-c8b8-4ceb-8cb8-8dfb9d7e3c79'] Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4c085839-7467-4168-b572-5e59359edeac tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Request method failure captured: Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-security-groups/be32d5fa-8942-4876-b9c6-4cc772247998 HTTP/1.1 Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14A9Nhhzqzqy6wcKnAPfNFyGndd9F8NY0uWYSvv35OVNrKfHj1qzit929IZSxCnYt-wxPFuHrVwfF46BQ1rZ3Y3C8ThjR4_Wiuabfm6x-XAQ88gT0PFYsw-XSLvXYu-tXjoiV7mOwn0se3thskm2LFEMXEKsdXHyYK17M7eGhQzPyGY Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a65ce07993414eabbf78ddb9571336d0 Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:10:42.746085 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a65ce07993414eabbf78ddb9571336d0 Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupsNegativeTestJSON-245522766-project Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: be28473714534cc5ae0a345070ea508e Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-245522766-project Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: exception: Insufficient rights for removing default security group. Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-4cd9126a-c8b8-4ceb-8cb8-8dfb9d7e3c79'] Jul 20 04:10:42.747781 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'be32d5fa-8942-4876-b9c6-4cc772247998'} Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:42.748759 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cd9126a-c8b8-4ceb-8cb8-8dfb9d7e3c79'] Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 20 04:10:42.750181 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cd9126a-c8b8-4ceb-8cb8-8dfb9d7e3c79'] Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cd9126a-c8b8-4ceb-8cb8-8dfb9d7e3c79'] Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:42.751665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:42.753214 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:42.753214 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:42.753214 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:42.753214 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 20 04:10:42.753214 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cd9126a-c8b8-4ceb-8cb8-8dfb9d7e3c79'] Jul 20 04:10:42.753214 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:42.754675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4c085839-7467-4168-b572-5e59359edeac tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 20 04:10:42.754675 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-4cd9126a-c8b8-4ceb-8cb8-8dfb9d7e3c79'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:42.757539 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4c085839-7467-4168-b572-5e59359edeac tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/be32d5fa-8942-4876-b9c6-4cc772247998" status: 400 len: 182 microversion: 2.1 time: 0.451879 Jul 20 04:10:42.765129 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 546/1060] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:10:42 2022] DELETE /compute/v2.1/os-security-groups/be32d5fa-8942-4876-b9c6-4cc772247998 => generated 182 bytes in 471 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:10:42.776251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9b028056-a7d5-46a0-b1a8-41400efc5aad tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:42.779563 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:42.779563 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:42.838284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:42.852928 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9b028056-a7d5-46a0-b1a8-41400efc5aad tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/490627744" status: 202 len: 0 microversion: 2.1 time: 0.086326 Jul 20 04:10:42.861201 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 547/1061] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:10:42 2022] DELETE /compute/v2.1/flavors/490627744 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:42.866573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e11950d2-2a8b-4bd7-827a-28ca9fe32e1a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:42.879623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e11950d2-2a8b-4bd7-827a-28ca9fe32e1a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:42.919504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e11950d2-2a8b-4bd7-827a-28ca9fe32e1a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:42.927974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e11950d2-2a8b-4bd7-827a-28ca9fe32e1a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:42.931196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e11950d2-2a8b-4bd7-827a-28ca9fe32e1a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:42.937916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e11950d2-2a8b-4bd7-827a-28ca9fe32e1a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.257362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e11950d2-2a8b-4bd7-827a-28ca9fe32e1a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:43.284571 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e11950d2-2a8b-4bd7-827a-28ca9fe32e1a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1338 microversion: 2.1 time: 0.414602 Jul 20 04:10:43.300838 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 548/1062] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:42 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1338 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:43.321944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-99f05742-133c-4b2e-ac40-ef0401319691 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:43.324523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-99f05742-133c-4b2e-ac40-ef0401319691 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:43.352623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99f05742-133c-4b2e-ac40-ef0401319691 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.361642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99f05742-133c-4b2e-ac40-ef0401319691 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:43.365992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99f05742-133c-4b2e-ac40-ef0401319691 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:43.367878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99f05742-133c-4b2e-ac40-ef0401319691 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.125133 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e7172b87-6882-4b42-aada-263088979afa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 3.709095 Jul 20 04:10:44.131476 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 515/1063] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:40 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 3721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:44.138283 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-99f05742-133c-4b2e-ac40-ef0401319691 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1619 microversion: 2.1 time: 0.835926 Jul 20 04:10:44.139146 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 549/1064] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:43 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1619 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:44.167930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d1b6d7f4-cab7-4aed-b579-32d557be86f8 tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Calling method '.version_select at 0x7fb842205700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:44.174101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4597008a-ae0a-4637-a0e7-0ec888dc4879 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:44.250497 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4597008a-ae0a-4637-a0e7-0ec888dc4879 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.095565 Jul 20 04:10:44.263330 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 550/1065] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:44 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:44.285277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6fa99be6-4e5f-46cb-8534-e332a1353d95 req-14926db3-62b1-44f1-8839-328566fd8216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23765b5-80ca-4a5d-bd2e-480d92222c04", "name": "network-vif-plugged", "status": "completed", "tag": "40f5fbe1-7bda-48e3-886f-5b7124d37017"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:44.294139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG neutronclient.v2_0.client [None req-d1b6d7f4-cab7-4aed-b579-32d557be86f8 tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3c2dfc8b-4745-498d-ad72-022a1616a0bb does not exist", "detail": ""}} {{(pid=119605) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:10:44.294792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.security_group_api [None req-d1b6d7f4-cab7-4aed-b579-32d557be86f8 tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Neutron security group 3c2dfc8b-4745-498d-ad72-022a1616a0bb not found {{(pid=119605) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:10:44.295350 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-d1b6d7f4-cab7-4aed-b579-32d557be86f8 tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] HTTP exception thrown: Security group 3c2dfc8b-4745-498d-ad72-022a1616a0bb does not exist Jul 20 04:10:44.295350 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-ef346b89-b06c-4260-a57e-449ab45d9d59'] Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d1b6d7f4-cab7-4aed-b579-32d557be86f8 tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Request method failure captured: Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-security-groups/3c2dfc8b-4745-498d-ad72-022a1616a0bb HTTP/1.1 Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14A9Nhhzqzqy6wcKnAPfNFyGndd9F8NY0uWYSvv35OVNrKfHj1qzit929IZSxCnYt-wxPFuHrVwfF46BQ1rZ3Y3C8ThjR4_Wiuabfm6x-XAQ88gT0PFYsw-XSLvXYu-tXjoiV7mOwn0se3thskm2LFEMXEKsdXHyYK17M7eGhQzPyGY Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: a65ce07993414eabbf78ddb9571336d0 Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:10:44.297317 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: a65ce07993414eabbf78ddb9571336d0 Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsNegativeTestJSON-245522766-project Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: be28473714534cc5ae0a345070ea508e Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-245522766-project Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: exception: Security group 3c2dfc8b-4745-498d-ad72-022a1616a0bb does not exist Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-ef346b89-b06c-4260-a57e-449ab45d9d59'] Jul 20 04:10:44.300664 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '3c2dfc8b-4745-498d-ad72-022a1616a0bb'} Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:44.306768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3c2dfc8b-4745-498d-ad72-022a1616a0bb does not exist Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef346b89-b06c-4260-a57e-449ab45d9d59'] Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:10:44.308196 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3c2dfc8b-4745-498d-ad72-022a1616a0bb does not exist Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef346b89-b06c-4260-a57e-449ab45d9d59'] Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3c2dfc8b-4745-498d-ad72-022a1616a0bb does not exist Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef346b89-b06c-4260-a57e-449ab45d9d59'] Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.309587 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3c2dfc8b-4745-498d-ad72-022a1616a0bb does not exist Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef346b89-b06c-4260-a57e-449ab45d9d59'] Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d1b6d7f4-cab7-4aed-b579-32d557be86f8 tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Returning 404 to user: Security group 3c2dfc8b-4745-498d-ad72-022a1616a0bb does not exist Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-ef346b89-b06c-4260-a57e-449ab45d9d59'] {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d1b6d7f4-cab7-4aed-b579-32d557be86f8 tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/3c2dfc8b-4745-498d-ad72-022a1616a0bb" status: 404 len: 194 microversion: 2.1 time: 0.167515 Jul 20 04:10:44.312867 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 516/1066] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:10:44 2022] GET /compute/v2.1/os-security-groups/3c2dfc8b-4745-498d-ad72-022a1616a0bb => generated 194 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:44.315814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6fa99be6-4e5f-46cb-8534-e332a1353d95 req-14926db3-62b1-44f1-8839-328566fd8216 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.319103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6fa99be6-4e5f-46cb-8534-e332a1353d95 req-14926db3-62b1-44f1-8839-328566fd8216 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.332590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d437079-5634-4452-a7dc-fc33118074ff tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:44.334684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d437079-5634-4452-a7dc-fc33118074ff tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:44.352865 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6fa99be6-4e5f-46cb-8534-e332a1353d95 req-14926db3-62b1-44f1-8839-328566fd8216 service nova] Creating event network-vif-plugged:40f5fbe1-7bda-48e3-886f-5b7124d37017 for instance a23765b5-80ca-4a5d-bd2e-480d92222c04 on n-h2-760456-11 Jul 20 04:10:44.365429 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6fa99be6-4e5f-46cb-8534-e332a1353d95 req-14926db3-62b1-44f1-8839-328566fd8216 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098279 Jul 20 04:10:44.367276 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 551/1067] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:44.398933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50c1098b-6123-4846-ad6a-7f7c41db9d73 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-506202449", "id": 622926395, "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:44.401130 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:44.401130 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:44.432432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d437079-5634-4452-a7dc-fc33118074ff tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.432902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d437079-5634-4452-a7dc-fc33118074ff tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.433715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d437079-5634-4452-a7dc-fc33118074ff tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.434161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d437079-5634-4452-a7dc-fc33118074ff tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.526821 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-50c1098b-6123-4846-ad6a-7f7c41db9d73 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.157625 Jul 20 04:10:44.539231 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 552/1068] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:44 2022] POST /compute/v2.1/flavors => generated 434 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:44.585090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ab4a04d8-cd85-4248-bc5b-6d5cfe44c947 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:44.602904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ab4a04d8-cd85-4248-bc5b-6d5cfe44c947 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:44.682115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab4a04d8-cd85-4248-bc5b-6d5cfe44c947 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.685659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab4a04d8-cd85-4248-bc5b-6d5cfe44c947 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:44.686547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab4a04d8-cd85-4248-bc5b-6d5cfe44c947 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:44.688362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab4a04d8-cd85-4248-bc5b-6d5cfe44c947 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:45.093079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ab4a04d8-cd85-4248-bc5b-6d5cfe44c947 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:45.114073 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ab4a04d8-cd85-4248-bc5b-6d5cfe44c947 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1336 microversion: 2.1 time: 0.569608 Jul 20 04:10:45.131603 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 553/1069] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:44 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1336 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:45.162052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f931bc31-3a7f-4c54-9ff0-c7f14f02482b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Action: 'update', calling method: .version_select at 0x7fb841ee8670>, body: {"security_group": {"name": "tempest-sg-899329698", "description": "tempest-description-2028553697"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:45.391027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-f931bc31-3a7f-4c54-9ff0-c7f14f02482b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eb4137dd-96de-4b59-b092-eb75f84a45a1 does not exist", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:10:45.391696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.security_group_api [None req-f931bc31-3a7f-4c54-9ff0-c7f14f02482b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Neutron security group eb4137dd-96de-4b59-b092-eb75f84a45a1 not found {{(pid=119606) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:10:45.392241 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-f931bc31-3a7f-4c54-9ff0-c7f14f02482b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] HTTP exception thrown: Security group eb4137dd-96de-4b59-b092-eb75f84a45a1 does not exist Jul 20 04:10:45.392241 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-79f30356-c04e-480e-a4b1-4c277de1a6ef'] Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f931bc31-3a7f-4c54-9ff0-c7f14f02482b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Request method failure captured: Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/os-security-groups/eb4137dd-96de-4b59-b092-eb75f84a45a1 HTTP/1.1 Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 101 Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14A9Nhhzqzqy6wcKnAPfNFyGndd9F8NY0uWYSvv35OVNrKfHj1qzit929IZSxCnYt-wxPFuHrVwfF46BQ1rZ3Y3C8ThjR4_Wiuabfm6x-XAQ88gT0PFYsw-XSLvXYu-tXjoiV7mOwn0se3thskm2LFEMXEKsdXHyYK17M7eGhQzPyGY Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a65ce07993414eabbf78ddb9571336d0 Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:10:45.394461 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a65ce07993414eabbf78ddb9571336d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a65ce07993414eabbf78ddb9571336d0 Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-245522766 Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupsNegativeTestJSON-245522766-project Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: be28473714534cc5ae0a345070ea508e Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-245522766-project Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: {"security_group": {"name": "tempest-sg-899329698", "description": "tempest-description-2028553697"}} Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:10:45.396126 n-d-760456-11 devstack@n-api.service[119606]: exception: Security group eb4137dd-96de-4b59-b092-eb75f84a45a1 does not exist Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-79f30356-c04e-480e-a4b1-4c277de1a6ef'] Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'eb4137dd-96de-4b59-b092-eb75f84a45a1', 'body': {'security_group': {'name': 'tempest-sg-899329698', 'description': 'tempest-description-2028553697'}}} Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:10:45.397109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eb4137dd-96de-4b59-b092-eb75f84a45a1 does not exist Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79f30356-c04e-480e-a4b1-4c277de1a6ef'] Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:10:45.398472 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eb4137dd-96de-4b59-b092-eb75f84a45a1 does not exist Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79f30356-c04e-480e-a4b1-4c277de1a6ef'] Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eb4137dd-96de-4b59-b092-eb75f84a45a1 does not exist Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79f30356-c04e-480e-a4b1-4c277de1a6ef'] Jul 20 04:10:45.399879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eb4137dd-96de-4b59-b092-eb75f84a45a1 does not exist Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79f30356-c04e-480e-a4b1-4c277de1a6ef'] Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f931bc31-3a7f-4c54-9ff0-c7f14f02482b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] Returning 404 to user: Security group eb4137dd-96de-4b59-b092-eb75f84a45a1 does not exist Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-79f30356-c04e-480e-a4b1-4c277de1a6ef'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:45.401340 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f931bc31-3a7f-4c54-9ff0-c7f14f02482b tempest-SecurityGroupsNegativeTestJSON-245522766 tempest-SecurityGroupsNegativeTestJSON-245522766-project] 10.222.0.59 "PUT /compute/v2.1/os-security-groups/eb4137dd-96de-4b59-b092-eb75f84a45a1" status: 404 len: 194 microversion: 2.1 time: 0.263372 Jul 20 04:10:45.406204 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 554/1070] 10.222.0.59 () {60 vars in 1289 bytes} [Wed Jul 20 04:10:45 2022] PUT /compute/v2.1/os-security-groups/eb4137dd-96de-4b59-b092-eb75f84a45a1 => generated 194 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:45.419204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0f79496-3b42-476b-944c-136b5dd4fa65 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:45.424043 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:45.424043 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:45.461374 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e0f79496-3b42-476b-944c-136b5dd4fa65 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0f79496-3b42-476b-944c-136b5dd4fa65 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Request method failure captured: Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/flavors/622926395/os-flavor-access HTTP/1.1 Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14A7YASDi6Fkj10Q1HBHYVitpEvmYW5uZgJ6IcFas-5-Ai8rJM8RAz51S7nORr3RUCXpzRPGUZaPwhAcGvBT-raLHAUToj1xi3-hpKbrLqpwowskZ0Uz6bAU6sHwW9CpUgl1UXaEkgtS1QhWJTy18Ni7cs51CDT91OiGl1Jh7pZVnQs Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 56afb99dc6df41e097fd2194ae68f0da Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-545961111 Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:10:45.469187 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-545961111 Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 56afb99dc6df41e097fd2194ae68f0da Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-545961111 Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 13c36d7894784552a65720142af69a17 Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: exception: Access list not available for public flavors. Jul 20 04:10:45.470829 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'flavor_id': '622926395'} Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 20 04:10:45.471723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:45.473218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0f79496-3b42-476b-944c-136b5dd4fa65 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:45.476834 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0f79496-3b42-476b-944c-136b5dd4fa65 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/622926395/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.069446 Jul 20 04:10:45.477436 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 555/1071] 10.222.0.59 () {58 vars in 1205 bytes} [Wed Jul 20 04:10:45 2022] GET /compute/v2.1/flavors/622926395/os-flavor-access => generated 91 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:10:45.509882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1594429219", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "cc16be0b-acc6-4bec-997a-2f0026a5500e"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:45.710213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:10:46.343907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d437079-5634-4452-a7dc-fc33118074ff tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:46.363378 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d437079-5634-4452-a7dc-fc33118074ff tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1310 microversion: 2.1 time: 2.059824 Jul 20 04:10:46.366362 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 517/1072] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:44 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1310 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:46.391554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b9d9c1c-4498-41ed-a54a-49dc3d5a79c6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842117550>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:46.490108 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3b9d9c1c-4498-41ed-a54a-49dc3d5a79c6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.114325 Jul 20 04:10:46.491378 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 518/1073] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:46 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:46.504001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-62eadacf-58e0-4eff-8384-14aa60bf5078 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:46.509455 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:46.509455 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:10:46.569952 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-62eadacf-58e0-4eff-8384-14aa60bf5078 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/622926395" status: 202 len: 0 microversion: 2.1 time: 0.074626 Jul 20 04:10:46.570082 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 519/1074] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:10:46 2022] DELETE /compute/v2.1/flavors/622926395 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:46.594974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8831a110-0963-4d43-9a89-81ac4f4f7e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:46.595636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8831a110-0963-4d43-9a89-81ac4f4f7e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:46.641217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8831a110-0963-4d43-9a89-81ac4f4f7e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:46.643489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8831a110-0963-4d43-9a89-81ac4f4f7e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:46.645988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8831a110-0963-4d43-9a89-81ac4f4f7e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:46.649892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8831a110-0963-4d43-9a89-81ac4f4f7e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:46.762576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:47.139997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8831a110-0963-4d43-9a89-81ac4f4f7e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:47.156456 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8831a110-0963-4d43-9a89-81ac4f4f7e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1378 microversion: 2.1 time: 0.580282 Jul 20 04:10:47.157980 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 520/1075] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:46 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1378 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:47.199468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-578d03e2-531d-4533-b5c3-25df852688a5 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.297034 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-578d03e2-531d-4533-b5c3-25df852688a5 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.115744 Jul 20 04:10:47.298033 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 521/1076] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:47 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:47.327166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9677f102-ce1b-4f94-a4fc-87f85df2d7c0 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-660282240", "id": 1049799178, "os-flavor-access:is_public": "False"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:47.330517 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:47.330517 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:10:47.359624 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9677f102-ce1b-4f94-a4fc-87f85df2d7c0 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.037066 Jul 20 04:10:47.364654 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 522/1077] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:47 2022] POST /compute/v2.1/flavors => generated 438 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:47.773296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-739cc2d4-625f-4a2e-a9e9-d59600145dc0 tempest-FlavorsAccessNegativeTestJSON-2059171640 tempest-FlavorsAccessNegativeTestJSON-2059171640-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "14bed34727bc43508d085440b20acdd5"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:47.774763 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:47.774763 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:10:47.775629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-739cc2d4-625f-4a2e-a9e9-d59600145dc0 tempest-FlavorsAccessNegativeTestJSON-2059171640 tempest-FlavorsAccessNegativeTestJSON-2059171640-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '1125e23bb05b46318dad9b0553c9a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bed34727bc43508d085440b20acdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-739cc2d4-625f-4a2e-a9e9-d59600145dc0 tempest-FlavorsAccessNegativeTestJSON-2059171640 tempest-FlavorsAccessNegativeTestJSON-2059171640-project] Request method failure captured: Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/flavors/1049799178/action HTTP/1.1 Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 67 Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14A6XIfunIMqtIrDQ7eQivbpYRlisjC0MXKvU2p6wt2ZaeZAWt1Dm4rZElH6OPln_mAdQAFMoKcY2tgQkPJ05jf5IBo1EubfJTPs1FnDKZFaJ87XCZiBYctnc-ha9-fqR2-ZjCBdWw7Gkj7szrbINSXba4RvaLD8X-UZHofPcP1AAVE Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 14bed34727bc43508d085440b20acdd5 Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2059171640 Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:10:47.780046 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/14bed34727bc43508d085440b20acdd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/14bed34727bc43508d085440b20acdd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/14bed34727bc43508d085440b20acdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_14bed34727bc43508d085440b20acdd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2059171640 Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 14bed34727bc43508d085440b20acdd5 Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2059171640 Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-FlavorsAccessNegativeTestJSON-2059171640-project Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 1125e23bb05b46318dad9b0553c9a584 Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2059171640-project Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: {"addTenantAccess": {"tenant": "14bed34727bc43508d085440b20acdd5"}} Jul 20 04:10:47.781389 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1049799178', 'body': {'addTenantAccess': {'tenant': '14bed34727bc43508d085440b20acdd5'}}} Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:47.782165 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:10:47.783428 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:47.784660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-739cc2d4-625f-4a2e-a9e9-d59600145dc0 tempest-FlavorsAccessNegativeTestJSON-2059171640 tempest-FlavorsAccessNegativeTestJSON-2059171640-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:47.784660 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-739cc2d4-625f-4a2e-a9e9-d59600145dc0 tempest-FlavorsAccessNegativeTestJSON-2059171640 tempest-FlavorsAccessNegativeTestJSON-2059171640-project] 10.222.0.59 "POST /compute/v2.1/flavors/1049799178/action" status: 403 len: 130 microversion: 2.1 time: 0.411572 Jul 20 04:10:47.790542 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 523/1078] 10.222.0.59 () {60 vars in 1199 bytes} [Wed Jul 20 04:10:47 2022] POST /compute/v2.1/flavors/1049799178/action => generated 130 bytes in 421 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:47.809093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10facb59-b5b8-46c0-9187-43fb3ecf2697 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:47.809895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10facb59-b5b8-46c0-9187-43fb3ecf2697 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:47.831699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10facb59-b5b8-46c0-9187-43fb3ecf2697 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.831939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10facb59-b5b8-46c0-9187-43fb3ecf2697 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:47.837022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10facb59-b5b8-46c0-9187-43fb3ecf2697 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:47.837536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10facb59-b5b8-46c0-9187-43fb3ecf2697 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.732111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:10:48.732588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:10:48.733010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:10:48.733427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:10:48.735643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:10:48.789055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:48.789856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.790932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:48.793196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:48.925250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:10:48.964547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Getting quotas for user f508838d58f442dd80ab9f1b5b07b4df and project 95231a9d82164f88b1c6ff355679d292. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:10:49.008684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:10:49.025390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:10:49.040890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10facb59-b5b8-46c0-9187-43fb3ecf2697 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:49.054567 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10facb59-b5b8-46c0-9187-43fb3ecf2697 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1493 microversion: 2.1 time: 1.262815 Jul 20 04:10:49.064167 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 524/1079] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:47 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1493 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:49.101939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e022505f-2d2b-4cb1-bb57-168278291fd5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842235dc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:49.284457 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9c84b04f-0b2c-4c8b-a41b-a4f5131d3ad2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.802443 Jul 20 04:10:49.296183 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 556/1080] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:10:49.310889 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e022505f-2d2b-4cb1-bb57-168278291fd5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.242275 Jul 20 04:10:49.315252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0d0838b8-5a87-4e7a-b425-5db0e39708d9 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:49.316903 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 525/1081] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:49 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:49.321579 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:49.321579 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:49.334841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bff3cc1-306e-443d-832a-56a663539b91 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:49.336576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6bff3cc1-306e-443d-832a-56a663539b91 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:49.366098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bff3cc1-306e-443d-832a-56a663539b91 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.371159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bff3cc1-306e-443d-832a-56a663539b91 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.376571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bff3cc1-306e-443d-832a-56a663539b91 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.377933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bff3cc1-306e-443d-832a-56a663539b91 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.396902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0d0838b8-5a87-4e7a-b425-5db0e39708d9 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1049799178" status: 202 len: 0 microversion: 2.1 time: 0.099085 Jul 20 04:10:49.403982 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 557/1082] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:10:49 2022] DELETE /compute/v2.1/flavors/1049799178 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:49.421590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-443a6539-b2d0-40c5-938b-db3dc6561d61 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:49.426041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-443a6539-b2d0-40c5-938b-db3dc6561d61 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:49.456632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-443a6539-b2d0-40c5-938b-db3dc6561d61 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.477602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-443a6539-b2d0-40c5-938b-db3dc6561d61 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:49.478531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-443a6539-b2d0-40c5-938b-db3dc6561d61 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:49.479026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-443a6539-b2d0-40c5-938b-db3dc6561d61 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.168217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:50.194575 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-443a6539-b2d0-40c5-938b-db3dc6561d61 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1646 microversion: 2.1 time: 0.780195 Jul 20 04:10:50.195272 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 558/1083] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:49 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1646 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:50.233274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:10:50.235913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ab68b29b-e08d-460b-8944-e07666d76c84 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:50.239610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ab68b29b-e08d-460b-8944-e07666d76c84 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:50.449742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ab68b29b-e08d-460b-8944-e07666d76c84 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:50.459292 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ab68b29b-e08d-460b-8944-e07666d76c84 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1217 microversion: 2.1 time: 0.252405 Jul 20 04:10:50.473111 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 559/1084] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:50 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1217 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:50.487947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b77f465f-dba7-44f4-9900-f67b99fa351c tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:50.549922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6bff3cc1-306e-443d-832a-56a663539b91 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:50.560428 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b77f465f-dba7-44f4-9900-f67b99fa351c tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.082692 Jul 20 04:10:50.561611 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 560/1085] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:50 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:50.564417 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6bff3cc1-306e-443d-832a-56a663539b91 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1378 microversion: 2.1 time: 1.245305 Jul 20 04:10:50.565974 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 526/1086] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:49 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1378 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:50.575225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ae2bdd0c-b061-4db6-98bf-b4e8d7ff7512 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:50.576178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ae2bdd0c-b061-4db6-98bf-b4e8d7ff7512 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:50.596600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9210ad3e-2c3f-4a81-be90-e29290ea5ca3 req-c0efd53c-877b-405b-bdec-f232a47933ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a36a696-8851-4e69-ac90-65e06e37bc2b", "tag": "b7b586b2-e4b3-4e30-bff1-a39da550c591"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:50.597660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae2bdd0c-b061-4db6-98bf-b4e8d7ff7512 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:50.598381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae2bdd0c-b061-4db6-98bf-b4e8d7ff7512 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.601279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae2bdd0c-b061-4db6-98bf-b4e8d7ff7512 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:50.603846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae2bdd0c-b061-4db6-98bf-b4e8d7ff7512 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.638679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9210ad3e-2c3f-4a81-be90-e29290ea5ca3 req-c0efd53c-877b-405b-bdec-f232a47933ec service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:50.639219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9210ad3e-2c3f-4a81-be90-e29290ea5ca3 req-c0efd53c-877b-405b-bdec-f232a47933ec service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:50.701600 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9210ad3e-2c3f-4a81-be90-e29290ea5ca3 req-c0efd53c-877b-405b-bdec-f232a47933ec service nova] Creating event network-changed:b7b586b2-e4b3-4e30-bff1-a39da550c591 for instance 1a36a696-8851-4e69-ac90-65e06e37bc2b on n-h2-760456-11 Jul 20 04:10:50.714949 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9210ad3e-2c3f-4a81-be90-e29290ea5ca3 req-c0efd53c-877b-405b-bdec-f232a47933ec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151374 Jul 20 04:10:50.739913 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 561/1087] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:50.759550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e7083a3-7db0-46e3-a470-2b4e7effe89a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841ee8940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:50.901455 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3e7083a3-7db0-46e3-a470-2b4e7effe89a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.154873 Jul 20 04:10:50.907649 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 562/1088] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:50 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:50.916538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f72ae85-d7ad-410d-b14b-9718eabd36eb tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-321996230", "id": 1106247198, "os-flavor-access:is_public": "False"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:50.918129 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:50.918129 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:50.983514 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f72ae85-d7ad-410d-b14b-9718eabd36eb tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.074691 Jul 20 04:10:51.000728 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 563/1089] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:50 2022] POST /compute/v2.1/flavors => generated 438 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:51.010182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ab2a2ec3-f2a5-4633-afaa-c67a611cfadc tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "14bed34727bc43508d085440b20acdd5"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:51.025433 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:51.025433 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:51.174617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ab2a2ec3-f2a5-4633-afaa-c67a611cfadc tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/1106247198/action" status: 200 len: 97 microversion: 2.1 time: 0.168129 Jul 20 04:10:51.182909 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 564/1090] 10.222.0.59 () {60 vars in 1199 bytes} [Wed Jul 20 04:10:51 2022] POST /compute/v2.1/flavors/1106247198/action => generated 97 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:51.201100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd1ac3da-bb4b-4999-abb8-cc39877a2862 tempest-FlavorsAccessNegativeTestJSON-2059171640 tempest-FlavorsAccessNegativeTestJSON-2059171640-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "14bed34727bc43508d085440b20acdd5"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:51.206211 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:51.206211 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:51.209570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dd1ac3da-bb4b-4999-abb8-cc39877a2862 tempest-FlavorsAccessNegativeTestJSON-2059171640 tempest-FlavorsAccessNegativeTestJSON-2059171640-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '1125e23bb05b46318dad9b0553c9a584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bed34727bc43508d085440b20acdd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd1ac3da-bb4b-4999-abb8-cc39877a2862 tempest-FlavorsAccessNegativeTestJSON-2059171640 tempest-FlavorsAccessNegativeTestJSON-2059171640-project] Request method failure captured: Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/flavors/1106247198/action HTTP/1.1 Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 70 Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14A6XIfunIMqtIrDQ7eQivbpYRlisjC0MXKvU2p6wt2ZaeZAWt1Dm4rZElH6OPln_mAdQAFMoKcY2tgQkPJ05jf5IBo1EubfJTPs1FnDKZFaJ87XCZiBYctnc-ha9-fqR2-ZjCBdWw7Gkj7szrbINSXba4RvaLD8X-UZHofPcP1AAVE Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 14bed34727bc43508d085440b20acdd5 Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2059171640 Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:10:51.212421 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/14bed34727bc43508d085440b20acdd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/14bed34727bc43508d085440b20acdd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/14bed34727bc43508d085440b20acdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_14bed34727bc43508d085440b20acdd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2059171640 Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 14bed34727bc43508d085440b20acdd5 Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2059171640 Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FlavorsAccessNegativeTestJSON-2059171640-project Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 1125e23bb05b46318dad9b0553c9a584 Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2059171640-project Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: {"removeTenantAccess": {"tenant": "14bed34727bc43508d085440b20acdd5"}} Jul 20 04:10:51.213940 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '1106247198', 'body': {'removeTenantAccess': {'tenant': '14bed34727bc43508d085440b20acdd5'}}} Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can( Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:10:51.216665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:10:51.219609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:10:51.223607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd1ac3da-bb4b-4999-abb8-cc39877a2862 tempest-FlavorsAccessNegativeTestJSON-2059171640 tempest-FlavorsAccessNegativeTestJSON-2059171640-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:51.224913 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dd1ac3da-bb4b-4999-abb8-cc39877a2862 tempest-FlavorsAccessNegativeTestJSON-2059171640 tempest-FlavorsAccessNegativeTestJSON-2059171640-project] 10.222.0.59 "POST /compute/v2.1/flavors/1106247198/action" status: 403 len: 133 microversion: 2.1 time: 0.040591 Jul 20 04:10:51.225737 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 565/1091] 10.222.0.59 () {60 vars in 1199 bytes} [Wed Jul 20 04:10:51 2022] POST /compute/v2.1/flavors/1106247198/action => generated 133 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:51.236737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9f354db-0879-4be8-96a7-8563d3be7169 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "14bed34727bc43508d085440b20acdd5"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:51.385714 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9f354db-0879-4be8-96a7-8563d3be7169 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/1106247198/action" status: 200 len: 21 microversion: 2.1 time: 0.153987 Jul 20 04:10:51.398089 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 566/1092] 10.222.0.59 () {60 vars in 1199 bytes} [Wed Jul 20 04:10:51 2022] POST /compute/v2.1/flavors/1106247198/action => generated 21 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:10:51.418397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fcd358c5-bbc4-49c9-a05b-90e29897f1c5 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.421214 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:51.421214 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:51.488909 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fcd358c5-bbc4-49c9-a05b-90e29897f1c5 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1106247198" status: 202 len: 0 microversion: 2.1 time: 0.084532 Jul 20 04:10:51.491380 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 567/1093] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:10:51 2022] DELETE /compute/v2.1/flavors/1106247198 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:51.511997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae313b83-3ae2-45fc-9520-5c07e20f0485 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.516319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ae313b83-3ae2-45fc-9520-5c07e20f0485 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:51.538002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae313b83-3ae2-45fc-9520-5c07e20f0485 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.552547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae313b83-3ae2-45fc-9520-5c07e20f0485 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.558822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae313b83-3ae2-45fc-9520-5c07e20f0485 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.559697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae313b83-3ae2-45fc-9520-5c07e20f0485 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.685570 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ae2bdd0c-b061-4db6-98bf-b4e8d7ff7512 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1646 microversion: 2.1 time: 1.116808 Jul 20 04:10:51.689573 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 527/1094] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:50 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1646 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:51.708936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-54ef4a35-d8d8-49dc-ad14-3f1e5a949a57 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.753869 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-54ef4a35-d8d8-49dc-ad14-3f1e5a949a57 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.061516 Jul 20 04:10:51.766235 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 528/1095] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:51 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:51.785530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf2d780a-794a-4e4f-8618-fc3885b13ee1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:51.788322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cf2d780a-794a-4e4f-8618-fc3885b13ee1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:51.808780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf2d780a-794a-4e4f-8618-fc3885b13ee1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.809527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf2d780a-794a-4e4f-8618-fc3885b13ee1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:51.810520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf2d780a-794a-4e4f-8618-fc3885b13ee1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:51.811111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf2d780a-794a-4e4f-8618-fc3885b13ee1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.171731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cf2d780a-794a-4e4f-8618-fc3885b13ee1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:52.184492 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf2d780a-794a-4e4f-8618-fc3885b13ee1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1378 microversion: 2.1 time: 0.415679 Jul 20 04:10:52.185086 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 529/1096] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:51 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1378 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:52.202196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ebd4a215-4296-4688-8293-b7a95fdea037 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.209920 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:52.209920 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:10:52.214955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ebd4a215-4296-4688-8293-b7a95fdea037 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.216589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ebd4a215-4296-4688-8293-b7a95fdea037 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.219334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ebd4a215-4296-4688-8293-b7a95fdea037 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.221885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ebd4a215-4296-4688-8293-b7a95fdea037 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.297639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae313b83-3ae2-45fc-9520-5c07e20f0485 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:52.307126 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae313b83-3ae2-45fc-9520-5c07e20f0485 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1269 microversion: 2.1 time: 0.811802 Jul 20 04:10:52.328282 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 568/1097] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:51 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1269 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:52.345642 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ebd4a215-4296-4688-8293-b7a95fdea037 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.157757 Jul 20 04:10:52.346584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ecfdd00e-7c78-4fc4-9be2-2fef3cba907c tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1593577479", "id": 67256755, "os-flavor-access:is_public": "False"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:52.349051 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:52.349051 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:10:52.355944 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 530/1098] 10.222.0.59 () {58 vars in 1175 bytes} [Wed Jul 20 04:10:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:52.368818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-60996116-e0d9-4511-96db-899a3932f95f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842205670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.403473 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ecfdd00e-7c78-4fc4-9be2-2fef3cba907c tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.073475 Jul 20 04:10:52.409278 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 569/1099] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:10:52 2022] POST /compute/v2.1/flavors => generated 433 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:10:52.431405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6bc219c0-5161-47ec-901d-fabf895cb964 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:52.433236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6bc219c0-5161-47ec-901d-fabf895cb964 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:52.447572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc219c0-5161-47ec-901d-fabf895cb964 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.449774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc219c0-5161-47ec-901d-fabf895cb964 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.451989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc219c0-5161-47ec-901d-fabf895cb964 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.464674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc219c0-5161-47ec-901d-fabf895cb964 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.505716 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-60996116-e0d9-4511-96db-899a3932f95f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1413 microversion: 2.1 time: 0.143214 Jul 20 04:10:52.507282 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 531/1100] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:52 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1413 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:52.519313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f56a226-d88f-4765-9559-c95521f1baf4 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "804c261a12f84cd2970dafec3f1ff7dc"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:52.531983 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:52.531983 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:10:52.737258 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-0f56a226-d88f-4765-9559-c95521f1baf4 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] HTTP exception thrown: Flavor access not found for 39 / 804c261a12f84cd2970dafec3f1ff7dc combination. Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f56a226-d88f-4765-9559-c95521f1baf4 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Request method failure captured: Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/flavors/67256755/action HTTP/1.1 Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 70 Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14A7YASDi6Fkj10Q1HBHYVitpEvmYW5uZgJ6IcFas-5-Ai8rJM8RAz51S7nORr3RUCXpzRPGUZaPwhAcGvBT-raLHAUToj1xi3-hpKbrLqpwowskZ0Uz6bAU6sHwW9CpUgl1UXaEkgtS1QhWJTy18Ni7cs51CDT91OiGl1Jh7pZVnQs Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 56afb99dc6df41e097fd2194ae68f0da Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-545961111 Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:10:52.752120 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_56afb99dc6df41e097fd2194ae68f0da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-545961111 Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 56afb99dc6df41e097fd2194ae68f0da Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-545961111 Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 13c36d7894784552a65720142af69a17 Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: {"removeTenantAccess": {"tenant": "804c261a12f84cd2970dafec3f1ff7dc"}} Jul 20 04:10:52.753662 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: exception: Flavor access not found for 39 / 804c261a12f84cd2970dafec3f1ff7dc combination. Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '67256755', 'body': {'removeTenantAccess': {'tenant': '804c261a12f84cd2970dafec3f1ff7dc'}}} Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 20 04:10:52.754506 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 804c261a12f84cd2970dafec3f1ff7dc combination. Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 804c261a12f84cd2970dafec3f1ff7dc combination. Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:52.756089 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:10:52.760361 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:10:52.760361 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:10:52.760361 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:10:52.760361 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:10:52.760361 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 804c261a12f84cd2970dafec3f1ff7dc combination. Jul 20 04:10:52.760361 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:10:52.762420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f56a226-d88f-4765-9559-c95521f1baf4 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Returning 404 to user: Flavor access not found for 39 / 804c261a12f84cd2970dafec3f1ff7dc combination. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:10:52.773953 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0f56a226-d88f-4765-9559-c95521f1baf4 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/67256755/action" status: 404 len: 124 microversion: 2.1 time: 0.265326 Jul 20 04:10:52.796893 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 532/1101] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:10:52 2022] POST /compute/v2.1/flavors/67256755/action => generated 124 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:10:52.812871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2feafbad-a843-483d-9cb7-2204618394f1 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.814101 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:10:52.814101 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:10:52.819837 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6bc219c0-5161-47ec-901d-fabf895cb964 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04/action" status: 202 len: 0 microversion: 2.1 time: 0.401642 Jul 20 04:10:52.822769 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 570/1102] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:52 2022] POST /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:52.848654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e88e6cfa-702e-43e2-85f8-16e4b2929128 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.849673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e88e6cfa-702e-43e2-85f8-16e4b2929128 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:52.859395 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2feafbad-a843-483d-9cb7-2204618394f1 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/67256755" status: 202 len: 0 microversion: 2.1 time: 0.060212 Jul 20 04:10:52.868521 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 533/1103] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:10:52 2022] DELETE /compute/v2.1/flavors/67256755 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:10:52.872041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e88e6cfa-702e-43e2-85f8-16e4b2929128 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.872516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e88e6cfa-702e-43e2-85f8-16e4b2929128 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.873333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e88e6cfa-702e-43e2-85f8-16e4b2929128 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:52.873786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e88e6cfa-702e-43e2-85f8-16e4b2929128 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:52.875380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fb3d8a91-0af0-4ce5-86fe-58824483fa41 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:52.916112 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fb3d8a91-0af0-4ce5-86fe-58824483fa41 tempest-FlavorsAccessNegativeTestJSON-545961111 tempest-FlavorsAccessNegativeTestJSON-545961111-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.046045 Jul 20 04:10:52.929502 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 534/1104] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:10:52 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:53.204381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e837c4e9-6f7e-4372-9747-ee417a22bf84 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:53.205406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e837c4e9-6f7e-4372-9747-ee417a22bf84 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:53.217446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e837c4e9-6f7e-4372-9747-ee417a22bf84 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:53.222560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e837c4e9-6f7e-4372-9747-ee417a22bf84 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:53.229290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e837c4e9-6f7e-4372-9747-ee417a22bf84 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:53.230303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e837c4e9-6f7e-4372-9747-ee417a22bf84 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.053255 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e88e6cfa-702e-43e2-85f8-16e4b2929128 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1651 microversion: 2.1 time: 1.221357 Jul 20 04:10:54.058809 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 571/1105] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:52 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1651 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:54.069068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-763872a9-d597-4424-ac6f-a32135f92d7b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:54.075162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-763872a9-d597-4424-ac6f-a32135f92d7b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:54.103529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-763872a9-d597-4424-ac6f-a32135f92d7b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.106188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-763872a9-d597-4424-ac6f-a32135f92d7b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.107728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-763872a9-d597-4424-ac6f-a32135f92d7b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:54.111013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-763872a9-d597-4424-ac6f-a32135f92d7b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:54.374562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-763872a9-d597-4424-ac6f-a32135f92d7b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:54.400045 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-763872a9-d597-4424-ac6f-a32135f92d7b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1275 microversion: 2.1 time: 0.324377 Jul 20 04:10:54.400757 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 572/1106] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:54 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1275 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:54.409383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-338c64db-669a-4df6-910f-3e236aa09a3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841ee10d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:54.415692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e837c4e9-6f7e-4372-9747-ee417a22bf84 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:54.432127 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e837c4e9-6f7e-4372-9747-ee417a22bf84 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1378 microversion: 2.1 time: 1.231341 Jul 20 04:10:54.445210 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 535/1107] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:53 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1378 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:55.075975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8e4aa53f-d9de-4d96-94e4-74b91a93f34e tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:55.076986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8e4aa53f-d9de-4d96-94e4-74b91a93f34e tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:55.097424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e4aa53f-d9de-4d96-94e4-74b91a93f34e tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.097888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e4aa53f-d9de-4d96-94e4-74b91a93f34e tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:55.098801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e4aa53f-d9de-4d96-94e4-74b91a93f34e tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:55.099251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e4aa53f-d9de-4d96-94e4-74b91a93f34e tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.284032 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8e4aa53f-d9de-4d96-94e4-74b91a93f34e tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1631 microversion: 2.1 time: 1.211857 Jul 20 04:10:56.294094 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 536/1108] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:55 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1631 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:56.306376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec5ad922-7c45-4ce5-bcd7-fc3aee04b53e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:56.307354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ec5ad922-7c45-4ce5-bcd7-fc3aee04b53e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:56.364945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec5ad922-7c45-4ce5-bcd7-fc3aee04b53e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.365915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec5ad922-7c45-4ce5-bcd7-fc3aee04b53e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.370645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec5ad922-7c45-4ce5-bcd7-fc3aee04b53e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.374500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec5ad922-7c45-4ce5-bcd7-fc3aee04b53e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.798678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ec5ad922-7c45-4ce5-bcd7-fc3aee04b53e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:56.823251 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec5ad922-7c45-4ce5-bcd7-fc3aee04b53e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1317 microversion: 2.1 time: 0.527128 Jul 20 04:10:56.824858 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 537/1109] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:56 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:56.836363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4c7ff79b-3459-4bc3-b35f-3924fb490ccd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:10:56.837056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4c7ff79b-3459-4bc3-b35f-3924fb490ccd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:56.862025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c7ff79b-3459-4bc3-b35f-3924fb490ccd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.862507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c7ff79b-3459-4bc3-b35f-3924fb490ccd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:56.866801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c7ff79b-3459-4bc3-b35f-3924fb490ccd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:56.867297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c7ff79b-3459-4bc3-b35f-3924fb490ccd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.243770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4c7ff79b-3459-4bc3-b35f-3924fb490ccd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:10:57.256448 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4c7ff79b-3459-4bc3-b35f-3924fb490ccd tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1378 microversion: 2.1 time: 0.426744 Jul 20 04:10:57.257559 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 538/1110] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:10:56 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1378 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:10:57.268403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d133177b-b4cd-404a-b9fb-09021400aa23 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-760456-11", "block_migration": true, "disk_over_commit": false}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:10:57.276131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d133177b-b4cd-404a-b9fb-09021400aa23 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:10:57.288084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d133177b-b4cd-404a-b9fb-09021400aa23 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:57.293512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d133177b-b4cd-404a-b9fb-09021400aa23 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.294388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d133177b-b4cd-404a-b9fb-09021400aa23 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:10:57.294837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d133177b-b4cd-404a-b9fb-09021400aa23 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:10:57.382740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-d133177b-b4cd-404a-b9fb-09021400aa23 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lazy-loading 'flavor' on Instance uuid a23765b5-80ca-4a5d-bd2e-480d92222c04 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:10:57.425721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d133177b-b4cd-404a-b9fb-09021400aa23 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Going to try to live migrate instance to n-h1-760456-11 {{(pid=119605) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:10:58.840940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:00.457606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:00.627352 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d133177b-b4cd-404a-b9fb-09021400aa23 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04/action" status: 202 len: 0 microversion: 2.1 time: 3.368304 Jul 20 04:11:00.629200 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 539/1111] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:10:57 2022] POST /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04/action => generated 0 bytes in 3371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:00.644877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-06107f66-808e-456e-8fda-8bca9db91d49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:00.647169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-06107f66-808e-456e-8fda-8bca9db91d49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:00.684695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06107f66-808e-456e-8fda-8bca9db91d49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:00.699940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06107f66-808e-456e-8fda-8bca9db91d49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:00.704052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06107f66-808e-456e-8fda-8bca9db91d49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:00.711866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06107f66-808e-456e-8fda-8bca9db91d49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.116530 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-338c64db-669a-4df6-910f-3e236aa09a3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1422 microversion: 2.1 time: 6.714486 Jul 20 04:11:01.120418 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 573/1112] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:10:54 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1422 bytes in 6719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:01.753109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3a51179-48d2-4668-8b96-d8815b2c085c tempest-FloatingIPDetailsNegativeTestJSON-460802259 tempest-FloatingIPDetailsNegativeTestJSON-460802259-project] Calling method '.version_select at 0x7fb841e95af0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:01.849193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-d3a51179-48d2-4668-8b96-d8815b2c085c tempest-FloatingIPDetailsNegativeTestJSON-460802259 tempest-FloatingIPDetailsNegativeTestJSON-460802259-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ed3a3b08-cb3c-4489-980b-da6e35d3e9de could not be found", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:11:01.850011 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d3a51179-48d2-4668-8b96-d8815b2c085c tempest-FloatingIPDetailsNegativeTestJSON-460802259 tempest-FloatingIPDetailsNegativeTestJSON-460802259-project] HTTP exception thrown: Floating IP not found for ID ed3a3b08-cb3c-4489-980b-da6e35d3e9de Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3a51179-48d2-4668-8b96-d8815b2c085c tempest-FloatingIPDetailsNegativeTestJSON-460802259 tempest-FloatingIPDetailsNegativeTestJSON-460802259-project] Request method failure captured: Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-floating-ips/ed3a3b08-cb3c-4489-980b-da6e35d3e9de HTTP/1.1 Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14BREjTtCCHcx7Wda6hEyt-w2P2xft9BA5ZJ84S__C2UnB_P4TmTzq8RBJv2PROSx-ymwdfBH9fUMMAaKcKLn3qMWl7W0vBE6DUpqx1gvtl72OG0q7q3TIzuy7qEdrDWud_ME1N_rrwXLifMsEECwWMakmoY3KZk_hqN5VADyiKGYtc Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4230b7fe71c343c4a3e14023e612a921 Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-460802259 Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:01.860212 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4230b7fe71c343c4a3e14023e612a921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4230b7fe71c343c4a3e14023e612a921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4230b7fe71c343c4a3e14023e612a921"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4230b7fe71c343c4a3e14023e612a921"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-460802259 Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4230b7fe71c343c4a3e14023e612a921 Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-460802259 Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-460802259-project Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 159236f90bce4d81add868a5f9b009d8 Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-460802259-project Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: exception: Floating IP not found for ID ed3a3b08-cb3c-4489-980b-da6e35d3e9de Jul 20 04:11:01.861977 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'ed3a3b08-cb3c-4489-980b-da6e35d3e9de'} Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:01.863003 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ed3a3b08-cb3c-4489-980b-da6e35d3e9de could not be found Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ac2890f-ee50-4d5c-aff1-ee8431630ea7'] Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ed3a3b08-cb3c-4489-980b-da6e35d3e9de. Jul 20 04:11:01.864506 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ed3a3b08-cb3c-4489-980b-da6e35d3e9de Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:01.866032 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:01.867518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:01.867518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ed3a3b08-cb3c-4489-980b-da6e35d3e9de Jul 20 04:11:01.867518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:01.869617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3a51179-48d2-4668-8b96-d8815b2c085c tempest-FloatingIPDetailsNegativeTestJSON-460802259 tempest-FloatingIPDetailsNegativeTestJSON-460802259-project] Returning 404 to user: Floating IP not found for ID ed3a3b08-cb3c-4489-980b-da6e35d3e9de {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:01.870773 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d3a51179-48d2-4668-8b96-d8815b2c085c tempest-FloatingIPDetailsNegativeTestJSON-460802259 tempest-FloatingIPDetailsNegativeTestJSON-460802259-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips/ed3a3b08-cb3c-4489-980b-da6e35d3e9de" status: 404 len: 111 microversion: 2.1 time: 0.747615 Jul 20 04:11:01.872063 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 574/1113] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:11:01 2022] GET /compute/v2.1/os-floating-ips/ed3a3b08-cb3c-4489-980b-da6e35d3e9de => generated 111 bytes in 749 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:01.892807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e6b7d469-31de-4427-9a48-5bba7eae399d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:01.893970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e6b7d469-31de-4427-9a48-5bba7eae399d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:01.914211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6b7d469-31de-4427-9a48-5bba7eae399d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:01.914739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6b7d469-31de-4427-9a48-5bba7eae399d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:01.915636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6b7d469-31de-4427-9a48-5bba7eae399d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:01.918204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6b7d469-31de-4427-9a48-5bba7eae399d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.122606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-06107f66-808e-456e-8fda-8bca9db91d49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:02.151498 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-06107f66-808e-456e-8fda-8bca9db91d49 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1317 microversion: 2.1 time: 1.518133 Jul 20 04:11:02.153966 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 540/1114] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:00 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1317 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:02.171600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b6bfac45-4222-417e-93a0-e09cde18b235 req-fe884af1-d34f-4095-8fd5-16f9844026a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1edd260-1e51-4c32-8180-970defd4c4be", "tag": "48ffa109-64f7-4732-8a92-008a26d30eaf"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:02.182765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b6bfac45-4222-417e-93a0-e09cde18b235 req-fe884af1-d34f-4095-8fd5-16f9844026a9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.183533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b6bfac45-4222-417e-93a0-e09cde18b235 req-fe884af1-d34f-4095-8fd5-16f9844026a9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.215143 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b6bfac45-4222-417e-93a0-e09cde18b235 req-fe884af1-d34f-4095-8fd5-16f9844026a9 service nova] Creating event network-changed:48ffa109-64f7-4732-8a92-008a26d30eaf for instance e1edd260-1e51-4c32-8180-970defd4c4be on n-h2-760456-11 Jul 20 04:11:02.223162 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b6bfac45-4222-417e-93a0-e09cde18b235 req-fe884af1-d34f-4095-8fd5-16f9844026a9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057434 Jul 20 04:11:02.224470 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 541/1115] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:02.244984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c17e7bbe-cf77-445e-8bdf-97f5f532eeb5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.250410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c17e7bbe-cf77-445e-8bdf-97f5f532eeb5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:02.264031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:02.272228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c17e7bbe-cf77-445e-8bdf-97f5f532eeb5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.274936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c17e7bbe-cf77-445e-8bdf-97f5f532eeb5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.276176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c17e7bbe-cf77-445e-8bdf-97f5f532eeb5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:02.283637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c17e7bbe-cf77-445e-8bdf-97f5f532eeb5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:02.832307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e6b7d469-31de-4427-9a48-5bba7eae399d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:02.834741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:02.854530 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e6b7d469-31de-4427-9a48-5bba7eae399d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1378 microversion: 2.1 time: 0.980080 Jul 20 04:11:02.875680 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 575/1116] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:01 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1378 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:02.882522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97c2622a-9b7d-4a93-a111-4841d67082e3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841ed4dc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:02.963626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c17e7bbe-cf77-445e-8bdf-97f5f532eeb5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:02.973702 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c17e7bbe-cf77-445e-8bdf-97f5f532eeb5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1503 microversion: 2.1 time: 0.746754 Jul 20 04:11:02.982991 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 542/1117] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:02 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1503 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:02.986944 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97c2622a-9b7d-4a93-a111-4841d67082e3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 200 len: 1422 microversion: 2.1 time: 0.109401 Jul 20 04:11:02.987957 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 576/1118] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:02 2022] GET /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 1422 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:03.003329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-cc3dcf29-3580-4d5e-b047-649cf3961f13 req-fcd6ca4f-0d21-4b51-8948-1e18ad299677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a36a696-8851-4e69-ac90-65e06e37bc2b", "name": "network-vif-plugged", "status": "completed", "tag": "b7b586b2-e4b3-4e30-bff1-a39da550c591"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:03.024693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c1a86cf7-0c68-4f3e-8f3f-d5b47e98216b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841e95c10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:03.036589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cc3dcf29-3580-4d5e-b047-649cf3961f13 req-fcd6ca4f-0d21-4b51-8948-1e18ad299677 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.038658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cc3dcf29-3580-4d5e-b047-649cf3961f13 req-fcd6ca4f-0d21-4b51-8948-1e18ad299677 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:03.080258 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-cc3dcf29-3580-4d5e-b047-649cf3961f13 req-fcd6ca4f-0d21-4b51-8948-1e18ad299677 service nova] Creating event network-vif-plugged:b7b586b2-e4b3-4e30-bff1-a39da550c591 for instance 1a36a696-8851-4e69-ac90-65e06e37bc2b on n-h2-760456-11 Jul 20 04:11:03.092054 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-cc3dcf29-3580-4d5e-b047-649cf3961f13 req-fcd6ca4f-0d21-4b51-8948-1e18ad299677 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107679 Jul 20 04:11:03.117887 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 543/1119] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:03.170272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-331b9e16-ee12-4810-ab15-d1cfd8655e4b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:03.170953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-331b9e16-ee12-4810-ab15-d1cfd8655e4b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:03.185000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-331b9e16-ee12-4810-ab15-d1cfd8655e4b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.185388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-331b9e16-ee12-4810-ab15-d1cfd8655e4b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:03.186186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-331b9e16-ee12-4810-ab15-d1cfd8655e4b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.186649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-331b9e16-ee12-4810-ab15-d1cfd8655e4b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:03.849047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-331b9e16-ee12-4810-ab15-d1cfd8655e4b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:03.870458 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-331b9e16-ee12-4810-ab15-d1cfd8655e4b tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1317 microversion: 2.1 time: 0.704135 Jul 20 04:11:03.874410 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 544/1120] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:03 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:03.907303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-70098b29-ff2e-411f-a68e-87f05160a5dc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:03.907808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-70098b29-ff2e-411f-a68e-87f05160a5dc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:03.944106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70098b29-ff2e-411f-a68e-87f05160a5dc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.944572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70098b29-ff2e-411f-a68e-87f05160a5dc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:03.945376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70098b29-ff2e-411f-a68e-87f05160a5dc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:03.945819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70098b29-ff2e-411f-a68e-87f05160a5dc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.436643 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c1a86cf7-0c68-4f3e-8f3f-d5b47e98216b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 204 len: 0 microversion: 2.1 time: 1.436519 Jul 20 04:11:04.437239 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 577/1121] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:02 2022] DELETE /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 0 bytes in 1438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:04.451230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ed53cdf4-bed8-402c-bd7f-f7459629b7c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:04.451873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ed53cdf4-bed8-402c-bd7f-f7459629b7c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:04.484014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed53cdf4-bed8-402c-bd7f-f7459629b7c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.485011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed53cdf4-bed8-402c-bd7f-f7459629b7c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.486057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed53cdf4-bed8-402c-bd7f-f7459629b7c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.487298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed53cdf4-bed8-402c-bd7f-f7459629b7c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.867934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ed53cdf4-bed8-402c-bd7f-f7459629b7c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:04.878048 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ed53cdf4-bed8-402c-bd7f-f7459629b7c6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1503 microversion: 2.1 time: 0.439745 Jul 20 04:11:04.880987 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 578/1122] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:04 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1503 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:04.892689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86518fa7-dcb0-4210-a3d5-f90d31928816 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:04.894485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-86518fa7-dcb0-4210-a3d5-f90d31928816 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:04.905147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86518fa7-dcb0-4210-a3d5-f90d31928816 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.905619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86518fa7-dcb0-4210-a3d5-f90d31928816 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.916520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86518fa7-dcb0-4210-a3d5-f90d31928816 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:04.916985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86518fa7-dcb0-4210-a3d5-f90d31928816 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:04.921425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-70098b29-ff2e-411f-a68e-87f05160a5dc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:04.945419 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-70098b29-ff2e-411f-a68e-87f05160a5dc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1378 microversion: 2.1 time: 1.062000 Jul 20 04:11:04.951247 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 545/1123] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:03 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1378 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:05.038950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-86518fa7-dcb0-4210-a3d5-f90d31928816 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:11:05.218711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c8651fa-6c15-459e-b8a7-cc8c9e084dc1 tempest-FlavorsV261TestJSON-1164773086 tempest-FlavorsV261TestJSON-1164773086-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-324844634", "id": 1260616605, "os-flavor-access:is_public": "True"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:05.220558 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:05.220558 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:11:05.245328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:DELETE=7 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:05.295091 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c8651fa-6c15-459e-b8a7-cc8c9e084dc1 tempest-FlavorsV261TestJSON-1164773086 tempest-FlavorsV261TestJSON-1164773086-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.339396 Jul 20 04:11:05.306113 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 546/1124] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:11:04 2022] POST /compute/v2.1/flavors => generated 467 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:05.319334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0be47d61-84e8-424d-97f4-46e05eed3bd0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:05.346165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0be47d61-84e8-424d-97f4-46e05eed3bd0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:05.361175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0be47d61-84e8-424d-97f4-46e05eed3bd0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:05.361641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0be47d61-84e8-424d-97f4-46e05eed3bd0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:05.369461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0be47d61-84e8-424d-97f4-46e05eed3bd0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:05.370114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0be47d61-84e8-424d-97f4-46e05eed3bd0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:05.386764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=7 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:05.393791 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-86518fa7-dcb0-4210-a3d5-f90d31928816 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 204 len: 0 microversion: 2.1 time: 0.510522 Jul 20 04:11:05.401422 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 579/1125] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:04 2022] DELETE /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:05.447102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:05.903793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a34a2d85-8746-49e1-b421-c9056cc05cb7 tempest-FlavorsV261TestJSON-1010784747 tempest-FlavorsV261TestJSON-1010784747-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:05.930387 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a34a2d85-8746-49e1-b421-c9056cc05cb7 tempest-FlavorsV261TestJSON-1010784747 tempest-FlavorsV261TestJSON-1010784747-project] 10.222.0.59 "GET /compute/v2.1/flavors/1260616605" status: 200 len: 467 microversion: 2.61 time: 0.527347 Jul 20 04:11:05.931045 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 580/1126] 10.222.0.59 () {60 vars in 1198 bytes} [Wed Jul 20 04:11:05 2022] GET /compute/v2.1/flavors/1260616605 => generated 467 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:05.949468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2135337861", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "8ef25bc8-09e8-4802-9a88-9466c2609da2"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:06.004465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0be47d61-84e8-424d-97f4-46e05eed3bd0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:06.014864 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0be47d61-84e8-424d-97f4-46e05eed3bd0 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1317 microversion: 2.1 time: 0.707255 Jul 20 04:11:06.017903 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 547/1127] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:05 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:06.031858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f70e5f3-97da-4df3-b73b-96663ed3bf10 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:06.032534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8f70e5f3-97da-4df3-b73b-96663ed3bf10 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:06.046023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f70e5f3-97da-4df3-b73b-96663ed3bf10 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:06.056874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f70e5f3-97da-4df3-b73b-96663ed3bf10 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:06.057897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f70e5f3-97da-4df3-b73b-96663ed3bf10 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:06.068426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f70e5f3-97da-4df3-b73b-96663ed3bf10 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:06.132011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] validate_networks() for [('8ef25bc8-09e8-4802-9a88-9466c2609da2', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:07.521280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8f70e5f3-97da-4df3-b73b-96663ed3bf10 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:07.529881 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8f70e5f3-97da-4df3-b73b-96663ed3bf10 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1503 microversion: 2.1 time: 1.510825 Jul 20 04:11:07.530837 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 548/1128] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:06 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1503 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:07.536316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3dcbeeb8-1e4a-4c0e-a635-25118e905d1d tempest-FlavorsV261TestJSON-1164773086 tempest-FlavorsV261TestJSON-1164773086-project-admin] Action: 'update', calling method: .version_select at 0x7fb849127310>, body: {"flavor": {"description": "new"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:07.550421 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:07.550421 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:11:07.604576 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3dcbeeb8-1e4a-4c0e-a635-25118e905d1d tempest-FlavorsV261TestJSON-1164773086 tempest-FlavorsV261TestJSON-1164773086-project-admin] 10.222.0.59 "PUT /compute/v2.1/flavors/1260616605" status: 200 len: 468 microversion: 2.61 time: 0.072422 Jul 20 04:11:07.605550 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 549/1129] 10.222.0.59 () {62 vars in 1218 bytes} [Wed Jul 20 04:11:07 2022] PUT /compute/v2.1/flavors/1260616605 => generated 468 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:11:07.622477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f628aa2-f09a-459c-a1f9-21c53da1fe85 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:07.623412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f628aa2-f09a-459c-a1f9-21c53da1fe85 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:07.632474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:07.632986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:07.633418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:07.633868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:07.634376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:07.635497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f628aa2-f09a-459c-a1f9-21c53da1fe85 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.636490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f628aa2-f09a-459c-a1f9-21c53da1fe85 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.637778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f628aa2-f09a-459c-a1f9-21c53da1fe85 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.639219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f628aa2-f09a-459c-a1f9-21c53da1fe85 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.663772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.664234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.665049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:07.665489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:07.753708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Getting quotas for project d95803bcc72643c995784af8507117b3. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:07.772741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Getting quotas for user 8aad902393614d1fae3d0f5bf5456c06 and project d95803bcc72643c995784af8507117b3. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:07.820245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:07.827601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:08.021226 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8594cf23-f269-4b34-93f3-891b1a0722a8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.075564 Jul 20 04:11:08.030299 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 581/1130] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:08.051788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6e55ce79-7e1e-4b5a-94d1-49225cf91887 req-1ea393b4-ce39-4f30-8f48-ccd374d948f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23765b5-80ca-4a5d-bd2e-480d92222c04", "name": "network-vif-unplugged", "status": "completed", "tag": "40f5fbe1-7bda-48e3-886f-5b7124d37017"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:08.112083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6e55ce79-7e1e-4b5a-94d1-49225cf91887 req-1ea393b4-ce39-4f30-8f48-ccd374d948f4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.112988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6e55ce79-7e1e-4b5a-94d1-49225cf91887 req-1ea393b4-ce39-4f30-8f48-ccd374d948f4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.154860 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6e55ce79-7e1e-4b5a-94d1-49225cf91887 req-1ea393b4-ce39-4f30-8f48-ccd374d948f4 service nova] Creating event network-vif-unplugged:40f5fbe1-7bda-48e3-886f-5b7124d37017 for instance a23765b5-80ca-4a5d-bd2e-480d92222c04 on n-h2-760456-11 Jul 20 04:11:08.165782 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6e55ce79-7e1e-4b5a-94d1-49225cf91887 req-1ea393b4-ce39-4f30-8f48-ccd374d948f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131357 Jul 20 04:11:08.171325 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 582/1131] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:08.198541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3f7cd73b-0031-4263-98eb-6d7e8bcab0a7 req-be07bcc2-8c2c-45e0-b6e5-816544561a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1edd260-1e51-4c32-8180-970defd4c4be", "name": "network-vif-plugged", "status": "completed", "tag": "48ffa109-64f7-4732-8a92-008a26d30eaf"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:08.228186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3f7cd73b-0031-4263-98eb-6d7e8bcab0a7 req-be07bcc2-8c2c-45e0-b6e5-816544561a19 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.238065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3f7cd73b-0031-4263-98eb-6d7e8bcab0a7 req-be07bcc2-8c2c-45e0-b6e5-816544561a19 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.288912 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3f7cd73b-0031-4263-98eb-6d7e8bcab0a7 req-be07bcc2-8c2c-45e0-b6e5-816544561a19 service nova] Creating event network-vif-plugged:48ffa109-64f7-4732-8a92-008a26d30eaf for instance e1edd260-1e51-4c32-8180-970defd4c4be on n-h2-760456-11 Jul 20 04:11:08.304594 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3f7cd73b-0031-4263-98eb-6d7e8bcab0a7 req-be07bcc2-8c2c-45e0-b6e5-816544561a19 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131299 Jul 20 04:11:08.307921 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 583/1132] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:08.326869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cc5b09f0-b631-4011-beec-9c67e2ea13ef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.328100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cc5b09f0-b631-4011-beec-9c67e2ea13ef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:08.359374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc5b09f0-b631-4011-beec-9c67e2ea13ef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.360361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc5b09f0-b631-4011-beec-9c67e2ea13ef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.364895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc5b09f0-b631-4011-beec-9c67e2ea13ef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:08.366928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc5b09f0-b631-4011-beec-9c67e2ea13ef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:08.835127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cc5b09f0-b631-4011-beec-9c67e2ea13ef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:08.849518 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cc5b09f0-b631-4011-beec-9c67e2ea13ef tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1317 microversion: 2.1 time: 0.533378 Jul 20 04:11:08.850402 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 584/1133] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:08.877776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-34d000b8-5561-4873-afc6-816bb3539be8 tempest-FlavorsV261TestJSON-1010784747 tempest-FlavorsV261TestJSON-1010784747-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.921641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5f628aa2-f09a-459c-a1f9-21c53da1fe85 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:08.951098 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f628aa2-f09a-459c-a1f9-21c53da1fe85 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1527 microversion: 2.1 time: 1.344091 Jul 20 04:11:08.960266 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 550/1134] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:07 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1527 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:08.987718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a020e9e0-6c8d-42a8-9dc8-934dac8d3b36 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:08.990485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a020e9e0-6c8d-42a8-9dc8-934dac8d3b36 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:09.010902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-34d000b8-5561-4873-afc6-816bb3539be8 tempest-FlavorsV261TestJSON-1010784747 tempest-FlavorsV261TestJSON-1010784747-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 6777 microversion: 2.61 time: 0.158474 Jul 20 04:11:09.022074 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 585/1135] 10.222.0.59 () {60 vars in 1186 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/flavors/detail => generated 6777 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:09.040289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1625a60c-7c51-4855-95aa-589334977c53 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.048958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1625a60c-7c51-4855-95aa-589334977c53 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:09.085013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1625a60c-7c51-4855-95aa-589334977c53 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.094171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1625a60c-7c51-4855-95aa-589334977c53 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.096089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1625a60c-7c51-4855-95aa-589334977c53 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.096560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1625a60c-7c51-4855-95aa-589334977c53 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.255162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a020e9e0-6c8d-42a8-9dc8-934dac8d3b36 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:09.263104 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a020e9e0-6c8d-42a8-9dc8-934dac8d3b36 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1208 microversion: 2.1 time: 0.300142 Jul 20 04:11:09.275844 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 551/1136] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:08 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1208 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:09.280487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-883bcc6e-1824-4f38-90dc-04272fbea857 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.281108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-883bcc6e-1824-4f38-90dc-04272fbea857 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:09.302489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-883bcc6e-1824-4f38-90dc-04272fbea857 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.302950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-883bcc6e-1824-4f38-90dc-04272fbea857 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.305632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-883bcc6e-1824-4f38-90dc-04272fbea857 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.306300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-883bcc6e-1824-4f38-90dc-04272fbea857 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.668411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1625a60c-7c51-4855-95aa-589334977c53 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:09.683366 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1625a60c-7c51-4855-95aa-589334977c53 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1503 microversion: 2.1 time: 0.652574 Jul 20 04:11:09.692729 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 586/1137] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:09 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1503 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:09.703021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d01153a-439a-4527-a4c9-73c3f71bf73a tempest-FlavorsV261TestJSON-1010784747 tempest-FlavorsV261TestJSON-1010784747-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.716088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-883bcc6e-1824-4f38-90dc-04272fbea857 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:09.730874 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-883bcc6e-1824-4f38-90dc-04272fbea857 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1527 microversion: 2.1 time: 0.457249 Jul 20 04:11:09.731751 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 552/1138] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:09 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1527 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:09.748959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5dc801b4-d586-4138-8758-411e35538e99 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.750474 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:09.750474 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:11:09.752331 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d01153a-439a-4527-a4c9-73c3f71bf73a tempest-FlavorsV261TestJSON-1010784747 tempest-FlavorsV261TestJSON-1010784747-project] 10.222.0.59 "GET /compute/v2.1/flavors" status: 200 len: 3494 microversion: 2.61 time: 0.057104 Jul 20 04:11:09.757357 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 587/1139] 10.222.0.59 () {60 vars in 1165 bytes} [Wed Jul 20 04:11:09 2022] GET /compute/v2.1/flavors => generated 3494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:11:09.766838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e42c007-fb09-4c1a-b8e9-a1a0a8bc6ade tempest-FlavorsV261TestJSON-1164773086 tempest-FlavorsV261TestJSON-1164773086-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.767970 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:09.767970 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:11:09.802385 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e42c007-fb09-4c1a-b8e9-a1a0a8bc6ade tempest-FlavorsV261TestJSON-1164773086 tempest-FlavorsV261TestJSON-1164773086-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1260616605" status: 202 len: 0 microversion: 2.61 time: 0.038122 Jul 20 04:11:09.803721 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 588/1140] 10.222.0.59 () {60 vars in 1201 bytes} [Wed Jul 20 04:11:09 2022] DELETE /compute/v2.1/flavors/1260616605 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:09.811878 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5dc801b4-d586-4138-8758-411e35538e99 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/d58c74e9-1b39-41fd-98a4-32662fbf74ee" status: 202 len: 0 microversion: 2.1 time: 0.067172 Jul 20 04:11:09.814530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8b356d42-d379-4abd-8fbc-8d5e6997572f tempest-FlavorsV261TestJSON-1164773086 tempest-FlavorsV261TestJSON-1164773086-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.817169 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 553/1141] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:09 2022] DELETE /compute/v2.1/flavors/d58c74e9-1b39-41fd-98a4-32662fbf74ee => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:11:09.831905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-44e2260e-b26e-4e7c-b1b2-a96be8e5e220 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.856507 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8b356d42-d379-4abd-8fbc-8d5e6997572f tempest-FlavorsV261TestJSON-1164773086 tempest-FlavorsV261TestJSON-1164773086-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.048163 Jul 20 04:11:09.861561 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 589/1142] 10.222.0.59 () {60 vars in 1186 bytes} [Wed Jul 20 04:11:09 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:11:09.895767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da6aaa3a-38b4-4751-aa98-b1cc22da7baa tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:09.901515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-da6aaa3a-38b4-4751-aa98-b1cc22da7baa tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:09.908739 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-44e2260e-b26e-4e7c-b1b2-a96be8e5e220 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085917 Jul 20 04:11:09.915764 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 554/1143] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:11:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:09.931531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da6aaa3a-38b4-4751-aa98-b1cc22da7baa tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.935227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da6aaa3a-38b4-4751-aa98-b1cc22da7baa tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.937994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da6aaa3a-38b4-4751-aa98-b1cc22da7baa tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.938497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da6aaa3a-38b4-4751-aa98-b1cc22da7baa tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.939065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:09.947011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:09.974496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.979135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:09.981492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:09.985893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.142050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.164713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Old instance type tempest-test_resize_flavor_-402444391, new instance type m1.heat {{(pid=119605) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:11:10.192703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:10.199095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:10.203154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:10.204747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:10.205265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:10.402194 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-965c14d0-efc9-44e3-b8f4-97c4119709ca tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b/action" status: 202 len: 0 microversion: 2.1 time: 0.476603 Jul 20 04:11:10.403988 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 555/1144] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:09 2022] POST /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:10.416335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9a78524f-7284-4d76-97f4-6ea7a037c720 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:10.418977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9a78524f-7284-4d76-97f4-6ea7a037c720 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:10.424983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-da6aaa3a-38b4-4751-aa98-b1cc22da7baa tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.436866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a78524f-7284-4d76-97f4-6ea7a037c720 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.437774 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-da6aaa3a-38b4-4751-aa98-b1cc22da7baa tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1317 microversion: 2.1 time: 0.564952 Jul 20 04:11:10.438207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a78524f-7284-4d76-97f4-6ea7a037c720 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.440020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 590/1145] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:09 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:10.451824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a78524f-7284-4d76-97f4-6ea7a037c720 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.453902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a78524f-7284-4d76-97f4-6ea7a037c720 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.457888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-d21971dd-754a-4ed3-a706-b4f9c5cd5dd6 req-d9764771-5eef-442c-9680-5d4a7828dc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8ba299-71a7-44ca-94d0-574109f98bc2", "name": "network-vif-unplugged", "status": "completed", "tag": "dbd9f7bb-f31e-478b-8b04-2621b3d9428a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:10.472091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d21971dd-754a-4ed3-a706-b4f9c5cd5dd6 req-d9764771-5eef-442c-9680-5d4a7828dc7d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.473552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d21971dd-754a-4ed3-a706-b4f9c5cd5dd6 req-d9764771-5eef-442c-9680-5d4a7828dc7d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.490988 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-d21971dd-754a-4ed3-a706-b4f9c5cd5dd6 req-d9764771-5eef-442c-9680-5d4a7828dc7d service nova] Creating event network-vif-unplugged:dbd9f7bb-f31e-478b-8b04-2621b3d9428a for instance ea8ba299-71a7-44ca-94d0-574109f98bc2 on n-h2-760456-11 Jul 20 04:11:10.496985 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-d21971dd-754a-4ed3-a706-b4f9c5cd5dd6 req-d9764771-5eef-442c-9680-5d4a7828dc7d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050273 Jul 20 04:11:10.498314 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 591/1146] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:10.504040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9854c560-28ca-484f-b0c3-72e7ef813e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:10.506960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9854c560-28ca-484f-b0c3-72e7ef813e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:10.515064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9854c560-28ca-484f-b0c3-72e7ef813e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.516070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9854c560-28ca-484f-b0c3-72e7ef813e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.518765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9854c560-28ca-484f-b0c3-72e7ef813e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.549938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9854c560-28ca-484f-b0c3-72e7ef813e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.813327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9a78524f-7284-4d76-97f4-6ea7a037c720 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:10.827304 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9a78524f-7284-4d76-97f4-6ea7a037c720 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1260 microversion: 2.1 time: 0.419148 Jul 20 04:11:10.839710 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 556/1147] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:10 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1260 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:10.845050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-8842fa0a-2262-48c9-9ad3-324f52369826 req-922a1a88-d284-46d0-82f6-fffaee555939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a23765b5-80ca-4a5d-bd2e-480d92222c04", "tag": "40f5fbe1-7bda-48e3-886f-5b7124d37017"}, {"server_uuid": "ea8ba299-71a7-44ca-94d0-574109f98bc2", "name": "network-vif-deleted", "tag": "dbd9f7bb-f31e-478b-8b04-2621b3d9428a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:10.856029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8842fa0a-2262-48c9-9ad3-324f52369826 req-922a1a88-d284-46d0-82f6-fffaee555939 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.856748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8842fa0a-2262-48c9-9ad3-324f52369826 req-922a1a88-d284-46d0-82f6-fffaee555939 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.876663 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8842fa0a-2262-48c9-9ad3-324f52369826 req-922a1a88-d284-46d0-82f6-fffaee555939 service nova] Creating event network-changed:40f5fbe1-7bda-48e3-886f-5b7124d37017 for instance a23765b5-80ca-4a5d-bd2e-480d92222c04 on n-h2-760456-11 Jul 20 04:11:10.877430 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8842fa0a-2262-48c9-9ad3-324f52369826 req-922a1a88-d284-46d0-82f6-fffaee555939 service nova] Creating event network-vif-deleted:dbd9f7bb-f31e-478b-8b04-2621b3d9428a for instance ea8ba299-71a7-44ca-94d0-574109f98bc2 on n-h2-760456-11 Jul 20 04:11:10.886302 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-8842fa0a-2262-48c9-9ad3-324f52369826 req-922a1a88-d284-46d0-82f6-fffaee555939 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045055 Jul 20 04:11:10.887670 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 557/1148] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:10.893933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1698c9b2-17bb-4d2f-9142-3b99cf0b4a59 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:10.895135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1698c9b2-17bb-4d2f-9142-3b99cf0b4a59 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:10.903885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1698c9b2-17bb-4d2f-9142-3b99cf0b4a59 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.904664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1698c9b2-17bb-4d2f-9142-3b99cf0b4a59 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:10.905738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1698c9b2-17bb-4d2f-9142-3b99cf0b4a59 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:10.906411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1698c9b2-17bb-4d2f-9142-3b99cf0b4a59 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.247171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9854c560-28ca-484f-b0c3-72e7ef813e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:11.267071 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9854c560-28ca-484f-b0c3-72e7ef813e9b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1536 microversion: 2.1 time: 0.763026 Jul 20 04:11:11.267707 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 592/1149] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:10 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1536 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:11.456836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93690e64-cac6-4f81-9f1f-4663bbf5fe4c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:11.461404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-93690e64-cac6-4f81-9f1f-4663bbf5fe4c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:11.485018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93690e64-cac6-4f81-9f1f-4663bbf5fe4c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.496104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93690e64-cac6-4f81-9f1f-4663bbf5fe4c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.497136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93690e64-cac6-4f81-9f1f-4663bbf5fe4c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.497772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93690e64-cac6-4f81-9f1f-4663bbf5fe4c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.844997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1698c9b2-17bb-4d2f-9142-3b99cf0b4a59 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:11.868904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1698c9b2-17bb-4d2f-9142-3b99cf0b4a59 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1503 microversion: 2.1 time: 0.979290 Jul 20 04:11:11.871279 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 558/1150] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:10 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1503 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:11.884070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e7201cb2-a28d-42f2-8535-25567f39c8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:11.884712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e7201cb2-a28d-42f2-8535-25567f39c8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:11.894452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7201cb2-a28d-42f2-8535-25567f39c8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.895290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7201cb2-a28d-42f2-8535-25567f39c8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:11.902624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7201cb2-a28d-42f2-8535-25567f39c8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:11.903930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7201cb2-a28d-42f2-8535-25567f39c8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:12.084788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7201cb2-a28d-42f2-8535-25567f39c8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:12.100857 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e7201cb2-a28d-42f2-8535-25567f39c8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1266 microversion: 2.1 time: 0.223010 Jul 20 04:11:12.102076 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 559/1151] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:11 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:12.295238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ae5fdb93-22d6-40ba-adb5-288419ff50b1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:12.297764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ae5fdb93-22d6-40ba-adb5-288419ff50b1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:12.349271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae5fdb93-22d6-40ba-adb5-288419ff50b1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:12.353277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae5fdb93-22d6-40ba-adb5-288419ff50b1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:12.356292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae5fdb93-22d6-40ba-adb5-288419ff50b1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:12.362453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae5fdb93-22d6-40ba-adb5-288419ff50b1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:12.383558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-93690e64-cac6-4f81-9f1f-4663bbf5fe4c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:12.395477 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-93690e64-cac6-4f81-9f1f-4663bbf5fe4c tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1466 microversion: 2.1 time: 0.942441 Jul 20 04:11:12.396076 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 593/1152] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:11 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1466 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:12.412512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e586670a-71b1-4002-b842-dffad2c630b6 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:12.413158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e586670a-71b1-4002-b842-dffad2c630b6 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:12.433668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e586670a-71b1-4002-b842-dffad2c630b6 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:12.434144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e586670a-71b1-4002-b842-dffad2c630b6 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:12.435054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e586670a-71b1-4002-b842-dffad2c630b6 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:12.435531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e586670a-71b1-4002-b842-dffad2c630b6 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.258691 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e586670a-71b1-4002-b842-dffad2c630b6 tempest-ServersOnMultiNodesTest-1846363292 tempest-ServersOnMultiNodesTest-1846363292-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1619 microversion: 2.1 time: 0.849255 Jul 20 04:11:13.266142 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 594/1153] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:12 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1619 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:13.285047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-948a31e3-6bba-4501-9351-148e6370a931 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:13.295949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-948a31e3-6bba-4501-9351-148e6370a931 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:13.322960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-948a31e3-6bba-4501-9351-148e6370a931 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.324030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-948a31e3-6bba-4501-9351-148e6370a931 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.326764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-948a31e3-6bba-4501-9351-148e6370a931 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.335207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-948a31e3-6bba-4501-9351-148e6370a931 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.360059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ae5fdb93-22d6-40ba-adb5-288419ff50b1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:13.374672 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ae5fdb93-22d6-40ba-adb5-288419ff50b1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1536 microversion: 2.1 time: 1.088598 Jul 20 04:11:13.375498 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 560/1154] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:12 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1536 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:13.421038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-821c5f41-8b3b-4da6-bd6d-dac569c5024b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:13.423515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-821c5f41-8b3b-4da6-bd6d-dac569c5024b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:13.487572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-821c5f41-8b3b-4da6-bd6d-dac569c5024b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.494395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-821c5f41-8b3b-4da6-bd6d-dac569c5024b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:13.498111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-821c5f41-8b3b-4da6-bd6d-dac569c5024b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:13.498864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-821c5f41-8b3b-4da6-bd6d-dac569c5024b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.059425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-948a31e3-6bba-4501-9351-148e6370a931 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:14.075207 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-948a31e3-6bba-4501-9351-148e6370a931 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1503 microversion: 2.1 time: 0.807876 Jul 20 04:11:14.094041 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 595/1155] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:13 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1503 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:14.140247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-821c5f41-8b3b-4da6-bd6d-dac569c5024b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:14.140740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca027440-2420-4e76-829c-f5f4afce0a47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:14.143058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ca027440-2420-4e76-829c-f5f4afce0a47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:14.152109 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-821c5f41-8b3b-4da6-bd6d-dac569c5024b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1308 microversion: 2.1 time: 0.774802 Jul 20 04:11:14.164516 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 561/1156] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:13 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1308 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:14.175208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca027440-2420-4e76-829c-f5f4afce0a47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.175670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca027440-2420-4e76-829c-f5f4afce0a47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.187269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca027440-2420-4e76-829c-f5f4afce0a47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.188996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca027440-2420-4e76-829c-f5f4afce0a47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.293156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ca027440-2420-4e76-829c-f5f4afce0a47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:11:14.394228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9328f60a-0bba-4210-a996-c502d862022b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:14.395719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9328f60a-0bba-4210-a996-c502d862022b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:14.406481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9328f60a-0bba-4210-a996-c502d862022b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.408259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9328f60a-0bba-4210-a996-c502d862022b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.412309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9328f60a-0bba-4210-a996-c502d862022b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.414654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9328f60a-0bba-4210-a996-c502d862022b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.664122 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ca027440-2420-4e76-829c-f5f4afce0a47 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 204 len: 0 microversion: 2.1 time: 0.557597 Jul 20 04:11:14.672554 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 596/1157] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:14 2022] DELETE /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:14.685197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c9adc64f-d567-45ee-845a-8283e7630790 req-6b79ea4b-068b-41fc-b66f-9d203d6e8d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23765b5-80ca-4a5d-bd2e-480d92222c04", "name": "network-vif-unplugged", "status": "completed", "tag": "40f5fbe1-7bda-48e3-886f-5b7124d37017"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:14.717008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c9adc64f-d567-45ee-845a-8283e7630790 req-6b79ea4b-068b-41fc-b66f-9d203d6e8d0a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.717449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c9adc64f-d567-45ee-845a-8283e7630790 req-6b79ea4b-068b-41fc-b66f-9d203d6e8d0a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.764592 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c9adc64f-d567-45ee-845a-8283e7630790 req-6b79ea4b-068b-41fc-b66f-9d203d6e8d0a service nova] Creating event network-vif-unplugged:40f5fbe1-7bda-48e3-886f-5b7124d37017 for instance a23765b5-80ca-4a5d-bd2e-480d92222c04 on n-h2-760456-11 Jul 20 04:11:14.774777 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c9adc64f-d567-45ee-845a-8283e7630790 req-6b79ea4b-068b-41fc-b66f-9d203d6e8d0a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099744 Jul 20 04:11:14.776363 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 597/1158] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:14.787551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e29edbd3-6e7d-4036-9a07-5c93a9417e61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:14.792477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e29edbd3-6e7d-4036-9a07-5c93a9417e61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:14.806024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e29edbd3-6e7d-4036-9a07-5c93a9417e61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.806895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e29edbd3-6e7d-4036-9a07-5c93a9417e61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:14.807950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e29edbd3-6e7d-4036-9a07-5c93a9417e61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:14.808804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e29edbd3-6e7d-4036-9a07-5c93a9417e61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.248673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9328f60a-0bba-4210-a996-c502d862022b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.266150 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9328f60a-0bba-4210-a996-c502d862022b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1536 microversion: 2.1 time: 0.872764 Jul 20 04:11:15.270285 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 562/1159] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:14 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1536 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:15.287093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-161fd19f-275b-4e70-b18b-76734c55de61 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:15.287868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-161fd19f-275b-4e70-b18b-76734c55de61 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:15.296650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-161fd19f-275b-4e70-b18b-76734c55de61 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.297106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-161fd19f-275b-4e70-b18b-76734c55de61 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.297880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-161fd19f-275b-4e70-b18b-76734c55de61 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.298347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-161fd19f-275b-4e70-b18b-76734c55de61 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.603807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e29edbd3-6e7d-4036-9a07-5c93a9417e61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.611678 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e29edbd3-6e7d-4036-9a07-5c93a9417e61 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1472 microversion: 2.1 time: 0.833181 Jul 20 04:11:15.613913 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 598/1160] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:14 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1472 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:15.637799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fefd71c4-c2ca-4ac3-ae1d-ad5855de54f7 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:15.638568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fefd71c4-c2ca-4ac3-ae1d-ad5855de54f7 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:15.680844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fefd71c4-c2ca-4ac3-ae1d-ad5855de54f7 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.694904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fefd71c4-c2ca-4ac3-ae1d-ad5855de54f7 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.698731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fefd71c4-c2ca-4ac3-ae1d-ad5855de54f7 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:15.699158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fefd71c4-c2ca-4ac3-ae1d-ad5855de54f7 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:15.835416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:15.928823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-161fd19f-275b-4e70-b18b-76734c55de61 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:15.949747 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-161fd19f-275b-4e70-b18b-76734c55de61 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1503 microversion: 2.1 time: 0.677719 Jul 20 04:11:15.954883 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 563/1161] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:15 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1503 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:16.131461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2b4c655f-991c-4537-8c20-e2e54d15debf tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Calling method '.version_select at 0x7fb8420bcdc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:16.218001 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2b4c655f-991c-4537-8c20-e2e54d15debf tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297" status: 200 len: 636 microversion: 2.1 time: 0.091588 Jul 20 04:11:16.233832 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 564/1162] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:11:16 2022] GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297 => generated 636 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:16.264176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f592f289-7c6c-42b5-8a11-45087c3649ce tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Action: 'update_all', calling method: .version_select at 0x7fb84226ea60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:16.389822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f592f289-7c6c-42b5-8a11-45087c3649ce tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:16.410674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fefd71c4-c2ca-4ac3-ae1d-ad5855de54f7 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:16.415520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f592f289-7c6c-42b5-8a11-45087c3649ce tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for user f6aa677d78254839a263875c650e6a0f and project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:16.423186 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fefd71c4-c2ca-4ac3-ae1d-ad5855de54f7 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1308 microversion: 2.1 time: 0.807028 Jul 20 04:11:16.426769 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 599/1163] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:15 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1308 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:16.448848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32ce9980-80f2-494d-b774-6a0b1ceddb55 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:16.451601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-32ce9980-80f2-494d-b774-6a0b1ceddb55 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:16.475937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32ce9980-80f2-494d-b774-6a0b1ceddb55 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.477146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32ce9980-80f2-494d-b774-6a0b1ceddb55 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.478148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32ce9980-80f2-494d-b774-6a0b1ceddb55 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:16.478782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32ce9980-80f2-494d-b774-6a0b1ceddb55 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:16.959580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-32ce9980-80f2-494d-b774-6a0b1ceddb55 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:16.977089 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-32ce9980-80f2-494d-b774-6a0b1ceddb55 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1536 microversion: 2.1 time: 0.535070 Jul 20 04:11:16.977724 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 600/1164] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:16 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1536 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:16.997896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2d2d2131-f0a1-45c7-a904-ec842442dae6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:16.998561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2d2d2131-f0a1-45c7-a904-ec842442dae6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:17.025040 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f592f289-7c6c-42b5-8a11-45087c3649ce tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 61 microversion: 2.1 time: 0.784885 Jul 20 04:11:17.030742 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 565/1165] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:11:16 2022] PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 61 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:17.037147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1b21bb4d-9d08-44c0-b19d-4be734fa5cc8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:17.037935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1b21bb4d-9d08-44c0-b19d-4be734fa5cc8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:17.038220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d2d2131-f0a1-45c7-a904-ec842442dae6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.038748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d2d2131-f0a1-45c7-a904-ec842442dae6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.039590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d2d2131-f0a1-45c7-a904-ec842442dae6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.043689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d2d2131-f0a1-45c7-a904-ec842442dae6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.057933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b21bb4d-9d08-44c0-b19d-4be734fa5cc8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.061441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b21bb4d-9d08-44c0-b19d-4be734fa5cc8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.062422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b21bb4d-9d08-44c0-b19d-4be734fa5cc8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:17.067802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b21bb4d-9d08-44c0-b19d-4be734fa5cc8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:17.568694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d2d2131-f0a1-45c7-a904-ec842442dae6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:17.580294 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2d2d2131-f0a1-45c7-a904-ec842442dae6 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1472 microversion: 2.1 time: 0.596138 Jul 20 04:11:17.583195 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 601/1166] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:16 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1472 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:17.608582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26bcf7db-468f-41bc-a6d0-30fcfce70d7b tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Calling method '.version_select at 0x7fb841e95ee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:17.700708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:17.799608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:18.091648 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26bcf7db-468f-41bc-a6d0-30fcfce70d7b tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "DELETE /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.495025 Jul 20 04:11:18.096232 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 602/1167] 10.222.0.59 () {58 vars in 1295 bytes} [Wed Jul 20 04:11:17 2022] DELETE /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata/os_version => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:18.103070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5abc5e04-272d-4b92-a964-395ad90dc7b5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:18.103966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5abc5e04-272d-4b92-a964-395ad90dc7b5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:18.119577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5abc5e04-272d-4b92-a964-395ad90dc7b5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.120372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5abc5e04-272d-4b92-a964-395ad90dc7b5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.121898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5abc5e04-272d-4b92-a964-395ad90dc7b5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:18.122537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5abc5e04-272d-4b92-a964-395ad90dc7b5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:18.730685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5abc5e04-272d-4b92-a964-395ad90dc7b5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:18.744382 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5abc5e04-272d-4b92-a964-395ad90dc7b5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1308 microversion: 2.1 time: 0.646486 Jul 20 04:11:18.745015 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 603/1168] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1308 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:19.019664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c96989f-e0c0-4821-bad3-53fac960740b tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706 tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.021116 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:19.021116 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:11:19.023676 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3c96989f-e0c0-4821-bad3-53fac960740b tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706 tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c96989f-e0c0-4821-bad3-53fac960740b tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706 tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706-project-admin] Request method failure captured: Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14BlW3Iecx1s3-ZtDFk39iWG9V0dD8l43YoND6DHFcrqQG50oBzUMvzhEYL91v9KjTsUwd9e1ZBc376D7j5XRsZnyRaBU6IqezscN0af0dhSRFpb_XQTjImHuCthxXtn2VgJ2YjKtk0AxX6MKWSlqUvNpFoS6qvLgRoCpBhT12zS-ls Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e2a92c109e3842408404c041b12608bc Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706 Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:11:19.042576 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e2a92c109e3842408404c041b12608bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e2a92c109e3842408404c041b12608bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e2a92c109e3842408404c041b12608bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e2a92c109e3842408404c041b12608bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706 Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e2a92c109e3842408404c041b12608bc Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706 Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706-project-admin Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: d692efc2501a4e9ea4434020586898fb Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706-project-admin Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:11:19.044098 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid timestamp for date invalid_time Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'invalid_time'} Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:19.044801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c96989f-e0c0-4821-bad3-53fac960740b tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706 tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:19.048205 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3c96989f-e0c0-4821-bad3-53fac960740b tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706 tempest-InstanceUsageAuditLogNegativeTestJSON-2016202706-project-admin] 10.222.0.59 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.298381 Jul 20 04:11:19.050113 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 604/1169] 10.222.0.59 () {58 vars in 1223 bytes} [Wed Jul 20 04:11:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:11:19.067920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc9e0c42-1322-4958-873e-acf265621607 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.068718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc9e0c42-1322-4958-873e-acf265621607 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.112643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc9e0c42-1322-4958-873e-acf265621607 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.119779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc9e0c42-1322-4958-873e-acf265621607 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.122526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc9e0c42-1322-4958-873e-acf265621607 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.123517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc9e0c42-1322-4958-873e-acf265621607 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.193050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1b21bb4d-9d08-44c0-b19d-4be734fa5cc8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.203559 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1b21bb4d-9d08-44c0-b19d-4be734fa5cc8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1503 microversion: 2.1 time: 2.176163 Jul 20 04:11:19.215646 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 566/1170] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:17 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1503 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:19.220832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b606a8a8-a938-48d1-81c1-84e21db6b37e tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Calling method '.version_select at 0x7fb8420ee0d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.298216 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b606a8a8-a938-48d1-81c1-84e21db6b37e tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 37 microversion: 2.1 time: 0.080672 Jul 20 04:11:19.305457 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 567/1171] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 37 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:19.317669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4239201f-8e4b-4d0a-942f-52fa6bf97c7c req-bf000c47-111f-44dd-8291-fba508938b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ac1ca0-13df-42f1-a6dd-c8f8fcb92340", "tag": "ad5a7fda-bddf-4601-824c-60a7451ad16c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:19.351206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4239201f-8e4b-4d0a-942f-52fa6bf97c7c req-bf000c47-111f-44dd-8291-fba508938b0f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.351965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4239201f-8e4b-4d0a-942f-52fa6bf97c7c req-bf000c47-111f-44dd-8291-fba508938b0f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.390134 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4239201f-8e4b-4d0a-942f-52fa6bf97c7c req-bf000c47-111f-44dd-8291-fba508938b0f service nova] Creating event network-changed:ad5a7fda-bddf-4601-824c-60a7451ad16c for instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 on n-h1-760456-11 Jul 20 04:11:19.403424 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4239201f-8e4b-4d0a-942f-52fa6bf97c7c req-bf000c47-111f-44dd-8291-fba508938b0f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103557 Jul 20 04:11:19.405960 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 568/1172] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:19.412743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.413934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.426919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.427380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.430694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.431156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.543924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.546781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.548653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lazy-loading 'fault' on Instance uuid e1edd260-1e51-4c32-8180-970defd4c4be {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:19.551788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc9e0c42-1322-4958-873e-acf265621607 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.574314 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc9e0c42-1322-4958-873e-acf265621607 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1541 microversion: 2.1 time: 0.527823 Jul 20 04:11:19.577782 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 605/1173] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1541 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:19.733337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.751577 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1f666b8f-7d69-4983-8d4e-1f9022a59529 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 200 len: 1307 microversion: 2.1 time: 0.339970 Jul 20 04:11:19.752507 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 569/1174] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:19.770721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f5632558-31aa-4e4e-9765-4cea02380fb5 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Action: 'update_all', calling method: .version_select at 0x7fb842106280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:19.869550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7f89af6c-9d47-494e-8544-cf13f3af3385 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.870956 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:19.870956 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:11:19.872091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7f89af6c-9d47-494e-8544-cf13f3af3385 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '7e9dc34412344c78ab4a3cfaed4ecbd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053fd39f4d3f4798aa9fba064d9e0f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7f89af6c-9d47-494e-8544-cf13f3af3385 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project] Request method failure captured: Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14BkJde7hFr-ww-0A5M9VbQZXKa1chRAzz0GohqlhpdAC4y1XjzYuLVqsHrlavDV96SZajRTx4TZ0M2Lb1ifqNlPY85kWBijBi3UBR376r5x1KWjJhp3eYsyY8p_CqCgVNPnkkZ0-a0r-w_JIt9sT3etl4REcuuwSXu5_i8V2klf8uM Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 053fd39f4d3f4798aa9fba064d9e0f8a Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:19.873658 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/053fd39f4d3f4798aa9fba064d9e0f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/053fd39f4d3f4798aa9fba064d9e0f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/053fd39f4d3f4798aa9fba064d9e0f8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_053fd39f4d3f4798aa9fba064d9e0f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 053fd39f4d3f4798aa9fba064d9e0f8a Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 7e9dc34412344c78ab4a3cfaed4ecbd8 Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:11:19.875070 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: action_args: {} Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:19.875799 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:19.877203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7f89af6c-9d47-494e-8544-cf13f3af3385 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:19.878299 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7f89af6c-9d47-494e-8544-cf13f3af3385 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project] 10.222.0.59 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.298459 Jul 20 04:11:19.892474 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 606/1175] 10.222.0.59 () {58 vars in 1184 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 314 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:19.898602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0c65ca1-385b-4e3b-85a9-b4975f9014a9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:19.899229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e0c65ca1-385b-4e3b-85a9-b4975f9014a9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:19.904327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f5632558-31aa-4e4e-9765-4cea02380fb5 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:19.914320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f5632558-31aa-4e4e-9765-4cea02380fb5 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for user f6aa677d78254839a263875c650e6a0f and project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:19.936201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0c65ca1-385b-4e3b-85a9-b4975f9014a9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.936667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0c65ca1-385b-4e3b-85a9-b4975f9014a9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:19.946953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0c65ca1-385b-4e3b-85a9-b4975f9014a9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:19.948955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0c65ca1-385b-4e3b-85a9-b4975f9014a9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.618376 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f5632558-31aa-4e4e-9765-4cea02380fb5 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 61 microversion: 2.1 time: 0.864544 Jul 20 04:11:20.623466 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 570/1176] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:11:19 2022] PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 61 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:20.626741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e05fd0f8-04db-47d6-bba5-07d433c2a88e tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.627548 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:11:20.627548 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:11:20.628815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e05fd0f8-04db-47d6-bba5-07d433c2a88e tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '7e9dc34412344c78ab4a3cfaed4ecbd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053fd39f4d3f4798aa9fba064d9e0f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e05fd0f8-04db-47d6-bba5-07d433c2a88e tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project] Request method failure captured: Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004:11:19 HTTP/1.1 Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14BkJde7hFr-ww-0A5M9VbQZXKa1chRAzz0GohqlhpdAC4y1XjzYuLVqsHrlavDV96SZajRTx4TZ0M2Lb1ifqNlPY85kWBijBi3UBR376r5x1KWjJhp3eYsyY8p_CqCgVNPnkkZ0-a0r-w_JIt9sT3etl4REcuuwSXu5_i8V2klf8uM Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 053fd39f4d3f4798aa9fba064d9e0f8a Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:11:20.631339 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/053fd39f4d3f4798aa9fba064d9e0f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/053fd39f4d3f4798aa9fba064d9e0f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/053fd39f4d3f4798aa9fba064d9e0f8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_053fd39f4d3f4798aa9fba064d9e0f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 053fd39f4d3f4798aa9fba064d9e0f8a Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 7e9dc34412344c78ab4a3cfaed4ecbd8 Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:11:20.632714 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '2022-07-20 04:11:19'} Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:20.633397 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:20.635009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e05fd0f8-04db-47d6-bba5-07d433c2a88e tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:20.636075 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e05fd0f8-04db-47d6-bba5-07d433c2a88e tempest-InstanceUsageAuditLogNegativeTestJSON-166420125 tempest-InstanceUsageAuditLogNegativeTestJSON-166420125-project] 10.222.0.59 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20 04:11:19" status: 403 len: 128 microversion: 2.1 time: 0.012453 Jul 20 04:11:20.636075 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 571/1177] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004%3A11%3A19 => generated 128 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:20.652431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2e006a3-349d-4ec5-965e-b301bfb5b0b8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.653057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e2e006a3-349d-4ec5-965e-b301bfb5b0b8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:20.669794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2e006a3-349d-4ec5-965e-b301bfb5b0b8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.670275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2e006a3-349d-4ec5-965e-b301bfb5b0b8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.672889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2e006a3-349d-4ec5-965e-b301bfb5b0b8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.678873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2e006a3-349d-4ec5-965e-b301bfb5b0b8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.726002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:20.909256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e2e006a3-349d-4ec5-965e-b301bfb5b0b8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:20.922752 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e2e006a3-349d-4ec5-965e-b301bfb5b0b8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1478 microversion: 2.1 time: 0.278982 Jul 20 04:11:20.937633 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 572/1178] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1478 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:20.942743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a0bd253e-5634-411b-aaec-26146c59de1e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:20.943361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a0bd253e-5634-411b-aaec-26146c59de1e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:20.950336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0bd253e-5634-411b-aaec-26146c59de1e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.951004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0bd253e-5634-411b-aaec-26146c59de1e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:20.952092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0bd253e-5634-411b-aaec-26146c59de1e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:20.952698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0bd253e-5634-411b-aaec-26146c59de1e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.115678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a0bd253e-5634-411b-aaec-26146c59de1e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:21.126666 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a0bd253e-5634-411b-aaec-26146c59de1e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1541 microversion: 2.1 time: 0.186443 Jul 20 04:11:21.127526 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 573/1179] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:20 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1541 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:21.134087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e772e01-a0e2-418b-88ba-6049e15e2d76 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Calling method '.version_select at 0x7fb842014550>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.135777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e0c65ca1-385b-4e3b-85a9-b4975f9014a9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:21.143867 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0c65ca1-385b-4e3b-85a9-b4975f9014a9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1308 microversion: 2.1 time: 1.250237 Jul 20 04:11:21.145090 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 607/1180] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:19 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1308 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:21.155388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cabc685f-fb2f-4dad-abf8-7f5733722fca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.155388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cabc685f-fb2f-4dad-abf8-7f5733722fca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: e1edd260-1e51-4c32-8180-970defd4c4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:21.180436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cabc685f-fb2f-4dad-abf8-7f5733722fca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.180906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cabc685f-fb2f-4dad-abf8-7f5733722fca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.181719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cabc685f-fb2f-4dad-abf8-7f5733722fca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.182170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cabc685f-fb2f-4dad-abf8-7f5733722fca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.206662 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-cabc685f-fb2f-4dad-abf8-7f5733722fca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] HTTP exception thrown: Instance e1edd260-1e51-4c32-8180-970defd4c4be could not be found. Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cabc685f-fb2f-4dad-abf8-7f5733722fca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Request method failure captured: Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be HTTP/1.1 Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-_SLHHBe8zHgPmumqpGQGpfE5LciA5LXldNSzzRGvnFhq4OGvTsggFhLX1dpz26prLgd5YVZZ1DDpeEElNjiN2Kic4UMQWDkK9PyUhI5m2ZW6wgBdxmxlZyocgT836TvA08u269TeLJRQUTi77wIrvb9rmOJYYGhZeh34fdWej1CU Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:21.208906 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_95231a9d82164f88b1c6ff355679d292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f508838d58f442dd80ab9f1b5b07b4df Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance e1edd260-1e51-4c32-8180-970defd4c4be could not be found. Jul 20 04:11:21.210361 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'e1edd260-1e51-4c32-8180-970defd4c4be'} Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1edd260-1e51-4c32-8180-970defd4c4be could not be found. Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:21.211188 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1edd260-1e51-4c32-8180-970defd4c4be could not be found. Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1edd260-1e51-4c32-8180-970defd4c4be could not be found. Jul 20 04:11:21.212917 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:21.214562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cabc685f-fb2f-4dad-abf8-7f5733722fca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Returning 404 to user: Instance e1edd260-1e51-4c32-8180-970defd4c4be could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:21.214562 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cabc685f-fb2f-4dad-abf8-7f5733722fca tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be" status: 404 len: 111 microversion: 2.1 time: 0.064348 Jul 20 04:11:21.215310 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 608/1181] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/servers/e1edd260-1e51-4c32-8180-970defd4c4be => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:21.221387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b3e1371a-affe-4c17-a726-cc1e7e8680b0 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '.version_select at 0x7fb841e95ee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.227263 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e772e01-a0e2-418b-88ba-6049e15e2d76 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.098423 Jul 20 04:11:21.227853 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 574/1182] 10.222.0.59 () {58 vars in 1289 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata/os_distro => generated 33 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:21.232549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a12ca8d-c2a9-4435-9811-5635912a860e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.233031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3e1371a-affe-4c17-a726-cc1e7e8680b0 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.233554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3e1371a-affe-4c17-a726-cc1e7e8680b0 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.238112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0a12ca8d-c2a9-4435-9811-5635912a860e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:21.245304 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b3e1371a-affe-4c17-a726-cc1e7e8680b0 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 1983 microversion: 2.1 time: 0.028876 Jul 20 04:11:21.256828 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 609/1183] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/os-migrations => generated 1983 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:21.266718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a12ca8d-c2a9-4435-9811-5635912a860e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.268010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b55599f-af72-43d1-bec4-42f340a49be4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Action: 'update_all', calling method: .version_select at 0x7fb841eabf70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:21.272138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a12ca8d-c2a9-4435-9811-5635912a860e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.274690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a12ca8d-c2a9-4435-9811-5635912a860e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.277403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a12ca8d-c2a9-4435-9811-5635912a860e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.354947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4b55599f-af72-43d1-bec4-42f340a49be4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:21.367449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0a12ca8d-c2a9-4435-9811-5635912a860e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:11:21.369333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4b55599f-af72-43d1-bec4-42f340a49be4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for user f6aa677d78254839a263875c650e6a0f and project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:21.605854 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a12ca8d-c2a9-4435-9811-5635912a860e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 204 len: 0 microversion: 2.1 time: 0.376703 Jul 20 04:11:21.608336 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 575/1184] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:21 2022] DELETE /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:21.618100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fd968b64-1319-46cd-8df1-2e9aa93d78f3 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.618856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fd968b64-1319-46cd-8df1-2e9aa93d78f3 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:21.633337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd968b64-1319-46cd-8df1-2e9aa93d78f3 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.633796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd968b64-1319-46cd-8df1-2e9aa93d78f3 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.639190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd968b64-1319-46cd-8df1-2e9aa93d78f3 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.642066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd968b64-1319-46cd-8df1-2e9aa93d78f3 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.837361 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4b55599f-af72-43d1-bec4-42f340a49be4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 61 microversion: 2.1 time: 0.579111 Jul 20 04:11:21.842369 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 610/1185] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:11:21 2022] PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 61 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:21.844832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a66785e6-5829-4294-9235-642c8012db36 req-017722c3-e810-48d0-a88c-176aecb14c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1edd260-1e51-4c32-8180-970defd4c4be", "name": "network-vif-deleted", "tag": "48ffa109-64f7-4732-8a92-008a26d30eaf"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:21.855627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a66785e6-5829-4294-9235-642c8012db36 req-017722c3-e810-48d0-a88c-176aecb14c7c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.856366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a66785e6-5829-4294-9235-642c8012db36 req-017722c3-e810-48d0-a88c-176aecb14c7c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.871554 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a66785e6-5829-4294-9235-642c8012db36 req-017722c3-e810-48d0-a88c-176aecb14c7c service nova] Creating event network-vif-deleted:48ffa109-64f7-4732-8a92-008a26d30eaf for instance e1edd260-1e51-4c32-8180-970defd4c4be on n-h2-760456-11 Jul 20 04:11:21.878181 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a66785e6-5829-4294-9235-642c8012db36 req-017722c3-e810-48d0-a88c-176aecb14c7c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037689 Jul 20 04:11:21.879973 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 611/1186] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:21.885599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb639695-0318-497d-91ed-e32dc3bf57d2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:21.886897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb639695-0318-497d-91ed-e32dc3bf57d2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:21.897229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb639695-0318-497d-91ed-e32dc3bf57d2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.898092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb639695-0318-497d-91ed-e32dc3bf57d2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.899152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb639695-0318-497d-91ed-e32dc3bf57d2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:21.899831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb639695-0318-497d-91ed-e32dc3bf57d2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:21.900766 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fd968b64-1319-46cd-8df1-2e9aa93d78f3 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1631 microversion: 2.1 time: 0.289528 Jul 20 04:11:21.901511 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 576/1187] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1631 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.092425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb639695-0318-497d-91ed-e32dc3bf57d2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:22.104130 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb639695-0318-497d-91ed-e32dc3bf57d2 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1472 microversion: 2.1 time: 0.222554 Jul 20 04:11:22.107740 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 612/1188] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:21 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.115330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3067c608-ac7b-4f3f-900c-4ec03363ff9d tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Calling method '.version_select at 0x7fb841ee4280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.178809 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3067c608-ac7b-4f3f-900c-4ec03363ff9d tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 61 microversion: 2.1 time: 0.069603 Jul 20 04:11:22.180167 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 613/1189] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 61 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:22.189514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e382507e-8f1b-446e-a098-15d194bb878a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Action: 'create', calling method: .version_select at 0x7fb841eab310>, body: {"keypair": {"name": "tempest-keypair-1283323942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKth7Wn9ZRRIn9pLok4q03sFnSipNePIQvOlJ9Gfj6Sk2m06erYFoWbKeeLuAH/Hi8fp/qygG/UhOOQW22w3bJQIrVDE1lhxiUIK71iJsCP8pUV6vb2ycnluubaQlfrO6w=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:22.205001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bc34ed3-db0c-4ed7-a270-1ca91148a59a tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Action: 'create', calling method: .version_select at 0x7fb8420a6a60>, body: {"keypair": {"name": "tempest-keypair-1198835146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtNqsSLn3xEsYVr77e0hF1fIL4u7otBLw0PE8AOVL7ZbuPrfd6OMus/6oF4fSYu0ehDmUue16CHnxW/BX5WKMaB4/rmPf9fSMNgP76e0OAkZQjPPOjLmDGCR9DU8bMx/A=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:22.223362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e382507e-8f1b-446e-a098-15d194bb878a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Getting quotas for project 1ec8a3f7a123436c825135d50dd93865. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:22.229789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e382507e-8f1b-446e-a098-15d194bb878a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Getting quotas for user 04547e35c8c541af914c30e9083cda85 and project 1ec8a3f7a123436c825135d50dd93865. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:22.242666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-6bc34ed3-db0c-4ed7-a270-1ca91148a59a tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Getting quotas for project 4ad9f7ab7fcb4d76a2a6cccc260b7704. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:22.249940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-6bc34ed3-db0c-4ed7-a270-1ca91148a59a tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Getting quotas for user aff983224243430c83b9054014715548 and project 4ad9f7ab7fcb4d76a2a6cccc260b7704. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:22.251152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:22.268085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:22.273273 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e382507e-8f1b-446e-a098-15d194bb878a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091136 Jul 20 04:11:22.274410 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 614/1190] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:11:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:22.279171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5752e151-1003-4892-b47d-bc43c8241c0d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.286722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5752e151-1003-4892-b47d-bc43c8241c0d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.299976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5752e151-1003-4892-b47d-bc43c8241c0d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.300287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5752e151-1003-4892-b47d-bc43c8241c0d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.301834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5752e151-1003-4892-b47d-bc43c8241c0d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.304179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5752e151-1003-4892-b47d-bc43c8241c0d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.313219 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6bc34ed3-db0c-4ed7-a270-1ca91148a59a tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.410479 Jul 20 04:11:22.313729 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 577/1191] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:11:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:22.326415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bee75bca-8f00-4ac2-b69f-e53345fe9631 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:22.327235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bee75bca-8f00-4ac2-b69f-e53345fe9631 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:22.337290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bee75bca-8f00-4ac2-b69f-e53345fe9631 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.339185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bee75bca-8f00-4ac2-b69f-e53345fe9631 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.339185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bee75bca-8f00-4ac2-b69f-e53345fe9631 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:22.340235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bee75bca-8f00-4ac2-b69f-e53345fe9631 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:22.600194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5752e151-1003-4892-b47d-bc43c8241c0d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:22.617555 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5752e151-1003-4892-b47d-bc43c8241c0d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1541 microversion: 2.1 time: 0.341978 Jul 20 04:11:22.618170 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 615/1192] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1541 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:22.624146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d446e008-ee14-4b7f-8436-a7486ce338b4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Action: 'update_all', calling method: .version_select at 0x7fb841ee49d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:22.703934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d446e008-ee14-4b7f-8436-a7486ce338b4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:22.720093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d446e008-ee14-4b7f-8436-a7486ce338b4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for user f6aa677d78254839a263875c650e6a0f and project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:22.853974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bee75bca-8f00-4ac2-b69f-e53345fe9631 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:22.871940 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bee75bca-8f00-4ac2-b69f-e53345fe9631 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1308 microversion: 2.1 time: 0.556853 Jul 20 04:11:22.872736 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 578/1193] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:22 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1308 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:23.125667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b2f48f0-79ca-4587-a476-c26d50e910df tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:23.126570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b2f48f0-79ca-4587-a476-c26d50e910df tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:23.138642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b2f48f0-79ca-4587-a476-c26d50e910df tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.139102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b2f48f0-79ca-4587-a476-c26d50e910df tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.139885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b2f48f0-79ca-4587-a476-c26d50e910df tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.140334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b2f48f0-79ca-4587-a476-c26d50e910df tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.145949 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d446e008-ee14-4b7f-8436-a7486ce338b4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 61 microversion: 2.1 time: 0.526467 Jul 20 04:11:23.146613 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 616/1194] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:11:22 2022] PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 61 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:23.156656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ad57d64e-d44d-4f71-85ce-74e42aaf07e0 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Action: 'update_all', calling method: .version_select at 0x7fb841eee310>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:23.273955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ad57d64e-d44d-4f71-85ce-74e42aaf07e0 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:23.289538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ad57d64e-d44d-4f71-85ce-74e42aaf07e0 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for user f6aa677d78254839a263875c650e6a0f and project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:23.767849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7b2f48f0-79ca-4587-a476-c26d50e910df tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:23.781790 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b2f48f0-79ca-4587-a476-c26d50e910df tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1472 microversion: 2.1 time: 0.660780 Jul 20 04:11:23.782461 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 579/1195] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:23 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1472 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:23.796269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bc215ac7-eaa4-4f51-bdfa-97df6de00476 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:23.797407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bc215ac7-eaa4-4f51-bdfa-97df6de00476 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:23.818912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc215ac7-eaa4-4f51-bdfa-97df6de00476 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.819381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc215ac7-eaa4-4f51-bdfa-97df6de00476 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:23.820182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc215ac7-eaa4-4f51-bdfa-97df6de00476 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:23.822518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc215ac7-eaa4-4f51-bdfa-97df6de00476 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.057835 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ad57d64e-d44d-4f71-85ce-74e42aaf07e0 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 64 microversion: 2.1 time: 0.905247 Jul 20 04:11:24.059166 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 617/1196] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:11:23 2022] PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 64 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:11:24.066282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d07a8e61-9d43-44b9-b35e-922f310e4957 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:24.067329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d07a8e61-9d43-44b9-b35e-922f310e4957 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:24.080538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d07a8e61-9d43-44b9-b35e-922f310e4957 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.081011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d07a8e61-9d43-44b9-b35e-922f310e4957 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.083029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d07a8e61-9d43-44b9-b35e-922f310e4957 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.083812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d07a8e61-9d43-44b9-b35e-922f310e4957 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.228136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc215ac7-eaa4-4f51-bdfa-97df6de00476 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:24.249022 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bc215ac7-eaa4-4f51-bdfa-97df6de00476 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1541 microversion: 2.1 time: 0.463843 Jul 20 04:11:24.252199 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 580/1197] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:23 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1541 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:24.262273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3bda656-6096-4d13-b76d-5d13ec6605c4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Calling method '.version_select at 0x7fb84204d160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:24.370460 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f3bda656-6096-4d13-b76d-5d13ec6605c4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 64 microversion: 2.1 time: 0.116782 Jul 20 04:11:24.371760 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 581/1198] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:11:24 2022] GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 64 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:24.384664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-db767484-7238-4364-aa86-9d586b2f93ab tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Action: 'update_all', calling method: .version_select at 0x7fb8420ee160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:24.491604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-db767484-7238-4364-aa86-9d586b2f93ab tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:24.507070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-db767484-7238-4364-aa86-9d586b2f93ab tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for user f6aa677d78254839a263875c650e6a0f and project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:24.710773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d07a8e61-9d43-44b9-b35e-922f310e4957 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:24.738683 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d07a8e61-9d43-44b9-b35e-922f310e4957 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1308 microversion: 2.1 time: 0.674286 Jul 20 04:11:24.739389 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 618/1199] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:24 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1308 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:24.789510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3bdcb94a-b8d9-4251-9c31-5c1c1111bf8b req-08136efd-ae19-4eb6-95e2-1e4a037a60e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab536ec-6bd0-4380-b23c-56154cfafbad", "name": "network-vif-deleted", "tag": "873e2fdf-83fa-49db-a423-2fcca74c2a46"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:24.821902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3bdcb94a-b8d9-4251-9c31-5c1c1111bf8b req-08136efd-ae19-4eb6-95e2-1e4a037a60e7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.830846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3bdcb94a-b8d9-4251-9c31-5c1c1111bf8b req-08136efd-ae19-4eb6-95e2-1e4a037a60e7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.888905 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3bdcb94a-b8d9-4251-9c31-5c1c1111bf8b req-08136efd-ae19-4eb6-95e2-1e4a037a60e7 service nova] Creating event network-vif-deleted:873e2fdf-83fa-49db-a423-2fcca74c2a46 for instance 1ab536ec-6bd0-4380-b23c-56154cfafbad on n-h1-760456-11 Jul 20 04:11:24.907622 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3bdcb94a-b8d9-4251-9c31-5c1c1111bf8b req-08136efd-ae19-4eb6-95e2-1e4a037a60e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122985 Jul 20 04:11:24.913177 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 619/1200] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:24.931970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:24.944395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:24.968451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.968915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:24.972947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:24.989863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.102736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.110782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.111532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lazy-loading 'fault' on Instance uuid 1ab536ec-6bd0-4380-b23c-56154cfafbad {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:25.218207 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-db767484-7238-4364-aa86-9d586b2f93ab tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 61 microversion: 2.1 time: 0.841260 Jul 20 04:11:25.219437 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 582/1201] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:11:24 2022] PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 61 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:11:25.232807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d1dd1a9d-19f5-427c-a668-20c0c2951721 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Action: 'update', calling method: .version_select at 0x7fb84206a310>, body: {"meta": {"os_version": "alt"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:25.334183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d1dd1a9d-19f5-427c-a668-20c0c2951721 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:25.359579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d1dd1a9d-19f5-427c-a668-20c0c2951721 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for user f6aa677d78254839a263875c650e6a0f and project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:25.459094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:25.473204 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ab879787-c2f6-4bf0-945e-7c02ae4b73ec tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 200 len: 1307 microversion: 2.1 time: 0.558198 Jul 20 04:11:25.477589 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 620/1202] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:24 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 1307 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:25.501198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bfb0e80b-1a95-4e8b-b270-f929f3a0d390 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:25.501846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bfb0e80b-1a95-4e8b-b270-f929f3a0d390 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:25.510941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfb0e80b-1a95-4e8b-b270-f929f3a0d390 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.511916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfb0e80b-1a95-4e8b-b270-f929f3a0d390 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.512913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfb0e80b-1a95-4e8b-b270-f929f3a0d390 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:25.513557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfb0e80b-1a95-4e8b-b270-f929f3a0d390 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:25.968156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bfb0e80b-1a95-4e8b-b270-f929f3a0d390 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:25.979062 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d1dd1a9d-19f5-427c-a668-20c0c2951721 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.753474 Jul 20 04:11:25.980873 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 583/1203] 10.222.0.59 () {60 vars in 1312 bytes} [Wed Jul 20 04:11:25 2022] PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata/os_version => generated 31 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:11:25.983873 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bfb0e80b-1a95-4e8b-b270-f929f3a0d390 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1541 microversion: 2.1 time: 0.503432 Jul 20 04:11:25.989124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36d1a1ce-1b3e-481a-810e-4964ad6365bd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:25.990456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-36d1a1ce-1b3e-481a-810e-4964ad6365bd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:25.995181 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 621/1204] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:25 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1541 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:26.007406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0eeed911-d73d-43fb-a937-5f6b570b83fa tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Calling method '.version_select at 0x7fb8421630d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:26.007637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36d1a1ce-1b3e-481a-810e-4964ad6365bd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.008223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36d1a1ce-1b3e-481a-810e-4964ad6365bd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.014549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36d1a1ce-1b3e-481a-810e-4964ad6365bd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.015390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36d1a1ce-1b3e-481a-810e-4964ad6365bd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.103577 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0eeed911-d73d-43fb-a937-5f6b570b83fa tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 58 microversion: 2.1 time: 0.106475 Jul 20 04:11:26.104400 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 622/1205] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:11:25 2022] GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 58 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:26.115817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db18c89e-f317-4158-99e6-a9b80a6acad4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Action: 'update_all', calling method: .version_select at 0x7fb841e4a430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:26.193470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-db18c89e-f317-4158-99e6-a9b80a6acad4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:26.199661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-db18c89e-f317-4158-99e6-a9b80a6acad4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for user f6aa677d78254839a263875c650e6a0f and project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:26.425571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-36d1a1ce-1b3e-481a-810e-4964ad6365bd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:26.441828 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-36d1a1ce-1b3e-481a-810e-4964ad6365bd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1308 microversion: 2.1 time: 0.456289 Jul 20 04:11:26.442793 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 584/1206] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:25 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:26.494864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3d05626-1448-466d-8942-a4a5c9475717 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:26.495707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d3d05626-1448-466d-8942-a4a5c9475717 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 1ab536ec-6bd0-4380-b23c-56154cfafbad] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:26.508571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3d05626-1448-466d-8942-a4a5c9475717 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.509289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3d05626-1448-466d-8942-a4a5c9475717 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.514605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3d05626-1448-466d-8942-a4a5c9475717 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.515327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3d05626-1448-466d-8942-a4a5c9475717 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.554592 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-d3d05626-1448-466d-8942-a4a5c9475717 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] HTTP exception thrown: Instance 1ab536ec-6bd0-4380-b23c-56154cfafbad could not be found. Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3d05626-1448-466d-8942-a4a5c9475717 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Request method failure captured: Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad HTTP/1.1 Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-_SLHHBe8zHgPmumqpGQGpfE5LciA5LXldNSzzRGvnFhq4OGvTsggFhLX1dpz26prLgd5YVZZ1DDpeEElNjiN2Kic4UMQWDkK9PyUhI5m2ZW6wgBdxmxlZyocgT836TvA08u269TeLJRQUTi77wIrvb9rmOJYYGhZeh34fdWej1CU Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:11:26.559695 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_95231a9d82164f88b1c6ff355679d292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f508838d58f442dd80ab9f1b5b07b4df Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 1ab536ec-6bd0-4380-b23c-56154cfafbad could not be found. Jul 20 04:11:26.561148 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1ab536ec-6bd0-4380-b23c-56154cfafbad'} Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ab536ec-6bd0-4380-b23c-56154cfafbad could not be found. Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:26.561958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ab536ec-6bd0-4380-b23c-56154cfafbad could not be found. Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ab536ec-6bd0-4380-b23c-56154cfafbad could not be found. Jul 20 04:11:26.563315 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:26.568514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3d05626-1448-466d-8942-a4a5c9475717 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Returning 404 to user: Instance 1ab536ec-6bd0-4380-b23c-56154cfafbad could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:26.572675 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d3d05626-1448-466d-8942-a4a5c9475717 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad" status: 404 len: 111 microversion: 2.1 time: 0.083248 Jul 20 04:11:26.574469 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 585/1207] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:26 2022] GET /compute/v2.1/servers/1ab536ec-6bd0-4380-b23c-56154cfafbad => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:26.591180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-479a4aaf-1030-4fb7-a856-93a5543db05d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:26.591696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-479a4aaf-1030-4fb7-a856-93a5543db05d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:26.598610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-479a4aaf-1030-4fb7-a856-93a5543db05d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.599061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-479a4aaf-1030-4fb7-a856-93a5543db05d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.600002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-479a4aaf-1030-4fb7-a856-93a5543db05d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.600504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-479a4aaf-1030-4fb7-a856-93a5543db05d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.629971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-479a4aaf-1030-4fb7-a856-93a5543db05d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:11:26.672998 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-db18c89e-f317-4158-99e6-a9b80a6acad4 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 61 microversion: 2.1 time: 0.561798 Jul 20 04:11:26.673789 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 623/1208] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:11:26 2022] PUT /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 61 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:11:26.684726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-116da212-5aba-4754-8b14-e9f7c1036158 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Action: 'create', calling method: .version_select at 0x7fb841e76820>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:26.760821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-116da212-5aba-4754-8b14-e9f7c1036158 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:26.768045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-116da212-5aba-4754-8b14-e9f7c1036158 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Getting quotas for user f6aa677d78254839a263875c650e6a0f and project 03830805847f4ab5a8338ca9b32b2fb0. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:26.769891 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-479a4aaf-1030-4fb7-a856-93a5543db05d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 204 len: 0 microversion: 2.1 time: 0.188413 Jul 20 04:11:26.772609 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 586/1209] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:26 2022] DELETE /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:26.781188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6936cdc-26c9-4515-b98f-5ca14f7c1667 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:26.782105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6936cdc-26c9-4515-b98f-5ca14f7c1667 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:26.789053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6936cdc-26c9-4515-b98f-5ca14f7c1667 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.789515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6936cdc-26c9-4515-b98f-5ca14f7c1667 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:26.790431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6936cdc-26c9-4515-b98f-5ca14f7c1667 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:26.790878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6936cdc-26c9-4515-b98f-5ca14f7c1667 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.086416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f6936cdc-26c9-4515-b98f-5ca14f7c1667 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:27.099584 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6936cdc-26c9-4515-b98f-5ca14f7c1667 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1471 microversion: 2.1 time: 0.320195 Jul 20 04:11:27.118648 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 587/1210] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:26 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:27.138499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-fe9914de-232b-4f19-8074-213e48232200 req-f375f0a2-136c-49d3-98ac-84ac8e797a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ac1ca0-13df-42f1-a6dd-c8f8fcb92340", "name": "network-vif-plugged", "status": "completed", "tag": "ad5a7fda-bddf-4601-824c-60a7451ad16c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:27.165111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fe9914de-232b-4f19-8074-213e48232200 req-f375f0a2-136c-49d3-98ac-84ac8e797a89 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.165670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fe9914de-232b-4f19-8074-213e48232200 req-f375f0a2-136c-49d3-98ac-84ac8e797a89 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.196107 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-fe9914de-232b-4f19-8074-213e48232200 req-f375f0a2-136c-49d3-98ac-84ac8e797a89 service nova] Creating event network-vif-plugged:ad5a7fda-bddf-4601-824c-60a7451ad16c for instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 on n-h1-760456-11 Jul 20 04:11:27.201868 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-fe9914de-232b-4f19-8074-213e48232200 req-f375f0a2-136c-49d3-98ac-84ac8e797a89 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081550 Jul 20 04:11:27.203006 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 588/1211] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:27.211802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3372e09-b71b-4f7a-bace-f41dae89ce02 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:27.213475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e3372e09-b71b-4f7a-bace-f41dae89ce02 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:27.222064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3372e09-b71b-4f7a-bace-f41dae89ce02 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.223337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3372e09-b71b-4f7a-bace-f41dae89ce02 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.224520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3372e09-b71b-4f7a-bace-f41dae89ce02 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.225299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3372e09-b71b-4f7a-bace-f41dae89ce02 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.234382 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-116da212-5aba-4754-8b14-e9f7c1036158 tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "POST /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 85 microversion: 2.1 time: 0.554983 Jul 20 04:11:27.240178 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 624/1212] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Jul 20 04:11:26 2022] POST /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 85 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:11:27.249073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5acc9cfb-4fe6-4e06-80f3-c42373cfce9c tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] Calling method '.version_select at 0x7fb841e4ae50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:27.304839 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5acc9cfb-4fe6-4e06-80f3-c42373cfce9c tempest-ImagesMetadataTestJSON-799977225 tempest-ImagesMetadataTestJSON-799977225-project] 10.222.0.59 "GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata" status: 200 len: 85 microversion: 2.1 time: 0.062347 Jul 20 04:11:27.305431 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 625/1213] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:11:27 2022] GET /compute/v2.1/images/1fabe10f-d2e3-44f6-a709-b8069cbe9297/metadata => generated 85 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:11:27.463743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-05d938cc-2699-4f20-bb25-9444e64898b0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:27.464679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-05d938cc-2699-4f20-bb25-9444e64898b0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:27.612043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3372e09-b71b-4f7a-bace-f41dae89ce02 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:27.627065 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e3372e09-b71b-4f7a-bace-f41dae89ce02 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1541 microversion: 2.1 time: 0.421756 Jul 20 04:11:27.627736 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 589/1214] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:27 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1541 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:27.814005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1783874798", "imageRef": "7f596617-7183-4656-84cb-8a7e0696a9d4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "969770b9-8e9f-4414-9402-320ec6a95afc"}], "security_groups": [{"name": "tempest-securitygroup--1833832500"}], "key_name": "tempest-keypair-1198835146", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:27.932026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05d938cc-2699-4f20-bb25-9444e64898b0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.932712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05d938cc-2699-4f20-bb25-9444e64898b0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:27.933701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05d938cc-2699-4f20-bb25-9444e64898b0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:27.934391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05d938cc-2699-4f20-bb25-9444e64898b0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:28.423340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] validate_networks() for [('969770b9-8e9f-4414-9402-320ec6a95afc', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:28.446388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-05d938cc-2699-4f20-bb25-9444e64898b0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:28.462530 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-05d938cc-2699-4f20-bb25-9444e64898b0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1308 microversion: 2.1 time: 1.007107 Jul 20 04:11:28.463944 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 626/1215] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:27 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1308 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:28.472022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1239841166", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "aca274f9-d664-47a2-aeef-a3985bda5141"}], "security_groups": [{"name": "tempest-securitygroup--238856435"}], "key_name": "tempest-keypair-1283323942", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:28.768129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] validate_networks() for [('aca274f9-d664-47a2-aeef-a3985bda5141', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:11:30.007901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:30.009743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:30.010621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:30.011298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:30.011877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:30.023157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.023995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.025194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.027918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.057201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Getting quotas for project 4ad9f7ab7fcb4d76a2a6cccc260b7704. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:30.065226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Getting quotas for user aff983224243430c83b9054014715548 and project 4ad9f7ab7fcb4d76a2a6cccc260b7704. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:30.087466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:30.090733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f596617-7183-4656-84cb-8a7e0696a9d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:30.203253 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aeb08ba2-a2de-402e-a678-a52d5b3011ef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.390816 Jul 20 04:11:30.205358 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 590/1216] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:30.212045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:11:30.212583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:11:30.213294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:11:30.213723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:11:30.214148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:11:30.217774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-369b9404-9727-45f7-904d-4c37c95665e1 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:30.221073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-369b9404-9727-45f7-904d-4c37c95665e1 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:30.236752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.237295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.238772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.239284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.241319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-369b9404-9727-45f7-904d-4c37c95665e1 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.244451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-369b9404-9727-45f7-904d-4c37c95665e1 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.245460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-369b9404-9727-45f7-904d-4c37c95665e1 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.247893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-369b9404-9727-45f7-904d-4c37c95665e1 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.312682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Getting quotas for project 1ec8a3f7a123436c825135d50dd93865. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:30.343642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Getting quotas for user 04547e35c8c541af914c30e9083cda85 and project 1ec8a3f7a123436c825135d50dd93865. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:30.398746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:11:30.401110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:11:30.541923 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea7a876b-6fef-4273-bdc2-1b5cf74ba555 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.076450 Jul 20 04:11:30.542601 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 627/1217] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:11:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:11:30.563164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2385162f-0a4d-42e7-b62c-22b454ec1555 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:30.568663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2385162f-0a4d-42e7-b62c-22b454ec1555 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:30.589241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2385162f-0a4d-42e7-b62c-22b454ec1555 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.589720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2385162f-0a4d-42e7-b62c-22b454ec1555 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.590560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2385162f-0a4d-42e7-b62c-22b454ec1555 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:30.591015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2385162f-0a4d-42e7-b62c-22b454ec1555 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:30.954451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-369b9404-9727-45f7-904d-4c37c95665e1 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:30.967165 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-369b9404-9727-45f7-904d-4c37c95665e1 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 200 len: 1471 microversion: 2.1 time: 0.758730 Jul 20 04:11:30.967743 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 591/1218] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:30 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 1471 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:30.985235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ce1c3093-fbfd-43ab-9907-e5a8e6322948 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:30.987560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ce1c3093-fbfd-43ab-9907-e5a8e6322948 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:31.017352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce1c3093-fbfd-43ab-9907-e5a8e6322948 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.019554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce1c3093-fbfd-43ab-9907-e5a8e6322948 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.024095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce1c3093-fbfd-43ab-9907-e5a8e6322948 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.029668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce1c3093-fbfd-43ab-9907-e5a8e6322948 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.479999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2385162f-0a4d-42e7-b62c-22b454ec1555 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:31.491360 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2385162f-0a4d-42e7-b62c-22b454ec1555 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1541 microversion: 2.1 time: 0.943222 Jul 20 04:11:31.492535 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 628/1219] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:30 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1541 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:31.519602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2b9ae30b-29bb-4c83-93d9-c53db66ffc4c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:31.520946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2b9ae30b-29bb-4c83-93d9-c53db66ffc4c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:31.540800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b9ae30b-29bb-4c83-93d9-c53db66ffc4c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.541618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b9ae30b-29bb-4c83-93d9-c53db66ffc4c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.552152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b9ae30b-29bb-4c83-93d9-c53db66ffc4c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.552867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b9ae30b-29bb-4c83-93d9-c53db66ffc4c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.783170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ce1c3093-fbfd-43ab-9907-e5a8e6322948 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:31.795310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:31.811254 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ce1c3093-fbfd-43ab-9907-e5a8e6322948 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1488 microversion: 2.1 time: 0.833143 Jul 20 04:11:31.812422 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 592/1220] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:30 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1488 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:31.820166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7e1a8ea7-2a93-4611-8249-c7a6e80aa580 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:31.821130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7e1a8ea7-2a93-4611-8249-c7a6e80aa580 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:31.829737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e1a8ea7-2a93-4611-8249-c7a6e80aa580 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.830574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e1a8ea7-2a93-4611-8249-c7a6e80aa580 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.831687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e1a8ea7-2a93-4611-8249-c7a6e80aa580 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.832479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e1a8ea7-2a93-4611-8249-c7a6e80aa580 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:31.874065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2b9ae30b-29bb-4c83-93d9-c53db66ffc4c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:31.894104 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2b9ae30b-29bb-4c83-93d9-c53db66ffc4c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1250 microversion: 2.1 time: 0.395512 Jul 20 04:11:31.894104 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 629/1221] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:31 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1250 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:31.914666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6182bac1-7deb-461c-90f9-039abbe2eda1 req-a822d01a-753c-453e-93f4-681d7a7f7305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec4b278f-a380-46e4-8d3f-216258883086", "name": "network-vif-deleted", "tag": "8c4921df-07be-4e19-a80a-939084fe95a2"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:31.963880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6182bac1-7deb-461c-90f9-039abbe2eda1 req-a822d01a-753c-453e-93f4-681d7a7f7305 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:31.966088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6182bac1-7deb-461c-90f9-039abbe2eda1 req-a822d01a-753c-453e-93f4-681d7a7f7305 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.001234 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6182bac1-7deb-461c-90f9-039abbe2eda1 req-a822d01a-753c-453e-93f4-681d7a7f7305 service nova] Creating event network-vif-deleted:8c4921df-07be-4e19-a80a-939084fe95a2 for instance ec4b278f-a380-46e4-8d3f-216258883086 on n-h1-760456-11 Jul 20 04:11:32.012364 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6182bac1-7deb-461c-90f9-039abbe2eda1 req-a822d01a-753c-453e-93f4-681d7a7f7305 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114696 Jul 20 04:11:32.013562 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 630/1222] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:32.029042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-afaf5a72-e476-4e16-9210-d1bc5e9cfb5e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:32.042014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-afaf5a72-e476-4e16-9210-d1bc5e9cfb5e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.042843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-afaf5a72-e476-4e16-9210-d1bc5e9cfb5e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.178981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7e1a8ea7-2a93-4611-8249-c7a6e80aa580 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:32.189556 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7e1a8ea7-2a93-4611-8249-c7a6e80aa580 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1239 microversion: 2.1 time: 0.375401 Jul 20 04:11:32.190157 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 593/1223] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:31 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1239 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:32.214824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8675862e-09d4-46bd-82e2-078261082d96 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.215632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8675862e-09d4-46bd-82e2-078261082d96 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: ec4b278f-a380-46e4-8d3f-216258883086] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.235816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8675862e-09d4-46bd-82e2-078261082d96 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.247029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8675862e-09d4-46bd-82e2-078261082d96 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.248809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8675862e-09d4-46bd-82e2-078261082d96 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.249465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8675862e-09d4-46bd-82e2-078261082d96 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.293354 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8675862e-09d4-46bd-82e2-078261082d96 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] HTTP exception thrown: Instance ec4b278f-a380-46e4-8d3f-216258883086 could not be found. Jul 20 04:11:32.293866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-afaf5a72-e476-4e16-9210-d1bc5e9cfb5e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Going to try to stop instance {{(pid=119606) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:11:32.303066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8675862e-09d4-46bd-82e2-078261082d96 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Request method failure captured: Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 HTTP/1.1 Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-_SLHHBe8zHgPmumqpGQGpfE5LciA5LXldNSzzRGvnFhq4OGvTsggFhLX1dpz26prLgd5YVZZ1DDpeEElNjiN2Kic4UMQWDkK9PyUhI5m2ZW6wgBdxmxlZyocgT836TvA08u269TeLJRQUTi77wIrvb9rmOJYYGhZeh34fdWej1CU Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:11:32.305599 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_95231a9d82164f88b1c6ff355679d292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f508838d58f442dd80ab9f1b5b07b4df Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance ec4b278f-a380-46e4-8d3f-216258883086 could not be found. Jul 20 04:11:32.307353 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'ec4b278f-a380-46e4-8d3f-216258883086'} Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec4b278f-a380-46e4-8d3f-216258883086 could not be found. Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:32.308217 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec4b278f-a380-46e4-8d3f-216258883086 could not be found. Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec4b278f-a380-46e4-8d3f-216258883086 could not be found. Jul 20 04:11:32.309459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:32.310622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8675862e-09d4-46bd-82e2-078261082d96 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Returning 404 to user: Instance ec4b278f-a380-46e4-8d3f-216258883086 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:32.310622 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8675862e-09d4-46bd-82e2-078261082d96 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086" status: 404 len: 111 microversion: 2.1 time: 0.112744 Jul 20 04:11:32.310622 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 594/1224] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/ec4b278f-a380-46e4-8d3f-216258883086 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:32.368151 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-afaf5a72-e476-4e16-9210-d1bc5e9cfb5e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340/action" status: 202 len: 0 microversion: 2.1 time: 0.352388 Jul 20 04:11:32.368796 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 631/1225] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:32 2022] POST /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:32.381080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3962ce0d-2d3c-40c5-9bf3-c07ba2a2c16f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.381855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3962ce0d-2d3c-40c5-9bf3-c07ba2a2c16f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.401818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3962ce0d-2d3c-40c5-9bf3-c07ba2a2c16f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.402344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3962ce0d-2d3c-40c5-9bf3-c07ba2a2c16f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.403182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3962ce0d-2d3c-40c5-9bf3-c07ba2a2c16f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.403637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3962ce0d-2d3c-40c5-9bf3-c07ba2a2c16f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.474650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3962ce0d-2d3c-40c5-9bf3-c07ba2a2c16f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:11:32.733862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a71cb325-b498-4118-b1ab-cad2db3ee3c1 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Action: 'create', calling method: .version_select at 0x7fb842014ee0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhqV54bq3/zzRToFRfuXZdbiaaO1s1X80HPUKQ2pjgGA5SKF+Sv3dtPDOBK76G16/lJe65u8FsmwyLdkUVW/VM+55uSU2h+Oh9Fc2DrFeF8QDBT5Nqj5VBV1lrPbUgiaw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:32.743563 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a71cb325-b498-4118-b1ab-cad2db3ee3c1 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a71cb325-b498-4118-b1ab-cad2db3ee3c1 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Request method failure captured: Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 257 Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14B0fjsQ-aUpR8GQUm9RK4Frup-66QJZgHP-1yhtaIxFIMmH0duCgbAeolAleLKjNpmTWNANAZTkhrKZrNA2-suAWZ_N1H-sKvTeAhg3DWZaEnPzrBm9L7keoastCQ8mNAWjjxMzAqmV7BgQr5rvcvuJA1FbyXjYp5wLOROEUZrnlo0 Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:11:32.757042 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4257fed047449439e9e785ad34a01f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhqV54bq3/zzRToFRfuXZdbiaaO1s1X80HPUKQ2pjgGA5SKF+Sv3dtPDOBK76G16/lJe65u8FsmwyLdkUVW/VM+55uSU2h+Oh9Fc2DrFeF8QDBT5Nqj5VBV1lrPbUgiaw=="}} Jul 20 04:11:32.758782 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhqV54bq3/zzRToFRfuXZdbiaaO1s1X80HPUKQ2pjgGA5SKF+Sv3dtPDOBK76G16/lJe65u8FsmwyLdkUVW/VM+55uSU2h+Oh9Fc2DrFeF8QDBT5Nqj5VBV1lrPbUgiaw=='}}} Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 20 04:11:32.759723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:11:32.761383 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:11:32.765757 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:32.768588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a71cb325-b498-4118-b1ab-cad2db3ee3c1 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:32.773976 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a71cb325-b498-4118-b1ab-cad2db3ee3c1 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.461468 Jul 20 04:11:32.775641 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 595/1226] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:11:32 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 467 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:11:32.788702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4562eeb2-148a-455c-bce9-f19012baaf27 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.795323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4562eeb2-148a-455c-bce9-f19012baaf27 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.803067 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3962ce0d-2d3c-40c5-9bf3-c07ba2a2c16f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f" status: 204 len: 0 microversion: 2.1 time: 0.428157 Jul 20 04:11:32.809902 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 632/1227] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:32 2022] DELETE /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:32.813970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4562eeb2-148a-455c-bce9-f19012baaf27 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.814788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4562eeb2-148a-455c-bce9-f19012baaf27 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.815894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4562eeb2-148a-455c-bce9-f19012baaf27 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.820533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4562eeb2-148a-455c-bce9-f19012baaf27 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.831236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28ce9c3a-b420-4658-a1b7-239bed478cb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:32.836689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-28ce9c3a-b420-4658-a1b7-239bed478cb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:32.844753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28ce9c3a-b420-4658-a1b7-239bed478cb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.845217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28ce9c3a-b420-4658-a1b7-239bed478cb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:32.848445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28ce9c3a-b420-4658-a1b7-239bed478cb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:32.857919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28ce9c3a-b420-4658-a1b7-239bed478cb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.274937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4562eeb2-148a-455c-bce9-f19012baaf27 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:33.293177 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4562eeb2-148a-455c-bce9-f19012baaf27 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 0.516144 Jul 20 04:11:33.301004 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 596/1228] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:33.308529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0ea29d0d-4be9-46a0-b3f5-c0c6d181a72e tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Action: 'create', calling method: .version_select at 0x7fb842024d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1631800945", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:33.342949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=29 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:33.344812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-0ea29d0d-4be9-46a0-b3f5-c0c6d181a72e tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Getting quotas for project b4257fed047449439e9e785ad34a01f1. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:33.353874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-0ea29d0d-4be9-46a0-b3f5-c0c6d181a72e tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Getting quotas for user 84255d76f588466eae37c1e32e7f457c and project b4257fed047449439e9e785ad34a01f1. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:33.381768 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-0ea29d0d-4be9-46a0-b3f5-c0c6d181a72e tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0ea29d0d-4be9-46a0-b3f5-c0c6d181a72e tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Request method failure captured: Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 2167 Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14B0fjsQ-aUpR8GQUm9RK4Frup-66QJZgHP-1yhtaIxFIMmH0duCgbAeolAleLKjNpmTWNANAZTkhrKZrNA2-suAWZ_N1H-sKvTeAhg3DWZaEnPzrBm9L7keoastCQ8mNAWjjxMzAqmV7BgQr5rvcvuJA1FbyXjYp5wLOROEUZrnlo0 Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4257fed047449439e9e785ad34a01f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1631800945", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:11:33.397050 n-d-760456-11 devstack@n-api.service[119605]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1631800945', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:33.399430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:33.401984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:33.406979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0ea29d0d-4be9-46a0-b3f5-c0c6d181a72e tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:33.408276 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0ea29d0d-4be9-46a0-b3f5-c0c6d181a72e tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.105553 Jul 20 04:11:33.410390 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 597/1229] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Jul 20 04:11:33 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:11:33.415740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d5fdfcd1-fb02-444d-bec3-97baab48f54f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:33.420987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d5fdfcd1-fb02-444d-bec3-97baab48f54f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:33.449725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5fdfcd1-fb02-444d-bec3-97baab48f54f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.451472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5fdfcd1-fb02-444d-bec3-97baab48f54f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.453168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5fdfcd1-fb02-444d-bec3-97baab48f54f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.453856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5fdfcd1-fb02-444d-bec3-97baab48f54f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.530628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d5fdfcd1-fb02-444d-bec3-97baab48f54f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:11:33.675212 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d5fdfcd1-fb02-444d-bec3-97baab48f54f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 204 len: 0 microversion: 2.1 time: 0.262743 Jul 20 04:11:33.678412 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 598/1230] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:33 2022] DELETE /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:33.687344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4031bcd8-86a5-42ff-9078-dc5852130bbc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:33.688242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4031bcd8-86a5-42ff-9078-dc5852130bbc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:33.704846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4031bcd8-86a5-42ff-9078-dc5852130bbc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.705808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4031bcd8-86a5-42ff-9078-dc5852130bbc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.708432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4031bcd8-86a5-42ff-9078-dc5852130bbc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:33.709710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4031bcd8-86a5-42ff-9078-dc5852130bbc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:33.946932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-28ce9c3a-b420-4658-a1b7-239bed478cb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:33.961438 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-28ce9c3a-b420-4658-a1b7-239bed478cb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1541 microversion: 2.1 time: 1.146844 Jul 20 04:11:33.971404 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 633/1231] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:32 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1541 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:33.995791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d13a4cac-fa60-466b-a20e-78e8338970dc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:33.998144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d13a4cac-fa60-466b-a20e-78e8338970dc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:34.022812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4031bcd8-86a5-42ff-9078-dc5852130bbc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:34.034180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d13a4cac-fa60-466b-a20e-78e8338970dc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.035830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d13a4cac-fa60-466b-a20e-78e8338970dc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.038324 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4031bcd8-86a5-42ff-9078-dc5852130bbc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1304 microversion: 2.1 time: 0.358352 Jul 20 04:11:34.038922 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 599/1232] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:33 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1304 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:34.039583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d13a4cac-fa60-466b-a20e-78e8338970dc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.040196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d13a4cac-fa60-466b-a20e-78e8338970dc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.059414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-103993ab-7fcb-4160-9e3e-b9dc11fd7e19 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Action: 'create', calling method: .version_select at 0x7fb842024940>, body: {"keypair": {"name": "tempest-keypair-1628876666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8CDDRzM5gTswhKLT34mxWnW8cSI5pUcNH9mYNIQkuda/J4618W6GkJHNi8nSHnXsRWqvgtcrHdUJeh9Yu2cXqf7+YjV3isiw26FpY8btvr4CLhCMDXgQZ4KB4OmqhSnw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:34.105662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-103993ab-7fcb-4160-9e3e-b9dc11fd7e19 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Getting quotas for project b4257fed047449439e9e785ad34a01f1. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:34.117996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-103993ab-7fcb-4160-9e3e-b9dc11fd7e19 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Getting quotas for user 84255d76f588466eae37c1e32e7f457c and project b4257fed047449439e9e785ad34a01f1. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:34.151763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:34.209399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d13a4cac-fa60-466b-a20e-78e8338970dc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:34.213752 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-103993ab-7fcb-4160-9e3e-b9dc11fd7e19 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158109 Jul 20 04:11:34.217313 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 600/1233] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:11:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:34.228886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-02577c1b-2c80-47ea-a3c0-4fa9265371b5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.229717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-02577c1b-2c80-47ea-a3c0-4fa9265371b5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:34.230653 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d13a4cac-fa60-466b-a20e-78e8338970dc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1293 microversion: 2.1 time: 0.250992 Jul 20 04:11:34.231244 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 634/1234] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:33 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1293 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:34.244374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02577c1b-2c80-47ea-a3c0-4fa9265371b5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.249706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02577c1b-2c80-47ea-a3c0-4fa9265371b5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.250889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02577c1b-2c80-47ea-a3c0-4fa9265371b5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.251498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02577c1b-2c80-47ea-a3c0-4fa9265371b5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.252256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-327e3593-ad97-42ad-b687-5ff71c30c4b0 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Action: 'create', calling method: .version_select at 0x7fb841ee1ca0>, body: {"keypair": {"name": "tempest-keypair-1628876666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcM6inYgAcWrHDO2Dw6h6iov++E+r8UjFTqEAQAzXPQXauLtkMPMSYQNUvY8Sp4a1NWhHeX7efnNrxrdrZGL8IXp+mGMXBMqc7hIOk7p1p97cfGKbaqgrb9cO+B82wN0g=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:34.296928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-327e3593-ad97-42ad-b687-5ff71c30c4b0 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Getting quotas for project b4257fed047449439e9e785ad34a01f1. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:34.317802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-327e3593-ad97-42ad-b687-5ff71c30c4b0 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Getting quotas for user 84255d76f588466eae37c1e32e7f457c and project b4257fed047449439e9e785ad34a01f1. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:34.367806 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-327e3593-ad97-42ad-b687-5ff71c30c4b0 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] HTTP exception thrown: Key pair 'tempest-keypair-1628876666' already exists. Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-327e3593-ad97-42ad-b687-5ff71c30c4b0 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Request method failure captured: Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 273 Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14B0fjsQ-aUpR8GQUm9RK4Frup-66QJZgHP-1yhtaIxFIMmH0duCgbAeolAleLKjNpmTWNANAZTkhrKZrNA2-suAWZ_N1H-sKvTeAhg3DWZaEnPzrBm9L7keoastCQ8mNAWjjxMzAqmV7BgQr5rvcvuJA1FbyXjYp5wLOROEUZrnlo0 Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4257fed047449439e9e785ad34a01f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: {"keypair": {"name": "tempest-keypair-1628876666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcM6inYgAcWrHDO2Dw6h6iov++E+r8UjFTqEAQAzXPQXauLtkMPMSYQNUvY8Sp4a1NWhHeX7efnNrxrdrZGL8IXp+mGMXBMqc7hIOk7p1p97cfGKbaqgrb9cO+B82wN0g=="}} Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: exception: Key pair 'tempest-keypair-1628876666' already exists. Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1628876666', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcM6inYgAcWrHDO2Dw6h6iov++E+r8UjFTqEAQAzXPQXauLtkMPMSYQNUvY8Sp4a1NWhHeX7efnNrxrdrZGL8IXp+mGMXBMqc7hIOk7p1p97cfGKbaqgrb9cO+B82wN0g=='}}} Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '84255d76f588466eae37c1e32e7f457c-tempest-keypair-1628876666' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 20 04:11:34.377418 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:11:34.381970 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '84255d76f588466eae37c1e32e7f457c-tempest-keypair-1628876666' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 11, 34, 355890), 'updated_at': None, 'name': 'tempest-keypair-1628876666', 'user_id': '84255d76f588466eae37c1e32e7f457c', 'fingerprint': '9e:e1:66:fe:ce:e2:cd:83:84:e1:16:cb:42:2d:2a:83', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcM6inYgAcWrHDO2Dw6h6iov++E+r8UjFTqEAQAzXPQXauLtkMPMSYQNUvY8Sp4a1NWhHeX7efnNrxrdrZGL8IXp+mGMXBMqc7hIOk7p1p97cfGKbaqgrb9cO+B82wN0g==', 'type': 'ssh'}] Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi keypair.create() Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._create() Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1628876666' already exists. Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 20 04:11:34.392701 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1628876666' already exists. Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1628876666' already exists. Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-327e3593-ad97-42ad-b687-5ff71c30c4b0 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Returning 409 to user: Key pair 'tempest-keypair-1628876666' already exists. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-327e3593-ad97-42ad-b687-5ff71c30c4b0 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.147031 Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 635/1235] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:11:34 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-45ae3f1f-c76d-4e9e-9a0c-efc42d5c93d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.400660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-45ae3f1f-c76d-4e9e-9a0c-efc42d5c93d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:34.411582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:34.415046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-45ae3f1f-c76d-4e9e-9a0c-efc42d5c93d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.415518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-45ae3f1f-c76d-4e9e-9a0c-efc42d5c93d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.421263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-45ae3f1f-c76d-4e9e-9a0c-efc42d5c93d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:34.421770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-45ae3f1f-c76d-4e9e-9a0c-efc42d5c93d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:34.895487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-02577c1b-2c80-47ea-a3c0-4fa9265371b5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:34.911900 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-02577c1b-2c80-47ea-a3c0-4fa9265371b5 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f" status: 200 len: 1474 microversion: 2.1 time: 0.693270 Jul 20 04:11:34.912469 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 601/1236] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:34 2022] GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f => generated 1474 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:34.917198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9093bf77-3af3-47a7-b5bf-8999bfde1e02 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Calling method '.version_select at 0x7fb8420cf9d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.960585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-45ae3f1f-c76d-4e9e-9a0c-efc42d5c93d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:34.970343 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9093bf77-3af3-47a7-b5bf-8999bfde1e02 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628876666" status: 202 len: 0 microversion: 2.1 time: 0.056609 Jul 20 04:11:34.976351 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 602/1237] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:11:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628876666 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:34.982456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-45ae3f1f-c76d-4e9e-9a0c-efc42d5c93d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 0.597722 Jul 20 04:11:34.985741 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 636/1238] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:34 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:34.992031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf0b5c5c-0d91-4d81-bf63-ceb433c3c282 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:34.994507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cf0b5c5c-0d91-4d81-bf63-ceb433c3c282 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:35.001245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0b443ca-5f52-4e81-8962-33e9ad322bd8 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Action: 'create', calling method: .version_select at 0x7fb8421ac040>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQUPH7Ysash4IoDXDD7aD0iVbI6WJzpW8/fya3tgxXPJIsU1vhbusrIre7idwGcAlw3tLbJmgZdf5S3AL9LDwGLiux4XNYD0OB09HJU/o0Mfqw1jh0YciNwh9a//C9Ktg=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0b443ca-5f52-4e81-8962-33e9ad322bd8 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Request method failure captured: Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 247 Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14B0fjsQ-aUpR8GQUm9RK4Frup-66QJZgHP-1yhtaIxFIMmH0duCgbAeolAleLKjNpmTWNANAZTkhrKZrNA2-suAWZ_N1H-sKvTeAhg3DWZaEnPzrBm9L7keoastCQ8mNAWjjxMzAqmV7BgQr5rvcvuJA1FbyXjYp5wLOROEUZrnlo0 Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4257fed047449439e9e785ad34a01f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQUPH7Ysash4IoDXDD7aD0iVbI6WJzpW8/fya3tgxXPJIsU1vhbusrIre7idwGcAlw3tLbJmgZdf5S3AL9LDwGLiux4XNYD0OB09HJU/o0Mfqw1jh0YciNwh9a//C9Ktg=="}} Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQUPH7Ysash4IoDXDD7aD0iVbI6WJzpW8/fya3tgxXPJIsU1vhbusrIre7idwGcAlw3tLbJmgZdf5S3AL9LDwGLiux4XNYD0OB09HJU/o0Mfqw1jh0YciNwh9a//C9Ktg=='}}} Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi '' Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:11:35.034894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.043660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0b443ca-5f52-4e81-8962-33e9ad322bd8 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:35.044694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf0b5c5c-0d91-4d81-bf63-ceb433c3c282 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.044694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf0b5c5c-0d91-4d81-bf63-ceb433c3c282 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.044694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf0b5c5c-0d91-4d81-bf63-ceb433c3c282 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.044929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf0b5c5c-0d91-4d81-bf63-ceb433c3c282 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.047154 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0b443ca-5f52-4e81-8962-33e9ad322bd8 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.052769 Jul 20 04:11:35.047968 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 637/1239] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:11:34 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:11:35.065468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1186c3a7-54a4-4d8f-a5ef-deecda43e66c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:35.066697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1186c3a7-54a4-4d8f-a5ef-deecda43e66c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:35.090553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1186c3a7-54a4-4d8f-a5ef-deecda43e66c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.095045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1186c3a7-54a4-4d8f-a5ef-deecda43e66c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.102023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1186c3a7-54a4-4d8f-a5ef-deecda43e66c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.102643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1186c3a7-54a4-4d8f-a5ef-deecda43e66c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.234373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1186c3a7-54a4-4d8f-a5ef-deecda43e66c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:35.248513 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1186c3a7-54a4-4d8f-a5ef-deecda43e66c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1304 microversion: 2.1 time: 0.195936 Jul 20 04:11:35.263861 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 638/1240] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:35 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:35.284132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ceda90bd-502e-4d0b-92ff-bf1ebeab8243 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Action: 'create', calling method: .version_select at 0x7fb842163d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1310589357", "public_key": " "}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:35.307534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ceda90bd-502e-4d0b-92ff-bf1ebeab8243 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Getting quotas for project b4257fed047449439e9e785ad34a01f1. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:35.333689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ceda90bd-502e-4d0b-92ff-bf1ebeab8243 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Getting quotas for user 84255d76f588466eae37c1e32e7f457c and project b4257fed047449439e9e785ad34a01f1. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:35.399368 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-ceda90bd-502e-4d0b-92ff-bf1ebeab8243 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ceda90bd-502e-4d0b-92ff-bf1ebeab8243 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Request method failure captured: Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 95 Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14B0fjsQ-aUpR8GQUm9RK4Frup-66QJZgHP-1yhtaIxFIMmH0duCgbAeolAleLKjNpmTWNANAZTkhrKZrNA2-suAWZ_N1H-sKvTeAhg3DWZaEnPzrBm9L7keoastCQ8mNAWjjxMzAqmV7BgQr5rvcvuJA1FbyXjYp5wLOROEUZrnlo0 Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4257fed047449439e9e785ad34a01f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1310589357", "public_key": " "}} Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1310589357', 'public_key': ' '}}} Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.401881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ceda90bd-502e-4d0b-92ff-bf1ebeab8243 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ceda90bd-502e-4d0b-92ff-bf1ebeab8243 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.137951 Jul 20 04:11:35.406362 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 639/1241] 10.222.0.59 () {60 vars in 1157 bytes} [Wed Jul 20 04:11:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:11:35.414305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04b24a3d-7294-40ea-ac2d-221b2e221970 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:35.426060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04b24a3d-7294-40ea-ac2d-221b2e221970 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:35.438179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b24a3d-7294-40ea-ac2d-221b2e221970 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.439127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b24a3d-7294-40ea-ac2d-221b2e221970 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.440316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b24a3d-7294-40ea-ac2d-221b2e221970 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.441365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b24a3d-7294-40ea-ac2d-221b2e221970 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.567408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-04b24a3d-7294-40ea-ac2d-221b2e221970 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:35.577560 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04b24a3d-7294-40ea-ac2d-221b2e221970 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1293 microversion: 2.1 time: 0.172627 Jul 20 04:11:35.587634 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 640/1242] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:35 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1293 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:35.601193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7579f68-fada-439d-9288-60634c6b2b49 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Action: 'create', calling method: .version_select at 0x7fb842163820>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvKmrHBwBJFkwTaxwKPSaqwRxXvCx/K9Kd3qlYmxTAFCl5zkjzSNWEovoGF/C1GU3hf2CQfS9/IyBozR4GLgq9jMxW/pZE3NREygBGF7f8oZDpZiFKt4NuZHRybDtc+4g=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7579f68-fada-439d-9288-60634c6b2b49 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Request method failure captured: Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 507 Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14B0fjsQ-aUpR8GQUm9RK4Frup-66QJZgHP-1yhtaIxFIMmH0duCgbAeolAleLKjNpmTWNANAZTkhrKZrNA2-suAWZ_N1H-sKvTeAhg3DWZaEnPzrBm9L7keoastCQ8mNAWjjxMzAqmV7BgQr5rvcvuJA1FbyXjYp5wLOROEUZrnlo0 Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4257fed047449439e9e785ad34a01f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvKmrHBwBJFkwTaxwKPSaqwRxXvCx/K9Kd3qlYmxTAFCl5zkjzSNWEovoGF/C1GU3hf2CQfS9/IyBozR4GLgq9jMxW/pZE3NREygBGF7f8oZDpZiFKt4NuZHRybDtc+4g=="}} Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvKmrHBwBJFkwTaxwKPSaqwRxXvCx/K9Kd3qlYmxTAFCl5zkjzSNWEovoGF/C1GU3hf2CQfS9/IyBozR4GLgq9jMxW/pZE3NREygBGF7f8oZDpZiFKt4NuZHRybDtc+4g=='}}} Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 20 04:11:35.603746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7579f68-fada-439d-9288-60634c6b2b49 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:35.606872 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7579f68-fada-439d-9288-60634c6b2b49 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.015702 Jul 20 04:11:35.608873 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 641/1243] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:11:35 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:11:35.622285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e478d2f3-51da-4944-8e4a-faad5b3c0982 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Action: 'create', calling method: .version_select at 0x7fb8421f1310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1420752253", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:35.663711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e478d2f3-51da-4944-8e4a-faad5b3c0982 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Getting quotas for project b4257fed047449439e9e785ad34a01f1. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:35.671232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e478d2f3-51da-4944-8e4a-faad5b3c0982 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Getting quotas for user 84255d76f588466eae37c1e32e7f457c and project b4257fed047449439e9e785ad34a01f1. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:35.720728 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e478d2f3-51da-4944-8e4a-faad5b3c0982 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e478d2f3-51da-4944-8e4a-faad5b3c0982 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Request method failure captured: Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 118 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14B0fjsQ-aUpR8GQUm9RK4Frup-66QJZgHP-1yhtaIxFIMmH0duCgbAeolAleLKjNpmTWNANAZTkhrKZrNA2-suAWZ_N1H-sKvTeAhg3DWZaEnPzrBm9L7keoastCQ8mNAWjjxMzAqmV7BgQr5rvcvuJA1FbyXjYp5wLOROEUZrnlo0 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4257fed047449439e9e785ad34a01f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1420752253", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1420752253', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:11:35.724333 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:11:35.728952 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.733612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e478d2f3-51da-4944-8e4a-faad5b3c0982 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:35.739838 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e478d2f3-51da-4944-8e4a-faad5b3c0982 tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.126919 Jul 20 04:11:35.740687 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 642/1244] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:11:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 20 04:11:35.752209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d344551-0c63-4aac-bd11-072be397362f tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Calling method '.version_select at 0x7fb842163040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:35.792545 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5d344551-0c63-4aac-bd11-072be397362f tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1173715380 not found for user 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d344551-0c63-4aac-bd11-072be397362f tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Request method failure captured: Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1173715380 HTTP/1.1 Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14B0fjsQ-aUpR8GQUm9RK4Frup-66QJZgHP-1yhtaIxFIMmH0duCgbAeolAleLKjNpmTWNANAZTkhrKZrNA2-suAWZ_N1H-sKvTeAhg3DWZaEnPzrBm9L7keoastCQ8mNAWjjxMzAqmV7BgQr5rvcvuJA1FbyXjYp5wLOROEUZrnlo0 Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4257fed047449439e9e785ad34a01f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4257fed047449439e9e785ad34a01f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: b4257fed047449439e9e785ad34a01f1 Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542653143 Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542653143-project Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: exception: Keypair tempest-keypair-non-existent-1173715380 not found for user 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'tempest-keypair-non-existent-1173715380'} Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1173715380 not found for user 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.795004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1173715380 not found for user 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1173715380 not found for user 84255d76f588466eae37c1e32e7f457c Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d344551-0c63-4aac-bd11-072be397362f tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1173715380 not found for user 84255d76f588466eae37c1e32e7f457c {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d344551-0c63-4aac-bd11-072be397362f tempest-KeyPairsNegativeTestJSON-1542653143 tempest-KeyPairsNegativeTestJSON-1542653143-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1173715380" status: 404 len: 145 microversion: 2.1 time: 0.047989 Jul 20 04:11:35.808039 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 643/1245] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:11:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1173715380 => generated 145 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:11:35.932003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7aee4ff4-b0c6-4485-a93d-e3c7bbddb6ad tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:35.933255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7aee4ff4-b0c6-4485-a93d-e3c7bbddb6ad tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:35.953521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aee4ff4-b0c6-4485-a93d-e3c7bbddb6ad tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.953992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aee4ff4-b0c6-4485-a93d-e3c7bbddb6ad tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:35.954830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aee4ff4-b0c6-4485-a93d-e3c7bbddb6ad tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:35.955275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aee4ff4-b0c6-4485-a93d-e3c7bbddb6ad tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.517229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7aee4ff4-b0c6-4485-a93d-e3c7bbddb6ad tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:36.525935 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7aee4ff4-b0c6-4485-a93d-e3c7bbddb6ad tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f" status: 200 len: 1474 microversion: 2.1 time: 0.600430 Jul 20 04:11:36.531214 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 644/1246] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:35 2022] GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f => generated 1474 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:11:36.537043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b626a53f-8146-4756-9704-cc5df6ff9324 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:36.547094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b626a53f-8146-4756-9704-cc5df6ff9324 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:36.563909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b626a53f-8146-4756-9704-cc5df6ff9324 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.564606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b626a53f-8146-4756-9704-cc5df6ff9324 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.565557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b626a53f-8146-4756-9704-cc5df6ff9324 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:36.566207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b626a53f-8146-4756-9704-cc5df6ff9324 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:36.981295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cf0b5c5c-0d91-4d81-bf63-ceb433c3c282 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.001715 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf0b5c5c-0d91-4d81-bf63-ceb433c3c282 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1541 microversion: 2.1 time: 2.021304 Jul 20 04:11:37.003969 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 603/1247] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:34 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1541 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:37.017869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6cb7c7fa-b295-4fb9-bcee-68f5c5b63730 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.021594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6cb7c7fa-b295-4fb9-bcee-68f5c5b63730 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.056074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cb7c7fa-b295-4fb9-bcee-68f5c5b63730 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.058319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cb7c7fa-b295-4fb9-bcee-68f5c5b63730 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.064915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cb7c7fa-b295-4fb9-bcee-68f5c5b63730 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.066344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cb7c7fa-b295-4fb9-bcee-68f5c5b63730 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.448210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b626a53f-8146-4756-9704-cc5df6ff9324 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.459865 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b626a53f-8146-4756-9704-cc5df6ff9324 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 0.926981 Jul 20 04:11:37.468379 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 645/1248] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:36 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:37.476175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f5b28246-4f04-41f4-8a83-015ca250273d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.480705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f5b28246-4f04-41f4-8a83-015ca250273d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.496562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5b28246-4f04-41f4-8a83-015ca250273d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.497334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5b28246-4f04-41f4-8a83-015ca250273d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.498342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5b28246-4f04-41f4-8a83-015ca250273d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.501045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5b28246-4f04-41f4-8a83-015ca250273d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.705077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6cb7c7fa-b295-4fb9-bcee-68f5c5b63730 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:37.715198 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6cb7c7fa-b295-4fb9-bcee-68f5c5b63730 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1304 microversion: 2.1 time: 0.708204 Jul 20 04:11:37.715799 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 604/1249] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1304 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:37.744152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-abae2652-7e0c-41d0-83e9-362c530568a9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:37.747693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-abae2652-7e0c-41d0-83e9-362c530568a9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:37.764802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abae2652-7e0c-41d0-83e9-362c530568a9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.768271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abae2652-7e0c-41d0-83e9-362c530568a9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:37.770549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abae2652-7e0c-41d0-83e9-362c530568a9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:37.772155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abae2652-7e0c-41d0-83e9-362c530568a9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.171404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f5b28246-4f04-41f4-8a83-015ca250273d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:38.197757 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f5b28246-4f04-41f4-8a83-015ca250273d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1293 microversion: 2.1 time: 0.727745 Jul 20 04:11:38.211440 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 646/1250] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1293 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:38.222713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d4807118-c63a-4c37-9f85-5df26a2122a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:38.228316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d4807118-c63a-4c37-9f85-5df26a2122a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:38.250191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4807118-c63a-4c37-9f85-5df26a2122a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.251766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4807118-c63a-4c37-9f85-5df26a2122a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.256689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4807118-c63a-4c37-9f85-5df26a2122a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:38.257440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4807118-c63a-4c37-9f85-5df26a2122a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:38.980543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-abae2652-7e0c-41d0-83e9-362c530568a9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:38.992660 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-abae2652-7e0c-41d0-83e9-362c530568a9 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f" status: 200 len: 1474 microversion: 2.1 time: 1.275675 Jul 20 04:11:39.005998 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 605/1251] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:37 2022] GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f => generated 1474 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.021254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c71654b4-1193-49dd-95ec-7312cda4c4d6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.022224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c71654b4-1193-49dd-95ec-7312cda4c4d6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:39.038159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c71654b4-1193-49dd-95ec-7312cda4c4d6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.042114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c71654b4-1193-49dd-95ec-7312cda4c4d6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.043301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c71654b4-1193-49dd-95ec-7312cda4c4d6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.043949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c71654b4-1193-49dd-95ec-7312cda4c4d6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.835090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d4807118-c63a-4c37-9f85-5df26a2122a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:39.862093 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d4807118-c63a-4c37-9f85-5df26a2122a8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1540 microversion: 2.1 time: 1.636858 Jul 20 04:11:39.864513 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 647/1252] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:38 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1540 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:39.899953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-adcff152-3316-483e-8594-fb82a8e999a0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:39.906716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-adcff152-3316-483e-8594-fb82a8e999a0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:39.928742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adcff152-3316-483e-8594-fb82a8e999a0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.932081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adcff152-3316-483e-8594-fb82a8e999a0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:39.935820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adcff152-3316-483e-8594-fb82a8e999a0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:39.939347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adcff152-3316-483e-8594-fb82a8e999a0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.026174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c71654b4-1193-49dd-95ec-7312cda4c4d6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:40.039876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c71654b4-1193-49dd-95ec-7312cda4c4d6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 1.031908 Jul 20 04:11:40.053403 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 606/1253] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:39 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:40.060395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6120e712-8f89-4c5b-a964-1e4139290656 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.061475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6120e712-8f89-4c5b-a964-1e4139290656 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:40.064042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:40.074401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6120e712-8f89-4c5b-a964-1e4139290656 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.075135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6120e712-8f89-4c5b-a964-1e4139290656 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.076121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6120e712-8f89-4c5b-a964-1e4139290656 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.076732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6120e712-8f89-4c5b-a964-1e4139290656 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.205845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6120e712-8f89-4c5b-a964-1e4139290656 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:40.219998 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6120e712-8f89-4c5b-a964-1e4139290656 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1293 microversion: 2.1 time: 0.164863 Jul 20 04:11:40.224070 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 607/1254] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1293 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:40.239579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-591c800b-083c-401c-ac14-28f11bb1511e req-ef2216b0-bf5f-4043-8229-a3cae3fc5f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d7c31d1-d04a-443f-a3e2-c0aac27ac60f", "name": "network-vif-deleted", "tag": "fbee6877-612d-4443-9f16-5173fc6e0c75"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:40.267169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:40.268488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-591c800b-083c-401c-ac14-28f11bb1511e req-ef2216b0-bf5f-4043-8229-a3cae3fc5f71 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.269305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-591c800b-083c-401c-ac14-28f11bb1511e req-ef2216b0-bf5f-4043-8229-a3cae3fc5f71 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.319817 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-591c800b-083c-401c-ac14-28f11bb1511e req-ef2216b0-bf5f-4043-8229-a3cae3fc5f71 service nova] Creating event network-vif-deleted:fbee6877-612d-4443-9f16-5173fc6e0c75 for instance 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f on n-h2-760456-11 Jul 20 04:11:40.357301 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-591c800b-083c-401c-ac14-28f11bb1511e req-ef2216b0-bf5f-4043-8229-a3cae3fc5f71 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129499 Jul 20 04:11:40.361736 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 608/1255] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:40.379226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-cdb94bab-2011-4b3d-ad71-1e7c9f75b691 req-4d8c0d8e-4c72-4566-b2de-d8e9281a13ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be", "name": "network-vif-deleted", "tag": "44018208-b4ae-4293-8a0f-afbf74fba179"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:40.404492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cdb94bab-2011-4b3d-ad71-1e7c9f75b691 req-4d8c0d8e-4c72-4566-b2de-d8e9281a13ba service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.405211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cdb94bab-2011-4b3d-ad71-1e7c9f75b691 req-4d8c0d8e-4c72-4566-b2de-d8e9281a13ba service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.435983 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-cdb94bab-2011-4b3d-ad71-1e7c9f75b691 req-4d8c0d8e-4c72-4566-b2de-d8e9281a13ba service nova] Creating event network-vif-deleted:44018208-b4ae-4293-8a0f-afbf74fba179 for instance 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be on n-h1-760456-11 Jul 20 04:11:40.442893 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-cdb94bab-2011-4b3d-ad71-1e7c9f75b691 req-4d8c0d8e-4c72-4566-b2de-d8e9281a13ba service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077035 Jul 20 04:11:40.444241 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 609/1256] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:40.451323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.452456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:40.463197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.463917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.464970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.465610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.564004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.568119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.570293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lazy-loading 'fault' on Instance uuid 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:40.757354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:40.770896 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eb8689e9-806f-410f-8fe9-bbc1d063c167 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f" status: 200 len: 1309 microversion: 2.1 time: 0.320906 Jul 20 04:11:40.773803 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 610/1257] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:40.833059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3304657e-a98d-4b9a-9553-6b3547bad25d req-18c007f0-518b-48aa-9d40-bec4eda3975f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a36a696-8851-4e69-ac90-65e06e37bc2b", "name": "network-vif-unplugged", "status": "completed", "tag": "b7b586b2-e4b3-4e30-bff1-a39da550c591"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:40.848817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3304657e-a98d-4b9a-9553-6b3547bad25d req-18c007f0-518b-48aa-9d40-bec4eda3975f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:40.851241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3304657e-a98d-4b9a-9553-6b3547bad25d req-18c007f0-518b-48aa-9d40-bec4eda3975f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:40.889632 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3304657e-a98d-4b9a-9553-6b3547bad25d req-18c007f0-518b-48aa-9d40-bec4eda3975f service nova] Creating event network-vif-unplugged:b7b586b2-e4b3-4e30-bff1-a39da550c591 for instance 1a36a696-8851-4e69-ac90-65e06e37bc2b on n-h1-760456-11 Jul 20 04:11:40.920435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-3304657e-a98d-4b9a-9553-6b3547bad25d req-18c007f0-518b-48aa-9d40-bec4eda3975f service nova] Instance 1a36a696-8851-4e69-ac90-65e06e37bc2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:11:40.951904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3304657e-a98d-4b9a-9553-6b3547bad25d req-18c007f0-518b-48aa-9d40-bec4eda3975f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123025 Jul 20 04:11:40.954570 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 611/1258] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:11:40.972821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d72230e-5266-4643-93aa-2cc3b0e2daa0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:40.981686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4d72230e-5266-4643-93aa-2cc3b0e2daa0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.003505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-adcff152-3316-483e-8594-fb82a8e999a0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.025037 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-adcff152-3316-483e-8594-fb82a8e999a0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1372 microversion: 2.1 time: 1.146400 Jul 20 04:11:41.028106 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 648/1259] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:39 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1372 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:41.041383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d72230e-5266-4643-93aa-2cc3b0e2daa0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.047944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d72230e-5266-4643-93aa-2cc3b0e2daa0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.048920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d72230e-5266-4643-93aa-2cc3b0e2daa0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.051917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d72230e-5266-4643-93aa-2cc3b0e2daa0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.060938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1b6a20d1-73fa-43ff-bf3d-8797b6b9da5f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.063102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1b6a20d1-73fa-43ff-bf3d-8797b6b9da5f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.114119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b6a20d1-73fa-43ff-bf3d-8797b6b9da5f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.121027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b6a20d1-73fa-43ff-bf3d-8797b6b9da5f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.133279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b6a20d1-73fa-43ff-bf3d-8797b6b9da5f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.139494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b6a20d1-73fa-43ff-bf3d-8797b6b9da5f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.764953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4d72230e-5266-4643-93aa-2cc3b0e2daa0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.769398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1b6a20d1-73fa-43ff-bf3d-8797b6b9da5f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:41.783729 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4d72230e-5266-4643-93aa-2cc3b0e2daa0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1540 microversion: 2.1 time: 0.827602 Jul 20 04:11:41.788470 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1b6a20d1-73fa-43ff-bf3d-8797b6b9da5f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 0.731300 Jul 20 04:11:41.792344 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 612/1260] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:40 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1540 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:41.795776 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 649/1261] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:41.812790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a893134-963b-4b76-89a3-4068a111ff3a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.814965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0a893134-963b-4b76-89a3-4068a111ff3a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.827963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a6a2ca4-4041-4193-901b-3609d7cbb267 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.828932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5a6a2ca4-4041-4193-901b-3609d7cbb267 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.849252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a893134-963b-4b76-89a3-4068a111ff3a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.852093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a893134-963b-4b76-89a3-4068a111ff3a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.853500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a893134-963b-4b76-89a3-4068a111ff3a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.855386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a6a2ca4-4041-4193-901b-3609d7cbb267 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.856084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a893134-963b-4b76-89a3-4068a111ff3a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.859703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a6a2ca4-4041-4193-901b-3609d7cbb267 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.860801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a6a2ca4-4041-4193-901b-3609d7cbb267 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.861444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a6a2ca4-4041-4193-901b-3609d7cbb267 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.920315 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5a6a2ca4-4041-4193-901b-3609d7cbb267 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] HTTP exception thrown: Instance 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f could not be found. Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a6a2ca4-4041-4193-901b-3609d7cbb267 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Request method failure captured: Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f HTTP/1.1 Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-_SLHHBe8zHgPmumqpGQGpfE5LciA5LXldNSzzRGvnFhq4OGvTsggFhLX1dpz26prLgd5YVZZ1DDpeEElNjiN2Kic4UMQWDkK9PyUhI5m2ZW6wgBdxmxlZyocgT836TvA08u269TeLJRQUTi77wIrvb9rmOJYYGhZeh34fdWej1CU Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_95231a9d82164f88b1c6ff355679d292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f508838d58f442dd80ab9f1b5b07b4df Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f could not be found. Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '2d7c31d1-d04a-443f-a3e2-c0aac27ac60f'} Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f could not be found. Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f could not be found. Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:41.922393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:41.928180 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:41.928180 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:41.928180 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:41.928180 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:41.928180 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:41.928180 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f could not be found. Jul 20 04:11:41.928180 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:41.936511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a6a2ca4-4041-4193-901b-3609d7cbb267 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Returning 404 to user: Instance 2d7c31d1-d04a-443f-a3e2-c0aac27ac60f could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:41.937983 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5a6a2ca4-4041-4193-901b-3609d7cbb267 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f" status: 404 len: 111 microversion: 2.1 time: 0.132003 Jul 20 04:11:41.940618 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 650/1262] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/2d7c31d1-d04a-443f-a3e2-c0aac27ac60f => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:41.950187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fa966a3d-a3be-4184-9cd5-645fcf3ee558 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:41.956578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fa966a3d-a3be-4184-9cd5-645fcf3ee558 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:41.995385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa966a3d-a3be-4184-9cd5-645fcf3ee558 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.996175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa966a3d-a3be-4184-9cd5-645fcf3ee558 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:41.997116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa966a3d-a3be-4184-9cd5-645fcf3ee558 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:41.997569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa966a3d-a3be-4184-9cd5-645fcf3ee558 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.053433 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-fa966a3d-a3be-4184-9cd5-645fcf3ee558 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] HTTP exception thrown: Instance 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be could not be found. Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fa966a3d-a3be-4184-9cd5-645fcf3ee558 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Request method failure captured: Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be HTTP/1.1 Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-_SLHHBe8zHgPmumqpGQGpfE5LciA5LXldNSzzRGvnFhq4OGvTsggFhLX1dpz26prLgd5YVZZ1DDpeEElNjiN2Kic4UMQWDkK9PyUhI5m2ZW6wgBdxmxlZyocgT836TvA08u269TeLJRQUTi77wIrvb9rmOJYYGhZeh34fdWej1CU Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_95231a9d82164f88b1c6ff355679d292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f508838d58f442dd80ab9f1b5b07b4df Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be could not be found. Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be'} Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be could not be found. Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be could not be found. Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:42.055835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:42.061669 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:42.061669 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:42.061669 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:42.061669 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:42.061669 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:42.061669 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be could not be found. Jul 20 04:11:42.061669 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:42.075370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fa966a3d-a3be-4184-9cd5-645fcf3ee558 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Returning 404 to user: Instance 4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:42.076580 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fa966a3d-a3be-4184-9cd5-645fcf3ee558 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be" status: 404 len: 111 microversion: 2.1 time: 0.130358 Jul 20 04:11:42.079531 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 651/1263] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/4ed3f8a0-6e9e-4f58-9525-e30f1ef8e4be => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:42.092131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca931716-eac0-4d4e-af8a-26cd812c1629 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:42.103068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ca931716-eac0-4d4e-af8a-26cd812c1629 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:42.136350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca931716-eac0-4d4e-af8a-26cd812c1629 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.138782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca931716-eac0-4d4e-af8a-26cd812c1629 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.146058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca931716-eac0-4d4e-af8a-26cd812c1629 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.146853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca931716-eac0-4d4e-af8a-26cd812c1629 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.685806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0a893134-963b-4b76-89a3-4068a111ff3a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:42.692634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:42.710913 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a893134-963b-4b76-89a3-4068a111ff3a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 0.914236 Jul 20 04:11:42.714011 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 613/1264] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:41 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:42.728561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-30860b09-2bb6-4a29-b6ae-9fa1eeefad0f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:42.841625 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-30860b09-2bb6-4a29-b6ae-9fa1eeefad0f tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/ce3b350e-4517-4aab-9a1b-07c66910c1cb" status: 204 len: 0 microversion: 2.1 time: 0.125880 Jul 20 04:11:42.842555 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 614/1265] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:11:42 2022] DELETE /compute/v2.1/os-server-groups/ce3b350e-4517-4aab-9a1b-07c66910c1cb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:42.849350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f51f9034-25ae-4741-b4ef-5872ff64f540 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:42.854339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f51f9034-25ae-4741-b4ef-5872ff64f540 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:42.877462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f51f9034-25ae-4741-b4ef-5872ff64f540 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.878880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f51f9034-25ae-4741-b4ef-5872ff64f540 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:42.879939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f51f9034-25ae-4741-b4ef-5872ff64f540 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:42.880552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f51f9034-25ae-4741-b4ef-5872ff64f540 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.200645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ca931716-eac0-4d4e-af8a-26cd812c1629 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:43.212763 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ca931716-eac0-4d4e-af8a-26cd812c1629 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1372 microversion: 2.1 time: 1.130411 Jul 20 04:11:43.216592 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 652/1266] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:42 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1372 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:43.229716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-139a6c18-2cd6-4163-9bbb-37787c0770c2 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:43.232300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-139a6c18-2cd6-4163-9bbb-37787c0770c2 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:43.263475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-139a6c18-2cd6-4163-9bbb-37787c0770c2 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.264330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-139a6c18-2cd6-4163-9bbb-37787c0770c2 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.268609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-139a6c18-2cd6-4163-9bbb-37787c0770c2 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:43.274015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-139a6c18-2cd6-4163-9bbb-37787c0770c2 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:43.359467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:43.944641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f51f9034-25ae-4741-b4ef-5872ff64f540 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:43.961159 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f51f9034-25ae-4741-b4ef-5872ff64f540 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1540 microversion: 2.1 time: 1.115856 Jul 20 04:11:43.966333 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 615/1267] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:42 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1540 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:43.981071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7458c63e-820e-467b-995c-a8e57b3ba601 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:43.987069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7458c63e-820e-467b-995c-a8e57b3ba601 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 062ae2d5-b44a-4064-aef7-0ab665ad2f5c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:44.017788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7458c63e-820e-467b-995c-a8e57b3ba601 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.022222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7458c63e-820e-467b-995c-a8e57b3ba601 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.025030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7458c63e-820e-467b-995c-a8e57b3ba601 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.025497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7458c63e-820e-467b-995c-a8e57b3ba601 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.111573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7458c63e-820e-467b-995c-a8e57b3ba601 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 062ae2d5-b44a-4064-aef7-0ab665ad2f5c] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:11:44.118221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-139a6c18-2cd6-4163-9bbb-37787c0770c2 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:44.136695 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-139a6c18-2cd6-4163-9bbb-37787c0770c2 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 0.918434 Jul 20 04:11:44.137699 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 653/1268] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:43 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:44.145559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ab70da16-331a-411a-91d4-7631362a4a4b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:44.146448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ab70da16-331a-411a-91d4-7631362a4a4b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:44.156310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab70da16-331a-411a-91d4-7631362a4a4b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.156773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab70da16-331a-411a-91d4-7631362a4a4b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.157933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab70da16-331a-411a-91d4-7631362a4a4b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.158433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab70da16-331a-411a-91d4-7631362a4a4b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.241328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=7 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:44.400004 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7458c63e-820e-467b-995c-a8e57b3ba601 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "DELETE /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c" status: 204 len: 0 microversion: 2.1 time: 0.430176 Jul 20 04:11:44.407983 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 616/1269] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:43 2022] DELETE /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:44.420468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-55b81cf9-88cb-408f-9fcc-f6343ca5ec73 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:44.421236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-55b81cf9-88cb-408f-9fcc-f6343ca5ec73 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:44.469121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55b81cf9-88cb-408f-9fcc-f6343ca5ec73 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.469635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55b81cf9-88cb-408f-9fcc-f6343ca5ec73 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:44.470521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55b81cf9-88cb-408f-9fcc-f6343ca5ec73 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:44.470985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55b81cf9-88cb-408f-9fcc-f6343ca5ec73 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.543147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-55b81cf9-88cb-408f-9fcc-f6343ca5ec73 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:45.557811 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-55b81cf9-88cb-408f-9fcc-f6343ca5ec73 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1372 microversion: 2.1 time: 1.150332 Jul 20 04:11:45.561040 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 617/1270] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:44 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1372 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:45.568814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ad30d64a-890c-4a61-9e5e-e18344a3cc32 req-0b71dc9f-6ac2-4abf-b5bc-002118cceaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0079fbd3-9f24-447a-8331-0823b53255ac", "tag": "7bde46c1-9c2f-458d-a411-c6bd6b2efd84"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:45.632840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ad30d64a-890c-4a61-9e5e-e18344a3cc32 req-0b71dc9f-6ac2-4abf-b5bc-002118cceaf8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.633247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ad30d64a-890c-4a61-9e5e-e18344a3cc32 req-0b71dc9f-6ac2-4abf-b5bc-002118cceaf8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.667734 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ad30d64a-890c-4a61-9e5e-e18344a3cc32 req-0b71dc9f-6ac2-4abf-b5bc-002118cceaf8 service nova] Creating event network-changed:7bde46c1-9c2f-458d-a411-c6bd6b2efd84 for instance 0079fbd3-9f24-447a-8331-0823b53255ac on n-h1-760456-11 Jul 20 04:11:45.689002 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ad30d64a-890c-4a61-9e5e-e18344a3cc32 req-0b71dc9f-6ac2-4abf-b5bc-002118cceaf8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124203 Jul 20 04:11:45.692033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=42 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:45.694653 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 618/1271] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:45.711524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-94962366-7405-48ee-9ff5-db12afba893d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:45.712174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-94962366-7405-48ee-9ff5-db12afba893d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:45.728766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94962366-7405-48ee-9ff5-db12afba893d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.731169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94962366-7405-48ee-9ff5-db12afba893d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.736640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94962366-7405-48ee-9ff5-db12afba893d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:45.737536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94962366-7405-48ee-9ff5-db12afba893d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:45.874648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-94962366-7405-48ee-9ff5-db12afba893d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:11:45.956837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ab70da16-331a-411a-91d4-7631362a4a4b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:45.969602 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ab70da16-331a-411a-91d4-7631362a4a4b tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 1.829629 Jul 20 04:11:45.970218 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 654/1272] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:44 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:45.994321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2def4a50-937c-4e4c-bb80-37abf0054290 req-ab2dade2-e878-46ba-afb2-89b3ec81b302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a36a696-8851-4e69-ac90-65e06e37bc2b", "tag": "b7b586b2-e4b3-4e30-bff1-a39da550c591"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:46.051584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2def4a50-937c-4e4c-bb80-37abf0054290 req-ab2dade2-e878-46ba-afb2-89b3ec81b302 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.051955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2def4a50-937c-4e4c-bb80-37abf0054290 req-ab2dade2-e878-46ba-afb2-89b3ec81b302 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.100165 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2def4a50-937c-4e4c-bb80-37abf0054290 req-ab2dade2-e878-46ba-afb2-89b3ec81b302 service nova] Creating event network-changed:b7b586b2-e4b3-4e30-bff1-a39da550c591 for instance 1a36a696-8851-4e69-ac90-65e06e37bc2b on n-h1-760456-11 Jul 20 04:11:46.119031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-2def4a50-937c-4e4c-bb80-37abf0054290 req-ab2dade2-e878-46ba-afb2-89b3ec81b302 service nova] Instance 1a36a696-8851-4e69-ac90-65e06e37bc2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:11:46.168620 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2def4a50-937c-4e4c-bb80-37abf0054290 req-ab2dade2-e878-46ba-afb2-89b3ec81b302 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191739 Jul 20 04:11:46.169957 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 655/1273] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:46.185017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2f3280db-0476-4b7d-9445-8412688b5c9a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.188810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f3280db-0476-4b7d-9445-8412688b5c9a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:46.200267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f3280db-0476-4b7d-9445-8412688b5c9a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.201351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f3280db-0476-4b7d-9445-8412688b5c9a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.202899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f3280db-0476-4b7d-9445-8412688b5c9a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.203574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f3280db-0476-4b7d-9445-8412688b5c9a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.217059 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-94962366-7405-48ee-9ff5-db12afba893d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "DELETE /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 204 len: 0 microversion: 2.1 time: 0.515818 Jul 20 04:11:46.219826 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 619/1274] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:45 2022] DELETE /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:46.233144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40ad179d-73c4-4b03-b75b-223126aa37bb tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:46.234776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40ad179d-73c4-4b03-b75b-223126aa37bb tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:46.248435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40ad179d-73c4-4b03-b75b-223126aa37bb tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.262054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40ad179d-73c4-4b03-b75b-223126aa37bb tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:46.267025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40ad179d-73c4-4b03-b75b-223126aa37bb tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:46.267765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40ad179d-73c4-4b03-b75b-223126aa37bb tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.507309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-40ad179d-73c4-4b03-b75b-223126aa37bb tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.519691 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40ad179d-73c4-4b03-b75b-223126aa37bb tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 1.298253 Jul 20 04:11:47.520341 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 620/1275] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:47.532886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d81734d5-ac3e-499e-95e4-be6051a7d77a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.533552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d81734d5-ac3e-499e-95e4-be6051a7d77a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 062ae2d5-b44a-4064-aef7-0ab665ad2f5c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:47.552522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d81734d5-ac3e-499e-95e4-be6051a7d77a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.557221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d81734d5-ac3e-499e-95e4-be6051a7d77a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.558195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d81734d5-ac3e-499e-95e4-be6051a7d77a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.558717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d81734d5-ac3e-499e-95e4-be6051a7d77a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.576434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2f3280db-0476-4b7d-9445-8412688b5c9a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:47.593873 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2f3280db-0476-4b7d-9445-8412688b5c9a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1540 microversion: 2.1 time: 1.421510 Jul 20 04:11:47.594508 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 656/1276] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:46 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1540 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:47.632927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-52772b19-611f-467c-87dc-616c9a717b5c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:47.636245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-52772b19-611f-467c-87dc-616c9a717b5c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:47.650862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52772b19-611f-467c-87dc-616c9a717b5c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.652662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52772b19-611f-467c-87dc-616c9a717b5c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:47.655596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52772b19-611f-467c-87dc-616c9a717b5c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:47.656561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52772b19-611f-467c-87dc-616c9a717b5c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:48.988913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-52772b19-611f-467c-87dc-616c9a717b5c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:49.000561 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-52772b19-611f-467c-87dc-616c9a717b5c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1372 microversion: 2.1 time: 1.404984 Jul 20 04:11:49.006207 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 657/1277] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1372 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:49.020301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d983502a-37b6-45fd-94e5-a6ace4283da7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:49.022125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d983502a-37b6-45fd-94e5-a6ace4283da7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:49.044223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d983502a-37b6-45fd-94e5-a6ace4283da7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.044694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d983502a-37b6-45fd-94e5-a6ace4283da7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.055405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d983502a-37b6-45fd-94e5-a6ace4283da7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.058650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d983502a-37b6-45fd-94e5-a6ace4283da7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.296870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d81734d5-ac3e-499e-95e4-be6051a7d77a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:49.306541 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d81734d5-ac3e-499e-95e4-be6051a7d77a tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c" status: 200 len: 1475 microversion: 2.1 time: 1.780403 Jul 20 04:11:49.310105 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 621/1278] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:47 2022] GET /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c => generated 1475 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:49.351232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f8098ca5-c537-4ed2-8b36-904332084b4c req-6137f9aa-f3ee-4b35-9006-6b4ec8d4fbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a7ceeb-daba-4132-93a5-95c891a45687", "tag": "1ae0744b-76c2-48e9-882c-17cee7beb535"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:49.375299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f8098ca5-c537-4ed2-8b36-904332084b4c req-6137f9aa-f3ee-4b35-9006-6b4ec8d4fbe8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.378504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f8098ca5-c537-4ed2-8b36-904332084b4c req-6137f9aa-f3ee-4b35-9006-6b4ec8d4fbe8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.401585 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f8098ca5-c537-4ed2-8b36-904332084b4c req-6137f9aa-f3ee-4b35-9006-6b4ec8d4fbe8 service nova] Creating event network-changed:1ae0744b-76c2-48e9-882c-17cee7beb535 for instance b0a7ceeb-daba-4132-93a5-95c891a45687 on n-h1-760456-11 Jul 20 04:11:49.416782 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f8098ca5-c537-4ed2-8b36-904332084b4c req-6137f9aa-f3ee-4b35-9006-6b4ec8d4fbe8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104164 Jul 20 04:11:49.421401 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 622/1279] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:49.436451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a913b65f-db8b-4166-9857-6a4296315629 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:49.437193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a913b65f-db8b-4166-9857-6a4296315629 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:49.451885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a913b65f-db8b-4166-9857-6a4296315629 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.459418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a913b65f-db8b-4166-9857-6a4296315629 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:49.463419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a913b65f-db8b-4166-9857-6a4296315629 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:49.464001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a913b65f-db8b-4166-9857-6a4296315629 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.128639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d983502a-37b6-45fd-94e5-a6ace4283da7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:50.161684 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d983502a-37b6-45fd-94e5-a6ace4283da7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 1.133724 Jul 20 04:11:50.163416 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 658/1280] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:49 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:50.171824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0bf874d4-5e2e-489e-a678-32ed9b56be1c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:50.173895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0bf874d4-5e2e-489e-a678-32ed9b56be1c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:50.191892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0bf874d4-5e2e-489e-a678-32ed9b56be1c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.196875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0bf874d4-5e2e-489e-a678-32ed9b56be1c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.200806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0bf874d4-5e2e-489e-a678-32ed9b56be1c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.207152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0bf874d4-5e2e-489e-a678-32ed9b56be1c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.444971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a913b65f-db8b-4166-9857-6a4296315629 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:50.464741 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a913b65f-db8b-4166-9857-6a4296315629 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 1.041332 Jul 20 04:11:50.468132 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 623/1281] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:49 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:50.486203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e0fa021-3aab-469f-a46c-3837030ef7e5 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:50.487573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e0fa021-3aab-469f-a46c-3837030ef7e5 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:50.502010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0fa021-3aab-469f-a46c-3837030ef7e5 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.502954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0fa021-3aab-469f-a46c-3837030ef7e5 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:50.508582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0fa021-3aab-469f-a46c-3837030ef7e5 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:50.510959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0fa021-3aab-469f-a46c-3837030ef7e5 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.110683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0bf874d4-5e2e-489e-a678-32ed9b56be1c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:51.121860 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0bf874d4-5e2e-489e-a678-32ed9b56be1c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1540 microversion: 2.1 time: 0.956843 Jul 20 04:11:51.136244 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 659/1282] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:50 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1540 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:51.139762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b8a0bda7-6c9c-47ce-8776-f543ea1a3116 req-081bf033-0047-4c32-8adb-4649947c8204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062ae2d5-b44a-4064-aef7-0ab665ad2f5c", "name": "network-vif-deleted", "tag": "6f8db406-db7c-4124-b75e-47dbe2c90aab"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:51.164415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b8a0bda7-6c9c-47ce-8776-f543ea1a3116 req-081bf033-0047-4c32-8adb-4649947c8204 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.165435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b8a0bda7-6c9c-47ce-8776-f543ea1a3116 req-081bf033-0047-4c32-8adb-4649947c8204 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.199579 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b8a0bda7-6c9c-47ce-8776-f543ea1a3116 req-081bf033-0047-4c32-8adb-4649947c8204 service nova] Creating event network-vif-deleted:6f8db406-db7c-4124-b75e-47dbe2c90aab for instance 062ae2d5-b44a-4064-aef7-0ab665ad2f5c on n-h2-760456-11 Jul 20 04:11:51.219835 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b8a0bda7-6c9c-47ce-8776-f543ea1a3116 req-081bf033-0047-4c32-8adb-4649947c8204 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087742 Jul 20 04:11:51.220528 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 660/1283] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:51.235965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1029b540-b700-4b17-bc61-9c7ab6fa0437 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.237549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1029b540-b700-4b17-bc61-9c7ab6fa0437 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 062ae2d5-b44a-4064-aef7-0ab665ad2f5c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:51.254177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1029b540-b700-4b17-bc61-9c7ab6fa0437 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.271851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1029b540-b700-4b17-bc61-9c7ab6fa0437 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.273050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1029b540-b700-4b17-bc61-9c7ab6fa0437 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.273686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1029b540-b700-4b17-bc61-9c7ab6fa0437 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.296462 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-1029b540-b700-4b17-bc61-9c7ab6fa0437 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] HTTP exception thrown: Instance 062ae2d5-b44a-4064-aef7-0ab665ad2f5c could not be found. Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1029b540-b700-4b17-bc61-9c7ab6fa0437 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Request method failure captured: Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c HTTP/1.1 Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-_SLHHBe8zHgPmumqpGQGpfE5LciA5LXldNSzzRGvnFhq4OGvTsggFhLX1dpz26prLgd5YVZZ1DDpeEElNjiN2Kic4UMQWDkK9PyUhI5m2ZW6wgBdxmxlZyocgT836TvA08u269TeLJRQUTi77wIrvb9rmOJYYGhZeh34fdWej1CU Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_95231a9d82164f88b1c6ff355679d292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f508838d58f442dd80ab9f1b5b07b4df Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 062ae2d5-b44a-4064-aef7-0ab665ad2f5c could not be found. Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '062ae2d5-b44a-4064-aef7-0ab665ad2f5c'} Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 062ae2d5-b44a-4064-aef7-0ab665ad2f5c could not be found. Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 062ae2d5-b44a-4064-aef7-0ab665ad2f5c could not be found. Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:51.298522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:51.304426 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:51.304426 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:51.304426 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:51.304426 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:51.304426 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:51.304426 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 062ae2d5-b44a-4064-aef7-0ab665ad2f5c could not be found. Jul 20 04:11:51.304426 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:11:51.322515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1029b540-b700-4b17-bc61-9c7ab6fa0437 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Returning 404 to user: Instance 062ae2d5-b44a-4064-aef7-0ab665ad2f5c could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:51.323795 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1029b540-b700-4b17-bc61-9c7ab6fa0437 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c" status: 404 len: 111 microversion: 2.1 time: 0.101529 Jul 20 04:11:51.324375 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 661/1284] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:51 2022] GET /compute/v2.1/servers/062ae2d5-b44a-4064-aef7-0ab665ad2f5c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:51.334561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4714d1fb-bc2a-411f-937c-095c0d31f1a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.339347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4714d1fb-bc2a-411f-937c-095c0d31f1a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:51.353356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4714d1fb-bc2a-411f-937c-095c0d31f1a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.357807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4714d1fb-bc2a-411f-937c-095c0d31f1a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.359139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4714d1fb-bc2a-411f-937c-095c0d31f1a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.363053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4714d1fb-bc2a-411f-937c-095c0d31f1a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.547483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e0fa021-3aab-469f-a46c-3837030ef7e5 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:51.559840 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e0fa021-3aab-469f-a46c-3837030ef7e5 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1372 microversion: 2.1 time: 1.087046 Jul 20 04:11:51.560999 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 624/1285] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:50 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1372 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:51.585998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-305fbe4a-5342-4fdc-825a-0d2d3e594243 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.600014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-305fbe4a-5342-4fdc-825a-0d2d3e594243 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: 808c1a0c-c593-4ae9-8816-bd7d884a7943] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:51.608149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-305fbe4a-5342-4fdc-825a-0d2d3e594243 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.608950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-305fbe4a-5342-4fdc-825a-0d2d3e594243 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.610179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-305fbe4a-5342-4fdc-825a-0d2d3e594243 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.610941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-305fbe4a-5342-4fdc-825a-0d2d3e594243 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.636349 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-305fbe4a-5342-4fdc-825a-0d2d3e594243 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] HTTP exception thrown: Instance 808c1a0c-c593-4ae9-8816-bd7d884a7943 could not be found. Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-305fbe4a-5342-4fdc-825a-0d2d3e594243 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Request method failure captured: Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 HTTP/1.1 Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-_SLHHBe8zHgPmumqpGQGpfE5LciA5LXldNSzzRGvnFhq4OGvTsggFhLX1dpz26prLgd5YVZZ1DDpeEElNjiN2Kic4UMQWDkK9PyUhI5m2ZW6wgBdxmxlZyocgT836TvA08u269TeLJRQUTi77wIrvb9rmOJYYGhZeh34fdWej1CU Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_95231a9d82164f88b1c6ff355679d292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f508838d58f442dd80ab9f1b5b07b4df Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 808c1a0c-c593-4ae9-8816-bd7d884a7943 could not be found. Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '808c1a0c-c593-4ae9-8816-bd7d884a7943'} Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 808c1a0c-c593-4ae9-8816-bd7d884a7943 could not be found. Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 808c1a0c-c593-4ae9-8816-bd7d884a7943 could not be found. Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:51.638430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:51.645312 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:51.645312 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:51.645312 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:51.645312 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:51.645312 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:51.645312 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 808c1a0c-c593-4ae9-8816-bd7d884a7943 could not be found. Jul 20 04:11:51.645312 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:51.650829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-305fbe4a-5342-4fdc-825a-0d2d3e594243 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Returning 404 to user: Instance 808c1a0c-c593-4ae9-8816-bd7d884a7943 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:51.651933 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-305fbe4a-5342-4fdc-825a-0d2d3e594243 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943" status: 404 len: 111 microversion: 2.1 time: 0.089798 Jul 20 04:11:51.654764 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 625/1286] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:51 2022] GET /compute/v2.1/servers/808c1a0c-c593-4ae9-8816-bd7d884a7943 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:51.675278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3998b89a-49e2-4e58-a702-57638052133c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.684555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3998b89a-49e2-4e58-a702-57638052133c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:51.691923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3998b89a-49e2-4e58-a702-57638052133c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.692882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3998b89a-49e2-4e58-a702-57638052133c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.694406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3998b89a-49e2-4e58-a702-57638052133c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.695106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3998b89a-49e2-4e58-a702-57638052133c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.838954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4714d1fb-bc2a-411f-937c-095c0d31f1a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:51.849857 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4714d1fb-bc2a-411f-937c-095c0d31f1a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 0.521890 Jul 20 04:11:51.857682 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 662/1287] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:51 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:51.869193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dba29683-ce6f-4360-8c89-1a5aa3cc60e1 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.946407 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dba29683-ce6f-4360-8c89-1a5aa3cc60e1 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/43b90a72-1e93-4b1d-846d-9e78f147e47a" status: 204 len: 0 microversion: 2.1 time: 0.087358 Jul 20 04:11:51.951510 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 663/1288] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:11:51 2022] DELETE /compute/v2.1/os-server-groups/43b90a72-1e93-4b1d-846d-9e78f147e47a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:51.959318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c99346bb-4833-4f99-962e-2825c7ae9b8d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:51.961162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c99346bb-4833-4f99-962e-2825c7ae9b8d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:51.969029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c99346bb-4833-4f99-962e-2825c7ae9b8d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.970799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c99346bb-4833-4f99-962e-2825c7ae9b8d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:51.972303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c99346bb-4833-4f99-962e-2825c7ae9b8d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:51.973326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c99346bb-4833-4f99-962e-2825c7ae9b8d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.042175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c99346bb-4833-4f99-962e-2825c7ae9b8d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:11:52.374403 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c99346bb-4833-4f99-962e-2825c7ae9b8d tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 204 len: 0 microversion: 2.1 time: 0.419265 Jul 20 04:11:52.379370 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 664/1289] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:11:51 2022] DELETE /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:11:52.392972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72522ef2-d937-4dd2-a775-26f069464181 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:52.393767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-72522ef2-d937-4dd2-a775-26f069464181 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:52.411447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3998b89a-49e2-4e58-a702-57638052133c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:52.420895 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3998b89a-49e2-4e58-a702-57638052133c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 0.759594 Jul 20 04:11:52.425471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72522ef2-d937-4dd2-a775-26f069464181 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.425951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72522ef2-d937-4dd2-a775-26f069464181 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.427320 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 626/1290] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:51 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:52.427457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72522ef2-d937-4dd2-a775-26f069464181 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.430207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72522ef2-d937-4dd2-a775-26f069464181 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.440647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-efd22039-b6d2-44f7-b5ba-a9b431444da8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:52.440987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-efd22039-b6d2-44f7-b5ba-a9b431444da8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:52.449938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efd22039-b6d2-44f7-b5ba-a9b431444da8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.452071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efd22039-b6d2-44f7-b5ba-a9b431444da8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.468409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efd22039-b6d2-44f7-b5ba-a9b431444da8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:52.469124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efd22039-b6d2-44f7-b5ba-a9b431444da8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:52.965498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72522ef2-d937-4dd2-a775-26f069464181 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:52.975912 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72522ef2-d937-4dd2-a775-26f069464181 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1472 microversion: 2.1 time: 0.594184 Jul 20 04:11:52.989772 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 665/1291] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:52 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1472 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:53.000280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-14ea4e64-47a4-4e32-b8a7-944f19e4efef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:53.001181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-14ea4e64-47a4-4e32-b8a7-944f19e4efef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:53.013046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14ea4e64-47a4-4e32-b8a7-944f19e4efef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.014351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14ea4e64-47a4-4e32-b8a7-944f19e4efef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.022213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14ea4e64-47a4-4e32-b8a7-944f19e4efef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.023428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14ea4e64-47a4-4e32-b8a7-944f19e4efef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.094306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-efd22039-b6d2-44f7-b5ba-a9b431444da8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:53.139858 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-efd22039-b6d2-44f7-b5ba-a9b431444da8 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1472 microversion: 2.1 time: 0.710146 Jul 20 04:11:53.140473 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 627/1292] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:52 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1472 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:53.160727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b0c1077d-22ee-45f5-84a1-4afb8670b8b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:53.165156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b0c1077d-22ee-45f5-84a1-4afb8670b8b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:53.186086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0c1077d-22ee-45f5-84a1-4afb8670b8b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.186574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0c1077d-22ee-45f5-84a1-4afb8670b8b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:53.187377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0c1077d-22ee-45f5-84a1-4afb8670b8b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:53.188796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0c1077d-22ee-45f5-84a1-4afb8670b8b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.038472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0c1077d-22ee-45f5-84a1-4afb8670b8b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:54.052677 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b0c1077d-22ee-45f5-84a1-4afb8670b8b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 0.908724 Jul 20 04:11:54.053633 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 628/1293] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:53 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:54.064458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9bf74b05-bf92-4ee3-9dcb-08868cebe1a3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:54.067449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9bf74b05-bf92-4ee3-9dcb-08868cebe1a3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:54.076359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9bf74b05-bf92-4ee3-9dcb-08868cebe1a3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.077074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9bf74b05-bf92-4ee3-9dcb-08868cebe1a3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.078032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9bf74b05-bf92-4ee3-9dcb-08868cebe1a3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.078763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9bf74b05-bf92-4ee3-9dcb-08868cebe1a3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.329010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-14ea4e64-47a4-4e32-b8a7-944f19e4efef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:54.337103 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-14ea4e64-47a4-4e32-b8a7-944f19e4efef tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1372 microversion: 2.1 time: 1.343190 Jul 20 04:11:54.340945 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 666/1294] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:52 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1372 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:54.350650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-04538f44-923c-4458-8cd0-cd4e1ed6b5ec req-9015404e-be29-4a54-b5de-c2d5bea894f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808c1a0c-c593-4ae9-8816-bd7d884a7943", "name": "network-vif-deleted", "tag": "514d5015-3418-492f-a8e4-09fc0c38b9b9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:54.372759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-04538f44-923c-4458-8cd0-cd4e1ed6b5ec req-9015404e-be29-4a54-b5de-c2d5bea894f8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.379154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-04538f44-923c-4458-8cd0-cd4e1ed6b5ec req-9015404e-be29-4a54-b5de-c2d5bea894f8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.405551 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-04538f44-923c-4458-8cd0-cd4e1ed6b5ec req-9015404e-be29-4a54-b5de-c2d5bea894f8 service nova] Creating event network-vif-deleted:514d5015-3418-492f-a8e4-09fc0c38b9b9 for instance 808c1a0c-c593-4ae9-8816-bd7d884a7943 on n-h2-760456-11 Jul 20 04:11:54.411101 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-04538f44-923c-4458-8cd0-cd4e1ed6b5ec req-9015404e-be29-4a54-b5de-c2d5bea894f8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068778 Jul 20 04:11:54.412849 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 667/1295] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:54.427373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5298cde-c5c2-4bf6-ad8a-2bbef0bef624 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:54.432939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5298cde-c5c2-4bf6-ad8a-2bbef0bef624 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:54.444971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5298cde-c5c2-4bf6-ad8a-2bbef0bef624 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.446857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5298cde-c5c2-4bf6-ad8a-2bbef0bef624 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.449531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5298cde-c5c2-4bf6-ad8a-2bbef0bef624 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.453511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9bf74b05-bf92-4ee3-9dcb-08868cebe1a3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:54.454737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5298cde-c5c2-4bf6-ad8a-2bbef0bef624 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.461670 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9bf74b05-bf92-4ee3-9dcb-08868cebe1a3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 0.406696 Jul 20 04:11:54.465949 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 629/1296] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:54 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:54.473884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c59f904-c8d5-44d8-b764-e187faf47f24 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:54.477998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c59f904-c8d5-44d8-b764-e187faf47f24 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:54.499869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c59f904-c8d5-44d8-b764-e187faf47f24 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.500449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c59f904-c8d5-44d8-b764-e187faf47f24 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.501168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c59f904-c8d5-44d8-b764-e187faf47f24 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.501599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c59f904-c8d5-44d8-b764-e187faf47f24 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.504980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:54.794375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c59f904-c8d5-44d8-b764-e187faf47f24 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:54.816190 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c59f904-c8d5-44d8-b764-e187faf47f24 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1472 microversion: 2.1 time: 0.348563 Jul 20 04:11:54.820678 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 630/1297] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:54 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:54.896884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a5298cde-c5c2-4bf6-ad8a-2bbef0bef624 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:54.905304 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5298cde-c5c2-4bf6-ad8a-2bbef0bef624 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1469 microversion: 2.1 time: 0.489761 Jul 20 04:11:54.914002 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 668/1298] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:54 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1469 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:54.932851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:54.933491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:54.948534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.950066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:54.950920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:54.951373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.052927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.053483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.055882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.056342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.071904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e049dd92-fb85-4b97-af98-e257049ff259 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.073036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e049dd92-fb85-4b97-af98-e257049ff259 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:55.088068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e049dd92-fb85-4b97-af98-e257049ff259 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.088800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e049dd92-fb85-4b97-af98-e257049ff259 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.124057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e049dd92-fb85-4b97-af98-e257049ff259 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.125040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e049dd92-fb85-4b97-af98-e257049ff259 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.146281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:11:55.191622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for user e82ac4df5f844ec4996d939efdba9c11 and project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:11:55.341416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:55.605854 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1f1c99f1-4482-494f-90dd-163879bc7da7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b/action" status: 202 len: 0 microversion: 2.1 time: 0.678117 Jul 20 04:11:55.609527 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 631/1299] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:54 2022] POST /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b/action => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:11:55.619485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ac994680-3092-46bf-bf5d-588be1323df0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.620495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ac994680-3092-46bf-bf5d-588be1323df0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:55.634192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac994680-3092-46bf-bf5d-588be1323df0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.634703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac994680-3092-46bf-bf5d-588be1323df0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.635931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac994680-3092-46bf-bf5d-588be1323df0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.636465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac994680-3092-46bf-bf5d-588be1323df0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.890647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e049dd92-fb85-4b97-af98-e257049ff259 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:55.900465 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e049dd92-fb85-4b97-af98-e257049ff259 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 0.833333 Jul 20 04:11:55.915625 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 669/1300] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:55.934568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e1e3995-3d84-4202-bff0-6be90d58122f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:55.935789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3e1e3995-3d84-4202-bff0-6be90d58122f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:55.965467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e1e3995-3d84-4202-bff0-6be90d58122f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.966092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e1e3995-3d84-4202-bff0-6be90d58122f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:55.967066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e1e3995-3d84-4202-bff0-6be90d58122f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:55.967651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e1e3995-3d84-4202-bff0-6be90d58122f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.404330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ac994680-3092-46bf-bf5d-588be1323df0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:56.418707 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ac994680-3092-46bf-bf5d-588be1323df0 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1372 microversion: 2.1 time: 0.804481 Jul 20 04:11:56.419862 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 632/1301] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1372 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:56.435524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cdf2861e-f2f1-4b24-9c6c-ea1210274ead tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:56.436418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cdf2861e-f2f1-4b24-9c6c-ea1210274ead tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:56.444929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf2861e-f2f1-4b24-9c6c-ea1210274ead tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.445633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf2861e-f2f1-4b24-9c6c-ea1210274ead tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.446637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf2861e-f2f1-4b24-9c6c-ea1210274ead tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:56.447258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf2861e-f2f1-4b24-9c6c-ea1210274ead tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:56.989725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3e1e3995-3d84-4202-bff0-6be90d58122f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.001201 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3e1e3995-3d84-4202-bff0-6be90d58122f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1498 microversion: 2.1 time: 1.082407 Jul 20 04:11:57.005439 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 670/1302] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:55 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1498 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:57.015022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.016716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:57.030314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cdf2861e-f2f1-4b24-9c6c-ea1210274ead tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.036960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.040596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.041625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.045103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.045643 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cdf2861e-f2f1-4b24-9c6c-ea1210274ead tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1468 microversion: 2.1 time: 0.610672 Jul 20 04:11:57.049170 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 633/1303] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:56 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1468 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:57.058118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-715c02ed-3f18-43ad-be8e-f8d7456a3944 req-78a3f9c7-1205-4efa-91ec-1efd09a3aec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc16be0b-acc6-4bec-997a-2f0026a5500e", "name": "network-vif-deleted", "tag": "bd25208d-66ad-4a91-a9ef-2368928833ad"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:57.092428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-715c02ed-3f18-43ad-be8e-f8d7456a3944 req-78a3f9c7-1205-4efa-91ec-1efd09a3aec3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.094153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-715c02ed-3f18-43ad-be8e-f8d7456a3944 req-78a3f9c7-1205-4efa-91ec-1efd09a3aec3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.099360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:57.121309 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-715c02ed-3f18-43ad-be8e-f8d7456a3944 req-78a3f9c7-1205-4efa-91ec-1efd09a3aec3 service nova] Creating event network-vif-deleted:bd25208d-66ad-4a91-a9ef-2368928833ad for instance cc16be0b-acc6-4bec-997a-2f0026a5500e on n-h2-760456-11 Jul 20 04:11:57.138067 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-715c02ed-3f18-43ad-be8e-f8d7456a3944 req-78a3f9c7-1205-4efa-91ec-1efd09a3aec3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086124 Jul 20 04:11:57.139890 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 634/1304] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:11:57.149226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ffa1640f-1269-4f05-aedb-35b336a17c86 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.150211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ffa1640f-1269-4f05-aedb-35b336a17c86 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:57.157699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffa1640f-1269-4f05-aedb-35b336a17c86 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.158521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffa1640f-1269-4f05-aedb-35b336a17c86 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.159775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.161122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.161751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffa1640f-1269-4f05-aedb-35b336a17c86 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.162460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffa1640f-1269-4f05-aedb-35b336a17c86 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.163334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lazy-loading 'fault' on Instance uuid cc16be0b-acc6-4bec-997a-2f0026a5500e {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:11:57.286912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f508838d58f442dd80ab9f1b5b07b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95231a9d82164f88b1c6ff355679d292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.310644 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3947d101-407a-444f-8ef2-599f8726753e tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 200 len: 1307 microversion: 2.1 time: 0.301396 Jul 20 04:11:57.325833 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 671/1305] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 1307 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:57.439849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fcf4aa41-2068-4611-957b-1363afd16f8e tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:57.441672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fcf4aa41-2068-4611-957b-1363afd16f8e tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:57.453864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fcf4aa41-2068-4611-957b-1363afd16f8e tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.456715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fcf4aa41-2068-4611-957b-1363afd16f8e tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.458494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fcf4aa41-2068-4611-957b-1363afd16f8e tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:57.461849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fcf4aa41-2068-4611-957b-1363afd16f8e tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:57.835340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ffa1640f-1269-4f05-aedb-35b336a17c86 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:57.856272 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ffa1640f-1269-4f05-aedb-35b336a17c86 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 0.711753 Jul 20 04:11:57.866210 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 635/1306] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:58.024975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a64f9ec0-4e09-49f3-8257-bfb396a48ae3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:58.025671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a64f9ec0-4e09-49f3-8257-bfb396a48ae3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:58.042142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a64f9ec0-4e09-49f3-8257-bfb396a48ae3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.043938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a64f9ec0-4e09-49f3-8257-bfb396a48ae3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.044884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a64f9ec0-4e09-49f3-8257-bfb396a48ae3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.061699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a64f9ec0-4e09-49f3-8257-bfb396a48ae3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.423400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fcf4aa41-2068-4611-957b-1363afd16f8e tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:58.439192 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fcf4aa41-2068-4611-957b-1363afd16f8e tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1372 microversion: 2.1 time: 1.004061 Jul 20 04:11:58.449739 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 672/1307] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:57 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1372 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:58.449739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ba13851e-482e-4ac4-b5a4-fca2b70ed9d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:58.449739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ba13851e-482e-4ac4-b5a4-fca2b70ed9d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:58.464087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:11:58.469379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba13851e-482e-4ac4-b5a4-fca2b70ed9d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.469949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba13851e-482e-4ac4-b5a4-fca2b70ed9d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.470844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba13851e-482e-4ac4-b5a4-fca2b70ed9d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.471394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba13851e-482e-4ac4-b5a4-fca2b70ed9d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.870095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a64f9ec0-4e09-49f3-8257-bfb396a48ae3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:58.891083 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a64f9ec0-4e09-49f3-8257-bfb396a48ae3 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 200 len: 1475 microversion: 2.1 time: 0.871857 Jul 20 04:11:58.892823 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 636/1308] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:58 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 1475 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:58.927642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a1b7a0d5-cb16-46fc-973a-80e61559ef29 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:58.932543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a1b7a0d5-cb16-46fc-973a-80e61559ef29 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] [instance: cc16be0b-acc6-4bec-997a-2f0026a5500e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:58.952588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1b7a0d5-cb16-46fc-973a-80e61559ef29 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.958238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1b7a0d5-cb16-46fc-973a-80e61559ef29 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:58.966658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1b7a0d5-cb16-46fc-973a-80e61559ef29 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:58.969212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1b7a0d5-cb16-46fc-973a-80e61559ef29 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.012483 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a1b7a0d5-cb16-46fc-973a-80e61559ef29 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] HTTP exception thrown: Instance cc16be0b-acc6-4bec-997a-2f0026a5500e could not be found. Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a1b7a0d5-cb16-46fc-973a-80e61559ef29 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Request method failure captured: Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e HTTP/1.1 Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-_SLHHBe8zHgPmumqpGQGpfE5LciA5LXldNSzzRGvnFhq4OGvTsggFhLX1dpz26prLgd5YVZZ1DDpeEElNjiN2Kic4UMQWDkK9PyUhI5m2ZW6wgBdxmxlZyocgT836TvA08u269TeLJRQUTi77wIrvb9rmOJYYGhZeh34fdWej1CU Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/95231a9d82164f88b1c6ff355679d292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_95231a9d82164f88b1c6ff355679d292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 95231a9d82164f88b1c6ff355679d292 Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1265736496 Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f508838d58f442dd80ab9f1b5b07b4df Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersOnMultiNodesTest-1265736496-project Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance cc16be0b-acc6-4bec-997a-2f0026a5500e could not be found. Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'cc16be0b-acc6-4bec-997a-2f0026a5500e'} Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc16be0b-acc6-4bec-997a-2f0026a5500e could not be found. Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc16be0b-acc6-4bec-997a-2f0026a5500e could not be found. Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:11:59.014586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:59.019776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:11:59.019776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:11:59.019776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:11:59.019776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:11:59.019776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:11:59.019776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc16be0b-acc6-4bec-997a-2f0026a5500e could not be found. Jul 20 04:11:59.019776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:11:59.019776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a1b7a0d5-cb16-46fc-973a-80e61559ef29 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] Returning 404 to user: Instance cc16be0b-acc6-4bec-997a-2f0026a5500e could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:11:59.019776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a1b7a0d5-cb16-46fc-973a-80e61559ef29 tempest-ServersOnMultiNodesTest-1265736496 tempest-ServersOnMultiNodesTest-1265736496-project] 10.222.0.59 "GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e" status: 404 len: 111 microversion: 2.1 time: 0.104753 Jul 20 04:11:59.019776 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 637/1309] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:58 2022] GET /compute/v2.1/servers/cc16be0b-acc6-4bec-997a-2f0026a5500e => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:11:59.038947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e9fc24f-0647-4d29-9903-f63bc18b3436 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:11:59.039725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e9fc24f-0647-4d29-9903-f63bc18b3436 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:59.053092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9fc24f-0647-4d29-9903-f63bc18b3436 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.053801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9fc24f-0647-4d29-9903-f63bc18b3436 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.054351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9fc24f-0647-4d29-9903-f63bc18b3436 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.064177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9fc24f-0647-4d29-9903-f63bc18b3436 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.092768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ba13851e-482e-4ac4-b5a4-fca2b70ed9d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:11:59.110356 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ba13851e-482e-4ac4-b5a4-fca2b70ed9d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1468 microversion: 2.1 time: 0.668029 Jul 20 04:11:59.121704 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 673/1310] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:58 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1468 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:11:59.122855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8bec6fb0-fc57-42da-91da-8673ffb88543 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1905879146"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:11:59.124377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8bec6fb0-fc57-42da-91da-8673ffb88543 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:11:59.144536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bec6fb0-fc57-42da-91da-8673ffb88543 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.147802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bec6fb0-fc57-42da-91da-8673ffb88543 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.149613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bec6fb0-fc57-42da-91da-8673ffb88543 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:11:59.152363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bec6fb0-fc57-42da-91da-8673ffb88543 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:11:59.992596 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8bec6fb0-fc57-42da-91da-8673ffb88543 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340/action" status: 202 len: 0 microversion: 2.1 time: 0.877804 Jul 20 04:11:59.999281 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 674/1311] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:11:59 2022] POST /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340/action => generated 0 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:12:00.014147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-531559df-888a-4a1e-9749-db43b63ee33d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:00.015682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-531559df-888a-4a1e-9749-db43b63ee33d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:00.045826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-531559df-888a-4a1e-9749-db43b63ee33d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.046889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-531559df-888a-4a1e-9749-db43b63ee33d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.048516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-531559df-888a-4a1e-9749-db43b63ee33d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.049188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-531559df-888a-4a1e-9749-db43b63ee33d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.700555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-531559df-888a-4a1e-9749-db43b63ee33d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.707175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e9fc24f-0647-4d29-9903-f63bc18b3436 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:00.710017 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-531559df-888a-4a1e-9749-db43b63ee33d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1372 microversion: 2.1 time: 0.709147 Jul 20 04:12:00.713808 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 675/1312] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:59 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1372 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:00.727562 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e9fc24f-0647-4d29-9903-f63bc18b3436 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 1.700577 Jul 20 04:12:00.730054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5579a4a9-481a-4dc8-b7df-0921496b1157 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8422d4d30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:00.735897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 638/1313] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:11:59 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:00.742614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c58494f7-c292-44eb-927a-33208ab176f1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:00.746010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c58494f7-c292-44eb-927a-33208ab176f1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:00.762771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c58494f7-c292-44eb-927a-33208ab176f1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.763437 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c58494f7-c292-44eb-927a-33208ab176f1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.764429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c58494f7-c292-44eb-927a-33208ab176f1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:00.765023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c58494f7-c292-44eb-927a-33208ab176f1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:00.828681 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5579a4a9-481a-4dc8-b7df-0921496b1157 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.113394 Jul 20 04:12:00.834489 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 676/1314] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:00 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:01.395895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f9f46f08-7506-4a6e-9f3a-8f9314ba2341 req-246505a2-c6f4-4d42-887c-eef52c544664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0079fbd3-9f24-447a-8331-0823b53255ac", "name": "network-vif-plugged", "status": "completed", "tag": "7bde46c1-9c2f-458d-a411-c6bd6b2efd84"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:01.416956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f9f46f08-7506-4a6e-9f3a-8f9314ba2341 req-246505a2-c6f4-4d42-887c-eef52c544664 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.417415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f9f46f08-7506-4a6e-9f3a-8f9314ba2341 req-246505a2-c6f4-4d42-887c-eef52c544664 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.428031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c58494f7-c292-44eb-927a-33208ab176f1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:01.452249 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c58494f7-c292-44eb-927a-33208ab176f1 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1468 microversion: 2.1 time: 0.711761 Jul 20 04:12:01.465423 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 639/1315] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:00 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1468 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:01.466074 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f9f46f08-7506-4a6e-9f3a-8f9314ba2341 req-246505a2-c6f4-4d42-887c-eef52c544664 service nova] Creating event network-vif-plugged:7bde46c1-9c2f-458d-a411-c6bd6b2efd84 for instance 0079fbd3-9f24-447a-8331-0823b53255ac on n-h1-760456-11 Jul 20 04:12:01.481019 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f9f46f08-7506-4a6e-9f3a-8f9314ba2341 req-246505a2-c6f4-4d42-887c-eef52c544664 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090538 Jul 20 04:12:01.481972 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 677/1316] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:12:01.742436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6eea8ef2-047a-447a-9360-81ed46d871ae tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.743427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6eea8ef2-047a-447a-9360-81ed46d871ae tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:01.745563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6cd19a41-c774-4444-83e6-badc3ab54d94 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:01.746523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6cd19a41-c774-4444-83e6-badc3ab54d94 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:01.772024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cd19a41-c774-4444-83e6-badc3ab54d94 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.772485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cd19a41-c774-4444-83e6-badc3ab54d94 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.780742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6eea8ef2-047a-447a-9360-81ed46d871ae tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.782557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cd19a41-c774-4444-83e6-badc3ab54d94 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.783112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cd19a41-c774-4444-83e6-badc3ab54d94 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.784364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6eea8ef2-047a-447a-9360-81ed46d871ae tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:01.789346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6eea8ef2-047a-447a-9360-81ed46d871ae tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:01.792321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6eea8ef2-047a-447a-9360-81ed46d871ae tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.305883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6eea8ef2-047a-447a-9360-81ed46d871ae tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:02.313912 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6eea8ef2-047a-447a-9360-81ed46d871ae tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1372 microversion: 2.1 time: 0.588334 Jul 20 04:12:02.331643 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 640/1317] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1372 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:02.341177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-17830bfc-0770-41fd-953a-742b1cf7cb16 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8420240d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.827726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6cd19a41-c774-4444-83e6-badc3ab54d94 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:02.836798 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6cd19a41-c774-4444-83e6-badc3ab54d94 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 1.095367 Jul 20 04:12:02.846721 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 678/1318] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:01 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:02.852792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e30e24b7-bf7b-423d-b9c3-a532dd08ae67 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:02.855418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e30e24b7-bf7b-423d-b9c3-a532dd08ae67 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:02.888702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e30e24b7-bf7b-423d-b9c3-a532dd08ae67 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.889176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e30e24b7-bf7b-423d-b9c3-a532dd08ae67 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.889997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e30e24b7-bf7b-423d-b9c3-a532dd08ae67 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:02.890469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e30e24b7-bf7b-423d-b9c3-a532dd08ae67 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:02.926281 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-17830bfc-0770-41fd-953a-742b1cf7cb16 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.592038 Jul 20 04:12:02.926880 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 641/1319] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:03.335038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16dbde91-88f7-40d2-91b6-6930b54273cb tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:03.335932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16dbde91-88f7-40d2-91b6-6930b54273cb tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:03.364466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16dbde91-88f7-40d2-91b6-6930b54273cb tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.367196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16dbde91-88f7-40d2-91b6-6930b54273cb tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.369919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16dbde91-88f7-40d2-91b6-6930b54273cb tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:03.371594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16dbde91-88f7-40d2-91b6-6930b54273cb tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:03.959397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-16dbde91-88f7-40d2-91b6-6930b54273cb tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:03.969560 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16dbde91-88f7-40d2-91b6-6930b54273cb tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1557 microversion: 2.1 time: 0.639246 Jul 20 04:12:03.979641 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 642/1320] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:03 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1557 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:03.992481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f47d1ded-b453-42dc-8931-28e58fa91738 req-b8ed646e-da51-4c26-8eaa-66c38c02fb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a7ceeb-daba-4132-93a5-95c891a45687", "name": "network-vif-plugged", "status": "completed", "tag": "1ae0744b-76c2-48e9-882c-17cee7beb535"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:04.011638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f47d1ded-b453-42dc-8931-28e58fa91738 req-b8ed646e-da51-4c26-8eaa-66c38c02fb79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.012354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f47d1ded-b453-42dc-8931-28e58fa91738 req-b8ed646e-da51-4c26-8eaa-66c38c02fb79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.046621 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f47d1ded-b453-42dc-8931-28e58fa91738 req-b8ed646e-da51-4c26-8eaa-66c38c02fb79 service nova] Creating event network-vif-plugged:1ae0744b-76c2-48e9-882c-17cee7beb535 for instance b0a7ceeb-daba-4132-93a5-95c891a45687 on n-h1-760456-11 Jul 20 04:12:04.073922 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f47d1ded-b453-42dc-8931-28e58fa91738 req-b8ed646e-da51-4c26-8eaa-66c38c02fb79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092813 Jul 20 04:12:04.077904 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 643/1321] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:04.088510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-99de2243-11fa-4f0b-9068-78addb9d9ddf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:04.091808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-99de2243-11fa-4f0b-9068-78addb9d9ddf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:04.096382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e30e24b7-bf7b-423d-b9c3-a532dd08ae67 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:04.109472 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e30e24b7-bf7b-423d-b9c3-a532dd08ae67 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1534 microversion: 2.1 time: 1.261150 Jul 20 04:12:04.116561 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 679/1322] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:02 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1534 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:04.125627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-106b044c-995c-4e20-b54c-a9f331f8c4ee tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842230ee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:04.129820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99de2243-11fa-4f0b-9068-78addb9d9ddf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.130305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99de2243-11fa-4f0b-9068-78addb9d9ddf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.131382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99de2243-11fa-4f0b-9068-78addb9d9ddf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.131826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99de2243-11fa-4f0b-9068-78addb9d9ddf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.906026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-99de2243-11fa-4f0b-9068-78addb9d9ddf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:04.926695 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-99de2243-11fa-4f0b-9068-78addb9d9ddf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 0.846909 Jul 20 04:12:04.928482 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 644/1323] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:04 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:04.945223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b418ad40-753c-4776-87c9-4a016620b8f4 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:04.946684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b418ad40-753c-4776-87c9-4a016620b8f4 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:04.965492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b418ad40-753c-4776-87c9-4a016620b8f4 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.966116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b418ad40-753c-4776-87c9-4a016620b8f4 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:04.978181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b418ad40-753c-4776-87c9-4a016620b8f4 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:04.978782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b418ad40-753c-4776-87c9-4a016620b8f4 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.130436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:05.247839 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b418ad40-753c-4776-87c9-4a016620b8f4 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.317989 Jul 20 04:12:05.257959 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 645/1324] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:12:04 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-interface => generated 284 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:05.264382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-383e6ed3-a1f7-4a2f-848a-681556f78261 req-d6a8da12-9bfc-4423-a1e1-4c6229b90978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a36a696-8851-4e69-ac90-65e06e37bc2b", "tag": "b7b586b2-e4b3-4e30-bff1-a39da550c591"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:05.293664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-383e6ed3-a1f7-4a2f-848a-681556f78261 req-d6a8da12-9bfc-4423-a1e1-4c6229b90978 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.294980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-383e6ed3-a1f7-4a2f-848a-681556f78261 req-d6a8da12-9bfc-4423-a1e1-4c6229b90978 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.339789 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-383e6ed3-a1f7-4a2f-848a-681556f78261 req-d6a8da12-9bfc-4423-a1e1-4c6229b90978 service nova] Creating event network-changed:b7b586b2-e4b3-4e30-bff1-a39da550c591 for instance 1a36a696-8851-4e69-ac90-65e06e37bc2b on n-h2-760456-11 Jul 20 04:12:05.352259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-383e6ed3-a1f7-4a2f-848a-681556f78261 req-d6a8da12-9bfc-4423-a1e1-4c6229b90978 service nova] Instance 1a36a696-8851-4e69-ac90-65e06e37bc2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:12:05.382539 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-383e6ed3-a1f7-4a2f-848a-681556f78261 req-d6a8da12-9bfc-4423-a1e1-4c6229b90978 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122269 Jul 20 04:12:05.384127 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 646/1325] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:05.396998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8289a71d-12d8-442d-9c96-58a674bca528 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:05.397733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8289a71d-12d8-442d-9c96-58a674bca528 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:05.423229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8289a71d-12d8-442d-9c96-58a674bca528 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.425347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8289a71d-12d8-442d-9c96-58a674bca528 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.426589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8289a71d-12d8-442d-9c96-58a674bca528 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.428033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8289a71d-12d8-442d-9c96-58a674bca528 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.491344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:05.864416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8289a71d-12d8-442d-9c96-58a674bca528 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:05.880056 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8289a71d-12d8-442d-9c96-58a674bca528 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1534 microversion: 2.1 time: 0.494678 Jul 20 04:12:05.883862 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 647/1326] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:05 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1534 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:05.950779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa1e2237-8fae-478a-a305-2171ff4c6302 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:05.957205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aa1e2237-8fae-478a-a305-2171ff4c6302 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:05.983068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa1e2237-8fae-478a-a305-2171ff4c6302 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.984323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa1e2237-8fae-478a-a305-2171ff4c6302 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:05.990237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa1e2237-8fae-478a-a305-2171ff4c6302 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:05.993210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa1e2237-8fae-478a-a305-2171ff4c6302 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:06.308610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aa1e2237-8fae-478a-a305-2171ff4c6302 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:06.317006 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aa1e2237-8fae-478a-a305-2171ff4c6302 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1360 microversion: 2.1 time: 0.374936 Jul 20 04:12:06.317588 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 648/1327] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:05 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1360 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:07.145319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f2c1b0d4-bb75-44f7-be0e-75d94f2a2c92 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: .version_select at 0x7fb841f65940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2105687423", "description": "tempest-description-2047501275"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:07.558953 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f2c1b0d4-bb75-44f7-be0e-75d94f2a2c92 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.240227 Jul 20 04:12:07.559566 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 649/1328] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:07.678519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75298fa9-a310-4005-83e2-906c7684e4c9 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Action: 'update', calling method: .version_select at 0x7fb84226e430>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:07.681222 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:07.681222 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:07.686305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75298fa9-a310-4005-83e2-906c7684e4c9 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.689009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75298fa9-a310-4005-83e2-906c7684e4c9 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.714096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75298fa9-a310-4005-83e2-906c7684e4c9 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.715096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75298fa9-a310-4005-83e2-906c7684e4c9 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.739570 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-75298fa9-a310-4005-83e2-906c7684e4c9 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] HTTP exception thrown: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75298fa9-a310-4005-83e2-906c7684e4c9 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Request method failure captured: Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: request: PUT /compute/v2.1/os-services/8566d2e5-3be2-42a3-beed-5930e5bfca07 HTTP/1.1 Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 56 Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWwbGppYlPRnNVG65qkl364_qpbOgAzET2ovKJuftvAP5vGEbiGxRx8yM7dpFTf7j-3FQK2poW9jbTdZTUFQxFl439qdsVysm2RJ9MNFIAJtesR2soR-5gNMheIynAtlslV8XLBioXYz6ZG4-Di2_ZxFoOsFczcSA91Yei7e1ViJo Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4ff3336cc6304c9d813261b9158b34e0 Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1285530034 Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1285530034 Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4ff3336cc6304c9d813261b9158b34e0 Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1285530034 Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e635f6cb17134f23b314f466c92a79ed Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: exception: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8566d2e5-3be2-42a3-beed-5930e5bfca07', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:12:07.746390 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:07.752014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:07.757262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75298fa9-a310-4005-83e2-906c7684e4c9 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Returning 404 to user: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:07.760356 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75298fa9-a310-4005-83e2-906c7684e4c9 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-services/8566d2e5-3be2-42a3-beed-5930e5bfca07" status: 404 len: 110 microversion: 2.53 time: 0.199423 Jul 20 04:12:07.764215 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 650/1329] 10.222.0.59 () {62 vars in 1308 bytes} [Wed Jul 20 04:12:07 2022] PUT /compute/v2.1/os-services/8566d2e5-3be2-42a3-beed-5930e5bfca07 => generated 110 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:12:07.775998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-04d61220-6a37-4520-8b38-ccc610b35f16 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:07.781727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-04d61220-6a37-4520-8b38-ccc610b35f16 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:07.798578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04d61220-6a37-4520-8b38-ccc610b35f16 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.800365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04d61220-6a37-4520-8b38-ccc610b35f16 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:07.803486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04d61220-6a37-4520-8b38-ccc610b35f16 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:07.807074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04d61220-6a37-4520-8b38-ccc610b35f16 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:08.242826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-04d61220-6a37-4520-8b38-ccc610b35f16 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:08.272985 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-04d61220-6a37-4520-8b38-ccc610b35f16 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1534 microversion: 2.1 time: 0.506810 Jul 20 04:12:08.276439 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 651/1330] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:07 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1534 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:08.287452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d954161-0e00-4517-9d4b-ad2f02fa9d17 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:08.288599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d954161-0e00-4517-9d4b-ad2f02fa9d17 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:08.302400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d954161-0e00-4517-9d4b-ad2f02fa9d17 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:08.303117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d954161-0e00-4517-9d4b-ad2f02fa9d17 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:08.304272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d954161-0e00-4517-9d4b-ad2f02fa9d17 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:08.304889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d954161-0e00-4517-9d4b-ad2f02fa9d17 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:08.691990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d954161-0e00-4517-9d4b-ad2f02fa9d17 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:08.717041 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d954161-0e00-4517-9d4b-ad2f02fa9d17 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1542 microversion: 2.1 time: 0.437598 Jul 20 04:12:08.719330 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 652/1331] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:08 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1542 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:08.725738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7dfd4e7-40eb-45b1-9430-a8b51ef15142 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: .version_select at 0x7fb841f4f940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1310808578", "description": "tempest-description-1376214904"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:09.081749 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b7dfd4e7-40eb-45b1-9430-a8b51ef15142 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.360960 Jul 20 04:12:09.104885 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 653/1332] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:09.112416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0fe08068-3e2e-4a33-9cb7-d30484a44eae tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Action: 'update', calling method: .version_select at 0x7fb841f7e940>, body: {"status": "disabled"} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:09.123855 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:09.123855 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:09.124933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0fe08068-3e2e-4a33-9cb7-d30484a44eae tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.125389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0fe08068-3e2e-4a33-9cb7-d30484a44eae tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.169248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0fe08068-3e2e-4a33-9cb7-d30484a44eae tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.170370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0fe08068-3e2e-4a33-9cb7-d30484a44eae tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.201259 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-0fe08068-3e2e-4a33-9cb7-d30484a44eae tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] HTTP exception thrown: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0fe08068-3e2e-4a33-9cb7-d30484a44eae tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Request method failure captured: Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: request: PUT /compute/v2.1/os-services/8566d2e5-3be2-42a3-beed-5930e5bfca07 HTTP/1.1 Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 22 Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWwbGppYlPRnNVG65qkl364_qpbOgAzET2ovKJuftvAP5vGEbiGxRx8yM7dpFTf7j-3FQK2poW9jbTdZTUFQxFl439qdsVysm2RJ9MNFIAJtesR2soR-5gNMheIynAtlslV8XLBioXYz6ZG4-Di2_ZxFoOsFczcSA91Yei7e1ViJo Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4ff3336cc6304c9d813261b9158b34e0 Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1285530034 Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1285530034 Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4ff3336cc6304c9d813261b9158b34e0 Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1285530034 Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e635f6cb17134f23b314f466c92a79ed Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: {"status": "disabled"} Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: exception: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8566d2e5-3be2-42a3-beed-5930e5bfca07', 'body': {'status': 'disabled'}} Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:12:09.206046 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0fe08068-3e2e-4a33-9cb7-d30484a44eae tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Returning 404 to user: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0fe08068-3e2e-4a33-9cb7-d30484a44eae tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-services/8566d2e5-3be2-42a3-beed-5930e5bfca07" status: 404 len: 110 microversion: 2.53 time: 0.111885 Jul 20 04:12:09.213630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 654/1333] 10.222.0.59 () {62 vars in 1308 bytes} [Wed Jul 20 04:12:09 2022] PUT /compute/v2.1/os-services/8566d2e5-3be2-42a3-beed-5930e5bfca07 => generated 110 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:12:09.261210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-aa1bdfba-df59-4041-a74b-d60bdeede998 req-c54c0a88-2c78-425d-947a-09f7b79cd213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ac1ca0-13df-42f1-a6dd-c8f8fcb92340", "name": "network-vif-plugged", "status": "completed", "tag": "ad5a7fda-bddf-4601-824c-60a7451ad16c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:09.275505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-aa1bdfba-df59-4041-a74b-d60bdeede998 req-c54c0a88-2c78-425d-947a-09f7b79cd213 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.276239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-aa1bdfba-df59-4041-a74b-d60bdeede998 req-c54c0a88-2c78-425d-947a-09f7b79cd213 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.290145 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-aa1bdfba-df59-4041-a74b-d60bdeede998 req-c54c0a88-2c78-425d-947a-09f7b79cd213 service nova] Creating event network-vif-plugged:ad5a7fda-bddf-4601-824c-60a7451ad16c for instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 on n-h1-760456-11 Jul 20 04:12:09.303625 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-aa1bdfba-df59-4041-a74b-d60bdeede998 req-c54c0a88-2c78-425d-947a-09f7b79cd213 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070134 Jul 20 04:12:09.304881 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 655/1334] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:09.310644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a8f590bd-df35-4da0-b233-16bfb0d6b838 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:09.312236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a8f590bd-df35-4da0-b233-16bfb0d6b838 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:09.323181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8f590bd-df35-4da0-b233-16bfb0d6b838 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.324479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8f590bd-df35-4da0-b233-16bfb0d6b838 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.325815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8f590bd-df35-4da0-b233-16bfb0d6b838 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.326564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8f590bd-df35-4da0-b233-16bfb0d6b838 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.465733 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a8f590bd-df35-4da0-b233-16bfb0d6b838 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159184 Jul 20 04:12:09.467686 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 656/1335] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:12:09 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:09.474074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-875fbb80-c12b-4539-9ebd-eddecc627898 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Action: 'update', calling method: .version_select at 0x7fb841f4f040>, body: {"status": "enabled"} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:09.478282 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:09.478282 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:09.488243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-875fbb80-c12b-4539-9ebd-eddecc627898 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.489146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-875fbb80-c12b-4539-9ebd-eddecc627898 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.509242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-875fbb80-c12b-4539-9ebd-eddecc627898 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:09.516723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-875fbb80-c12b-4539-9ebd-eddecc627898 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:09.540788 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-875fbb80-c12b-4539-9ebd-eddecc627898 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] HTTP exception thrown: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-875fbb80-c12b-4539-9ebd-eddecc627898 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Request method failure captured: Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: request: PUT /compute/v2.1/os-services/8566d2e5-3be2-42a3-beed-5930e5bfca07 HTTP/1.1 Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 21 Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWwbGppYlPRnNVG65qkl364_qpbOgAzET2ovKJuftvAP5vGEbiGxRx8yM7dpFTf7j-3FQK2poW9jbTdZTUFQxFl439qdsVysm2RJ9MNFIAJtesR2soR-5gNMheIynAtlslV8XLBioXYz6ZG4-Di2_ZxFoOsFczcSA91Yei7e1ViJo Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4ff3336cc6304c9d813261b9158b34e0 Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1285530034 Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4ff3336cc6304c9d813261b9158b34e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1285530034 Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4ff3336cc6304c9d813261b9158b34e0 Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1285530034 Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e635f6cb17134f23b314f466c92a79ed Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: {"status": "enabled"} Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: exception: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8566d2e5-3be2-42a3-beed-5930e5bfca07', 'body': {'status': 'enabled'}} Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:12:09.553310 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. Jul 20 04:12:09.557768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:09.566315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-875fbb80-c12b-4539-9ebd-eddecc627898 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Returning 404 to user: Service 8566d2e5-3be2-42a3-beed-5930e5bfca07 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:09.570923 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-875fbb80-c12b-4539-9ebd-eddecc627898 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-services/8566d2e5-3be2-42a3-beed-5930e5bfca07" status: 404 len: 110 microversion: 2.53 time: 0.099692 Jul 20 04:12:09.581555 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 657/1336] 10.222.0.59 () {62 vars in 1308 bytes} [Wed Jul 20 04:12:09 2022] PUT /compute/v2.1/os-services/8566d2e5-3be2-42a3-beed-5930e5bfca07 => generated 110 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:12:09.597283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1152647045", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "24279765-8c7d-49e8-a577-95b4ec8373a0"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:11.165045 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-106b044c-995c-4e20-b54c-a9f331f8c4ee tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 7.045987 Jul 20 04:12:11.165657 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 680/1337] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:04 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 7049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:11.180733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] validate_networks() for [('24279765-8c7d-49e8-a577-95b4ec8373a0', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:11.181471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06ebd45b-b33b-426c-a8d6-0dfd8f5ca07a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:11.182110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-06ebd45b-b33b-426c-a8d6-0dfd8f5ca07a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:11.216187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06ebd45b-b33b-426c-a8d6-0dfd8f5ca07a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.223364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06ebd45b-b33b-426c-a8d6-0dfd8f5ca07a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:11.225710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06ebd45b-b33b-426c-a8d6-0dfd8f5ca07a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:11.226710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06ebd45b-b33b-426c-a8d6-0dfd8f5ca07a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.619376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-06ebd45b-b33b-426c-a8d6-0dfd8f5ca07a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:12.634459 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-06ebd45b-b33b-426c-a8d6-0dfd8f5ca07a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1527 microversion: 2.1 time: 1.465814 Jul 20 04:12:12.643036 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 681/1338] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:11 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1527 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:12.657069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dfa7d0ae-6b63-46e5-9d65-2208dde97d0c tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.659551 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:12.659551 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:12:12.673436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfa7d0ae-6b63-46e5-9d65-2208dde97d0c tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.675542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfa7d0ae-6b63-46e5-9d65-2208dde97d0c tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.679267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfa7d0ae-6b63-46e5-9d65-2208dde97d0c tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:12.682550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfa7d0ae-6b63-46e5-9d65-2208dde97d0c tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:12.814005 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dfa7d0ae-6b63-46e5-9d65-2208dde97d0c tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.169443 Jul 20 04:12:12.824150 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 682/1339] 10.222.0.59 () {60 vars in 1177 bytes} [Wed Jul 20 04:12:12 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:12.838104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c6d77b2b-2228-4c59-bcda-723140d4bf8a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8421e71f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:12.960214 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c6d77b2b-2228-4c59-bcda-723140d4bf8a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.134063 Jul 20 04:12:12.964151 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 683/1340] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:12 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:12.977556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b91e28ad-907d-4fe7-af2a-f981dfb78be7 req-6dc719e6-24b2-4f44-9eb7-5c084fbe88be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0079fbd3-9f24-447a-8331-0823b53255ac", "tag": "7bde46c1-9c2f-458d-a411-c6bd6b2efd84"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:13.010929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b91e28ad-907d-4fe7-af2a-f981dfb78be7 req-6dc719e6-24b2-4f44-9eb7-5c084fbe88be service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.011384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b91e28ad-907d-4fe7-af2a-f981dfb78be7 req-6dc719e6-24b2-4f44-9eb7-5c084fbe88be service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.031949 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b91e28ad-907d-4fe7-af2a-f981dfb78be7 req-6dc719e6-24b2-4f44-9eb7-5c084fbe88be service nova] Creating event network-changed:7bde46c1-9c2f-458d-a411-c6bd6b2efd84 for instance 0079fbd3-9f24-447a-8331-0823b53255ac on n-h1-760456-11 Jul 20 04:12:13.041660 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b91e28ad-907d-4fe7-af2a-f981dfb78be7 req-6dc719e6-24b2-4f44-9eb7-5c084fbe88be service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074748 Jul 20 04:12:13.046880 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 684/1341] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:13.063753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08c73ff9-e32b-4451-a2b2-5adcde2e5127 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.065749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-08c73ff9-e32b-4451-a2b2-5adcde2e5127 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:13.077795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08c73ff9-e32b-4451-a2b2-5adcde2e5127 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.081509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08c73ff9-e32b-4451-a2b2-5adcde2e5127 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.082637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08c73ff9-e32b-4451-a2b2-5adcde2e5127 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.085509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08c73ff9-e32b-4451-a2b2-5adcde2e5127 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.244534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:13.245136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:13.245756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:13.249152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:13.249739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:13.285606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.286230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.291625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.293296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.373690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Getting quotas for project 2152dc59b4bb4b40bab36a32b782e70b. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:13.388795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Getting quotas for user aebf32ff7a3146f0a29ac97b5d868794 and project 2152dc59b4bb4b40bab36a32b782e70b. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:13.410924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:13.413952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:13.497931 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c055fc96-7d41-4338-b22a-49ff57fcccc5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.913618 Jul 20 04:12:13.504718 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 658/1342] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:13.514177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-97b91a72-2c10-4d7a-8e51-2124f47a3536 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.516049 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:13.516049 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:13.521038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97b91a72-2c10-4d7a-8e51-2124f47a3536 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.530999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97b91a72-2c10-4d7a-8e51-2124f47a3536 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.532162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97b91a72-2c10-4d7a-8e51-2124f47a3536 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.532753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97b91a72-2c10-4d7a-8e51-2124f47a3536 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.588222 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-97b91a72-2c10-4d7a-8e51-2124f47a3536 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.081787 Jul 20 04:12:13.597307 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 659/1343] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:13.607902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5e716dec-5a42-456f-a84e-de61a116993d req-bf0eaf79-c6d9-47b7-b53c-1612b2864384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a7ceeb-daba-4132-93a5-95c891a45687", "tag": "1ae0744b-76c2-48e9-882c-17cee7beb535"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:13.634651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5e716dec-5a42-456f-a84e-de61a116993d req-bf0eaf79-c6d9-47b7-b53c-1612b2864384 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.635410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5e716dec-5a42-456f-a84e-de61a116993d req-bf0eaf79-c6d9-47b7-b53c-1612b2864384 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.675394 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5e716dec-5a42-456f-a84e-de61a116993d req-bf0eaf79-c6d9-47b7-b53c-1612b2864384 service nova] Creating event network-changed:1ae0744b-76c2-48e9-882c-17cee7beb535 for instance b0a7ceeb-daba-4132-93a5-95c891a45687 on n-h1-760456-11 Jul 20 04:12:13.691649 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5e716dec-5a42-456f-a84e-de61a116993d req-bf0eaf79-c6d9-47b7-b53c-1612b2864384 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092676 Jul 20 04:12:13.692264 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 660/1344] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:13.728879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d9995022-d006-4c83-b86b-c3afb744ce44 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.729574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d9995022-d006-4c83-b86b-c3afb744ce44 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:13.904967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d9995022-d006-4c83-b86b-c3afb744ce44 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:13.916173 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d9995022-d006-4c83-b86b-c3afb744ce44 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1216 microversion: 2.1 time: 0.197751 Jul 20 04:12:13.928468 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 661/1345] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1216 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:13.941459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d88c93f6-1243-44e3-a7ac-4b22ea449019 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:13.954562 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:13.954562 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:13.957115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d88c93f6-1243-44e3-a7ac-4b22ea449019 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.958436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d88c93f6-1243-44e3-a7ac-4b22ea449019 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:13.959352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d88c93f6-1243-44e3-a7ac-4b22ea449019 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:13.959796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d88c93f6-1243-44e3-a7ac-4b22ea449019 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.035138 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d88c93f6-1243-44e3-a7ac-4b22ea449019 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.105429 Jul 20 04:12:14.036098 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 662/1346] 10.222.0.59 () {60 vars in 1177 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:14.046547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d2840a08-bce5-4773-a93d-48eba65e164e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f4e820>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.150511 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d2840a08-bce5-4773-a93d-48eba65e164e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.113289 Jul 20 04:12:14.151356 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 663/1347] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:14.165407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-233e7c36-0179-457c-b077-c726451fddc7 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.167860 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:14.167860 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:14.169160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-233e7c36-0179-457c-b077-c726451fddc7 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.169617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-233e7c36-0179-457c-b077-c726451fddc7 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.170483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-233e7c36-0179-457c-b077-c726451fddc7 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.170922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-233e7c36-0179-457c-b077-c726451fddc7 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.282692 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-233e7c36-0179-457c-b077-c726451fddc7 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?host=n-d-760456-11&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.126316 Jul 20 04:12:14.287190 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 664/1348] 10.222.0.59 () {60 vars in 1236 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/os-services?host=n-d-760456-11&binary=xxx => generated 16 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:14.307095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-15626ead-580f-4ef8-bfe4-a6caaa3455c3 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.315317 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:14.315317 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:14.323470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15626ead-580f-4ef8-bfe4-a6caaa3455c3 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.325880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15626ead-580f-4ef8-bfe4-a6caaa3455c3 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.329681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15626ead-580f-4ef8-bfe4-a6caaa3455c3 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.331579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15626ead-580f-4ef8-bfe4-a6caaa3455c3 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.395175 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-15626ead-580f-4ef8-bfe4-a6caaa3455c3 tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.103515 Jul 20 04:12:14.399283 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 665/1349] 10.222.0.59 () {60 vars in 1177 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:14.413419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f9bb256a-6eda-4be6-a415-97705c1ee57b tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.414787 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:14.414787 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:14.416279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9bb256a-6eda-4be6-a415-97705c1ee57b tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.419767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9bb256a-6eda-4be6-a415-97705c1ee57b tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.423374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9bb256a-6eda-4be6-a415-97705c1ee57b tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.424844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9bb256a-6eda-4be6-a415-97705c1ee57b tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.460144 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f9bb256a-6eda-4be6-a415-97705c1ee57b tempest-ServicesAdminNegativeV253TestJSON-1285530034 tempest-ServicesAdminNegativeV253TestJSON-1285530034-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.052019 Jul 20 04:12:14.463561 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 666/1350] 10.222.0.59 () {60 vars in 1238 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:14.775549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cca803d7-45d2-428d-9ce3-55af1edbf6ac tempest-ServicesAdminNegativeV253TestJSON-1639053501 tempest-ServicesAdminNegativeV253TestJSON-1639053501-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.778713 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:14.778713 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:14.780272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cca803d7-45d2-428d-9ce3-55af1edbf6ac tempest-ServicesAdminNegativeV253TestJSON-1639053501 tempest-ServicesAdminNegativeV253TestJSON-1639053501-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '26a32c81a5734a3d83d6adcb406d2892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8e9ffc335c4e71966704a93310278d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cca803d7-45d2-428d-9ce3-55af1edbf6ac tempest-ServicesAdminNegativeV253TestJSON-1639053501 tempest-ServicesAdminNegativeV253TestJSON-1639053501-project] Request method failure captured: Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CVP8xM0BQHaslbvSjEjN1Skipt6ft9hUwYM6iqWEISN4W9EOKq1ZjvGB95j2KfeCLPX3MCkTzBNlXJjrBN7M6NbEwxD7HQMsMns3806StwXmQ42bLJ69RZUQ3ywREZDiqg8j-u4w70GXaI089F6BQduOiAjVNFaieESMqqMcLNPJA Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: db8e9ffc335c4e71966704a93310278d Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1639053501 Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db8e9ffc335c4e71966704a93310278d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db8e9ffc335c4e71966704a93310278d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db8e9ffc335c4e71966704a93310278d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db8e9ffc335c4e71966704a93310278d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1639053501 Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: db8e9ffc335c4e71966704a93310278d Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1639053501 Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1639053501-project Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 26a32c81a5734a3d83d6adcb406d2892 Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1639053501-project Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: action_args: {} Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:12:14.782020 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cca803d7-45d2-428d-9ce3-55af1edbf6ac tempest-ServicesAdminNegativeV253TestJSON-1639053501 tempest-ServicesAdminNegativeV253TestJSON-1639053501-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cca803d7-45d2-428d-9ce3-55af1edbf6ac tempest-ServicesAdminNegativeV253TestJSON-1639053501 tempest-ServicesAdminNegativeV253TestJSON-1639053501-project] 10.222.0.59 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.311867 Jul 20 04:12:14.787617 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 667/1351] 10.222.0.59 () {60 vars in 1177 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/os-services => generated 112 bytes in 314 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:12:14.938586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cce72601-9170-4d49-ace1-effe96f7e225 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:14.939410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cce72601-9170-4d49-ace1-effe96f7e225 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:14.967885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cce72601-9170-4d49-ace1-effe96f7e225 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.968473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cce72601-9170-4d49-ace1-effe96f7e225 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:14.976551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cce72601-9170-4d49-ace1-effe96f7e225 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:14.977162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cce72601-9170-4d49-ace1-effe96f7e225 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:15.200705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cce72601-9170-4d49-ace1-effe96f7e225 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:15.215604 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cce72601-9170-4d49-ace1-effe96f7e225 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1220 microversion: 2.1 time: 0.281878 Jul 20 04:12:15.225245 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 668/1352] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:14 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1220 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:15.247481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-866e0a2f-17eb-4e5e-8909-a5376e7d80e7 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f7eaf0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.384702 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-866e0a2f-17eb-4e5e-8909-a5376e7d80e7 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.158185 Jul 20 04:12:15.394641 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 669/1353] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:15 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.547983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-08c73ff9-e32b-4451-a2b2-5adcde2e5127 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:15.558517 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08c73ff9-e32b-4451-a2b2-5adcde2e5127 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1527 microversion: 2.1 time: 2.509922 Jul 20 04:12:15.561807 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 685/1354] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:13 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1527 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:15.579534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-74dc5267-70f0-4bbd-b666-0e81b7b120d7 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:15.580970 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:15.580970 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:15.597243 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-74dc5267-70f0-4bbd-b666-0e81b7b120d7 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] HTTP exception thrown: Flavor d58c74e9-1b39-41fd-98a4-32662fbf74ee could not be found. Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-74dc5267-70f0-4bbd-b666-0e81b7b120d7 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Request method failure captured: Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/flavors/d58c74e9-1b39-41fd-98a4-32662fbf74ee HTTP/1.1 Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-oTfFu5QzLUug4RDQAYfIJeImIO8tqSWwR7Txp74YUXo7z8s6JcpXkrs3Bib4mhhf8TUrIyttw6tH_QDdvFoEKzqn0W1yVE6zF3i7euolIIZM6uuXiY6PmaN7WTAXj8zo4Q3V5FrNlkqa2b1O1wupV7hJpK4YGMQhsW5TnO7ObygU Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 85d1c878f033455faa4920d840e07769 Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-MigrationsAdminTest-1790905836 Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/85d1c878f033455faa4920d840e07769"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/85d1c878f033455faa4920d840e07769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/85d1c878f033455faa4920d840e07769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_85d1c878f033455faa4920d840e07769"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-MigrationsAdminTest-1790905836 Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 85d1c878f033455faa4920d840e07769 Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-MigrationsAdminTest-1790905836 Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-MigrationsAdminTest-1790905836-project-admin Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 76ca70f286324a98b7589d76b890fa00 Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-MigrationsAdminTest-1790905836-project-admin Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: exception: Flavor d58c74e9-1b39-41fd-98a4-32662fbf74ee could not be found. Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'd58c74e9-1b39-41fd-98a4-32662fbf74ee'} Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d58c74e9-1b39-41fd-98a4-32662fbf74ee could not be found. Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor d58c74e9-1b39-41fd-98a4-32662fbf74ee could not be found. Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:15.613075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:15.618214 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:15.618214 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:15.618214 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:15.618214 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:15.618214 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:15.618214 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:15.618214 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d58c74e9-1b39-41fd-98a4-32662fbf74ee could not be found. Jul 20 04:12:15.618214 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:15.618214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-74dc5267-70f0-4bbd-b666-0e81b7b120d7 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Returning 404 to user: Flavor d58c74e9-1b39-41fd-98a4-32662fbf74ee could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:15.618214 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-74dc5267-70f0-4bbd-b666-0e81b7b120d7 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/d58c74e9-1b39-41fd-98a4-32662fbf74ee" status: 404 len: 109 microversion: 2.1 time: 0.039963 Jul 20 04:12:15.623009 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 670/1355] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:12:15 2022] DELETE /compute/v2.1/flavors/d58c74e9-1b39-41fd-98a4-32662fbf74ee => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:15.899979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-666271632", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:16.051333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:16.097526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1007949384", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "d7df1a6a-edf6-4e43-8286-ec664673f3ed"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:16.266879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] validate_networks() for [('d7df1a6a-edf6-4e43-8286-ec664673f3ed', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:17.177467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:17.178531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:17.179226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:17.179826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:17.180486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:17.197568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.198437 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.199625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.200383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.230105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:17.239979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Getting quotas for user e82ac4df5f844ec4996d939efdba9c11 and project 443f09d183854727bdf9fe467f2ac8fd. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:17.258166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:17.262340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:17.279669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:17.343196 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e753626-79e8-46dd-b28c-c532d239189c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.445746 Jul 20 04:12:17.346957 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 671/1356] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:17.358349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3624aca-1c4a-41e0-8f0d-e1e68d8c19de tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.375036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3624aca-1c4a-41e0-8f0d-e1e68d8c19de tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:17.389069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3624aca-1c4a-41e0-8f0d-e1e68d8c19de tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.389882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3624aca-1c4a-41e0-8f0d-e1e68d8c19de tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.392140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3624aca-1c4a-41e0-8f0d-e1e68d8c19de tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.393506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3624aca-1c4a-41e0-8f0d-e1e68d8c19de tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.537135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3624aca-1c4a-41e0-8f0d-e1e68d8c19de tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:17.552842 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3624aca-1c4a-41e0-8f0d-e1e68d8c19de tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1274 microversion: 2.1 time: 0.204547 Jul 20 04:12:17.566622 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 672/1357] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:17 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1274 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:17.577340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba19acad-f366-4d98-92fa-029d87303b09 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f4f5e0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.762084 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ba19acad-f366-4d98-92fa-029d87303b09 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.192766 Jul 20 04:12:17.771804 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 673/1358] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:17 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:17.778534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1d097cfc-6767-41f5-a3e5-772cd090ae62 req-83f05be0-1a12-4cdc-9ee3-9dc9f88f7eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a36a696-8851-4e69-ac90-65e06e37bc2b", "name": "network-vif-plugged", "status": "completed", "tag": "b7b586b2-e4b3-4e30-bff1-a39da550c591"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:17.790874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1d097cfc-6767-41f5-a3e5-772cd090ae62 req-83f05be0-1a12-4cdc-9ee3-9dc9f88f7eb9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:17.791999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1d097cfc-6767-41f5-a3e5-772cd090ae62 req-83f05be0-1a12-4cdc-9ee3-9dc9f88f7eb9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:17.811167 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1d097cfc-6767-41f5-a3e5-772cd090ae62 req-83f05be0-1a12-4cdc-9ee3-9dc9f88f7eb9 service nova] Creating event network-vif-plugged:b7b586b2-e4b3-4e30-bff1-a39da550c591 for instance 1a36a696-8851-4e69-ac90-65e06e37bc2b on n-h2-760456-11 Jul 20 04:12:17.844521 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1d097cfc-6767-41f5-a3e5-772cd090ae62 req-83f05be0-1a12-4cdc-9ee3-9dc9f88f7eb9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047986 Jul 20 04:12:17.848725 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 674/1359] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:17.859289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-15186e5b-f168-4b00-90e2-798c72b68bad tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:17.860751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-15186e5b-f168-4b00-90e2-798c72b68bad tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:18.042512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-15186e5b-f168-4b00-90e2-798c72b68bad tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:18.062016 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-15186e5b-f168-4b00-90e2-798c72b68bad tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1212 microversion: 2.1 time: 0.209250 Jul 20 04:12:18.064054 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 675/1360] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:17 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1212 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:18.594523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-539499ff-2c46-41c8-a89e-307169b84924 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:18.601274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-539499ff-2c46-41c8-a89e-307169b84924 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:18.625363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-539499ff-2c46-41c8-a89e-307169b84924 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.627583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-539499ff-2c46-41c8-a89e-307169b84924 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.631082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-539499ff-2c46-41c8-a89e-307169b84924 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.631850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-539499ff-2c46-41c8-a89e-307169b84924 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.812244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-539499ff-2c46-41c8-a89e-307169b84924 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:18.846414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:18.847602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:18.853278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:18.854095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:18.854911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:18.870337 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-539499ff-2c46-41c8-a89e-307169b84924 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1274 microversion: 2.1 time: 0.293424 Jul 20 04:12:18.886004 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 676/1361] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:18 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1274 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:18.904810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.907618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.909007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ae19818-a116-4506-8135-324bfb9a15e0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f4f040>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:18.912201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:18.914054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:18.978545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Getting quotas for project d2323a93fbfb432f81cd11b542380af8. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:18.990619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Getting quotas for user df3e2faf94584fc99a59e3839e18f8b1 and project d2323a93fbfb432f81cd11b542380af8. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:19.009825 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ae19818-a116-4506-8135-324bfb9a15e0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.121418 Jul 20 04:12:19.014675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:19.018730 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 677/1362] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:18 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:19.025952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:19.080910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-222a8ca5-f7d8-429c-8b32-2913eedbcb38 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:19.081966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-222a8ca5-f7d8-429c-8b32-2913eedbcb38 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:19.098029 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-78582ff2-42ee-4cb1-a7f3-05b5371721a8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.393198 Jul 20 04:12:19.098703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-222a8ca5-f7d8-429c-8b32-2913eedbcb38 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.099424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-222a8ca5-f7d8-429c-8b32-2913eedbcb38 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.103444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-222a8ca5-f7d8-429c-8b32-2913eedbcb38 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.104370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-222a8ca5-f7d8-429c-8b32-2913eedbcb38 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.115347 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 686/1363] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3413 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:12:19.165130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4d0ab420-a43f-4ed5-9212-b7033ebe94e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:19.165786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4d0ab420-a43f-4ed5-9212-b7033ebe94e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:19.274871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-222a8ca5-f7d8-429c-8b32-2913eedbcb38 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:19.288828 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-222a8ca5-f7d8-429c-8b32-2913eedbcb38 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1264 microversion: 2.1 time: 0.213352 Jul 20 04:12:19.299276 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 678/1364] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:19 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:19.408152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4d0ab420-a43f-4ed5-9212-b7033ebe94e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:19.421322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4d0ab420-a43f-4ed5-9212-b7033ebe94e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:19.430598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4d0ab420-a43f-4ed5-9212-b7033ebe94e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:19.432994 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4d0ab420-a43f-4ed5-9212-b7033ebe94e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1262 microversion: 2.25 time: 0.295444 Jul 20 04:12:19.434022 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 687/1365] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:19 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1262 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:19.892848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a5356220-50de-4b54-8afc-47d23abae12b tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:19.893463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a5356220-50de-4b54-8afc-47d23abae12b tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:19.905325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5356220-50de-4b54-8afc-47d23abae12b tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.905787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5356220-50de-4b54-8afc-47d23abae12b tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:19.906598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5356220-50de-4b54-8afc-47d23abae12b tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:19.907214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5356220-50de-4b54-8afc-47d23abae12b tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.031728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d1f29cf-eea1-40ea-9cb7-9ea259dd1300 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8421f83a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.162148 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d1f29cf-eea1-40ea-9cb7-9ea259dd1300 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.134080 Jul 20 04:12:20.163234 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 688/1366] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:20.306214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d59d10e-b0f6-4a34-83e8-cff3e61768c6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.306904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5d59d10e-b0f6-4a34-83e8-cff3e61768c6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.320893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d59d10e-b0f6-4a34-83e8-cff3e61768c6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.321423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d59d10e-b0f6-4a34-83e8-cff3e61768c6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.322277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d59d10e-b0f6-4a34-83e8-cff3e61768c6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.322732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d59d10e-b0f6-4a34-83e8-cff3e61768c6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.340083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a5356220-50de-4b54-8afc-47d23abae12b tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.350550 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a5356220-50de-4b54-8afc-47d23abae12b tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1316 microversion: 2.1 time: 0.462085 Jul 20 04:12:20.359134 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 679/1367] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:19 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:20.453175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-50ec34f0-9131-4d86-910a-d36ee2843ed7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:20.453785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-50ec34f0-9131-4d86-910a-d36ee2843ed7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:20.466666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50ec34f0-9131-4d86-910a-d36ee2843ed7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.479049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50ec34f0-9131-4d86-910a-d36ee2843ed7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.487717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50ec34f0-9131-4d86-910a-d36ee2843ed7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:20.488176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50ec34f0-9131-4d86-910a-d36ee2843ed7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:20.555720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5d59d10e-b0f6-4a34-83e8-cff3e61768c6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.565282 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d59d10e-b0f6-4a34-83e8-cff3e61768c6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1270 microversion: 2.1 time: 0.262369 Jul 20 04:12:20.571007 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 689/1368] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1270 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:20.675797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-50ec34f0-9131-4d86-910a-d36ee2843ed7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.686544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-50ec34f0-9131-4d86-910a-d36ee2843ed7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.701476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-50ec34f0-9131-4d86-910a-d36ee2843ed7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:20.706087 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-50ec34f0-9131-4d86-910a-d36ee2843ed7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1266 microversion: 2.25 time: 0.253698 Jul 20 04:12:20.712130 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 680/1369] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:20 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:21.176351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a7de9d0a-074b-407d-b31b-a47e1ec23361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb84233eb80>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:21.290696 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a7de9d0a-074b-407d-b31b-a47e1ec23361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.115764 Jul 20 04:12:21.292209 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 690/1370] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:21 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:21.375660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd18e600-253a-445f-8a4d-fc2e4cf12d4a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:21.377554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd18e600-253a-445f-8a4d-fc2e4cf12d4a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:21.390459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd18e600-253a-445f-8a4d-fc2e4cf12d4a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.405546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd18e600-253a-445f-8a4d-fc2e4cf12d4a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.406393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd18e600-253a-445f-8a4d-fc2e4cf12d4a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.406847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd18e600-253a-445f-8a4d-fc2e4cf12d4a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.589332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ad27048d-43b3-4999-911e-21b427296fb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:21.590732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ad27048d-43b3-4999-911e-21b427296fb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:21.603029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad27048d-43b3-4999-911e-21b427296fb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.604345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad27048d-43b3-4999-911e-21b427296fb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:21.605668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad27048d-43b3-4999-911e-21b427296fb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:21.607707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad27048d-43b3-4999-911e-21b427296fb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.650425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ad27048d-43b3-4999-911e-21b427296fb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:22.659819 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ad27048d-43b3-4999-911e-21b427296fb7 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1312 microversion: 2.1 time: 1.075338 Jul 20 04:12:22.672669 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 691/1371] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:21 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1312 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:22.687291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-46a49464-6d64-438b-be53-84afd53db6b5 req-d68489bb-5a17-4733-a973-d8120ab37ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12b3f11-eda1-41ed-b619-b4ffe2b3a5de", "tag": "224f96bf-13e6-432c-ace2-bcb6f2691dc5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:22.711637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-46a49464-6d64-438b-be53-84afd53db6b5 req-d68489bb-5a17-4733-a973-d8120ab37ee8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.724132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-46a49464-6d64-438b-be53-84afd53db6b5 req-d68489bb-5a17-4733-a973-d8120ab37ee8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.766402 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-46a49464-6d64-438b-be53-84afd53db6b5 req-d68489bb-5a17-4733-a973-d8120ab37ee8 service nova] Creating event network-changed:224f96bf-13e6-432c-ace2-bcb6f2691dc5 for instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de on n-h2-760456-11 Jul 20 04:12:22.776019 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-46a49464-6d64-438b-be53-84afd53db6b5 req-d68489bb-5a17-4733-a973-d8120ab37ee8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101183 Jul 20 04:12:22.778686 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 692/1372] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:22.811509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72aabc01-1431-4f2f-b10a-770280312137 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:22.812897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-72aabc01-1431-4f2f-b10a-770280312137 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:22.861098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aabc01-1431-4f2f-b10a-770280312137 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.863201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aabc01-1431-4f2f-b10a-770280312137 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:22.868363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aabc01-1431-4f2f-b10a-770280312137 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:22.878856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aabc01-1431-4f2f-b10a-770280312137 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.151830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd18e600-253a-445f-8a4d-fc2e4cf12d4a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.163227 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd18e600-253a-445f-8a4d-fc2e4cf12d4a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1316 microversion: 2.1 time: 1.792268 Jul 20 04:12:23.174494 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 681/1373] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:21 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1316 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:23.188311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9846ea74-6bfe-4d81-ace9-828418d60d6e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f4f160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.227167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72aabc01-1431-4f2f-b10a-770280312137 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.254965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72aabc01-1431-4f2f-b10a-770280312137 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.258909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72aabc01-1431-4f2f-b10a-770280312137 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:23.260204 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72aabc01-1431-4f2f-b10a-770280312137 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1320 microversion: 2.25 time: 0.480092 Jul 20 04:12:23.274470 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 693/1374] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:22 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:23.328590 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9846ea74-6bfe-4d81-ace9-828418d60d6e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.145468 Jul 20 04:12:23.329706 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 682/1375] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:23 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:23.679791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f6ae518-efd7-45f9-8909-80bab477b388 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:23.682199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8f6ae518-efd7-45f9-8909-80bab477b388 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:23.699234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f6ae518-efd7-45f9-8909-80bab477b388 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.700232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f6ae518-efd7-45f9-8909-80bab477b388 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:23.704901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f6ae518-efd7-45f9-8909-80bab477b388 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:23.705928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f6ae518-efd7-45f9-8909-80bab477b388 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.019789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8f6ae518-efd7-45f9-8909-80bab477b388 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.035104 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8f6ae518-efd7-45f9-8909-80bab477b388 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1312 microversion: 2.1 time: 0.359074 Jul 20 04:12:24.035807 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 694/1376] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:23 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.183256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bdfe69f9-f14c-4cd5-985b-1fe523f20ce8 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.184886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bdfe69f9-f14c-4cd5-985b-1fe523f20ce8 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:24.197258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdfe69f9-f14c-4cd5-985b-1fe523f20ce8 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.200201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdfe69f9-f14c-4cd5-985b-1fe523f20ce8 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.202753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdfe69f9-f14c-4cd5-985b-1fe523f20ce8 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.204311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdfe69f9-f14c-4cd5-985b-1fe523f20ce8 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.288627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0da36c5d-313c-4e44-9c9a-c00b4d7fbdb6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.289268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0da36c5d-313c-4e44-9c9a-c00b4d7fbdb6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:24.305855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0da36c5d-313c-4e44-9c9a-c00b4d7fbdb6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.306184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0da36c5d-313c-4e44-9c9a-c00b4d7fbdb6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.309075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0da36c5d-313c-4e44-9c9a-c00b4d7fbdb6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:24.312455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0da36c5d-313c-4e44-9c9a-c00b4d7fbdb6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:24.744182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bdfe69f9-f14c-4cd5-985b-1fe523f20ce8 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.758850 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bdfe69f9-f14c-4cd5-985b-1fe523f20ce8 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1316 microversion: 2.1 time: 0.582070 Jul 20 04:12:24.766829 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 683/1377] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1316 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:24.775369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e57df5af-c712-458f-bea1-f1d442d467d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f7eaf0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:24.797284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0da36c5d-313c-4e44-9c9a-c00b4d7fbdb6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.816928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:24.824568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0da36c5d-313c-4e44-9c9a-c00b4d7fbdb6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.828468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0da36c5d-313c-4e44-9c9a-c00b4d7fbdb6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:24.831732 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0da36c5d-313c-4e44-9c9a-c00b4d7fbdb6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.547338 Jul 20 04:12:24.832730 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 695/1378] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:24.862495 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e57df5af-c712-458f-bea1-f1d442d467d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.101418 Jul 20 04:12:24.869929 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 684/1379] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:25.054141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-71ea6d5c-85eb-4825-9547-73baa6764c17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.055889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-71ea6d5c-85eb-4825-9547-73baa6764c17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:25.098916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71ea6d5c-85eb-4825-9547-73baa6764c17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.101127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71ea6d5c-85eb-4825-9547-73baa6764c17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.134128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71ea6d5c-85eb-4825-9547-73baa6764c17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.136720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71ea6d5c-85eb-4825-9547-73baa6764c17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.152878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:25.315635 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26e869c8-4322-4524-a6ea-72d1b8781a2c tempest-TenantUsagesNegativeTestJSON-128749332 tempest-TenantUsagesNegativeTestJSON-128749332-project-admin] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-19T04%3A12%3A24.511699&end=2022-07-21T04%3A12%3A24.511699" status: 404 len: 112 microversion: - time: 0.466149 Jul 20 04:12:25.317752 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 696/1380] 10.222.0.59 () {58 vars in 1315 bytes} [Wed Jul 20 04:12:24 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-19T04%3A12%3A24.511699&end=2022-07-21T04%3A12%3A24.511699 => generated 112 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:12:25.474025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f4e4dea9-891f-4d1d-8eb5-84ed205b7e41 req-68427042-6c3e-49fc-9387-9bf0131de6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9", "tag": "b4437382-d813-4ba5-b42b-466403da1026"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:25.518584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f4e4dea9-891f-4d1d-8eb5-84ed205b7e41 req-68427042-6c3e-49fc-9387-9bf0131de6c8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.519065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f4e4dea9-891f-4d1d-8eb5-84ed205b7e41 req-68427042-6c3e-49fc-9387-9bf0131de6c8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.541597 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f4e4dea9-891f-4d1d-8eb5-84ed205b7e41 req-68427042-6c3e-49fc-9387-9bf0131de6c8 service nova] Creating event network-changed:b4437382-d813-4ba5-b42b-466403da1026 for instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 on n-h2-760456-11 Jul 20 04:12:25.556723 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f4e4dea9-891f-4d1d-8eb5-84ed205b7e41 req-68427042-6c3e-49fc-9387-9bf0131de6c8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230574 Jul 20 04:12:25.557784 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 697/1381] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:25.579934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5a32720-d2cd-4fcc-8e16-cf5a14a809e1 tempest-TenantUsagesNegativeTestJSON-128749332 tempest-TenantUsagesNegativeTestJSON-128749332-project-admin] Calling method '.version_select at 0x7fb8421e5c10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.598199 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a5a32720-d2cd-4fcc-8e16-cf5a14a809e1 tempest-TenantUsagesNegativeTestJSON-128749332 tempest-TenantUsagesNegativeTestJSON-128749332-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5a32720-d2cd-4fcc-8e16-cf5a14a809e1 tempest-TenantUsagesNegativeTestJSON-128749332 tempest-TenantUsagesNegativeTestJSON-128749332-project-admin] Request method failure captured: Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-simple-tenant-usage/834908c8edd64e4b80dc4e9ed0539e13?start=2022-07-21T04%3A12%3A24.511699&end=2022-07-19T04%3A12%3A24.511699 HTTP/1.1 Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14CoXC9-18V28g90mlcIZZnyJJYvc3vrV-v_UsV5MAmTxRH8Pfzk_3q88oE7K3-p_U1L0XdIizDenpeZO5ARpBFvPa8lodRRfOqcG2u82tuCIO0YTz8dXbHQgfunzFZFKd42dfJ6_kwXF9xl2nAqj8lriqSBpptEBvERJLJG3DySHJI Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 0791c0fd2701461f9ede5fc590d0f5d0 Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-128749332 Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0791c0fd2701461f9ede5fc590d0f5d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0791c0fd2701461f9ede5fc590d0f5d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0791c0fd2701461f9ede5fc590d0f5d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0791c0fd2701461f9ede5fc590d0f5d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-128749332 Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 0791c0fd2701461f9ede5fc590d0f5d0 Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-128749332 Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TenantUsagesNegativeTestJSON-128749332-project-admin Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 511097118d664eb997518345e94f5e93 Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-128749332-project-admin Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid start time. The start time cannot occur after the end time. Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '834908c8edd64e4b80dc4e9ed0539e13'} Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 20 04:12:25.617517 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:25.632161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5a32720-d2cd-4fcc-8e16-cf5a14a809e1 tempest-TenantUsagesNegativeTestJSON-128749332 tempest-TenantUsagesNegativeTestJSON-128749332-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:25.636617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5a32720-d2cd-4fcc-8e16-cf5a14a809e1 tempest-TenantUsagesNegativeTestJSON-128749332 tempest-TenantUsagesNegativeTestJSON-128749332-project-admin] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage/834908c8edd64e4b80dc4e9ed0539e13?start=2022-07-21T04%3A12%3A24.511699&end=2022-07-19T04%3A12%3A24.511699" status: 400 len: 111 microversion: 2.1 time: 0.068543 Jul 20 04:12:25.637583 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 698/1382] 10.222.0.59 () {58 vars in 1411 bytes} [Wed Jul 20 04:12:25 2022] GET /compute/v2.1/os-simple-tenant-usage/834908c8edd64e4b80dc4e9ed0539e13?start=2022-07-21T04%3A12%3A24.511699&end=2022-07-19T04%3A12%3A24.511699 => generated 111 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:12:25.900529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bf232bf8-4e7d-40cd-aab4-780de839efa8 tempest-TenantUsagesNegativeTestJSON-133355346 tempest-TenantUsagesNegativeTestJSON-133355346-project] Calling method '.version_select at 0x7fb84233ec10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.905321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bf232bf8-4e7d-40cd-aab4-780de839efa8 tempest-TenantUsagesNegativeTestJSON-133355346 tempest-TenantUsagesNegativeTestJSON-133355346-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '065eade570fe4361afe5dbe59502e6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834908c8edd64e4b80dc4e9ed0539e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bf232bf8-4e7d-40cd-aab4-780de839efa8 tempest-TenantUsagesNegativeTestJSON-133355346 tempest-TenantUsagesNegativeTestJSON-133355346-project] Request method failure captured: Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A12%3A24.511699&end=2022-07-21T04%3A12%3A24.511699&detailed=1 HTTP/1.1 Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Cn5Xcs-PmpywgFmjAgtEXbIW8BsZ7UXWkhusZXjJYSC5X2jG0Tt1UCSRFSqtzymNooQzcL9Pa4xdRZHOfRuXOtnM1SqaGkcoKvMmprU_plyoYYSI-FRua1R86TBX1eFiowbJ6UyP4af6lL1oAOMb8FLSKRzs9reXUcu40eKk64YOQ Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 834908c8edd64e4b80dc4e9ed0539e13 Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-133355346 Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/834908c8edd64e4b80dc4e9ed0539e13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/834908c8edd64e4b80dc4e9ed0539e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/834908c8edd64e4b80dc4e9ed0539e13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_834908c8edd64e4b80dc4e9ed0539e13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-133355346 Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 834908c8edd64e4b80dc4e9ed0539e13 Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-133355346 Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TenantUsagesNegativeTestJSON-133355346-project Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 065eade570fe4361afe5dbe59502e6d2 Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-133355346-project Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: action_args: {} Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:12:25.909037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:12:25.914120 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:25.916105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bf232bf8-4e7d-40cd-aab4-780de839efa8 tempest-TenantUsagesNegativeTestJSON-133355346 tempest-TenantUsagesNegativeTestJSON-133355346-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:25.917291 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bf232bf8-4e7d-40cd-aab4-780de839efa8 tempest-TenantUsagesNegativeTestJSON-133355346 tempest-TenantUsagesNegativeTestJSON-133355346-project] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A12%3A24.511699&end=2022-07-21T04%3A12%3A24.511699&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.272983 Jul 20 04:12:25.918738 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 699/1383] 10.222.0.59 () {58 vars in 1334 bytes} [Wed Jul 20 04:12:25 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A12%3A24.511699&end=2022-07-21T04%3A12%3A24.511699&detailed=1 => generated 123 bytes in 275 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:25.944492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e890459e-af25-4e1c-bb5c-ce269c5f3116 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:25.949178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e890459e-af25-4e1c-bb5c-ce269c5f3116 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:25.966040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e890459e-af25-4e1c-bb5c-ce269c5f3116 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.966907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e890459e-af25-4e1c-bb5c-ce269c5f3116 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:25.970818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e890459e-af25-4e1c-bb5c-ce269c5f3116 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:25.972435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e890459e-af25-4e1c-bb5c-ce269c5f3116 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.250654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-71ea6d5c-85eb-4825-9547-73baa6764c17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.264672 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-71ea6d5c-85eb-4825-9547-73baa6764c17 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1312 microversion: 2.1 time: 1.216617 Jul 20 04:12:26.267372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e890459e-af25-4e1c-bb5c-ce269c5f3116 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.275601 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e890459e-af25-4e1c-bb5c-ce269c5f3116 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1316 microversion: 2.1 time: 0.354883 Jul 20 04:12:26.287197 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 685/1384] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:25 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1312 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:26.287903 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 700/1385] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:25 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:26.293083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ba0bbf4e-8b43-4110-8a2a-38d1a287a489 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8422de280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.304330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bc4838c3-c550-47d1-bb6c-0f74e80ace7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:26.304861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bc4838c3-c550-47d1-bb6c-0f74e80ace7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:26.335522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc4838c3-c550-47d1-bb6c-0f74e80ace7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.335821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc4838c3-c550-47d1-bb6c-0f74e80ace7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.360309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc4838c3-c550-47d1-bb6c-0f74e80ace7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:26.362897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc4838c3-c550-47d1-bb6c-0f74e80ace7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:26.373641 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ba0bbf4e-8b43-4110-8a2a-38d1a287a489 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.084407 Jul 20 04:12:26.375001 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 701/1386] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:26 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:26.796426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc4838c3-c550-47d1-bb6c-0f74e80ace7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.807293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc4838c3-c550-47d1-bb6c-0f74e80ace7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.815760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc4838c3-c550-47d1-bb6c-0f74e80ace7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:26.817958 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bc4838c3-c550-47d1-bb6c-0f74e80ace7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.535542 Jul 20 04:12:26.846693 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 686/1387] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:26 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:27.292398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6c02cfe-90d4-4a92-82a0-3f45a586e09a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.293045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6c02cfe-90d4-4a92-82a0-3f45a586e09a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:27.294803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d0300318-e098-483d-8166-4cc1cd6ec3fe tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.295651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d0300318-e098-483d-8166-4cc1cd6ec3fe tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:27.308210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=20 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:27.315730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0300318-e098-483d-8166-4cc1cd6ec3fe tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.316204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0300318-e098-483d-8166-4cc1cd6ec3fe tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.322049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6c02cfe-90d4-4a92-82a0-3f45a586e09a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.322518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6c02cfe-90d4-4a92-82a0-3f45a586e09a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.322750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0300318-e098-483d-8166-4cc1cd6ec3fe tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.324223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0300318-e098-483d-8166-4cc1cd6ec3fe tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.333542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6c02cfe-90d4-4a92-82a0-3f45a586e09a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.334379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6c02cfe-90d4-4a92-82a0-3f45a586e09a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.745382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6c02cfe-90d4-4a92-82a0-3f45a586e09a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:27.767956 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6c02cfe-90d4-4a92-82a0-3f45a586e09a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1312 microversion: 2.1 time: 0.485306 Jul 20 04:12:27.783444 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 702/1388] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1312 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:27.794484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-81ae1ea4-3bfd-4d09-be91-b5dfe415206b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb84290a550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.899263 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-81ae1ea4-3bfd-4d09-be91-b5dfe415206b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.114781 Jul 20 04:12:27.900428 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 703/1389] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:27.917178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f6327285-07d6-437b-a071-c888c6f4099c req-09a98338-fb5c-427a-84cc-8522ec4cedaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00cd136f-c79e-422a-b3ea-b8b6e73aa96d", "tag": "c78a3349-2e55-45c6-9808-0b45347d0b3b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:27.935593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f6327285-07d6-437b-a071-c888c6f4099c req-09a98338-fb5c-427a-84cc-8522ec4cedaf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:27.936412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f6327285-07d6-437b-a071-c888c6f4099c req-09a98338-fb5c-427a-84cc-8522ec4cedaf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:27.958916 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f6327285-07d6-437b-a071-c888c6f4099c req-09a98338-fb5c-427a-84cc-8522ec4cedaf service nova] Creating event network-changed:c78a3349-2e55-45c6-9808-0b45347d0b3b for instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d on n-h2-760456-11 Jul 20 04:12:27.960572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d0300318-e098-483d-8166-4cc1cd6ec3fe tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:27.965850 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f6327285-07d6-437b-a071-c888c6f4099c req-09a98338-fb5c-427a-84cc-8522ec4cedaf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063909 Jul 20 04:12:27.967075 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 704/1390] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:27.972209 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d0300318-e098-483d-8166-4cc1cd6ec3fe tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1316 microversion: 2.1 time: 0.681135 Jul 20 04:12:27.972767 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 687/1391] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1316 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:27.984313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9903644a-b0f3-4e5b-b08a-df216e6e0df4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:27.985030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9903644a-b0f3-4e5b-b08a-df216e6e0df4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:28.008379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9903644a-b0f3-4e5b-b08a-df216e6e0df4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.008840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9903644a-b0f3-4e5b-b08a-df216e6e0df4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.009628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9903644a-b0f3-4e5b-b08a-df216e6e0df4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.010066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9903644a-b0f3-4e5b-b08a-df216e6e0df4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.326704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9903644a-b0f3-4e5b-b08a-df216e6e0df4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:28.343292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9903644a-b0f3-4e5b-b08a-df216e6e0df4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:28.349646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9903644a-b0f3-4e5b-b08a-df216e6e0df4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:28.359175 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9903644a-b0f3-4e5b-b08a-df216e6e0df4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.382351 Jul 20 04:12:28.361172 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 705/1392] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:27 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:28.792526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c7ad1d0e-f85e-4f55-a3a5-a342cecb636c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:28.793095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c7ad1d0e-f85e-4f55-a3a5-a342cecb636c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:28.797105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=16 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:28.804303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7ad1d0e-f85e-4f55-a3a5-a342cecb636c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.804758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7ad1d0e-f85e-4f55-a3a5-a342cecb636c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.805753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7ad1d0e-f85e-4f55-a3a5-a342cecb636c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.806939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7ad1d0e-f85e-4f55-a3a5-a342cecb636c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.910412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5ec6f0ed-6164-4e68-ae9c-a98661432736 req-481aa96d-419e-462c-805b-2911f7705386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12b3f11-eda1-41ed-b619-b4ffe2b3a5de", "name": "network-vif-plugged", "status": "completed", "tag": "224f96bf-13e6-432c-ace2-bcb6f2691dc5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:28.923649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:28.929257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5ec6f0ed-6164-4e68-ae9c-a98661432736 req-481aa96d-419e-462c-805b-2911f7705386 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:28.929961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5ec6f0ed-6164-4e68-ae9c-a98661432736 req-481aa96d-419e-462c-805b-2911f7705386 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:28.968511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:28.973234 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5ec6f0ed-6164-4e68-ae9c-a98661432736 req-481aa96d-419e-462c-805b-2911f7705386 service nova] Creating event network-vif-plugged:224f96bf-13e6-432c-ace2-bcb6f2691dc5 for instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de on n-h2-760456-11 Jul 20 04:12:28.983713 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5ec6f0ed-6164-4e68-ae9c-a98661432736 req-481aa96d-419e-462c-805b-2911f7705386 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081923 Jul 20 04:12:28.987652 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 706/1393] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:29.023871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d5c0d977-0411-4732-b5fd-9d07f44d76b9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841ee1430>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:29.119386 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d5c0d977-0411-4732-b5fd-9d07f44d76b9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.127120 Jul 20 04:12:29.126483 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 707/1394] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:28 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:29.146789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f5413cc7-bb89-49d1-b885-1f59cfc98b64 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:29.149739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f5413cc7-bb89-49d1-b885-1f59cfc98b64 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:29.170286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5413cc7-bb89-49d1-b885-1f59cfc98b64 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:29.170763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5413cc7-bb89-49d1-b885-1f59cfc98b64 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:29.171567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5413cc7-bb89-49d1-b885-1f59cfc98b64 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:29.172021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5413cc7-bb89-49d1-b885-1f59cfc98b64 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:29.413948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:29.473192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f5413cc7-bb89-49d1-b885-1f59cfc98b64 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:29.481584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c7ad1d0e-f85e-4f55-a3a5-a342cecb636c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:29.482737 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f5413cc7-bb89-49d1-b885-1f59cfc98b64 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1316 microversion: 2.1 time: 0.355011 Jul 20 04:12:29.483513 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 708/1395] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:29 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:29.488374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f5ac5175-bda1-4ac1-bfd9-6c3d796db0b5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:29.489203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f5ac5175-bda1-4ac1-bfd9-6c3d796db0b5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:29.494585 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c7ad1d0e-f85e-4f55-a3a5-a342cecb636c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1312 microversion: 2.1 time: 0.706182 Jul 20 04:12:29.495319 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 688/1396] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:28 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1312 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:29.495974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5ac5175-bda1-4ac1-bfd9-6c3d796db0b5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:29.497231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5ac5175-bda1-4ac1-bfd9-6c3d796db0b5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:29.498329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5ac5175-bda1-4ac1-bfd9-6c3d796db0b5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:29.498931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5ac5175-bda1-4ac1-bfd9-6c3d796db0b5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:29.723937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f5ac5175-bda1-4ac1-bfd9-6c3d796db0b5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:29.732897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f5ac5175-bda1-4ac1-bfd9-6c3d796db0b5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:29.740516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f5ac5175-bda1-4ac1-bfd9-6c3d796db0b5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:29.744833 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f5ac5175-bda1-4ac1-bfd9-6c3d796db0b5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.260217 Jul 20 04:12:29.745510 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 709/1397] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:29 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:30.039506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2555fee-7b47-43bb-908e-89085123ff3f tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.047679 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e2555fee-7b47-43bb-908e-89085123ff3f tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.186210 Jul 20 04:12:30.049643 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 689/1398] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:12:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:30.062835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c91fdf2-b28e-4930-b494-4a0a55670e53 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.084512 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0c91fdf2-b28e-4930-b494-4a0a55670e53 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.025410 Jul 20 04:12:30.093198 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 710/1399] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.099841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a4705738-c539-48c2-b280-571b12f8cb2e tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.122019 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a4705738-c539-48c2-b280-571b12f8cb2e tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027490 Jul 20 04:12:30.124257 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 690/1400] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:30.134013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0ffe5279-78f2-49dd-89f2-06129b8cf3da tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8422d44c0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.151522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1826e55b-2e5d-48e9-a674-76ca91afd6df tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.168593 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1826e55b-2e5d-48e9-a674-76ca91afd6df tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029997 Jul 20 04:12:30.169464 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 691/1401] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:30.180900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-382e22f8-aa38-402a-80e6-6bacab5ffa0d tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.211234 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-382e22f8-aa38-402a-80e6-6bacab5ffa0d tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.034657 Jul 20 04:12:30.224365 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 692/1402] 10.222.0.59 () {58 vars in 1164 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:30.225506 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0ffe5279-78f2-49dd-89f2-06129b8cf3da tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.096134 Jul 20 04:12:30.226603 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 711/1403] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.230221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-add3b337-40ef-4352-a6a6-280e53353157 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.240394 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-add3b337-40ef-4352-a6a6-280e53353157 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014523 Jul 20 04:12:30.240914 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 693/1404] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:30.253370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1d1a837c-cd13-44e7-bbdd-07b864b7d87f tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.306873 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1d1a837c-cd13-44e7-bbdd-07b864b7d87f tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.059142 Jul 20 04:12:30.308294 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 712/1405] 10.222.0.59 () {58 vars in 1168 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.321155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d59cc39-4c80-482a-bd2d-67dc1a72ff38 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.334177 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7d59cc39-4c80-482a-bd2d-67dc1a72ff38 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.016712 Jul 20 04:12:30.341446 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 694/1406] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:30.347079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-05d388f8-ab09-4a8c-999b-3d4dc0ba40cf tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.357915 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-05d388f8-ab09-4a8c-999b-3d4dc0ba40cf tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015239 Jul 20 04:12:30.358663 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 713/1407] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:12:30.369346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9f7c2e9b-0ee5-4db4-97ed-2de57ac59934 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.414175 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9f7c2e9b-0ee5-4db4-97ed-2de57ac59934 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.048428 Jul 20 04:12:30.415209 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 695/1408] 10.222.0.59 () {58 vars in 1166 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:30.431070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f716df20-b8ec-4cad-96fa-8faf932bda64 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.441551 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f716df20-b8ec-4cad-96fa-8faf932bda64 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014678 Jul 20 04:12:30.442855 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 714/1409] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:30.462885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4fa8e853-b990-4e7d-b333-2e9ec1aada74 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.485158 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4fa8e853-b990-4e7d-b333-2e9ec1aada74 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.032723 Jul 20 04:12:30.486492 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 696/1410] 10.222.0.59 () {58 vars in 1143 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.507377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-737fc3ac-757d-409d-9b62-d53412444536 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.508932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-737fc3ac-757d-409d-9b62-d53412444536 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:30.516830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f8c8ccfd-da68-432b-a850-77fdf73ed00b tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.525788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-737fc3ac-757d-409d-9b62-d53412444536 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.526243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-737fc3ac-757d-409d-9b62-d53412444536 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.527102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-737fc3ac-757d-409d-9b62-d53412444536 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.527558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-737fc3ac-757d-409d-9b62-d53412444536 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.536848 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f8c8ccfd-da68-432b-a850-77fdf73ed00b tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030584 Jul 20 04:12:30.537514 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 697/1411] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:30.544073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c546520-49d3-48b8-9b37-695bc9c9f55d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.544953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c546520-49d3-48b8-9b37-695bc9c9f55d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:30.552553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c546520-49d3-48b8-9b37-695bc9c9f55d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.553539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c546520-49d3-48b8-9b37-695bc9c9f55d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.554641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c546520-49d3-48b8-9b37-695bc9c9f55d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.555081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c546520-49d3-48b8-9b37-695bc9c9f55d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.709358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6c546520-49d3-48b8-9b37-695bc9c9f55d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.716482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-737fc3ac-757d-409d-9b62-d53412444536 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.723298 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6c546520-49d3-48b8-9b37-695bc9c9f55d tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1312 microversion: 2.1 time: 0.184649 Jul 20 04:12:30.729395 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-737fc3ac-757d-409d-9b62-d53412444536 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1316 microversion: 2.1 time: 0.232739 Jul 20 04:12:30.734600 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 698/1412] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.741930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75e8edc2-dadf-45c7-8a19-41d132211747 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.746973 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 715/1413] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.765833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e6af61f-3569-4c99-bd49-a65b4c8dbc81 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.766501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e6af61f-3569-4c99-bd49-a65b4c8dbc81 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:30.769651 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75e8edc2-dadf-45c7-8a19-41d132211747 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.032675 Jul 20 04:12:30.770943 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 699/1414] 10.222.0.59 () {58 vars in 1147 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.775411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e6af61f-3569-4c99-bd49-a65b4c8dbc81 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.775872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e6af61f-3569-4c99-bd49-a65b4c8dbc81 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.776683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e6af61f-3569-4c99-bd49-a65b4c8dbc81 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:30.777133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e6af61f-3569-4c99-bd49-a65b4c8dbc81 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:30.785661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f60c8e5d-dcb7-4020-9e74-d0e922850e51 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.797535 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f60c8e5d-dcb7-4020-9e74-d0e922850e51 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.016721 Jul 20 04:12:30.802321 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 700/1415] 10.222.0.59 () {58 vars in 1139 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:12:30.827756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d82de88b-7241-4abf-9646-c413084611a2 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.854145 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d82de88b-7241-4abf-9646-c413084611a2 tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030025 Jul 20 04:12:30.855145 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 701/1416] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:30.869875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38f20c0c-6864-48eb-bce4-f15f43b2ca2f tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.897967 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-38f20c0c-6864-48eb-bce4-f15f43b2ca2f tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.035668 Jul 20 04:12:30.898919 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 702/1417] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.918279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5d9c4126-e3c7-488a-af59-3c5a2c57308f tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.967068 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5d9c4126-e3c7-488a-af59-3c5a2c57308f tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052491 Jul 20 04:12:30.968328 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 703/1418] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:30.983941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-46b9cd55-93b5-4559-b7ae-1970e28274fa tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:30.984913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e6af61f-3569-4c99-bd49-a65b4c8dbc81 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.994294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e6af61f-3569-4c99-bd49-a65b4c8dbc81 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.997249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e6af61f-3569-4c99-bd49-a65b4c8dbc81 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:30.998720 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e6af61f-3569-4c99-bd49-a65b4c8dbc81 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.237738 Jul 20 04:12:31.007446 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-46b9cd55-93b5-4559-b7ae-1970e28274fa tempest-FlavorsV2TestJSON-505745410 tempest-FlavorsV2TestJSON-505745410-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027277 Jul 20 04:12:31.008318 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 704/1419] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:12:31.010592 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 716/1420] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:30 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:12:31.239959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9642b36d-d4ed-44d5-834b-02b573393aea tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f17940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:31.341722 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9642b36d-d4ed-44d5-834b-02b573393aea tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1414 microversion: 2.1 time: 0.106648 Jul 20 04:12:31.343519 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 705/1421] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:31 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:31.739989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4361e3ee-cb8f-451f-812f-d0ea113790f9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:31.741230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4361e3ee-cb8f-451f-812f-d0ea113790f9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:31.756896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40f2abe7-66a4-4e2e-9f76-72fbf4bbcab3 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:31.757823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40f2abe7-66a4-4e2e-9f76-72fbf4bbcab3 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:31.766022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f2abe7-66a4-4e2e-9f76-72fbf4bbcab3 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.767457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f2abe7-66a4-4e2e-9f76-72fbf4bbcab3 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.768512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f2abe7-66a4-4e2e-9f76-72fbf4bbcab3 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.769336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f2abe7-66a4-4e2e-9f76-72fbf4bbcab3 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.777004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4361e3ee-cb8f-451f-812f-d0ea113790f9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.778085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4361e3ee-cb8f-451f-812f-d0ea113790f9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.779187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4361e3ee-cb8f-451f-812f-d0ea113790f9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:31.779875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4361e3ee-cb8f-451f-812f-d0ea113790f9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:31.975586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-40f2abe7-66a4-4e2e-9f76-72fbf4bbcab3 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:31.984005 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40f2abe7-66a4-4e2e-9f76-72fbf4bbcab3 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1503 microversion: 2.1 time: 0.231222 Jul 20 04:12:31.985196 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 706/1422] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:31 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.002551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8dc568d3-5cc8-4cef-8282-fc433b2bd1b9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2105687423"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:32.003141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8dc568d3-5cc8-4cef-8282-fc433b2bd1b9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.010734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8dc568d3-5cc8-4cef-8282-fc433b2bd1b9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.011193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8dc568d3-5cc8-4cef-8282-fc433b2bd1b9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.012203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8dc568d3-5cc8-4cef-8282-fc433b2bd1b9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.012904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8dc568d3-5cc8-4cef-8282-fc433b2bd1b9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.163739 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.network.security_group_api [None req-8dc568d3-5cc8-4cef-8282-fc433b2bd1b9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Adding security group e7127006-e67c-4d41-a87c-397acd1621a6 to port 224f96bf-13e6-432c-ace2-bcb6f2691dc5 Jul 20 04:12:32.429268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4361e3ee-cb8f-451f-812f-d0ea113790f9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.453866 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4361e3ee-cb8f-451f-812f-d0ea113790f9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1312 microversion: 2.1 time: 0.717515 Jul 20 04:12:32.457069 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 717/1423] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:31 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1312 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.474317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f6d86e86-33ab-43c1-a412-2ae90ab5c07b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.475323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f6d86e86-33ab-43c1-a412-2ae90ab5c07b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.483223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6d86e86-33ab-43c1-a412-2ae90ab5c07b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.484469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6d86e86-33ab-43c1-a412-2ae90ab5c07b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.486815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6d86e86-33ab-43c1-a412-2ae90ab5c07b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.487870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6d86e86-33ab-43c1-a412-2ae90ab5c07b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.624171 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8dc568d3-5cc8-4cef-8282-fc433b2bd1b9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de/action" status: 202 len: 0 microversion: 2.1 time: 0.627036 Jul 20 04:12:32.624869 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 707/1424] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:31 2022] POST /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:32.630165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fd42872-8849-4a66-97ab-88963ca5992f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f17160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.711304 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1fd42872-8849-4a66-97ab-88963ca5992f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1423 microversion: 2.1 time: 0.084933 Jul 20 04:12:32.721014 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 708/1425] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1423 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.730017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-430d32df-6f84-4286-9a73-d633975204a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1310808578"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:32.732008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f6d86e86-33ab-43c1-a412-2ae90ab5c07b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.734480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-430d32df-6f84-4286-9a73-d633975204a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:32.742600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f6d86e86-33ab-43c1-a412-2ae90ab5c07b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.745619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f6d86e86-33ab-43c1-a412-2ae90ab5c07b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:32.747528 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f6d86e86-33ab-43c1-a412-2ae90ab5c07b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.286851 Jul 20 04:12:32.747838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-430d32df-6f84-4286-9a73-d633975204a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.748634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-430d32df-6f84-4286-9a73-d633975204a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.748958 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 718/1426] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:32.750164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-430d32df-6f84-4286-9a73-d633975204a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.754508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-71a412fc-4faa-44d1-8d26-e441d6f91c27 req-36a5ed86-be11-443e-ba48-f6f67126a377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12b3f11-eda1-41ed-b619-b4ffe2b3a5de", "tag": "224f96bf-13e6-432c-ace2-bcb6f2691dc5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:32.755289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-430d32df-6f84-4286-9a73-d633975204a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.772355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-71a412fc-4faa-44d1-8d26-e441d6f91c27 req-36a5ed86-be11-443e-ba48-f6f67126a377 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:32.772873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-71a412fc-4faa-44d1-8d26-e441d6f91c27 req-36a5ed86-be11-443e-ba48-f6f67126a377 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:32.798697 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-71a412fc-4faa-44d1-8d26-e441d6f91c27 req-36a5ed86-be11-443e-ba48-f6f67126a377 service nova] Creating event network-changed:224f96bf-13e6-432c-ace2-bcb6f2691dc5 for instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de on n-h2-760456-11 Jul 20 04:12:32.806548 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-71a412fc-4faa-44d1-8d26-e441d6f91c27 req-36a5ed86-be11-443e-ba48-f6f67126a377 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056054 Jul 20 04:12:32.807442 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 719/1427] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:32.817986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-214daad3-438a-4212-9b80-2a1a9f3a58ae tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842317790>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:32.888066 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-214daad3-438a-4212-9b80-2a1a9f3a58ae tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 200 len: 1423 microversion: 2.1 time: 0.078866 Jul 20 04:12:32.888974 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 720/1428] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:12:32 2022] GET /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:32.903920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a2bcc12-c866-4412-9fde-fe9e247e0ae6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8422de550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.094473 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.network.security_group_api [None req-430d32df-6f84-4286-9a73-d633975204a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Adding security group bb4d96a9-328f-4bc6-847f-a49dc677cadc to port 224f96bf-13e6-432c-ace2-bcb6f2691dc5 Jul 20 04:12:33.861490 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-430d32df-6f84-4286-9a73-d633975204a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de/action" status: 202 len: 0 microversion: 2.1 time: 1.138620 Jul 20 04:12:33.867142 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 709/1429] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:32 2022] POST /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de/action => generated 0 bytes in 1146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:33.875566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ddea5efd-e427-4859-8ef7-ab68b872788b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:33.877125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ddea5efd-e427-4859-8ef7-ab68b872788b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:33.894367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddea5efd-e427-4859-8ef7-ab68b872788b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.897825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddea5efd-e427-4859-8ef7-ab68b872788b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:33.900415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddea5efd-e427-4859-8ef7-ab68b872788b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:33.901798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddea5efd-e427-4859-8ef7-ab68b872788b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.025967 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5a2bcc12-c866-4412-9fde-fe9e247e0ae6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 204 len: 0 microversion: 2.1 time: 1.127509 Jul 20 04:12:34.026839 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 721/1430] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:32 2022] DELETE /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 0 bytes in 1129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:12:34.278388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2dcf909f-f5c7-4e01-8e50-f642c0a27e98 req-fe06ffd3-aa55-427b-834e-ad8009da1759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9", "name": "network-vif-plugged", "status": "completed", "tag": "b4437382-d813-4ba5-b42b-466403da1026"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:34.302350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2dcf909f-f5c7-4e01-8e50-f642c0a27e98 req-fe06ffd3-aa55-427b-834e-ad8009da1759 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.303235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2dcf909f-f5c7-4e01-8e50-f642c0a27e98 req-fe06ffd3-aa55-427b-834e-ad8009da1759 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.308135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ddea5efd-e427-4859-8ef7-ab68b872788b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.323888 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ddea5efd-e427-4859-8ef7-ab68b872788b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1312 microversion: 2.1 time: 0.450628 Jul 20 04:12:34.326875 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 710/1431] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:33 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1312 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:34.344373 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2dcf909f-f5c7-4e01-8e50-f642c0a27e98 req-fe06ffd3-aa55-427b-834e-ad8009da1759 service nova] Creating event network-vif-plugged:b4437382-d813-4ba5-b42b-466403da1026 for instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 on n-h2-760456-11 Jul 20 04:12:34.348570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2f99008-80f5-48ed-81eb-31a467e6c5a5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:34.349475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c2f99008-80f5-48ed-81eb-31a467e6c5a5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:34.363350 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2dcf909f-f5c7-4e01-8e50-f642c0a27e98 req-fe06ffd3-aa55-427b-834e-ad8009da1759 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335284 Jul 20 04:12:34.363748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2f99008-80f5-48ed-81eb-31a467e6c5a5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.364475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2f99008-80f5-48ed-81eb-31a467e6c5a5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.365708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2f99008-80f5-48ed-81eb-31a467e6c5a5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.366413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2f99008-80f5-48ed-81eb-31a467e6c5a5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.370614 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 722/1432] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:34.383567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-00e31830-a270-4ae7-b040-ae42a965c1e5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:34.384569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-00e31830-a270-4ae7-b040-ae42a965c1e5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:34.405390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00e31830-a270-4ae7-b040-ae42a965c1e5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.408101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00e31830-a270-4ae7-b040-ae42a965c1e5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.411237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00e31830-a270-4ae7-b040-ae42a965c1e5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.414960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00e31830-a270-4ae7-b040-ae42a965c1e5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.819529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2f99008-80f5-48ed-81eb-31a467e6c5a5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.841959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2f99008-80f5-48ed-81eb-31a467e6c5a5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.848106 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-00e31830-a270-4ae7-b040-ae42a965c1e5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.474871 Jul 20 04:12:34.851169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2f99008-80f5-48ed-81eb-31a467e6c5a5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:34.853929 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c2f99008-80f5-48ed-81eb-31a467e6c5a5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.523994 Jul 20 04:12:34.855341 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 711/1433] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:34 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:34.863917 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 723/1434] 10.222.0.59 () {58 vars in 1292 bytes} [Wed Jul 20 04:12:34 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de/os-security-groups => generated 1159 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:34.870332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3e0fd6ee-0a1f-421d-9836-29fcf07e61b6 req-91531f9e-7389-49b3-8694-3cb45375c3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12b3f11-eda1-41ed-b619-b4ffe2b3a5de", "tag": "224f96bf-13e6-432c-ace2-bcb6f2691dc5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:34.870504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-72fc886a-8a11-4ead-96a6-2850e267d0c1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:34.871026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-72fc886a-8a11-4ead-96a6-2850e267d0c1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:34.882346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72fc886a-8a11-4ead-96a6-2850e267d0c1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.884497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72fc886a-8a11-4ead-96a6-2850e267d0c1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.887219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72fc886a-8a11-4ead-96a6-2850e267d0c1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.889298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3e0fd6ee-0a1f-421d-9836-29fcf07e61b6 req-91531f9e-7389-49b3-8694-3cb45375c3f5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:34.890071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72fc886a-8a11-4ead-96a6-2850e267d0c1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.890626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3e0fd6ee-0a1f-421d-9836-29fcf07e61b6 req-91531f9e-7389-49b3-8694-3cb45375c3f5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:34.909748 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3e0fd6ee-0a1f-421d-9836-29fcf07e61b6 req-91531f9e-7389-49b3-8694-3cb45375c3f5 service nova] Creating event network-changed:224f96bf-13e6-432c-ace2-bcb6f2691dc5 for instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de on n-h2-760456-11 Jul 20 04:12:34.917327 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3e0fd6ee-0a1f-421d-9836-29fcf07e61b6 req-91531f9e-7389-49b3-8694-3cb45375c3f5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050390 Jul 20 04:12:34.918230 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 724/1435] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:34.926441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3eb3c136-911f-4211-b0dd-4f239ac137b4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: .version_select at 0x7fb8421e74c0>, body: {"security_group": {"name": " tempest-securitygroup -1566488287 ", "description": "tempest-description-1784950973"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:34.943194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-72fc886a-8a11-4ead-96a6-2850e267d0c1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:12:35.075512 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-72fc886a-8a11-4ead-96a6-2850e267d0c1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 204 len: 0 microversion: 2.1 time: 0.218197 Jul 20 04:12:35.076567 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 712/1436] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:12:34 2022] DELETE /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:12:35.252629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1930369002", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "8ef25bc8-09e8-4802-9a88-9466c2609da2"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:35.262126 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3eb3c136-911f-4211-b0dd-4f239ac137b4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.342311 Jul 20 04:12:35.270555 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 725/1437] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:34 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:35.276883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2dde3315-5c68-4b62-94cc-45c228131680 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb8421e5f70>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.347370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] validate_networks() for [('8ef25bc8-09e8-4802-9a88-9466c2609da2', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:35.365793 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2dde3315-5c68-4b62-94cc-45c228131680 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/70353ef7-b6ed-4c37-ac3d-99ba635d8fec" status: 200 len: 224 microversion: 2.1 time: 0.093660 Jul 20 04:12:35.370649 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 726/1438] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:12:35 2022] GET /compute/v2.1/os-security-groups/70353ef7-b6ed-4c37-ac3d-99ba635d8fec => generated 224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:35.377144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c604b994-1387-4a29-b5e9-664ff16ca982 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:35.378195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c604b994-1387-4a29-b5e9-664ff16ca982 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:35.392597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c604b994-1387-4a29-b5e9-664ff16ca982 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.395248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c604b994-1387-4a29-b5e9-664ff16ca982 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.397078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c604b994-1387-4a29-b5e9-664ff16ca982 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:35.398271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c604b994-1387-4a29-b5e9-664ff16ca982 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:35.664359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c604b994-1387-4a29-b5e9-664ff16ca982 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:35.685831 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c604b994-1387-4a29-b5e9-664ff16ca982 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1312 microversion: 2.1 time: 0.312362 Jul 20 04:12:35.690752 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 727/1439] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:35 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1312 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:35.700550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a3e6597a-54f6-4ba7-86b4-8f66d0d85ab1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb842317af0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.298488 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a3e6597a-54f6-4ba7-86b4-8f66d0d85ab1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/70353ef7-b6ed-4c37-ac3d-99ba635d8fec" status: 202 len: 0 microversion: 2.1 time: 0.606170 Jul 20 04:12:36.299209 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 728/1440] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:12:35 2022] DELETE /compute/v2.1/os-security-groups/70353ef7-b6ed-4c37-ac3d-99ba635d8fec => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:36.304408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0239f213-2b24-4414-a66e-0908ff4fafd3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.305266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0239f213-2b24-4414-a66e-0908ff4fafd3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:36.315495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0239f213-2b24-4414-a66e-0908ff4fafd3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.317397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0239f213-2b24-4414-a66e-0908ff4fafd3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.319431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0239f213-2b24-4414-a66e-0908ff4fafd3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.320780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0239f213-2b24-4414-a66e-0908ff4fafd3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.651600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0239f213-2b24-4414-a66e-0908ff4fafd3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.679261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0239f213-2b24-4414-a66e-0908ff4fafd3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.681417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0239f213-2b24-4414-a66e-0908ff4fafd3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:36.682959 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0239f213-2b24-4414-a66e-0908ff4fafd3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.382411 Jul 20 04:12:36.684189 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 729/1441] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:36.691201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4973c2c-1260-42d9-a27d-c5ef5d11a440 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb842dcaa60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.771869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-a4973c2c-1260-42d9-a27d-c5ef5d11a440 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:12:36.772582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.security_group_api [None req-a4973c2c-1260-42d9-a27d-c5ef5d11a440 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Neutron security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec not found {{(pid=119606) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:12:36.773215 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a4973c2c-1260-42d9-a27d-c5ef5d11a440 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:12:36.773215 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-7a4f3204-0e54-44da-b881-98b04a0b07a4'] Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4973c2c-1260-42d9-a27d-c5ef5d11a440 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-security-groups/70353ef7-b6ed-4c37-ac3d-99ba635d8fec HTTP/1.1 Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: exception: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-7a4f3204-0e54-44da-b881-98b04a0b07a4'] Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '70353ef7-b6ed-4c37-ac3d-99ba635d8fec'} Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:12:36.775576 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a4f3204-0e54-44da-b881-98b04a0b07a4'] Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a4f3204-0e54-44da-b881-98b04a0b07a4'] Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a4f3204-0e54-44da-b881-98b04a0b07a4'] Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a4f3204-0e54-44da-b881-98b04a0b07a4'] Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4973c2c-1260-42d9-a27d-c5ef5d11a440 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-7a4f3204-0e54-44da-b881-98b04a0b07a4'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a4973c2c-1260-42d9-a27d-c5ef5d11a440 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/70353ef7-b6ed-4c37-ac3d-99ba635d8fec" status: 404 len: 194 microversion: 2.1 time: 0.095808 Jul 20 04:12:36.783397 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 730/1442] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/os-security-groups/70353ef7-b6ed-4c37-ac3d-99ba635d8fec => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:36.791986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0d98d37-2f68-471f-b9ec-84ed6cce842f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:36.792247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e0d98d37-2f68-471f-b9ec-84ed6cce842f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:36.800772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0d98d37-2f68-471f-b9ec-84ed6cce842f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.801596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0d98d37-2f68-471f-b9ec-84ed6cce842f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.802685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0d98d37-2f68-471f-b9ec-84ed6cce842f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.803361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0d98d37-2f68-471f-b9ec-84ed6cce842f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.883403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:36.884447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:36.886470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:36.887198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:36.887837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:36.910724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.911550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.912613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:36.913284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:36.935756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Getting quotas for project d95803bcc72643c995784af8507117b3. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:36.943495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Getting quotas for user 8aad902393614d1fae3d0f5bf5456c06 and project d95803bcc72643c995784af8507117b3. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:36.974631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:36.981610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:37.040829 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-56023847-01a7-4ae1-8f8b-30ff4c2d9569 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.794069 Jul 20 04:12:37.057842 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 713/1443] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:37.070889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7c1022b1-e02b-4715-8f73-52acf27a18a3 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: .version_select at 0x7fb84226ec10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1355494860", "description": "tempest-description-1507311232"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:37.259105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e0d98d37-2f68-471f-b9ec-84ed6cce842f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:37.273177 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0d98d37-2f68-471f-b9ec-84ed6cce842f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1461 microversion: 2.1 time: 0.485713 Jul 20 04:12:37.274014 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 731/1444] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:36 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1461 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:37.284679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e86f3166-cece-4c07-b738-d633a6e886f6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:37.286092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e86f3166-cece-4c07-b738-d633a6e886f6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:37.513243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e86f3166-cece-4c07-b738-d633a6e886f6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:37.521492 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e86f3166-cece-4c07-b738-d633a6e886f6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1208 microversion: 2.1 time: 0.245935 Jul 20 04:12:37.535057 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 732/1445] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:37 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1208 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:37.552944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-12b95140-4a20-474a-8bed-582b5b18046a req-18e96467-f020-481e-bb0c-174694b88030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ac1ca0-13df-42f1-a6dd-c8f8fcb92340", "name": "network-vif-unplugged", "status": "completed", "tag": "ad5a7fda-bddf-4601-824c-60a7451ad16c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:37.583643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-12b95140-4a20-474a-8bed-582b5b18046a req-18e96467-f020-481e-bb0c-174694b88030 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.588955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-12b95140-4a20-474a-8bed-582b5b18046a req-18e96467-f020-481e-bb0c-174694b88030 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.615149 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-12b95140-4a20-474a-8bed-582b5b18046a req-18e96467-f020-481e-bb0c-174694b88030 service nova] Creating event network-vif-unplugged:ad5a7fda-bddf-4601-824c-60a7451ad16c for instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 on n-h1-760456-11 Jul 20 04:12:37.634916 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-12b95140-4a20-474a-8bed-582b5b18046a req-18e96467-f020-481e-bb0c-174694b88030 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083600 Jul 20 04:12:37.636041 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 733/1446] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:37.646070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3fe5e04c-b0b9-45ef-9bd0-f93a07f34ead tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:37.654481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3fe5e04c-b0b9-45ef-9bd0-f93a07f34ead tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:37.674082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fe5e04c-b0b9-45ef-9bd0-f93a07f34ead tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.674809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fe5e04c-b0b9-45ef-9bd0-f93a07f34ead tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.677118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fe5e04c-b0b9-45ef-9bd0-f93a07f34ead tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.677570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fe5e04c-b0b9-45ef-9bd0-f93a07f34ead tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.691959 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7c1022b1-e02b-4715-8f73-52acf27a18a3 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.628368 Jul 20 04:12:37.699944 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 714/1447] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:37 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:37.705009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2317137c-3cfc-4886-a8f4-e023211c3202 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:37.705636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2317137c-3cfc-4886-a8f4-e023211c3202 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:37.731496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:37.734227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2317137c-3cfc-4886-a8f4-e023211c3202 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.734731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2317137c-3cfc-4886-a8f4-e023211c3202 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:37.736269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2317137c-3cfc-4886-a8f4-e023211c3202 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:37.736709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2317137c-3cfc-4886-a8f4-e023211c3202 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.162418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2317137c-3cfc-4886-a8f4-e023211c3202 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.173702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2317137c-3cfc-4886-a8f4-e023211c3202 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.193495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2317137c-3cfc-4886-a8f4-e023211c3202 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.194874 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2317137c-3cfc-4886-a8f4-e023211c3202 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.493829 Jul 20 04:12:38.195852 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 715/1448] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:37 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:38.203844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-881b5677-684e-4048-b19d-7dfd922b0a6f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: .version_select at 0x7fb841f4ef70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-407217187", "description": "tempest-description-742890794"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:38.268439 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3fe5e04c-b0b9-45ef-9bd0-f93a07f34ead tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1614 microversion: 2.1 time: 0.629061 Jul 20 04:12:38.269802 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 734/1449] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:37 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1614 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:38.290346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9e63f5b6-23e0-4f7c-9e39-1a54ad196069 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:38.291025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9e63f5b6-23e0-4f7c-9e39-1a54ad196069 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:38.335045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e63f5b6-23e0-4f7c-9e39-1a54ad196069 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.335811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e63f5b6-23e0-4f7c-9e39-1a54ad196069 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.336794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e63f5b6-23e0-4f7c-9e39-1a54ad196069 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:38.337446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e63f5b6-23e0-4f7c-9e39-1a54ad196069 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:38.362956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:38.401833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9e63f5b6-23e0-4f7c-9e39-1a54ad196069 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '76ca70f286324a98b7589d76b890fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d1c878f033455faa4920d840e07769', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:38.402720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9e63f5b6-23e0-4f7c-9e39-1a54ad196069 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] flavor_id is None. Assuming migration. {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:12:38.403266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9e63f5b6-23e0-4f7c-9e39-1a54ad196069 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:12:39.437171 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9e63f5b6-23e0-4f7c-9e39-1a54ad196069 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9/action" status: 202 len: 0 microversion: 2.1 time: 1.155624 Jul 20 04:12:39.441665 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 735/1450] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:38 2022] POST /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9/action => generated 0 bytes in 1161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:39.456435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a90aa188-39ed-45e3-b86e-98a892d3a67c req-8fd029b1-4ace-4703-94e9-423eecab7683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ac1ca0-13df-42f1-a6dd-c8f8fcb92340", "name": "network-vif-deleted", "tag": "ad5a7fda-bddf-4601-824c-60a7451ad16c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:39.478001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a90aa188-39ed-45e3-b86e-98a892d3a67c req-8fd029b1-4ace-4703-94e9-423eecab7683 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.481985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a90aa188-39ed-45e3-b86e-98a892d3a67c req-8fd029b1-4ace-4703-94e9-423eecab7683 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.513883 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a90aa188-39ed-45e3-b86e-98a892d3a67c req-8fd029b1-4ace-4703-94e9-423eecab7683 service nova] Creating event network-vif-deleted:ad5a7fda-bddf-4601-824c-60a7451ad16c for instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 on n-h1-760456-11 Jul 20 04:12:39.526824 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a90aa188-39ed-45e3-b86e-98a892d3a67c req-8fd029b1-4ace-4703-94e9-423eecab7683 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083287 Jul 20 04:12:39.528023 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 736/1451] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:39.540666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb751887-1c91-4bb7-a493-26165da64743 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.541385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb751887-1c91-4bb7-a493-26165da64743 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:39.549610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb751887-1c91-4bb7-a493-26165da64743 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.550068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb751887-1c91-4bb7-a493-26165da64743 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.550880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb751887-1c91-4bb7-a493-26165da64743 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.551320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb751887-1c91-4bb7-a493-26165da64743 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.684023 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-881b5677-684e-4048-b19d-7dfd922b0a6f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.481986 Jul 20 04:12:39.684790 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 716/1452] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:38 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:39.694888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-98e6f41e-b141-4b6a-8e7b-c67bd60147fa tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.695510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-98e6f41e-b141-4b6a-8e7b-c67bd60147fa tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:39.710078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb751887-1c91-4bb7-a493-26165da64743 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:39.722666 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb751887-1c91-4bb7-a493-26165da64743 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1266 microversion: 2.1 time: 0.193090 Jul 20 04:12:39.723519 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 737/1453] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:39.729273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-510f8d35-d84a-4023-aae3-bb18854cc2ef tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:39.730276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-510f8d35-d84a-4023-aae3-bb18854cc2ef tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:39.734627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98e6f41e-b141-4b6a-8e7b-c67bd60147fa tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.738134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98e6f41e-b141-4b6a-8e7b-c67bd60147fa tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.739205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98e6f41e-b141-4b6a-8e7b-c67bd60147fa tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.740315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-510f8d35-d84a-4023-aae3-bb18854cc2ef tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.740452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98e6f41e-b141-4b6a-8e7b-c67bd60147fa tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.742293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-510f8d35-d84a-4023-aae3-bb18854cc2ef tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:39.743647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-510f8d35-d84a-4023-aae3-bb18854cc2ef tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:39.744327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-510f8d35-d84a-4023-aae3-bb18854cc2ef tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:40.129577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-98e6f41e-b141-4b6a-8e7b-c67bd60147fa tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.145481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-98e6f41e-b141-4b6a-8e7b-c67bd60147fa tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.173875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-98e6f41e-b141-4b6a-8e7b-c67bd60147fa tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:40.175455 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-98e6f41e-b141-4b6a-8e7b-c67bd60147fa tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.489621 Jul 20 04:12:40.178435 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 717/1454] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:40.187272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4f1a6f47-d03d-463e-af0d-26073479d4be tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: .version_select at 0x7fb841f178b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1394848628", "description": "tempest-description-2112300959"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:41.196434 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4f1a6f47-d03d-463e-af0d-26073479d4be tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.015955 Jul 20 04:12:41.197049 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 718/1455] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:40 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:41.202511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ccf0cce2-a460-48b4-aae6-9f2ae315ade4 req-1a3f3a79-dfed-4a65-8236-fcea84607a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cd136f-c79e-422a-b3ea-b8b6e73aa96d", "name": "network-vif-plugged", "status": "completed", "tag": "c78a3349-2e55-45c6-9808-0b45347d0b3b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:41.225040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ccf0cce2-a460-48b4-aae6-9f2ae315ade4 req-1a3f3a79-dfed-4a65-8236-fcea84607a6f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.226857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ccf0cce2-a460-48b4-aae6-9f2ae315ade4 req-1a3f3a79-dfed-4a65-8236-fcea84607a6f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.266240 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ccf0cce2-a460-48b4-aae6-9f2ae315ade4 req-1a3f3a79-dfed-4a65-8236-fcea84607a6f service nova] Creating event network-vif-plugged:c78a3349-2e55-45c6-9808-0b45347d0b3b for instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d on n-h2-760456-11 Jul 20 04:12:41.300581 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ccf0cce2-a460-48b4-aae6-9f2ae315ade4 req-1a3f3a79-dfed-4a65-8236-fcea84607a6f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102130 Jul 20 04:12:41.301216 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 719/1456] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:41.331459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f2d32ec-156b-4101-95da-2d73b942f5ee tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.332176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f2d32ec-156b-4101-95da-2d73b942f5ee tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:41.376886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f2d32ec-156b-4101-95da-2d73b942f5ee tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.378880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f2d32ec-156b-4101-95da-2d73b942f5ee tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.380739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f2d32ec-156b-4101-95da-2d73b942f5ee tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.386285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f2d32ec-156b-4101-95da-2d73b942f5ee tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.500737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-510f8d35-d84a-4023-aae3-bb18854cc2ef tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:41.512705 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-510f8d35-d84a-4023-aae3-bb18854cc2ef tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1470 microversion: 2.1 time: 1.787940 Jul 20 04:12:41.515907 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 738/1457] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:39 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1470 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:41.527997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f67e24d3-823d-415c-9c4b-601cedc15351 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:41.536276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f67e24d3-823d-415c-9c4b-601cedc15351 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:41.549692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f67e24d3-823d-415c-9c4b-601cedc15351 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.568827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f67e24d3-823d-415c-9c4b-601cedc15351 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:41.569838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f67e24d3-823d-415c-9c4b-601cedc15351 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:41.570450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f67e24d3-823d-415c-9c4b-601cedc15351 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:42.002710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f67e24d3-823d-415c-9c4b-601cedc15351 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:42.015218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f67e24d3-823d-415c-9c4b-601cedc15351 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:42.016837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f67e24d3-823d-415c-9c4b-601cedc15351 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:42.018133 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f67e24d3-823d-415c-9c4b-601cedc15351 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.500574 Jul 20 04:12:42.030599 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 739/1458] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:42.038510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8fc63ed2-8300-4457-a03c-34d30dde94b6 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb8421578b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:42.341892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5f2d32ec-156b-4101-95da-2d73b942f5ee tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:42.353084 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f2d32ec-156b-4101-95da-2d73b942f5ee tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1266 microversion: 2.1 time: 1.032566 Jul 20 04:12:42.357275 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 720/1459] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:41 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1266 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:42.365657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34243a7b-78ba-43b2-8d6f-073dc1f3ace0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Action: 'create', calling method: .version_select at 0x7fb841e98af0>, body: {"keypair": {"name": "tempest-keypair-1403283623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdb8yO7MQ6RdeAeKk/aUkOwFxxrkT5F0/t30qXGW+XUGz4booOEo0aN4svmR+r5vxM7aCd55VUU7adGOLCLok/z2dNoBE8DbNUpOqR0XyU+yqLazCA8cOOVt5fXHSTLcw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:42.412568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-34243a7b-78ba-43b2-8d6f-073dc1f3ace0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Getting quotas for project 29c19ef6ed5b4e27947af6ce219d18d5. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:42.420548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-34243a7b-78ba-43b2-8d6f-073dc1f3ace0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Getting quotas for user 2ea3ed970c1348aa922dda7fb3edf866 and project 29c19ef6ed5b4e27947af6ce219d18d5. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:42.480260 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-34243a7b-78ba-43b2-8d6f-073dc1f3ace0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.121504 Jul 20 04:12:42.480879 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 721/1460] 10.222.0.59 () {62 vars in 1199 bytes} [Wed Jul 20 04:12:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:12:42.533647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fdb05d25-93f3-4e03-bbb5-57d9ebc8f640 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:42.534376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fdb05d25-93f3-4e03-bbb5-57d9ebc8f640 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:42.544918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fdb05d25-93f3-4e03-bbb5-57d9ebc8f640 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:42.545381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fdb05d25-93f3-4e03-bbb5-57d9ebc8f640 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:42.546171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fdb05d25-93f3-4e03-bbb5-57d9ebc8f640 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:42.549231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fdb05d25-93f3-4e03-bbb5-57d9ebc8f640 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.211689 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8fc63ed2-8300-4457-a03c-34d30dde94b6 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 1.179598 Jul 20 04:12:43.212290 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 740/1461] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:12:42 2022] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:43.217623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ef5fad77-e475-4e60-8d85-0416019d99b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:43.218486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ef5fad77-e475-4e60-8d85-0416019d99b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:43.231986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef5fad77-e475-4e60-8d85-0416019d99b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.233060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef5fad77-e475-4e60-8d85-0416019d99b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.236998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef5fad77-e475-4e60-8d85-0416019d99b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.237619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef5fad77-e475-4e60-8d85-0416019d99b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.269276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fdb05d25-93f3-4e03-bbb5-57d9ebc8f640 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:43.277757 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fdb05d25-93f3-4e03-bbb5-57d9ebc8f640 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1470 microversion: 2.1 time: 0.748607 Jul 20 04:12:43.291203 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 722/1462] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:42 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1470 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:43.305849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e9ee19ec-953c-4669-9885-01d05833c964 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841e985e0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:43.529998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ef5fad77-e475-4e60-8d85-0416019d99b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:43.539229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ef5fad77-e475-4e60-8d85-0416019d99b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:43.540772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ef5fad77-e475-4e60-8d85-0416019d99b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:43.541931 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ef5fad77-e475-4e60-8d85-0416019d99b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1362 microversion: 2.25 time: 0.328458 Jul 20 04:12:43.542534 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 741/1463] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:43 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:43.565316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5260f7b1-eada-4cc8-9ac4-b7d679f299ec tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:43.565957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5260f7b1-eada-4cc8-9ac4-b7d679f299ec tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:43.586920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5260f7b1-eada-4cc8-9ac4-b7d679f299ec tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.587388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5260f7b1-eada-4cc8-9ac4-b7d679f299ec tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:43.588196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5260f7b1-eada-4cc8-9ac4-b7d679f299ec tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:43.588650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5260f7b1-eada-4cc8-9ac4-b7d679f299ec tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.080122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5260f7b1-eada-4cc8-9ac4-b7d679f299ec tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:44.090703 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5260f7b1-eada-4cc8-9ac4-b7d679f299ec tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1308 microversion: 2.1 time: 0.536870 Jul 20 04:12:44.093215 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 742/1464] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:43 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1308 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:44.310753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86e46ba2-8e4d-44b3-9757-8b56dcf707ea tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:44.311815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-86e46ba2-8e4d-44b3-9757-8b56dcf707ea tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:44.324907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86e46ba2-8e4d-44b3-9757-8b56dcf707ea tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.326567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86e46ba2-8e4d-44b3-9757-8b56dcf707ea tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.329561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86e46ba2-8e4d-44b3-9757-8b56dcf707ea tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:44.330508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86e46ba2-8e4d-44b3-9757-8b56dcf707ea tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:44.406026 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e9ee19ec-953c-4669-9885-01d05833c964 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/207e0086-fd51-4f62-85b5-3383d25204cc" status: 202 len: 0 microversion: 2.1 time: 1.113584 Jul 20 04:12:44.408048 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 723/1465] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:12:43 2022] DELETE /compute/v2.1/os-security-groups/207e0086-fd51-4f62-85b5-3383d25204cc => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:44.418178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f268b15-7028-4336-af37-64d50b801f7d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841e98940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:44.481685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG neutronclient.v2_0.client [None req-0f268b15-7028-4336-af37-64d50b801f7d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist", "detail": ""}} {{(pid=119605) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:12:44.482586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.security_group_api [None req-0f268b15-7028-4336-af37-64d50b801f7d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Neutron security group 207e0086-fd51-4f62-85b5-3383d25204cc not found {{(pid=119605) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:12:44.483118 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-0f268b15-7028-4336-af37-64d50b801f7d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:12:44.483118 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-1264c47d-0019-409b-b49e-4c5a0cdfef55'] Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f268b15-7028-4336-af37-64d50b801f7d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-security-groups/207e0086-fd51-4f62-85b5-3383d25204cc HTTP/1.1 Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: exception: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-1264c47d-0019-409b-b49e-4c5a0cdfef55'] Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '207e0086-fd51-4f62-85b5-3383d25204cc'} Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:12:44.485546 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1264c47d-0019-409b-b49e-4c5a0cdfef55'] Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1264c47d-0019-409b-b49e-4c5a0cdfef55'] Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1264c47d-0019-409b-b49e-4c5a0cdfef55'] Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1264c47d-0019-409b-b49e-4c5a0cdfef55'] Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f268b15-7028-4336-af37-64d50b801f7d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-1264c47d-0019-409b-b49e-4c5a0cdfef55'] {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:44.490534 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0f268b15-7028-4336-af37-64d50b801f7d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/207e0086-fd51-4f62-85b5-3383d25204cc" status: 404 len: 194 microversion: 2.1 time: 0.073584 Jul 20 04:12:44.511744 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 724/1466] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:12:44 2022] GET /compute/v2.1/os-security-groups/207e0086-fd51-4f62-85b5-3383d25204cc => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:44.523122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4cb6c4b8-65f1-40cb-a5ce-394ae244bf9a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841f7e310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:44.965726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-86e46ba2-8e4d-44b3-9757-8b56dcf707ea tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:44.979434 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-86e46ba2-8e4d-44b3-9757-8b56dcf707ea tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1470 microversion: 2.1 time: 0.674319 Jul 20 04:12:44.980766 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 743/1467] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:44 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1470 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:44.992085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7dba9ab2-7fbc-4936-bc34-70d0b93cb96c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:44.995935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7dba9ab2-7fbc-4936-bc34-70d0b93cb96c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:45.015929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dba9ab2-7fbc-4936-bc34-70d0b93cb96c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.017031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dba9ab2-7fbc-4936-bc34-70d0b93cb96c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.018221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dba9ab2-7fbc-4936-bc34-70d0b93cb96c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.030212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7dba9ab2-7fbc-4936-bc34-70d0b93cb96c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.183285 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4cb6c4b8-65f1-40cb-a5ce-394ae244bf9a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/c94fbc38-b073-4b2b-beda-5d28c50bf3ef" status: 202 len: 0 microversion: 2.1 time: 0.669945 Jul 20 04:12:45.187979 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 725/1468] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:12:44 2022] DELETE /compute/v2.1/os-security-groups/c94fbc38-b073-4b2b-beda-5d28c50bf3ef => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:45.200222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d799934f-8c49-409d-b789-0373dc544f6f req-54411e5a-debc-4a51-a82d-fcf6a88792e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe65a9e-ad47-4844-a1d1-b673bca616c5", "tag": "e8758fe3-5fc7-4de5-b21a-4f8e7a450410"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:45.212352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d799934f-8c49-409d-b789-0373dc544f6f req-54411e5a-debc-4a51-a82d-fcf6a88792e0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.217387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d799934f-8c49-409d-b789-0373dc544f6f req-54411e5a-debc-4a51-a82d-fcf6a88792e0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.225336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:45.245790 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d799934f-8c49-409d-b789-0373dc544f6f req-54411e5a-debc-4a51-a82d-fcf6a88792e0 service nova] Creating event network-changed:e8758fe3-5fc7-4de5-b21a-4f8e7a450410 for instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 on n-h1-760456-11 Jul 20 04:12:45.258876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d799934f-8c49-409d-b789-0373dc544f6f req-54411e5a-debc-4a51-a82d-fcf6a88792e0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067890 Jul 20 04:12:45.265530 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 726/1469] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:45.274523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c189d38e-2a1b-4457-81bc-c7d73e8795b6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:45.285898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c189d38e-2a1b-4457-81bc-c7d73e8795b6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:45.302074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c189d38e-2a1b-4457-81bc-c7d73e8795b6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.303026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c189d38e-2a1b-4457-81bc-c7d73e8795b6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.304100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c189d38e-2a1b-4457-81bc-c7d73e8795b6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.304806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c189d38e-2a1b-4457-81bc-c7d73e8795b6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.573415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7dba9ab2-7fbc-4936-bc34-70d0b93cb96c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.590406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7dba9ab2-7fbc-4936-bc34-70d0b93cb96c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.592220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7dba9ab2-7fbc-4936-bc34-70d0b93cb96c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.593866 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7dba9ab2-7fbc-4936-bc34-70d0b93cb96c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1557 microversion: 2.25 time: 0.611976 Jul 20 04:12:45.595223 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 744/1470] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:44 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1557 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:45.602005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8708cf9d-b61d-478d-9bdb-c16f9da09a9c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb842230160>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:45.637289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-8708cf9d-b61d-478d-9bdb-c16f9da09a9c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:12:45.638074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.security_group_api [None req-8708cf9d-b61d-478d-9bdb-c16f9da09a9c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Neutron security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef not found {{(pid=119606) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:12:45.638803 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-8708cf9d-b61d-478d-9bdb-c16f9da09a9c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:12:45.638803 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-59910669-b5d6-46cc-98ed-648053de128f'] Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8708cf9d-b61d-478d-9bdb-c16f9da09a9c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-security-groups/c94fbc38-b073-4b2b-beda-5d28c50bf3ef HTTP/1.1 Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: exception: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-59910669-b5d6-46cc-98ed-648053de128f'] Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'c94fbc38-b073-4b2b-beda-5d28c50bf3ef'} Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:12:45.644619 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59910669-b5d6-46cc-98ed-648053de128f'] Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59910669-b5d6-46cc-98ed-648053de128f'] Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59910669-b5d6-46cc-98ed-648053de128f'] Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59910669-b5d6-46cc-98ed-648053de128f'] Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8708cf9d-b61d-478d-9bdb-c16f9da09a9c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-59910669-b5d6-46cc-98ed-648053de128f'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8708cf9d-b61d-478d-9bdb-c16f9da09a9c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/c94fbc38-b073-4b2b-beda-5d28c50bf3ef" status: 404 len: 194 microversion: 2.1 time: 0.049694 Jul 20 04:12:45.651212 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 745/1471] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:12:45 2022] GET /compute/v2.1/os-security-groups/c94fbc38-b073-4b2b-beda-5d28c50bf3ef => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:45.655167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b1c6c941-ca98-4d92-a179-4f3b5c1c8529 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:45.655920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b1c6c941-ca98-4d92-a179-4f3b5c1c8529 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:45.664082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1c6c941-ca98-4d92-a179-4f3b5c1c8529 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.664539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1c6c941-ca98-4d92-a179-4f3b5c1c8529 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.665327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1c6c941-ca98-4d92-a179-4f3b5c1c8529 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.665767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1c6c941-ca98-4d92-a179-4f3b5c1c8529 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.670889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c189d38e-2a1b-4457-81bc-c7d73e8795b6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:45.684694 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c189d38e-2a1b-4457-81bc-c7d73e8795b6 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1308 microversion: 2.1 time: 0.415902 Jul 20 04:12:45.686136 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 727/1472] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:45 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:45.930764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d07665ff-5f2a-4ef0-8995-165c1025b01c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:45.932132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d07665ff-5f2a-4ef0-8995-165c1025b01c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:45.942846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d07665ff-5f2a-4ef0-8995-165c1025b01c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.944108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d07665ff-5f2a-4ef0-8995-165c1025b01c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:45.951813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d07665ff-5f2a-4ef0-8995-165c1025b01c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:45.952368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d07665ff-5f2a-4ef0-8995-165c1025b01c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.078664 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b1c6c941-ca98-4d92-a179-4f3b5c1c8529 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1814 microversion: 2.1 time: 0.427001 Jul 20 04:12:46.080373 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 746/1473] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:45 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1814 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:46.096080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d33e5bd1-dc56-46f1-ab25-536ab8b1876b tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841eab280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:46.245411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-d07665ff-5f2a-4ef0-8995-165c1025b01c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid 00cd136f-c79e-422a-b3ea-b8b6e73aa96d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:46.278813 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d07665ff-5f2a-4ef0-8995-165c1025b01c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 2052 microversion: 2.25 time: 0.580503 Jul 20 04:12:46.286757 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 728/1474] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:45 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 2052 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:46.286757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f1ebbbb5-00e1-40fc-ac20-1595f2d0de23 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:46.286757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f1ebbbb5-00e1-40fc-ac20-1595f2d0de23 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:46.305328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1ebbbb5-00e1-40fc-ac20-1595f2d0de23 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.305802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1ebbbb5-00e1-40fc-ac20-1595f2d0de23 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.306899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1ebbbb5-00e1-40fc-ac20-1595f2d0de23 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.307364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1ebbbb5-00e1-40fc-ac20-1595f2d0de23 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.477110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f1ebbbb5-00e1-40fc-ac20-1595f2d0de23 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:46.486198 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f1ebbbb5-00e1-40fc-ac20-1595f2d0de23 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1475 microversion: 2.1 time: 0.204684 Jul 20 04:12:46.487030 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 729/1475] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:46 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1475 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:46.492156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e24de6e4-2881-4052-b755-ccdeb9859a8a tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:46.494023 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:46.494023 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:46.496033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e24de6e4-2881-4052-b755-ccdeb9859a8a tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.496659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e24de6e4-2881-4052-b755-ccdeb9859a8a tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.497642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e24de6e4-2881-4052-b755-ccdeb9859a8a tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.498525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e24de6e4-2881-4052-b755-ccdeb9859a8a tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.528239 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e24de6e4-2881-4052-b755-ccdeb9859a8a tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.039840 Jul 20 04:12:46.529257 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 730/1476] 10.222.0.59 () {58 vars in 1175 bytes} [Wed Jul 20 04:12:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:46.535689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ae84daa-d084-47be-82bb-9f9c347c3833 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a0b976b-6ad3-48d9-b3c4-a1f85f3e1928"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:46.536851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ae84daa-d084-47be-82bb-9f9c347c3833 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:46.544448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ae84daa-d084-47be-82bb-9f9c347c3833 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.545131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ae84daa-d084-47be-82bb-9f9c347c3833 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.546077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ae84daa-d084-47be-82bb-9f9c347c3833 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.546706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ae84daa-d084-47be-82bb-9f9c347c3833 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.627256 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d33e5bd1-dc56-46f1-ab25-536ab8b1876b tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/7c3b92e2-217f-4e31-bfd2-ef7d7b303dff" status: 202 len: 0 microversion: 2.1 time: 0.545647 Jul 20 04:12:46.627949 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 747/1477] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:12:46 2022] DELETE /compute/v2.1/os-security-groups/7c3b92e2-217f-4e31-bfd2-ef7d7b303dff => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:46.634091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-91e9c71a-206c-4516-9705-f3fe57e17629 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:46.635229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-91e9c71a-206c-4516-9705-f3fe57e17629 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:46.655867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91e9c71a-206c-4516-9705-f3fe57e17629 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.656745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91e9c71a-206c-4516-9705-f3fe57e17629 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.658844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91e9c71a-206c-4516-9705-f3fe57e17629 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:46.670593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91e9c71a-206c-4516-9705-f3fe57e17629 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:46.977232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-91e9c71a-206c-4516-9705-f3fe57e17629 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid 00cd136f-c79e-422a-b3ea-b8b6e73aa96d {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:47.014630 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-91e9c71a-206c-4516-9705-f3fe57e17629 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 2052 microversion: 2.25 time: 0.385180 Jul 20 04:12:47.019528 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 748/1478] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:46 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 2052 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:47.155089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1406042030", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "604b70c9-b599-4ff3-883c-8483229ab76c"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:47.249093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] validate_networks() for [('604b70c9-b599-4ff3-883c-8483229ab76c', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:47.373628 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ae84daa-d084-47be-82bb-9f9c347c3833 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "POST /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.842718 Jul 20 04:12:47.380211 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 731/1479] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:12:46 2022] POST /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:47.422348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-439ec252-f58a-42db-b131-e7fd4f8415e4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb8422058b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:47.493721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG neutronclient.v2_0.client [None req-439ec252-f58a-42db-b131-e7fd4f8415e4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist", "detail": ""}} {{(pid=119605) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:12:47.494486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.security_group_api [None req-439ec252-f58a-42db-b131-e7fd4f8415e4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Neutron security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff not found {{(pid=119605) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:12:47.495534 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-439ec252-f58a-42db-b131-e7fd4f8415e4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:12:47.495534 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-37d527da-0385-4f37-b57a-0e849a3f42c1'] Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-439ec252-f58a-42db-b131-e7fd4f8415e4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-security-groups/7c3b92e2-217f-4e31-bfd2-ef7d7b303dff HTTP/1.1 Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: exception: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-37d527da-0385-4f37-b57a-0e849a3f42c1'] Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7c3b92e2-217f-4e31-bfd2-ef7d7b303dff'} Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:12:47.499080 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37d527da-0385-4f37-b57a-0e849a3f42c1'] Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37d527da-0385-4f37-b57a-0e849a3f42c1'] Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37d527da-0385-4f37-b57a-0e849a3f42c1'] Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37d527da-0385-4f37-b57a-0e849a3f42c1'] Jul 20 04:12:47.503149 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:12:47.509788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-439ec252-f58a-42db-b131-e7fd4f8415e4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:12:47.509788 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-37d527da-0385-4f37-b57a-0e849a3f42c1'] {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:12:47.511106 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-439ec252-f58a-42db-b131-e7fd4f8415e4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/7c3b92e2-217f-4e31-bfd2-ef7d7b303dff" status: 404 len: 194 microversion: 2.1 time: 0.134370 Jul 20 04:12:47.512268 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 732/1480] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:12:47 2022] GET /compute/v2.1/os-security-groups/7c3b92e2-217f-4e31-bfd2-ef7d7b303dff => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:12:47.517331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:47.532939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-57bd6edc-f962-48d7-ab09-3a7a2a05f848 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:47.533653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-57bd6edc-f962-48d7-ab09-3a7a2a05f848 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:47.571947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57bd6edc-f962-48d7-ab09-3a7a2a05f848 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:47.572419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57bd6edc-f962-48d7-ab09-3a7a2a05f848 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.573273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57bd6edc-f962-48d7-ab09-3a7a2a05f848 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:47.573727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57bd6edc-f962-48d7-ab09-3a7a2a05f848 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.867388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-57bd6edc-f962-48d7-ab09-3a7a2a05f848 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:47.908086 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-57bd6edc-f962-48d7-ab09-3a7a2a05f848 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1308 microversion: 2.1 time: 0.394185 Jul 20 04:12:47.909256 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 733/1481] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:47 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:47.915061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ad4d14b-592d-4f9d-8035-8e9dcdb9f42b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:47.917037 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:47.917037 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:12:47.918791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ad4d14b-592d-4f9d-8035-8e9dcdb9f42b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:47.919488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ad4d14b-592d-4f9d-8035-8e9dcdb9f42b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.920568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ad4d14b-592d-4f9d-8035-8e9dcdb9f42b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:47.921285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ad4d14b-592d-4f9d-8035-8e9dcdb9f42b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:47.978755 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8ad4d14b-592d-4f9d-8035-8e9dcdb9f42b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.065952 Jul 20 04:12:47.981269 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 734/1482] 10.222.0.59 () {60 vars in 1216 bytes} [Wed Jul 20 04:12:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:12:48.001231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-997074931", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2d60a80d-f495-480d-9daa-cf9759718793"}, {"port": "d7d5ae22-6a79-44a5-8895-e9cb3dfd5596", "tag": "port-1"}, {"port": "4437228e-d8f6-466d-873b-2e507d95f8fb", "tag": "port-2"}, {"uuid": "2431f50e-96c6-406e-9e0c-c0ebcb487c65", "tag": "net-1"}, {"uuid": "2431f50e-96c6-406e-9e0c-c0ebcb487c65"}, {"uuid": "49778cfa-8270-466b-a5b1-35f3d22d82ed", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "49778cfa-8270-466b-a5b1-35f3d22d82ed", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5651c47f-c587-4f1d-a838-59a55cbda212", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "77bf9654-ec72-44fb-a433-e17e5e211990", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6be13122-daa4-449a-85d7-f94e376063c0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1266583444"}], "key_name": "tempest-keypair-1403283623", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:48.166940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] validate_networks() for [('2d60a80d-f495-480d-9daa-cf9759718793', None, None, None, None, None), (None, None, 'd7d5ae22-6a79-44a5-8895-e9cb3dfd5596', None, None, None), (None, None, '4437228e-d8f6-466d-873b-2e507d95f8fb', None, None, None), ('2431f50e-96c6-406e-9e0c-c0ebcb487c65', None, None, None, None, None), ('2431f50e-96c6-406e-9e0c-c0ebcb487c65', None, None, None, None, None), ('49778cfa-8270-466b-a5b1-35f3d22d82ed', '10.2.2.100', None, None, None, None), ('49778cfa-8270-466b-a5b1-35f3d22d82ed', '10.2.2.200', None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:48.698892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:48.702196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:48.702774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:48.703212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:48.703725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:48.731225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.731696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.732555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.733011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.761725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Getting quotas for project 331b4b2d7e544142b029b6237d99efae. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:48.767796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Getting quotas for user 678b46bea19846c2869efe2df01293d4 and project 331b4b2d7e544142b029b6237d99efae. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:48.781144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:48.784412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:48.845125 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-abc3e095-1191-4775-a1f5-860c4da31d3c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.823431 Jul 20 04:12:48.851601 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 749/1483] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:48.858809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f705a186-31d6-453b-86f9-819583e0cac8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:48.859901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f705a186-31d6-453b-86f9-819583e0cac8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:48.869416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f705a186-31d6-453b-86f9-819583e0cac8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.870879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f705a186-31d6-453b-86f9-819583e0cac8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:48.872610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f705a186-31d6-453b-86f9-819583e0cac8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:48.873287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f705a186-31d6-453b-86f9-819583e0cac8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.244439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f705a186-31d6-453b-86f9-819583e0cac8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:49.256923 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f705a186-31d6-453b-86f9-819583e0cac8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1475 microversion: 2.1 time: 0.403399 Jul 20 04:12:49.257873 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 750/1484] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:48 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1475 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:49.263776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-400dc3f2-9d98-4029-8867-b6b288cfa969 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb842b1ad30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:49.564730 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-400dc3f2-9d98-4029-8867-b6b288cfa969 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.305493 Jul 20 04:12:49.565628 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 751/1485] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:12:49 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:49.570499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baa966ec-066d-4a26-866e-ab0ac483bd18 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-760456-11", "block_migration": "auto"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:49.573596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-baa966ec-066d-4a26-866e-ab0ac483bd18 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:49.581096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa966ec-066d-4a26-866e-ab0ac483bd18 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.582360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa966ec-066d-4a26-866e-ab0ac483bd18 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.583401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa966ec-066d-4a26-866e-ab0ac483bd18 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:49.584347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa966ec-066d-4a26-866e-ab0ac483bd18 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:49.630877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-baa966ec-066d-4a26-866e-ab0ac483bd18 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'flavor' on Instance uuid 00cd136f-c79e-422a-b3ea-b8b6e73aa96d {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:49.647213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-baa966ec-066d-4a26-866e-ab0ac483bd18 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Going to try to live migrate instance to n-h1-760456-11 {{(pid=119606) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:12:51.657271 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-baa966ec-066d-4a26-866e-ab0ac483bd18 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d/action" status: 202 len: 0 microversion: 2.25 time: 2.089718 Jul 20 04:12:51.661023 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 752/1486] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:12:49 2022] POST /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d/action => generated 0 bytes in 2095 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:12:51.671375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ad52d69-bc99-428d-814a-ba2293ef3199 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.674573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ad52d69-bc99-428d-814a-ba2293ef3199 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:51.691936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ad52d69-bc99-428d-814a-ba2293ef3199 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.692978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ad52d69-bc99-428d-814a-ba2293ef3199 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.694050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ad52d69-bc99-428d-814a-ba2293ef3199 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.695377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ad52d69-bc99-428d-814a-ba2293ef3199 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.721740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:51.789058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ad52d69-bc99-428d-814a-ba2293ef3199 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678b46bea19846c2869efe2df01293d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331b4b2d7e544142b029b6237d99efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:51.806244 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ad52d69-bc99-428d-814a-ba2293ef3199 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 200 len: 1274 microversion: 2.1 time: 0.142915 Jul 20 04:12:51.807286 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 753/1487] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:51.812052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e748d344-a2c7-4014-b1ba-0acc6cc6796b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.812725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e748d344-a2c7-4014-b1ba-0acc6cc6796b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:51.820751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e748d344-a2c7-4014-b1ba-0acc6cc6796b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.821397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e748d344-a2c7-4014-b1ba-0acc6cc6796b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:51.822897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e748d344-a2c7-4014-b1ba-0acc6cc6796b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:51.823782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e748d344-a2c7-4014-b1ba-0acc6cc6796b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.043414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e748d344-a2c7-4014-b1ba-0acc6cc6796b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:52.058658 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e748d344-a2c7-4014-b1ba-0acc6cc6796b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1308 microversion: 2.1 time: 0.248946 Jul 20 04:12:52.059510 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 754/1488] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1308 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:52.071368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d8a96383-14e8-4f28-b63c-d61fc13d1e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9a3f0de-d96b-4a36-a028-0d6ca7dc05e4", "device": "/dev/xvdb"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:52.073345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d8a96383-14e8-4f28-b63c-d61fc13d1e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:52.080967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8a96383-14e8-4f28-b63c-d61fc13d1e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.081676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8a96383-14e8-4f28-b63c-d61fc13d1e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.082734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8a96383-14e8-4f28-b63c-d61fc13d1e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.083370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8a96383-14e8-4f28-b63c-d61fc13d1e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.440624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=10 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:52.458288 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d8a96383-14e8-4f28-b63c-d61fc13d1e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "POST /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397451 Jul 20 04:12:52.459246 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 755/1489] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:12:52 2022] POST /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:52.466021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97f2cfc2-76d7-46dc-bd44-909cf070f0b7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: .version_select at 0x7fb842a9f4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-964356102", "description": "tempest-description-1679467894"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:53.036880 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97f2cfc2-76d7-46dc-bd44-909cf070f0b7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.576383 Jul 20 04:12:53.039079 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 756/1490] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:53.046849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9584d130-be05-40b1-a126-0ca7d0015a1b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:53.051899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:53.052268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9584d130-be05-40b1-a126-0ca7d0015a1b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:53.052392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:53.052785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:53.053348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:53.053767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:53.072488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.072948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.073912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.074384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.081904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9584d130-be05-40b1-a126-0ca7d0015a1b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.082521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9584d130-be05-40b1-a126-0ca7d0015a1b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.083396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9584d130-be05-40b1-a126-0ca7d0015a1b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.083850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9584d130-be05-40b1-a126-0ca7d0015a1b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.132237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Getting quotas for project 29c19ef6ed5b4e27947af6ce219d18d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:53.145057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Getting quotas for user 2ea3ed970c1348aa922dda7fb3edf866 and project 29c19ef6ed5b4e27947af6ce219d18d5. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:53.417181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9584d130-be05-40b1-a126-0ca7d0015a1b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.426011 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9584d130-be05-40b1-a126-0ca7d0015a1b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1475 microversion: 2.1 time: 0.385080 Jul 20 04:12:53.433000 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 757/1491] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1475 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:53.439996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-fd9bfa26-84d5-4c49-a1f3-308eedb929a1 req-274c604d-2a70-4441-9752-c09289207081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe65a9e-ad47-4844-a1d1-b673bca616c5", "name": "network-vif-plugged", "status": "completed", "tag": "e8758fe3-5fc7-4de5-b21a-4f8e7a450410"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:53.467828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fd9bfa26-84d5-4c49-a1f3-308eedb929a1 req-274c604d-2a70-4441-9752-c09289207081 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.468290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fd9bfa26-84d5-4c49-a1f3-308eedb929a1 req-274c604d-2a70-4441-9752-c09289207081 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.500449 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-fd9bfa26-84d5-4c49-a1f3-308eedb929a1 req-274c604d-2a70-4441-9752-c09289207081 service nova] Creating event network-vif-plugged:e8758fe3-5fc7-4de5-b21a-4f8e7a450410 for instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 on n-h1-760456-11 Jul 20 04:12:53.513434 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-fd9bfa26-84d5-4c49-a1f3-308eedb929a1 req-274c604d-2a70-4441-9752-c09289207081 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078596 Jul 20 04:12:53.525275 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 758/1492] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:53.541790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e6c2de68-52fc-4f62-9046-d79d182001b8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:53.542538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e6c2de68-52fc-4f62-9046-d79d182001b8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:53.544552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:53.565051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6c2de68-52fc-4f62-9046-d79d182001b8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.565517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6c2de68-52fc-4f62-9046-d79d182001b8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.566345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6c2de68-52fc-4f62-9046-d79d182001b8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.566802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6c2de68-52fc-4f62-9046-d79d182001b8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.943226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e6c2de68-52fc-4f62-9046-d79d182001b8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.972324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e6c2de68-52fc-4f62-9046-d79d182001b8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.975860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e6c2de68-52fc-4f62-9046-d79d182001b8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:53.977741 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e6c2de68-52fc-4f62-9046-d79d182001b8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1567 microversion: 2.25 time: 0.447142 Jul 20 04:12:53.978616 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 759/1493] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1567 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:53.998061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8cce69dd-5519-4813-a2c0-8c469eb1a5a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:53.998993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8cce69dd-5519-4813-a2c0-8c469eb1a5a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:54.007749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cce69dd-5519-4813-a2c0-8c469eb1a5a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.008562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cce69dd-5519-4813-a2c0-8c469eb1a5a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.009604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cce69dd-5519-4813-a2c0-8c469eb1a5a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.011276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cce69dd-5519-4813-a2c0-8c469eb1a5a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.298006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8cce69dd-5519-4813-a2c0-8c469eb1a5a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678b46bea19846c2869efe2df01293d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331b4b2d7e544142b029b6237d99efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:54.311083 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8cce69dd-5519-4813-a2c0-8c469eb1a5a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 200 len: 1316 microversion: 2.1 time: 0.317185 Jul 20 04:12:54.315408 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 760/1494] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:54.327729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f7a166d-986f-4a28-afc3-c5a1d33bc09c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: .version_select at 0x7fb841d01820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-57440223", "description": "tempest-description-1888495912"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:54.668572 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f7a166d-986f-4a28-afc3-c5a1d33bc09c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.351744 Jul 20 04:12:54.669255 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 761/1495] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:12:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:54.675552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-942b734e-0c9f-4302-92b8-68ef8dbfb696 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:54.676182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-942b734e-0c9f-4302-92b8-68ef8dbfb696 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:54.704308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942b734e-0c9f-4302-92b8-68ef8dbfb696 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.706754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942b734e-0c9f-4302-92b8-68ef8dbfb696 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.708674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942b734e-0c9f-4302-92b8-68ef8dbfb696 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.709235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942b734e-0c9f-4302-92b8-68ef8dbfb696 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.879596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-942b734e-0c9f-4302-92b8-68ef8dbfb696 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:54.887907 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-942b734e-0c9f-4302-92b8-68ef8dbfb696 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1308 microversion: 2.1 time: 0.217579 Jul 20 04:12:54.888950 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 762/1496] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:54 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:54.894699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a9e34ec9-5c4c-4ec5-9d4b-3017f4491007 req-2bbe5756-64e5-41e4-9182-4ddd8c285f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca12048-6ea8-42d1-b6c3-94a6c28c4377", "tag": "58ced8b4-3955-4e7d-9955-a190a39d8ba9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:54.911757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a9e34ec9-5c4c-4ec5-9d4b-3017f4491007 req-2bbe5756-64e5-41e4-9182-4ddd8c285f0f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.912723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a9e34ec9-5c4c-4ec5-9d4b-3017f4491007 req-2bbe5756-64e5-41e4-9182-4ddd8c285f0f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.928783 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a9e34ec9-5c4c-4ec5-9d4b-3017f4491007 req-2bbe5756-64e5-41e4-9182-4ddd8c285f0f service nova] Creating event network-changed:58ced8b4-3955-4e7d-9955-a190a39d8ba9 for instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 on n-h2-760456-11 Jul 20 04:12:54.934604 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a9e34ec9-5c4c-4ec5-9d4b-3017f4491007 req-2bbe5756-64e5-41e4-9182-4ddd8c285f0f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042604 Jul 20 04:12:54.935387 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 763/1497] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:54.945328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-21d10508-c6ce-411e-bccc-81b0b65a3863 req-93b28c16-62e8-4d83-a556-3ce58e983972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cd136f-c79e-422a-b3ea-b8b6e73aa96d", "name": "network-vif-unplugged", "status": "completed", "tag": "c78a3349-2e55-45c6-9808-0b45347d0b3b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:54.954927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-21d10508-c6ce-411e-bccc-81b0b65a3863 req-93b28c16-62e8-4d83-a556-3ce58e983972 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:54.955620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-21d10508-c6ce-411e-bccc-81b0b65a3863 req-93b28c16-62e8-4d83-a556-3ce58e983972 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:54.969286 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-21d10508-c6ce-411e-bccc-81b0b65a3863 req-93b28c16-62e8-4d83-a556-3ce58e983972 service nova] Creating event network-vif-unplugged:c78a3349-2e55-45c6-9808-0b45347d0b3b for instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d on n-h2-760456-11 Jul 20 04:12:54.975470 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-21d10508-c6ce-411e-bccc-81b0b65a3863 req-93b28c16-62e8-4d83-a556-3ce58e983972 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033364 Jul 20 04:12:54.979327 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 764/1498] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:54.986639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-88d6a9d2-2376-4f21-9151-805f261fdfab tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:54.987612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-88d6a9d2-2376-4f21-9151-805f261fdfab tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.004775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-88d6a9d2-2376-4f21-9151-805f261fdfab tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.006344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-88d6a9d2-2376-4f21-9151-805f261fdfab tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.007449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-88d6a9d2-2376-4f21-9151-805f261fdfab tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.008010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-88d6a9d2-2376-4f21-9151-805f261fdfab tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.171212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-88d6a9d2-2376-4f21-9151-805f261fdfab tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:55.180000 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-88d6a9d2-2376-4f21-9151-805f261fdfab tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1475 microversion: 2.1 time: 0.199106 Jul 20 04:12:55.180589 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 765/1499] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:54 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1475 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:55.185318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1388402492", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "24279765-8c7d-49e8-a577-95b4ec8373a0"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:55.240903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] validate_networks() for [('24279765-8c7d-49e8-a577-95b4ec8373a0', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:12:55.506606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:55.509456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5651c47f-c587-4f1d-a838-59a55cbda212',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='77bf9654-ec72-44fb-a433-e17e5e211990',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6be13122-daa4-449a-85d7-f94e376063c0',volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:55.840452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:12:55.842439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:12:55.843181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:12:55.843848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:12:55.845378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:12:55.858374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.859139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.860484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.861385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.883645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Getting quotas for project 2152dc59b4bb4b40bab36a32b782e70b. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:12:55.897196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Getting quotas for user aebf32ff7a3146f0a29ac97b5d868794 and project 2152dc59b4bb4b40bab36a32b782e70b. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:12:55.913887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:12:55.916449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:12:55.916688 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ff404739-7dbb-48ba-b129-23a58207e62d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.928786 Jul 20 04:12:55.917314 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 735/1500] 10.222.0.59 () {62 vars in 1188 bytes} [Wed Jul 20 04:12:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 7931 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:12:55.936351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-79b1fa01-5921-4c1b-b276-59ea987f31b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.939799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-79b1fa01-5921-4c1b-b276-59ea987f31b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.956935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79b1fa01-5921-4c1b-b276-59ea987f31b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.968677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79b1fa01-5921-4c1b-b276-59ea987f31b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.973266 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc8651a8-cd8f-4d74-9e17-ee170329f97a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791432 Jul 20 04:12:55.974684 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 766/1501] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:12:55.979680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f42e3f32-1e26-4c9d-bba6-174a5a27fdab tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:55.980689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f42e3f32-1e26-4c9d-bba6-174a5a27fdab tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:55.988408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79b1fa01-5921-4c1b-b276-59ea987f31b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.989126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79b1fa01-5921-4c1b-b276-59ea987f31b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.989572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f42e3f32-1e26-4c9d-bba6-174a5a27fdab tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.990451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f42e3f32-1e26-4c9d-bba6-174a5a27fdab tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:55.991455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f42e3f32-1e26-4c9d-bba6-174a5a27fdab tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:55.992059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f42e3f32-1e26-4c9d-bba6-174a5a27fdab tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.346642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f42e3f32-1e26-4c9d-bba6-174a5a27fdab tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678b46bea19846c2869efe2df01293d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331b4b2d7e544142b029b6237d99efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.369322 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f42e3f32-1e26-4c9d-bba6-174a5a27fdab tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 200 len: 1316 microversion: 2.1 time: 0.393300 Jul 20 04:12:56.381346 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 767/1502] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:55 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:56.391509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a77982c6-9e1a-449b-aae7-ab011a7762fa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.393263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a77982c6-9e1a-449b-aae7-ab011a7762fa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.404238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a77982c6-9e1a-449b-aae7-ab011a7762fa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.405098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a77982c6-9e1a-449b-aae7-ab011a7762fa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.407290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a77982c6-9e1a-449b-aae7-ab011a7762fa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.408400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a77982c6-9e1a-449b-aae7-ab011a7762fa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.468321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-79b1fa01-5921-4c1b-b276-59ea987f31b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.489582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-79b1fa01-5921-4c1b-b276-59ea987f31b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.495840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-79b1fa01-5921-4c1b-b276-59ea987f31b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.499056 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-79b1fa01-5921-4c1b-b276-59ea987f31b9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1567 microversion: 2.25 time: 0.574979 Jul 20 04:12:56.499824 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 736/1503] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:55 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1567 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:56.513064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-161fff59-52be-4ef7-b263-964c89c9dd00 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.514808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-161fff59-52be-4ef7-b263-964c89c9dd00 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.712570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-161fff59-52be-4ef7-b263-964c89c9dd00 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.725320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-161fff59-52be-4ef7-b263-964c89c9dd00 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.728786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-161fff59-52be-4ef7-b263-964c89c9dd00 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.732825 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-161fff59-52be-4ef7-b263-964c89c9dd00 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1285 microversion: 2.42 time: 0.230268 Jul 20 04:12:56.735633 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 737/1504] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:56.749059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f5796f91-918a-45c4-b544-a831499940c6 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.750083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f5796f91-918a-45c4-b544-a831499940c6 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.789392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a77982c6-9e1a-449b-aae7-ab011a7762fa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:56.799120 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a77982c6-9e1a-449b-aae7-ab011a7762fa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1488 microversion: 2.1 time: 0.416114 Jul 20 04:12:56.799707 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 768/1505] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1488 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:56.808952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1ff5e1e-3d3a-447c-8622-266508dc7516 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:56.813407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1ff5e1e-3d3a-447c-8622-266508dc7516 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:56.817441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5796f91-918a-45c4-b544-a831499940c6 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.819645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5796f91-918a-45c4-b544-a831499940c6 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.821665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5796f91-918a-45c4-b544-a831499940c6 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.824503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5796f91-918a-45c4-b544-a831499940c6 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.828457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ff5e1e-3d3a-447c-8622-266508dc7516 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.832278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ff5e1e-3d3a-447c-8622-266508dc7516 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:56.839373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ff5e1e-3d3a-447c-8622-266508dc7516 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:56.840233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ff5e1e-3d3a-447c-8622-266508dc7516 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.016341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f5796f91-918a-45c4-b544-a831499940c6 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:57.030876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f5796f91-918a-45c4-b544-a831499940c6 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1212 microversion: 2.1 time: 0.287084 Jul 20 04:12:57.043013 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 738/1506] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1212 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:57.055648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ac646cbb-6b11-430b-ad6b-215fcc1e99fd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:57.065279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ac646cbb-6b11-430b-ad6b-215fcc1e99fd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:57.079662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac646cbb-6b11-430b-ad6b-215fcc1e99fd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.081520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac646cbb-6b11-430b-ad6b-215fcc1e99fd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.083429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac646cbb-6b11-430b-ad6b-215fcc1e99fd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.083994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac646cbb-6b11-430b-ad6b-215fcc1e99fd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.138648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-ac646cbb-6b11-430b-ad6b-215fcc1e99fd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lazy-loading 'flavor' on Instance uuid 8fe65a9e-ad47-4844-a1d1-b673bca616c5 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:12:57.175290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a1ff5e1e-3d3a-447c-8622-266508dc7516 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:57.189342 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1ff5e1e-3d3a-447c-8622-266508dc7516 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1475 microversion: 2.1 time: 0.385366 Jul 20 04:12:57.200337 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 769/1507] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:56 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1475 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:57.211848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3647433d-0ec9-4b8f-88e1-66d080c1eba0 req-2e5310f6-8a77-4e33-8694-46cb359e7feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00cd136f-c79e-422a-b3ea-b8b6e73aa96d", "tag": "c78a3349-2e55-45c6-9808-0b45347d0b3b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:57.228449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3647433d-0ec9-4b8f-88e1-66d080c1eba0 req-2e5310f6-8a77-4e33-8694-46cb359e7feb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.239015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3647433d-0ec9-4b8f-88e1-66d080c1eba0 req-2e5310f6-8a77-4e33-8694-46cb359e7feb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.251741 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3647433d-0ec9-4b8f-88e1-66d080c1eba0 req-2e5310f6-8a77-4e33-8694-46cb359e7feb service nova] Creating event network-changed:c78a3349-2e55-45c6-9808-0b45347d0b3b for instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d on n-h2-760456-11 Jul 20 04:12:57.257291 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3647433d-0ec9-4b8f-88e1-66d080c1eba0 req-2e5310f6-8a77-4e33-8694-46cb359e7feb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055521 Jul 20 04:12:57.258371 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 770/1508] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:57.370750 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ac646cbb-6b11-430b-ad6b-215fcc1e99fd tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5/action" status: 202 len: 0 microversion: 2.1 time: 0.324241 Jul 20 04:12:57.384278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e497d1e-52d5-4dab-a8cf-d77999cfbfca tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:57.385001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e497d1e-52d5-4dab-a8cf-d77999cfbfca tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:57.388304 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 739/1509] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:57 2022] POST /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:12:57.397841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e497d1e-52d5-4dab-a8cf-d77999cfbfca tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.402304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e497d1e-52d5-4dab-a8cf-d77999cfbfca tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.403148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e497d1e-52d5-4dab-a8cf-d77999cfbfca tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.407062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-12bdd5f7-7d22-44c3-9cbc-5e86cef01746 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:57.407810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-12bdd5f7-7d22-44c3-9cbc-5e86cef01746 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:57.410403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e497d1e-52d5-4dab-a8cf-d77999cfbfca tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.432384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12bdd5f7-7d22-44c3-9cbc-5e86cef01746 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.434185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12bdd5f7-7d22-44c3-9cbc-5e86cef01746 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.436723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12bdd5f7-7d22-44c3-9cbc-5e86cef01746 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.439055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12bdd5f7-7d22-44c3-9cbc-5e86cef01746 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.800409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e497d1e-52d5-4dab-a8cf-d77999cfbfca tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:57.812813 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e497d1e-52d5-4dab-a8cf-d77999cfbfca tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1496 microversion: 2.1 time: 0.430474 Jul 20 04:12:57.813868 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 771/1510] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:57 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1496 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:57.819905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-12bdd5f7-7d22-44c3-9cbc-5e86cef01746 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678b46bea19846c2869efe2df01293d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331b4b2d7e544142b029b6237d99efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:57.822033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7304e198-057c-4dee-ba52-947273650e51 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:57.822956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7304e198-057c-4dee-ba52-947273650e51 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:57.832711 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-12bdd5f7-7d22-44c3-9cbc-5e86cef01746 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 200 len: 1316 microversion: 2.1 time: 0.439059 Jul 20 04:12:57.834614 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 740/1511] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:57 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:57.841033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7304e198-057c-4dee-ba52-947273650e51 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.845300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6045bcb3-c679-4c68-89e1-283ee2eb217a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:57.845930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6045bcb3-c679-4c68-89e1-283ee2eb217a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:57.848035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7304e198-057c-4dee-ba52-947273650e51 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.849214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7304e198-057c-4dee-ba52-947273650e51 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.849926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7304e198-057c-4dee-ba52-947273650e51 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.863770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6045bcb3-c679-4c68-89e1-283ee2eb217a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.864225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6045bcb3-c679-4c68-89e1-283ee2eb217a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:57.865022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6045bcb3-c679-4c68-89e1-283ee2eb217a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:57.865460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6045bcb3-c679-4c68-89e1-283ee2eb217a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.028257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7304e198-057c-4dee-ba52-947273650e51 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:58.039288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7304e198-057c-4dee-ba52-947273650e51 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:58.041259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7304e198-057c-4dee-ba52-947273650e51 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:58.042952 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7304e198-057c-4dee-ba52-947273650e51 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1567 microversion: 2.25 time: 0.227259 Jul 20 04:12:58.044313 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 772/1512] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:57 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:58.050451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f4dbb8e-8e45-4eac-819b-89196b8d7828 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:58.051833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8f4dbb8e-8e45-4eac-819b-89196b8d7828 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:58.061355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4dbb8e-8e45-4eac-819b-89196b8d7828 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.061933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4dbb8e-8e45-4eac-819b-89196b8d7828 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.063499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4dbb8e-8e45-4eac-819b-89196b8d7828 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.064335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4dbb8e-8e45-4eac-819b-89196b8d7828 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.144337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8f4dbb8e-8e45-4eac-819b-89196b8d7828 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:58.153290 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8f4dbb8e-8e45-4eac-819b-89196b8d7828 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1274 microversion: 2.1 time: 0.107564 Jul 20 04:12:58.154150 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 773/1513] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:58 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:58.220915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37433f26-e62c-4b22-9c5e-aad5deefee4e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:58.221608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37433f26-e62c-4b22-9c5e-aad5deefee4e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:58.229350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37433f26-e62c-4b22-9c5e-aad5deefee4e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.229836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37433f26-e62c-4b22-9c5e-aad5deefee4e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.230851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37433f26-e62c-4b22-9c5e-aad5deefee4e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.245932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37433f26-e62c-4b22-9c5e-aad5deefee4e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.293823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:58.303513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6045bcb3-c679-4c68-89e1-283ee2eb217a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:58.312569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6045bcb3-c679-4c68-89e1-283ee2eb217a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:58.314879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6045bcb3-c679-4c68-89e1-283ee2eb217a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:58.316054 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6045bcb3-c679-4c68-89e1-283ee2eb217a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1575 microversion: 2.42 time: 0.480462 Jul 20 04:12:58.316614 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 741/1514] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:57 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1575 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:58.694631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-37433f26-e62c-4b22-9c5e-aad5deefee4e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:58.705786 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37433f26-e62c-4b22-9c5e-aad5deefee4e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1475 microversion: 2.1 time: 0.501032 Jul 20 04:12:58.707377 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 774/1515] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:58 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1475 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:58.830865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2e6e8b9-20f4-47d3-9c47-bddb14d66563 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:58.831471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c2e6e8b9-20f4-47d3-9c47-bddb14d66563 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:58.843173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2e6e8b9-20f4-47d3-9c47-bddb14d66563 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.845383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2e6e8b9-20f4-47d3-9c47-bddb14d66563 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.846390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2e6e8b9-20f4-47d3-9c47-bddb14d66563 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.850446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1467b511-c363-44b4-b91b-2f7d906be004 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:58.851289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1467b511-c363-44b4-b91b-2f7d906be004 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:58.856662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2e6e8b9-20f4-47d3-9c47-bddb14d66563 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.863167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1467b511-c363-44b4-b91b-2f7d906be004 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.863949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1467b511-c363-44b4-b91b-2f7d906be004 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:58.864943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1467b511-c363-44b4-b91b-2f7d906be004 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:58.867140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1467b511-c363-44b4-b91b-2f7d906be004 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.015551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2e6e8b9-20f4-47d3-9c47-bddb14d66563 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:59.024480 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c2e6e8b9-20f4-47d3-9c47-bddb14d66563 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 200 len: 1479 microversion: 2.1 time: 0.197719 Jul 20 04:12:59.026330 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 742/1516] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:58 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 1479 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:12:59.045952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3dc70013-c924-42e4-8a9c-63e018812e92 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-953956078"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:12:59.049144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3dc70013-c924-42e4-8a9c-63e018812e92 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:59.056305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3dc70013-c924-42e4-8a9c-63e018812e92 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.057009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3dc70013-c924-42e4-8a9c-63e018812e92 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.059816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3dc70013-c924-42e4-8a9c-63e018812e92 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.060520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3dc70013-c924-42e4-8a9c-63e018812e92 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.462330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:59.574405 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3dc70013-c924-42e4-8a9c-63e018812e92 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5/action" status: 202 len: 0 microversion: 2.1 time: 0.530136 Jul 20 04:12:59.579452 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 743/1517] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:12:59 2022] POST /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 20 04:12:59.588053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-457f0cfa-43f4-4a26-91f0-c6924a083d93 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:59.588768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-457f0cfa-43f4-4a26-91f0-c6924a083d93 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:59.596960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-457f0cfa-43f4-4a26-91f0-c6924a083d93 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.597807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-457f0cfa-43f4-4a26-91f0-c6924a083d93 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.599036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-457f0cfa-43f4-4a26-91f0-c6924a083d93 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.599754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-457f0cfa-43f4-4a26-91f0-c6924a083d93 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.838172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-457f0cfa-43f4-4a26-91f0-c6924a083d93 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:59.848721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-457f0cfa-43f4-4a26-91f0-c6924a083d93 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:59.850348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-457f0cfa-43f4-4a26-91f0-c6924a083d93 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:12:59.851468 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-457f0cfa-43f4-4a26-91f0-c6924a083d93 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1567 microversion: 2.25 time: 0.270819 Jul 20 04:12:59.862755 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 744/1518] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:12:59 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:59.862755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-86c8cef0-1330-4a26-839e-0386b0cb7469 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:59.862755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-86c8cef0-1330-4a26-839e-0386b0cb7469 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:12:59.868473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86c8cef0-1330-4a26-839e-0386b0cb7469 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.868939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86c8cef0-1330-4a26-839e-0386b0cb7469 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.869779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86c8cef0-1330-4a26-839e-0386b0cb7469 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:59.870232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86c8cef0-1330-4a26-839e-0386b0cb7469 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:59.991246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1467b511-c363-44b4-b91b-2f7d906be004 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678b46bea19846c2869efe2df01293d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331b4b2d7e544142b029b6237d99efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.001753 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1467b511-c363-44b4-b91b-2f7d906be004 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 200 len: 1316 microversion: 2.1 time: 1.155063 Jul 20 04:13:00.003098 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 775/1519] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:58 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 1316 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:00.008601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e1fb6526-c66b-44dc-a185-e3fc187e4379 req-2b74d179-b428-4090-9c70-cd3ad4963834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca12048-6ea8-42d1-b6c3-94a6c28c4377", "name": "network-vif-plugged", "status": "completed", "tag": "58ced8b4-3955-4e7d-9955-a190a39d8ba9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:00.020083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e1fb6526-c66b-44dc-a185-e3fc187e4379 req-2b74d179-b428-4090-9c70-cd3ad4963834 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.020910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e1fb6526-c66b-44dc-a185-e3fc187e4379 req-2b74d179-b428-4090-9c70-cd3ad4963834 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.035437 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e1fb6526-c66b-44dc-a185-e3fc187e4379 req-2b74d179-b428-4090-9c70-cd3ad4963834 service nova] Creating event network-vif-plugged:58ced8b4-3955-4e7d-9955-a190a39d8ba9 for instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 on n-h2-760456-11 Jul 20 04:13:00.036365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-86c8cef0-1330-4a26-839e-0386b0cb7469 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.042117 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e1fb6526-c66b-44dc-a185-e3fc187e4379 req-2b74d179-b428-4090-9c70-cd3ad4963834 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037230 Jul 20 04:13:00.043728 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 776/1520] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:00.047765 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-86c8cef0-1330-4a26-839e-0386b0cb7469 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1316 microversion: 2.1 time: 0.192955 Jul 20 04:13:00.048633 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 745/1521] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:12:59 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:00.053594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-19aba32f-f9f5-4d28-bd5e-3421f30ac775 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:00.054147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ed54f9b8-2491-4135-9ca4-abf8b0e9e49b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8424e6d30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:00.054638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-19aba32f-f9f5-4d28-bd5e-3421f30ac775 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:00.064887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19aba32f-f9f5-4d28-bd5e-3421f30ac775 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.065562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19aba32f-f9f5-4d28-bd5e-3421f30ac775 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.066754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19aba32f-f9f5-4d28-bd5e-3421f30ac775 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.067462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19aba32f-f9f5-4d28-bd5e-3421f30ac775 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.110840 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ed54f9b8-2491-4135-9ca4-abf8b0e9e49b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.060491 Jul 20 04:13:00.114237 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 746/1522] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:00 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:00.121169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5713e26e-36e6-40d4-b900-bffab0762fac tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:00.122122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5713e26e-36e6-40d4-b900-bffab0762fac tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:00.129389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5713e26e-36e6-40d4-b900-bffab0762fac tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.130737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5713e26e-36e6-40d4-b900-bffab0762fac tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.131720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5713e26e-36e6-40d4-b900-bffab0762fac tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.132998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5713e26e-36e6-40d4-b900-bffab0762fac tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.294415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5713e26e-36e6-40d4-b900-bffab0762fac tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.303612 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5713e26e-36e6-40d4-b900-bffab0762fac tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1475 microversion: 2.1 time: 0.188096 Jul 20 04:13:00.309233 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 747/1523] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:00 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1475 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:00.352085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-19aba32f-f9f5-4d28-bd5e-3421f30ac775 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.364609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-19aba32f-f9f5-4d28-bd5e-3421f30ac775 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.366137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-19aba32f-f9f5-4d28-bd5e-3421f30ac775 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:00.367394 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-19aba32f-f9f5-4d28-bd5e-3421f30ac775 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1593 microversion: 2.42 time: 0.321803 Jul 20 04:13:00.367966 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 777/1524] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:00 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1593 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:00.870338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e68e2d9-2d9d-4b5f-a02f-caa3ad64e427 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:00.870941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e68e2d9-2d9d-4b5f-a02f-caa3ad64e427 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:00.878539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e68e2d9-2d9d-4b5f-a02f-caa3ad64e427 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.879317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e68e2d9-2d9d-4b5f-a02f-caa3ad64e427 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:00.880731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e68e2d9-2d9d-4b5f-a02f-caa3ad64e427 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:00.881336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e68e2d9-2d9d-4b5f-a02f-caa3ad64e427 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.020963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9793eb85-64a7-4cc5-9e8b-47896d3cbecb tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.022207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9793eb85-64a7-4cc5-9e8b-47896d3cbecb tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.036186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9793eb85-64a7-4cc5-9e8b-47896d3cbecb tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.039089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9793eb85-64a7-4cc5-9e8b-47896d3cbecb tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.042272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9793eb85-64a7-4cc5-9e8b-47896d3cbecb tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.042924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9793eb85-64a7-4cc5-9e8b-47896d3cbecb tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.478815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e68e2d9-2d9d-4b5f-a02f-caa3ad64e427 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:01.494855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e68e2d9-2d9d-4b5f-a02f-caa3ad64e427 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:01.497584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9793eb85-64a7-4cc5-9e8b-47896d3cbecb tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678b46bea19846c2869efe2df01293d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331b4b2d7e544142b029b6237d99efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:01.497899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e68e2d9-2d9d-4b5f-a02f-caa3ad64e427 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:01.503544 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e68e2d9-2d9d-4b5f-a02f-caa3ad64e427 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1567 microversion: 2.25 time: 0.632750 Jul 20 04:13:01.508129 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9793eb85-64a7-4cc5-9e8b-47896d3cbecb tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 200 len: 1316 microversion: 2.1 time: 0.491668 Jul 20 04:13:01.517058 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 748/1525] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:00 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1567 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:01.521981 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 778/1526] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:01.528266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6a19dc8-71f3-4a76-af52-505a79b9014c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.531065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e6a19dc8-71f3-4a76-af52-505a79b9014c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.532305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17b8ded7-7973-431b-a4c0-12a35a26c975 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841cf11f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.561449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a19dc8-71f3-4a76-af52-505a79b9014c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.562198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a19dc8-71f3-4a76-af52-505a79b9014c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.565470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a19dc8-71f3-4a76-af52-505a79b9014c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.568130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a19dc8-71f3-4a76-af52-505a79b9014c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.612705 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-17b8ded7-7973-431b-a4c0-12a35a26c975 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.089017 Jul 20 04:13:01.614171 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 779/1527] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:01.624091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a649266-6972-49bc-8d47-ef915009996c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.627890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3a649266-6972-49bc-8d47-ef915009996c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.642284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a649266-6972-49bc-8d47-ef915009996c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.643364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a649266-6972-49bc-8d47-ef915009996c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.644178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a649266-6972-49bc-8d47-ef915009996c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:01.644630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a649266-6972-49bc-8d47-ef915009996c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:01.910356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3a649266-6972-49bc-8d47-ef915009996c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:01.931617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3a649266-6972-49bc-8d47-ef915009996c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1474 microversion: 2.1 time: 0.315530 Jul 20 04:13:01.956951 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 780/1528] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1474 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:01.975691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2d8fbcf6-e57c-4076-bd87-b1ab37765af6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:01.976360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2d8fbcf6-e57c-4076-bd87-b1ab37765af6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:01.998458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d8fbcf6-e57c-4076-bd87-b1ab37765af6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.004820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d8fbcf6-e57c-4076-bd87-b1ab37765af6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.005934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d8fbcf6-e57c-4076-bd87-b1ab37765af6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.006655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d8fbcf6-e57c-4076-bd87-b1ab37765af6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.236093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6a19dc8-71f3-4a76-af52-505a79b9014c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:02.248471 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6a19dc8-71f3-4a76-af52-505a79b9014c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1316 microversion: 2.1 time: 0.729584 Jul 20 04:13:02.249736 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 749/1529] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1316 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:02.349475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-00bfb1ba-cee4-444c-ac5b-8d34ff8690fa req-1b52d888-ccee-4358-ae26-00590cb16bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26b3126-e80d-4687-a609-36e6cca0b861", "tag": "d60885a1-1430-4843-baf6-315aebbd7b84"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:02.367005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-00bfb1ba-cee4-444c-ac5b-8d34ff8690fa req-1b52d888-ccee-4358-ae26-00590cb16bf9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.374499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-00bfb1ba-cee4-444c-ac5b-8d34ff8690fa req-1b52d888-ccee-4358-ae26-00590cb16bf9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.393522 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-00bfb1ba-cee4-444c-ac5b-8d34ff8690fa req-1b52d888-ccee-4358-ae26-00590cb16bf9 service nova] Creating event network-changed:d60885a1-1430-4843-baf6-315aebbd7b84 for instance b26b3126-e80d-4687-a609-36e6cca0b861 on n-h1-760456-11 Jul 20 04:13:02.398396 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-00bfb1ba-cee4-444c-ac5b-8d34ff8690fa req-1b52d888-ccee-4358-ae26-00590cb16bf9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146911 Jul 20 04:13:02.399023 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 750/1530] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:02.404501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2523ce6d-baa7-4f8b-a218-0ca431ed4f91 req-281a8897-1769-40a6-bd2b-9af2c790692b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cd136f-c79e-422a-b3ea-b8b6e73aa96d", "name": "network-vif-unplugged", "status": "completed", "tag": "c78a3349-2e55-45c6-9808-0b45347d0b3b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:02.430933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2523ce6d-baa7-4f8b-a218-0ca431ed4f91 req-281a8897-1769-40a6-bd2b-9af2c790692b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.431303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2523ce6d-baa7-4f8b-a218-0ca431ed4f91 req-281a8897-1769-40a6-bd2b-9af2c790692b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.462540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d8fbcf6-e57c-4076-bd87-b1ab37765af6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:02.464375 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2523ce6d-baa7-4f8b-a218-0ca431ed4f91 req-281a8897-1769-40a6-bd2b-9af2c790692b service nova] Creating event network-vif-unplugged:c78a3349-2e55-45c6-9808-0b45347d0b3b for instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d on n-h2-760456-11 Jul 20 04:13:02.476787 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2523ce6d-baa7-4f8b-a218-0ca431ed4f91 req-281a8897-1769-40a6-bd2b-9af2c790692b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075734 Jul 20 04:13:02.479034 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 751/1531] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:02.487252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d8fbcf6-e57c-4076-bd87-b1ab37765af6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:02.490498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d8fbcf6-e57c-4076-bd87-b1ab37765af6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:02.493676 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2d8fbcf6-e57c-4076-bd87-b1ab37765af6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1661 microversion: 2.42 time: 0.533919 Jul 20 04:13:02.508684 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 781/1532] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:01 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1661 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:02.527891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e0565158-9c0a-4809-ba23-0eec1c6e8520 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:02.533070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e0565158-9c0a-4809-ba23-0eec1c6e8520 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:02.553043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0fec5578-efb7-4725-84f9-99945f3f5213 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:02.553651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0fec5578-efb7-4725-84f9-99945f3f5213 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:02.555949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0565158-9c0a-4809-ba23-0eec1c6e8520 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.557381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0565158-9c0a-4809-ba23-0eec1c6e8520 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.559523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0565158-9c0a-4809-ba23-0eec1c6e8520 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.560665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0565158-9c0a-4809-ba23-0eec1c6e8520 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.575532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fec5578-efb7-4725-84f9-99945f3f5213 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.576208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fec5578-efb7-4725-84f9-99945f3f5213 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:02.580549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fec5578-efb7-4725-84f9-99945f3f5213 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:02.581002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fec5578-efb7-4725-84f9-99945f3f5213 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.014863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0fec5578-efb7-4725-84f9-99945f3f5213 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678b46bea19846c2869efe2df01293d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331b4b2d7e544142b029b6237d99efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:03.025704 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0fec5578-efb7-4725-84f9-99945f3f5213 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 200 len: 1316 microversion: 2.1 time: 0.488373 Jul 20 04:13:03.029365 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 782/1533] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:02 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:03.043161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e3c3d763-d02c-4321-b790-3208bcccc83e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841d645e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:03.095366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:03.154854 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e3c3d763-d02c-4321-b790-3208bcccc83e tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.123352 Jul 20 04:13:03.160989 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 783/1534] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:03 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:03.171395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-68e2a48b-2669-4b36-8f93-5fbb8f3d3ad5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:03.179524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-68e2a48b-2669-4b36-8f93-5fbb8f3d3ad5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:03.232378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68e2a48b-2669-4b36-8f93-5fbb8f3d3ad5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.233071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68e2a48b-2669-4b36-8f93-5fbb8f3d3ad5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.234078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68e2a48b-2669-4b36-8f93-5fbb8f3d3ad5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.236258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68e2a48b-2669-4b36-8f93-5fbb8f3d3ad5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.524606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-68e2a48b-2669-4b36-8f93-5fbb8f3d3ad5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:03.540175 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-68e2a48b-2669-4b36-8f93-5fbb8f3d3ad5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1474 microversion: 2.1 time: 0.381016 Jul 20 04:13:03.546314 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 784/1535] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:03 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1474 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:03.559323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-906fb34e-0716-483c-9641-0eb915a85dcd req-a8698dcc-e291-425c-b08a-0e50595abf56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe65a9e-ad47-4844-a1d1-b673bca616c5", "name": "network-vif-plugged", "status": "completed", "tag": "e8758fe3-5fc7-4de5-b21a-4f8e7a450410"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:03.589398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-906fb34e-0716-483c-9641-0eb915a85dcd req-a8698dcc-e291-425c-b08a-0e50595abf56 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.589888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-906fb34e-0716-483c-9641-0eb915a85dcd req-a8698dcc-e291-425c-b08a-0e50595abf56 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.620111 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-906fb34e-0716-483c-9641-0eb915a85dcd req-a8698dcc-e291-425c-b08a-0e50595abf56 service nova] Creating event network-vif-plugged:e8758fe3-5fc7-4de5-b21a-4f8e7a450410 for instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 on n-h1-760456-11 Jul 20 04:13:03.640680 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-906fb34e-0716-483c-9641-0eb915a85dcd req-a8698dcc-e291-425c-b08a-0e50595abf56 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090486 Jul 20 04:13:03.642458 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 785/1536] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:03.651338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0713d4e-7d90-486c-a3c0-415e76b124dc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:03.652750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0713d4e-7d90-486c-a3c0-415e76b124dc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:03.661313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0713d4e-7d90-486c-a3c0-415e76b124dc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.662120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0713d4e-7d90-486c-a3c0-415e76b124dc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.663212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0713d4e-7d90-486c-a3c0-415e76b124dc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.663876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0713d4e-7d90-486c-a3c0-415e76b124dc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.727838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e0565158-9c0a-4809-ba23-0eec1c6e8520 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:03.737621 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0713d4e-7d90-486c-a3c0-415e76b124dc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093521 Jul 20 04:13:03.738270 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 786/1537] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:13:03 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:03.743330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e0565158-9c0a-4809-ba23-0eec1c6e8520 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:03.747688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e0565158-9c0a-4809-ba23-0eec1c6e8520 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:03.748978 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e0565158-9c0a-4809-ba23-0eec1c6e8520 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1567 microversion: 2.25 time: 1.230277 Jul 20 04:13:03.752881 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 752/1538] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:02 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1567 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:03.756007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8cdc854d-1766-41d5-a2b3-8e469abe580d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:03.761151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8cdc854d-1766-41d5-a2b3-8e469abe580d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:03.763417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-18ebe91e-fbff-4a27-be9e-e54c73c6a232 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:03.764054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-18ebe91e-fbff-4a27-be9e-e54c73c6a232 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:03.776830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cdc854d-1766-41d5-a2b3-8e469abe580d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.777297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cdc854d-1766-41d5-a2b3-8e469abe580d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.778097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cdc854d-1766-41d5-a2b3-8e469abe580d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.778369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18ebe91e-fbff-4a27-be9e-e54c73c6a232 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.778747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cdc854d-1766-41d5-a2b3-8e469abe580d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.778869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18ebe91e-fbff-4a27-be9e-e54c73c6a232 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:03.779594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18ebe91e-fbff-4a27-be9e-e54c73c6a232 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:03.780029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18ebe91e-fbff-4a27-be9e-e54c73c6a232 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.081846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8cdc854d-1766-41d5-a2b3-8e469abe580d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:04.091254 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8cdc854d-1766-41d5-a2b3-8e469abe580d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1316 microversion: 2.1 time: 0.342474 Jul 20 04:13:04.096602 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 787/1539] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:03 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:04.101930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-69321b9d-e06b-460a-acdb-e4312ceb29bc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:04.120492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-69321b9d-e06b-460a-acdb-e4312ceb29bc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:04.130580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69321b9d-e06b-460a-acdb-e4312ceb29bc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.131330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69321b9d-e06b-460a-acdb-e4312ceb29bc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.132358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69321b9d-e06b-460a-acdb-e4312ceb29bc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.132988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69321b9d-e06b-460a-acdb-e4312ceb29bc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.166297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-18ebe91e-fbff-4a27-be9e-e54c73c6a232 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:04.181754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-18ebe91e-fbff-4a27-be9e-e54c73c6a232 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:04.184357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-18ebe91e-fbff-4a27-be9e-e54c73c6a232 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:04.195316 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-18ebe91e-fbff-4a27-be9e-e54c73c6a232 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1708 microversion: 2.42 time: 0.441262 Jul 20 04:13:04.197975 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 753/1540] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:03 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1708 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:04.203736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43f47b41-7773-4c46-81a2-34e5aecb95e1 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:04.204669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43f47b41-7773-4c46-81a2-34e5aecb95e1 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:04.215189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43f47b41-7773-4c46-81a2-34e5aecb95e1 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.216202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43f47b41-7773-4c46-81a2-34e5aecb95e1 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.217260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43f47b41-7773-4c46-81a2-34e5aecb95e1 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.217956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43f47b41-7773-4c46-81a2-34e5aecb95e1 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.408791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-69321b9d-e06b-460a-acdb-e4312ceb29bc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lazy-loading 'services' on Instance uuid 0079fbd3-9f24-447a-8331-0823b53255ac {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:04.638606 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-69321b9d-e06b-460a-acdb-e4312ceb29bc tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-volume_attachments/6a0b976b-6ad3-48d9-b3c4-a1f85f3e1928" status: 202 len: 0 microversion: 2.1 time: 0.540266 Jul 20 04:13:04.639543 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 788/1541] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:13:04 2022] DELETE /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-volume_attachments/6a0b976b-6ad3-48d9-b3c4-a1f85f3e1928 => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:04.663865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8eea2a1e-4346-4d22-be8e-cb18f60fda74 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb842230160>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:04.740728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-43f47b41-7773-4c46-81a2-34e5aecb95e1 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678b46bea19846c2869efe2df01293d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331b4b2d7e544142b029b6237d99efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:04.752359 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43f47b41-7773-4c46-81a2-34e5aecb95e1 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 200 len: 1504 microversion: 2.1 time: 0.550975 Jul 20 04:13:04.754064 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 754/1542] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:04 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 1504 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:04.767783 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8eea2a1e-4346-4d22-be8e-cb18f60fda74 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.127015 Jul 20 04:13:04.770981 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 789/1543] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:04 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:04.776865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5b9891c-b856-44b8-b195-ff2ac11f4bc4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:04.780999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-cd291779-5072-4d08-a1d3-c7b9dea307a3 req-91caf541-cd59-4536-83ec-3c0508d2b5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9", "name": "network-vif-unplugged", "status": "completed", "tag": "b4437382-d813-4ba5-b42b-466403da1026"}, {"name": "network-changed", "server_uuid": "6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9", "tag": "b4437382-d813-4ba5-b42b-466403da1026"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:04.789841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5b9891c-b856-44b8-b195-ff2ac11f4bc4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:04.807059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5b9891c-b856-44b8-b195-ff2ac11f4bc4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.812609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cd291779-5072-4d08-a1d3-c7b9dea307a3 req-91caf541-cd59-4536-83ec-3c0508d2b5e4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.813781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5b9891c-b856-44b8-b195-ff2ac11f4bc4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.814883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cd291779-5072-4d08-a1d3-c7b9dea307a3 req-91caf541-cd59-4536-83ec-3c0508d2b5e4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.819679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5b9891c-b856-44b8-b195-ff2ac11f4bc4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.825406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5b9891c-b856-44b8-b195-ff2ac11f4bc4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.859079 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-cd291779-5072-4d08-a1d3-c7b9dea307a3 req-91caf541-cd59-4536-83ec-3c0508d2b5e4 service nova] Creating event network-vif-unplugged:b4437382-d813-4ba5-b42b-466403da1026 for instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 on n-h1-760456-11 Jul 20 04:13:04.868255 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-cd291779-5072-4d08-a1d3-c7b9dea307a3 req-91caf541-cd59-4536-83ec-3c0508d2b5e4 service nova] Creating event network-changed:b4437382-d813-4ba5-b42b-466403da1026 for instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 on n-h1-760456-11 Jul 20 04:13:04.878748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-cd291779-5072-4d08-a1d3-c7b9dea307a3 req-91caf541-cd59-4536-83ec-3c0508d2b5e4 service nova] Instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:13:04.921790 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-cd291779-5072-4d08-a1d3-c7b9dea307a3 req-91caf541-cd59-4536-83ec-3c0508d2b5e4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.164850 Jul 20 04:13:04.924641 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 755/1544] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:04.938104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b2bdcca9-b8cb-446e-b6e9-baee80623d96 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:04.944069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b2bdcca9-b8cb-446e-b6e9-baee80623d96 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:04.951549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:04.979141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2bdcca9-b8cb-446e-b6e9-baee80623d96 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.980003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2bdcca9-b8cb-446e-b6e9-baee80623d96 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:04.981087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2bdcca9-b8cb-446e-b6e9-baee80623d96 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:04.981765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2bdcca9-b8cb-446e-b6e9-baee80623d96 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.322520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b2bdcca9-b8cb-446e-b6e9-baee80623d96 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:05.335273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b2bdcca9-b8cb-446e-b6e9-baee80623d96 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:05.347252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b2bdcca9-b8cb-446e-b6e9-baee80623d96 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:05.353922 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b2bdcca9-b8cb-446e-b6e9-baee80623d96 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1567 microversion: 2.25 time: 0.423577 Jul 20 04:13:05.354559 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 756/1545] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:04 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1567 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:05.369792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-30db5317-eb54-45e2-975f-5374e675cede tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:05.382379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-30db5317-eb54-45e2-975f-5374e675cede tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:05.409929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30db5317-eb54-45e2-975f-5374e675cede tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:05.411842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30db5317-eb54-45e2-975f-5374e675cede tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.412825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30db5317-eb54-45e2-975f-5374e675cede tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:05.415751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30db5317-eb54-45e2-975f-5374e675cede tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.485947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-30db5317-eb54-45e2-975f-5374e675cede tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:05.675920 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-30db5317-eb54-45e2-975f-5374e675cede tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 204 len: 0 microversion: 2.1 time: 0.319799 Jul 20 04:13:05.678091 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 757/1546] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:05 2022] DELETE /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:05.685723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c07108e1-02a3-40dd-a1d0-f9b906a98f0f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:05.689081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c07108e1-02a3-40dd-a1d0-f9b906a98f0f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:05.696525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c07108e1-02a3-40dd-a1d0-f9b906a98f0f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:05.697622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c07108e1-02a3-40dd-a1d0-f9b906a98f0f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.699319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c07108e1-02a3-40dd-a1d0-f9b906a98f0f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:05.699951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c07108e1-02a3-40dd-a1d0-f9b906a98f0f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:05.873472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:05.906281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:06.061041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c07108e1-02a3-40dd-a1d0-f9b906a98f0f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.086185 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c07108e1-02a3-40dd-a1d0-f9b906a98f0f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1316 microversion: 2.1 time: 0.406265 Jul 20 04:13:06.097178 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 758/1547] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:05 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:06.102236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-190cc951-3ffc-4704-bd14-6fa76fab7bc2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:06.102881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-190cc951-3ffc-4704-bd14-6fa76fab7bc2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:06.124585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-190cc951-3ffc-4704-bd14-6fa76fab7bc2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.125766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-190cc951-3ffc-4704-bd14-6fa76fab7bc2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.129252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-190cc951-3ffc-4704-bd14-6fa76fab7bc2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.129709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-190cc951-3ffc-4704-bd14-6fa76fab7bc2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.308104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a5b9891c-b856-44b8-b195-ff2ac11f4bc4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.317861 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5b9891c-b856-44b8-b195-ff2ac11f4bc4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1474 microversion: 2.1 time: 1.544749 Jul 20 04:13:06.329549 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 790/1548] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:04 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1474 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:06.334696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc968023-d486-481f-8ad5-37611cf7095f tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:06.335541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc968023-d486-481f-8ad5-37611cf7095f tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:06.350706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-190cc951-3ffc-4704-bd14-6fa76fab7bc2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.357418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc968023-d486-481f-8ad5-37611cf7095f tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.357869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc968023-d486-481f-8ad5-37611cf7095f tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.360386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc968023-d486-481f-8ad5-37611cf7095f tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.360822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc968023-d486-481f-8ad5-37611cf7095f tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.367257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-190cc951-3ffc-4704-bd14-6fa76fab7bc2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.371949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-190cc951-3ffc-4704-bd14-6fa76fab7bc2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.373656 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-190cc951-3ffc-4704-bd14-6fa76fab7bc2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1708 microversion: 2.42 time: 0.275386 Jul 20 04:13:06.393299 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 759/1549] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1708 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:06.398713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29e90615-b576-428f-b8f1-083b6627d01d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f4e550>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:06.491437 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-29e90615-b576-428f-b8f1-083b6627d01d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.096709 Jul 20 04:13:06.492873 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 760/1550] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:06.498545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4bc9f0df-3944-45c2-abf9-7e60437cb5b1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:06.500644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4bc9f0df-3944-45c2-abf9-7e60437cb5b1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:06.509011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bc9f0df-3944-45c2-abf9-7e60437cb5b1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.509747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bc9f0df-3944-45c2-abf9-7e60437cb5b1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.510916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bc9f0df-3944-45c2-abf9-7e60437cb5b1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:06.511524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bc9f0df-3944-45c2-abf9-7e60437cb5b1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:06.531346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:06.712283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4bc9f0df-3944-45c2-abf9-7e60437cb5b1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.720102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:06.726192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4bc9f0df-3944-45c2-abf9-7e60437cb5b1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.735988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4bc9f0df-3944-45c2-abf9-7e60437cb5b1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:06.737618 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4bc9f0df-3944-45c2-abf9-7e60437cb5b1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1567 microversion: 2.25 time: 0.243095 Jul 20 04:13:06.740892 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 761/1551] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:07.105172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d1f159cf-bf4d-4fe9-af4b-bcbf0de70644 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.105864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d1f159cf-bf4d-4fe9-af4b-bcbf0de70644 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:07.134706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1f159cf-bf4d-4fe9-af4b-bcbf0de70644 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.135177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1f159cf-bf4d-4fe9-af4b-bcbf0de70644 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.145233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1f159cf-bf4d-4fe9-af4b-bcbf0de70644 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.145726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1f159cf-bf4d-4fe9-af4b-bcbf0de70644 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.294023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc968023-d486-481f-8ad5-37611cf7095f tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678b46bea19846c2869efe2df01293d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331b4b2d7e544142b029b6237d99efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:07.306728 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc968023-d486-481f-8ad5-37611cf7095f tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 200 len: 1510 microversion: 2.1 time: 0.975612 Jul 20 04:13:07.308012 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 791/1552] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:06 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 1510 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:07.322998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-53946b57-b990-422c-95a2-373858c570c7 req-030bd86e-015d-4f37-9432-bd0189ab6330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26b3126-e80d-4687-a609-36e6cca0b861", "name": "network-vif-plugged", "status": "completed", "tag": "d60885a1-1430-4843-baf6-315aebbd7b84"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:07.333692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-53946b57-b990-422c-95a2-373858c570c7 req-030bd86e-015d-4f37-9432-bd0189ab6330 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.336337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-53946b57-b990-422c-95a2-373858c570c7 req-030bd86e-015d-4f37-9432-bd0189ab6330 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.355673 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-53946b57-b990-422c-95a2-373858c570c7 req-030bd86e-015d-4f37-9432-bd0189ab6330 service nova] Creating event network-vif-plugged:d60885a1-1430-4843-baf6-315aebbd7b84 for instance b26b3126-e80d-4687-a609-36e6cca0b861 on n-h1-760456-11 Jul 20 04:13:07.365003 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-53946b57-b990-422c-95a2-373858c570c7 req-030bd86e-015d-4f37-9432-bd0189ab6330 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054109 Jul 20 04:13:07.366402 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 792/1553] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:07.372883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-00cb3497-6c46-4c90-b375-5c9b53a20ca8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.373957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-00cb3497-6c46-4c90-b375-5c9b53a20ca8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:07.382574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00cb3497-6c46-4c90-b375-5c9b53a20ca8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.383331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00cb3497-6c46-4c90-b375-5c9b53a20ca8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.384353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00cb3497-6c46-4c90-b375-5c9b53a20ca8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.385176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00cb3497-6c46-4c90-b375-5c9b53a20ca8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.617337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d1f159cf-bf4d-4fe9-af4b-bcbf0de70644 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:07.633086 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d1f159cf-bf4d-4fe9-af4b-bcbf0de70644 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1316 microversion: 2.1 time: 0.533100 Jul 20 04:13:07.646981 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 762/1554] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:07.654593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89fc8459-6cbc-4db1-9564-1ac0c3213ee8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:07.655222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-89fc8459-6cbc-4db1-9564-1ac0c3213ee8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:07.675277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89fc8459-6cbc-4db1-9564-1ac0c3213ee8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.678284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89fc8459-6cbc-4db1-9564-1ac0c3213ee8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:07.683642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89fc8459-6cbc-4db1-9564-1ac0c3213ee8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:07.684200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89fc8459-6cbc-4db1-9564-1ac0c3213ee8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.020186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89fc8459-6cbc-4db1-9564-1ac0c3213ee8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.037487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89fc8459-6cbc-4db1-9564-1ac0c3213ee8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.039122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89fc8459-6cbc-4db1-9564-1ac0c3213ee8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.040390 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89fc8459-6cbc-4db1-9564-1ac0c3213ee8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1755 microversion: 2.42 time: 0.392295 Jul 20 04:13:08.060046 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 763/1555] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1755 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:08.065785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ae341dc7-c228-488c-a35c-8a17321cc173 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841eb3ca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:08.177436 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ae341dc7-c228-488c-a35c-8a17321cc173 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.116117 Jul 20 04:13:08.182336 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 764/1556] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:08 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:08.194629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b88a6b92-3700-4bff-9229-94bfaa6a021c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:08.195325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b88a6b92-3700-4bff-9229-94bfaa6a021c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:08.212269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b88a6b92-3700-4bff-9229-94bfaa6a021c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.212786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b88a6b92-3700-4bff-9229-94bfaa6a021c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.215286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b88a6b92-3700-4bff-9229-94bfaa6a021c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.215742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b88a6b92-3700-4bff-9229-94bfaa6a021c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.495907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b88a6b92-3700-4bff-9229-94bfaa6a021c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.514217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b88a6b92-3700-4bff-9229-94bfaa6a021c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.517952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b88a6b92-3700-4bff-9229-94bfaa6a021c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.521994 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b88a6b92-3700-4bff-9229-94bfaa6a021c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1567 microversion: 2.25 time: 0.336856 Jul 20 04:13:08.536322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-00cb3497-6c46-4c90-b375-5c9b53a20ca8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.538887 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 765/1557] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:08 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1567 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:08.541662 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-00cb3497-6c46-4c90-b375-5c9b53a20ca8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1474 microversion: 2.1 time: 1.173828 Jul 20 04:13:08.542244 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 793/1558] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:07 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1474 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:08.549274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6d82c0e-0b0c-4481-8b6c-1de8f1a5782c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:08.550296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6d82c0e-0b0c-4481-8b6c-1de8f1a5782c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:08.570980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d82c0e-0b0c-4481-8b6c-1de8f1a5782c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.571622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d82c0e-0b0c-4481-8b6c-1de8f1a5782c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.572571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d82c0e-0b0c-4481-8b6c-1de8f1a5782c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.573127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d82c0e-0b0c-4481-8b6c-1de8f1a5782c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.650495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1566186b-f434-41d0-9783-50374c8d83a2 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:08.651586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1566186b-f434-41d0-9783-50374c8d83a2 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:08.663560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1566186b-f434-41d0-9783-50374c8d83a2 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.664504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1566186b-f434-41d0-9783-50374c8d83a2 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.670825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1566186b-f434-41d0-9783-50374c8d83a2 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.672037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1566186b-f434-41d0-9783-50374c8d83a2 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.745256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f6d82c0e-0b0c-4481-8b6c-1de8f1a5782c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678b46bea19846c2869efe2df01293d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331b4b2d7e544142b029b6237d99efae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:08.756528 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6d82c0e-0b0c-4481-8b6c-1de8f1a5782c tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 200 len: 1468 microversion: 2.1 time: 0.216277 Jul 20 04:13:08.770635 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 766/1559] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:08 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 1468 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:08.856633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f9df607d-a668-4d3c-958b-d723ed2c9b33 req-b39b4bf9-35b2-45ff-996a-f6b84aa4f98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca12048-6ea8-42d1-b6c3-94a6c28c4377", "name": "network-vif-deleted", "tag": "58ced8b4-3955-4e7d-9955-a190a39d8ba9"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:08.893063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f9df607d-a668-4d3c-958b-d723ed2c9b33 req-b39b4bf9-35b2-45ff-996a-f6b84aa4f98a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:08.893526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f9df607d-a668-4d3c-958b-d723ed2c9b33 req-b39b4bf9-35b2-45ff-996a-f6b84aa4f98a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:08.965186 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f9df607d-a668-4d3c-958b-d723ed2c9b33 req-b39b4bf9-35b2-45ff-996a-f6b84aa4f98a service nova] Creating event network-vif-deleted:58ced8b4-3955-4e7d-9955-a190a39d8ba9 for instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 on n-h2-760456-11 Jul 20 04:13:08.998158 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f9df607d-a668-4d3c-958b-d723ed2c9b33 req-b39b4bf9-35b2-45ff-996a-f6b84aa4f98a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142795 Jul 20 04:13:08.999405 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 767/1560] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:13:09.062561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0cb50fab-6821-4277-bd31-dc79cca60389 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.063809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0cb50fab-6821-4277-bd31-dc79cca60389 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:09.084877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cb50fab-6821-4277-bd31-dc79cca60389 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.085371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cb50fab-6821-4277-bd31-dc79cca60389 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.086895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cb50fab-6821-4277-bd31-dc79cca60389 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.090144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cb50fab-6821-4277-bd31-dc79cca60389 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.279045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1566186b-f434-41d0-9783-50374c8d83a2 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:09.290235 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1566186b-f434-41d0-9783-50374c8d83a2 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1316 microversion: 2.1 time: 0.643605 Jul 20 04:13:09.292100 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 794/1561] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:08 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:09.304204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a7bc7ee-a546-49b4-b51c-e9f548eee29f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841c4e430>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.388001 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a7bc7ee-a546-49b4-b51c-e9f548eee29f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.094587 Jul 20 04:13:09.396550 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 795/1562] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:09.467138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0cb50fab-6821-4277-bd31-dc79cca60389 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:09.480281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0cb50fab-6821-4277-bd31-dc79cca60389 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:09.482224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0cb50fab-6821-4277-bd31-dc79cca60389 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:09.483768 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0cb50fab-6821-4277-bd31-dc79cca60389 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1755 microversion: 2.42 time: 0.427145 Jul 20 04:13:09.485657 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 768/1563] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1755 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:13:09.543425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49fff7ff-14a5-4497-8b7c-d3845e707410 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.544668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-49fff7ff-14a5-4497-8b7c-d3845e707410 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:09.564064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34704134-ef7a-436a-bb89-764a2a383c41 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.565028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-34704134-ef7a-436a-bb89-764a2a383c41 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:09.571590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49fff7ff-14a5-4497-8b7c-d3845e707410 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.575875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49fff7ff-14a5-4497-8b7c-d3845e707410 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.576715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49fff7ff-14a5-4497-8b7c-d3845e707410 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.577158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49fff7ff-14a5-4497-8b7c-d3845e707410 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.580317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34704134-ef7a-436a-bb89-764a2a383c41 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.580774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34704134-ef7a-436a-bb89-764a2a383c41 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.582999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34704134-ef7a-436a-bb89-764a2a383c41 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.584263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34704134-ef7a-436a-bb89-764a2a383c41 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.624260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:09.866069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-34704134-ef7a-436a-bb89-764a2a383c41 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:09.882510 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-34704134-ef7a-436a-bb89-764a2a383c41 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1472 microversion: 2.1 time: 0.323126 Jul 20 04:13:09.883107 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 769/1564] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1472 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:09.896276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df575482-4219-4a91-9dfa-ce7dd2753f07 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:09.896820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-df575482-4219-4a91-9dfa-ce7dd2753f07 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:09.925766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df575482-4219-4a91-9dfa-ce7dd2753f07 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.926243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df575482-4219-4a91-9dfa-ce7dd2753f07 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.927081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df575482-4219-4a91-9dfa-ce7dd2753f07 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:09.927531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df575482-4219-4a91-9dfa-ce7dd2753f07 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:09.995857 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-df575482-4219-4a91-9dfa-ce7dd2753f07 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] HTTP exception thrown: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df575482-4219-4a91-9dfa-ce7dd2753f07 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Request method failure captured: Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 HTTP/1.1 Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14C-VFREeHGacjMCFu9yApCSYd6mbuPYXIV7Q9EQJ3nBKeujgejitg2qLbl0fe-B0s6YGE4ALTMZo97YeKS4qR5VJ72J8cDPtYwUUiX4aAhLz8u5JLb9awtkhMLUAPoz4lpbzrlnsY1ahwZSo7D_1f8q1Y2X9MvIX2A4bxvg2stHLOs Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_331b4b2d7e544142b029b6237d99efae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 678b46bea19846c2869efe2df01293d4 Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7ca12048-6ea8-42d1-b6c3-94a6c28c4377'} Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:09.997496 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.003612 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.003612 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.003612 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.003612 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:10.003612 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:10.003612 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.003612 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.003612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df575482-4219-4a91-9dfa-ce7dd2753f07 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Returning 404 to user: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:10.003612 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-df575482-4219-4a91-9dfa-ce7dd2753f07 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 404 len: 111 microversion: 2.1 time: 0.114924 Jul 20 04:13:10.016453 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 770/1565] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:10.022228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-208768b5-b7ed-42c4-aba5-2e46e60e601a tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-462932628", "metadata": {"image_type": "test"}}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:10.023400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-208768b5-b7ed-42c4-aba5-2e46e60e601a tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.030456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-208768b5-b7ed-42c4-aba5-2e46e60e601a tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.030900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-208768b5-b7ed-42c4-aba5-2e46e60e601a tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.033595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-208768b5-b7ed-42c4-aba5-2e46e60e601a tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.044841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-208768b5-b7ed-42c4-aba5-2e46e60e601a tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.083466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-49fff7ff-14a5-4497-8b7c-d3845e707410 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.096442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-49fff7ff-14a5-4497-8b7c-d3845e707410 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.097321 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-208768b5-b7ed-42c4-aba5-2e46e60e601a tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] HTTP exception thrown: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-208768b5-b7ed-42c4-aba5-2e46e60e601a tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Request method failure captured: Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377/action HTTP/1.1 Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 111 Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14C-VFREeHGacjMCFu9yApCSYd6mbuPYXIV7Q9EQJ3nBKeujgejitg2qLbl0fe-B0s6YGE4ALTMZo97YeKS4qR5VJ72J8cDPtYwUUiX4aAhLz8u5JLb9awtkhMLUAPoz4lpbzrlnsY1ahwZSo7D_1f8q1Y2X9MvIX2A4bxvg2stHLOs Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_331b4b2d7e544142b029b6237d99efae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 678b46bea19846c2869efe2df01293d4 Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-462932628", "metadata": {"image_type": "test"}}} Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7ca12048-6ea8-42d1-b6c3-94a6c28c4377', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-462932628', 'metadata': {'image_type': 'test'}}}} Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:13:10.099210 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.107881 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.110485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-49fff7ff-14a5-4497-8b7c-d3845e707410 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.110671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-208768b5-b7ed-42c4-aba5-2e46e60e601a tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Returning 404 to user: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:10.110671 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-208768b5-b7ed-42c4-aba5-2e46e60e601a tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "POST /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377/action" status: 404 len: 111 microversion: 2.1 time: 0.088264 Jul 20 04:13:10.114529 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 771/1566] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Jul 20 04:13:10 2022] POST /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377/action => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:10.126905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d8bb1e6f-695d-4110-b5a8-4794fc62340e tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-811499731", "metadata": {"image_type": "test"}}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:10.128039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d8bb1e6f-695d-4110-b5a8-4794fc62340e tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Failed to fetch instance by id tempest-invalid-251030462 {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:13:10.128552 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-d8bb1e6f-695d-4110-b5a8-4794fc62340e tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] HTTP exception thrown: Instance tempest-invalid-251030462 could not be found. Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d8bb1e6f-695d-4110-b5a8-4794fc62340e tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Request method failure captured: Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/tempest-invalid-251030462/action HTTP/1.1 Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 111 Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14C-VFREeHGacjMCFu9yApCSYd6mbuPYXIV7Q9EQJ3nBKeujgejitg2qLbl0fe-B0s6YGE4ALTMZo97YeKS4qR5VJ72J8cDPtYwUUiX4aAhLz8u5JLb9awtkhMLUAPoz4lpbzrlnsY1ahwZSo7D_1f8q1Y2X9MvIX2A4bxvg2stHLOs Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_331b4b2d7e544142b029b6237d99efae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 678b46bea19846c2869efe2df01293d4 Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-811499731", "metadata": {"image_type": "test"}}} Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance tempest-invalid-251030462 could not be found. Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'tempest-invalid-251030462', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-811499731', 'metadata': {'image_type': 'test'}}}} Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-251030462 could not be found. Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-251030462 could not be found. Jul 20 04:13:10.130099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.135847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.135847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.135847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.135847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.135847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.135847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:10.135847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:10.135847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-251030462 could not be found. Jul 20 04:13:10.135847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.136556 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-49fff7ff-14a5-4497-8b7c-d3845e707410 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1567 microversion: 2.25 time: 0.592130 Jul 20 04:13:10.136556 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 796/1567] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:09 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1567 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:10.136756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d8bb1e6f-695d-4110-b5a8-4794fc62340e tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Returning 404 to user: Instance tempest-invalid-251030462 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:10.136756 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d8bb1e6f-695d-4110-b5a8-4794fc62340e tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "POST /compute/v2.1/servers/tempest-invalid-251030462/action" status: 404 len: 100 microversion: 2.1 time: 0.011753 Jul 20 04:13:10.146615 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 772/1568] 10.222.0.59 () {60 vars in 1245 bytes} [Wed Jul 20 04:13:10 2022] POST /compute/v2.1/servers/tempest-invalid-251030462/action => generated 100 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:13:10.159667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7938f480-5917-43ec-94c2-22ce8f857b93 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-339556921"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:10.160785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7938f480-5917-43ec-94c2-22ce8f857b93 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:13:10.161353 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-7938f480-5917-43ec-94c2-22ce8f857b93 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7938f480-5917-43ec-94c2-22ce8f857b93 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Request method failure captured: Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 56 Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14C-VFREeHGacjMCFu9yApCSYd6mbuPYXIV7Q9EQJ3nBKeujgejitg2qLbl0fe-B0s6YGE4ALTMZo97YeKS4qR5VJ72J8cDPtYwUUiX4aAhLz8u5JLb9awtkhMLUAPoz4lpbzrlnsY1ahwZSo7D_1f8q1Y2X9MvIX2A4bxvg2stHLOs Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_331b4b2d7e544142b029b6237d99efae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 678b46bea19846c2869efe2df01293d4 Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: {"createImage": {"name": "tempest-test-snap-339556921"}} Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-339556921'}}} Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:13:10.163943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7938f480-5917-43ec-94c2-22ce8f857b93 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7938f480-5917-43ec-94c2-22ce8f857b93 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.010367 Jul 20 04:13:10.172212 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 797/1569] 10.222.0.59 () {60 vars in 1274 bytes} [Wed Jul 20 04:13:10 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:10.178412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9ae1dfd-8109-4633-ab76-dfcefe484439 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-713259492"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:10.179436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b9ae1dfd-8109-4633-ab76-dfcefe484439 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:13:10.181079 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-b9ae1dfd-8109-4633-ab76-dfcefe484439 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9ae1dfd-8109-4633-ab76-dfcefe484439 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Request method failure captured: Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 56 Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14C-VFREeHGacjMCFu9yApCSYd6mbuPYXIV7Q9EQJ3nBKeujgejitg2qLbl0fe-B0s6YGE4ALTMZo97YeKS4qR5VJ72J8cDPtYwUUiX4aAhLz8u5JLb9awtkhMLUAPoz4lpbzrlnsY1ahwZSo7D_1f8q1Y2X9MvIX2A4bxvg2stHLOs Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_331b4b2d7e544142b029b6237d99efae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 678b46bea19846c2869efe2df01293d4 Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: {"createImage": {"name": "tempest-test-snap-713259492"}} Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-713259492'}}} Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:13:10.182684 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9ae1dfd-8109-4633-ab76-dfcefe484439 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b9ae1dfd-8109-4633-ab76-dfcefe484439 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010406 Jul 20 04:13:10.188936 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 773/1570] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Jul 20 04:13:10 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:10.196437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26c78ba7-3379-4ebc-9240-02ee8b1888a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.196961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26c78ba7-3379-4ebc-9240-02ee8b1888a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.205951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26c78ba7-3379-4ebc-9240-02ee8b1888a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.206458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26c78ba7-3379-4ebc-9240-02ee8b1888a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.207277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26c78ba7-3379-4ebc-9240-02ee8b1888a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.207785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26c78ba7-3379-4ebc-9240-02ee8b1888a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.237979 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-26c78ba7-3379-4ebc-9240-02ee8b1888a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] HTTP exception thrown: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26c78ba7-3379-4ebc-9240-02ee8b1888a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Request method failure captured: Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 HTTP/1.1 Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14C-VFREeHGacjMCFu9yApCSYd6mbuPYXIV7Q9EQJ3nBKeujgejitg2qLbl0fe-B0s6YGE4ALTMZo97YeKS4qR5VJ72J8cDPtYwUUiX4aAhLz8u5JLb9awtkhMLUAPoz4lpbzrlnsY1ahwZSo7D_1f8q1Y2X9MvIX2A4bxvg2stHLOs Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_331b4b2d7e544142b029b6237d99efae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 678b46bea19846c2869efe2df01293d4 Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '7ca12048-6ea8-42d1-b6c3-94a6c28c4377'} Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:10.239624 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26c78ba7-3379-4ebc-9240-02ee8b1888a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Returning 404 to user: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:10.244752 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26c78ba7-3379-4ebc-9240-02ee8b1888a8 tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 404 len: 111 microversion: 2.1 time: 0.049331 Jul 20 04:13:10.245926 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 798/1571] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:10 2022] DELETE /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:10.251787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6287d3d-ad27-40fe-aee5-823b139eefba tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.254935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a6287d3d-ad27-40fe-aee5-823b139eefba tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] [instance: 7ca12048-6ea8-42d1-b6c3-94a6c28c4377] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.275430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6287d3d-ad27-40fe-aee5-823b139eefba tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.275944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6287d3d-ad27-40fe-aee5-823b139eefba tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.282915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6287d3d-ad27-40fe-aee5-823b139eefba tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.283311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6287d3d-ad27-40fe-aee5-823b139eefba tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.303887 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a6287d3d-ad27-40fe-aee5-823b139eefba tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] HTTP exception thrown: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6287d3d-ad27-40fe-aee5-823b139eefba tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Request method failure captured: Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 HTTP/1.1 Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14C-VFREeHGacjMCFu9yApCSYd6mbuPYXIV7Q9EQJ3nBKeujgejitg2qLbl0fe-B0s6YGE4ALTMZo97YeKS4qR5VJ72J8cDPtYwUUiX4aAhLz8u5JLb9awtkhMLUAPoz4lpbzrlnsY1ahwZSo7D_1f8q1Y2X9MvIX2A4bxvg2stHLOs Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/331b4b2d7e544142b029b6237d99efae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_331b4b2d7e544142b029b6237d99efae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 331b4b2d7e544142b029b6237d99efae Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-565284019 Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 678b46bea19846c2869efe2df01293d4 Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesNegativeTestJSON-565284019-project Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7ca12048-6ea8-42d1-b6c3-94a6c28c4377'} Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:10.305785 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.311454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:10.311454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:10.311454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:10.311454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:10.311454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:10.311454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. Jul 20 04:13:10.311454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:10.311923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-91e0f548-bb11-4995-acea-dca2a9f80863 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.311923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-91e0f548-bb11-4995-acea-dca2a9f80863 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.313829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6287d3d-ad27-40fe-aee5-823b139eefba tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] Returning 404 to user: Instance 7ca12048-6ea8-42d1-b6c3-94a6c28c4377 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:10.315288 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a6287d3d-ad27-40fe-aee5-823b139eefba tempest-ImagesNegativeTestJSON-565284019 tempest-ImagesNegativeTestJSON-565284019-project] 10.222.0.59 "GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377" status: 404 len: 111 microversion: 2.1 time: 0.067817 Jul 20 04:13:10.316833 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 774/1572] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/servers/7ca12048-6ea8-42d1-b6c3-94a6c28c4377 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:10.321257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91e0f548-bb11-4995-acea-dca2a9f80863 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.321730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91e0f548-bb11-4995-acea-dca2a9f80863 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.322577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91e0f548-bb11-4995-acea-dca2a9f80863 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.323138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91e0f548-bb11-4995-acea-dca2a9f80863 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.404424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f024978-4919-491a-b7d2-93927dc40011 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb8427e1af0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.470775 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f024978-4919-491a-b7d2-93927dc40011 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.070651 Jul 20 04:13:10.472549 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 775/1573] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:10.503900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-db461f88-a5ee-4b13-a8de-81a3390fbad2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.504521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-db461f88-a5ee-4b13-a8de-81a3390fbad2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.514571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db461f88-a5ee-4b13-a8de-81a3390fbad2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.515296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db461f88-a5ee-4b13-a8de-81a3390fbad2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.517129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db461f88-a5ee-4b13-a8de-81a3390fbad2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.517848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db461f88-a5ee-4b13-a8de-81a3390fbad2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.610729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-91e0f548-bb11-4995-acea-dca2a9f80863 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.624011 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-91e0f548-bb11-4995-acea-dca2a9f80863 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1316 microversion: 2.1 time: 0.320624 Jul 20 04:13:10.625788 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 799/1574] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:10.747276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-db461f88-a5ee-4b13-a8de-81a3390fbad2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.776057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-db461f88-a5ee-4b13-a8de-81a3390fbad2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.782933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-db461f88-a5ee-4b13-a8de-81a3390fbad2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:10.784473 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-db461f88-a5ee-4b13-a8de-81a3390fbad2 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1802 microversion: 2.42 time: 0.285034 Jul 20 04:13:10.785781 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 776/1575] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1802 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:13:10.927366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b7e8144e-402f-4a44-87b5-48db95ea4244 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:10.928978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b7e8144e-402f-4a44-87b5-48db95ea4244 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:10.954296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7e8144e-402f-4a44-87b5-48db95ea4244 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.955405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7e8144e-402f-4a44-87b5-48db95ea4244 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:10.956997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7e8144e-402f-4a44-87b5-48db95ea4244 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:10.959229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7e8144e-402f-4a44-87b5-48db95ea4244 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.149369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89db366a-da15-48ba-8f1f-0b622ce4eea3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.149996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-89db366a-da15-48ba-8f1f-0b622ce4eea3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.164506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89db366a-da15-48ba-8f1f-0b622ce4eea3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.165028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89db366a-da15-48ba-8f1f-0b622ce4eea3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.166088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89db366a-da15-48ba-8f1f-0b622ce4eea3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.166475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89db366a-da15-48ba-8f1f-0b622ce4eea3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.472982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89db366a-da15-48ba-8f1f-0b622ce4eea3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:11.483579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89db366a-da15-48ba-8f1f-0b622ce4eea3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:11.486945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89db366a-da15-48ba-8f1f-0b622ce4eea3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:11.488338 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89db366a-da15-48ba-8f1f-0b622ce4eea3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1557 microversion: 2.25 time: 0.343250 Jul 20 04:13:11.502224 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 777/1576] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1557 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:13:11.508312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0c55159b-ce04-4039-a42f-e8843ea1d08b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841e453a0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.560056 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0c55159b-ce04-4039-a42f-e8843ea1d08b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.054430 Jul 20 04:13:11.571493 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 778/1577] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:11.576997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f4844ef-9a28-4bd8-a09e-bee9fbf5a79a tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '.version_select at 0x7fb841e40f70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.579750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f4844ef-9a28-4bd8-a09e-bee9fbf5a79a tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.580388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f4844ef-9a28-4bd8-a09e-bee9fbf5a79a tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.596483 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f4844ef-9a28-4bd8-a09e-bee9fbf5a79a tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 3236 microversion: 2.25 time: 0.023417 Jul 20 04:13:11.605013 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 779/1578] 10.222.0.59 () {60 vars in 1183 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/os-migrations => generated 3236 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:11.610390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d2f91a77-4d40-4fec-93a0-235b4fa280b2 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.611265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d2f91a77-4d40-4fec-93a0-235b4fa280b2 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.618202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2f91a77-4d40-4fec-93a0-235b4fa280b2 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.618938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2f91a77-4d40-4fec-93a0-235b4fa280b2 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.619890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2f91a77-4d40-4fec-93a0-235b4fa280b2 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.620492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2f91a77-4d40-4fec-93a0-235b4fa280b2 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.776074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-d2f91a77-4d40-4fec-93a0-235b4fa280b2 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid 00cd136f-c79e-422a-b3ea-b8b6e73aa96d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:11.794093 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d2f91a77-4d40-4fec-93a0-235b4fa280b2 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 2052 microversion: 2.25 time: 0.187729 Jul 20 04:13:11.795335 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 780/1579] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 2052 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:11.802979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2c8879a9-dad3-4996-88e9-3c32fc5c8085 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:11.803854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2c8879a9-dad3-4996-88e9-3c32fc5c8085 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:11.810877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c8879a9-dad3-4996-88e9-3c32fc5c8085 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.811670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c8879a9-dad3-4996-88e9-3c32fc5c8085 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:11.812806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c8879a9-dad3-4996-88e9-3c32fc5c8085 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:11.813570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c8879a9-dad3-4996-88e9-3c32fc5c8085 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.075283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2c8879a9-dad3-4996-88e9-3c32fc5c8085 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.083436 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2c8879a9-dad3-4996-88e9-3c32fc5c8085 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1503 microversion: 2.1 time: 0.286808 Jul 20 04:13:12.094958 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 781/1580] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:11 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:12.101046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3752ab16-ef89-48fa-8c8c-62b55c48a6d6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:12.102126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3752ab16-ef89-48fa-8c8c-62b55c48a6d6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:12.110800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3752ab16-ef89-48fa-8c8c-62b55c48a6d6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.111519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3752ab16-ef89-48fa-8c8c-62b55c48a6d6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.112513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3752ab16-ef89-48fa-8c8c-62b55c48a6d6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.113127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3752ab16-ef89-48fa-8c8c-62b55c48a6d6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.344343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3752ab16-ef89-48fa-8c8c-62b55c48a6d6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.365654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3752ab16-ef89-48fa-8c8c-62b55c48a6d6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.367944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3752ab16-ef89-48fa-8c8c-62b55c48a6d6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.369280 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3752ab16-ef89-48fa-8c8c-62b55c48a6d6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1802 microversion: 2.42 time: 0.272993 Jul 20 04:13:12.370282 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 782/1581] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:12 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1802 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:12.375663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1527915336", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "d7df1a6a-edf6-4e43-8286-ec664673f3ed"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:12.451810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] validate_networks() for [('d7df1a6a-edf6-4e43-8286-ec664673f3ed', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:12.602818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b7e8144e-402f-4a44-87b5-48db95ea4244 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:12.612982 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b7e8144e-402f-4a44-87b5-48db95ea4244 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1472 microversion: 2.1 time: 1.692328 Jul 20 04:13:12.623316 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 800/1582] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:10 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1472 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:12.631132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8886fc6f-c2b0-481c-a547-79a9280b1412 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-964356102"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:12.631892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8886fc6f-c2b0-481c-a547-79a9280b1412 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:12.640240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8886fc6f-c2b0-481c-a547-79a9280b1412 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.641707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8886fc6f-c2b0-481c-a547-79a9280b1412 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:12.645143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8886fc6f-c2b0-481c-a547-79a9280b1412 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:12.645811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8886fc6f-c2b0-481c-a547-79a9280b1412 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.244447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:13.245474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:13.246568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:13.247715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:13.248301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:13.269514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.270351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.272064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.274176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.327433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Getting quotas for project d2323a93fbfb432f81cd11b542380af8. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:13.342024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Getting quotas for user df3e2faf94584fc99a59e3839e18f8b1 and project d2323a93fbfb432f81cd11b542380af8. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:13.377587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:13.386054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:13.517138 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-451abc28-904c-4992-bd1f-183c7c4fe489 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.145383 Jul 20 04:13:13.526925 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 783/1583] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:13:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:13:13.541922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7996d1b1-2dd8-4939-af00-e4df8c45b046 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f17940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:13.608635 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7996d1b1-2dd8-4939-af00-e4df8c45b046 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.080303 Jul 20 04:13:13.619295 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 784/1584] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:13 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:13.634134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cdf758db-d017-4449-95b9-55c68e41db91 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:13.635141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cdf758db-d017-4449-95b9-55c68e41db91 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:13.649522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf758db-d017-4449-95b9-55c68e41db91 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.653919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf758db-d017-4449-95b9-55c68e41db91 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:13.654566 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.network.security_group_api [None req-8886fc6f-c2b0-481c-a547-79a9280b1412 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Adding security group 9f86ad41-1449-4129-b473-984867d6a96f to port d60885a1-1430-4843-baf6-315aebbd7b84 Jul 20 04:13:13.655492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf758db-d017-4449-95b9-55c68e41db91 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:13.656961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf758db-d017-4449-95b9-55c68e41db91 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.035664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cdf758db-d017-4449-95b9-55c68e41db91 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.054897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cdf758db-d017-4449-95b9-55c68e41db91 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.071319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cdf758db-d017-4449-95b9-55c68e41db91 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.072814 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cdf758db-d017-4449-95b9-55c68e41db91 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1802 microversion: 2.42 time: 0.451687 Jul 20 04:13:14.073598 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 785/1585] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:13 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1802 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:14.079061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3ee2e2fc-92f3-4b62-bd35-b933b69507fb req-8dff37da-0476-4de6-95ae-b8e60837212d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9", "name": "network-vif-plugged", "status": "completed", "tag": "b4437382-d813-4ba5-b42b-466403da1026"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:14.114778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3ee2e2fc-92f3-4b62-bd35-b933b69507fb req-8dff37da-0476-4de6-95ae-b8e60837212d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.116229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3ee2e2fc-92f3-4b62-bd35-b933b69507fb req-8dff37da-0476-4de6-95ae-b8e60837212d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.138343 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3ee2e2fc-92f3-4b62-bd35-b933b69507fb req-8dff37da-0476-4de6-95ae-b8e60837212d service nova] Creating event network-vif-plugged:b4437382-d813-4ba5-b42b-466403da1026 for instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 on n-h1-760456-11 Jul 20 04:13:14.148474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-3ee2e2fc-92f3-4b62-bd35-b933b69507fb req-8dff37da-0476-4de6-95ae-b8e60837212d service nova] Instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:13:14.168245 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3ee2e2fc-92f3-4b62-bd35-b933b69507fb req-8dff37da-0476-4de6-95ae-b8e60837212d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092073 Jul 20 04:13:14.169151 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 786/1586] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:14.178705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a563e97-39f6-425f-a7b7-3bd74cfe86d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.180404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0a563e97-39f6-425f-a7b7-3bd74cfe86d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:14.287009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0a563e97-39f6-425f-a7b7-3bd74cfe86d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.296226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0a563e97-39f6-425f-a7b7-3bd74cfe86d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.307227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0a563e97-39f6-425f-a7b7-3bd74cfe86d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.308429 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a563e97-39f6-425f-a7b7-3bd74cfe86d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1262 microversion: 2.25 time: 0.137551 Jul 20 04:13:14.326849 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 787/1587] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1262 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:14.326849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f15c151-01bb-44db-a010-ce7c0418027a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.326849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6f15c151-01bb-44db-a010-ce7c0418027a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:14.362312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f15c151-01bb-44db-a010-ce7c0418027a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.362786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f15c151-01bb-44db-a010-ce7c0418027a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.363597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f15c151-01bb-44db-a010-ce7c0418027a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.364051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f15c151-01bb-44db-a010-ce7c0418027a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.688186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6f15c151-01bb-44db-a010-ce7c0418027a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:14.699097 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f15c151-01bb-44db-a010-ce7c0418027a tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1469 microversion: 2.1 time: 0.377647 Jul 20 04:13:14.701597 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 788/1588] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:14.727564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1295333d-ec40-44f5-8ca1-79eea802c4cc tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f17700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:14.818652 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1295333d-ec40-44f5-8ca1-79eea802c4cc tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.113940 Jul 20 04:13:14.824058 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 789/1589] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:14 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:14.829544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-226ecf58-2220-44ef-beda-dce43d5fc45c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:14.832617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-226ecf58-2220-44ef-beda-dce43d5fc45c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:14.846064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-226ecf58-2220-44ef-beda-dce43d5fc45c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.850021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-226ecf58-2220-44ef-beda-dce43d5fc45c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.851318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-226ecf58-2220-44ef-beda-dce43d5fc45c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:14.851940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-226ecf58-2220-44ef-beda-dce43d5fc45c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:14.855986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:15.052239 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-226ecf58-2220-44ef-beda-dce43d5fc45c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "POST /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9/action" status: 202 len: 0 microversion: 2.1 time: 0.226668 Jul 20 04:13:15.053519 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 790/1590] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:14 2022] POST /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:15.065470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56deffb3-86f1-4816-82ad-ccba8f292bcb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.066366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-56deffb3-86f1-4816-82ad-ccba8f292bcb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:15.082848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56deffb3-86f1-4816-82ad-ccba8f292bcb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.083329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56deffb3-86f1-4816-82ad-ccba8f292bcb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.084201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56deffb3-86f1-4816-82ad-ccba8f292bcb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.086614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56deffb3-86f1-4816-82ad-ccba8f292bcb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.260619 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8886fc6f-c2b0-481c-a547-79a9280b1412 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861/action" status: 202 len: 0 microversion: 2.1 time: 2.634477 Jul 20 04:13:15.266550 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 801/1591] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:12 2022] POST /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861/action => generated 0 bytes in 2642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:15.272830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c5a48ae9-cf17-483f-b861-5a53acf6550f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:15.273816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c5a48ae9-cf17-483f-b861-5a53acf6550f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:15.327375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5a48ae9-cf17-483f-b861-5a53acf6550f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.330508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5a48ae9-cf17-483f-b861-5a53acf6550f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.333266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5a48ae9-cf17-483f-b861-5a53acf6550f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:15.335336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5a48ae9-cf17-483f-b861-5a53acf6550f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:15.920797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-56deffb3-86f1-4816-82ad-ccba8f292bcb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:15.929365 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-56deffb3-86f1-4816-82ad-ccba8f292bcb tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1468 microversion: 2.1 time: 0.871734 Jul 20 04:13:15.930178 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 791/1592] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:15 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1468 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:13:15.938988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-751cf50e-24f4-4b38-8a71-7a518c5f48a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841f178b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.595349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5a48ae9-cf17-483f-b861-5a53acf6550f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:16.629552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5a48ae9-cf17-483f-b861-5a53acf6550f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:16.632915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5a48ae9-cf17-483f-b861-5a53acf6550f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:16.638633 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c5a48ae9-cf17-483f-b861-5a53acf6550f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1849 microversion: 2.42 time: 1.370688 Jul 20 04:13:16.651520 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 802/1593] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:15 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1849 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:16.659823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4f6aedb4-49c8-4bcb-8df9-71160a152fb2 req-0a221dce-6d13-4464-ae60-06683930aeb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26b3126-e80d-4687-a609-36e6cca0b861", "tag": "d60885a1-1430-4843-baf6-315aebbd7b84"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:16.668940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4f6aedb4-49c8-4bcb-8df9-71160a152fb2 req-0a221dce-6d13-4464-ae60-06683930aeb7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.670473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4f6aedb4-49c8-4bcb-8df9-71160a152fb2 req-0a221dce-6d13-4464-ae60-06683930aeb7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.692692 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4f6aedb4-49c8-4bcb-8df9-71160a152fb2 req-0a221dce-6d13-4464-ae60-06683930aeb7 service nova] Creating event network-changed:d60885a1-1430-4843-baf6-315aebbd7b84 for instance b26b3126-e80d-4687-a609-36e6cca0b861 on n-h1-760456-11 Jul 20 04:13:16.699864 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4f6aedb4-49c8-4bcb-8df9-71160a152fb2 req-0a221dce-6d13-4464-ae60-06683930aeb7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046633 Jul 20 04:13:16.701001 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 803/1594] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:16.708457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f9777750-8439-4020-8ed1-4158fb489e12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.709406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f9777750-8439-4020-8ed1-4158fb489e12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:16.718392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9777750-8439-4020-8ed1-4158fb489e12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.719441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9777750-8439-4020-8ed1-4158fb489e12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.720466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9777750-8439-4020-8ed1-4158fb489e12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.721086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9777750-8439-4020-8ed1-4158fb489e12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.780519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG neutronclient.v2_0.client [None req-751cf50e-24f4-4b38-8a71-7a518c5f48a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9f86ad41-1449-4129-b473-984867d6a96f in use.", "detail": ""}} {{(pid=119605) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:13:16.781516 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-751cf50e-24f4-4b38-8a71-7a518c5f48a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security Group 9f86ad41-1449-4129-b473-984867d6a96f in use. Jul 20 04:13:16.781516 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-c3517af7-e448-4598-9c4a-bd0b45200250'] Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-751cf50e-24f4-4b38-8a71-7a518c5f48a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-security-groups/9f86ad41-1449-4129-b473-984867d6a96f HTTP/1.1 Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: exception: Security Group 9f86ad41-1449-4129-b473-984867d6a96f in use. Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-c3517af7-e448-4598-9c4a-bd0b45200250'] Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '9f86ad41-1449-4129-b473-984867d6a96f'} Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:13:16.784427 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9f86ad41-1449-4129-b473-984867d6a96f in use. Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3517af7-e448-4598-9c4a-bd0b45200250'] Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9f86ad41-1449-4129-b473-984867d6a96f in use. Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3517af7-e448-4598-9c4a-bd0b45200250'] Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9f86ad41-1449-4129-b473-984867d6a96f in use. Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3517af7-e448-4598-9c4a-bd0b45200250'] Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9f86ad41-1449-4129-b473-984867d6a96f in use. Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3517af7-e448-4598-9c4a-bd0b45200250'] Jul 20 04:13:16.789445 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:16.793404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-751cf50e-24f4-4b38-8a71-7a518c5f48a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 400 to user: Security Group 9f86ad41-1449-4129-b473-984867d6a96f in use. Jul 20 04:13:16.793404 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-c3517af7-e448-4598-9c4a-bd0b45200250'] {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:16.794498 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-751cf50e-24f4-4b38-8a71-7a518c5f48a1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/9f86ad41-1449-4129-b473-984867d6a96f" status: 400 len: 185 microversion: 2.1 time: 0.863497 Jul 20 04:13:16.795382 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 792/1595] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:15 2022] DELETE /compute/v2.1/os-security-groups/9f86ad41-1449-4129-b473-984867d6a96f => generated 185 bytes in 865 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:13:16.804531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16d1e309-2994-4e95-b090-cc7c6aad8a8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841e47b80>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.923269 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16d1e309-2994-4e95-b090-cc7c6aad8a8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.126913 Jul 20 04:13:16.930267 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 793/1596] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:16.931730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f9777750-8439-4020-8ed1-4158fb489e12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:16.936687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-540269bd-4716-4723-a1a3-73daeba20ea8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.938545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-540269bd-4716-4723-a1a3-73daeba20ea8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:16.948648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-540269bd-4716-4723-a1a3-73daeba20ea8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.948989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f9777750-8439-4020-8ed1-4158fb489e12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:16.949953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-540269bd-4716-4723-a1a3-73daeba20ea8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.950975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-540269bd-4716-4723-a1a3-73daeba20ea8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.951110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f9777750-8439-4020-8ed1-4158fb489e12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:16.951731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-540269bd-4716-4723-a1a3-73daeba20ea8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.959593 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f9777750-8439-4020-8ed1-4158fb489e12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1320 microversion: 2.25 time: 0.251894 Jul 20 04:13:16.961324 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 804/1597] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:16.966490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6db01ee1-6f6a-446e-a834-617f9556847f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:16.967324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6db01ee1-6f6a-446e-a834-617f9556847f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:16.976746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6db01ee1-6f6a-446e-a834-617f9556847f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.977548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6db01ee1-6f6a-446e-a834-617f9556847f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:16.978593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6db01ee1-6f6a-446e-a834-617f9556847f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:16.979207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6db01ee1-6f6a-446e-a834-617f9556847f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.022319 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-540269bd-4716-4723-a1a3-73daeba20ea8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090632 Jul 20 04:13:17.025678 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 794/1598] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:17.048442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-15a91d99-da79-4b1a-a6eb-797a5daee106 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:17.053532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-15a91d99-da79-4b1a-a6eb-797a5daee106 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:17.064198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15a91d99-da79-4b1a-a6eb-797a5daee106 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.064878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15a91d99-da79-4b1a-a6eb-797a5daee106 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.068929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15a91d99-da79-4b1a-a6eb-797a5daee106 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.069639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15a91d99-da79-4b1a-a6eb-797a5daee106 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.298230 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-15a91d99-da79-4b1a-a6eb-797a5daee106 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861/action" status: 202 len: 0 microversion: 2.1 time: 0.261284 Jul 20 04:13:17.300707 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 795/1599] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:17 2022] POST /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:17.312623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38f35578-7e9f-442f-b5e1-74dafd54af7c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.317095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-38f35578-7e9f-442f-b5e1-74dafd54af7c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:17.332260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f35578-7e9f-442f-b5e1-74dafd54af7c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.334901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f35578-7e9f-442f-b5e1-74dafd54af7c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.335982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f35578-7e9f-442f-b5e1-74dafd54af7c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.336757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f35578-7e9f-442f-b5e1-74dafd54af7c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.902231 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6db01ee1-6f6a-446e-a834-617f9556847f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1860 microversion: 2.1 time: 0.939602 Jul 20 04:13:17.922604 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 805/1600] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:16 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1860 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:17.930910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5295f252-372d-47c2-9bf7-9292892175d8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:17.935365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5295f252-372d-47c2-9bf7-9292892175d8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:17.949994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5295f252-372d-47c2-9bf7-9292892175d8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.955269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5295f252-372d-47c2-9bf7-9292892175d8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:17.956531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5295f252-372d-47c2-9bf7-9292892175d8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:17.957437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5295f252-372d-47c2-9bf7-9292892175d8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.017924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-38f35578-7e9f-442f-b5e1-74dafd54af7c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:18.024635 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5295f252-372d-47c2-9bf7-9292892175d8 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099956 Jul 20 04:13:18.026569 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-38f35578-7e9f-442f-b5e1-74dafd54af7c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1468 microversion: 2.1 time: 0.723427 Jul 20 04:13:18.027229 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 796/1601] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:17 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1468 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:18.033563 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 806/1602] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:13:17 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:13:18.038882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4bfd0a3a-462b-4373-9b2c-60ed9e280228 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:18.041777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4bfd0a3a-462b-4373-9b2c-60ed9e280228 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:18.044440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c30d09e-f813-462c-87ce-c5c1370e1f7d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:18.047425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2c30d09e-f813-462c-87ce-c5c1370e1f7d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:18.058677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bfd0a3a-462b-4373-9b2c-60ed9e280228 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.059139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bfd0a3a-462b-4373-9b2c-60ed9e280228 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.060377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bfd0a3a-462b-4373-9b2c-60ed9e280228 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.060816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c30d09e-f813-462c-87ce-c5c1370e1f7d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.061582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c30d09e-f813-462c-87ce-c5c1370e1f7d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.062009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bfd0a3a-462b-4373-9b2c-60ed9e280228 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.069611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c30d09e-f813-462c-87ce-c5c1370e1f7d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.070659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c30d09e-f813-462c-87ce-c5c1370e1f7d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.578778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4bfd0a3a-462b-4373-9b2c-60ed9e280228 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:18.587666 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4bfd0a3a-462b-4373-9b2c-60ed9e280228 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1573 microversion: 2.1 time: 0.559416 Jul 20 04:13:18.588312 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 797/1603] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:18 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1573 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:18.611105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fab0fabe-72ea-4ad9-98cf-9803c3a24ee5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-760456-11", "block_migration": true, "disk_over_commit": false}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:18.612277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fab0fabe-72ea-4ad9-98cf-9803c3a24ee5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:18.652456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fab0fabe-72ea-4ad9-98cf-9803c3a24ee5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.652924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fab0fabe-72ea-4ad9-98cf-9803c3a24ee5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.653736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fab0fabe-72ea-4ad9-98cf-9803c3a24ee5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.654232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fab0fabe-72ea-4ad9-98cf-9803c3a24ee5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.721999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c30d09e-f813-462c-87ce-c5c1370e1f7d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:18.743226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c30d09e-f813-462c-87ce-c5c1370e1f7d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:18.750728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c30d09e-f813-462c-87ce-c5c1370e1f7d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:18.756996 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c30d09e-f813-462c-87ce-c5c1370e1f7d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1849 microversion: 2.42 time: 0.721994 Jul 20 04:13:18.760917 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 807/1604] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:18 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1849 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:18.773895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-fab0fabe-72ea-4ad9-98cf-9803c3a24ee5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lazy-loading 'flavor' on Instance uuid b0a7ceeb-daba-4132-93a5-95c891a45687 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:18.774657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6c59bc6-3f40-4cc7-b99c-1eff41b7d085 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841bdd4c0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:18.808727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fab0fabe-72ea-4ad9-98cf-9803c3a24ee5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Going to try to live migrate instance to n-h2-760456-11 {{(pid=119605) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:13:18.867468 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d6c59bc6-3f40-4cc7-b99c-1eff41b7d085 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.104990 Jul 20 04:13:18.868324 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 808/1605] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:18 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:18.882367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6cdb40ee-dacb-49e2-992b-8a50ee8cf930 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:18.886063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6cdb40ee-dacb-49e2-992b-8a50ee8cf930 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:18.902191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:18.907922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cdb40ee-dacb-49e2-992b-8a50ee8cf930 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.909078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cdb40ee-dacb-49e2-992b-8a50ee8cf930 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:18.912137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cdb40ee-dacb-49e2-992b-8a50ee8cf930 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:18.912441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cdb40ee-dacb-49e2-992b-8a50ee8cf930 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.876382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6cdb40ee-dacb-49e2-992b-8a50ee8cf930 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:19.892182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6cdb40ee-dacb-49e2-992b-8a50ee8cf930 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:19.896058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6cdb40ee-dacb-49e2-992b-8a50ee8cf930 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:19.900174 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6cdb40ee-dacb-49e2-992b-8a50ee8cf930 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1362 microversion: 2.25 time: 1.029239 Jul 20 04:13:19.915255 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 809/1606] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:18 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1362 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:19.927170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db7cf42a-7832-4674-a3d3-00b012aed29d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:19.930823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-db7cf42a-7832-4674-a3d3-00b012aed29d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:19.949444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db7cf42a-7832-4674-a3d3-00b012aed29d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.963205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db7cf42a-7832-4674-a3d3-00b012aed29d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:19.968894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db7cf42a-7832-4674-a3d3-00b012aed29d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:19.969701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db7cf42a-7832-4674-a3d3-00b012aed29d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.020368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-db7cf42a-7832-4674-a3d3-00b012aed29d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:20.196538 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-db7cf42a-7832-4674-a3d3-00b012aed29d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 204 len: 0 microversion: 2.1 time: 0.278992 Jul 20 04:13:20.201009 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 810/1607] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:19 2022] DELETE /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:20.209456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8cb8adeb-1bd3-438c-b6e8-a918da7bcbe4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.210632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8cb8adeb-1bd3-438c-b6e8-a918da7bcbe4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.218696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cb8adeb-1bd3-438c-b6e8-a918da7bcbe4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.219965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cb8adeb-1bd3-438c-b6e8-a918da7bcbe4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.221032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cb8adeb-1bd3-438c-b6e8-a918da7bcbe4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.223206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cb8adeb-1bd3-438c-b6e8-a918da7bcbe4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.500856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8cb8adeb-1bd3-438c-b6e8-a918da7bcbe4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:20.514592 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8cb8adeb-1bd3-438c-b6e8-a918da7bcbe4 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1468 microversion: 2.1 time: 0.311882 Jul 20 04:13:20.524838 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 811/1608] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1468 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:20.529696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1cc15f93-24dc-4747-a836-ebc7272c5df2 req-65872278-dbf7-497b-bc5a-022ae2c7ddcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "tag": "c6f02ab9-a2a7-47dd-896e-14309db365f1"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:20.559171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1cc15f93-24dc-4747-a836-ebc7272c5df2 req-65872278-dbf7-497b-bc5a-022ae2c7ddcc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.559650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1cc15f93-24dc-4747-a836-ebc7272c5df2 req-65872278-dbf7-497b-bc5a-022ae2c7ddcc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.573570 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1cc15f93-24dc-4747-a836-ebc7272c5df2 req-65872278-dbf7-497b-bc5a-022ae2c7ddcc service nova] Creating event network-changed:c6f02ab9-a2a7-47dd-896e-14309db365f1 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:13:20.589810 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1cc15f93-24dc-4747-a836-ebc7272c5df2 req-65872278-dbf7-497b-bc5a-022ae2c7ddcc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063614 Jul 20 04:13:20.596164 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 812/1609] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:20.601755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f9cf9a29-429e-4ff0-a045-f8f9bf7e840c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:20.617997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f9cf9a29-429e-4ff0-a045-f8f9bf7e840c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:20.646621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9cf9a29-429e-4ff0-a045-f8f9bf7e840c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.647189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9cf9a29-429e-4ff0-a045-f8f9bf7e840c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:20.648049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9cf9a29-429e-4ff0-a045-f8f9bf7e840c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:20.648494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9cf9a29-429e-4ff0-a045-f8f9bf7e840c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.160273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f9cf9a29-429e-4ff0-a045-f8f9bf7e840c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:21.169105 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f9cf9a29-429e-4ff0-a045-f8f9bf7e840c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1573 microversion: 2.1 time: 0.571559 Jul 20 04:13:21.169713 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 813/1610] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:20 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1573 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:21.185447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-60013d0b-6679-486c-a96e-48c36183c7da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.189931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-60013d0b-6679-486c-a96e-48c36183c7da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:21.209533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60013d0b-6679-486c-a96e-48c36183c7da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.230991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60013d0b-6679-486c-a96e-48c36183c7da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.232139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60013d0b-6679-486c-a96e-48c36183c7da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.232856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60013d0b-6679-486c-a96e-48c36183c7da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.688418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-60013d0b-6679-486c-a96e-48c36183c7da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:21.699184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-60013d0b-6679-486c-a96e-48c36183c7da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:21.712515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-60013d0b-6679-486c-a96e-48c36183c7da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:21.714180 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-60013d0b-6679-486c-a96e-48c36183c7da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1870 microversion: 2.42 time: 0.535416 Jul 20 04:13:21.715366 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 814/1611] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1870 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:21.721396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-181421b6-2a3a-4d08-a947-bc6b9abe1da9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841bfcdc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.778805 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-181421b6-2a3a-4d08-a947-bc6b9abe1da9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.062090 Jul 20 04:13:21.779794 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 815/1612] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:21.786528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5018790e-01b4-4c4e-9c46-9aea98aa2bfe tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:21.787448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5018790e-01b4-4c4e-9c46-9aea98aa2bfe tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:21.796292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5018790e-01b4-4c4e-9c46-9aea98aa2bfe tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.798300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5018790e-01b4-4c4e-9c46-9aea98aa2bfe tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.799478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5018790e-01b4-4c4e-9c46-9aea98aa2bfe tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:21.800358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5018790e-01b4-4c4e-9c46-9aea98aa2bfe tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:21.859160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:22.048674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5018790e-01b4-4c4e-9c46-9aea98aa2bfe tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:22.062782 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5018790e-01b4-4c4e-9c46-9aea98aa2bfe tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1682 microversion: 2.1 time: 0.279629 Jul 20 04:13:22.063711 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 816/1613] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:21 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1682 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:22.068477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28806e67-ea94-4cdb-9f98-3d5cb3bd656f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.079580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-28806e67-ea94-4cdb-9f98-3d5cb3bd656f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:22.089463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28806e67-ea94-4cdb-9f98-3d5cb3bd656f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.091589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28806e67-ea94-4cdb-9f98-3d5cb3bd656f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.094667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28806e67-ea94-4cdb-9f98-3d5cb3bd656f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.097333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28806e67-ea94-4cdb-9f98-3d5cb3bd656f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.431864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-28806e67-ea94-4cdb-9f98-3d5cb3bd656f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:22.445107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-28806e67-ea94-4cdb-9f98-3d5cb3bd656f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:22.450081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-28806e67-ea94-4cdb-9f98-3d5cb3bd656f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:22.454776 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-28806e67-ea94-4cdb-9f98-3d5cb3bd656f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1362 microversion: 2.25 time: 0.390101 Jul 20 04:13:22.455651 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 817/1614] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:22.473251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5f624d65-7a8e-46fb-80d8-38d478512d68 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.474225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5f624d65-7a8e-46fb-80d8-38d478512d68 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:22.481124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f624d65-7a8e-46fb-80d8-38d478512d68 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.481931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f624d65-7a8e-46fb-80d8-38d478512d68 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.483560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f624d65-7a8e-46fb-80d8-38d478512d68 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.484349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f624d65-7a8e-46fb-80d8-38d478512d68 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.749674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5f624d65-7a8e-46fb-80d8-38d478512d68 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:22.758002 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5f624d65-7a8e-46fb-80d8-38d478512d68 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1468 microversion: 2.1 time: 0.289788 Jul 20 04:13:22.770665 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 818/1615] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1468 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:22.801457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-78b3a30e-1e58-4814-a5eb-70fb6761b200 req-df450f94-d6f0-496f-b4ed-83ca69788642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfd0a05-0361-4623-b862-7e525c0eeb91", "tag": "24377567-d41e-41ac-b4a3-0d0f3a117215"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:22.817130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-78b3a30e-1e58-4814-a5eb-70fb6761b200 req-df450f94-d6f0-496f-b4ed-83ca69788642 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.819829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-78b3a30e-1e58-4814-a5eb-70fb6761b200 req-df450f94-d6f0-496f-b4ed-83ca69788642 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.837779 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-78b3a30e-1e58-4814-a5eb-70fb6761b200 req-df450f94-d6f0-496f-b4ed-83ca69788642 service nova] Creating event network-changed:24377567-d41e-41ac-b4a3-0d0f3a117215 for instance dbfd0a05-0361-4623-b862-7e525c0eeb91 on n-h2-760456-11 Jul 20 04:13:22.887887 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-78b3a30e-1e58-4814-a5eb-70fb6761b200 req-df450f94-d6f0-496f-b4ed-83ca69788642 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118730 Jul 20 04:13:22.888759 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 819/1616] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:22.908408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-184a0372-017c-4173-984d-481e6ff09391 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:22.912274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-184a0372-017c-4173-984d-481e6ff09391 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:22.934189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-184a0372-017c-4173-984d-481e6ff09391 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.935822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-184a0372-017c-4173-984d-481e6ff09391 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:22.937449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-184a0372-017c-4173-984d-481e6ff09391 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:22.942114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-184a0372-017c-4173-984d-481e6ff09391 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:23.301796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:24.232154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-184a0372-017c-4173-984d-481e6ff09391 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:24.258772 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-184a0372-017c-4173-984d-481e6ff09391 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1573 microversion: 2.1 time: 1.367365 Jul 20 04:13:24.271012 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 820/1617] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:22 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1573 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:24.287177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e3402eb2-c1b3-4872-8427-dd4f917546f3 req-c38e7ec5-a718-433f-bffa-45807c364139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "tag": "d7d5ae22-6a79-44a5-8895-e9cb3dfd5596"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:24.295345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:24.318223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e3402eb2-c1b3-4872-8427-dd4f917546f3 req-c38e7ec5-a718-433f-bffa-45807c364139 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.319226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e3402eb2-c1b3-4872-8427-dd4f917546f3 req-c38e7ec5-a718-433f-bffa-45807c364139 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:24.344356 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e3402eb2-c1b3-4872-8427-dd4f917546f3 req-c38e7ec5-a718-433f-bffa-45807c364139 service nova] Creating event network-changed:d7d5ae22-6a79-44a5-8895-e9cb3dfd5596 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:13:24.353400 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e3402eb2-c1b3-4872-8427-dd4f917546f3 req-c38e7ec5-a718-433f-bffa-45807c364139 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077923 Jul 20 04:13:24.354765 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 821/1618] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:24.361844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac5da3ab-59be-42b3-a0b3-0bf83327c6f5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:24.367645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac5da3ab-59be-42b3-a0b3-0bf83327c6f5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:24.386359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac5da3ab-59be-42b3-a0b3-0bf83327c6f5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.387369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac5da3ab-59be-42b3-a0b3-0bf83327c6f5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:24.388417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac5da3ab-59be-42b3-a0b3-0bf83327c6f5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:24.389103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac5da3ab-59be-42b3-a0b3-0bf83327c6f5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.706769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ac5da3ab-59be-42b3-a0b3-0bf83327c6f5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:25.717609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ac5da3ab-59be-42b3-a0b3-0bf83327c6f5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:25.724213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ac5da3ab-59be-42b3-a0b3-0bf83327c6f5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:25.727497 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac5da3ab-59be-42b3-a0b3-0bf83327c6f5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1870 microversion: 2.42 time: 1.370698 Jul 20 04:13:25.741295 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 822/1619] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:24 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1870 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:25.755534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17976e02-2c4f-4934-b99f-bd55a6867580 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841bec5e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:25.885590 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-17976e02-2c4f-4934-b99f-bd55a6867580 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1439 microversion: 2.1 time: 0.142065 Jul 20 04:13:25.892509 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 823/1620] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:25 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1439 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:25.902824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-868daa7e-a223-4ee6-a9bf-1c95e4bbb0a2 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:25.907446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-868daa7e-a223-4ee6-a9bf-1c95e4bbb0a2 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:25.923094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-868daa7e-a223-4ee6-a9bf-1c95e4bbb0a2 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:25.928278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-868daa7e-a223-4ee6-a9bf-1c95e4bbb0a2 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:25.929467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-868daa7e-a223-4ee6-a9bf-1c95e4bbb0a2 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:25.930569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-868daa7e-a223-4ee6-a9bf-1c95e4bbb0a2 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.191408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-868daa7e-a223-4ee6-a9bf-1c95e4bbb0a2 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff983224243430c83b9054014715548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad9f7ab7fcb4d76a2a6cccc260b7704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:26.199669 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-868daa7e-a223-4ee6-a9bf-1c95e4bbb0a2 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 200 len: 1614 microversion: 2.1 time: 0.305921 Jul 20 04:13:26.206267 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 824/1621] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:25 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 1614 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:26.211639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6bcc358d-25ab-4827-af06-8d41976e443b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:26.223869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6bcc358d-25ab-4827-af06-8d41976e443b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:26.231463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bcc358d-25ab-4827-af06-8d41976e443b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.233071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bcc358d-25ab-4827-af06-8d41976e443b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.236545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bcc358d-25ab-4827-af06-8d41976e443b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.237247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bcc358d-25ab-4827-af06-8d41976e443b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.538377 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fab0fabe-72ea-4ad9-98cf-9803c3a24ee5 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/action" status: 202 len: 0 microversion: 2.1 time: 7.948850 Jul 20 04:13:26.540628 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 798/1622] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:18 2022] POST /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/action => generated 0 bytes in 7951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:26.547968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6fa675cd-ff13-4f71-9b54-df5d8643e6a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:26.556926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6fa675cd-ff13-4f71-9b54-df5d8643e6a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:26.595410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fa675cd-ff13-4f71-9b54-df5d8643e6a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.598586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fa675cd-ff13-4f71-9b54-df5d8643e6a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:26.606537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fa675cd-ff13-4f71-9b54-df5d8643e6a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:26.607616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fa675cd-ff13-4f71-9b54-df5d8643e6a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.149480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6fa675cd-ff13-4f71-9b54-df5d8643e6a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:27.158689 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6fa675cd-ff13-4f71-9b54-df5d8643e6a6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1468 microversion: 2.1 time: 0.616870 Jul 20 04:13:27.165124 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 799/1623] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:26 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1468 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:27.516825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-831df5e2-980e-4bb9-a1f8-a0c47ab926e7 tempest-ListImageFiltersNegativeTestJSON-1422544174 tempest-ListImageFiltersNegativeTestJSON-1422544174-project] Calling method '.version_select at 0x7fb841e65280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:27.552926 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-831df5e2-980e-4bb9-a1f8-a0c47ab926e7 tempest-ListImageFiltersNegativeTestJSON-1422544174 tempest-ListImageFiltersNegativeTestJSON-1422544174-project] HTTP exception thrown: Image not found. Jul 20 04:13:27.663697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6bcc358d-25ab-4827-af06-8d41976e443b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:27.676980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6bcc358d-25ab-4827-af06-8d41976e443b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:27.682550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6bcc358d-25ab-4827-af06-8d41976e443b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-831df5e2-980e-4bb9-a1f8-a0c47ab926e7 tempest-ListImageFiltersNegativeTestJSON-1422544174 tempest-ListImageFiltersNegativeTestJSON-1422544174-project] Request method failure captured: Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/images/1ad378b2-588d-415e-825c-51062d63739c HTTP/1.1 Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14DjkSdcl9U0W720178T8wNQ85UaZbNFbfElbBe4xiUvIGRLg7Tb3oC0SshU52dNxzogydY891mfu0lJMd7H2IkG560nhhR5FRSnhCzoV0zwUa4CRaBrVr6Q4ByPv_7UzYV0FMrwuq1xyDa6Q5u03J8sDlwq7uAMj-24u3wBJ4j7wXs Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 0d55e9ccfe0b4559ba5a4e595436669a Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1422544174 Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0d55e9ccfe0b4559ba5a4e595436669a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d55e9ccfe0b4559ba5a4e595436669a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0d55e9ccfe0b4559ba5a4e595436669a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0d55e9ccfe0b4559ba5a4e595436669a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1422544174 Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 0d55e9ccfe0b4559ba5a4e595436669a Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1422544174 Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ListImageFiltersNegativeTestJSON-1422544174-project Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2372026e6da14006b0c8026f50de07ec Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1422544174-project Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1ad378b2-588d-415e-825c-51062d63739c'} Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1ad378b2-588d-415e-825c-51062d63739c Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:13:27.684639 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1ad378b2-588d-415e-825c-51062d63739c could not be found. Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:27.690694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-831df5e2-980e-4bb9-a1f8-a0c47ab926e7 tempest-ListImageFiltersNegativeTestJSON-1422544174 tempest-ListImageFiltersNegativeTestJSON-1422544174-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:27.694323 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-831df5e2-980e-4bb9-a1f8-a0c47ab926e7 tempest-ListImageFiltersNegativeTestJSON-1422544174 tempest-ListImageFiltersNegativeTestJSON-1422544174-project] 10.222.0.59 "GET /compute/v2.1/images/1ad378b2-588d-415e-825c-51062d63739c" status: 404 len: 62 microversion: 2.1 time: 0.518825 Jul 20 04:13:27.695116 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 800/1624] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:27 2022] GET /compute/v2.1/images/1ad378b2-588d-415e-825c-51062d63739c => generated 62 bytes in 529 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:13:27.701349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-83d691b3-75a5-4524-b3ed-816259eaba6e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:27.704310 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6bcc358d-25ab-4827-af06-8d41976e443b tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1362 microversion: 2.25 time: 1.496613 Jul 20 04:13:27.707368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-83d691b3-75a5-4524-b3ed-816259eaba6e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:27.709767 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 825/1625] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:26 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1362 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:27.729628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-963224d9-6872-4851-98d0-626f741bf7e5 req-e30e8068-e5f0-4fed-8c11-d9f7d6fb14c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0079fbd3-9f24-447a-8331-0823b53255ac", "name": "network-vif-deleted", "tag": "7bde46c1-9c2f-458d-a411-c6bd6b2efd84"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:27.730420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83d691b3-75a5-4524-b3ed-816259eaba6e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.731209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83d691b3-75a5-4524-b3ed-816259eaba6e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.734333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83d691b3-75a5-4524-b3ed-816259eaba6e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.741734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83d691b3-75a5-4524-b3ed-816259eaba6e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.754865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-963224d9-6872-4851-98d0-626f741bf7e5 req-e30e8068-e5f0-4fed-8c11-d9f7d6fb14c0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.763725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-963224d9-6872-4851-98d0-626f741bf7e5 req-e30e8068-e5f0-4fed-8c11-d9f7d6fb14c0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.806384 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-963224d9-6872-4851-98d0-626f741bf7e5 req-e30e8068-e5f0-4fed-8c11-d9f7d6fb14c0 service nova] Creating event network-vif-deleted:7bde46c1-9c2f-458d-a411-c6bd6b2efd84 for instance 0079fbd3-9f24-447a-8331-0823b53255ac on n-h1-760456-11 Jul 20 04:13:27.820802 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-963224d9-6872-4851-98d0-626f741bf7e5 req-e30e8068-e5f0-4fed-8c11-d9f7d6fb14c0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109269 Jul 20 04:13:27.824768 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 826/1626] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:27.840844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c7828e55-b423-4e33-91d4-b9c5a275dff5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:27.843467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c7828e55-b423-4e33-91d4-b9c5a275dff5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:27.864271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7828e55-b423-4e33-91d4-b9c5a275dff5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.867176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7828e55-b423-4e33-91d4-b9c5a275dff5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:27.871622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7828e55-b423-4e33-91d4-b9c5a275dff5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:27.874664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7828e55-b423-4e33-91d4-b9c5a275dff5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.369174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-83d691b3-75a5-4524-b3ed-816259eaba6e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:28.378183 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-83d691b3-75a5-4524-b3ed-816259eaba6e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1573 microversion: 2.1 time: 0.680641 Jul 20 04:13:28.378830 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 801/1627] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:27 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1573 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:28.400577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b13995c-6a2a-43f1-b058-e6164f90d6da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:28.401194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9b13995c-6a2a-43f1-b058-e6164f90d6da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:28.426616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b13995c-6a2a-43f1-b058-e6164f90d6da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.427482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b13995c-6a2a-43f1-b058-e6164f90d6da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.428445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b13995c-6a2a-43f1-b058-e6164f90d6da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:28.429060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b13995c-6a2a-43f1-b058-e6164f90d6da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:28.825993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c7828e55-b423-4e33-91d4-b9c5a275dff5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:28.840998 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c7828e55-b423-4e33-91d4-b9c5a275dff5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 1.010231 Jul 20 04:13:28.852822 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 827/1628] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:27 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:28.864566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62caf5a5-fe08-4c4c-9dc2-77b13aba77ca tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841d33e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:28.999696 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62caf5a5-fe08-4c4c-9dc2-77b13aba77ca tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1448 microversion: 2.1 time: 0.153505 Jul 20 04:13:29.000551 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 828/1629] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:28 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:29.021422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26c4e719-c0e7-4ee2-a693-d0768b22726c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.022833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26c4e719-c0e7-4ee2-a693-d0768b22726c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.038089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26c4e719-c0e7-4ee2-a693-d0768b22726c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.042775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26c4e719-c0e7-4ee2-a693-d0768b22726c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.043825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26c4e719-c0e7-4ee2-a693-d0768b22726c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.054086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26c4e719-c0e7-4ee2-a693-d0768b22726c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.087970 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-26c4e719-c0e7-4ee2-a693-d0768b22726c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] HTTP exception thrown: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26c4e719-c0e7-4ee2-a693-d0768b22726c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Request method failure captured: Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac HTTP/1.1 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14AuXboPxnrvfbzEFw32g2NKgUX1UqfKtfH4aAOiBejLjemvpTGqghr7vSmG2C_fpYkocFHBSTF-_WKcRVYUOaqoGU4P-CeOtIJixtST9qkd6Mx02SF41FblNGjQ9QPKhbIheCoscGnX_6fDtKPQArmfKziKXzLxTLU0TeS2c-kiC18 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4ad9f7ab7fcb4d76a2a6cccc260b7704 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-433503692 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-433503692 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4ad9f7ab7fcb4d76a2a6cccc260b7704 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-433503692 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachSCSIVolumeTestJSON-433503692-project Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: aff983224243430c83b9054014715548 Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-433503692-project Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '0079fbd3-9f24-447a-8331-0823b53255ac'} Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:29.090634 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:29.096839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:29.096839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:29.096839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:29.096839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:29.096839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:29.096839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:29.096839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:29.103568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26c4e719-c0e7-4ee2-a693-d0768b22726c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Returning 404 to user: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:29.110419 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26c4e719-c0e7-4ee2-a693-d0768b22726c tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 404 len: 111 microversion: 2.1 time: 0.108614 Jul 20 04:13:29.111750 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 829/1630] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:29.122278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4a914aa3-e141-43ae-96e7-6e4a651eaa8c req-2f1e44ad-2dbe-4842-8829-edfd4cf93ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfd0a05-0361-4623-b862-7e525c0eeb91", "name": "network-vif-plugged", "status": "completed", "tag": "24377567-d41e-41ac-b4a3-0d0f3a117215"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:29.147235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4a914aa3-e141-43ae-96e7-6e4a651eaa8c req-2f1e44ad-2dbe-4842-8829-edfd4cf93ccf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.152731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4a914aa3-e141-43ae-96e7-6e4a651eaa8c req-2f1e44ad-2dbe-4842-8829-edfd4cf93ccf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.178415 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4a914aa3-e141-43ae-96e7-6e4a651eaa8c req-2f1e44ad-2dbe-4842-8829-edfd4cf93ccf service nova] Creating event network-vif-plugged:24377567-d41e-41ac-b4a3-0d0f3a117215 for instance dbfd0a05-0361-4623-b862-7e525c0eeb91 on n-h2-760456-11 Jul 20 04:13:29.185264 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4a914aa3-e141-43ae-96e7-6e4a651eaa8c req-2f1e44ad-2dbe-4842-8829-edfd4cf93ccf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068062 Jul 20 04:13:29.190447 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 830/1631] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:29.197838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-879a2f88-aec9-4e8d-bbbf-7978c71065b0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.203914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-879a2f88-aec9-4e8d-bbbf-7978c71065b0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.220556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-879a2f88-aec9-4e8d-bbbf-7978c71065b0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.222870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-879a2f88-aec9-4e8d-bbbf-7978c71065b0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.225372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-879a2f88-aec9-4e8d-bbbf-7978c71065b0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.227249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-879a2f88-aec9-4e8d-bbbf-7978c71065b0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.305256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b13995c-6a2a-43f1-b058-e6164f90d6da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:29.316823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b13995c-6a2a-43f1-b058-e6164f90d6da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:29.319432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b13995c-6a2a-43f1-b058-e6164f90d6da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:29.322059 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9b13995c-6a2a-43f1-b058-e6164f90d6da tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1891 microversion: 2.42 time: 0.928952 Jul 20 04:13:29.335316 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 802/1632] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:28 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1891 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:29.345680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-621d7154-d66c-4c6f-af08-7599b2aa49b8 req-27fc39b4-9ee0-4962-a1b3-ba4396dda15d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "tag": "4437228e-d8f6-466d-873b-2e507d95f8fb"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:29.364831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-621d7154-d66c-4c6f-af08-7599b2aa49b8 req-27fc39b4-9ee0-4962-a1b3-ba4396dda15d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.365838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-621d7154-d66c-4c6f-af08-7599b2aa49b8 req-27fc39b4-9ee0-4962-a1b3-ba4396dda15d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.391154 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-621d7154-d66c-4c6f-af08-7599b2aa49b8 req-27fc39b4-9ee0-4962-a1b3-ba4396dda15d service nova] Creating event network-changed:4437228e-d8f6-466d-873b-2e507d95f8fb for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:13:29.399033 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-621d7154-d66c-4c6f-af08-7599b2aa49b8 req-27fc39b4-9ee0-4962-a1b3-ba4396dda15d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057423 Jul 20 04:13:29.400344 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 803/1633] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:29.421843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2b8a8ba5-7735-48a7-ae00-9919c663ee71 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.423060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2b8a8ba5-7735-48a7-ae00-9919c663ee71 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.441914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:29.444459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b8a8ba5-7735-48a7-ae00-9919c663ee71 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.445251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b8a8ba5-7735-48a7-ae00-9919c663ee71 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.446976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b8a8ba5-7735-48a7-ae00-9919c663ee71 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.447863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b8a8ba5-7735-48a7-ae00-9919c663ee71 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.651156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2b8a8ba5-7735-48a7-ae00-9919c663ee71 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:29.663048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2b8a8ba5-7735-48a7-ae00-9919c663ee71 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:29.668105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2b8a8ba5-7735-48a7-ae00-9919c663ee71 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:29.672990 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2b8a8ba5-7735-48a7-ae00-9919c663ee71 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1362 microversion: 2.25 time: 0.271089 Jul 20 04:13:29.674403 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 804/1634] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:29.689419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-61f0a213-c391-469c-9a10-f768ff6c9f03 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841e5b4c0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.780775 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-61f0a213-c391-469c-9a10-f768ff6c9f03 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 200 len: 1448 microversion: 2.1 time: 0.104976 Jul 20 04:13:29.785735 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 805/1635] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 1448 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:29.802779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f4fb658b-5ebe-4bd5-8eb3-b5cadf549dd6 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '.version_select at 0x7fb841e40a60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.857999 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f4fb658b-5ebe-4bd5-8eb3-b5cadf549dd6 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198835146" status: 202 len: 0 microversion: 2.1 time: 0.067507 Jul 20 04:13:29.864092 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 806/1636] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:13:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198835146 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:29.869751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-31aab916-25fb-42f0-b302-7ef79772e070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:29.870648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-31aab916-25fb-42f0-b302-7ef79772e070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:29.893621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31aab916-25fb-42f0-b302-7ef79772e070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.895492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31aab916-25fb-42f0-b302-7ef79772e070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.897046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31aab916-25fb-42f0-b302-7ef79772e070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:29.898759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31aab916-25fb-42f0-b302-7ef79772e070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:29.953643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:30.133359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-879a2f88-aec9-4e8d-bbbf-7978c71065b0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:30.143892 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-879a2f88-aec9-4e8d-bbbf-7978c71065b0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1468 microversion: 2.1 time: 0.950435 Jul 20 04:13:30.146022 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 831/1637] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1468 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:30.160186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-36c73b32-a67a-4f3d-b232-535e24dad040 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841b49af0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:30.304880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-31aab916-25fb-42f0-b302-7ef79772e070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:30.314914 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-31aab916-25fb-42f0-b302-7ef79772e070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1571 microversion: 2.1 time: 0.449515 Jul 20 04:13:30.320330 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 807/1638] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:29 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1571 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:30.326006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ff5f4cb1-1a10-41b8-96db-75181536a94e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:30.326817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ff5f4cb1-1a10-41b8-96db-75181536a94e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:30.352506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff5f4cb1-1a10-41b8-96db-75181536a94e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.353914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff5f4cb1-1a10-41b8-96db-75181536a94e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.355911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff5f4cb1-1a10-41b8-96db-75181536a94e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.356571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff5f4cb1-1a10-41b8-96db-75181536a94e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.659013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ff5f4cb1-1a10-41b8-96db-75181536a94e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:30.669096 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ff5f4cb1-1a10-41b8-96db-75181536a94e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.347383 Jul 20 04:13:30.670031 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 808/1639] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:30 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:30.688988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43466a18-577f-4293-b761-2b189e6c386a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-57440223"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:30.689572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43466a18-577f-4293-b761-2b189e6c386a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:30.699891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43466a18-577f-4293-b761-2b189e6c386a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.700362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43466a18-577f-4293-b761-2b189e6c386a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:30.702991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43466a18-577f-4293-b761-2b189e6c386a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:30.703476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43466a18-577f-4293-b761-2b189e6c386a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.016782 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.network.security_group_api [None req-43466a18-577f-4293-b761-2b189e6c386a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Adding security group 5d45c3d1-2c75-4360-8850-5726e6c358f6 to port d60885a1-1430-4843-baf6-315aebbd7b84 Jul 20 04:13:31.534562 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-36c73b32-a67a-4f3d-b232-535e24dad040 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 204 len: 0 microversion: 2.1 time: 1.387096 Jul 20 04:13:31.536265 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 832/1640] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:30 2022] DELETE /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 0 bytes in 1389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:31.541803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bef13b26-0635-4fef-bf8d-f40fe2d1620f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.542801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bef13b26-0635-4fef-bf8d-f40fe2d1620f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.552135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bef13b26-0635-4fef-bf8d-f40fe2d1620f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.552881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bef13b26-0635-4fef-bf8d-f40fe2d1620f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.554388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bef13b26-0635-4fef-bf8d-f40fe2d1620f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.555457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bef13b26-0635-4fef-bf8d-f40fe2d1620f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.687365 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43466a18-577f-4293-b761-2b189e6c386a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861/action" status: 202 len: 0 microversion: 2.1 time: 1.014535 Jul 20 04:13:31.688950 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 809/1641] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:30 2022] POST /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861/action => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:31.697459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-071724de-7e74-47b0-bfc8-caf9782a79dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.699046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-071724de-7e74-47b0-bfc8-caf9782a79dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:31.714233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-071724de-7e74-47b0-bfc8-caf9782a79dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.717342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-071724de-7e74-47b0-bfc8-caf9782a79dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.722563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-071724de-7e74-47b0-bfc8-caf9782a79dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:31.723245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-071724de-7e74-47b0-bfc8-caf9782a79dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:31.940411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-071724de-7e74-47b0-bfc8-caf9782a79dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:31.956734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-071724de-7e74-47b0-bfc8-caf9782a79dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:31.964202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-071724de-7e74-47b0-bfc8-caf9782a79dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:31.966396 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-071724de-7e74-47b0-bfc8-caf9782a79dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1558 microversion: 2.25 time: 0.273043 Jul 20 04:13:31.971445 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 810/1642] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1558 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:31.991630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e5d6821a-8d65-4412-92bb-7daa8ece6ea8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:31.992574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e5d6821a-8d65-4412-92bb-7daa8ece6ea8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:32.003517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5d6821a-8d65-4412-92bb-7daa8ece6ea8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.004785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5d6821a-8d65-4412-92bb-7daa8ece6ea8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.008002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5d6821a-8d65-4412-92bb-7daa8ece6ea8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.008743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5d6821a-8d65-4412-92bb-7daa8ece6ea8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.102892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bef13b26-0635-4fef-bf8d-f40fe2d1620f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:32.118834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bef13b26-0635-4fef-bf8d-f40fe2d1620f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:32.122817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bef13b26-0635-4fef-bf8d-f40fe2d1620f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:32.126627 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bef13b26-0635-4fef-bf8d-f40fe2d1620f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1891 microversion: 2.42 time: 0.589094 Jul 20 04:13:32.127219 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 833/1643] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1891 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:32.145401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f2660b54-b80e-45c5-af38-e99f9486e4a3 req-5f3c282f-d412-4caa-bd9b-4f199e27d461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9", "name": "network-vif-unplugged", "status": "completed", "tag": "b4437382-d813-4ba5-b42b-466403da1026"}, {"name": "network-changed", "server_uuid": "6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9", "tag": "b4437382-d813-4ba5-b42b-466403da1026"}, {"name": "network-changed", "server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "tag": "58c84e4d-21a1-4739-b37c-080f055491f3"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:32.157340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f2660b54-b80e-45c5-af38-e99f9486e4a3 req-5f3c282f-d412-4caa-bd9b-4f199e27d461 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.157787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f2660b54-b80e-45c5-af38-e99f9486e4a3 req-5f3c282f-d412-4caa-bd9b-4f199e27d461 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.192534 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f2660b54-b80e-45c5-af38-e99f9486e4a3 req-5f3c282f-d412-4caa-bd9b-4f199e27d461 service nova] Creating event network-vif-unplugged:b4437382-d813-4ba5-b42b-466403da1026 for instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 on n-h2-760456-11 Jul 20 04:13:32.198574 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f2660b54-b80e-45c5-af38-e99f9486e4a3 req-5f3c282f-d412-4caa-bd9b-4f199e27d461 service nova] Creating event network-changed:b4437382-d813-4ba5-b42b-466403da1026 for instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 on n-h2-760456-11 Jul 20 04:13:32.199266 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f2660b54-b80e-45c5-af38-e99f9486e4a3 req-5f3c282f-d412-4caa-bd9b-4f199e27d461 service nova] Creating event network-changed:58c84e4d-21a1-4739-b37c-080f055491f3 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:13:32.215700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-f2660b54-b80e-45c5-af38-e99f9486e4a3 req-5f3c282f-d412-4caa-bd9b-4f199e27d461 service nova] Instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:13:32.246029 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f2660b54-b80e-45c5-af38-e99f9486e4a3 req-5f3c282f-d412-4caa-bd9b-4f199e27d461 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.104231 Jul 20 04:13:32.250302 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 834/1644] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:32.263410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b1c4e259-a9c0-4278-afd6-142768a46aa4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:32.264028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b1c4e259-a9c0-4278-afd6-142768a46aa4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:32.277794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1c4e259-a9c0-4278-afd6-142768a46aa4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.278295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1c4e259-a9c0-4278-afd6-142768a46aa4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.279138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1c4e259-a9c0-4278-afd6-142768a46aa4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.279585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1c4e259-a9c0-4278-afd6-142768a46aa4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.309174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b1c4e259-a9c0-4278-afd6-142768a46aa4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:32.424534 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b1c4e259-a9c0-4278-afd6-142768a46aa4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 204 len: 0 microversion: 2.1 time: 0.172046 Jul 20 04:13:32.425164 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 835/1645] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:32 2022] DELETE /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:32.441310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-19c58ffa-16d5-4e63-9656-a7d36ac8ecb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:32.442467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-19c58ffa-16d5-4e63-9656-a7d36ac8ecb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:32.450881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19c58ffa-16d5-4e63-9656-a7d36ac8ecb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.451520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19c58ffa-16d5-4e63-9656-a7d36ac8ecb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.453274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19c58ffa-16d5-4e63-9656-a7d36ac8ecb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:32.455158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19c58ffa-16d5-4e63-9656-a7d36ac8ecb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:32.635366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e5d6821a-8d65-4412-92bb-7daa8ece6ea8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:32.645727 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e5d6821a-8d65-4412-92bb-7daa8ece6ea8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1468 microversion: 2.1 time: 0.672862 Jul 20 04:13:32.660003 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 811/1646] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:31 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1468 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:32.666790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d08131b-b3e6-4686-8ee0-bb2e850b4ae9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841e5f790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:32.963161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG neutronclient.v2_0.client [None req-7d08131b-b3e6-4686-8ee0-bb2e850b4ae9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5d45c3d1-2c75-4360-8850-5726e6c358f6 in use.", "detail": ""}} {{(pid=119605) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:13:32.964629 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-7d08131b-b3e6-4686-8ee0-bb2e850b4ae9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security Group 5d45c3d1-2c75-4360-8850-5726e6c358f6 in use. Jul 20 04:13:32.964629 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-28c3957c-3a3f-4cfb-9ff6-2759c3cd6bbe'] Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d08131b-b3e6-4686-8ee0-bb2e850b4ae9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-security-groups/5d45c3d1-2c75-4360-8850-5726e6c358f6 HTTP/1.1 Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: exception: Security Group 5d45c3d1-2c75-4360-8850-5726e6c358f6 in use. Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-28c3957c-3a3f-4cfb-9ff6-2759c3cd6bbe'] Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '5d45c3d1-2c75-4360-8850-5726e6c358f6'} Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:13:32.967321 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5d45c3d1-2c75-4360-8850-5726e6c358f6 in use. Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28c3957c-3a3f-4cfb-9ff6-2759c3cd6bbe'] Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5d45c3d1-2c75-4360-8850-5726e6c358f6 in use. Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28c3957c-3a3f-4cfb-9ff6-2759c3cd6bbe'] Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5d45c3d1-2c75-4360-8850-5726e6c358f6 in use. Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28c3957c-3a3f-4cfb-9ff6-2759c3cd6bbe'] Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5d45c3d1-2c75-4360-8850-5726e6c358f6 in use. Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28c3957c-3a3f-4cfb-9ff6-2759c3cd6bbe'] Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d08131b-b3e6-4686-8ee0-bb2e850b4ae9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 400 to user: Security Group 5d45c3d1-2c75-4360-8850-5726e6c358f6 in use. Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-28c3957c-3a3f-4cfb-9ff6-2759c3cd6bbe'] {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7d08131b-b3e6-4686-8ee0-bb2e850b4ae9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/5d45c3d1-2c75-4360-8850-5726e6c358f6" status: 400 len: 185 microversion: 2.1 time: 0.308053 Jul 20 04:13:32.972852 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 812/1647] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:32 2022] DELETE /compute/v2.1/os-security-groups/5d45c3d1-2c75-4360-8850-5726e6c358f6 => generated 185 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:13:32.982480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-80fd83f1-9490-4e71-8e0c-1d1f5a10a254 req-80588849-215f-4aa4-870a-e43dae0deac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26b3126-e80d-4687-a609-36e6cca0b861", "tag": "d60885a1-1430-4843-baf6-315aebbd7b84"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:33.009336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-80fd83f1-9490-4e71-8e0c-1d1f5a10a254 req-80588849-215f-4aa4-870a-e43dae0deac6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.009336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-80fd83f1-9490-4e71-8e0c-1d1f5a10a254 req-80588849-215f-4aa4-870a-e43dae0deac6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.036911 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-80fd83f1-9490-4e71-8e0c-1d1f5a10a254 req-80588849-215f-4aa4-870a-e43dae0deac6 service nova] Creating event network-changed:d60885a1-1430-4843-baf6-315aebbd7b84 for instance b26b3126-e80d-4687-a609-36e6cca0b861 on n-h1-760456-11 Jul 20 04:13:33.046939 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-80fd83f1-9490-4e71-8e0c-1d1f5a10a254 req-80588849-215f-4aa4-870a-e43dae0deac6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072451 Jul 20 04:13:33.048248 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 813/1648] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:33.057249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ee33655-832d-43ad-a0ce-6b0d875a1b65 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.057956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ee33655-832d-43ad-a0ce-6b0d875a1b65 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:33.081779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ee33655-832d-43ad-a0ce-6b0d875a1b65 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.082234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ee33655-832d-43ad-a0ce-6b0d875a1b65 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.083044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ee33655-832d-43ad-a0ce-6b0d875a1b65 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.084718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ee33655-832d-43ad-a0ce-6b0d875a1b65 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.503421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-1ee33655-832d-43ad-a0ce-6b0d875a1b65 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid dbfd0a05-0361-4623-b862-7e525c0eeb91 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:33.544143 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ee33655-832d-43ad-a0ce-6b0d875a1b65 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 2053 microversion: 2.25 time: 0.494147 Jul 20 04:13:33.545004 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 814/1649] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:33 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 2053 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:33.561017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1205089300", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "8ef25bc8-09e8-4802-9a88-9466c2609da2"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:33.675649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] validate_networks() for [('8ef25bc8-09e8-4802-9a88-9466c2609da2', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:33.750082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-19c58ffa-16d5-4e63-9656-a7d36ac8ecb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:33.764385 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-19c58ffa-16d5-4e63-9656-a7d36ac8ecb8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 1.337748 Jul 20 04:13:33.769787 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 836/1650] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:32 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:33.775430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a96d7b98-6bcd-461d-8f06-98b0fcb0e811 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:33.775954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a96d7b98-6bcd-461d-8f06-98b0fcb0e811 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:33.798031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a96d7b98-6bcd-461d-8f06-98b0fcb0e811 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.798897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a96d7b98-6bcd-461d-8f06-98b0fcb0e811 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.799873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a96d7b98-6bcd-461d-8f06-98b0fcb0e811 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:33.800489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a96d7b98-6bcd-461d-8f06-98b0fcb0e811 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:33.852978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a96d7b98-6bcd-461d-8f06-98b0fcb0e811 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:33.869262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:34.001855 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a96d7b98-6bcd-461d-8f06-98b0fcb0e811 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 204 len: 0 microversion: 2.1 time: 0.230189 Jul 20 04:13:34.002993 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 837/1651] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:33 2022] DELETE /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:34.010233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d7e8f19-fae8-4ff1-a98c-37e506f56547 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:34.011707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d7e8f19-fae8-4ff1-a98c-37e506f56547 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:34.020957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d7e8f19-fae8-4ff1-a98c-37e506f56547 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.021603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d7e8f19-fae8-4ff1-a98c-37e506f56547 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.022653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d7e8f19-fae8-4ff1-a98c-37e506f56547 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.023264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d7e8f19-fae8-4ff1-a98c-37e506f56547 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.494029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d7e8f19-fae8-4ff1-a98c-37e506f56547 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:34.510383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d7e8f19-fae8-4ff1-a98c-37e506f56547 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:34.520370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d7e8f19-fae8-4ff1-a98c-37e506f56547 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:34.524437 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d7e8f19-fae8-4ff1-a98c-37e506f56547 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1891 microversion: 2.42 time: 0.519944 Jul 20 04:13:34.533811 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 838/1652] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:34 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1891 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:34.539432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e4474270-9516-4f2b-90c3-c385722d39f7 req-96f0ffef-def9-4a94-8b80-9260eecacc8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe65a9e-ad47-4844-a1d1-b673bca616c5", "name": "network-vif-unplugged", "status": "completed", "tag": "e8758fe3-5fc7-4de5-b21a-4f8e7a450410"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:34.549407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e4474270-9516-4f2b-90c3-c385722d39f7 req-96f0ffef-def9-4a94-8b80-9260eecacc8e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.550140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e4474270-9516-4f2b-90c3-c385722d39f7 req-96f0ffef-def9-4a94-8b80-9260eecacc8e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.563876 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e4474270-9516-4f2b-90c3-c385722d39f7 req-96f0ffef-def9-4a94-8b80-9260eecacc8e service nova] Creating event network-vif-unplugged:e8758fe3-5fc7-4de5-b21a-4f8e7a450410 for instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 on n-h1-760456-11 Jul 20 04:13:34.569958 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e4474270-9516-4f2b-90c3-c385722d39f7 req-96f0ffef-def9-4a94-8b80-9260eecacc8e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034735 Jul 20 04:13:34.570868 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 839/1653] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:34.578680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f1830db-8485-4ef0-8671-b964503ba11c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:34.579632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3f1830db-8485-4ef0-8671-b964503ba11c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:34.586683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f1830db-8485-4ef0-8671-b964503ba11c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.587389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f1830db-8485-4ef0-8671-b964503ba11c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.588990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f1830db-8485-4ef0-8671-b964503ba11c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.589604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f1830db-8485-4ef0-8671-b964503ba11c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.789979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-3f1830db-8485-4ef0-8671-b964503ba11c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid dbfd0a05-0361-4623-b862-7e525c0eeb91 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:34.807780 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f1830db-8485-4ef0-8671-b964503ba11c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 2053 microversion: 2.25 time: 0.235447 Jul 20 04:13:34.808733 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 840/1654] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:34 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 2053 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:34.814792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3bb4a370-6a10-407f-8d2e-3966c0e286b8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:34.815733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3bb4a370-6a10-407f-8d2e-3966c0e286b8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:34.825827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3bb4a370-6a10-407f-8d2e-3966c0e286b8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.826687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3bb4a370-6a10-407f-8d2e-3966c0e286b8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:34.828671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3bb4a370-6a10-407f-8d2e-3966c0e286b8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:34.829333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3bb4a370-6a10-407f-8d2e-3966c0e286b8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.098212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3bb4a370-6a10-407f-8d2e-3966c0e286b8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:35.099733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:35.100306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:35.100904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:35.101424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:35.102113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:35.106456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3bb4a370-6a10-407f-8d2e-3966c0e286b8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1468 microversion: 2.1 time: 0.296446 Jul 20 04:13:35.122123 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 841/1655] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:34 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1468 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:35.127253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94963f06-620a-4618-a650-b4da2d53c95c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:35.127869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-94963f06-620a-4618-a650-b4da2d53c95c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:35.132545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.132993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.133799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.134240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.146700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94963f06-620a-4618-a650-b4da2d53c95c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.147147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94963f06-620a-4618-a650-b4da2d53c95c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.150349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94963f06-620a-4618-a650-b4da2d53c95c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.156155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94963f06-620a-4618-a650-b4da2d53c95c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.173185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Getting quotas for project d95803bcc72643c995784af8507117b3. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:35.202182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Getting quotas for user 8aad902393614d1fae3d0f5bf5456c06 and project d95803bcc72643c995784af8507117b3. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:35.237817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:35.248101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:35.374370 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-279b6cfa-7b5e-4b8b-8157-8afb48da0f44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.822783 Jul 20 04:13:35.375062 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 815/1656] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:35.383710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01001d68-3fba-482d-b8f6-d1784ac7427d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:35.385135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-01001d68-3fba-482d-b8f6-d1784ac7427d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:35.399386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01001d68-3fba-482d-b8f6-d1784ac7427d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.400079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01001d68-3fba-482d-b8f6-d1784ac7427d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.401052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01001d68-3fba-482d-b8f6-d1784ac7427d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.403986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01001d68-3fba-482d-b8f6-d1784ac7427d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.831889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-94963f06-620a-4618-a650-b4da2d53c95c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:35.842287 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94963f06-620a-4618-a650-b4da2d53c95c tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1644 microversion: 2.1 time: 0.718851 Jul 20 04:13:35.844780 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 842/1657] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:35 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1644 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:35.851539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f90008cb-9658-468d-9790-56606a7ff65e tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:35.853482 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:13:35.853482 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:13:35.855461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f90008cb-9658-468d-9790-56606a7ff65e tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.856261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f90008cb-9658-468d-9790-56606a7ff65e tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.857656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f90008cb-9658-468d-9790-56606a7ff65e tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.859797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f90008cb-9658-468d-9790-56606a7ff65e tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.925140 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f90008cb-9658-468d-9790-56606a7ff65e tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.078887 Jul 20 04:13:35.926682 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 843/1658] 10.222.0.59 () {60 vars in 1216 bytes} [Wed Jul 20 04:13:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:13:35.933082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-dafe80e2-776f-4734-83ef-550579545d85 req-41173810-27de-4a87-b5ee-f4276a067ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "tag": "6cd82c0a-6158-4750-9342-bab7ea3f563d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:35.946948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-dafe80e2-776f-4734-83ef-550579545d85 req-41173810-27de-4a87-b5ee-f4276a067ab7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:35.949800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-dafe80e2-776f-4734-83ef-550579545d85 req-41173810-27de-4a87-b5ee-f4276a067ab7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:35.966122 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-dafe80e2-776f-4734-83ef-550579545d85 req-41173810-27de-4a87-b5ee-f4276a067ab7 service nova] Creating event network-changed:6cd82c0a-6158-4750-9342-bab7ea3f563d for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:13:35.974187 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-dafe80e2-776f-4734-83ef-550579545d85 req-41173810-27de-4a87-b5ee-f4276a067ab7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045785 Jul 20 04:13:35.975554 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 844/1659] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:35.997551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d9030aec-2fe0-46e9-8e20-645620b246d1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:35.998380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d9030aec-2fe0-46e9-8e20-645620b246d1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:36.870057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d9030aec-2fe0-46e9-8e20-645620b246d1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:36.881805 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d9030aec-2fe0-46e9-8e20-645620b246d1 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1208 microversion: 2.1 time: 0.904534 Jul 20 04:13:36.883998 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 845/1660] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:35 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1208 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:36.905816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-01001d68-3fba-482d-b8f6-d1784ac7427d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:36.952634 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01001d68-3fba-482d-b8f6-d1784ac7427d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 1.572851 Jul 20 04:13:36.961986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d6763b9-5b21-401a-a9c7-65b466dee7c6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:36.968089 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 816/1661] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:35 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:36.969199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5d6763b9-5b21-401a-a9c7-65b466dee7c6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:36.997311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73e25401-9b7b-4092-bdc3-8e57f7240c7b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:37.005366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d6763b9-5b21-401a-a9c7-65b466dee7c6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.006170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-73e25401-9b7b-4092-bdc3-8e57f7240c7b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:37.011544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d6763b9-5b21-401a-a9c7-65b466dee7c6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.014083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d6763b9-5b21-401a-a9c7-65b466dee7c6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.023406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d6763b9-5b21-401a-a9c7-65b466dee7c6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.033294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73e25401-9b7b-4092-bdc3-8e57f7240c7b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.034736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73e25401-9b7b-4092-bdc3-8e57f7240c7b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.039957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73e25401-9b7b-4092-bdc3-8e57f7240c7b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.040432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73e25401-9b7b-4092-bdc3-8e57f7240c7b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.335209 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-73e25401-9b7b-4092-bdc3-8e57f7240c7b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91/action" status: 202 len: 0 microversion: 2.25 time: 0.363281 Jul 20 04:13:37.338431 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 817/1662] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:13:36 2022] POST /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:37.361722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6fa70acc-2839-4792-bb6c-c5381aeb520f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:37.362549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6fa70acc-2839-4792-bb6c-c5381aeb520f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:37.394005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fa70acc-2839-4792-bb6c-c5381aeb520f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.394590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fa70acc-2839-4792-bb6c-c5381aeb520f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.398072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fa70acc-2839-4792-bb6c-c5381aeb520f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.398586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fa70acc-2839-4792-bb6c-c5381aeb520f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.832701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5d6763b9-5b21-401a-a9c7-65b466dee7c6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:37.846575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5d6763b9-5b21-401a-a9c7-65b466dee7c6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:37.861068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5d6763b9-5b21-401a-a9c7-65b466dee7c6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:37.862353 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d6763b9-5b21-401a-a9c7-65b466dee7c6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1891 microversion: 2.42 time: 0.973881 Jul 20 04:13:37.862933 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 846/1663] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:36 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1891 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:37.884199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0594de61-17a9-4b14-81bc-c0f8f03285c7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:37.890601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0594de61-17a9-4b14-81bc-c0f8f03285c7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:37.909237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0594de61-17a9-4b14-81bc-c0f8f03285c7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.916203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0594de61-17a9-4b14-81bc-c0f8f03285c7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:37.921969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0594de61-17a9-4b14-81bc-c0f8f03285c7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:37.945491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0594de61-17a9-4b14-81bc-c0f8f03285c7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:38.957836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0594de61-17a9-4b14-81bc-c0f8f03285c7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:38.986343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6fa70acc-2839-4792-bb6c-c5381aeb520f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:38.987028 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0594de61-17a9-4b14-81bc-c0f8f03285c7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 200 len: 1467 microversion: 2.1 time: 1.115503 Jul 20 04:13:38.992734 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 847/1664] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:37 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 1467 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:39.008066 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6fa70acc-2839-4792-bb6c-c5381aeb520f tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1461 microversion: 2.1 time: 1.667235 Jul 20 04:13:39.009917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-92a2206a-d34f-4aeb-9d69-db97df446ea0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:39.011619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-92a2206a-d34f-4aeb-9d69-db97df446ea0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:39.021506 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 818/1665] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:37 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1461 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:39.031043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-92a2206a-d34f-4aeb-9d69-db97df446ea0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.037298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7989d08e-e65d-42ca-bce5-2aada10d8316 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:39.038329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7989d08e-e65d-42ca-bce5-2aada10d8316 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:39.042678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-92a2206a-d34f-4aeb-9d69-db97df446ea0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.047734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-92a2206a-d34f-4aeb-9d69-db97df446ea0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.049785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-92a2206a-d34f-4aeb-9d69-db97df446ea0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.060279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7989d08e-e65d-42ca-bce5-2aada10d8316 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.064276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7989d08e-e65d-42ca-bce5-2aada10d8316 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.069306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7989d08e-e65d-42ca-bce5-2aada10d8316 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.071388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7989d08e-e65d-42ca-bce5-2aada10d8316 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.323806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7989d08e-e65d-42ca-bce5-2aada10d8316 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:39.338442 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7989d08e-e65d-42ca-bce5-2aada10d8316 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1266 microversion: 2.1 time: 0.315491 Jul 20 04:13:39.342274 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 819/1666] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:39 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:39.354826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ee5c3b6-4353-411d-af0d-0af5dd21c1ea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:39.357022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ee5c3b6-4353-411d-af0d-0af5dd21c1ea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:39.375806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ee5c3b6-4353-411d-af0d-0af5dd21c1ea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.376667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ee5c3b6-4353-411d-af0d-0af5dd21c1ea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.377783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ee5c3b6-4353-411d-af0d-0af5dd21c1ea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:39.378505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ee5c3b6-4353-411d-af0d-0af5dd21c1ea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:39.924083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-92a2206a-d34f-4aeb-9d69-db97df446ea0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid dbfd0a05-0361-4623-b862-7e525c0eeb91 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:39.959751 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-92a2206a-d34f-4aeb-9d69-db97df446ea0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 2038 microversion: 2.25 time: 0.964909 Jul 20 04:13:39.962674 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 848/1667] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:38 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 2038 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:39.982520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-92ca15a6-9cd0-4c46-b2d4-5083e81149a4 req-986d0a1f-d1df-4f9d-9f6b-ed833418d2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26b3126-e80d-4687-a609-36e6cca0b861", "name": "network-vif-deleted", "tag": "d60885a1-1430-4843-baf6-315aebbd7b84"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:39.994409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-92ca15a6-9cd0-4c46-b2d4-5083e81149a4 req-986d0a1f-d1df-4f9d-9f6b-ed833418d2fb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.001274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-92ca15a6-9cd0-4c46-b2d4-5083e81149a4 req-986d0a1f-d1df-4f9d-9f6b-ed833418d2fb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.033235 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-92ca15a6-9cd0-4c46-b2d4-5083e81149a4 req-986d0a1f-d1df-4f9d-9f6b-ed833418d2fb service nova] Creating event network-vif-deleted:d60885a1-1430-4843-baf6-315aebbd7b84 for instance b26b3126-e80d-4687-a609-36e6cca0b861 on n-h1-760456-11 Jul 20 04:13:40.046126 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-92ca15a6-9cd0-4c46-b2d4-5083e81149a4 req-986d0a1f-d1df-4f9d-9f6b-ed833418d2fb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080009 Jul 20 04:13:40.048849 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 849/1668] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:40.061805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d09e7bab-e704-4037-b347-50cccaaf88f4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:40.064286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d09e7bab-e704-4037-b347-50cccaaf88f4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:40.075665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ee5c3b6-4353-411d-af0d-0af5dd21c1ea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:40.081460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d09e7bab-e704-4037-b347-50cccaaf88f4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.082152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d09e7bab-e704-4037-b347-50cccaaf88f4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.083465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d09e7bab-e704-4037-b347-50cccaaf88f4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.089724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d09e7bab-e704-4037-b347-50cccaaf88f4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.104652 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ee5c3b6-4353-411d-af0d-0af5dd21c1ea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.755940 Jul 20 04:13:40.108285 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 820/1669] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:39 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:40.515581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48be235f-0359-4bc9-91a9-aa3233a819a4 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:40.516205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-48be235f-0359-4bc9-91a9-aa3233a819a4 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:40.527650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48be235f-0359-4bc9-91a9-aa3233a819a4 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.528417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48be235f-0359-4bc9-91a9-aa3233a819a4 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.529239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48be235f-0359-4bc9-91a9-aa3233a819a4 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.531969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48be235f-0359-4bc9-91a9-aa3233a819a4 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.634475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d09e7bab-e704-4037-b347-50cccaaf88f4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:40.650389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d09e7bab-e704-4037-b347-50cccaaf88f4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:40.652660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d09e7bab-e704-4037-b347-50cccaaf88f4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:40.654705 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d09e7bab-e704-4037-b347-50cccaaf88f4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.601797 Jul 20 04:13:40.656493 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 850/1670] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:40 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:40.662339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-92b70694-fe61-4329-8db6-7900c0b88889 req-509a05e3-867a-4508-99c7-19b2a8845b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "tag": "34ed3285-dde5-4027-a99c-c92741329ec4"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:40.675254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-92b70694-fe61-4329-8db6-7900c0b88889 req-509a05e3-867a-4508-99c7-19b2a8845b7a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.675990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-92b70694-fe61-4329-8db6-7900c0b88889 req-509a05e3-867a-4508-99c7-19b2a8845b7a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.691777 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-92b70694-fe61-4329-8db6-7900c0b88889 req-509a05e3-867a-4508-99c7-19b2a8845b7a service nova] Creating event network-changed:34ed3285-dde5-4027-a99c-c92741329ec4 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:13:40.700772 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-92b70694-fe61-4329-8db6-7900c0b88889 req-509a05e3-867a-4508-99c7-19b2a8845b7a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042608 Jul 20 04:13:40.702963 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 851/1671] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:40.731866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6831c824-a395-4eba-a765-bfced2545c44 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-760456-11", "block_migration": "auto"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:40.742556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6831c824-a395-4eba-a765-bfced2545c44 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:40.760479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:40.762442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6831c824-a395-4eba-a765-bfced2545c44 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.762939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6831c824-a395-4eba-a765-bfced2545c44 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.763747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6831c824-a395-4eba-a765-bfced2545c44 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:40.764791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6831c824-a395-4eba-a765-bfced2545c44 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:40.827844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-6831c824-a395-4eba-a765-bfced2545c44 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'flavor' on Instance uuid dbfd0a05-0361-4623-b862-7e525c0eeb91 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:40.853421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6831c824-a395-4eba-a765-bfced2545c44 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Going to try to live migrate instance to n-h1-760456-11 {{(pid=119606) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:13:41.419553 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48be235f-0359-4bc9-91a9-aa3233a819a4 tempest-MigrationsAdminTest-1790905836 tempest-MigrationsAdminTest-1790905836-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1614 microversion: 2.1 time: 1.309943 Jul 20 04:13:41.431372 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 821/1672] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:40 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1614 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:41.437514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84a1d38a-66e2-4936-b991-0581f4dbbf8d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:41.441299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-84a1d38a-66e2-4936-b991-0581f4dbbf8d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:41.453212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84a1d38a-66e2-4936-b991-0581f4dbbf8d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.457991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84a1d38a-66e2-4936-b991-0581f4dbbf8d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.463415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84a1d38a-66e2-4936-b991-0581f4dbbf8d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.464834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84a1d38a-66e2-4936-b991-0581f4dbbf8d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.494910 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-84a1d38a-66e2-4936-b991-0581f4dbbf8d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84a1d38a-66e2-4936-b991-0581f4dbbf8d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 HTTP/1.1 Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'b26b3126-e80d-4687-a609-36e6cca0b861'} Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:41.498672 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.504320 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:41.504320 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:41.504320 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:41.504320 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:41.504320 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:41.504320 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:41.504320 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:41.506880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84a1d38a-66e2-4936-b991-0581f4dbbf8d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:41.508465 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-84a1d38a-66e2-4936-b991-0581f4dbbf8d tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 404 len: 111 microversion: 2.1 time: 0.075814 Jul 20 04:13:41.509604 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 822/1673] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:41 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:41.525196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3ddd3065-aeb7-447e-a9dd-836bafd055d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:41.526391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3ddd3065-aeb7-447e-a9dd-836bafd055d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:41.537906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ddd3065-aeb7-447e-a9dd-836bafd055d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.539036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ddd3065-aeb7-447e-a9dd-836bafd055d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:41.543639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ddd3065-aeb7-447e-a9dd-836bafd055d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:41.546042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ddd3065-aeb7-447e-a9dd-836bafd055d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.267480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3ddd3065-aeb7-447e-a9dd-836bafd055d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:42.282328 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3ddd3065-aeb7-447e-a9dd-836bafd055d8 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1308 microversion: 2.1 time: 0.768989 Jul 20 04:13:42.285094 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 823/1674] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:41 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1308 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:42.297653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-853ae3aa-2b3e-4373-9069-e29b5fdbc5c9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:42.298831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-853ae3aa-2b3e-4373-9069-e29b5fdbc5c9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:42.315941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-853ae3aa-2b3e-4373-9069-e29b5fdbc5c9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.316793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-853ae3aa-2b3e-4373-9069-e29b5fdbc5c9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:42.317949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-853ae3aa-2b3e-4373-9069-e29b5fdbc5c9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:42.318708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-853ae3aa-2b3e-4373-9069-e29b5fdbc5c9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.097349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-853ae3aa-2b3e-4373-9069-e29b5fdbc5c9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:43.115185 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-853ae3aa-2b3e-4373-9069-e29b5fdbc5c9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.828839 Jul 20 04:13:43.116018 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 824/1675] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:42 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:43.141899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-575eb487-c61b-41aa-8d14-5945a06219b9 req-da0a3300-e7f8-4af2-82a3-e2038efc3bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9", "name": "network-vif-plugged", "status": "completed", "tag": "b4437382-d813-4ba5-b42b-466403da1026"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:43.177605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-575eb487-c61b-41aa-8d14-5945a06219b9 req-da0a3300-e7f8-4af2-82a3-e2038efc3bc3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.178070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-575eb487-c61b-41aa-8d14-5945a06219b9 req-da0a3300-e7f8-4af2-82a3-e2038efc3bc3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.196112 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-575eb487-c61b-41aa-8d14-5945a06219b9 req-da0a3300-e7f8-4af2-82a3-e2038efc3bc3 service nova] Creating event network-vif-plugged:b4437382-d813-4ba5-b42b-466403da1026 for instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 on n-h2-760456-11 Jul 20 04:13:43.206777 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-575eb487-c61b-41aa-8d14-5945a06219b9 req-da0a3300-e7f8-4af2-82a3-e2038efc3bc3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088215 Jul 20 04:13:43.209284 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 825/1676] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:43.223630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-41ac7408-06c8-4934-aa64-aff8df38c2c8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.224492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-41ac7408-06c8-4934-aa64-aff8df38c2c8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:43.237270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ac7408-06c8-4934-aa64-aff8df38c2c8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.239788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ac7408-06c8-4934-aa64-aff8df38c2c8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.243463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ac7408-06c8-4934-aa64-aff8df38c2c8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.246194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ac7408-06c8-4934-aa64-aff8df38c2c8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.317796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-41ac7408-06c8-4934-aa64-aff8df38c2c8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:43.331815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:43.500685 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-41ac7408-06c8-4934-aa64-aff8df38c2c8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 204 len: 0 microversion: 2.1 time: 0.289612 Jul 20 04:13:43.503140 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 826/1677] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:43 2022] DELETE /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:43.518827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26cf7cd5-d9f6-4a9e-b89b-139e248d6752 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841e5f9d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.627899 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6831c824-a395-4eba-a765-bfced2545c44 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91/action" status: 202 len: 0 microversion: 2.25 time: 2.922733 Jul 20 04:13:43.630572 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 852/1678] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:13:40 2022] POST /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91/action => generated 0 bytes in 2927 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:43.638386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-25ce388d-9341-46ce-ab07-7080da1ecf9d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:43.641554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-25ce388d-9341-46ce-ab07-7080da1ecf9d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:43.663303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25ce388d-9341-46ce-ab07-7080da1ecf9d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.663805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25ce388d-9341-46ce-ab07-7080da1ecf9d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:43.664599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25ce388d-9341-46ce-ab07-7080da1ecf9d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:43.665046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25ce388d-9341-46ce-ab07-7080da1ecf9d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.104911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-25ce388d-9341-46ce-ab07-7080da1ecf9d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.122381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-25ce388d-9341-46ce-ab07-7080da1ecf9d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.125398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-25ce388d-9341-46ce-ab07-7080da1ecf9d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.138827 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-25ce388d-9341-46ce-ab07-7080da1ecf9d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.506839 Jul 20 04:13:44.141312 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 853/1679] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:43 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:44.156107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ad46b47f-1497-4945-af82-bd16a2970b61 req-7c9d8181-6d72-4bbf-b687-2c5254ff7a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe65a9e-ad47-4844-a1d1-b673bca616c5", "name": "network-vif-deleted", "tag": "e8758fe3-5fc7-4de5-b21a-4f8e7a450410"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:44.173978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ad46b47f-1497-4945-af82-bd16a2970b61 req-7c9d8181-6d72-4bbf-b687-2c5254ff7a4c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.174473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ad46b47f-1497-4945-af82-bd16a2970b61 req-7c9d8181-6d72-4bbf-b687-2c5254ff7a4c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.192548 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ad46b47f-1497-4945-af82-bd16a2970b61 req-7c9d8181-6d72-4bbf-b687-2c5254ff7a4c service nova] Creating event network-vif-deleted:e8758fe3-5fc7-4de5-b21a-4f8e7a450410 for instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 on n-h1-760456-11 Jul 20 04:13:44.199039 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ad46b47f-1497-4945-af82-bd16a2970b61 req-7c9d8181-6d72-4bbf-b687-2c5254ff7a4c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054559 Jul 20 04:13:44.202225 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 854/1680] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:44.209748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-0ddf85f8-379b-48ac-b7e1-083e78e01703 req-ec3726fe-5214-4ce4-aef7-88bd16fdadfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "tag": "de42dbfb-8539-4cfd-926d-fee4979c1aba"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:44.220479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0ddf85f8-379b-48ac-b7e1-083e78e01703 req-ec3726fe-5214-4ce4-aef7-88bd16fdadfe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.221667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0ddf85f8-379b-48ac-b7e1-083e78e01703 req-ec3726fe-5214-4ce4-aef7-88bd16fdadfe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.238868 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-0ddf85f8-379b-48ac-b7e1-083e78e01703 req-ec3726fe-5214-4ce4-aef7-88bd16fdadfe service nova] Creating event network-changed:de42dbfb-8539-4cfd-926d-fee4979c1aba for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:13:44.246421 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-0ddf85f8-379b-48ac-b7e1-083e78e01703 req-ec3726fe-5214-4ce4-aef7-88bd16fdadfe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042275 Jul 20 04:13:44.247566 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 855/1681] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:44.258945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0ce14da2-fa8b-4167-83f1-e2b13d89a361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.260260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0ce14da2-fa8b-4167-83f1-e2b13d89a361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.270634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ce14da2-fa8b-4167-83f1-e2b13d89a361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.271605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ce14da2-fa8b-4167-83f1-e2b13d89a361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.272711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ce14da2-fa8b-4167-83f1-e2b13d89a361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.273540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ce14da2-fa8b-4167-83f1-e2b13d89a361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.281433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:44.369245 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-26cf7cd5-d9f6-4a9e-b89b-139e248d6752 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/9f86ad41-1449-4129-b473-984867d6a96f" status: 202 len: 0 microversion: 2.1 time: 0.864584 Jul 20 04:13:44.372356 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 827/1682] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:43 2022] DELETE /compute/v2.1/os-security-groups/9f86ad41-1449-4129-b473-984867d6a96f => generated 0 bytes in 868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:44.379850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-af4d34ea-dd35-4bce-8503-82c81f3c42fe tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.381065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-af4d34ea-dd35-4bce-8503-82c81f3c42fe tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.393577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af4d34ea-dd35-4bce-8503-82c81f3c42fe tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.395687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af4d34ea-dd35-4bce-8503-82c81f3c42fe tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.398844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af4d34ea-dd35-4bce-8503-82c81f3c42fe tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.399552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af4d34ea-dd35-4bce-8503-82c81f3c42fe tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.593543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0ce14da2-fa8b-4167-83f1-e2b13d89a361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.609867 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0ce14da2-fa8b-4167-83f1-e2b13d89a361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1308 microversion: 2.1 time: 0.360857 Jul 20 04:13:44.610513 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 856/1683] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:44.628066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c26c529d-9175-4169-8306-dffba2d1dda5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.628745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c26c529d-9175-4169-8306-dffba2d1dda5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.637281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c26c529d-9175-4169-8306-dffba2d1dda5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.638989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c26c529d-9175-4169-8306-dffba2d1dda5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.640342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c26c529d-9175-4169-8306-dffba2d1dda5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.640769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c26c529d-9175-4169-8306-dffba2d1dda5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.933107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-af4d34ea-dd35-4bce-8503-82c81f3c42fe tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:44.941977 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-af4d34ea-dd35-4bce-8503-82c81f3c42fe tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1467 microversion: 2.1 time: 0.568265 Jul 20 04:13:44.952506 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 828/1684] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1467 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:44.960507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7151e4a1-acad-4eb5-a2f6-8fa3d4909617 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:44.962498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7151e4a1-acad-4eb5-a2f6-8fa3d4909617 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:44.972878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7151e4a1-acad-4eb5-a2f6-8fa3d4909617 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.974684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7151e4a1-acad-4eb5-a2f6-8fa3d4909617 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:44.975748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7151e4a1-acad-4eb5-a2f6-8fa3d4909617 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:44.976419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7151e4a1-acad-4eb5-a2f6-8fa3d4909617 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.150611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:45.224349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:45.425182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7151e4a1-acad-4eb5-a2f6-8fa3d4909617 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:45.437773 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7151e4a1-acad-4eb5-a2f6-8fa3d4909617 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.483736 Jul 20 04:13:45.438725 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 829/1685] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:45.443507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5b0fc59c-38c3-4dd3-8029-493b158f312e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb8427204c0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:45.650615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c26c529d-9175-4169-8306-dffba2d1dda5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:45.673346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c26c529d-9175-4169-8306-dffba2d1dda5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:45.675592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c26c529d-9175-4169-8306-dffba2d1dda5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:45.678889 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c26c529d-9175-4169-8306-dffba2d1dda5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1568 microversion: 2.25 time: 1.054755 Jul 20 04:13:45.682946 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 857/1686] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:44 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1568 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:45.690302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-704bef92-e123-4b0e-add2-99b259aa55fa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:45.691119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-704bef92-e123-4b0e-add2-99b259aa55fa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:45.699381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-704bef92-e123-4b0e-add2-99b259aa55fa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.700719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-704bef92-e123-4b0e-add2-99b259aa55fa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.704209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-704bef92-e123-4b0e-add2-99b259aa55fa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.705106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-704bef92-e123-4b0e-add2-99b259aa55fa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.873970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:45.903277 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5b0fc59c-38c3-4dd3-8029-493b158f312e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/5d45c3d1-2c75-4360-8850-5726e6c358f6" status: 202 len: 0 microversion: 2.1 time: 0.463294 Jul 20 04:13:45.903868 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 830/1687] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:45 2022] DELETE /compute/v2.1/os-security-groups/5d45c3d1-2c75-4360-8850-5726e6c358f6 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:45.911061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ebaef549-0c1e-40b2-a0cb-ea62f96e0903 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:45.911912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ebaef549-0c1e-40b2-a0cb-ea62f96e0903 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:45.942613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ebaef549-0c1e-40b2-a0cb-ea62f96e0903 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.943630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ebaef549-0c1e-40b2-a0cb-ea62f96e0903 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:45.944439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ebaef549-0c1e-40b2-a0cb-ea62f96e0903 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:45.944889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ebaef549-0c1e-40b2-a0cb-ea62f96e0903 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.217449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ebaef549-0c1e-40b2-a0cb-ea62f96e0903 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:46.230960 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ebaef549-0c1e-40b2-a0cb-ea62f96e0903 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1308 microversion: 2.1 time: 0.321600 Jul 20 04:13:46.231780 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 831/1688] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:45 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:46.247285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a82c3574-13bb-4349-bb8c-cc39ff67ec06 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'create', calling method: .version_select at 0x7fb841e573a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-351265070", "description": "tempest-description-148068686"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:46.463306 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a82c3574-13bb-4349-bb8c-cc39ff67ec06 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.221101 Jul 20 04:13:46.464920 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 832/1689] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:13:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:46.472342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-482d4858-da33-44c2-9900-fc181920afcc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.473244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-482d4858-da33-44c2-9900-fc181920afcc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:46.488490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-482d4858-da33-44c2-9900-fc181920afcc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.489215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-482d4858-da33-44c2-9900-fc181920afcc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.490188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-482d4858-da33-44c2-9900-fc181920afcc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.490837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-482d4858-da33-44c2-9900-fc181920afcc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.625990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-704bef92-e123-4b0e-add2-99b259aa55fa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:46.642417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-704bef92-e123-4b0e-add2-99b259aa55fa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:46.643980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-704bef92-e123-4b0e-add2-99b259aa55fa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:46.645185 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-704bef92-e123-4b0e-add2-99b259aa55fa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.961042 Jul 20 04:13:46.656513 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 858/1690] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:45 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:46.660932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-482d4858-da33-44c2-9900-fc181920afcc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:46.669642 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-482d4858-da33-44c2-9900-fc181920afcc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1467 microversion: 2.1 time: 0.203333 Jul 20 04:13:46.679568 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 833/1691] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1467 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:46.679568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-bcabefeb-0969-4364-b7d0-2225acae76fe req-c904503f-c667-4240-831e-e59cd3043d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5", "tag": "39f3f991-04fb-49d8-9fbf-c0e81da60206"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:46.684715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bcabefeb-0969-4364-b7d0-2225acae76fe req-c904503f-c667-4240-831e-e59cd3043d51 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.685167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bcabefeb-0969-4364-b7d0-2225acae76fe req-c904503f-c667-4240-831e-e59cd3043d51 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.705385 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-bcabefeb-0969-4364-b7d0-2225acae76fe req-c904503f-c667-4240-831e-e59cd3043d51 service nova] Creating event network-changed:39f3f991-04fb-49d8-9fbf-c0e81da60206 for instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 on n-h2-760456-11 Jul 20 04:13:46.721177 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-bcabefeb-0969-4364-b7d0-2225acae76fe req-c904503f-c667-4240-831e-e59cd3043d51 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047640 Jul 20 04:13:46.726332 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 834/1692] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:46.731991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf9be3a6-9b88-4293-853a-8673398fec4a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:46.733272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cf9be3a6-9b88-4293-853a-8673398fec4a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:46.735799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1425189132", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "7cdfae11-e5cf-43d7-978c-c002ade87b5e"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:46.739983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf9be3a6-9b88-4293-853a-8673398fec4a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.740484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf9be3a6-9b88-4293-853a-8673398fec4a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.741440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf9be3a6-9b88-4293-853a-8673398fec4a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:46.741877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf9be3a6-9b88-4293-853a-8673398fec4a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:46.822618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] validate_networks() for [('7cdfae11-e5cf-43d7-978c-c002ade87b5e', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:13:46.875971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:47.024992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cf9be3a6-9b88-4293-853a-8673398fec4a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:47.033968 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf9be3a6-9b88-4293-853a-8673398fec4a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.306348 Jul 20 04:13:47.034583 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 835/1693] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:46 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:47.044930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-301302b8-fad5-489b-9089-ad4d757679ee tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Action: 'update', calling method: .version_select at 0x7fb841e37f70>, body: {"security_group": {"name": "tempest-sg-hth-240452694", "description": "tempest-description-hth-1838994527"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:47.706380 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-301302b8-fad5-489b-9089-ad4d757679ee tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "PUT /compute/v2.1/os-security-groups/14fba13d-1112-45ca-a105-5466484c6982" status: 200 len: 217 microversion: 2.1 time: 0.665879 Jul 20 04:13:47.707051 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 836/1694] 10.222.0.59 () {60 vars in 1289 bytes} [Wed Jul 20 04:13:47 2022] PUT /compute/v2.1/os-security-groups/14fba13d-1112-45ca-a105-5466484c6982 => generated 217 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:47.712891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b03b8a65-133a-409a-81e5-b7a1dd09ac26 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:47.712891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b03b8a65-133a-409a-81e5-b7a1dd09ac26 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:47.725309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b03b8a65-133a-409a-81e5-b7a1dd09ac26 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.725766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b03b8a65-133a-409a-81e5-b7a1dd09ac26 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.726594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b03b8a65-133a-409a-81e5-b7a1dd09ac26 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.727045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b03b8a65-133a-409a-81e5-b7a1dd09ac26 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.978542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b03b8a65-133a-409a-81e5-b7a1dd09ac26 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:47.987742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b03b8a65-133a-409a-81e5-b7a1dd09ac26 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:47.989348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b03b8a65-133a-409a-81e5-b7a1dd09ac26 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:48.010828 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b03b8a65-133a-409a-81e5-b7a1dd09ac26 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1568 microversion: 2.25 time: 0.282483 Jul 20 04:13:48.011790 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 837/1695] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:47 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:48.018142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-737ebccd-b347-4005-a99b-7ee3a5fb56fe tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.018727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-737ebccd-b347-4005-a99b-7ee3a5fb56fe tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:48.037016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-737ebccd-b347-4005-a99b-7ee3a5fb56fe tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.037480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-737ebccd-b347-4005-a99b-7ee3a5fb56fe tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.038288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-737ebccd-b347-4005-a99b-7ee3a5fb56fe tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.038743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-737ebccd-b347-4005-a99b-7ee3a5fb56fe tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.236597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-737ebccd-b347-4005-a99b-7ee3a5fb56fe tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:48.245863 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-737ebccd-b347-4005-a99b-7ee3a5fb56fe tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1308 microversion: 2.1 time: 0.232648 Jul 20 04:13:48.258494 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 838/1696] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:48.264422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4788f6c3-61c2-4e2f-b348-de5423c40c10 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.265061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4788f6c3-61c2-4e2f-b348-de5423c40c10 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:48.271610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4788f6c3-61c2-4e2f-b348-de5423c40c10 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.272157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4788f6c3-61c2-4e2f-b348-de5423c40c10 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.273066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4788f6c3-61c2-4e2f-b348-de5423c40c10 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.273584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4788f6c3-61c2-4e2f-b348-de5423c40c10 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.289535 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-4788f6c3-61c2-4e2f-b348-de5423c40c10 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] HTTP exception thrown: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4788f6c3-61c2-4e2f-b348-de5423c40c10 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Request method failure captured: Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac HTTP/1.1 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14AuXboPxnrvfbzEFw32g2NKgUX1UqfKtfH4aAOiBejLjemvpTGqghr7vSmG2C_fpYkocFHBSTF-_WKcRVYUOaqoGU4P-CeOtIJixtST9qkd6Mx02SF41FblNGjQ9QPKhbIheCoscGnX_6fDtKPQArmfKziKXzLxTLU0TeS2c-kiC18 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4ad9f7ab7fcb4d76a2a6cccc260b7704 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-433503692 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-433503692 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4ad9f7ab7fcb4d76a2a6cccc260b7704 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-433503692 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachSCSIVolumeTestJSON-433503692-project Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aff983224243430c83b9054014715548 Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-433503692-project Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '0079fbd3-9f24-447a-8331-0823b53255ac'} Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:48.291374 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4788f6c3-61c2-4e2f-b348-de5423c40c10 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Returning 404 to user: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4788f6c3-61c2-4e2f-b348-de5423c40c10 tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 404 len: 111 microversion: 2.1 time: 0.033125 Jul 20 04:13:48.296541 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 839/1697] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:48 2022] DELETE /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:48.306045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1e565f4c-0fd2-47fc-b8b7-b5692383337a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.308134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1e565f4c-0fd2-47fc-b8b7-b5692383337a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:48.318632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e565f4c-0fd2-47fc-b8b7-b5692383337a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.319210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e565f4c-0fd2-47fc-b8b7-b5692383337a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.320443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e565f4c-0fd2-47fc-b8b7-b5692383337a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.321530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e565f4c-0fd2-47fc-b8b7-b5692383337a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.599775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1e565f4c-0fd2-47fc-b8b7-b5692383337a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:48.615688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1e565f4c-0fd2-47fc-b8b7-b5692383337a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:48.618744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1e565f4c-0fd2-47fc-b8b7-b5692383337a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:48.621732 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1e565f4c-0fd2-47fc-b8b7-b5692383337a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.326901 Jul 20 04:13:48.622116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:13:48.622872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:13:48.623885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:13:48.624407 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 840/1698] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:48.626571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:13:48.627061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:13:48.631863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-cc320d71-cc20-46f2-9538-6a63a974ac7d req-2d35a73e-b91c-4b3f-b502-8abd9b96dbac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9", "name": "network-vif-deleted", "tag": "b4437382-d813-4ba5-b42b-466403da1026"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:48.652412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cc320d71-cc20-46f2-9538-6a63a974ac7d req-2d35a73e-b91c-4b3f-b502-8abd9b96dbac service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.653056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cc320d71-cc20-46f2-9538-6a63a974ac7d req-2d35a73e-b91c-4b3f-b502-8abd9b96dbac service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.669569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.672214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.675059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.676153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.677736 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-cc320d71-cc20-46f2-9538-6a63a974ac7d req-2d35a73e-b91c-4b3f-b502-8abd9b96dbac service nova] Creating event network-vif-deleted:b4437382-d813-4ba5-b42b-466403da1026 for instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 on n-h2-760456-11 Jul 20 04:13:48.692246 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-cc320d71-cc20-46f2-9538-6a63a974ac7d req-2d35a73e-b91c-4b3f-b502-8abd9b96dbac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066414 Jul 20 04:13:48.698655 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 841/1699] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:48.711707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.712426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:48.713195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Getting quotas for project cd9cdf734cb84261a283155e4d8e438a. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:13:48.720728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Getting quotas for user d7c6ee309819422591bc153327821a46 and project cd9cdf734cb84261a283155e4d8e438a. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:13:48.731764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.732718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.735002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.735767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.745846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Going to run 2 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:13:48.749075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 1a4e9b05-2015-4e30-b844-d2396aa46eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:48.800819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.801282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.802736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lazy-loading 'fault' on Instance uuid 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:13:48.813698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=1a4e9b05-2015-4e30-b844-d2396aa46eda,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:13:48.854075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:48.864422 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-193726a1-297e-4cb9-95db-78fe7a2f8a69 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 200 len: 1302 microversion: 2.1 time: 0.164293 Jul 20 04:13:48.865622 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 842/1700] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:48.872693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b47fcdab-d50a-40f0-b921-1470c0b77ae1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841ec2af0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.905989 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ebdf494-d10b-4a1f-b808-dca32bfab100 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.248206 Jul 20 04:13:48.911688 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 859/1701] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:13:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:13:48.916943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-505ce44e-a31d-4368-aa86-e7aad693968c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.917823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-505ce44e-a31d-4368-aa86-e7aad693968c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:48.935970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-505ce44e-a31d-4368-aa86-e7aad693968c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.937333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-505ce44e-a31d-4368-aa86-e7aad693968c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.938163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-505ce44e-a31d-4368-aa86-e7aad693968c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.938635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-505ce44e-a31d-4368-aa86-e7aad693968c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.939253 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b47fcdab-d50a-40f0-b921-1470c0b77ae1 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/14fba13d-1112-45ca-a105-5466484c6982" status: 200 len: 217 microversion: 2.1 time: 0.072332 Jul 20 04:13:48.939850 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 843/1702] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/os-security-groups/14fba13d-1112-45ca-a105-5466484c6982 => generated 217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:48.955846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1545e681-c290-441e-a339-a84a483b815d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:48.956481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1545e681-c290-441e-a339-a84a483b815d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] [instance: 0079fbd3-9f24-447a-8331-0823b53255ac] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:48.976495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1545e681-c290-441e-a339-a84a483b815d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.976953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1545e681-c290-441e-a339-a84a483b815d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:48.977761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1545e681-c290-441e-a339-a84a483b815d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:48.992692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1545e681-c290-441e-a339-a84a483b815d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.041601 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-1545e681-c290-441e-a339-a84a483b815d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] HTTP exception thrown: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1545e681-c290-441e-a339-a84a483b815d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Request method failure captured: Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac HTTP/1.1 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14AuXboPxnrvfbzEFw32g2NKgUX1UqfKtfH4aAOiBejLjemvpTGqghr7vSmG2C_fpYkocFHBSTF-_WKcRVYUOaqoGU4P-CeOtIJixtST9qkd6Mx02SF41FblNGjQ9QPKhbIheCoscGnX_6fDtKPQArmfKziKXzLxTLU0TeS2c-kiC18 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4ad9f7ab7fcb4d76a2a6cccc260b7704 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-433503692 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4ad9f7ab7fcb4d76a2a6cccc260b7704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-433503692 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4ad9f7ab7fcb4d76a2a6cccc260b7704 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-433503692 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachSCSIVolumeTestJSON-433503692-project Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aff983224243430c83b9054014715548 Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-433503692-project Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '0079fbd3-9f24-447a-8331-0823b53255ac'} Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:49.048591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:49.054692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:49.054692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:49.054692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:49.054692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:49.054692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:49.054692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. Jul 20 04:13:49.054692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:49.057585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1545e681-c290-441e-a339-a84a483b815d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] Returning 404 to user: Instance 0079fbd3-9f24-447a-8331-0823b53255ac could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:49.059730 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1545e681-c290-441e-a339-a84a483b815d tempest-AttachSCSIVolumeTestJSON-433503692 tempest-AttachSCSIVolumeTestJSON-433503692-project] 10.222.0.59 "GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac" status: 404 len: 111 microversion: 2.1 time: 0.118714 Jul 20 04:13:49.067350 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 844/1703] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/servers/0079fbd3-9f24-447a-8331-0823b53255ac => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:49.074816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d82ad6a4-3017-41a7-9535-92ddd182221c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.080369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d82ad6a4-3017-41a7-9535-92ddd182221c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:49.087387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d82ad6a4-3017-41a7-9535-92ddd182221c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Searching by: {'deleted': False, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:13:49.107553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d82ad6a4-3017-41a7-9535-92ddd182221c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.108756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d82ad6a4-3017-41a7-9535-92ddd182221c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.109823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d82ad6a4-3017-41a7-9535-92ddd182221c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.110363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d82ad6a4-3017-41a7-9535-92ddd182221c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.156902 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d82ad6a4-3017-41a7-9535-92ddd182221c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.087646 Jul 20 04:13:49.164734 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 845/1704] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/servers => generated 677 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:49.174106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-242e4a9a-ff28-4298-b64f-6d7db4f455c9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841ebb9d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.935076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-505ce44e-a31d-4368-aa86-e7aad693968c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:49.945241 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-505ce44e-a31d-4368-aa86-e7aad693968c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 1.032085 Jul 20 04:13:49.950311 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 860/1705] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:48 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:49.958150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-54ef43c4-dd1d-4de9-afa9-6e2d32fbb1f5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:49.967571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-54ef43c4-dd1d-4de9-afa9-6e2d32fbb1f5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:49.985363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-54ef43c4-dd1d-4de9-afa9-6e2d32fbb1f5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.986141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-54ef43c4-dd1d-4de9-afa9-6e2d32fbb1f5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:49.987160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-54ef43c4-dd1d-4de9-afa9-6e2d32fbb1f5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:49.989579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-54ef43c4-dd1d-4de9-afa9-6e2d32fbb1f5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.495098 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-242e4a9a-ff28-4298-b64f-6d7db4f455c9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/14fba13d-1112-45ca-a105-5466484c6982" status: 202 len: 0 microversion: 2.1 time: 1.328590 Jul 20 04:13:50.497052 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 846/1706] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:49 2022] DELETE /compute/v2.1/os-security-groups/14fba13d-1112-45ca-a105-5466484c6982 => generated 0 bytes in 1332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:50.507747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bf005ecb-ed0c-49cf-b1ef-0c2e24d70cea tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:50.509397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bf005ecb-ed0c-49cf-b1ef-0c2e24d70cea tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:50.517832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf005ecb-ed0c-49cf-b1ef-0c2e24d70cea tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.518594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf005ecb-ed0c-49cf-b1ef-0c2e24d70cea tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.520461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf005ecb-ed0c-49cf-b1ef-0c2e24d70cea tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.521472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf005ecb-ed0c-49cf-b1ef-0c2e24d70cea tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.632355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-54ef43c4-dd1d-4de9-afa9-6e2d32fbb1f5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:50.641321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-54ef43c4-dd1d-4de9-afa9-6e2d32fbb1f5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:50.644092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-54ef43c4-dd1d-4de9-afa9-6e2d32fbb1f5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:50.646297 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-54ef43c4-dd1d-4de9-afa9-6e2d32fbb1f5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1568 microversion: 2.25 time: 0.694922 Jul 20 04:13:50.647206 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 861/1707] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:49 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1568 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:50.648552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bf005ecb-ed0c-49cf-b1ef-0c2e24d70cea tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:50.652786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a554d893-4886-41f9-b039-f7ba726e69f9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:50.653711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a554d893-4886-41f9-b039-f7ba726e69f9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:50.661925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a554d893-4886-41f9-b039-f7ba726e69f9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.662766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a554d893-4886-41f9-b039-f7ba726e69f9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.663764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a554d893-4886-41f9-b039-f7ba726e69f9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.664375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a554d893-4886-41f9-b039-f7ba726e69f9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.667181 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bf005ecb-ed0c-49cf-b1ef-0c2e24d70cea tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1272 microversion: 2.1 time: 0.164695 Jul 20 04:13:50.668556 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 847/1708] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:50 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:50.675754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ca54bc3-bf17-4f7a-98f6-27e186d8918f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:50.676591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ca54bc3-bf17-4f7a-98f6-27e186d8918f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:50.706169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ca54bc3-bf17-4f7a-98f6-27e186d8918f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.708707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ca54bc3-bf17-4f7a-98f6-27e186d8918f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:50.709767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ca54bc3-bf17-4f7a-98f6-27e186d8918f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:50.711175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ca54bc3-bf17-4f7a-98f6-27e186d8918f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.163014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ca54bc3-bf17-4f7a-98f6-27e186d8918f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:51.174242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ca54bc3-bf17-4f7a-98f6-27e186d8918f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:51.175934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ca54bc3-bf17-4f7a-98f6-27e186d8918f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:51.177511 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ca54bc3-bf17-4f7a-98f6-27e186d8918f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.505719 Jul 20 04:13:51.190326 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 848/1709] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:50 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:51.195777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c5e037a-75ea-46bf-8d85-5baf4b39147b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.196590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c5e037a-75ea-46bf-8d85-5baf4b39147b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.203688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c5e037a-75ea-46bf-8d85-5baf4b39147b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.204370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c5e037a-75ea-46bf-8d85-5baf4b39147b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.205146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c5e037a-75ea-46bf-8d85-5baf4b39147b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.205766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c5e037a-75ea-46bf-8d85-5baf4b39147b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.221454 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-6c5e037a-75ea-46bf-8d85-5baf4b39147b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] HTTP exception thrown: Instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 could not be found. Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c5e037a-75ea-46bf-8d85-5baf4b39147b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Request method failure captured: Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 HTTP/1.1 Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13-mOWaIOUL3u2C-CodKHgZaTMvXl6Ngh7isuUOfYdm3YCFUeOhSu-PnFEuAiMdymIBhufnukV_MG4sIXf2DPrbvnfMKdQ3WQYvcZXOBjKjyvv9hdypIlJnJjUBzqgtUOzVbCjV8GSM5541XNcxknmnwBv8xZFPNZC12Gak2oLolVGQ Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 443f09d183854727bdf9fe467f2ac8fd Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-MigrationsAdminTest-1284690242 Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-MigrationsAdminTest-1284690242 Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 443f09d183854727bdf9fe467f2ac8fd Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-MigrationsAdminTest-1284690242 Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-MigrationsAdminTest-1284690242-project Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e82ac4df5f844ec4996d939efdba9c11 Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-MigrationsAdminTest-1284690242-project Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 could not be found. Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9'} Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 could not be found. Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 could not be found. Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:51.223819 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.228847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:51.228847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:51.228847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:51.228847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:51.228847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:51.228847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 could not be found. Jul 20 04:13:51.228847 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.228847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c5e037a-75ea-46bf-8d85-5baf4b39147b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Returning 404 to user: Instance 6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:51.229456 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6c5e037a-75ea-46bf-8d85-5baf4b39147b tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9" status: 404 len: 111 microversion: 2.1 time: 0.037357 Jul 20 04:13:51.234965 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 849/1710] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/6937cc1a-1a6f-400c-b2f4-b4a95ad3b0c9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:51.242026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a04cfab9-f25f-4c6d-929a-498cfdcc45f5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.242639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a04cfab9-f25f-4c6d-929a-498cfdcc45f5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.248102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:51.253256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a04cfab9-f25f-4c6d-929a-498cfdcc45f5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.253511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a554d893-4886-41f9-b039-f7ba726e69f9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:51.257438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a04cfab9-f25f-4c6d-929a-498cfdcc45f5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.258227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a04cfab9-f25f-4c6d-929a-498cfdcc45f5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.258711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a04cfab9-f25f-4c6d-929a-498cfdcc45f5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.274136 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a554d893-4886-41f9-b039-f7ba726e69f9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1308 microversion: 2.1 time: 0.621357 Jul 20 04:13:51.276020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 862/1711] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:50 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1308 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:51.279058 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a04cfab9-f25f-4c6d-929a-498cfdcc45f5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a04cfab9-f25f-4c6d-929a-498cfdcc45f5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 HTTP/1.1 Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'b26b3126-e80d-4687-a609-36e6cca0b861'} Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:51.280685 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a04cfab9-f25f-4c6d-929a-498cfdcc45f5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a04cfab9-f25f-4c6d-929a-498cfdcc45f5 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 404 len: 111 microversion: 2.1 time: 0.048077 Jul 20 04:13:51.285420 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 850/1712] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:51 2022] DELETE /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:51.288300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a68b7222-42a4-45e7-8d8a-f5adcb190b09 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.288748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a68b7222-42a4-45e7-8d8a-f5adcb190b09 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.294808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-32ec685b-9b7f-4fba-a154-1fbf08413938 req-a1d2b96b-5105-40f9-9cce-7519d90b843d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfd0a05-0361-4623-b862-7e525c0eeb91", "name": "network-vif-unplugged", "status": "completed", "tag": "24377567-d41e-41ac-b4a3-0d0f3a117215"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:51.303218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a68b7222-42a4-45e7-8d8a-f5adcb190b09 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.303731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a68b7222-42a4-45e7-8d8a-f5adcb190b09 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.304586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a68b7222-42a4-45e7-8d8a-f5adcb190b09 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.305229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a68b7222-42a4-45e7-8d8a-f5adcb190b09 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.311555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-32ec685b-9b7f-4fba-a154-1fbf08413938 req-a1d2b96b-5105-40f9-9cce-7519d90b843d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.314342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-32ec685b-9b7f-4fba-a154-1fbf08413938 req-a1d2b96b-5105-40f9-9cce-7519d90b843d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.332768 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-32ec685b-9b7f-4fba-a154-1fbf08413938 req-a1d2b96b-5105-40f9-9cce-7519d90b843d service nova] Creating event network-vif-unplugged:24377567-d41e-41ac-b4a3-0d0f3a117215 for instance dbfd0a05-0361-4623-b862-7e525c0eeb91 on n-h2-760456-11 Jul 20 04:13:51.351827 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-32ec685b-9b7f-4fba-a154-1fbf08413938 req-a1d2b96b-5105-40f9-9cce-7519d90b843d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073257 Jul 20 04:13:51.353136 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 863/1713] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:51.368649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c7aef65d-14e7-4197-b636-e85ca7998ad3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.369710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c7aef65d-14e7-4197-b636-e85ca7998ad3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.386178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7aef65d-14e7-4197-b636-e85ca7998ad3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.386707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7aef65d-14e7-4197-b636-e85ca7998ad3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.387549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7aef65d-14e7-4197-b636-e85ca7998ad3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.388438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7aef65d-14e7-4197-b636-e85ca7998ad3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.425263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c7aef65d-14e7-4197-b636-e85ca7998ad3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:51.609917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a68b7222-42a4-45e7-8d8a-f5adcb190b09 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:51.622998 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a68b7222-42a4-45e7-8d8a-f5adcb190b09 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.338825 Jul 20 04:13:51.627141 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 851/1714] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:51.633263 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c7aef65d-14e7-4197-b636-e85ca7998ad3 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 204 len: 0 microversion: 2.1 time: 0.278420 Jul 20 04:13:51.636898 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 864/1715] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:51 2022] DELETE /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:51.645227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b937d0ca-da41-426d-82fa-5d37716ed791 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.645956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b937d0ca-da41-426d-82fa-5d37716ed791 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.646157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6dc59cd2-a455-4f26-818f-e7b5e9e47070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.646944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6dc59cd2-a455-4f26-818f-e7b5e9e47070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: b26b3126-e80d-4687-a609-36e6cca0b861] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.662649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b937d0ca-da41-426d-82fa-5d37716ed791 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.663117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b937d0ca-da41-426d-82fa-5d37716ed791 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.663999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b937d0ca-da41-426d-82fa-5d37716ed791 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.664675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b937d0ca-da41-426d-82fa-5d37716ed791 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.668751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc59cd2-a455-4f26-818f-e7b5e9e47070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.669347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc59cd2-a455-4f26-818f-e7b5e9e47070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.672068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc59cd2-a455-4f26-818f-e7b5e9e47070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.672699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc59cd2-a455-4f26-818f-e7b5e9e47070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.681724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:51.710081 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-6dc59cd2-a455-4f26-818f-e7b5e9e47070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6dc59cd2-a455-4f26-818f-e7b5e9e47070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 HTTP/1.1 Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'b26b3126-e80d-4687-a609-36e6cca0b861'} Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:51.714789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.721958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:51.721958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:51.721958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:51.721958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:51.721958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:51.721958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. Jul 20 04:13:51.721958 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:51.721958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6dc59cd2-a455-4f26-818f-e7b5e9e47070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Instance b26b3126-e80d-4687-a609-36e6cca0b861 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:51.721958 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6dc59cd2-a455-4f26-818f-e7b5e9e47070 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861" status: 404 len: 111 microversion: 2.1 time: 0.088025 Jul 20 04:13:51.721958 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 852/1716] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/b26b3126-e80d-4687-a609-36e6cca0b861 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:51.738566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d5afd35b-e8a7-4532-b810-12375426be27 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:51.739194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d5afd35b-e8a7-4532-b810-12375426be27 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:51.746930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5afd35b-e8a7-4532-b810-12375426be27 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.747599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5afd35b-e8a7-4532-b810-12375426be27 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:51.748469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5afd35b-e8a7-4532-b810-12375426be27 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:51.748926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5afd35b-e8a7-4532-b810-12375426be27 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.047584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b937d0ca-da41-426d-82fa-5d37716ed791 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.054896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d5afd35b-e8a7-4532-b810-12375426be27 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.059730 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b937d0ca-da41-426d-82fa-5d37716ed791 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1533 microversion: 2.1 time: 0.420401 Jul 20 04:13:52.063359 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 865/1717] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1533 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:52.072963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd85dbe0-ea5e-4358-b2d1-32b3f1ca7e57 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.075782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d5afd35b-e8a7-4532-b810-12375426be27 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.077292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd85dbe0-ea5e-4358-b2d1-32b3f1ca7e57 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.081147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d5afd35b-e8a7-4532-b810-12375426be27 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.088030 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d5afd35b-e8a7-4532-b810-12375426be27 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1568 microversion: 2.25 time: 0.363127 Jul 20 04:13:52.090325 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 853/1718] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:51 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1568 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:52.102900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd85dbe0-ea5e-4358-b2d1-32b3f1ca7e57 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.102900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd85dbe0-ea5e-4358-b2d1-32b3f1ca7e57 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.102900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd85dbe0-ea5e-4358-b2d1-32b3f1ca7e57 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.102900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd85dbe0-ea5e-4358-b2d1-32b3f1ca7e57 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.103795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b9aad35-a519-4c28-8aa3-d9350490ef92 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841e5b1f0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.181724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG neutronclient.v2_0.client [None req-8b9aad35-a519-4c28-8aa3-d9350490ef92 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5d45c3d1-2c75-4360-8850-5726e6c358f6 does not exist", "detail": ""}} {{(pid=119605) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:13:52.182511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.security_group_api [None req-8b9aad35-a519-4c28-8aa3-d9350490ef92 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Neutron security group 5d45c3d1-2c75-4360-8850-5726e6c358f6 not found {{(pid=119605) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:13:52.183165 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8b9aad35-a519-4c28-8aa3-d9350490ef92 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security group 5d45c3d1-2c75-4360-8850-5726e6c358f6 does not exist Jul 20 04:13:52.183165 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-d0e7725a-0412-48d5-bbad-9bd448ce6f3e'] Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b9aad35-a519-4c28-8aa3-d9350490ef92 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-security-groups/5d45c3d1-2c75-4360-8850-5726e6c358f6 HTTP/1.1 Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: exception: Security group 5d45c3d1-2c75-4360-8850-5726e6c358f6 does not exist Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-d0e7725a-0412-48d5-bbad-9bd448ce6f3e'] Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '5d45c3d1-2c75-4360-8850-5726e6c358f6'} Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:13:52.185235 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5d45c3d1-2c75-4360-8850-5726e6c358f6 does not exist Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0e7725a-0412-48d5-bbad-9bd448ce6f3e'] Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5d45c3d1-2c75-4360-8850-5726e6c358f6 does not exist Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0e7725a-0412-48d5-bbad-9bd448ce6f3e'] Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5d45c3d1-2c75-4360-8850-5726e6c358f6 does not exist Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0e7725a-0412-48d5-bbad-9bd448ce6f3e'] Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5d45c3d1-2c75-4360-8850-5726e6c358f6 does not exist Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0e7725a-0412-48d5-bbad-9bd448ce6f3e'] Jul 20 04:13:52.190421 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.204265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b9aad35-a519-4c28-8aa3-d9350490ef92 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Security group 5d45c3d1-2c75-4360-8850-5726e6c358f6 does not exist Jul 20 04:13:52.204265 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-d0e7725a-0412-48d5-bbad-9bd448ce6f3e'] {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:52.204265 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8b9aad35-a519-4c28-8aa3-d9350490ef92 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/5d45c3d1-2c75-4360-8850-5726e6c358f6" status: 404 len: 194 microversion: 2.1 time: 0.105132 Jul 20 04:13:52.206119 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 854/1719] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:52 2022] DELETE /compute/v2.1/os-security-groups/5d45c3d1-2c75-4360-8850-5726e6c358f6 => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:52.213520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-be6e1ade-ffee-4e1e-953f-a2551f10ef35 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.214543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-be6e1ade-ffee-4e1e-953f-a2551f10ef35 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.232622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be6e1ade-ffee-4e1e-953f-a2551f10ef35 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.234813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be6e1ade-ffee-4e1e-953f-a2551f10ef35 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.235876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be6e1ade-ffee-4e1e-953f-a2551f10ef35 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.236657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be6e1ade-ffee-4e1e-953f-a2551f10ef35 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.262883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cd85dbe0-ea5e-4358-b2d1-32b3f1ca7e57 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.289851 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd85dbe0-ea5e-4358-b2d1-32b3f1ca7e57 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1278 microversion: 2.1 time: 0.209450 Jul 20 04:13:52.296167 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 866/1720] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:52.313507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d47af6c-944b-4a0a-a0b8-190b57fbd3b7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841b19040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.532273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-5d47af6c-944b-4a0a-a0b8-190b57fbd3b7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f86ad41-1449-4129-b473-984867d6a96f does not exist", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:13:52.533099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.security_group_api [None req-5d47af6c-944b-4a0a-a0b8-190b57fbd3b7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Neutron security group 9f86ad41-1449-4129-b473-984867d6a96f not found {{(pid=119606) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:13:52.533936 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5d47af6c-944b-4a0a-a0b8-190b57fbd3b7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security group 9f86ad41-1449-4129-b473-984867d6a96f does not exist Jul 20 04:13:52.533936 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-e8968a78-f6d7-41c4-a187-6bd9ef1f1bcd'] Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d47af6c-944b-4a0a-a0b8-190b57fbd3b7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-security-groups/9f86ad41-1449-4129-b473-984867d6a96f HTTP/1.1 Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: exception: Security group 9f86ad41-1449-4129-b473-984867d6a96f does not exist Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-e8968a78-f6d7-41c4-a187-6bd9ef1f1bcd'] Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '9f86ad41-1449-4129-b473-984867d6a96f'} Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:13:52.536206 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f86ad41-1449-4129-b473-984867d6a96f does not exist Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8968a78-f6d7-41c4-a187-6bd9ef1f1bcd'] Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f86ad41-1449-4129-b473-984867d6a96f does not exist Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8968a78-f6d7-41c4-a187-6bd9ef1f1bcd'] Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f86ad41-1449-4129-b473-984867d6a96f does not exist Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8968a78-f6d7-41c4-a187-6bd9ef1f1bcd'] Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f86ad41-1449-4129-b473-984867d6a96f does not exist Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8968a78-f6d7-41c4-a187-6bd9ef1f1bcd'] Jul 20 04:13:52.541266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.546230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d47af6c-944b-4a0a-a0b8-190b57fbd3b7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Security group 9f86ad41-1449-4129-b473-984867d6a96f does not exist Jul 20 04:13:52.546230 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-e8968a78-f6d7-41c4-a187-6bd9ef1f1bcd'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:52.547464 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d47af6c-944b-4a0a-a0b8-190b57fbd3b7 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/9f86ad41-1449-4129-b473-984867d6a96f" status: 404 len: 194 microversion: 2.1 time: 0.249058 Jul 20 04:13:52.548573 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 867/1721] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:52 2022] DELETE /compute/v2.1/os-security-groups/9f86ad41-1449-4129-b473-984867d6a96f => generated 194 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:52.556011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dce4d007-d63a-4304-b7e5-d66219774e97 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.557325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dce4d007-d63a-4304-b7e5-d66219774e97 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.567638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dce4d007-d63a-4304-b7e5-d66219774e97 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.568520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dce4d007-d63a-4304-b7e5-d66219774e97 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.569504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dce4d007-d63a-4304-b7e5-d66219774e97 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.570124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dce4d007-d63a-4304-b7e5-d66219774e97 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.820807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dce4d007-d63a-4304-b7e5-d66219774e97 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.831265 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dce4d007-d63a-4304-b7e5-d66219774e97 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1308 microversion: 2.1 time: 0.281375 Jul 20 04:13:52.832597 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 868/1722] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:52.851117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3dfb8e37-f797-4bd6-873c-bead5a5f8e1f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841beca60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.894529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-be6e1ade-ffee-4e1e-953f-a2551f10ef35 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.913187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-be6e1ade-ffee-4e1e-953f-a2551f10ef35 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.914929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-be6e1ade-ffee-4e1e-953f-a2551f10ef35 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:52.917508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-be6e1ade-ffee-4e1e-953f-a2551f10ef35 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.710053 Jul 20 04:13:52.923745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-3dfb8e37-f797-4bd6-873c-bead5a5f8e1f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:13:52.924625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.security_group_api [None req-3dfb8e37-f797-4bd6-873c-bead5a5f8e1f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Neutron security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff not found {{(pid=119606) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:13:52.925315 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3dfb8e37-f797-4bd6-873c-bead5a5f8e1f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:13:52.925315 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-e0807a13-7161-4b4a-a8c5-aca35deec3f1'] Jul 20 04:13:52.926495 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 855/1723] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3dfb8e37-f797-4bd6-873c-bead5a5f8e1f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-security-groups/7c3b92e2-217f-4e31-bfd2-ef7d7b303dff HTTP/1.1 Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: exception: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-e0807a13-7161-4b4a-a8c5-aca35deec3f1'] Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '7c3b92e2-217f-4e31-bfd2-ef7d7b303dff'} Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:13:52.929297 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0807a13-7161-4b4a-a8c5-aca35deec3f1'] Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0807a13-7161-4b4a-a8c5-aca35deec3f1'] Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0807a13-7161-4b4a-a8c5-aca35deec3f1'] Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0807a13-7161-4b4a-a8c5-aca35deec3f1'] Jul 20 04:13:52.933938 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:52.941035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3dfb8e37-f797-4bd6-873c-bead5a5f8e1f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Security group 7c3b92e2-217f-4e31-bfd2-ef7d7b303dff does not exist Jul 20 04:13:52.941035 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-e0807a13-7161-4b4a-a8c5-aca35deec3f1'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:52.941035 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3dfb8e37-f797-4bd6-873c-bead5a5f8e1f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/7c3b92e2-217f-4e31-bfd2-ef7d7b303dff" status: 404 len: 194 microversion: 2.1 time: 0.097052 Jul 20 04:13:52.944212 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 869/1724] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:52 2022] DELETE /compute/v2.1/os-security-groups/7c3b92e2-217f-4e31-bfd2-ef7d7b303dff => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:52.946901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d4c808ee-8c92-44d9-87fd-22fa3b10a399 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:52.947541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d4c808ee-8c92-44d9-87fd-22fa3b10a399 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:52.951418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-83881b48-99f3-4542-bc79-d91de15eb1aa req-6cd1d5be-43ab-4958-9e88-2682f9db9222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5", "name": "network-vif-plugged", "status": "completed", "tag": "39f3f991-04fb-49d8-9fbf-c0e81da60206"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:52.954908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4c808ee-8c92-44d9-87fd-22fa3b10a399 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.956238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4c808ee-8c92-44d9-87fd-22fa3b10a399 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:52.957207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4c808ee-8c92-44d9-87fd-22fa3b10a399 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:52.959073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4c808ee-8c92-44d9-87fd-22fa3b10a399 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.003102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-83881b48-99f3-4542-bc79-d91de15eb1aa req-6cd1d5be-43ab-4958-9e88-2682f9db9222 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.003556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-83881b48-99f3-4542-bc79-d91de15eb1aa req-6cd1d5be-43ab-4958-9e88-2682f9db9222 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.027181 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-83881b48-99f3-4542-bc79-d91de15eb1aa req-6cd1d5be-43ab-4958-9e88-2682f9db9222 service nova] Creating event network-vif-plugged:39f3f991-04fb-49d8-9fbf-c0e81da60206 for instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 on n-h2-760456-11 Jul 20 04:13:53.036106 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-83881b48-99f3-4542-bc79-d91de15eb1aa req-6cd1d5be-43ab-4958-9e88-2682f9db9222 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090398 Jul 20 04:13:53.039707 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 870/1725] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:53.047924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6f772bf9-9200-40a3-b1d5-89b5cd32fdc4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb842bb88b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:53.481114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-6f772bf9-9200-40a3-b1d5-89b5cd32fdc4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:13:53.481855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.security_group_api [None req-6f772bf9-9200-40a3-b1d5-89b5cd32fdc4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Neutron security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef not found {{(pid=119606) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:13:53.482903 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-6f772bf9-9200-40a3-b1d5-89b5cd32fdc4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:13:53.482903 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-9d5e425c-cf0b-4d81-a40f-238e01f5e33e'] Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6f772bf9-9200-40a3-b1d5-89b5cd32fdc4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-security-groups/c94fbc38-b073-4b2b-beda-5d28c50bf3ef HTTP/1.1 Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: exception: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-9d5e425c-cf0b-4d81-a40f-238e01f5e33e'] Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'c94fbc38-b073-4b2b-beda-5d28c50bf3ef'} Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:13:53.485671 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d5e425c-cf0b-4d81-a40f-238e01f5e33e'] Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d5e425c-cf0b-4d81-a40f-238e01f5e33e'] Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d5e425c-cf0b-4d81-a40f-238e01f5e33e'] Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d5e425c-cf0b-4d81-a40f-238e01f5e33e'] Jul 20 04:13:53.489947 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:53.495087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6f772bf9-9200-40a3-b1d5-89b5cd32fdc4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Security group c94fbc38-b073-4b2b-beda-5d28c50bf3ef does not exist Jul 20 04:13:53.495087 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-9d5e425c-cf0b-4d81-a40f-238e01f5e33e'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:53.496312 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6f772bf9-9200-40a3-b1d5-89b5cd32fdc4 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/c94fbc38-b073-4b2b-beda-5d28c50bf3ef" status: 404 len: 194 microversion: 2.1 time: 0.455256 Jul 20 04:13:53.497096 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 871/1726] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:53 2022] DELETE /compute/v2.1/os-security-groups/c94fbc38-b073-4b2b-beda-5d28c50bf3ef => generated 194 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:53.509091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d795b887-24da-4ddf-ae5b-7616c1fcbf09 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:53.510112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d795b887-24da-4ddf-ae5b-7616c1fcbf09 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:53.533278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d795b887-24da-4ddf-ae5b-7616c1fcbf09 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.536766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d795b887-24da-4ddf-ae5b-7616c1fcbf09 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.538167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d795b887-24da-4ddf-ae5b-7616c1fcbf09 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.547111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d795b887-24da-4ddf-ae5b-7616c1fcbf09 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.714411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d4c808ee-8c92-44d9-87fd-22fa3b10a399 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:53.727828 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d4c808ee-8c92-44d9-87fd-22fa3b10a399 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.799450 Jul 20 04:13:53.737735 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 856/1727] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:52 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:53.740582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa3fede1-bb37-4551-b85d-85f6da58e5e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:53.741216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aa3fede1-bb37-4551-b85d-85f6da58e5e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:53.760080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa3fede1-bb37-4551-b85d-85f6da58e5e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.765000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa3fede1-bb37-4551-b85d-85f6da58e5e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:53.766291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa3fede1-bb37-4551-b85d-85f6da58e5e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:53.766940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa3fede1-bb37-4551-b85d-85f6da58e5e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.064085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d795b887-24da-4ddf-ae5b-7616c1fcbf09 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.071747 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d795b887-24da-4ddf-ae5b-7616c1fcbf09 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1533 microversion: 2.1 time: 0.573455 Jul 20 04:13:54.082004 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 872/1728] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:53 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1533 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:54.087883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a2d79ce0-ae9a-4921-a862-2d43911eaca3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:54.088796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a2d79ce0-ae9a-4921-a862-2d43911eaca3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:54.096016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2d79ce0-ae9a-4921-a862-2d43911eaca3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.096757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2d79ce0-ae9a-4921-a862-2d43911eaca3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.097723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2d79ce0-ae9a-4921-a862-2d43911eaca3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.098372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2d79ce0-ae9a-4921-a862-2d43911eaca3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.149056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aa3fede1-bb37-4551-b85d-85f6da58e5e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.167361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aa3fede1-bb37-4551-b85d-85f6da58e5e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.168899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aa3fede1-bb37-4551-b85d-85f6da58e5e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.170129 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aa3fede1-bb37-4551-b85d-85f6da58e5e9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1568 microversion: 2.25 time: 0.439379 Jul 20 04:13:54.170905 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 857/1729] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:53 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1568 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:54.175814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f3e8aae2-48bb-473c-abd4-1f11f58f679e req-9ab97a45-d8bf-44a5-bc1b-b8280e6e5745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a7ceeb-daba-4132-93a5-95c891a45687", "name": "network-vif-unplugged", "status": "completed", "tag": "1ae0744b-76c2-48e9-882c-17cee7beb535"}, {"name": "network-changed", "server_uuid": "dbfd0a05-0361-4623-b862-7e525c0eeb91", "tag": "24377567-d41e-41ac-b4a3-0d0f3a117215"}, {"name": "network-changed", "server_uuid": "b0a7ceeb-daba-4132-93a5-95c891a45687", "tag": "1ae0744b-76c2-48e9-882c-17cee7beb535"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:54.198823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f3e8aae2-48bb-473c-abd4-1f11f58f679e req-9ab97a45-d8bf-44a5-bc1b-b8280e6e5745 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.199519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f3e8aae2-48bb-473c-abd4-1f11f58f679e req-9ab97a45-d8bf-44a5-bc1b-b8280e6e5745 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.216320 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f3e8aae2-48bb-473c-abd4-1f11f58f679e req-9ab97a45-d8bf-44a5-bc1b-b8280e6e5745 service nova] Creating event network-vif-unplugged:1ae0744b-76c2-48e9-882c-17cee7beb535 for instance b0a7ceeb-daba-4132-93a5-95c891a45687 on n-h1-760456-11 Jul 20 04:13:54.221863 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f3e8aae2-48bb-473c-abd4-1f11f58f679e req-9ab97a45-d8bf-44a5-bc1b-b8280e6e5745 service nova] Creating event network-changed:24377567-d41e-41ac-b4a3-0d0f3a117215 for instance dbfd0a05-0361-4623-b862-7e525c0eeb91 on n-h2-760456-11 Jul 20 04:13:54.222675 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f3e8aae2-48bb-473c-abd4-1f11f58f679e req-9ab97a45-d8bf-44a5-bc1b-b8280e6e5745 service nova] Creating event network-changed:1ae0744b-76c2-48e9-882c-17cee7beb535 for instance b0a7ceeb-daba-4132-93a5-95c891a45687 on n-h1-760456-11 Jul 20 04:13:54.231828 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f3e8aae2-48bb-473c-abd4-1f11f58f679e req-9ab97a45-d8bf-44a5-bc1b-b8280e6e5745 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.059507 Jul 20 04:13:54.233148 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 858/1730] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:54.238717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6c8e0bb-ea11-45aa-b17e-6aabd516fb3a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841e61af0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:54.324275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG neutronclient.v2_0.client [None req-a6c8e0bb-ea11-45aa-b17e-6aabd516fb3a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist", "detail": ""}} {{(pid=119605) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:13:54.325222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.security_group_api [None req-a6c8e0bb-ea11-45aa-b17e-6aabd516fb3a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Neutron security group 207e0086-fd51-4f62-85b5-3383d25204cc not found {{(pid=119605) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:13:54.325948 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a6c8e0bb-ea11-45aa-b17e-6aabd516fb3a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:13:54.325948 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-cac36a06-3a97-4a10-b9e1-7406f5ded4cc'] Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6c8e0bb-ea11-45aa-b17e-6aabd516fb3a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-security-groups/207e0086-fd51-4f62-85b5-3383d25204cc HTTP/1.1 Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: exception: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-cac36a06-3a97-4a10-b9e1-7406f5ded4cc'] Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '207e0086-fd51-4f62-85b5-3383d25204cc'} Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:13:54.329676 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac36a06-3a97-4a10-b9e1-7406f5ded4cc'] Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac36a06-3a97-4a10-b9e1-7406f5ded4cc'] Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac36a06-3a97-4a10-b9e1-7406f5ded4cc'] Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac36a06-3a97-4a10-b9e1-7406f5ded4cc'] Jul 20 04:13:54.334341 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:54.339821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6c8e0bb-ea11-45aa-b17e-6aabd516fb3a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Security group 207e0086-fd51-4f62-85b5-3383d25204cc does not exist Jul 20 04:13:54.339821 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-cac36a06-3a97-4a10-b9e1-7406f5ded4cc'] {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:54.340990 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a6c8e0bb-ea11-45aa-b17e-6aabd516fb3a tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/207e0086-fd51-4f62-85b5-3383d25204cc" status: 404 len: 194 microversion: 2.1 time: 0.106535 Jul 20 04:13:54.345711 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 859/1731] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:54 2022] DELETE /compute/v2.1/os-security-groups/207e0086-fd51-4f62-85b5-3383d25204cc => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:54.351976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c31d63e4-9b1f-4441-b8b1-90a20d9cf4a4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:54.353533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c31d63e4-9b1f-4441-b8b1-90a20d9cf4a4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:54.362543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c31d63e4-9b1f-4441-b8b1-90a20d9cf4a4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.363415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c31d63e4-9b1f-4441-b8b1-90a20d9cf4a4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.364485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c31d63e4-9b1f-4441-b8b1-90a20d9cf4a4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.365259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c31d63e4-9b1f-4441-b8b1-90a20d9cf4a4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.554928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a2d79ce0-ae9a-4921-a862-2d43911eaca3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:54.573336 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a2d79ce0-ae9a-4921-a862-2d43911eaca3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1320 microversion: 2.1 time: 0.489785 Jul 20 04:13:54.574689 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 873/1732] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:54 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:54.580691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-03cc09e9-01ef-4d9d-8a74-272ae1c45306 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:54.581670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-03cc09e9-01ef-4d9d-8a74-272ae1c45306 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:54.590223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03cc09e9-01ef-4d9d-8a74-272ae1c45306 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.591097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03cc09e9-01ef-4d9d-8a74-272ae1c45306 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:54.592368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03cc09e9-01ef-4d9d-8a74-272ae1c45306 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:54.593081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03cc09e9-01ef-4d9d-8a74-272ae1c45306 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.239465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c31d63e4-9b1f-4441-b8b1-90a20d9cf4a4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.257930 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c31d63e4-9b1f-4441-b8b1-90a20d9cf4a4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1308 microversion: 2.1 time: 0.910770 Jul 20 04:13:55.265173 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 860/1733] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:54 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1308 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:55.279865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-154539a7-ea66-4250-ba40-de0998cc3326 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841e00670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.372764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG neutronclient.v2_0.client [None req-154539a7-ea66-4250-ba40-de0998cc3326 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist", "detail": ""}} {{(pid=119605) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:13:55.374758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.security_group_api [None req-154539a7-ea66-4250-ba40-de0998cc3326 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Neutron security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec not found {{(pid=119605) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:13:55.375560 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-154539a7-ea66-4250-ba40-de0998cc3326 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:13:55.375560 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-5423b0c6-8c10-4765-b69d-00c0ae505e20'] Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-154539a7-ea66-4250-ba40-de0998cc3326 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-security-groups/70353ef7-b6ed-4c37-ac3d-99ba635d8fec HTTP/1.1 Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: exception: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-5423b0c6-8c10-4765-b69d-00c0ae505e20'] Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '70353ef7-b6ed-4c37-ac3d-99ba635d8fec'} Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:13:55.378460 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5423b0c6-8c10-4765-b69d-00c0ae505e20'] Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5423b0c6-8c10-4765-b69d-00c0ae505e20'] Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5423b0c6-8c10-4765-b69d-00c0ae505e20'] Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5423b0c6-8c10-4765-b69d-00c0ae505e20'] Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-154539a7-ea66-4250-ba40-de0998cc3326 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Security group 70353ef7-b6ed-4c37-ac3d-99ba635d8fec does not exist Jul 20 04:13:55.384110 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-5423b0c6-8c10-4765-b69d-00c0ae505e20'] {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:55.388215 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-154539a7-ea66-4250-ba40-de0998cc3326 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/70353ef7-b6ed-4c37-ac3d-99ba635d8fec" status: 404 len: 194 microversion: 2.1 time: 0.117523 Jul 20 04:13:55.389606 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 861/1734] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:13:55 2022] DELETE /compute/v2.1/os-security-groups/70353ef7-b6ed-4c37-ac3d-99ba635d8fec => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:55.395112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bf6da701-ee71-4a83-91b4-40de72408bd8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.396101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bf6da701-ee71-4a83-91b4-40de72408bd8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.407150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf6da701-ee71-4a83-91b4-40de72408bd8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.407994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf6da701-ee71-4a83-91b4-40de72408bd8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.409054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf6da701-ee71-4a83-91b4-40de72408bd8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.409757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf6da701-ee71-4a83-91b4-40de72408bd8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.470467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-03cc09e9-01ef-4d9d-8a74-272ae1c45306 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.488654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-03cc09e9-01ef-4d9d-8a74-272ae1c45306 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.493074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-03cc09e9-01ef-4d9d-8a74-272ae1c45306 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.494635 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-03cc09e9-01ef-4d9d-8a74-272ae1c45306 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.918656 Jul 20 04:13:55.506189 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 874/1735] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:54 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:55.528514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50ee7a21-747c-4bdc-9509-025bf7348046 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.535364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-50ee7a21-747c-4bdc-9509-025bf7348046 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.542041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50ee7a21-747c-4bdc-9509-025bf7348046 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.543048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50ee7a21-747c-4bdc-9509-025bf7348046 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.544175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50ee7a21-747c-4bdc-9509-025bf7348046 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.545759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50ee7a21-747c-4bdc-9509-025bf7348046 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.947025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-50ee7a21-747c-4bdc-9509-025bf7348046 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:55.957893 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-50ee7a21-747c-4bdc-9509-025bf7348046 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 200 len: 1491 microversion: 2.1 time: 0.449980 Jul 20 04:13:55.958597 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 875/1736] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 1491 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:55.966290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-074b9297-9560-4054-ad1b-780e12e11d9c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:55.968260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-074b9297-9560-4054-ad1b-780e12e11d9c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:55.975979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-074b9297-9560-4054-ad1b-780e12e11d9c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.976593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-074b9297-9560-4054-ad1b-780e12e11d9c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.977405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-074b9297-9560-4054-ad1b-780e12e11d9c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:55.977854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-074b9297-9560-4054-ad1b-780e12e11d9c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:55.985939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:56.065235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bf6da701-ee71-4a83-91b4-40de72408bd8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:56.075781 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bf6da701-ee71-4a83-91b4-40de72408bd8 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.684784 Jul 20 04:13:56.077857 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 862/1737] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:56.098659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d0aee61d-c1e4-4654-8e24-2788c292ef4e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:56.099783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d0aee61d-c1e4-4654-8e24-2788c292ef4e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:56.110610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0aee61d-c1e4-4654-8e24-2788c292ef4e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.111543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0aee61d-c1e4-4654-8e24-2788c292ef4e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.113519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0aee61d-c1e4-4654-8e24-2788c292ef4e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.114597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0aee61d-c1e4-4654-8e24-2788c292ef4e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.157876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d0aee61d-c1e4-4654-8e24-2788c292ef4e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:13:56.303271 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d0aee61d-c1e4-4654-8e24-2788c292ef4e tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 204 len: 0 microversion: 2.1 time: 0.223740 Jul 20 04:13:56.304279 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 863/1738] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:13:56 2022] DELETE /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:13:56.309926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5003c539-810a-4567-aae0-1ef5d8f9c518 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:56.310838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5003c539-810a-4567-aae0-1ef5d8f9c518 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:56.317592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5003c539-810a-4567-aae0-1ef5d8f9c518 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.318271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5003c539-810a-4567-aae0-1ef5d8f9c518 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.319182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5003c539-810a-4567-aae0-1ef5d8f9c518 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.319729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5003c539-810a-4567-aae0-1ef5d8f9c518 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.709657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5003c539-810a-4567-aae0-1ef5d8f9c518 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:56.719320 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5003c539-810a-4567-aae0-1ef5d8f9c518 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1320 microversion: 2.1 time: 0.413506 Jul 20 04:13:56.719912 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 864/1739] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:56 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:56.725423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a8a6887-37a5-4efb-b2cc-a226651fe21b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:56.726342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0a8a6887-37a5-4efb-b2cc-a226651fe21b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:56.733259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a8a6887-37a5-4efb-b2cc-a226651fe21b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.734072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a8a6887-37a5-4efb-b2cc-a226651fe21b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.734936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a8a6887-37a5-4efb-b2cc-a226651fe21b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.735380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a8a6887-37a5-4efb-b2cc-a226651fe21b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.805164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-074b9297-9560-4054-ad1b-780e12e11d9c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:56.815420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-074b9297-9560-4054-ad1b-780e12e11d9c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:56.817132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-074b9297-9560-4054-ad1b-780e12e11d9c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:56.818513 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-074b9297-9560-4054-ad1b-780e12e11d9c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1568 microversion: 2.25 time: 0.858754 Jul 20 04:13:56.819596 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 876/1740] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:55 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1568 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:56.824671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a186264a-ce24-43f1-8ca3-fad7b6ab4348 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:56.826226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a186264a-ce24-43f1-8ca3-fad7b6ab4348 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:56.833946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a186264a-ce24-43f1-8ca3-fad7b6ab4348 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.834968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a186264a-ce24-43f1-8ca3-fad7b6ab4348 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:56.835893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a186264a-ce24-43f1-8ca3-fad7b6ab4348 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:56.836460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a186264a-ce24-43f1-8ca3-fad7b6ab4348 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.193895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0a8a6887-37a5-4efb-b2cc-a226651fe21b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.221182 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a8a6887-37a5-4efb-b2cc-a226651fe21b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1488 microversion: 2.1 time: 0.499288 Jul 20 04:13:57.225269 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 865/1741] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:56 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1488 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:57.234027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9071a76c-c1c0-458a-9eec-333c860a8cef tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:57.234947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9071a76c-c1c0-458a-9eec-333c860a8cef tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.244093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9071a76c-c1c0-458a-9eec-333c860a8cef tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.244754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9071a76c-c1c0-458a-9eec-333c860a8cef tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.245724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9071a76c-c1c0-458a-9eec-333c860a8cef tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.246371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9071a76c-c1c0-458a-9eec-333c860a8cef tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.434986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a186264a-ce24-43f1-8ca3-fad7b6ab4348 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.449865 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a186264a-ce24-43f1-8ca3-fad7b6ab4348 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1647 microversion: 2.1 time: 0.628785 Jul 20 04:13:57.450612 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 877/1742] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:56 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1647 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:57.465985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-03b2be72-05ef-407b-bc61-90f034d2bce6 req-d86e4ef7-37d4-474c-958c-9ee42cce51f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a36a696-8851-4e69-ac90-65e06e37bc2b", "name": "network-vif-deleted", "tag": "b7b586b2-e4b3-4e30-bff1-a39da550c591"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:57.476598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-03b2be72-05ef-407b-bc61-90f034d2bce6 req-d86e4ef7-37d4-474c-958c-9ee42cce51f5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.477562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-03b2be72-05ef-407b-bc61-90f034d2bce6 req-d86e4ef7-37d4-474c-958c-9ee42cce51f5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.503919 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-03b2be72-05ef-407b-bc61-90f034d2bce6 req-d86e4ef7-37d4-474c-958c-9ee42cce51f5 service nova] Creating event network-vif-deleted:b7b586b2-e4b3-4e30-bff1-a39da550c591 for instance 1a36a696-8851-4e69-ac90-65e06e37bc2b on n-h2-760456-11 Jul 20 04:13:57.520548 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-03b2be72-05ef-407b-bc61-90f034d2bce6 req-d86e4ef7-37d4-474c-958c-9ee42cce51f5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058438 Jul 20 04:13:57.521163 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 878/1743] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:57.530096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-408e9272-0cf0-4b49-833b-fdab6e0277d6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:57.531288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-408e9272-0cf0-4b49-833b-fdab6e0277d6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: 1a36a696-8851-4e69-ac90-65e06e37bc2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.539632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-408e9272-0cf0-4b49-833b-fdab6e0277d6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.542405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-408e9272-0cf0-4b49-833b-fdab6e0277d6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.542405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-408e9272-0cf0-4b49-833b-fdab6e0277d6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.542405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-408e9272-0cf0-4b49-833b-fdab6e0277d6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.559696 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-408e9272-0cf0-4b49-833b-fdab6e0277d6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] HTTP exception thrown: Instance 1a36a696-8851-4e69-ac90-65e06e37bc2b could not be found. Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-408e9272-0cf0-4b49-833b-fdab6e0277d6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Request method failure captured: Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b HTTP/1.1 Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-mOWaIOUL3u2C-CodKHgZaTMvXl6Ngh7isuUOfYdm3YCFUeOhSu-PnFEuAiMdymIBhufnukV_MG4sIXf2DPrbvnfMKdQ3WQYvcZXOBjKjyvv9hdypIlJnJjUBzqgtUOzVbCjV8GSM5541XNcxknmnwBv8xZFPNZC12Gak2oLolVGQ Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 443f09d183854727bdf9fe467f2ac8fd Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-MigrationsAdminTest-1284690242 Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-MigrationsAdminTest-1284690242 Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 443f09d183854727bdf9fe467f2ac8fd Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-MigrationsAdminTest-1284690242 Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-MigrationsAdminTest-1284690242-project Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e82ac4df5f844ec4996d939efdba9c11 Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-MigrationsAdminTest-1284690242-project Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 1a36a696-8851-4e69-ac90-65e06e37bc2b could not be found. Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '1a36a696-8851-4e69-ac90-65e06e37bc2b'} Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a36a696-8851-4e69-ac90-65e06e37bc2b could not be found. Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a36a696-8851-4e69-ac90-65e06e37bc2b could not be found. Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:13:57.565533 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:57.570419 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:13:57.570419 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:13:57.570419 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:13:57.570419 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:13:57.570419 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:13:57.570419 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a36a696-8851-4e69-ac90-65e06e37bc2b could not be found. Jul 20 04:13:57.570419 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:13:57.572408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-408e9272-0cf0-4b49-833b-fdab6e0277d6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Returning 404 to user: Instance 1a36a696-8851-4e69-ac90-65e06e37bc2b could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:13:57.573529 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-408e9272-0cf0-4b49-833b-fdab6e0277d6 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b" status: 404 len: 111 microversion: 2.1 time: 0.048970 Jul 20 04:13:57.574721 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 879/1744] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:57 2022] GET /compute/v2.1/servers/1a36a696-8851-4e69-ac90-65e06e37bc2b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:13:57.581526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0624b998-b498-479d-8d9f-f981c7aa832c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:57.582520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0624b998-b498-479d-8d9f-f981c7aa832c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.591495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0624b998-b498-479d-8d9f-f981c7aa832c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.592735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0624b998-b498-479d-8d9f-f981c7aa832c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.593822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0624b998-b498-479d-8d9f-f981c7aa832c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.594494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0624b998-b498-479d-8d9f-f981c7aa832c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.665777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9071a76c-c1c0-458a-9eec-333c860a8cef tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.686456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9071a76c-c1c0-458a-9eec-333c860a8cef tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.695672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9071a76c-c1c0-458a-9eec-333c860a8cef tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:57.704523 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9071a76c-c1c0-458a-9eec-333c860a8cef tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.475935 Jul 20 04:13:57.705262 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 866/1745] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:57 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:57.710239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-6ad17e37-581b-4482-94c6-e7cdc7e298e9 req-2f6bcda5-f5c1-464d-8939-af20f17d850e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b242965-4af1-41f0-b2c4-01bb9a1efaca", "tag": "45ddea36-046a-4574-bdfb-06d91c5443b1"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:57.721761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6ad17e37-581b-4482-94c6-e7cdc7e298e9 req-2f6bcda5-f5c1-464d-8939-af20f17d850e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.722531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6ad17e37-581b-4482-94c6-e7cdc7e298e9 req-2f6bcda5-f5c1-464d-8939-af20f17d850e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.739029 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6ad17e37-581b-4482-94c6-e7cdc7e298e9 req-2f6bcda5-f5c1-464d-8939-af20f17d850e service nova] Creating event network-changed:45ddea36-046a-4574-bdfb-06d91c5443b1 for instance 9b242965-4af1-41f0-b2c4-01bb9a1efaca on n-h2-760456-11 Jul 20 04:13:57.747311 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-6ad17e37-581b-4482-94c6-e7cdc7e298e9 req-2f6bcda5-f5c1-464d-8939-af20f17d850e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040327 Jul 20 04:13:57.748441 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 867/1746] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:57.763699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d91319c-4d22-4a5c-897d-ce225db87d96 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1860091421"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:57.765452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4d91319c-4d22-4a5c-897d-ce225db87d96 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:57.786484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d91319c-4d22-4a5c-897d-ce225db87d96 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.786809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d91319c-4d22-4a5c-897d-ce225db87d96 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:57.787597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d91319c-4d22-4a5c-897d-ce225db87d96 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:57.788235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d91319c-4d22-4a5c-897d-ce225db87d96 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.299107 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4d91319c-4d22-4a5c-897d-ce225db87d96 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "POST /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5/action" status: 202 len: 0 microversion: 2.1 time: 0.546060 Jul 20 04:13:58.300407 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 868/1747] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:13:57 2022] POST /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:13:58.306137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-55a81f9e-278b-45f3-aeea-165adba2e2d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '.version_select at 0x7fb841ddd0d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.327373 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-55a81f9e-278b-45f3-aeea-165adba2e2d5 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-73540090" status: 202 len: 0 microversion: 2.1 time: 0.025322 Jul 20 04:13:58.328750 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 869/1748] 10.222.0.59 () {58 vars in 1214 bytes} [Wed Jul 20 04:13:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-73540090 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:13:58.336668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c5c2c53-ccca-4b08-95dc-936e943d261e tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.338123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c5c2c53-ccca-4b08-95dc-936e943d261e tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.348888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5c2c53-ccca-4b08-95dc-936e943d261e tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.349284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5c2c53-ccca-4b08-95dc-936e943d261e tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.350385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5c2c53-ccca-4b08-95dc-936e943d261e tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.350901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5c2c53-ccca-4b08-95dc-936e943d261e tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.394359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0624b998-b498-479d-8d9f-f981c7aa832c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:58.413323 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0624b998-b498-479d-8d9f-f981c7aa832c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.837094 Jul 20 04:13:58.414332 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 880/1749] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:57 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:58.419013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cb8e99cb-ba61-4e90-bae1-f78053fe437c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:58.420593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cb8e99cb-ba61-4e90-bae1-f78053fe437c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:58.439711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb8e99cb-ba61-4e90-bae1-f78053fe437c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.441748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb8e99cb-ba61-4e90-bae1-f78053fe437c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.442611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb8e99cb-ba61-4e90-bae1-f78053fe437c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:58.443056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb8e99cb-ba61-4e90-bae1-f78053fe437c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:58.702529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:58.740740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:58.909986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cb8e99cb-ba61-4e90-bae1-f78053fe437c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:58.918452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cb8e99cb-ba61-4e90-bae1-f78053fe437c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:58.920368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cb8e99cb-ba61-4e90-bae1-f78053fe437c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:58.921898 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cb8e99cb-ba61-4e90-bae1-f78053fe437c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1568 microversion: 2.25 time: 0.506510 Jul 20 04:13:58.923058 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 881/1750] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1568 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:58.937128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b11cb2eb-3452-4a06-a174-53b4a9c1c734 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841b48310>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.021593 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b11cb2eb-3452-4a06-a174-53b4a9c1c734 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e" status: 200 len: 1414 microversion: 2.1 time: 0.097102 Jul 20 04:13:59.028399 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 882/1751] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:59.031899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9528e409-d215-43aa-bae6-70853af3a846 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.038881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9528e409-d215-43aa-bae6-70853af3a846 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:59.047234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9528e409-d215-43aa-bae6-70853af3a846 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.049081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9528e409-d215-43aa-bae6-70853af3a846 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.051097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9528e409-d215-43aa-bae6-70853af3a846 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.051649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9528e409-d215-43aa-bae6-70853af3a846 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.125212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:59.236206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c5c2c53-ccca-4b08-95dc-936e943d261e tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.244950 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c5c2c53-ccca-4b08-95dc-936e943d261e tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1320 microversion: 2.1 time: 0.914024 Jul 20 04:13:59.252141 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 870/1752] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:58 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1320 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:59.257532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e808f11c-f62d-42a9-b807-aa9848ebb0e7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.266552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e808f11c-f62d-42a9-b807-aa9848ebb0e7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:59.288734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e808f11c-f62d-42a9-b807-aa9848ebb0e7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.289498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e808f11c-f62d-42a9-b807-aa9848ebb0e7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.290889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e808f11c-f62d-42a9-b807-aa9848ebb0e7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.291663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e808f11c-f62d-42a9-b807-aa9848ebb0e7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.684641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9528e409-d215-43aa-bae6-70853af3a846 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.696969 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9528e409-d215-43aa-bae6-70853af3a846 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1647 microversion: 2.1 time: 0.670570 Jul 20 04:13:59.698203 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 883/1753] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:59 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1647 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:59.703170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-41c5e894-6393-4feb-af2f-9a35c7424361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841c4ec10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.756017 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-41c5e894-6393-4feb-af2f-9a35c7424361 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e" status: 200 len: 1414 microversion: 2.1 time: 0.056393 Jul 20 04:13:59.766362 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 884/1754] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:13:59 2022] GET /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:13:59.775385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-55e9159a-14c9-4988-b96f-5edd2d2b04bc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:13:59.776866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-55e9159a-14c9-4988-b96f-5edd2d2b04bc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:13:59.787691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55e9159a-14c9-4988-b96f-5edd2d2b04bc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.789357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55e9159a-14c9-4988-b96f-5edd2d2b04bc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.791102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55e9159a-14c9-4988-b96f-5edd2d2b04bc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.794648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55e9159a-14c9-4988-b96f-5edd2d2b04bc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.847818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e808f11c-f62d-42a9-b807-aa9848ebb0e7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.851426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:13:59.859895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e808f11c-f62d-42a9-b807-aa9848ebb0e7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.861696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e808f11c-f62d-42a9-b807-aa9848ebb0e7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:13:59.863175 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e808f11c-f62d-42a9-b807-aa9848ebb0e7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.609690 Jul 20 04:13:59.876868 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 871/1755] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:13:59 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:59.890152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c3781828-5f70-416c-8cbf-dd794d4530e1 req-38857f39-6b8f-4786-b1a9-f8e6d1b0569e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfd0a05-0361-4623-b862-7e525c0eeb91", "name": "network-vif-unplugged", "status": "completed", "tag": "24377567-d41e-41ac-b4a3-0d0f3a117215"}, {"name": "network-changed", "server_uuid": "1a4e9b05-2015-4e30-b844-d2396aa46eda", "tag": "e4f55595-f2e2-400c-9323-28f3878fad95"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:13:59.905760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c3781828-5f70-416c-8cbf-dd794d4530e1 req-38857f39-6b8f-4786-b1a9-f8e6d1b0569e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:59.906683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c3781828-5f70-416c-8cbf-dd794d4530e1 req-38857f39-6b8f-4786-b1a9-f8e6d1b0569e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:59.921460 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c3781828-5f70-416c-8cbf-dd794d4530e1 req-38857f39-6b8f-4786-b1a9-f8e6d1b0569e service nova] Creating event network-vif-unplugged:24377567-d41e-41ac-b4a3-0d0f3a117215 for instance dbfd0a05-0361-4623-b862-7e525c0eeb91 on n-h2-760456-11 Jul 20 04:13:59.922240 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c3781828-5f70-416c-8cbf-dd794d4530e1 req-38857f39-6b8f-4786-b1a9-f8e6d1b0569e service nova] Creating event network-changed:e4f55595-f2e2-400c-9323-28f3878fad95 for instance 1a4e9b05-2015-4e30-b844-d2396aa46eda on n-h1-760456-11 Jul 20 04:13:59.939343 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c3781828-5f70-416c-8cbf-dd794d4530e1 req-38857f39-6b8f-4786-b1a9-f8e6d1b0569e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053020 Jul 20 04:13:59.939967 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 872/1756] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:13:59.945244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-95129b7f-ca8c-4b10-8d92-d5bc633f1fff tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841e61a60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.156046 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-95129b7f-ca8c-4b10-8d92-d5bc633f1fff tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e" status: 204 len: 0 microversion: 2.1 time: 0.214656 Jul 20 04:14:00.157488 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 873/1757] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:59 2022] DELETE /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:00.163649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c027ba58-2915-4910-854c-6d1c9850f522 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.167041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c027ba58-2915-4910-854c-6d1c9850f522 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.177891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c027ba58-2915-4910-854c-6d1c9850f522 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.178649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c027ba58-2915-4910-854c-6d1c9850f522 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.179910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c027ba58-2915-4910-854c-6d1c9850f522 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.180527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c027ba58-2915-4910-854c-6d1c9850f522 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.519181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c027ba58-2915-4910-854c-6d1c9850f522 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.530672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c027ba58-2915-4910-854c-6d1c9850f522 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.532236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c027ba58-2915-4910-854c-6d1c9850f522 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.533427 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c027ba58-2915-4910-854c-6d1c9850f522 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1568 microversion: 2.25 time: 0.374832 Jul 20 04:14:00.544616 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 874/1758] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:00.548201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-31244af2-783a-4e91-8564-f66e93c77c70 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841f17940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.573356 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-31244af2-783a-4e91-8564-f66e93c77c70 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Image not found. Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-31244af2-783a-4e91-8564-f66e93c77c70 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e HTTP/1.1 Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'f0379bf1-1479-4733-88c8-5490e229429e'} Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f0379bf1-1479-4733-88c8-5490e229429e Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:14:00.575371 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0379bf1-1479-4733-88c8-5490e229429e could not be found. Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-31244af2-783a-4e91-8564-f66e93c77c70 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-31244af2-783a-4e91-8564-f66e93c77c70 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e" status: 404 len: 62 microversion: 2.1 time: 0.042116 Jul 20 04:14:00.580698 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 875/1759] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:00.587400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-00c69f8b-18a6-45e2-bf7d-16a525202c61 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.587400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-00c69f8b-18a6-45e2-bf7d-16a525202c61 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.603773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00c69f8b-18a6-45e2-bf7d-16a525202c61 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.604240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00c69f8b-18a6-45e2-bf7d-16a525202c61 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.605047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00c69f8b-18a6-45e2-bf7d-16a525202c61 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.605494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00c69f8b-18a6-45e2-bf7d-16a525202c61 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.740683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-55e9159a-14c9-4988-b96f-5edd2d2b04bc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.755400 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-55e9159a-14c9-4988-b96f-5edd2d2b04bc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.987318 Jul 20 04:14:00.756605 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 885/1760] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:13:59 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.768525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-19595159-7c56-42d9-ae53-05c7e7b948e5 req-bdd5d101-7f74-41bc-9f14-6c0d1dd76fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12b3f11-eda1-41ed-b619-b4ffe2b3a5de", "name": "network-vif-deleted", "tag": "224f96bf-13e6-432c-ace2-bcb6f2691dc5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:00.789808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-19595159-7c56-42d9-ae53-05c7e7b948e5 req-bdd5d101-7f74-41bc-9f14-6c0d1dd76fa7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.791313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-19595159-7c56-42d9-ae53-05c7e7b948e5 req-bdd5d101-7f74-41bc-9f14-6c0d1dd76fa7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.814781 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-19595159-7c56-42d9-ae53-05c7e7b948e5 req-bdd5d101-7f74-41bc-9f14-6c0d1dd76fa7 service nova] Creating event network-vif-deleted:224f96bf-13e6-432c-ace2-bcb6f2691dc5 for instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de on n-h2-760456-11 Jul 20 04:14:00.824778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-00c69f8b-18a6-45e2-bf7d-16a525202c61 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.828045 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-19595159-7c56-42d9-ae53-05c7e7b948e5 req-bdd5d101-7f74-41bc-9f14-6c0d1dd76fa7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069939 Jul 20 04:14:00.828891 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 886/1761] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:00.837963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c8d6bf0e-b823-4c58-90b3-80942c83fb8a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.838222 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-00c69f8b-18a6-45e2-bf7d-16a525202c61 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1320 microversion: 2.1 time: 0.258449 Jul 20 04:14:00.838710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c8d6bf0e-b823-4c58-90b3-80942c83fb8a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.839489 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 876/1762] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.846666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf0e-b823-4c58-90b3-80942c83fb8a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.847383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf0e-b823-4c58-90b3-80942c83fb8a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.848448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf0e-b823-4c58-90b3-80942c83fb8a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.849072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf0e-b823-4c58-90b3-80942c83fb8a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.849943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.850608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:00.871183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.871637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.872439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.872918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.922163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:00.922654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:00.923323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lazy-loading 'fault' on Instance uuid f12b3f11-eda1-41ed-b619-b4ffe2b3a5de {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:00.969999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebf32ff7a3146f0a29ac97b5d868794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2152dc59b4bb4b40bab36a32b782e70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:00.979584 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e804ca9e-1723-4aee-8f23-e47a16c8c464 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 200 len: 1306 microversion: 2.1 time: 0.138763 Jul 20 04:14:00.980183 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 877/1763] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 1306 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:00.996419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2b75b297-3bda-4a74-9940-e17b1827b5d9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:00.997115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2b75b297-3bda-4a74-9940-e17b1827b5d9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.004764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b75b297-3bda-4a74-9940-e17b1827b5d9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.005507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b75b297-3bda-4a74-9940-e17b1827b5d9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.006417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b75b297-3bda-4a74-9940-e17b1827b5d9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.006870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b75b297-3bda-4a74-9940-e17b1827b5d9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.220105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2b75b297-3bda-4a74-9940-e17b1827b5d9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.230769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2b75b297-3bda-4a74-9940-e17b1827b5d9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.233771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2b75b297-3bda-4a74-9940-e17b1827b5d9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.236495 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2b75b297-3bda-4a74-9940-e17b1827b5d9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.253888 Jul 20 04:14:01.237094 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 878/1764] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:01.331405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-15b6b599-2204-4719-9200-0aad30fe78e4 req-6d369357-34dd-46ee-976d-283a0542a2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a7ceeb-daba-4132-93a5-95c891a45687", "name": "network-vif-unplugged", "status": "completed", "tag": "1ae0744b-76c2-48e9-882c-17cee7beb535"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:01.342758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-15b6b599-2204-4719-9200-0aad30fe78e4 req-6d369357-34dd-46ee-976d-283a0542a2ec service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.343549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-15b6b599-2204-4719-9200-0aad30fe78e4 req-6d369357-34dd-46ee-976d-283a0542a2ec service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.355984 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-15b6b599-2204-4719-9200-0aad30fe78e4 req-6d369357-34dd-46ee-976d-283a0542a2ec service nova] Creating event network-vif-unplugged:1ae0744b-76c2-48e9-882c-17cee7beb535 for instance b0a7ceeb-daba-4132-93a5-95c891a45687 on n-h1-760456-11 Jul 20 04:14:01.361980 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-15b6b599-2204-4719-9200-0aad30fe78e4 req-6d369357-34dd-46ee-976d-283a0542a2ec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037127 Jul 20 04:14:01.363171 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 879/1765] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:01.554158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-024025e8-973e-4699-9a02-692bd01e0f11 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.554788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-024025e8-973e-4699-9a02-692bd01e0f11 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.563890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-024025e8-973e-4699-9a02-692bd01e0f11 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.564990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-024025e8-973e-4699-9a02-692bd01e0f11 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.566000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-024025e8-973e-4699-9a02-692bd01e0f11 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.567393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-024025e8-973e-4699-9a02-692bd01e0f11 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.568125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c8d6bf0e-b823-4c58-90b3-80942c83fb8a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.580456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c8d6bf0e-b823-4c58-90b3-80942c83fb8a tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1506 microversion: 2.1 time: 0.746185 Jul 20 04:14:01.581637 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 887/1766] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:00 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1506 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:01.643778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1e38bbdb-017d-48c3-b26b-807f31c18ba8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.644661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1e38bbdb-017d-48c3-b26b-807f31c18ba8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.653287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e38bbdb-017d-48c3-b26b-807f31c18ba8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.655775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e38bbdb-017d-48c3-b26b-807f31c18ba8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.657877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e38bbdb-017d-48c3-b26b-807f31c18ba8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.658604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e38bbdb-017d-48c3-b26b-807f31c18ba8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.700222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1e38bbdb-017d-48c3-b26b-807f31c18ba8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:01.776238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-024025e8-973e-4699-9a02-692bd01e0f11 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.792517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-024025e8-973e-4699-9a02-692bd01e0f11 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.794157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-024025e8-973e-4699-9a02-692bd01e0f11 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:01.796720 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-024025e8-973e-4699-9a02-692bd01e0f11 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1568 microversion: 2.25 time: 0.248286 Jul 20 04:14:01.808924 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 880/1767] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:01.816388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a51ce4db-ba4c-48b6-8217-b1825cd30831 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.816945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a51ce4db-ba4c-48b6-8217-b1825cd30831 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.824086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a51ce4db-ba4c-48b6-8217-b1825cd30831 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.824542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a51ce4db-ba4c-48b6-8217-b1825cd30831 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.825382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a51ce4db-ba4c-48b6-8217-b1825cd30831 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.825824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a51ce4db-ba4c-48b6-8217-b1825cd30831 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.848806 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1e38bbdb-017d-48c3-b26b-807f31c18ba8 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 204 len: 0 microversion: 2.1 time: 0.208975 Jul 20 04:14:01.850690 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 888/1768] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:01 2022] DELETE /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:01.860686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0163eda7-92c3-47b3-8179-962e22baf482 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:01.862754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0163eda7-92c3-47b3-8179-962e22baf482 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:01.872488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0163eda7-92c3-47b3-8179-962e22baf482 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.874626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0163eda7-92c3-47b3-8179-962e22baf482 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:01.876233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0163eda7-92c3-47b3-8179-962e22baf482 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:01.877543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0163eda7-92c3-47b3-8179-962e22baf482 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.049134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a51ce4db-ba4c-48b6-8217-b1825cd30831 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.063902 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a51ce4db-ba4c-48b6-8217-b1825cd30831 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.252605 Jul 20 04:14:02.076157 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 881/1769] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:02.081603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fece923e-c2ce-46b9-bd1f-160ed82c7ee6 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.082213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fece923e-c2ce-46b9-bd1f-160ed82c7ee6 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.090468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fece923e-c2ce-46b9-bd1f-160ed82c7ee6 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.090920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fece923e-c2ce-46b9-bd1f-160ed82c7ee6 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.092551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fece923e-c2ce-46b9-bd1f-160ed82c7ee6 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.093167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fece923e-c2ce-46b9-bd1f-160ed82c7ee6 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.249581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fece923e-c2ce-46b9-bd1f-160ed82c7ee6 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.261507 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fece923e-c2ce-46b9-bd1f-160ed82c7ee6 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1320 microversion: 2.1 time: 0.183695 Jul 20 04:14:02.262093 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 882/1770] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:02.267051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b54c58c-eb32-4886-be43-781881645c8f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.267659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8b54c58c-eb32-4886-be43-781881645c8f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] [instance: f12b3f11-eda1-41ed-b619-b4ffe2b3a5de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.274873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b54c58c-eb32-4886-be43-781881645c8f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.275324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b54c58c-eb32-4886-be43-781881645c8f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.276109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b54c58c-eb32-4886-be43-781881645c8f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.276740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b54c58c-eb32-4886-be43-781881645c8f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.291736 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8b54c58c-eb32-4886-be43-781881645c8f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] HTTP exception thrown: Instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de could not be found. Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b54c58c-eb32-4886-be43-781881645c8f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Request method failure captured: Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de HTTP/1.1 Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CWrnjFtsQij54RdJiAtgVBJFk6RKrkeP5EjT5BVXKdLtHXL9iUuRGiDOChdB0OAOJRIDkROXiK9Z3oAGYuyGZritKK3kxHjNnguk5WQQBjX9_IEoKYtddwugdCvLdoE3p8kb5XMUlYiwSmXqX1ZGRGBDGsP4JYQc_b7nxOTBLwaF0 Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2152dc59b4bb4b40bab36a32b782e70b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 2152dc59b4bb4b40bab36a32b782e70b Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2055339092 Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: aebf32ff7a3146f0a29ac97b5d868794 Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-SecurityGroupsTestJSON-2055339092-project Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de could not be found. Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'f12b3f11-eda1-41ed-b619-b4ffe2b3a5de'} Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de could not be found. Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de could not be found. Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:02.293584 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de could not be found. Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b54c58c-eb32-4886-be43-781881645c8f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Returning 404 to user: Instance f12b3f11-eda1-41ed-b619-b4ffe2b3a5de could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8b54c58c-eb32-4886-be43-781881645c8f tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de" status: 404 len: 111 microversion: 2.1 time: 0.031802 Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 883/1771] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/f12b3f11-eda1-41ed-b619-b4ffe2b3a5de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-44456678-a3d2-4b61-8cb9-03cc074fe8d7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.302703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-44456678-a3d2-4b61-8cb9-03cc074fe8d7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.307188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44456678-a3d2-4b61-8cb9-03cc074fe8d7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.307827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44456678-a3d2-4b61-8cb9-03cc074fe8d7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.308596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44456678-a3d2-4b61-8cb9-03cc074fe8d7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.309034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44456678-a3d2-4b61-8cb9-03cc074fe8d7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.437025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0163eda7-92c3-47b3-8179-962e22baf482 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.445041 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0163eda7-92c3-47b3-8179-962e22baf482 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1468 microversion: 2.1 time: 0.590323 Jul 20 04:14:02.456711 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 889/1772] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:01 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1468 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:02.456711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4005bad1-d83b-4dc1-b511-cbf2cc6abf70 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841b528b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.502595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-44456678-a3d2-4b61-8cb9-03cc074fe8d7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.511844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-44456678-a3d2-4b61-8cb9-03cc074fe8d7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.513362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-44456678-a3d2-4b61-8cb9-03cc074fe8d7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.515706 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-44456678-a3d2-4b61-8cb9-03cc074fe8d7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.218699 Jul 20 04:14:02.516506 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 884/1773] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:02.599022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6de7a8a6-1042-4881-88b1-34837dc1dd44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.599733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6de7a8a6-1042-4881-88b1-34837dc1dd44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.605993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6de7a8a6-1042-4881-88b1-34837dc1dd44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.606477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6de7a8a6-1042-4881-88b1-34837dc1dd44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.607362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6de7a8a6-1042-4881-88b1-34837dc1dd44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.608120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6de7a8a6-1042-4881-88b1-34837dc1dd44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.747454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6de7a8a6-1042-4881-88b1-34837dc1dd44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:02.756045 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6de7a8a6-1042-4881-88b1-34837dc1dd44 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1506 microversion: 2.1 time: 0.160871 Jul 20 04:14:02.756631 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 885/1774] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:02.816853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8afd7a32-4264-4280-894b-061e14df4fdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:02.817672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8afd7a32-4264-4280-894b-061e14df4fdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:02.830895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8afd7a32-4264-4280-894b-061e14df4fdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.831304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8afd7a32-4264-4280-894b-061e14df4fdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.832077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8afd7a32-4264-4280-894b-061e14df4fdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:02.832518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8afd7a32-4264-4280-894b-061e14df4fdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:02.985703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8afd7a32-4264-4280-894b-061e14df4fdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.004324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8afd7a32-4264-4280-894b-061e14df4fdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.006519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8afd7a32-4264-4280-894b-061e14df4fdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.011501 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8afd7a32-4264-4280-894b-061e14df4fdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1543 microversion: 2.25 time: 0.198961 Jul 20 04:14:03.023544 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 886/1775] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:02 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1543 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:03.031858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3ccc848d-22c9-4e06-a16b-c22bce250af0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '.version_select at 0x7fb841ddd820>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.036433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ccc848d-22c9-4e06-a16b-c22bce250af0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.037001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ccc848d-22c9-4e06-a16b-c22bce250af0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.050664 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3ccc848d-22c9-4e06-a16b-c22bce250af0 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 3477 microversion: 2.25 time: 0.023009 Jul 20 04:14:03.052004 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 887/1776] 10.222.0.59 () {60 vars in 1183 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/os-migrations => generated 3477 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:03.065961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa6ebc74-5ab0-414d-b9d3-e957a357a498 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.066640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fa6ebc74-5ab0-414d-b9d3-e957a357a498 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.073537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa6ebc74-5ab0-414d-b9d3-e957a357a498 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.074009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa6ebc74-5ab0-414d-b9d3-e957a357a498 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.074882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa6ebc74-5ab0-414d-b9d3-e957a357a498 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.075460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa6ebc74-5ab0-414d-b9d3-e957a357a498 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.243218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-fa6ebc74-5ab0-414d-b9d3-e957a357a498 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid dbfd0a05-0361-4623-b862-7e525c0eeb91 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:03.260314 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa6ebc74-5ab0-414d-b9d3-e957a357a498 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 2038 microversion: 2.25 time: 0.198686 Jul 20 04:14:03.275777 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 888/1777] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 2038 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:03.275777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fb1a12be-96d6-4daa-93a9-14d19139ceea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.275777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fb1a12be-96d6-4daa-93a9-14d19139ceea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.275777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb1a12be-96d6-4daa-93a9-14d19139ceea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.275777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb1a12be-96d6-4daa-93a9-14d19139ceea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.279838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb1a12be-96d6-4daa-93a9-14d19139ceea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.280615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb1a12be-96d6-4daa-93a9-14d19139ceea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.496084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fb1a12be-96d6-4daa-93a9-14d19139ceea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.507524 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fb1a12be-96d6-4daa-93a9-14d19139ceea tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.245150 Jul 20 04:14:03.509007 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 889/1778] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:03.513990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-db07caee-95a8-4e6a-af11-86b90e5116b4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.515011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-db07caee-95a8-4e6a-af11-86b90e5116b4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.535568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db07caee-95a8-4e6a-af11-86b90e5116b4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.545476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db07caee-95a8-4e6a-af11-86b90e5116b4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.547632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db07caee-95a8-4e6a-af11-86b90e5116b4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.548611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db07caee-95a8-4e6a-af11-86b90e5116b4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.589792 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4005bad1-d83b-4dc1-b511-cbf2cc6abf70 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/bb4d96a9-328f-4bc6-847f-a49dc677cadc" status: 202 len: 0 microversion: 2.1 time: 1.142326 Jul 20 04:14:03.593953 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 890/1779] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:02 2022] DELETE /compute/v2.1/os-security-groups/bb4d96a9-328f-4bc6-847f-a49dc677cadc => generated 0 bytes in 1144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:03.597246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b766c003-703c-4d21-b1d2-a66651a296a6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Action: 'create', calling method: .version_select at 0x7fb841b525e0>, body: {"keypair": {"name": "tempest-keypair-1993197706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVyYNMl5pZd/P9LnRfZViJq/Wv9a7JyMwBfHfLGpJzsPxp82Xs8pPMWNHhqQj3exygTiud5+0wSiZcco3QEkYsxRakOXlSfzp8s+7B4WOfolB+/wECzoVfFOQV+6NtnVw=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:03.618675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:03.632324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-b766c003-703c-4d21-b1d2-a66651a296a6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Getting quotas for project d2323a93fbfb432f81cd11b542380af8. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:03.645632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-b766c003-703c-4d21-b1d2-a66651a296a6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Getting quotas for user df3e2faf94584fc99a59e3839e18f8b1 and project d2323a93fbfb432f81cd11b542380af8. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:03.710649 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b766c003-703c-4d21-b1d2-a66651a296a6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.118833 Jul 20 04:14:03.721512 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 891/1780] 10.222.0.59 () {62 vars in 1199 bytes} [Wed Jul 20 04:14:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:14:03.771307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-04cde861-b671-4921-b4a0-fc72973b8364 req-f3427ee7-0d13-4ef7-8a04-28dee94ffd30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4e9b05-2015-4e30-b844-d2396aa46eda", "name": "network-vif-plugged", "status": "completed", "tag": "e4f55595-f2e2-400c-9323-28f3878fad95"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:03.792550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-04cde861-b671-4921-b4a0-fc72973b8364 req-f3427ee7-0d13-4ef7-8a04-28dee94ffd30 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.795433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-04cde861-b671-4921-b4a0-fc72973b8364 req-f3427ee7-0d13-4ef7-8a04-28dee94ffd30 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.819707 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-04cde861-b671-4921-b4a0-fc72973b8364 req-f3427ee7-0d13-4ef7-8a04-28dee94ffd30 service nova] Creating event network-vif-plugged:e4f55595-f2e2-400c-9323-28f3878fad95 for instance 1a4e9b05-2015-4e30-b844-d2396aa46eda on n-h1-760456-11 Jul 20 04:14:03.836365 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-04cde861-b671-4921-b4a0-fc72973b8364 req-f3427ee7-0d13-4ef7-8a04-28dee94ffd30 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111792 Jul 20 04:14:03.837314 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 892/1781] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:03.841064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-db07caee-95a8-4e6a-af11-86b90e5116b4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:03.843296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a616c57a-4ba5-4fc6-9462-f5df2e5d43cc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.852757 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-db07caee-95a8-4e6a-af11-86b90e5116b4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1320 microversion: 2.1 time: 0.341524 Jul 20 04:14:03.853923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a616c57a-4ba5-4fc6-9462-f5df2e5d43cc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.858194 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 890/1782] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:03.865624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5a4e9f14-ccb6-4b90-a489-e1b8ba7ed0b7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:03.867779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a616c57a-4ba5-4fc6-9462-f5df2e5d43cc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.868447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a616c57a-4ba5-4fc6-9462-f5df2e5d43cc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.869404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a616c57a-4ba5-4fc6-9462-f5df2e5d43cc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.869991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5a4e9f14-ccb6-4b90-a489-e1b8ba7ed0b7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:03.870212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a616c57a-4ba5-4fc6-9462-f5df2e5d43cc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.882702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a4e9f14-ccb6-4b90-a489-e1b8ba7ed0b7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.883169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a4e9f14-ccb6-4b90-a489-e1b8ba7ed0b7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:03.883973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a4e9f14-ccb6-4b90-a489-e1b8ba7ed0b7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:03.884422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a4e9f14-ccb6-4b90-a489-e1b8ba7ed0b7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.327818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a616c57a-4ba5-4fc6-9462-f5df2e5d43cc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.337632 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a616c57a-4ba5-4fc6-9462-f5df2e5d43cc tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1468 microversion: 2.1 time: 0.498918 Jul 20 04:14:04.337840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a4e9f14-ccb6-4b90-a489-e1b8ba7ed0b7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.346540 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 893/1783] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1468 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:04.346540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-73c91961-b09a-4071-872c-7113bc7a2fc9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] Calling method '.version_select at 0x7fb841b52ee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.351604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a4e9f14-ccb6-4b90-a489-e1b8ba7ed0b7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.353309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a4e9f14-ccb6-4b90-a489-e1b8ba7ed0b7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.354604 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5a4e9f14-ccb6-4b90-a489-e1b8ba7ed0b7 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.495322 Jul 20 04:14:04.355169 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 891/1784] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:03 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:04.371543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-677a81be-3962-4457-beb0-035a7481f9da tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.372481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-677a81be-3962-4457-beb0-035a7481f9da tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.379497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-677a81be-3962-4457-beb0-035a7481f9da tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.380443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-677a81be-3962-4457-beb0-035a7481f9da tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.381394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-677a81be-3962-4457-beb0-035a7481f9da tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.381995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-677a81be-3962-4457-beb0-035a7481f9da tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.416725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:04.727429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-677a81be-3962-4457-beb0-035a7481f9da tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:04.739690 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-677a81be-3962-4457-beb0-035a7481f9da tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1488 microversion: 2.1 time: 0.371905 Jul 20 04:14:04.740696 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 892/1785] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:04 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1488 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:04.746097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ee916ea4-30d1-4f8d-a3e2-3dc31b4d3917 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.747085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ee916ea4-30d1-4f8d-a3e2-3dc31b4d3917 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.755362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee916ea4-30d1-4f8d-a3e2-3dc31b4d3917 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.756629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee916ea4-30d1-4f8d-a3e2-3dc31b4d3917 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.757712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee916ea4-30d1-4f8d-a3e2-3dc31b4d3917 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.758539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee916ea4-30d1-4f8d-a3e2-3dc31b4d3917 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.962725 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-73c91961-b09a-4071-872c-7113bc7a2fc9 tempest-SecurityGroupsTestJSON-2055339092 tempest-SecurityGroupsTestJSON-2055339092-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/e7127006-e67c-4d41-a87c-397acd1621a6" status: 202 len: 0 microversion: 2.1 time: 0.622287 Jul 20 04:14:04.969540 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 894/1786] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:04 2022] DELETE /compute/v2.1/os-security-groups/e7127006-e67c-4d41-a87c-397acd1621a6 => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:04.978912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce60c16c-c3c8-461a-a9fa-8a36859eaba5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:04.980076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce60c16c-c3c8-461a-a9fa-8a36859eaba5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:04.992267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce60c16c-c3c8-461a-a9fa-8a36859eaba5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.992973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce60c16c-c3c8-461a-a9fa-8a36859eaba5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:04.994218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce60c16c-c3c8-461a-a9fa-8a36859eaba5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:04.995908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce60c16c-c3c8-461a-a9fa-8a36859eaba5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.048155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce60c16c-c3c8-461a-a9fa-8a36859eaba5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:05.105260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ee916ea4-30d1-4f8d-a3e2-3dc31b4d3917 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.121635 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ee916ea4-30d1-4f8d-a3e2-3dc31b4d3917 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.379530 Jul 20 04:14:05.137304 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 893/1787] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:04 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:05.142832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-08bbe733-7bf7-4534-ac55-f094347e75e7 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.143737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-08bbe733-7bf7-4534-ac55-f094347e75e7 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.151993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08bbe733-7bf7-4534-ac55-f094347e75e7 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.152717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08bbe733-7bf7-4534-ac55-f094347e75e7 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.154438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08bbe733-7bf7-4534-ac55-f094347e75e7 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.155108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08bbe733-7bf7-4534-ac55-f094347e75e7 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.247078 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce60c16c-c3c8-461a-a9fa-8a36859eaba5 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 204 len: 0 microversion: 2.1 time: 0.274846 Jul 20 04:14:05.249101 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 895/1788] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:04 2022] DELETE /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:05.255667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4beb6aeb-234c-4c8e-9b98-00dcb1c06922 req-2864858d-b4fa-49f9-ac0a-e363d5cce4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd68e268-5eaa-42cd-a269-14daad8c8dd4", "name": "network-vif-deleted", "tag": "6442fb08-15c8-4951-a0ab-5f5aca7f5482"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:05.267016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4beb6aeb-234c-4c8e-9b98-00dcb1c06922 req-2864858d-b4fa-49f9-ac0a-e363d5cce4d1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.267803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4beb6aeb-234c-4c8e-9b98-00dcb1c06922 req-2864858d-b4fa-49f9-ac0a-e363d5cce4d1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.283180 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4beb6aeb-234c-4c8e-9b98-00dcb1c06922 req-2864858d-b4fa-49f9-ac0a-e363d5cce4d1 service nova] Creating event network-vif-deleted:6442fb08-15c8-4951-a0ab-5f5aca7f5482 for instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 on n-h2-760456-11 Jul 20 04:14:05.290830 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4beb6aeb-234c-4c8e-9b98-00dcb1c06922 req-2864858d-b4fa-49f9-ac0a-e363d5cce4d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038180 Jul 20 04:14:05.291836 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 896/1789] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:05.298510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-480a7101-e90b-4038-9de8-843b99e79510 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841b1e1f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.364500 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-480a7101-e90b-4038-9de8-843b99e79510 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Image not found. Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-480a7101-e90b-4038-9de8-843b99e79510 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e HTTP/1.1 Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: exception: Image not found. Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'f0379bf1-1479-4733-88c8-5490e229429e'} Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f0379bf1-1479-4733-88c8-5490e229429e to delete Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0379bf1-1479-4733-88c8-5490e229429e could not be found. Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.368215 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-480a7101-e90b-4038-9de8-843b99e79510 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Image not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-480a7101-e90b-4038-9de8-843b99e79510 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e" status: 404 len: 62 microversion: 2.1 time: 0.076492 Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 897/1790] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] DELETE /compute/v2.1/images/f0379bf1-1479-4733-88c8-5490e229429e => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:05.376276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.380772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.385583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.386605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.387405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.387852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.455457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.456115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.456824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lazy-loading 'fault' on Instance uuid dd68e268-5eaa-42cd-a269-14daad8c8dd4 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:05.458549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-08bbe733-7bf7-4534-ac55-f094347e75e7 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.465342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:05.484220 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-08bbe733-7bf7-4534-ac55-f094347e75e7 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1320 microversion: 2.1 time: 0.345549 Jul 20 04:14:05.488515 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 894/1791] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:05.500719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-30157cc8-bb81-40ef-a07a-986a314f30d5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.504193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-30157cc8-bb81-40ef-a07a-986a314f30d5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.522408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30157cc8-bb81-40ef-a07a-986a314f30d5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.522821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30157cc8-bb81-40ef-a07a-986a314f30d5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.523607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30157cc8-bb81-40ef-a07a-986a314f30d5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.524043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30157cc8-bb81-40ef-a07a-986a314f30d5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.569416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:05.580029 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fe8cff3d-8bdf-4e54-9b46-da73f240f484 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1302 microversion: 2.1 time: 0.208353 Jul 20 04:14:05.594297 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 898/1792] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1302 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:05.594297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-673e499b-1b75-413f-b177-a34cafee6f3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.594297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-673e499b-1b75-413f-b177-a34cafee6f3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.609760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-673e499b-1b75-413f-b177-a34cafee6f3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.609988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-673e499b-1b75-413f-b177-a34cafee6f3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.611497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-673e499b-1b75-413f-b177-a34cafee6f3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.612196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-673e499b-1b75-413f-b177-a34cafee6f3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.672890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-673e499b-1b75-413f-b177-a34cafee6f3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:05.775676 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.compute.api [None req-673e499b-1b75-413f-b177-a34cafee6f3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Instance is already in deleting state, ignoring this request Jul 20 04:14:05.776548 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-673e499b-1b75-413f-b177-a34cafee6f3c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 204 len: 0 microversion: 2.1 time: 0.189415 Jul 20 04:14:05.778100 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 899/1793] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:05 2022] DELETE /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:05.788636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7819ce0f-d413-44fb-a762-ab59a681e608 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:05.791919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7819ce0f-d413-44fb-a762-ab59a681e608 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:05.808306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7819ce0f-d413-44fb-a762-ab59a681e608 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.809226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7819ce0f-d413-44fb-a762-ab59a681e608 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:05.811306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7819ce0f-d413-44fb-a762-ab59a681e608 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:05.814456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7819ce0f-d413-44fb-a762-ab59a681e608 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.265207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7819ce0f-d413-44fb-a762-ab59a681e608 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.277050 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7819ce0f-d413-44fb-a762-ab59a681e608 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1494 microversion: 2.1 time: 0.494750 Jul 20 04:14:06.281540 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 900/1794] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1494 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:06.287838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1a837ad9-db81-42c8-b7c4-70f89685d527 req-7151428b-f55d-46d0-a681-b3a734227dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5", "name": "network-vif-plugged", "status": "completed", "tag": "39f3f991-04fb-49d8-9fbf-c0e81da60206"}, {"server_uuid": "9b242965-4af1-41f0-b2c4-01bb9a1efaca", "name": "network-vif-plugged", "status": "completed", "tag": "45ddea36-046a-4574-bdfb-06d91c5443b1"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:06.299600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1a837ad9-db81-42c8-b7c4-70f89685d527 req-7151428b-f55d-46d0-a681-b3a734227dda service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.301073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1a837ad9-db81-42c8-b7c4-70f89685d527 req-7151428b-f55d-46d0-a681-b3a734227dda service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.319359 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1a837ad9-db81-42c8-b7c4-70f89685d527 req-7151428b-f55d-46d0-a681-b3a734227dda service nova] Creating event network-vif-plugged:39f3f991-04fb-49d8-9fbf-c0e81da60206 for instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 on n-h2-760456-11 Jul 20 04:14:06.320180 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1a837ad9-db81-42c8-b7c4-70f89685d527 req-7151428b-f55d-46d0-a681-b3a734227dda service nova] Creating event network-vif-plugged:45ddea36-046a-4574-bdfb-06d91c5443b1 for instance 9b242965-4af1-41f0-b2c4-01bb9a1efaca on n-h2-760456-11 Jul 20 04:14:06.324632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-30157cc8-bb81-40ef-a07a-986a314f30d5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.329418 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1a837ad9-db81-42c8-b7c4-70f89685d527 req-7151428b-f55d-46d0-a681-b3a734227dda service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046254 Jul 20 04:14:06.335435 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 901/1795] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:06.341328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-30157cc8-bb81-40ef-a07a-986a314f30d5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.343386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86c6d034-718f-4a6a-865c-20ca478ad51e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.344302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-86c6d034-718f-4a6a-865c-20ca478ad51e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.346059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-30157cc8-bb81-40ef-a07a-986a314f30d5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.347934 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-30157cc8-bb81-40ef-a07a-986a314f30d5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.857707 Jul 20 04:14:06.350027 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 895/1796] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:05 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:06.351953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86c6d034-718f-4a6a-865c-20ca478ad51e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.352420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86c6d034-718f-4a6a-865c-20ca478ad51e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.353774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86c6d034-718f-4a6a-865c-20ca478ad51e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.354445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86c6d034-718f-4a6a-865c-20ca478ad51e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.505529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b728691e-b960-43a7-9127-9e8412e9898f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.506150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b728691e-b960-43a7-9127-9e8412e9898f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.512815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b728691e-b960-43a7-9127-9e8412e9898f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.514197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b728691e-b960-43a7-9127-9e8412e9898f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.515305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b728691e-b960-43a7-9127-9e8412e9898f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.515933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b728691e-b960-43a7-9127-9e8412e9898f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.792578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b728691e-b960-43a7-9127-9e8412e9898f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:06.814643 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b728691e-b960-43a7-9127-9e8412e9898f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1320 microversion: 2.1 time: 0.313489 Jul 20 04:14:06.818954 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 896/1797] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:06.851665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:06.852702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:06.866534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.881706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.884156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.885650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.947688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:06.948422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:06.949053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lazy-loading 'fault' on Instance uuid dd68e268-5eaa-42cd-a269-14daad8c8dd4 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:07.052846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-86c6d034-718f-4a6a-865c-20ca478ad51e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.065266 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-86c6d034-718f-4a6a-865c-20ca478ad51e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1717 microversion: 2.1 time: 0.728292 Jul 20 04:14:07.072191 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 902/1798] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1717 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:07.088229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.113350 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-07de3936-80bc-43a4-bb54-4f1725ce12e9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 200 len: 1302 microversion: 2.1 time: 0.274149 Jul 20 04:14:07.113350 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 897/1799] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:06 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 1302 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:07.299576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-11678c76-bc5f-471a-82a2-170c27d6b0a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.300383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-11678c76-bc5f-471a-82a2-170c27d6b0a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:07.309058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11678c76-bc5f-471a-82a2-170c27d6b0a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.309654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11678c76-bc5f-471a-82a2-170c27d6b0a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.311973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11678c76-bc5f-471a-82a2-170c27d6b0a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.313434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11678c76-bc5f-471a-82a2-170c27d6b0a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.369260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d7a74cf9-7422-4343-97bd-da5528d665ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.370092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d7a74cf9-7422-4343-97bd-da5528d665ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:07.379502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7a74cf9-7422-4343-97bd-da5528d665ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.380633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7a74cf9-7422-4343-97bd-da5528d665ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.381812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7a74cf9-7422-4343-97bd-da5528d665ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.382457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7a74cf9-7422-4343-97bd-da5528d665ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.720579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-11678c76-bc5f-471a-82a2-170c27d6b0a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aad902393614d1fae3d0f5bf5456c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95803bcc72643c995784af8507117b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.732461 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-11678c76-bc5f-471a-82a2-170c27d6b0a0 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 200 len: 1494 microversion: 2.1 time: 0.436620 Jul 20 04:14:07.741188 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 903/1800] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 1494 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:07.836233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc15454e-afe4-4340-8901-c418354bbf9a tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:07.836860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc15454e-afe4-4340-8901-c418354bbf9a tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:07.844176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc15454e-afe4-4340-8901-c418354bbf9a tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.844941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc15454e-afe4-4340-8901-c418354bbf9a tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.845489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc15454e-afe4-4340-8901-c418354bbf9a tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:07.845926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc15454e-afe4-4340-8901-c418354bbf9a tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:07.852367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d7a74cf9-7422-4343-97bd-da5528d665ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.864809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d7a74cf9-7422-4343-97bd-da5528d665ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.867059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d7a74cf9-7422-4343-97bd-da5528d665ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:07.868464 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d7a74cf9-7422-4343-97bd-da5528d665ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.504522 Jul 20 04:14:07.884660 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 898/1801] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:08.090966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4be28766-7e8f-4b73-94f0-d5dae0db4995 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.093159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4be28766-7e8f-4b73-94f0-d5dae0db4995 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.113244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4be28766-7e8f-4b73-94f0-d5dae0db4995 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.118387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4be28766-7e8f-4b73-94f0-d5dae0db4995 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.120999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4be28766-7e8f-4b73-94f0-d5dae0db4995 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.121698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4be28766-7e8f-4b73-94f0-d5dae0db4995 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.208802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc15454e-afe4-4340-8901-c418354bbf9a tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:08.224012 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc15454e-afe4-4340-8901-c418354bbf9a tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1320 microversion: 2.1 time: 0.392086 Jul 20 04:14:08.225246 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 904/1802] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:07 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:08.230285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28b538ba-4a2b-4e1b-b365-12c1a37acad9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.251610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-28b538ba-4a2b-4e1b-b365-12c1a37acad9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: dd68e268-5eaa-42cd-a269-14daad8c8dd4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.272880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28b538ba-4a2b-4e1b-b365-12c1a37acad9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.274571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28b538ba-4a2b-4e1b-b365-12c1a37acad9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.275679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28b538ba-4a2b-4e1b-b365-12c1a37acad9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.276402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28b538ba-4a2b-4e1b-b365-12c1a37acad9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.321852 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-28b538ba-4a2b-4e1b-b365-12c1a37acad9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] HTTP exception thrown: Instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 could not be found. Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28b538ba-4a2b-4e1b-b365-12c1a37acad9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Request method failure captured: Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 HTTP/1.1 Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-mOWaIOUL3u2C-CodKHgZaTMvXl6Ngh7isuUOfYdm3YCFUeOhSu-PnFEuAiMdymIBhufnukV_MG4sIXf2DPrbvnfMKdQ3WQYvcZXOBjKjyvv9hdypIlJnJjUBzqgtUOzVbCjV8GSM5541XNcxknmnwBv8xZFPNZC12Gak2oLolVGQ Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 443f09d183854727bdf9fe467f2ac8fd Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-MigrationsAdminTest-1284690242 Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-MigrationsAdminTest-1284690242 Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 443f09d183854727bdf9fe467f2ac8fd Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-MigrationsAdminTest-1284690242 Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-MigrationsAdminTest-1284690242-project Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e82ac4df5f844ec4996d939efdba9c11 Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-MigrationsAdminTest-1284690242-project Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 could not be found. Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'dd68e268-5eaa-42cd-a269-14daad8c8dd4'} Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 could not be found. Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 could not be found. Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:08.324976 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:08.330788 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:08.330788 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:08.330788 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:08.330788 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:08.330788 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:08.330788 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 could not be found. Jul 20 04:14:08.330788 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:08.333334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28b538ba-4a2b-4e1b-b365-12c1a37acad9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Returning 404 to user: Instance dd68e268-5eaa-42cd-a269-14daad8c8dd4 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:08.335137 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-28b538ba-4a2b-4e1b-b365-12c1a37acad9 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4" status: 404 len: 111 microversion: 2.1 time: 0.108596 Jul 20 04:14:08.340788 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 905/1803] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/dd68e268-5eaa-42cd-a269-14daad8c8dd4 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:08.347718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e5887194-3f8c-441f-8a6e-18ce7f92b3df tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.348627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e5887194-3f8c-441f-8a6e-18ce7f92b3df tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.364780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5887194-3f8c-441f-8a6e-18ce7f92b3df tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.365765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5887194-3f8c-441f-8a6e-18ce7f92b3df tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.367085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5887194-3f8c-441f-8a6e-18ce7f92b3df tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.367772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5887194-3f8c-441f-8a6e-18ce7f92b3df tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.424186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e5887194-3f8c-441f-8a6e-18ce7f92b3df tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:08.581065 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e5887194-3f8c-441f-8a6e-18ce7f92b3df tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 204 len: 0 microversion: 2.1 time: 0.236693 Jul 20 04:14:08.583939 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 906/1804] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:08 2022] DELETE /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:08.593185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e9a262e6-9ae1-45bc-87e4-41b3a3650613 req-161771c3-2c7a-41e3-b503-0111ce27113d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5", "name": "network-vif-unplugged", "status": "completed", "tag": "39f3f991-04fb-49d8-9fbf-c0e81da60206"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:08.603114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e9a262e6-9ae1-45bc-87e4-41b3a3650613 req-161771c3-2c7a-41e3-b503-0111ce27113d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.603567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e9a262e6-9ae1-45bc-87e4-41b3a3650613 req-161771c3-2c7a-41e3-b503-0111ce27113d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.616905 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e9a262e6-9ae1-45bc-87e4-41b3a3650613 req-161771c3-2c7a-41e3-b503-0111ce27113d service nova] Creating event network-vif-unplugged:39f3f991-04fb-49d8-9fbf-c0e81da60206 for instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 on n-h2-760456-11 Jul 20 04:14:08.623837 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e9a262e6-9ae1-45bc-87e4-41b3a3650613 req-161771c3-2c7a-41e3-b503-0111ce27113d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035991 Jul 20 04:14:08.625331 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 907/1805] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:08.632335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-93190084-a2de-4c48-8206-ea23aafb1b7b req-3a265cdb-5f41-4278-8ceb-a10f623e62d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5", "name": "network-vif-deleted", "tag": "39f3f991-04fb-49d8-9fbf-c0e81da60206"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:08.644169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-93190084-a2de-4c48-8206-ea23aafb1b7b req-3a265cdb-5f41-4278-8ceb-a10f623e62d2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.644169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-93190084-a2de-4c48-8206-ea23aafb1b7b req-3a265cdb-5f41-4278-8ceb-a10f623e62d2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.657277 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-93190084-a2de-4c48-8206-ea23aafb1b7b req-3a265cdb-5f41-4278-8ceb-a10f623e62d2 service nova] Creating event network-vif-deleted:39f3f991-04fb-49d8-9fbf-c0e81da60206 for instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 on n-h2-760456-11 Jul 20 04:14:08.661957 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-93190084-a2de-4c48-8206-ea23aafb1b7b req-3a265cdb-5f41-4278-8ceb-a10f623e62d2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035109 Jul 20 04:14:08.663030 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 908/1806] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:08.668692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d60edca7-c9ca-4f7d-97bf-8cbac8e2238e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:08.669270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d60edca7-c9ca-4f7d-97bf-8cbac8e2238e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:08.673657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4be28766-7e8f-4b73-94f0-d5dae0db4995 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:08.679964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d60edca7-c9ca-4f7d-97bf-8cbac8e2238e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.680433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d60edca7-c9ca-4f7d-97bf-8cbac8e2238e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.681224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d60edca7-c9ca-4f7d-97bf-8cbac8e2238e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:08.681670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d60edca7-c9ca-4f7d-97bf-8cbac8e2238e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:08.690713 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4be28766-7e8f-4b73-94f0-d5dae0db4995 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1707 microversion: 2.1 time: 0.604623 Jul 20 04:14:08.693794 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 899/1807] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1707 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:08.700956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1995827021", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "d7df1a6a-edf6-4e43-8286-ec664673f3ed"}], "security_groups": [{"name": "tempest-securitygroup--878334747"}], "key_name": "tempest-keypair-1993197706", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:08.721272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:08.838647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] validate_networks() for [('d7df1a6a-edf6-4e43-8286-ec664673f3ed', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:09.067810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d60edca7-c9ca-4f7d-97bf-8cbac8e2238e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.088902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d60edca7-c9ca-4f7d-97bf-8cbac8e2238e tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1469 microversion: 2.1 time: 0.424442 Jul 20 04:14:09.089720 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 909/1808] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:08 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1469 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:09.093923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-180ec132-1ee3-4c97-9d88-fc53c152967a tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '.version_select at 0x7fb841b1e430>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.096359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-180ec132-1ee3-4c97-9d88-fc53c152967a tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.096809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-180ec132-1ee3-4c97-9d88-fc53c152967a tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.140079 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-180ec132-1ee3-4c97-9d88-fc53c152967a tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 2351 microversion: 2.1 time: 0.049337 Jul 20 04:14:09.141630 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 910/1809] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/os-migrations => generated 2351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:09.147053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-75ad6b50-e9d1-4d72-b226-4bf7573e4b4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.147673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-75ad6b50-e9d1-4d72-b226-4bf7573e4b4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.156637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75ad6b50-e9d1-4d72-b226-4bf7573e4b4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.157094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75ad6b50-e9d1-4d72-b226-4bf7573e4b4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.157894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75ad6b50-e9d1-4d72-b226-4bf7573e4b4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.158402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75ad6b50-e9d1-4d72-b226-4bf7573e4b4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.191418 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-75ad6b50-e9d1-4d72-b226-4bf7573e4b4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 could not be found. Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-75ad6b50-e9d1-4d72-b226-4bf7573e4b4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 HTTP/1.1 Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 could not be found. Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5'} Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 could not be found. Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 could not be found. Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.193849 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.199478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:09.199478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:09.199478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:09.199478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:09.199478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 could not be found. Jul 20 04:14:09.199478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.208549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-75ad6b50-e9d1-4d72-b226-4bf7573e4b4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Instance 0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:09.210701 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-75ad6b50-e9d1-4d72-b226-4bf7573e4b4c tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5" status: 404 len: 111 microversion: 2.1 time: 0.067025 Jul 20 04:14:09.212637 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 911/1810] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/0cc0cfb3-4de6-4f2d-9410-7ecd7a90cbb5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:09.223118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1d311085-a9d4-4a89-9f66-d4ff2dcf6799 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.224669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1d311085-a9d4-4a89-9f66-d4ff2dcf6799 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.236699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d311085-a9d4-4a89-9f66-d4ff2dcf6799 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.241330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d311085-a9d4-4a89-9f66-d4ff2dcf6799 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.242854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d311085-a9d4-4a89-9f66-d4ff2dcf6799 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.243569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d311085-a9d4-4a89-9f66-d4ff2dcf6799 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.358152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:09.358656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:09.359109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:09.359682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:09.360106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:09.369552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.370011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.370860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.371305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.389505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Getting quotas for project d2323a93fbfb432f81cd11b542380af8. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:09.395010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Getting quotas for user df3e2faf94584fc99a59e3839e18f8b1 and project d2323a93fbfb432f81cd11b542380af8. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:09.418507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:09.421090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:09.469049 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ff3dce9-864b-45e9-8459-1a0656c00467 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 0.773323 Jul 20 04:14:09.469669 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 900/1811] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:14:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:14:09.481565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6149b8a4-df57-4fb8-9f15-5bd6bc0c9d8f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.481565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6149b8a4-df57-4fb8-9f15-5bd6bc0c9d8f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.492283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6149b8a4-df57-4fb8-9f15-5bd6bc0c9d8f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.492283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6149b8a4-df57-4fb8-9f15-5bd6bc0c9d8f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.493174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6149b8a4-df57-4fb8-9f15-5bd6bc0c9d8f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.493647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6149b8a4-df57-4fb8-9f15-5bd6bc0c9d8f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.634987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d311085-a9d4-4a89-9f66-d4ff2dcf6799 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.645844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d311085-a9d4-4a89-9f66-d4ff2dcf6799 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.648136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d311085-a9d4-4a89-9f66-d4ff2dcf6799 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.649521 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1d311085-a9d4-4a89-9f66-d4ff2dcf6799 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.434978 Jul 20 04:14:09.650571 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 912/1812] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:09.655282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baebdb4d-27fa-4fe9-826e-76ec2a84973d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841b71c10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.680319 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6149b8a4-df57-4fb8-9f15-5bd6bc0c9d8f tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1860 microversion: 2.1 time: 0.209361 Jul 20 04:14:09.681380 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 901/1813] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1860 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:09.683017 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-baebdb4d-27fa-4fe9-826e-76ec2a84973d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Image not found. Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baebdb4d-27fa-4fe9-826e-76ec2a84973d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c HTTP/1.1 Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: exception: Image not found. Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4def0836-2722-4680-99bb-e7de2efbe96c'} Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4def0836-2722-4680-99bb-e7de2efbe96c to delete Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4def0836-2722-4680-99bb-e7de2efbe96c could not be found. Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.685537 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:09.702191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:09.704934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e8855148-7be0-4e19-b65b-33854104d13b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.704934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e8855148-7be0-4e19-b65b-33854104d13b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.705231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baebdb4d-27fa-4fe9-826e-76ec2a84973d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Image not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:09.705231 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-baebdb4d-27fa-4fe9-826e-76ec2a84973d tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c" status: 404 len: 62 microversion: 2.1 time: 0.044513 Jul 20 04:14:09.705231 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 913/1814] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:09 2022] DELETE /compute/v2.1/images/4def0836-2722-4680-99bb-e7de2efbe96c => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:09.711951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c0f39ae2-8e40-47b8-8ffd-ecbb81374457 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.712575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c0f39ae2-8e40-47b8-8ffd-ecbb81374457 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.743097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8855148-7be0-4e19-b65b-33854104d13b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.746884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8855148-7be0-4e19-b65b-33854104d13b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.750688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8855148-7be0-4e19-b65b-33854104d13b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.755646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8855148-7be0-4e19-b65b-33854104d13b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.825329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c0f39ae2-8e40-47b8-8ffd-ecbb81374457 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.839874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c0f39ae2-8e40-47b8-8ffd-ecbb81374457 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.844583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c0f39ae2-8e40-47b8-8ffd-ecbb81374457 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:09.846298 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c0f39ae2-8e40-47b8-8ffd-ecbb81374457 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1286 microversion: 2.25 time: 0.139382 Jul 20 04:14:09.850617 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 914/1815] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:09.868900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d326032-7e23-4916-8ab7-11e4528f338b tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:09.869810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7d326032-7e23-4916-8ab7-11e4528f338b tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:09.884125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d326032-7e23-4916-8ab7-11e4528f338b tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.891881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d326032-7e23-4916-8ab7-11e4528f338b tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:09.892882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d326032-7e23-4916-8ab7-11e4528f338b tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:09.894859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d326032-7e23-4916-8ab7-11e4528f338b tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.156245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e8855148-7be0-4e19-b65b-33854104d13b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.167165 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e8855148-7be0-4e19-b65b-33854104d13b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 200 len: 1506 microversion: 2.1 time: 0.483600 Jul 20 04:14:10.187708 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 902/1816] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:10.198902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8320db2f-61db-4c56-8f60-edba82494466 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.199702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8320db2f-61db-4c56-8f60-edba82494466 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.209591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8320db2f-61db-4c56-8f60-edba82494466 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.210388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8320db2f-61db-4c56-8f60-edba82494466 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.211385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8320db2f-61db-4c56-8f60-edba82494466 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.212240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8320db2f-61db-4c56-8f60-edba82494466 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.234529 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8320db2f-61db-4c56-8f60-edba82494466 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8320db2f-61db-4c56-8f60-edba82494466 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 HTTP/1.1 Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8fe65a9e-ad47-4844-a1d1-b673bca616c5'} Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:10.236438 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. Jul 20 04:14:10.241515 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.241515 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:10.241515 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.241515 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.241515 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:10.241515 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:10.241515 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:10.241515 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:10.241515 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. Jul 20 04:14:10.241515 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.255681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8320db2f-61db-4c56-8f60-edba82494466 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:10.257572 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8320db2f-61db-4c56-8f60-edba82494466 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 404 len: 111 microversion: 2.1 time: 0.065089 Jul 20 04:14:10.262478 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 903/1817] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:10 2022] DELETE /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:10.268820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e0edc77a-ede0-4e8d-84a9-8aa19bd76341 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.269772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e0edc77a-ede0-4e8d-84a9-8aa19bd76341 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.276505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0edc77a-ede0-4e8d-84a9-8aa19bd76341 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.277209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0edc77a-ede0-4e8d-84a9-8aa19bd76341 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.278198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0edc77a-ede0-4e8d-84a9-8aa19bd76341 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.279362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0edc77a-ede0-4e8d-84a9-8aa19bd76341 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.471043 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d326032-7e23-4916-8ab7-11e4528f338b tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1860 microversion: 2.1 time: 0.617243 Jul 20 04:14:10.472235 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 915/1818] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:09 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1860 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:10.491381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-47ec058d-2e71-46c9-92e1-0a3b6e7e59d3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.492017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-47ec058d-2e71-46c9-92e1-0a3b6e7e59d3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 1a4e9b05-2015-4e30-b844-d2396aa46eda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.516392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47ec058d-2e71-46c9-92e1-0a3b6e7e59d3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.516853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47ec058d-2e71-46c9-92e1-0a3b6e7e59d3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.517641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47ec058d-2e71-46c9-92e1-0a3b6e7e59d3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.518085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47ec058d-2e71-46c9-92e1-0a3b6e7e59d3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.742633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e0edc77a-ede0-4e8d-84a9-8aa19bd76341 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.752649 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e0edc77a-ede0-4e8d-84a9-8aa19bd76341 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1469 microversion: 2.1 time: 0.488646 Jul 20 04:14:10.762768 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 904/1819] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1469 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:10.769387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b3d23d2-d4e9-4d44-8e46-e193f2d13bc4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.770265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6b3d23d2-d4e9-4d44-8e46-e193f2d13bc4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 8fe65a9e-ad47-4844-a1d1-b673bca616c5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.778154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b3d23d2-d4e9-4d44-8e46-e193f2d13bc4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.778976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b3d23d2-d4e9-4d44-8e46-e193f2d13bc4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.780008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b3d23d2-d4e9-4d44-8e46-e193f2d13bc4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.780675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b3d23d2-d4e9-4d44-8e46-e193f2d13bc4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.798445 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-6b3d23d2-d4e9-4d44-8e46-e193f2d13bc4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b3d23d2-d4e9-4d44-8e46-e193f2d13bc4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 HTTP/1.1 Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8fe65a9e-ad47-4844-a1d1-b673bca616c5'} Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.800304 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:10.805614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:10.805614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:10.805614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:10.805614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:10.805614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. Jul 20 04:14:10.805614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:10.806236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-47ec058d-2e71-46c9-92e1-0a3b6e7e59d3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:10.807608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b3d23d2-d4e9-4d44-8e46-e193f2d13bc4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Instance 8fe65a9e-ad47-4844-a1d1-b673bca616c5 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:10.808643 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b3d23d2-d4e9-4d44-8e46-e193f2d13bc4 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5" status: 404 len: 111 microversion: 2.1 time: 0.044213 Jul 20 04:14:10.809389 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 905/1820] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/8fe65a9e-ad47-4844-a1d1-b673bca616c5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:10.816133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d8e52f06-e6e4-4274-b60b-1af6a715d7bf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.816868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d8e52f06-e6e4-4274-b60b-1af6a715d7bf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.822407 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-47ec058d-2e71-46c9-92e1-0a3b6e7e59d3 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/1a4e9b05-2015-4e30-b844-d2396aa46eda" status: 200 len: 1507 microversion: 2.1 time: 0.342604 Jul 20 04:14:10.823199 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 916/1821] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/1a4e9b05-2015-4e30-b844-d2396aa46eda => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:10.824894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8e52f06-e6e4-4274-b60b-1af6a715d7bf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.825567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8e52f06-e6e4-4274-b60b-1af6a715d7bf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.826940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8e52f06-e6e4-4274-b60b-1af6a715d7bf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.827558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8e52f06-e6e4-4274-b60b-1af6a715d7bf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.855952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9113bbb-e36d-474a-9f59-c9179e672933 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:10.857380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9113bbb-e36d-474a-9f59-c9179e672933 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:10.870963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9113bbb-e36d-474a-9f59-c9179e672933 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.874650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9113bbb-e36d-474a-9f59-c9179e672933 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:10.875855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9113bbb-e36d-474a-9f59-c9179e672933 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:10.876306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9113bbb-e36d-474a-9f59-c9179e672933 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.085105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-d8e52f06-e6e4-4274-b60b-1af6a715d7bf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lazy-loading 'services' on Instance uuid b0a7ceeb-daba-4132-93a5-95c891a45687 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:11.338880 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d8e52f06-e6e4-4274-b60b-1af6a715d7bf tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments/d9a3f0de-d96b-4a36-a028-0d6ca7dc05e4" status: 202 len: 0 microversion: 2.1 time: 0.526951 Jul 20 04:14:11.339547 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 906/1822] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:14:10 2022] DELETE /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments/d9a3f0de-d96b-4a36-a028-0d6ca7dc05e4 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:11.348979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-796f21f3-cb1b-49d7-ad17-14fed2427a02 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841df6d30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.375507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9113bbb-e36d-474a-9f59-c9179e672933 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.387212 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-796f21f3-cb1b-49d7-ad17-14fed2427a02 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Image not found. Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-796f21f3-cb1b-49d7-ad17-14fed2427a02 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 HTTP/1.1 Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c025557a-8768-4c35-b38c-90f829832840'} Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c025557a-8768-4c35-b38c-90f829832840 to delete Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c025557a-8768-4c35-b38c-90f829832840 could not be found. Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.390543 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:11.395911 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.397785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9113bbb-e36d-474a-9f59-c9179e672933 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.400194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-796f21f3-cb1b-49d7-ad17-14fed2427a02 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:11.401124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9113bbb-e36d-474a-9f59-c9179e672933 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.401552 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-796f21f3-cb1b-49d7-ad17-14fed2427a02 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840" status: 404 len: 62 microversion: 2.1 time: 0.060378 Jul 20 04:14:11.402320 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 907/1823] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] DELETE /compute/v2.1/images/c025557a-8768-4c35-b38c-90f829832840 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:11.406206 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9113bbb-e36d-474a-9f59-c9179e672933 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.569577 Jul 20 04:14:11.409905 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 917/1824] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:10 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:11.412524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-71eda947-9c27-4f77-8f61-c3f745b683a4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.413341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-71eda947-9c27-4f77-8f61-c3f745b683a4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 1a4e9b05-2015-4e30-b844-d2396aa46eda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.422925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71eda947-9c27-4f77-8f61-c3f745b683a4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.423383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71eda947-9c27-4f77-8f61-c3f745b683a4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.424170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71eda947-9c27-4f77-8f61-c3f745b683a4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.424612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71eda947-9c27-4f77-8f61-c3f745b683a4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.438488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8fd3b0ce-9666-40f0-8546-ccd6264390f8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.441676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8fd3b0ce-9666-40f0-8546-ccd6264390f8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.463982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fd3b0ce-9666-40f0-8546-ccd6264390f8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.467538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fd3b0ce-9666-40f0-8546-ccd6264390f8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.468666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fd3b0ce-9666-40f0-8546-ccd6264390f8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.472891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fd3b0ce-9666-40f0-8546-ccd6264390f8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.474428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-71eda947-9c27-4f77-8f61-c3f745b683a4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 1a4e9b05-2015-4e30-b844-d2396aa46eda] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:11.488072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:11.605870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8fd3b0ce-9666-40f0-8546-ccd6264390f8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.607446 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-71eda947-9c27-4f77-8f61-c3f745b683a4 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1a4e9b05-2015-4e30-b844-d2396aa46eda" status: 204 len: 0 microversion: 2.1 time: 0.199290 Jul 20 04:14:11.613262 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 908/1825] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:11 2022] DELETE /compute/v2.1/servers/1a4e9b05-2015-4e30-b844-d2396aa46eda => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:11.618628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8fd3b0ce-9666-40f0-8546-ccd6264390f8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.619783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2db05ddf-70f6-4a32-8d9e-540d95097759 req-90345618-2bb1-4e0c-a5d6-d4835abe78da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca69cf0f-51e1-44c3-b6c7-909906c86a98", "name": "network-vif-deleted", "tag": "5bb8310e-d16c-408e-835c-86dc238bca54"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:11.621048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8fd3b0ce-9666-40f0-8546-ccd6264390f8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:11.622790 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8fd3b0ce-9666-40f0-8546-ccd6264390f8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1344 microversion: 2.25 time: 0.199995 Jul 20 04:14:11.628410 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 918/1826] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1344 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:11.636612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-68c92f01-c291-4370-85e2-7fe5e2835f72 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.638565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2db05ddf-70f6-4a32-8d9e-540d95097759 req-90345618-2bb1-4e0c-a5d6-d4835abe78da service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.639659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2db05ddf-70f6-4a32-8d9e-540d95097759 req-90345618-2bb1-4e0c-a5d6-d4835abe78da service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.642949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-68c92f01-c291-4370-85e2-7fe5e2835f72 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.655042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68c92f01-c291-4370-85e2-7fe5e2835f72 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.657093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68c92f01-c291-4370-85e2-7fe5e2835f72 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.658356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68c92f01-c291-4370-85e2-7fe5e2835f72 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.660213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68c92f01-c291-4370-85e2-7fe5e2835f72 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.662684 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2db05ddf-70f6-4a32-8d9e-540d95097759 req-90345618-2bb1-4e0c-a5d6-d4835abe78da service nova] Creating event network-vif-deleted:5bb8310e-d16c-408e-835c-86dc238bca54 for instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 on n-h1-760456-11 Jul 20 04:14:11.669638 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2db05ddf-70f6-4a32-8d9e-540d95097759 req-90345618-2bb1-4e0c-a5d6-d4835abe78da service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054691 Jul 20 04:14:11.670624 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 909/1827] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:11.676160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-33158b1d-cae2-45bd-ae64-1017e6f63d8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.676751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-33158b1d-cae2-45bd-ae64-1017e6f63d8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.683950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33158b1d-cae2-45bd-ae64-1017e6f63d8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.684406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33158b1d-cae2-45bd-ae64-1017e6f63d8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.685735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33158b1d-cae2-45bd-ae64-1017e6f63d8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.686240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33158b1d-cae2-45bd-ae64-1017e6f63d8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.691473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:11.703606 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-33158b1d-cae2-45bd-ae64-1017e6f63d8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-33158b1d-cae2-45bd-ae64-1017e6f63d8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 HTTP/1.1 Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '76ac1ca0-13df-42f1-a6dd-c8f8fcb92340'} Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:11.705349 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-33158b1d-cae2-45bd-ae64-1017e6f63d8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-33158b1d-cae2-45bd-ae64-1017e6f63d8b tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 404 len: 111 microversion: 2.1 time: 0.035105 Jul 20 04:14:11.711068 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 910/1828] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:11 2022] DELETE /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:11.713368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4a38005a-59eb-4977-8473-44b199e1c93d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.714121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4a38005a-59eb-4977-8473-44b199e1c93d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.721826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a38005a-59eb-4977-8473-44b199e1c93d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.722227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a38005a-59eb-4977-8473-44b199e1c93d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.723042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a38005a-59eb-4977-8473-44b199e1c93d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.723486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a38005a-59eb-4977-8473-44b199e1c93d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.725100 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-68c92f01-c291-4370-85e2-7fe5e2835f72 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095545 Jul 20 04:14:11.725907 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 919/1829] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:11.734936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f5a849d-1de6-4c8b-b244-88a6ed308b85 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.735771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3f5a849d-1de6-4c8b-b244-88a6ed308b85 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.742640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f5a849d-1de6-4c8b-b244-88a6ed308b85 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.743386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f5a849d-1de6-4c8b-b244-88a6ed308b85 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.744858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f5a849d-1de6-4c8b-b244-88a6ed308b85 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.745486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f5a849d-1de6-4c8b-b244-88a6ed308b85 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.758124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4a38005a-59eb-4977-8473-44b199e1c93d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 9b242965-4af1-41f0-b2c4-01bb9a1efaca] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:11.763145 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3f5a849d-1de6-4c8b-b244-88a6ed308b85 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f5a849d-1de6-4c8b-b244-88a6ed308b85 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 HTTP/1.1 Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '76ac1ca0-13df-42f1-a6dd-c8f8fcb92340'} Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.774642 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:11.780835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:11.780835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:11.780835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:11.780835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:11.780835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. Jul 20 04:14:11.780835 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:11.785353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f5a849d-1de6-4c8b-b244-88a6ed308b85 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Instance 76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:11.789795 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f5a849d-1de6-4c8b-b244-88a6ed308b85 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340" status: 404 len: 111 microversion: 2.1 time: 0.059155 Jul 20 04:14:11.791426 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 920/1830] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/76ac1ca0-13df-42f1-a6dd-c8f8fcb92340 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:11.803883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:11.804529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:11.822288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.823942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.824997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.829203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.889722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:11.890497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:11.891166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lazy-loading 'fault' on Instance uuid ca69cf0f-51e1-44c3-b6c7-909906c86a98 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:11.946157 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4a38005a-59eb-4977-8473-44b199e1c93d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca" status: 204 len: 0 microversion: 2.1 time: 0.237050 Jul 20 04:14:11.947499 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 911/1831] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:11 2022] DELETE /compute/v2.1/servers/9b242965-4af1-41f0-b2c4-01bb9a1efaca => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:11.963889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df039cb9-e5a6-468a-9e13-0d02e9766faa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '.version_select at 0x7fb841e61040>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.024812 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-df039cb9-e5a6-468a-9e13-0d02e9766faa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Image not found. Jul 20 04:14:12.025369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82ac4df5f844ec4996d939efdba9c11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443f09d183854727bdf9fe467f2ac8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df039cb9-e5a6-468a-9e13-0d02e9766faa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 HTTP/1.1 Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '12941eaf-950b-4463-b2e0-893200f5bb90'} Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 12941eaf-950b-4463-b2e0-893200f5bb90 to delete Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 12941eaf-950b-4463-b2e0-893200f5bb90 could not be found. Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.026801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df039cb9-e5a6-468a-9e13-0d02e9766faa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-df039cb9-e5a6-468a-9e13-0d02e9766faa tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90" status: 404 len: 62 microversion: 2.1 time: 0.077385 Jul 20 04:14:12.033462 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 912/1832] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] DELETE /compute/v2.1/images/12941eaf-950b-4463-b2e0-893200f5bb90 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:12.037535 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fea63bf1-be24-4623-a6b8-ff13979c89a0 tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 200 len: 1303 microversion: 2.1 time: 0.243431 Jul 20 04:14:12.038796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a436f151-dac1-4f89-85f3-970b8ba4f8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.039038 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 921/1833] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:11 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:12.058239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a436f151-dac1-4f89-85f3-970b8ba4f8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:12.069377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a436f151-dac1-4f89-85f3-970b8ba4f8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.079091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a436f151-dac1-4f89-85f3-970b8ba4f8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.080663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a436f151-dac1-4f89-85f3-970b8ba4f8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.081297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a436f151-dac1-4f89-85f3-970b8ba4f8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.098009 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a436f151-dac1-4f89-85f3-970b8ba4f8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a436f151-dac1-4f89-85f3-970b8ba4f8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 HTTP/1.1 Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'ea8ba299-71a7-44ca-94d0-574109f98bc2'} Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:12.100399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. Jul 20 04:14:12.105988 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.105988 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:12.105988 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.105988 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:12.105988 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:12.105988 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:12.105988 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:12.105988 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:12.105988 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. Jul 20 04:14:12.105988 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.108327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a436f151-dac1-4f89-85f3-970b8ba4f8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:12.109700 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a436f151-dac1-4f89-85f3-970b8ba4f8c9 tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 404 len: 111 microversion: 2.1 time: 0.075946 Jul 20 04:14:12.111239 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 913/1834] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:12 2022] DELETE /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:14:12.119582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-df93fda7-1782-4f99-8db1-1b236bbdc22f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.120245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-df93fda7-1782-4f99-8db1-1b236bbdc22f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] [instance: ea8ba299-71a7-44ca-94d0-574109f98bc2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:12.131063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1001061204", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "7cdfae11-e5cf-43d7-978c-c002ade87b5e"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:12.141993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df93fda7-1782-4f99-8db1-1b236bbdc22f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.145697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df93fda7-1782-4f99-8db1-1b236bbdc22f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.146742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df93fda7-1782-4f99-8db1-1b236bbdc22f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.147811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df93fda7-1782-4f99-8db1-1b236bbdc22f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.190306 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-df93fda7-1782-4f99-8db1-1b236bbdc22f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] HTTP exception thrown: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-df93fda7-1782-4f99-8db1-1b236bbdc22f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Request method failure captured: Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 HTTP/1.1 Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14AWvwVrMRm-xaIWh1hlUojrwISW2NvRcGYNVvvhDrlj_IqfMYCZfxfO-096BJfZ_7DEdEIfoztF4RWQ8M5S1rhIFbl4mbRSFdGPBYqzKg7-RgP7MMReAgYnmAVrexrA81McKsoSVxBhKt_Pm9cMHd4_0KHb5lCw1ir5jWXv6b6UX4g Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d95803bcc72643c995784af8507117b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d95803bcc72643c995784af8507117b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d95803bcc72643c995784af8507117b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d95803bcc72643c995784af8507117b3 Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesTestJSON-2016718990 Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8aad902393614d1fae3d0f5bf5456c06 Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesTestJSON-2016718990-project Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'ea8ba299-71a7-44ca-94d0-574109f98bc2'} Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.194007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:12.198730 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:12.198730 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:12.198730 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:12.198730 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:12.198730 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. Jul 20 04:14:12.198730 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:12.202988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-df93fda7-1782-4f99-8db1-1b236bbdc22f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] Returning 404 to user: Instance ea8ba299-71a7-44ca-94d0-574109f98bc2 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:12.203664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] validate_networks() for [('7cdfae11-e5cf-43d7-978c-c002ade87b5e', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:12.211070 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-df93fda7-1782-4f99-8db1-1b236bbdc22f tempest-ImagesTestJSON-2016718990 tempest-ImagesTestJSON-2016718990-project] 10.222.0.59 "GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2" status: 404 len: 111 microversion: 2.1 time: 0.095793 Jul 20 04:14:12.212233 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 922/1835] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:12 2022] GET /compute/v2.1/servers/ea8ba299-71a7-44ca-94d0-574109f98bc2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:12.428120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-963c5f3d-f30b-4747-840a-c8863dcd1eb3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:12.428813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-963c5f3d-f30b-4747-840a-c8863dcd1eb3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:12.447506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-963c5f3d-f30b-4747-840a-c8863dcd1eb3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.456475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-963c5f3d-f30b-4747-840a-c8863dcd1eb3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:12.457486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-963c5f3d-f30b-4747-840a-c8863dcd1eb3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:12.458842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-963c5f3d-f30b-4747-840a-c8863dcd1eb3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.245243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-963c5f3d-f30b-4747-840a-c8863dcd1eb3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.267433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-963c5f3d-f30b-4747-840a-c8863dcd1eb3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.269075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-963c5f3d-f30b-4747-840a-c8863dcd1eb3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.270338 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-963c5f3d-f30b-4747-840a-c8863dcd1eb3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.846470 Jul 20 04:14:13.270903 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 923/1836] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:12 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:13.287275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4c9b07fb-e943-4a66-b356-ed9fffea12b2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.287919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4c9b07fb-e943-4a66-b356-ed9fffea12b2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:13.298519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c9b07fb-e943-4a66-b356-ed9fffea12b2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.298979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c9b07fb-e943-4a66-b356-ed9fffea12b2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.307504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c9b07fb-e943-4a66-b356-ed9fffea12b2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.308015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c9b07fb-e943-4a66-b356-ed9fffea12b2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.521270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4c9b07fb-e943-4a66-b356-ed9fffea12b2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.530850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4c9b07fb-e943-4a66-b356-ed9fffea12b2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.539093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4c9b07fb-e943-4a66-b356-ed9fffea12b2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:13.544972 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4c9b07fb-e943-4a66-b356-ed9fffea12b2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1344 microversion: 2.25 time: 0.272239 Jul 20 04:14:13.549257 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 924/1837] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:13 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1344 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:13.554599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8eb4dbc4-a13f-46b6-aa3e-ed487fe5dcc1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.557174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8eb4dbc4-a13f-46b6-aa3e-ed487fe5dcc1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:13.574841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb4dbc4-a13f-46b6-aa3e-ed487fe5dcc1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.576159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb4dbc4-a13f-46b6-aa3e-ed487fe5dcc1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.579381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb4dbc4-a13f-46b6-aa3e-ed487fe5dcc1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.580068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb4dbc4-a13f-46b6-aa3e-ed487fe5dcc1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.636815 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8eb4dbc4-a13f-46b6-aa3e-ed487fe5dcc1 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086187 Jul 20 04:14:13.637910 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 925/1838] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:14:13 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:13.655082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0f9905a-8ffa-4ab2-acdc-6cfe81add37c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:13.655873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d0f9905a-8ffa-4ab2-acdc-6cfe81add37c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] [instance: ca69cf0f-51e1-44c3-b6c7-909906c86a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:13.661983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0f9905a-8ffa-4ab2-acdc-6cfe81add37c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.662478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0f9905a-8ffa-4ab2-acdc-6cfe81add37c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.663270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0f9905a-8ffa-4ab2-acdc-6cfe81add37c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:13.663719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0f9905a-8ffa-4ab2-acdc-6cfe81add37c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:13.695466 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d0f9905a-8ffa-4ab2-acdc-6cfe81add37c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] HTTP exception thrown: Instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 could not be found. Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0f9905a-8ffa-4ab2-acdc-6cfe81add37c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Request method failure captured: Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 HTTP/1.1 Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13-mOWaIOUL3u2C-CodKHgZaTMvXl6Ngh7isuUOfYdm3YCFUeOhSu-PnFEuAiMdymIBhufnukV_MG4sIXf2DPrbvnfMKdQ3WQYvcZXOBjKjyvv9hdypIlJnJjUBzqgtUOzVbCjV8GSM5541XNcxknmnwBv8xZFPNZC12Gak2oLolVGQ Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 443f09d183854727bdf9fe467f2ac8fd Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-MigrationsAdminTest-1284690242 Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_443f09d183854727bdf9fe467f2ac8fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-MigrationsAdminTest-1284690242 Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 443f09d183854727bdf9fe467f2ac8fd Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-MigrationsAdminTest-1284690242 Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-MigrationsAdminTest-1284690242-project Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e82ac4df5f844ec4996d939efdba9c11 Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-MigrationsAdminTest-1284690242-project Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 could not be found. Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'ca69cf0f-51e1-44c3-b6c7-909906c86a98'} Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 could not be found. Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 could not be found. Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:13.697024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:13.702971 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:13.702971 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:13.702971 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:13.702971 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:13.702971 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:13.702971 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 could not be found. Jul 20 04:14:13.702971 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:13.702971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0f9905a-8ffa-4ab2-acdc-6cfe81add37c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] Returning 404 to user: Instance ca69cf0f-51e1-44c3-b6c7-909906c86a98 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:13.702971 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d0f9905a-8ffa-4ab2-acdc-6cfe81add37c tempest-MigrationsAdminTest-1284690242 tempest-MigrationsAdminTest-1284690242-project] 10.222.0.59 "GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98" status: 404 len: 111 microversion: 2.1 time: 0.058407 Jul 20 04:14:13.714721 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 926/1839] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:13 2022] GET /compute/v2.1/servers/ca69cf0f-51e1-44c3-b6c7-909906c86a98 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:14.289676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f56dea6f-6b61-4618-b8ee-d1c3f4d55ef3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.291515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f56dea6f-6b61-4618-b8ee-d1c3f4d55ef3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:14.307158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f56dea6f-6b61-4618-b8ee-d1c3f4d55ef3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.314535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f56dea6f-6b61-4618-b8ee-d1c3f4d55ef3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.315569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f56dea6f-6b61-4618-b8ee-d1c3f4d55ef3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.316189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f56dea6f-6b61-4618-b8ee-d1c3f4d55ef3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.376837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:14.377810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:14.378527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:14.379505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:14.380369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:14.401234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.401697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.402542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.402977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.477621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Getting quotas for project cd9cdf734cb84261a283155e4d8e438a. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:14.503970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Getting quotas for user d7c6ee309819422591bc153327821a46 and project cd9cdf734cb84261a283155e4d8e438a. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:14.562877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Going to run 2 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:14.571168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:14.670599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=032ace06-ffb8-4b16-a6fb-bb5d2ab82d04,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:14.801256 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3e256fd6-203b-40a8-ac00-5cf3ef32556f tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.674122 Jul 20 04:14:14.802568 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 914/1840] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:12 2022] POST /compute/v2.1/servers => generated 32 bytes in 2677 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jul 20 04:14:14.809061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43c41311-3cdd-419a-bc9e-6f37aa0589d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:14.810414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43c41311-3cdd-419a-bc9e-6f37aa0589d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:14.826420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43c41311-3cdd-419a-bc9e-6f37aa0589d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.827944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43c41311-3cdd-419a-bc9e-6f37aa0589d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:14.829409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43c41311-3cdd-419a-bc9e-6f37aa0589d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:14.830402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43c41311-3cdd-419a-bc9e-6f37aa0589d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.320034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f56dea6f-6b61-4618-b8ee-d1c3f4d55ef3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.335679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f56dea6f-6b61-4618-b8ee-d1c3f4d55ef3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.337229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f56dea6f-6b61-4618-b8ee-d1c3f4d55ef3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.338496 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f56dea6f-6b61-4618-b8ee-d1c3f4d55ef3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 1.053060 Jul 20 04:14:15.367844 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 927/1841] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:14 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:15.378228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-03b0cfc5-74cc-41aa-a916-560b881dedcc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.379221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-03b0cfc5-74cc-41aa-a916-560b881dedcc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:15.405030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03b0cfc5-74cc-41aa-a916-560b881dedcc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.405197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03b0cfc5-74cc-41aa-a916-560b881dedcc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.405913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03b0cfc5-74cc-41aa-a916-560b881dedcc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.406393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03b0cfc5-74cc-41aa-a916-560b881dedcc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.511092 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-03b0cfc5-74cc-41aa-a916-560b881dedcc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139844 Jul 20 04:14:15.514118 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 928/1842] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:15.526841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-725c08ac-6567-4090-a734-3f47cec0c4b0 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.534416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-725c08ac-6567-4090-a734-3f47cec0c4b0 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.536239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-725c08ac-6567-4090-a734-3f47cec0c4b0 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Searching by: {'deleted': False, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:14:15.571236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-725c08ac-6567-4090-a734-3f47cec0c4b0 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.572415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-725c08ac-6567-4090-a734-3f47cec0c4b0 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.574125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-725c08ac-6567-4090-a734-3f47cec0c4b0 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.575256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-725c08ac-6567-4090-a734-3f47cec0c4b0 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.609145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-43c41311-3cdd-419a-bc9e-6f37aa0589d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.639882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-43c41311-3cdd-419a-bc9e-6f37aa0589d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.647732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-43c41311-3cdd-419a-bc9e-6f37aa0589d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:15.652238 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43c41311-3cdd-419a-bc9e-6f37aa0589d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1411 microversion: 2.25 time: 0.848286 Jul 20 04:14:15.655230 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 915/1843] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:14 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1411 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:15.747117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-725c08ac-6567-4090-a734-3f47cec0c4b0 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:14:15.862437 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-725c08ac-6567-4090-a734-3f47cec0c4b0 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.346356 Jul 20 04:14:15.891793 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 929/1844] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/servers => generated 1337 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:15.905216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6707bc87-044d-4747-abf6-2c03167411d5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:15.906221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6707bc87-044d-4747-abf6-2c03167411d5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:15.945165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4faaa277-3a09-4075-a5be-dbb683a7c284 req-d20cce6e-5781-4e24-b768-79678d2caf92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4e9b05-2015-4e30-b844-d2396aa46eda", "name": "network-vif-deleted", "tag": "e4f55595-f2e2-400c-9323-28f3878fad95"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:15.967610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4faaa277-3a09-4075-a5be-dbb683a7c284 req-d20cce6e-5781-4e24-b768-79678d2caf92 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:15.968455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4faaa277-3a09-4075-a5be-dbb683a7c284 req-d20cce6e-5781-4e24-b768-79678d2caf92 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:15.997573 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4faaa277-3a09-4075-a5be-dbb683a7c284 req-d20cce6e-5781-4e24-b768-79678d2caf92 service nova] Creating event network-vif-deleted:e4f55595-f2e2-400c-9323-28f3878fad95 for instance 1a4e9b05-2015-4e30-b844-d2396aa46eda on n-h1-760456-11 Jul 20 04:14:16.006665 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4faaa277-3a09-4075-a5be-dbb683a7c284 req-d20cce6e-5781-4e24-b768-79678d2caf92 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064982 Jul 20 04:14:16.013752 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 930/1845] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:16.163234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6707bc87-044d-4747-abf6-2c03167411d5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:16.174383 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6707bc87-044d-4747-abf6-2c03167411d5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1218 microversion: 2.1 time: 0.275640 Jul 20 04:14:16.188439 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 916/1846] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:15 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1218 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:16.290364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c13d89bb-694c-457a-89c7-560f1910a8b3 req-6efd7cc4-7850-4942-a8a1-c83fce6d9e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b242965-4af1-41f0-b2c4-01bb9a1efaca", "name": "network-vif-deleted", "tag": "45ddea36-046a-4574-bdfb-06d91c5443b1"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:16.316764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c13d89bb-694c-457a-89c7-560f1910a8b3 req-6efd7cc4-7850-4942-a8a1-c83fce6d9e09 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.334502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c13d89bb-694c-457a-89c7-560f1910a8b3 req-6efd7cc4-7850-4942-a8a1-c83fce6d9e09 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.366417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ede3a87-1151-4276-8d1b-a301bdc26051 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:16.368824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ede3a87-1151-4276-8d1b-a301bdc26051 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:16.397040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ede3a87-1151-4276-8d1b-a301bdc26051 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.397511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ede3a87-1151-4276-8d1b-a301bdc26051 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.398367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ede3a87-1151-4276-8d1b-a301bdc26051 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.398818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ede3a87-1151-4276-8d1b-a301bdc26051 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.416621 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c13d89bb-694c-457a-89c7-560f1910a8b3 req-6efd7cc4-7850-4942-a8a1-c83fce6d9e09 service nova] Creating event network-vif-deleted:45ddea36-046a-4574-bdfb-06d91c5443b1 for instance 9b242965-4af1-41f0-b2c4-01bb9a1efaca on n-h2-760456-11 Jul 20 04:14:16.443589 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c13d89bb-694c-457a-89c7-560f1910a8b3 req-6efd7cc4-7850-4942-a8a1-c83fce6d9e09 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159284 Jul 20 04:14:16.447446 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 931/1847] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:16.527246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d3102a9-7c60-4902-b3f3-596b8dd645b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:16.528375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d3102a9-7c60-4902-b3f3-596b8dd645b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:16.541791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:16.546696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d3102a9-7c60-4902-b3f3-596b8dd645b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.547166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d3102a9-7c60-4902-b3f3-596b8dd645b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.547981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d3102a9-7c60-4902-b3f3-596b8dd645b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.548435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d3102a9-7c60-4902-b3f3-596b8dd645b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.649612 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d3102a9-7c60-4902-b3f3-596b8dd645b9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127165 Jul 20 04:14:16.651509 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 932/1848] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:14:16 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:16.676471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc864fc6-deb6-4a3d-9203-3e8ccef595b3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:16.677500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc864fc6-deb6-4a3d-9203-3e8ccef595b3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:16.703405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc864fc6-deb6-4a3d-9203-3e8ccef595b3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.704487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc864fc6-deb6-4a3d-9203-3e8ccef595b3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:16.705906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc864fc6-deb6-4a3d-9203-3e8ccef595b3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:16.706616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc864fc6-deb6-4a3d-9203-3e8ccef595b3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.718796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc864fc6-deb6-4a3d-9203-3e8ccef595b3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.749653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc864fc6-deb6-4a3d-9203-3e8ccef595b3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.758583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc864fc6-deb6-4a3d-9203-3e8ccef595b3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.765438 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc864fc6-deb6-4a3d-9203-3e8ccef595b3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1411 microversion: 2.25 time: 1.090939 Jul 20 04:14:17.766740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ede3a87-1151-4276-8d1b-a301bdc26051 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.772005 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 933/1849] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:16 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1411 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:17.786332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ede3a87-1151-4276-8d1b-a301bdc26051 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.788007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ede3a87-1151-4276-8d1b-a301bdc26051 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:17.789602 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ede3a87-1151-4276-8d1b-a301bdc26051 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 1.436545 Jul 20 04:14:17.801313 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 917/1850] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:16 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:17.801566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9a36dc7a-f2ec-48d9-bf5c-fd9b7147fdaa tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:17.801566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9a36dc7a-f2ec-48d9-bf5c-fd9b7147fdaa tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:17.805107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-abb08124-f052-4147-9eae-80b4575b1629 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:17.806054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-abb08124-f052-4147-9eae-80b4575b1629 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:17.826052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abb08124-f052-4147-9eae-80b4575b1629 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.836846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a36dc7a-f2ec-48d9-bf5c-fd9b7147fdaa tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.838704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abb08124-f052-4147-9eae-80b4575b1629 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.839142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a36dc7a-f2ec-48d9-bf5c-fd9b7147fdaa tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.839978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abb08124-f052-4147-9eae-80b4575b1629 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.840446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abb08124-f052-4147-9eae-80b4575b1629 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.845226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a36dc7a-f2ec-48d9-bf5c-fd9b7147fdaa tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:17.845752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a36dc7a-f2ec-48d9-bf5c-fd9b7147fdaa tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:17.974584 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-abb08124-f052-4147-9eae-80b4575b1629 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176610 Jul 20 04:14:17.976141 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 918/1851] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:14:17 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:18.071203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9a36dc7a-f2ec-48d9-bf5c-fd9b7147fdaa tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:18.083780 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9a36dc7a-f2ec-48d9-bf5c-fd9b7147fdaa tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1278 microversion: 2.1 time: 0.310090 Jul 20 04:14:18.084391 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 934/1852] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:17 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1278 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:18.789059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-229275f0-891c-4aa4-852d-c0cfce121bf9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:18.789684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-229275f0-891c-4aa4-852d-c0cfce121bf9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:18.809768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-229275f0-891c-4aa4-852d-c0cfce121bf9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.810889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a021d407-034f-46bd-b486-89357749ab3a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:18.811600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a021d407-034f-46bd-b486-89357749ab3a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:18.811874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-229275f0-891c-4aa4-852d-c0cfce121bf9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.812968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-229275f0-891c-4aa4-852d-c0cfce121bf9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.813629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-229275f0-891c-4aa4-852d-c0cfce121bf9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.824690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a021d407-034f-46bd-b486-89357749ab3a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.826507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a021d407-034f-46bd-b486-89357749ab3a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:18.827434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a021d407-034f-46bd-b486-89357749ab3a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:18.829235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a021d407-034f-46bd-b486-89357749ab3a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.271366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a021d407-034f-46bd-b486-89357749ab3a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.290359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a021d407-034f-46bd-b486-89357749ab3a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.296862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a021d407-034f-46bd-b486-89357749ab3a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.300698 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a021d407-034f-46bd-b486-89357749ab3a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.492909 Jul 20 04:14:19.303375 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 935/1853] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:18 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:19.319236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62926793-216a-4812-9ed4-04b3a2f9d3c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.320618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-62926793-216a-4812-9ed4-04b3a2f9d3c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:19.339126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62926793-216a-4812-9ed4-04b3a2f9d3c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.340216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62926793-216a-4812-9ed4-04b3a2f9d3c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.341567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62926793-216a-4812-9ed4-04b3a2f9d3c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.342585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62926793-216a-4812-9ed4-04b3a2f9d3c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.445294 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62926793-216a-4812-9ed4-04b3a2f9d3c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140518 Jul 20 04:14:19.452678 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 936/1854] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:14:19 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:19.465925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-19e378c7-b0e0-45c5-9579-f5e830ee1769 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:19.471010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-19e378c7-b0e0-45c5-9579-f5e830ee1769 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:19.492555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19e378c7-b0e0-45c5-9579-f5e830ee1769 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.493317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19e378c7-b0e0-45c5-9579-f5e830ee1769 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.495233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19e378c7-b0e0-45c5-9579-f5e830ee1769 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:19.496975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19e378c7-b0e0-45c5-9579-f5e830ee1769 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:19.561571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:19.816224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-229275f0-891c-4aa4-852d-c0cfce121bf9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.831951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-229275f0-891c-4aa4-852d-c0cfce121bf9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.834853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:19.837924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-229275f0-891c-4aa4-852d-c0cfce121bf9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:19.850348 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-229275f0-891c-4aa4-852d-c0cfce121bf9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1411 microversion: 2.25 time: 1.061424 Jul 20 04:14:19.853383 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 919/1855] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:18 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1411 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:20.319476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0870fe55-6a77-47b5-bf9b-47fa5d5d23a5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.320435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0870fe55-6a77-47b5-bf9b-47fa5d5d23a5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:20.331432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0870fe55-6a77-47b5-bf9b-47fa5d5d23a5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.333340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0870fe55-6a77-47b5-bf9b-47fa5d5d23a5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.336526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0870fe55-6a77-47b5-bf9b-47fa5d5d23a5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.337300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0870fe55-6a77-47b5-bf9b-47fa5d5d23a5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.589388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-19e378c7-b0e0-45c5-9579-f5e830ee1769 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:20.611016 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-19e378c7-b0e0-45c5-9579-f5e830ee1769 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1276 microversion: 2.1 time: 1.156853 Jul 20 04:14:20.622056 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 937/1856] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:19 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1276 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:20.633785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fce6edbc-eeed-4c0a-a55b-4498329005f9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:20.634764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fce6edbc-eeed-4c0a-a55b-4498329005f9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:20.649723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fce6edbc-eeed-4c0a-a55b-4498329005f9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.651363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fce6edbc-eeed-4c0a-a55b-4498329005f9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.653023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fce6edbc-eeed-4c0a-a55b-4498329005f9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.653526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fce6edbc-eeed-4c0a-a55b-4498329005f9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.788362 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fce6edbc-eeed-4c0a-a55b-4498329005f9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170177 Jul 20 04:14:20.793244 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 938/1857] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:20.816892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a0c467a5-3394-4fd8-9e0e-631b96af2728 req-8cffaea4-64f3-459a-aa41-17d708af214c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358c5f50-cf9e-4577-a295-0aa87e318810", "tag": "2cc5c8d5-88eb-4ddb-b127-216dd5aef81c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:20.841437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a0c467a5-3394-4fd8-9e0e-631b96af2728 req-8cffaea4-64f3-459a-aa41-17d708af214c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:20.842851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a0c467a5-3394-4fd8-9e0e-631b96af2728 req-8cffaea4-64f3-459a-aa41-17d708af214c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:20.871415 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a0c467a5-3394-4fd8-9e0e-631b96af2728 req-8cffaea4-64f3-459a-aa41-17d708af214c service nova] Creating event network-changed:2cc5c8d5-88eb-4ddb-b127-216dd5aef81c for instance 358c5f50-cf9e-4577-a295-0aa87e318810 on n-h2-760456-11 Jul 20 04:14:20.883418 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a0c467a5-3394-4fd8-9e0e-631b96af2728 req-8cffaea4-64f3-459a-aa41-17d708af214c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088852 Jul 20 04:14:20.887700 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 939/1858] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:21.490039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f268ae90-11b2-4a7c-96fd-b9abd7958008 tempest-AZV2TestJSON-1880445365 tempest-AZV2TestJSON-1880445365-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:21.492644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f268ae90-11b2-4a7c-96fd-b9abd7958008 tempest-AZV2TestJSON-1880445365 tempest-AZV2TestJSON-1880445365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.493172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f268ae90-11b2-4a7c-96fd-b9abd7958008 tempest-AZV2TestJSON-1880445365 tempest-AZV2TestJSON-1880445365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.494001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f268ae90-11b2-4a7c-96fd-b9abd7958008 tempest-AZV2TestJSON-1880445365 tempest-AZV2TestJSON-1880445365-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.494469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f268ae90-11b2-4a7c-96fd-b9abd7958008 tempest-AZV2TestJSON-1880445365 tempest-AZV2TestJSON-1880445365-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.555469 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f268ae90-11b2-4a7c-96fd-b9abd7958008 tempest-AZV2TestJSON-1880445365 tempest-AZV2TestJSON-1880445365-project] 10.222.0.59 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.665547 Jul 20 04:14:21.563509 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 940/1859] 10.222.0.59 () {58 vars in 1163 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:21.580822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e092585-627e-4673-9c12-475dd9dbd47d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:21.581590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e092585-627e-4673-9c12-475dd9dbd47d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:21.615401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e092585-627e-4673-9c12-475dd9dbd47d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.615908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e092585-627e-4673-9c12-475dd9dbd47d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:21.623366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e092585-627e-4673-9c12-475dd9dbd47d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:21.623925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e092585-627e-4673-9c12-475dd9dbd47d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.033468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0870fe55-6a77-47b5-bf9b-47fa5d5d23a5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.056765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0870fe55-6a77-47b5-bf9b-47fa5d5d23a5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.063126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0870fe55-6a77-47b5-bf9b-47fa5d5d23a5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.067883 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0870fe55-6a77-47b5-bf9b-47fa5d5d23a5 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 1.751944 Jul 20 04:14:22.070694 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 920/1860] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:20 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:22.114741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec991da6-cef9-42e0-86c8-c939db523c01 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:22.115404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ec991da6-cef9-42e0-86c8-c939db523c01 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:22.155948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec991da6-cef9-42e0-86c8-c939db523c01 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.156726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec991da6-cef9-42e0-86c8-c939db523c01 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.162535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec991da6-cef9-42e0-86c8-c939db523c01 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.163320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec991da6-cef9-42e0-86c8-c939db523c01 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.236672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e092585-627e-4673-9c12-475dd9dbd47d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.256277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e092585-627e-4673-9c12-475dd9dbd47d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.263911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e092585-627e-4673-9c12-475dd9dbd47d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.266936 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e092585-627e-4673-9c12-475dd9dbd47d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1411 microversion: 2.25 time: 0.707245 Jul 20 04:14:22.272938 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 941/1861] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:21 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1411 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:22.286209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7538d591-7bed-4bf0-a84a-038796c3a152 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:22.287346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7538d591-7bed-4bf0-a84a-038796c3a152 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:22.294317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7538d591-7bed-4bf0-a84a-038796c3a152 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.295093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7538d591-7bed-4bf0-a84a-038796c3a152 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.296413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7538d591-7bed-4bf0-a84a-038796c3a152 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.297000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7538d591-7bed-4bf0-a84a-038796c3a152 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.342327 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7538d591-7bed-4bf0-a84a-038796c3a152 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066646 Jul 20 04:14:22.346546 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 942/1862] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:14:22 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:22.434021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ec991da6-cef9-42e0-86c8-c939db523c01 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:22.459568 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec991da6-cef9-42e0-86c8-c939db523c01 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1276 microversion: 2.1 time: 0.372677 Jul 20 04:14:22.461502 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 921/1863] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:22 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1276 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:22.502465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a7981557-1bc9-4030-a43f-01403737474d req-af86582a-12c9-4ae1-a316-58b725053a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-plugged", "status": "completed", "tag": "d7d5ae22-6a79-44a5-8895-e9cb3dfd5596"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:22.520888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a7981557-1bc9-4030-a43f-01403737474d req-af86582a-12c9-4ae1-a316-58b725053a1e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:22.526978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a7981557-1bc9-4030-a43f-01403737474d req-af86582a-12c9-4ae1-a316-58b725053a1e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:22.556012 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a7981557-1bc9-4030-a43f-01403737474d req-af86582a-12c9-4ae1-a316-58b725053a1e service nova] Creating event network-vif-plugged:d7d5ae22-6a79-44a5-8895-e9cb3dfd5596 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:14:22.572342 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a7981557-1bc9-4030-a43f-01403737474d req-af86582a-12c9-4ae1-a316-58b725053a1e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073082 Jul 20 04:14:22.574881 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 922/1864] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:22.820206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-947aa852-5938-44b3-a408-71445526efc0 tempest-SecurityGroupsTestAdminJSON-1373502302 tempest-SecurityGroupsTestAdminJSON-1373502302-project] Action: 'create', calling method: .version_select at 0x7fb841a960d0>, body: {"security_group": {"name": "tempest-securitygroup-1101976299", "description": "tempest-description-673114015"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:23.089806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c21b943-23fe-4809-b0fa-b6acefb9f686 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:23.090622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8c21b943-23fe-4809-b0fa-b6acefb9f686 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:23.115301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c21b943-23fe-4809-b0fa-b6acefb9f686 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.115759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c21b943-23fe-4809-b0fa-b6acefb9f686 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.116552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c21b943-23fe-4809-b0fa-b6acefb9f686 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:23.116998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c21b943-23fe-4809-b0fa-b6acefb9f686 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:23.984219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8c21b943-23fe-4809-b0fa-b6acefb9f686 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.073805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8c21b943-23fe-4809-b0fa-b6acefb9f686 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.085830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8c21b943-23fe-4809-b0fa-b6acefb9f686 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:24.087268 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c21b943-23fe-4809-b0fa-b6acefb9f686 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 1.001754 Jul 20 04:14:24.090490 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 923/1865] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:23 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:24.105253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e0f293aa-4301-46ef-abb0-edc73f88b4ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.106511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e0f293aa-4301-46ef-abb0-edc73f88b4ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.126492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0f293aa-4301-46ef-abb0-edc73f88b4ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.127385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0f293aa-4301-46ef-abb0-edc73f88b4ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.128545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0f293aa-4301-46ef-abb0-edc73f88b4ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.129148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0f293aa-4301-46ef-abb0-edc73f88b4ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.191521 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-947aa852-5938-44b3-a408-71445526efc0 tempest-SecurityGroupsTestAdminJSON-1373502302 tempest-SecurityGroupsTestAdminJSON-1373502302-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.843729 Jul 20 04:14:24.192134 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 943/1866] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:22 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:24.208188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b8cab251-c30d-4698-88a8-544dc93fc493 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.209212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b8cab251-c30d-4698-88a8-544dc93fc493 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.224087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8cab251-c30d-4698-88a8-544dc93fc493 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.224546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8cab251-c30d-4698-88a8-544dc93fc493 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.225339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8cab251-c30d-4698-88a8-544dc93fc493 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.225781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8cab251-c30d-4698-88a8-544dc93fc493 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.316287 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b8cab251-c30d-4698-88a8-544dc93fc493 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116653 Jul 20 04:14:24.316885 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 944/1867] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:14:24 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:24.331904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2a2d0b6c-8241-47c7-aff3-7787b25dc88d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:24.347331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2a2d0b6c-8241-47c7-aff3-7787b25dc88d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:24.369660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a2d0b6c-8241-47c7-aff3-7787b25dc88d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.370106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a2d0b6c-8241-47c7-aff3-7787b25dc88d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.371043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a2d0b6c-8241-47c7-aff3-7787b25dc88d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:24.371487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a2d0b6c-8241-47c7-aff3-7787b25dc88d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:24.445934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:25.183975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2a2d0b6c-8241-47c7-aff3-7787b25dc88d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:25.218977 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2a2d0b6c-8241-47c7-aff3-7787b25dc88d tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1318 microversion: 2.1 time: 0.883847 Jul 20 04:14:25.232070 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 945/1868] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:24 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1318 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:25.246633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4f18ba2e-2859-4800-b599-3d26722a8c38 tempest-SecurityGroupsTestAdminJSON-1373502302 tempest-SecurityGroupsTestAdminJSON-1373502302-project] Action: 'create', calling method: .version_select at 0x7fb841b239d0>, body: {"security_group": {"name": "tempest-securitygroup-930817975", "description": "tempest-description-985328921"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:25.335407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e0f293aa-4301-46ef-abb0-edc73f88b4ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:25.359047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e0f293aa-4301-46ef-abb0-edc73f88b4ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:25.368257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e0f293aa-4301-46ef-abb0-edc73f88b4ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:25.371360 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e0f293aa-4301-46ef-abb0-edc73f88b4ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1411 microversion: 2.25 time: 1.277746 Jul 20 04:14:25.376813 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 924/1869] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:24 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1411 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:25.395294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2da3014c-2e5f-40d4-9f2e-aefd3184d51e req-c05919d2-cee4-4c63-b52f-ce2d4400bfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-plugged", "status": "completed", "tag": "34ed3285-dde5-4027-a99c-c92741329ec4"}, {"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-plugged", "status": "completed", "tag": "de42dbfb-8539-4cfd-926d-fee4979c1aba"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:25.431118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2da3014c-2e5f-40d4-9f2e-aefd3184d51e req-c05919d2-cee4-4c63-b52f-ce2d4400bfd4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.432078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2da3014c-2e5f-40d4-9f2e-aefd3184d51e req-c05919d2-cee4-4c63-b52f-ce2d4400bfd4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.491324 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2da3014c-2e5f-40d4-9f2e-aefd3184d51e req-c05919d2-cee4-4c63-b52f-ce2d4400bfd4 service nova] Creating event network-vif-plugged:34ed3285-dde5-4027-a99c-c92741329ec4 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:14:25.492715 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2da3014c-2e5f-40d4-9f2e-aefd3184d51e req-c05919d2-cee4-4c63-b52f-ce2d4400bfd4 service nova] Creating event network-vif-plugged:de42dbfb-8539-4cfd-926d-fee4979c1aba for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:14:25.505698 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2da3014c-2e5f-40d4-9f2e-aefd3184d51e req-c05919d2-cee4-4c63-b52f-ce2d4400bfd4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125472 Jul 20 04:14:25.507289 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 925/1870] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:25.515561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f83ec5d7-de86-4348-98b9-fc8d12baa0b8 req-8cd0878a-07a4-446b-9035-5474a87b3e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032ace06-ffb8-4b16-a6fb-bb5d2ab82d04", "tag": "00f3d5aa-762d-419f-8a8a-d6ca6eb75bfc"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:25.532374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f83ec5d7-de86-4348-98b9-fc8d12baa0b8 req-8cd0878a-07a4-446b-9035-5474a87b3e4b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.532825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f83ec5d7-de86-4348-98b9-fc8d12baa0b8 req-8cd0878a-07a4-446b-9035-5474a87b3e4b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.548706 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f83ec5d7-de86-4348-98b9-fc8d12baa0b8 req-8cd0878a-07a4-446b-9035-5474a87b3e4b service nova] Creating event network-changed:00f3d5aa-762d-419f-8a8a-d6ca6eb75bfc for instance 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 on n-h1-760456-11 Jul 20 04:14:25.553862 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f83ec5d7-de86-4348-98b9-fc8d12baa0b8 req-8cd0878a-07a4-446b-9035-5474a87b3e4b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044889 Jul 20 04:14:25.555742 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 926/1871] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:25.563829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a52bcfe7-5b5a-46bd-ac8c-477ad7685caa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:25.565813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a52bcfe7-5b5a-46bd-ac8c-477ad7685caa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:25.578543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a52bcfe7-5b5a-46bd-ac8c-477ad7685caa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.579353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a52bcfe7-5b5a-46bd-ac8c-477ad7685caa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.580377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a52bcfe7-5b5a-46bd-ac8c-477ad7685caa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:25.580981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a52bcfe7-5b5a-46bd-ac8c-477ad7685caa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:25.872844 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4f18ba2e-2859-4800-b599-3d26722a8c38 tempest-SecurityGroupsTestAdminJSON-1373502302 tempest-SecurityGroupsTestAdminJSON-1373502302-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.637494 Jul 20 04:14:25.873662 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 946/1872] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:25 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:26.172641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=14 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:26.308868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4823116a-22d3-426a-93a6-312d49378ba8 tempest-SecurityGroupsTestAdminJSON-174739133 tempest-SecurityGroupsTestAdminJSON-174739133-project-admin] Action: 'create', calling method: .version_select at 0x7fb841bddb80>, body: {"security_group": {"name": "tempest-securitygroup-1824867810", "description": "tempest-description-339938729"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:26.978193 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4823116a-22d3-426a-93a6-312d49378ba8 tempest-SecurityGroupsTestAdminJSON-174739133 tempest-SecurityGroupsTestAdminJSON-174739133-project-admin] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.094228 Jul 20 04:14:26.986342 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 947/1873] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:25 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:26.991422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3dd6e864-879c-4b23-a6d4-db4a23ac6e06 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:26.992046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3dd6e864-879c-4b23-a6d4-db4a23ac6e06 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:27.009043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3dd6e864-879c-4b23-a6d4-db4a23ac6e06 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.009499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3dd6e864-879c-4b23-a6d4-db4a23ac6e06 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.010329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3dd6e864-879c-4b23-a6d4-db4a23ac6e06 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.016377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3dd6e864-879c-4b23-a6d4-db4a23ac6e06 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.416688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a52bcfe7-5b5a-46bd-ac8c-477ad7685caa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:27.435956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a52bcfe7-5b5a-46bd-ac8c-477ad7685caa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:27.448845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a52bcfe7-5b5a-46bd-ac8c-477ad7685caa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:27.458225 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a52bcfe7-5b5a-46bd-ac8c-477ad7685caa tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 1.899848 Jul 20 04:14:27.462532 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 927/1874] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:25 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:27.481584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b30eaedc-58cd-4e4a-935b-8ec12cac399f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:27.487314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b30eaedc-58cd-4e4a-935b-8ec12cac399f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:27.496154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:27.516469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b30eaedc-58cd-4e4a-935b-8ec12cac399f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.517618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b30eaedc-58cd-4e4a-935b-8ec12cac399f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:27.519805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b30eaedc-58cd-4e4a-935b-8ec12cac399f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:27.520576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b30eaedc-58cd-4e4a-935b-8ec12cac399f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.006844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b30eaedc-58cd-4e4a-935b-8ec12cac399f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.016707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b30eaedc-58cd-4e4a-935b-8ec12cac399f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.027645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b30eaedc-58cd-4e4a-935b-8ec12cac399f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.031696 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b30eaedc-58cd-4e4a-935b-8ec12cac399f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1411 microversion: 2.25 time: 0.566434 Jul 20 04:14:28.034334 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 928/1875] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:27 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1411 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:28.046799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-985b65c0-9e61-421b-9706-646f0888dc4f tempest-SecurityGroupsTestAdminJSON-174739133 tempest-SecurityGroupsTestAdminJSON-174739133-project-admin] Action: 'create', calling method: .version_select at 0x7fb841d1a5e0>, body: {"security_group": {"name": "tempest-securitygroup-935871900", "description": "tempest-description-1034948027"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:28.118641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3dd6e864-879c-4b23-a6d4-db4a23ac6e06 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:28.156790 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3dd6e864-879c-4b23-a6d4-db4a23ac6e06 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1318 microversion: 2.1 time: 1.169586 Jul 20 04:14:28.158561 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 948/1876] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:26 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1318 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:28.167484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5c9d25f2-aa49-45a2-b8b9-382ccb0a0d23 req-bc274e8e-2814-4da0-9b0c-11e2e680acf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-plugged", "status": "completed", "tag": "4437228e-d8f6-466d-873b-2e507d95f8fb"}, {"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-plugged", "status": "completed", "tag": "6cd82c0a-6158-4750-9342-bab7ea3f563d"}, {"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-plugged", "status": "completed", "tag": "58c84e4d-21a1-4739-b37c-080f055491f3"}, {"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-plugged", "status": "completed", "tag": "c6f02ab9-a2a7-47dd-896e-14309db365f1"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:28.212114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5c9d25f2-aa49-45a2-b8b9-382ccb0a0d23 req-bc274e8e-2814-4da0-9b0c-11e2e680acf4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.212685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5c9d25f2-aa49-45a2-b8b9-382ccb0a0d23 req-bc274e8e-2814-4da0-9b0c-11e2e680acf4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.241026 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5c9d25f2-aa49-45a2-b8b9-382ccb0a0d23 req-bc274e8e-2814-4da0-9b0c-11e2e680acf4 service nova] Creating event network-vif-plugged:4437228e-d8f6-466d-873b-2e507d95f8fb for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:14:28.242508 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5c9d25f2-aa49-45a2-b8b9-382ccb0a0d23 req-bc274e8e-2814-4da0-9b0c-11e2e680acf4 service nova] Creating event network-vif-plugged:6cd82c0a-6158-4750-9342-bab7ea3f563d for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:14:28.249532 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5c9d25f2-aa49-45a2-b8b9-382ccb0a0d23 req-bc274e8e-2814-4da0-9b0c-11e2e680acf4 service nova] Creating event network-vif-plugged:58c84e4d-21a1-4739-b37c-080f055491f3 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:14:28.251310 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5c9d25f2-aa49-45a2-b8b9-382ccb0a0d23 req-bc274e8e-2814-4da0-9b0c-11e2e680acf4 service nova] Creating event network-vif-plugged:c6f02ab9-a2a7-47dd-896e-14309db365f1 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:14:28.291414 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5c9d25f2-aa49-45a2-b8b9-382ccb0a0d23 req-bc274e8e-2814-4da0-9b0c-11e2e680acf4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.128482 Jul 20 04:14:28.292056 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 949/1877] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:28.319947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-14032b40-fb20-4c7a-8ee9-4f54c0b787ca req-750d2e93-e516-4c21-a58e-4cd2898ad18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935be60e-ab59-41f1-a2a6-9a911c5da492", "tag": "d0366831-d28c-4177-a2e0-737988cd1d5b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:28.355017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-14032b40-fb20-4c7a-8ee9-4f54c0b787ca req-750d2e93-e516-4c21-a58e-4cd2898ad18c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.356516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-14032b40-fb20-4c7a-8ee9-4f54c0b787ca req-750d2e93-e516-4c21-a58e-4cd2898ad18c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.386303 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-14032b40-fb20-4c7a-8ee9-4f54c0b787ca req-750d2e93-e516-4c21-a58e-4cd2898ad18c service nova] Creating event network-changed:d0366831-d28c-4177-a2e0-737988cd1d5b for instance 935be60e-ab59-41f1-a2a6-9a911c5da492 on n-h2-760456-11 Jul 20 04:14:28.393761 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-14032b40-fb20-4c7a-8ee9-4f54c0b787ca req-750d2e93-e516-4c21-a58e-4cd2898ad18c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100299 Jul 20 04:14:28.395467 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 950/1878] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:28.478992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a281435d-868c-44a2-ba61-e65d55ed46fb tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:28.479762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a281435d-868c-44a2-ba61-e65d55ed46fb tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:28.491547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a281435d-868c-44a2-ba61-e65d55ed46fb tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.498728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a281435d-868c-44a2-ba61-e65d55ed46fb tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:28.499897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a281435d-868c-44a2-ba61-e65d55ed46fb tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:28.500537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a281435d-868c-44a2-ba61-e65d55ed46fb tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:29.020192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a281435d-868c-44a2-ba61-e65d55ed46fb tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:29.036354 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-985b65c0-9e61-421b-9706-646f0888dc4f tempest-SecurityGroupsTestAdminJSON-174739133 tempest-SecurityGroupsTestAdminJSON-174739133-project-admin] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.000713 Jul 20 04:14:29.037745 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 929/1879] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:14:28 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:29.045159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a281435d-868c-44a2-ba61-e65d55ed46fb tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:29.049304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b379f87c-2fda-482f-bf72-a0ddb3a98103 tempest-SecurityGroupsTestAdminJSON-174739133 tempest-SecurityGroupsTestAdminJSON-174739133-project-admin] Calling method '.version_select at 0x7fb841db2e50>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:29.052570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a281435d-868c-44a2-ba61-e65d55ed46fb tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:29.057455 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a281435d-868c-44a2-ba61-e65d55ed46fb tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.580809 Jul 20 04:14:29.060332 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 951/1880] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:28 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:29.080882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0f8b5f06-c66d-400d-a8e5-ff3188bbd5ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:29.081556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0f8b5f06-c66d-400d-a8e5-ff3188bbd5ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:29.110841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f8b5f06-c66d-400d-a8e5-ff3188bbd5ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.111303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f8b5f06-c66d-400d-a8e5-ff3188bbd5ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:29.113297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f8b5f06-c66d-400d-a8e5-ff3188bbd5ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.113759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0f8b5f06-c66d-400d-a8e5-ff3188bbd5ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:29.634813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0f8b5f06-c66d-400d-a8e5-ff3188bbd5ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:29.651087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0f8b5f06-c66d-400d-a8e5-ff3188bbd5ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:29.656882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0f8b5f06-c66d-400d-a8e5-ff3188bbd5ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:29.658955 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0f8b5f06-c66d-400d-a8e5-ff3188bbd5ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1411 microversion: 2.25 time: 0.595124 Jul 20 04:14:29.660452 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 952/1881] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:29 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1411 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:29.676819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f843522c-4a00-4a34-aac5-0517073b21b5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:29.677718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f843522c-4a00-4a34-aac5-0517073b21b5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:29.684942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f843522c-4a00-4a34-aac5-0517073b21b5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.685675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f843522c-4a00-4a34-aac5-0517073b21b5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:29.686833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f843522c-4a00-4a34-aac5-0517073b21b5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:29.687443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f843522c-4a00-4a34-aac5-0517073b21b5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.186727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f843522c-4a00-4a34-aac5-0517073b21b5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:30.197702 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f843522c-4a00-4a34-aac5-0517073b21b5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1318 microversion: 2.1 time: 0.523498 Jul 20 04:14:30.198882 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 953/1882] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:29 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:30.205585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-795be4e7-ff54-4c62-9055-8fdd38b57e0e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:30.206569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-795be4e7-ff54-4c62-9055-8fdd38b57e0e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:30.216948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-795be4e7-ff54-4c62-9055-8fdd38b57e0e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.218518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-795be4e7-ff54-4c62-9055-8fdd38b57e0e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.219853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-795be4e7-ff54-4c62-9055-8fdd38b57e0e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.220468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-795be4e7-ff54-4c62-9055-8fdd38b57e0e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.572876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-795be4e7-ff54-4c62-9055-8fdd38b57e0e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:30.588763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-795be4e7-ff54-4c62-9055-8fdd38b57e0e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:30.591891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-795be4e7-ff54-4c62-9055-8fdd38b57e0e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:30.593450 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-795be4e7-ff54-4c62-9055-8fdd38b57e0e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1879 microversion: 2.42 time: 0.393382 Jul 20 04:14:30.594760 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 954/1883] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:30 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1879 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:30.602050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-7aae383f-577f-45fa-8a8e-abb71ac87f22 req-3ac57012-1fb0-4db4-b0b8-c9a14c134fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358c5f50-cf9e-4577-a295-0aa87e318810", "name": "network-vif-plugged", "status": "completed", "tag": "2cc5c8d5-88eb-4ddb-b127-216dd5aef81c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:30.617384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7aae383f-577f-45fa-8a8e-abb71ac87f22 req-3ac57012-1fb0-4db4-b0b8-c9a14c134fe5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.618880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7aae383f-577f-45fa-8a8e-abb71ac87f22 req-3ac57012-1fb0-4db4-b0b8-c9a14c134fe5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.635175 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-7aae383f-577f-45fa-8a8e-abb71ac87f22 req-3ac57012-1fb0-4db4-b0b8-c9a14c134fe5 service nova] Creating event network-vif-plugged:2cc5c8d5-88eb-4ddb-b127-216dd5aef81c for instance 358c5f50-cf9e-4577-a295-0aa87e318810 on n-h2-760456-11 Jul 20 04:14:30.668094 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-7aae383f-577f-45fa-8a8e-abb71ac87f22 req-3ac57012-1fb0-4db4-b0b8-c9a14c134fe5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057678 Jul 20 04:14:30.668897 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 955/1884] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:30.686471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4f504096-4226-43cc-9e58-247f9d3802f6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:30.691405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4f504096-4226-43cc-9e58-247f9d3802f6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:30.731429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f504096-4226-43cc-9e58-247f9d3802f6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.731882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f504096-4226-43cc-9e58-247f9d3802f6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:30.733054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f504096-4226-43cc-9e58-247f9d3802f6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:30.734569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f504096-4226-43cc-9e58-247f9d3802f6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.096314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4f504096-4226-43cc-9e58-247f9d3802f6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:31.117688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4f504096-4226-43cc-9e58-247f9d3802f6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:31.162605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4f504096-4226-43cc-9e58-247f9d3802f6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:31.163946 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4f504096-4226-43cc-9e58-247f9d3802f6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1411 microversion: 2.25 time: 0.489200 Jul 20 04:14:31.179062 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 956/1885] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:30 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1411 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:31.219272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-624f27fe-a97c-4ee2-bf48-baf3139a3070 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:31.220404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-624f27fe-a97c-4ee2-bf48-baf3139a3070 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:31.232115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-624f27fe-a97c-4ee2-bf48-baf3139a3070 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.235143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-624f27fe-a97c-4ee2-bf48-baf3139a3070 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.238158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-624f27fe-a97c-4ee2-bf48-baf3139a3070 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.238916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-624f27fe-a97c-4ee2-bf48-baf3139a3070 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.511695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:31.641460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-624f27fe-a97c-4ee2-bf48-baf3139a3070 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:31.652018 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-624f27fe-a97c-4ee2-bf48-baf3139a3070 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1318 microversion: 2.1 time: 0.439457 Jul 20 04:14:31.656647 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 957/1886] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:31 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:31.668916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b67a8ef-4765-4b2f-8a98-930aa39076ca tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:31.670158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3b67a8ef-4765-4b2f-8a98-930aa39076ca tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:31.680917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b67a8ef-4765-4b2f-8a98-930aa39076ca tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.681955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b67a8ef-4765-4b2f-8a98-930aa39076ca tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:31.689755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b67a8ef-4765-4b2f-8a98-930aa39076ca tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:31.690573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b67a8ef-4765-4b2f-8a98-930aa39076ca tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.086559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3b67a8ef-4765-4b2f-8a98-930aa39076ca tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:32.118837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3b67a8ef-4765-4b2f-8a98-930aa39076ca tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:32.127925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3b67a8ef-4765-4b2f-8a98-930aa39076ca tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:32.139039 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b67a8ef-4765-4b2f-8a98-930aa39076ca tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 2837 microversion: 2.42 time: 0.478293 Jul 20 04:14:32.141585 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 958/1887] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:31 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 2837 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:32.164633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c4c838fc-7796-45cf-989f-27f68a92bc89 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:32.166562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c4c838fc-7796-45cf-989f-27f68a92bc89 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:32.189056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4c838fc-7796-45cf-989f-27f68a92bc89 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.189781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4c838fc-7796-45cf-989f-27f68a92bc89 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.190770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4c838fc-7796-45cf-989f-27f68a92bc89 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.191227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4c838fc-7796-45cf-989f-27f68a92bc89 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.479517 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c4c838fc-7796-45cf-989f-27f68a92bc89 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.319591 Jul 20 04:14:32.480237 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 959/1888] 10.222.0.59 () {60 vars in 1315 bytes} [Wed Jul 20 04:14:32 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b/os-interface => generated 1833 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:32.491485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-406df715-c643-4e18-a676-698be2cf6d2a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:32.501717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-406df715-c643-4e18-a676-698be2cf6d2a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:32.517704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-406df715-c643-4e18-a676-698be2cf6d2a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.519376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-406df715-c643-4e18-a676-698be2cf6d2a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.520394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-406df715-c643-4e18-a676-698be2cf6d2a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.522867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-406df715-c643-4e18-a676-698be2cf6d2a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.915790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-406df715-c643-4e18-a676-698be2cf6d2a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:32.919845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:32.943314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-406df715-c643-4e18-a676-698be2cf6d2a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:32.945153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-406df715-c643-4e18-a676-698be2cf6d2a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:32.946876 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-406df715-c643-4e18-a676-698be2cf6d2a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1411 microversion: 2.25 time: 0.463880 Jul 20 04:14:32.947753 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 960/1889] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:32 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1411 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:14:32.957133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-307c2851-18c2-4cc5-988d-0ee755ca0ad9 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:32.962078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-307c2851-18c2-4cc5-988d-0ee755ca0ad9 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:32.980136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-307c2851-18c2-4cc5-988d-0ee755ca0ad9 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.984823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-307c2851-18c2-4cc5-988d-0ee755ca0ad9 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:32.985897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-307c2851-18c2-4cc5-988d-0ee755ca0ad9 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:32.986711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-307c2851-18c2-4cc5-988d-0ee755ca0ad9 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.553823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-307c2851-18c2-4cc5-988d-0ee755ca0ad9 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:33.563374 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-307c2851-18c2-4cc5-988d-0ee755ca0ad9 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1318 microversion: 2.1 time: 0.614115 Jul 20 04:14:33.578636 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 961/1890] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:32 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:33.590001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-919a5a7e-ed88-4214-b9a7-82dbb9e077b4 req-271fd7be-344d-4cc3-ac7b-0d928f0855e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032ace06-ffb8-4b16-a6fb-bb5d2ab82d04", "name": "network-vif-plugged", "status": "completed", "tag": "00f3d5aa-762d-419f-8a8a-d6ca6eb75bfc"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:33.617534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-919a5a7e-ed88-4214-b9a7-82dbb9e077b4 req-271fd7be-344d-4cc3-ac7b-0d928f0855e5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.623296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-919a5a7e-ed88-4214-b9a7-82dbb9e077b4 req-271fd7be-344d-4cc3-ac7b-0d928f0855e5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.638357 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-919a5a7e-ed88-4214-b9a7-82dbb9e077b4 req-271fd7be-344d-4cc3-ac7b-0d928f0855e5 service nova] Creating event network-vif-plugged:00f3d5aa-762d-419f-8a8a-d6ca6eb75bfc for instance 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 on n-h1-760456-11 Jul 20 04:14:33.658726 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-919a5a7e-ed88-4214-b9a7-82dbb9e077b4 req-271fd7be-344d-4cc3-ac7b-0d928f0855e5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078433 Jul 20 04:14:33.671687 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 962/1891] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:33.969785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-87910009-9404-41ef-8aef-2e9687df5705 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:33.973361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-87910009-9404-41ef-8aef-2e9687df5705 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:33.990731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87910009-9404-41ef-8aef-2e9687df5705 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.991315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87910009-9404-41ef-8aef-2e9687df5705 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.992296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87910009-9404-41ef-8aef-2e9687df5705 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.992839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87910009-9404-41ef-8aef-2e9687df5705 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.134634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-87910009-9404-41ef-8aef-2e9687df5705 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:35.154583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-87910009-9404-41ef-8aef-2e9687df5705 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:35.159149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-87910009-9404-41ef-8aef-2e9687df5705 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:35.161610 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-87910009-9404-41ef-8aef-2e9687df5705 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1606 microversion: 2.25 time: 1.200068 Jul 20 04:14:35.178530 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 963/1892] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:14:33 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1606 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:35.187661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-80d8ebc0-fff5-46a9-bd23-1d35093efdeb tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:35.190207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-80d8ebc0-fff5-46a9-bd23-1d35093efdeb tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:35.212373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80d8ebc0-fff5-46a9-bd23-1d35093efdeb tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.213086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80d8ebc0-fff5-46a9-bd23-1d35093efdeb tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.215175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80d8ebc0-fff5-46a9-bd23-1d35093efdeb tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.218472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80d8ebc0-fff5-46a9-bd23-1d35093efdeb tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.796272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-80d8ebc0-fff5-46a9-bd23-1d35093efdeb tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:35.811392 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-80d8ebc0-fff5-46a9-bd23-1d35093efdeb tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1318 microversion: 2.1 time: 0.631013 Jul 20 04:14:35.812020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 964/1893] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:35 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:35.847859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9deaa653-bd0a-4f36-8b30-b2b341e01231 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:35.848977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9deaa653-bd0a-4f36-8b30-b2b341e01231 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:35.869199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9deaa653-bd0a-4f36-8b30-b2b341e01231 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.870147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9deaa653-bd0a-4f36-8b30-b2b341e01231 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.882061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9deaa653-bd0a-4f36-8b30-b2b341e01231 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.882953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9deaa653-bd0a-4f36-8b30-b2b341e01231 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.087689 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9deaa653-bd0a-4f36-8b30-b2b341e01231 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.272136 Jul 20 04:14:36.089330 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 965/1894] 10.222.0.59 () {60 vars in 1315 bytes} [Wed Jul 20 04:14:35 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:36.661808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-82ab4978-fbf4-4880-8624-0bb5d0684b00 req-48429d03-cd87-4f1e-b8f4-716f3830c1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "tag": "c6f02ab9-a2a7-47dd-896e-14309db365f1"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:36.677920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-82ab4978-fbf4-4880-8624-0bb5d0684b00 req-48429d03-cd87-4f1e-b8f4-716f3830c1ae service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.682688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-82ab4978-fbf4-4880-8624-0bb5d0684b00 req-48429d03-cd87-4f1e-b8f4-716f3830c1ae service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.710564 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-82ab4978-fbf4-4880-8624-0bb5d0684b00 req-48429d03-cd87-4f1e-b8f4-716f3830c1ae service nova] Creating event network-changed:c6f02ab9-a2a7-47dd-896e-14309db365f1 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:14:36.728273 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-82ab4978-fbf4-4880-8624-0bb5d0684b00 req-48429d03-cd87-4f1e-b8f4-716f3830c1ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071068 Jul 20 04:14:36.729083 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 966/1895] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:36.829802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fced7b74-b782-401e-adbe-ad571bcd1d3c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.831110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fced7b74-b782-401e-adbe-ad571bcd1d3c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:36.850774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fced7b74-b782-401e-adbe-ad571bcd1d3c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.851775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fced7b74-b782-401e-adbe-ad571bcd1d3c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.852807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fced7b74-b782-401e-adbe-ad571bcd1d3c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.853474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fced7b74-b782-401e-adbe-ad571bcd1d3c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.591451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:37.795785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fced7b74-b782-401e-adbe-ad571bcd1d3c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:37.807664 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fced7b74-b782-401e-adbe-ad571bcd1d3c tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1318 microversion: 2.1 time: 0.981533 Jul 20 04:14:37.808310 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 967/1896] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:36 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1318 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:37.824135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-68f71052-d114-4add-a7e3-aeea871e6a4b req-0483c0a4-ee9b-47a2-9fb0-04f0b3a3cf00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935be60e-ab59-41f1-a2a6-9a911c5da492", "name": "network-vif-plugged", "status": "completed", "tag": "d0366831-d28c-4177-a2e0-737988cd1d5b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:37.837105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-68f71052-d114-4add-a7e3-aeea871e6a4b req-0483c0a4-ee9b-47a2-9fb0-04f0b3a3cf00 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.837994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-68f71052-d114-4add-a7e3-aeea871e6a4b req-0483c0a4-ee9b-47a2-9fb0-04f0b3a3cf00 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.854437 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-68f71052-d114-4add-a7e3-aeea871e6a4b req-0483c0a4-ee9b-47a2-9fb0-04f0b3a3cf00 service nova] Creating event network-vif-plugged:d0366831-d28c-4177-a2e0-737988cd1d5b for instance 935be60e-ab59-41f1-a2a6-9a911c5da492 on n-h2-760456-11 Jul 20 04:14:37.865855 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-68f71052-d114-4add-a7e3-aeea871e6a4b req-0483c0a4-ee9b-47a2-9fb0-04f0b3a3cf00 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056251 Jul 20 04:14:37.867191 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 968/1897] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:38.011174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:38.828660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-46651cbe-6a21-40bf-a842-83153a1d1b07 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.830039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-46651cbe-6a21-40bf-a842-83153a1d1b07 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:38.843430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46651cbe-6a21-40bf-a842-83153a1d1b07 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.847305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46651cbe-6a21-40bf-a842-83153a1d1b07 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.849399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46651cbe-6a21-40bf-a842-83153a1d1b07 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.850867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46651cbe-6a21-40bf-a842-83153a1d1b07 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.626972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-46651cbe-6a21-40bf-a842-83153a1d1b07 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:39.650192 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-46651cbe-6a21-40bf-a842-83153a1d1b07 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1318 microversion: 2.1 time: 0.828822 Jul 20 04:14:39.667004 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 969/1898] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:38 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1318 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:40.896757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-44b50a3c-c21c-4405-8a16-c4108eb6be75 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Action: 'create', calling method: .version_select at 0x7fb841a63af0>, body: {"pool": null} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:41.503855 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b379f87c-2fda-482f-bf72-a0ddb3a98103 tempest-SecurityGroupsTestAdminJSON-174739133 tempest-SecurityGroupsTestAdminJSON-174739133-project-admin] 10.222.0.59 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12294 microversion: 2.1 time: 12.458311 Jul 20 04:14:41.504502 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 930/1899] 10.222.0.59 () {58 vars in 1190 bytes} [Wed Jul 20 04:14:29 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12294 bytes in 12461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:14:41.518554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e31cfd4-1d5e-4b8f-8d87-be25169c419b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.518554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6e31cfd4-1d5e-4b8f-8d87-be25169c419b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:41.532958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e31cfd4-1d5e-4b8f-8d87-be25169c419b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.533478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e31cfd4-1d5e-4b8f-8d87-be25169c419b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.534625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e31cfd4-1d5e-4b8f-8d87-be25169c419b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.535319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e31cfd4-1d5e-4b8f-8d87-be25169c419b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.862539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6e31cfd4-1d5e-4b8f-8d87-be25169c419b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:41.875667 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6e31cfd4-1d5e-4b8f-8d87-be25169c419b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1504 microversion: 2.1 time: 0.369559 Jul 20 04:14:41.884494 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 931/1900] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:41.912257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-cfa7f0c5-00f5-49a0-b0d2-b2c56da1f7c6 req-a8fc3889-98c3-4240-96bc-4802e8614fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358c5f50-cf9e-4577-a295-0aa87e318810", "tag": "2cc5c8d5-88eb-4ddb-b127-216dd5aef81c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:41.954432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cfa7f0c5-00f5-49a0-b0d2-b2c56da1f7c6 req-a8fc3889-98c3-4240-96bc-4802e8614fb8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.956523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cfa7f0c5-00f5-49a0-b0d2-b2c56da1f7c6 req-a8fc3889-98c3-4240-96bc-4802e8614fb8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.994169 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-cfa7f0c5-00f5-49a0-b0d2-b2c56da1f7c6 req-a8fc3889-98c3-4240-96bc-4802e8614fb8 service nova] Creating event network-changed:2cc5c8d5-88eb-4ddb-b127-216dd5aef81c for instance 358c5f50-cf9e-4577-a295-0aa87e318810 on n-h2-760456-11 Jul 20 04:14:42.010116 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-cfa7f0c5-00f5-49a0-b0d2-b2c56da1f7c6 req-a8fc3889-98c3-4240-96bc-4802e8614fb8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121625 Jul 20 04:14:42.012869 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 932/1901] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:42.042330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d6ae8bfb-8cbc-40f1-b110-355bce071cb1 tempest-SecurityGroupsTestAdminJSON-1373502302 tempest-SecurityGroupsTestAdminJSON-1373502302-project] Calling method '.version_select at 0x7fb841df6d30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.704561 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d6ae8bfb-8cbc-40f1-b110-355bce071cb1 tempest-SecurityGroupsTestAdminJSON-1373502302 tempest-SecurityGroupsTestAdminJSON-1373502302-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.672745 Jul 20 04:14:42.705470 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 933/1902] 10.222.0.59 () {58 vars in 1190 bytes} [Wed Jul 20 04:14:42 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:42.711525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7a695902-8535-4e65-9717-4d6696f8b837 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.712960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7a695902-8535-4e65-9717-4d6696f8b837 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:42.734213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a695902-8535-4e65-9717-4d6696f8b837 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.741260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a695902-8535-4e65-9717-4d6696f8b837 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.742559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a695902-8535-4e65-9717-4d6696f8b837 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.752120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a695902-8535-4e65-9717-4d6696f8b837 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:43.258190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7a695902-8535-4e65-9717-4d6696f8b837 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:43.273630 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7a695902-8535-4e65-9717-4d6696f8b837 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04" status: 200 len: 1504 microversion: 2.1 time: 0.566806 Jul 20 04:14:43.276231 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 934/1903] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:42 2022] GET /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 => generated 1504 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:43.656228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1258468310", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "191d678e-1adc-40c3-b7b1-1a7cb20ca675"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:43.797370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] validate_networks() for [('191d678e-1adc-40c3-b7b1-1a7cb20ca675', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:44.189111 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-44b50a3c-c21c-4405-8a16-c4108eb6be75 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.644601 Jul 20 04:14:44.189755 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 970/1904] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:14:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:44.195426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0559ea7a-f2e6-465e-8b5a-087521aa6557 tempest-SecurityGroupsTestAdminJSON-174739133 tempest-SecurityGroupsTestAdminJSON-174739133-project-admin] Calling method '.version_select at 0x7fb841a41a60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:44.555299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:44.555970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:44.556902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:44.557721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:44.558351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:44.570874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.571829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.576624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.580456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.604017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:44.613158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for user 9f053f31c02c412394d48ce65350d153 and project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:44.631615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:44.635041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:44.751368 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a02e521c-aae6-481f-9037-44703915ebdf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470875 Jul 20 04:14:44.760809 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 935/1905] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:14:44.773014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-37774be4-7a9a-465d-b1a1-cf1da138f509 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:44.774524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-37774be4-7a9a-465d-b1a1-cf1da138f509 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:44.794038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37774be4-7a9a-465d-b1a1-cf1da138f509 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.794901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37774be4-7a9a-465d-b1a1-cf1da138f509 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.795888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37774be4-7a9a-465d-b1a1-cf1da138f509 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:44.796364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37774be4-7a9a-465d-b1a1-cf1da138f509 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:44.830952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-37774be4-7a9a-465d-b1a1-cf1da138f509 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:44.926287 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0559ea7a-f2e6-465e-8b5a-087521aa6557 tempest-SecurityGroupsTestAdminJSON-174739133 tempest-SecurityGroupsTestAdminJSON-174739133-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/2f14c66e-da24-4bad-9c7d-14f1f9ccb594" status: 202 len: 0 microversion: 2.1 time: 0.734715 Jul 20 04:14:44.926929 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 971/1906] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:44 2022] DELETE /compute/v2.1/os-security-groups/2f14c66e-da24-4bad-9c7d-14f1f9ccb594 => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:44.934013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72834cac-b779-4a46-9710-6e0c4e52b37f tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Calling method '.version_select at 0x7fb841a63280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.007357 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-37774be4-7a9a-465d-b1a1-cf1da138f509 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "DELETE /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04" status: 204 len: 0 microversion: 2.1 time: 0.239991 Jul 20 04:14:45.008124 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 936/1907] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:44 2022] DELETE /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:45.020500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-72aef066-c38c-4ee3-baed-efbd6595c045 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.023259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-72aef066-c38c-4ee3-baed-efbd6595c045 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:45.152296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-72aef066-c38c-4ee3-baed-efbd6595c045 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:45.161242 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-72aef066-c38c-4ee3-baed-efbd6595c045 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1215 microversion: 2.1 time: 0.149594 Jul 20 04:14:45.163895 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 937/1908] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:45 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:45.179341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-95f0675a-ccfe-4073-81c5-58c5c0cb7954 tempest-SecurityGroupsTestAdminJSON-174739133 tempest-SecurityGroupsTestAdminJSON-174739133-project-admin] Calling method '.version_select at 0x7fb841d21dc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.538515 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-95f0675a-ccfe-4073-81c5-58c5c0cb7954 tempest-SecurityGroupsTestAdminJSON-174739133 tempest-SecurityGroupsTestAdminJSON-174739133-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/8e1f21ce-1c46-4820-9de0-f01d769d35a1" status: 202 len: 0 microversion: 2.1 time: 0.364465 Jul 20 04:14:45.539118 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 938/1909] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:45 2022] DELETE /compute/v2.1/os-security-groups/8e1f21ce-1c46-4820-9de0-f01d769d35a1 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:45.547970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3955d0ce-8b79-4545-9306-6d148c0846a5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.548559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3955d0ce-8b79-4545-9306-6d148c0846a5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:45.565107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3955d0ce-8b79-4545-9306-6d148c0846a5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.567265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3955d0ce-8b79-4545-9306-6d148c0846a5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.575409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3955d0ce-8b79-4545-9306-6d148c0846a5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.576366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3955d0ce-8b79-4545-9306-6d148c0846a5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.632365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3955d0ce-8b79-4545-9306-6d148c0846a5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:14:45.672381 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72834cac-b779-4a46-9710-6e0c4e52b37f tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips/851c03a5-fb84-4eaf-84ed-f273009b5fbe" status: 200 len: 142 microversion: 2.1 time: 0.744343 Jul 20 04:14:45.673003 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 972/1910] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:14:44 2022] GET /compute/v2.1/os-floating-ips/851c03a5-fb84-4eaf-84ed-f273009b5fbe => generated 142 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:45.678469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97c7b5f2-1bc6-4c0d-b00f-d9cdfa3d6d07 tempest-SecurityGroupsTestAdminJSON-1373502302 tempest-SecurityGroupsTestAdminJSON-1373502302-project] Calling method '.version_select at 0x7fb841a63d30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.859569 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3955d0ce-8b79-4545-9306-6d148c0846a5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "DELETE /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 204 len: 0 microversion: 2.1 time: 0.318665 Jul 20 04:14:45.861258 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 939/1911] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:45 2022] DELETE /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:14:45.868591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-737f8e13-72fc-474a-b65d-97005816d2f5 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Calling method '.version_select at 0x7fb841cea670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.005366 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-737f8e13-72fc-474a-b65d-97005816d2f5 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.142220 Jul 20 04:14:47.005881 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 940/1912] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:14:45 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:47.011516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8968298d-e2cb-4261-8144-087f10b035c5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.013524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8968298d-e2cb-4261-8144-087f10b035c5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:47.031502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8968298d-e2cb-4261-8144-087f10b035c5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.032282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8968298d-e2cb-4261-8144-087f10b035c5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.033634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8968298d-e2cb-4261-8144-087f10b035c5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.034543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8968298d-e2cb-4261-8144-087f10b035c5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.378419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8968298d-e2cb-4261-8144-087f10b035c5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:47.391104 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8968298d-e2cb-4261-8144-087f10b035c5 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04" status: 200 len: 1510 microversion: 2.1 time: 0.383586 Jul 20 04:14:47.393698 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 941/1913] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:47.407562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d999997e-ad10-4969-b8d3-35bdf74a4607 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.411425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d999997e-ad10-4969-b8d3-35bdf74a4607 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:47.436415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d999997e-ad10-4969-b8d3-35bdf74a4607 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.437196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d999997e-ad10-4969-b8d3-35bdf74a4607 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.440827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d999997e-ad10-4969-b8d3-35bdf74a4607 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:47.444157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d999997e-ad10-4969-b8d3-35bdf74a4607 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.548950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d999997e-ad10-4969-b8d3-35bdf74a4607 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:47.602465 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d999997e-ad10-4969-b8d3-35bdf74a4607 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1267 microversion: 2.1 time: 0.189912 Jul 20 04:14:47.611318 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 942/1914] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:47.627799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aba06ccf-b13b-4b62-8bd6-a5cf4da42706 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Calling method '.version_select at 0x7fb841ccedc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:47.648098 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97c7b5f2-1bc6-4c0d-b00f-d9cdfa3d6d07 tempest-SecurityGroupsTestAdminJSON-1373502302 tempest-SecurityGroupsTestAdminJSON-1373502302-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/7c4fb013-dc83-46f7-aa57-4dce915d6118" status: 202 len: 0 microversion: 2.1 time: 1.973732 Jul 20 04:14:47.662812 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 973/1915] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:45 2022] DELETE /compute/v2.1/os-security-groups/7c4fb013-dc83-46f7-aa57-4dce915d6118 => generated 0 bytes in 1989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:47.671965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-401be06a-507d-49cf-a87b-2ea8303e3d25 tempest-SecurityGroupsTestAdminJSON-1373502302 tempest-SecurityGroupsTestAdminJSON-1373502302-project] Calling method '.version_select at 0x7fb841a63b80>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.682888 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-401be06a-507d-49cf-a87b-2ea8303e3d25 tempest-SecurityGroupsTestAdminJSON-1373502302 tempest-SecurityGroupsTestAdminJSON-1373502302-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/545647d4-6040-4ac3-bfbc-cb45c654d4b3" status: 202 len: 0 microversion: 2.1 time: 1.017021 Jul 20 04:14:48.692432 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 974/1916] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:14:47 2022] DELETE /compute/v2.1/os-security-groups/545647d4-6040-4ac3-bfbc-cb45c654d4b3 => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:48.819882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c9175a9-cb1a-4f1c-b8cd-02eda46ecd69 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Action: 'create', calling method: .version_select at 0x7fb841b23550>, body: {"keypair": {"name": "tempest-keypair-1321823951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyjOZye7xRFFUlp5IvpgmJfgEHAT89OhRBOnUEMxhqygNszyYUItrLp+lDyzjYdOKNIS5QLfHTdSG0vaBmgj/apvPQWLEuejWhlLodXZ2m3wAv1hjS3tFQp5kSG2WgC9Q=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:48.839333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=72 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:48.874366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-0c9175a9-cb1a-4f1c-b8cd-02eda46ecd69 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Getting quotas for project d5bbe7152cf74f0f8d207134071a4be5. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:48.884606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-0c9175a9-cb1a-4f1c-b8cd-02eda46ecd69 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Getting quotas for user 0f066ff310d64feea8e45f1b7e401da7 and project d5bbe7152cf74f0f8d207134071a4be5. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:49.006927 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0c9175a9-cb1a-4f1c-b8cd-02eda46ecd69 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.307571 Jul 20 04:14:49.022340 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 975/1917] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:14:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:49.036965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2c2b9a10-d748-4528-a7c4-4c2e733ed442 req-05143124-5eb4-4db9-8860-48c5e96a4ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032ace06-ffb8-4b16-a6fb-bb5d2ab82d04", "name": "network-vif-deleted", "tag": "00f3d5aa-762d-419f-8a8a-d6ca6eb75bfc"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:49.064537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2c2b9a10-d748-4528-a7c4-4c2e733ed442 req-05143124-5eb4-4db9-8860-48c5e96a4ad8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.065175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2c2b9a10-d748-4528-a7c4-4c2e733ed442 req-05143124-5eb4-4db9-8860-48c5e96a4ad8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.108775 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2c2b9a10-d748-4528-a7c4-4c2e733ed442 req-05143124-5eb4-4db9-8860-48c5e96a4ad8 service nova] Creating event network-vif-deleted:00f3d5aa-762d-419f-8a8a-d6ca6eb75bfc for instance 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 on n-h1-760456-11 Jul 20 04:14:49.142559 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2c2b9a10-d748-4528-a7c4-4c2e733ed442 req-05143124-5eb4-4db9-8860-48c5e96a4ad8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118648 Jul 20 04:14:49.144179 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 976/1918] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:49.162097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:49.167923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:49.188046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.191909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.192937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.194292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.315705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.316080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.316552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lazy-loading 'fault' on Instance uuid 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:49.541036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:49.557899 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bb1255b9-69b0-4ea8-9fd8-7aa564f16bec tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04" status: 200 len: 1308 microversion: 2.1 time: 0.410353 Jul 20 04:14:49.561537 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 977/1919] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:49 2022] GET /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 => generated 1308 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:49.578215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c61120df-ca93-4c92-800c-f085b98f36f7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:49.579669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c61120df-ca93-4c92-800c-f085b98f36f7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:49.614578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c61120df-ca93-4c92-800c-f085b98f36f7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.617543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c61120df-ca93-4c92-800c-f085b98f36f7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.618808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c61120df-ca93-4c92-800c-f085b98f36f7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.624060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c61120df-ca93-4c92-800c-f085b98f36f7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.998239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c61120df-ca93-4c92-800c-f085b98f36f7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:50.008976 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c61120df-ca93-4c92-800c-f085b98f36f7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1273 microversion: 2.1 time: 0.441990 Jul 20 04:14:50.016720 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 978/1920] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:49 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1273 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.033413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5df3ec5c-7136-40e9-a89d-a3470d2cb405 req-b1c8c53e-fd1e-46b7-a5d7-aa772faa1242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935be60e-ab59-41f1-a2a6-9a911c5da492", "name": "network-vif-deleted", "tag": "d0366831-d28c-4177-a2e0-737988cd1d5b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:50.074365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5df3ec5c-7136-40e9-a89d-a3470d2cb405 req-b1c8c53e-fd1e-46b7-a5d7-aa772faa1242 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.075723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5df3ec5c-7136-40e9-a89d-a3470d2cb405 req-b1c8c53e-fd1e-46b7-a5d7-aa772faa1242 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.116698 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5df3ec5c-7136-40e9-a89d-a3470d2cb405 req-b1c8c53e-fd1e-46b7-a5d7-aa772faa1242 service nova] Creating event network-vif-deleted:d0366831-d28c-4177-a2e0-737988cd1d5b for instance 935be60e-ab59-41f1-a2a6-9a911c5da492 on n-h2-760456-11 Jul 20 04:14:50.135910 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5df3ec5c-7136-40e9-a89d-a3470d2cb405 req-b1c8c53e-fd1e-46b7-a5d7-aa772faa1242 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114906 Jul 20 04:14:50.140376 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 979/1921] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:50.582545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a3862ba-c25e-4dad-bd1b-ab9226aef893 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.583737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4a3862ba-c25e-4dad-bd1b-ab9226aef893 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:50.608024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a3862ba-c25e-4dad-bd1b-ab9226aef893 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.609014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a3862ba-c25e-4dad-bd1b-ab9226aef893 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.609925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a3862ba-c25e-4dad-bd1b-ab9226aef893 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.614444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a3862ba-c25e-4dad-bd1b-ab9226aef893 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.673314 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-4a3862ba-c25e-4dad-bd1b-ab9226aef893 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] HTTP exception thrown: Instance 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 could not be found. Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a3862ba-c25e-4dad-bd1b-ab9226aef893 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Request method failure captured: Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 HTTP/1.1 Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14D5Bfqi_3SkfUP-4E3BM-KOQGN2wtGdRqL5Ip3OQlopxi-GjbjzCYXcaDRw-Q-_l0vtalyRNloEy5VNV0mPABzHZAEVCQTBvjsk-7mGL5XVtcgG0nC0M-wgu1_Dbjd0mUQSgBwArpeZVVLMN4k4qLHLx6XIN8k7aINSTqntSjy2S5o Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: cd9cdf734cb84261a283155e4d8e438a Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-MultipleCreateTestJSON-841894515 Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cd9cdf734cb84261a283155e4d8e438a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cd9cdf734cb84261a283155e4d8e438a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cd9cdf734cb84261a283155e4d8e438a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cd9cdf734cb84261a283155e4d8e438a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-MultipleCreateTestJSON-841894515 Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: cd9cdf734cb84261a283155e4d8e438a Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-MultipleCreateTestJSON-841894515 Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-MultipleCreateTestJSON-841894515-project Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: d7c6ee309819422591bc153327821a46 Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-MultipleCreateTestJSON-841894515-project Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 could not be found. Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '032ace06-ffb8-4b16-a6fb-bb5d2ab82d04'} Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 could not be found. Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 could not be found. Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:50.676212 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:50.682102 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:50.682102 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:50.682102 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:50.682102 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:50.682102 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:50.682102 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 could not be found. Jul 20 04:14:50.682102 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:50.685539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a3862ba-c25e-4dad-bd1b-ab9226aef893 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Returning 404 to user: Instance 032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:50.687283 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4a3862ba-c25e-4dad-bd1b-ab9226aef893 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04" status: 404 len: 111 microversion: 2.1 time: 0.109217 Jul 20 04:14:50.689420 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 980/1922] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/servers/032ace06-ffb8-4b16-a6fb-bb5d2ab82d04 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:50.702943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.704104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:50.735398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.739487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.743338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.744087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.805064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:50.805419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:50.806076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lazy-loading 'fault' on Instance uuid 935be60e-ab59-41f1-a2a6-9a911c5da492 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:14:50.928437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c6ee309819422591bc153327821a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9cdf734cb84261a283155e4d8e438a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:50.951268 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b741ab84-48e3-4d17-9eca-80e6df33b38b tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 200 len: 1308 microversion: 2.1 time: 0.257275 Jul 20 04:14:50.960143 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 981/1923] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 1308 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:51.036601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6805cf7b-d517-48b9-a8cb-a77096430833 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.037390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6805cf7b-d517-48b9-a8cb-a77096430833 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:51.050663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6805cf7b-d517-48b9-a8cb-a77096430833 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.051159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6805cf7b-d517-48b9-a8cb-a77096430833 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.053249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6805cf7b-d517-48b9-a8cb-a77096430833 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.063405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6805cf7b-d517-48b9-a8cb-a77096430833 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.278959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6805cf7b-d517-48b9-a8cb-a77096430833 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:51.291305 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6805cf7b-d517-48b9-a8cb-a77096430833 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1273 microversion: 2.1 time: 0.256627 Jul 20 04:14:51.292422 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 982/1924] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:51.420266 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aba06ccf-b13b-4b62-8bd6-a5cf4da42706 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/851c03a5-fb84-4eaf-84ed-f273009b5fbe" status: 202 len: 0 microversion: 2.1 time: 3.797164 Jul 20 04:14:51.422045 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 943/1925] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:14:47 2022] DELETE /compute/v2.1/os-floating-ips/851c03a5-fb84-4eaf-84ed-f273009b5fbe => generated 0 bytes in 3810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:51.439511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-99c2df84-5ce9-44b3-aedd-661627bbf801 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Action: 'create', calling method: .version_select at 0x7fb841a66c10>, body: {"pool": null} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:51.972265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5d6b76ef-b452-4ab0-9966-84e03a4e6019 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.975380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5d6b76ef-b452-4ab0-9966-84e03a4e6019 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] [instance: 935be60e-ab59-41f1-a2a6-9a911c5da492] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:51.999793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d6b76ef-b452-4ab0-9966-84e03a4e6019 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:52.007140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d6b76ef-b452-4ab0-9966-84e03a4e6019 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:52.007833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d6b76ef-b452-4ab0-9966-84e03a4e6019 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:52.008298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d6b76ef-b452-4ab0-9966-84e03a4e6019 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:52.047423 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-5d6b76ef-b452-4ab0-9966-84e03a4e6019 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] HTTP exception thrown: Instance 935be60e-ab59-41f1-a2a6-9a911c5da492 could not be found. Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5d6b76ef-b452-4ab0-9966-84e03a4e6019 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Request method failure captured: Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 HTTP/1.1 Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14D5Bfqi_3SkfUP-4E3BM-KOQGN2wtGdRqL5Ip3OQlopxi-GjbjzCYXcaDRw-Q-_l0vtalyRNloEy5VNV0mPABzHZAEVCQTBvjsk-7mGL5XVtcgG0nC0M-wgu1_Dbjd0mUQSgBwArpeZVVLMN4k4qLHLx6XIN8k7aINSTqntSjy2S5o Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: cd9cdf734cb84261a283155e4d8e438a Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-MultipleCreateTestJSON-841894515 Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cd9cdf734cb84261a283155e4d8e438a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cd9cdf734cb84261a283155e4d8e438a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cd9cdf734cb84261a283155e4d8e438a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cd9cdf734cb84261a283155e4d8e438a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-MultipleCreateTestJSON-841894515 Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: cd9cdf734cb84261a283155e4d8e438a Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-MultipleCreateTestJSON-841894515 Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-MultipleCreateTestJSON-841894515-project Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: d7c6ee309819422591bc153327821a46 Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-MultipleCreateTestJSON-841894515-project Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 935be60e-ab59-41f1-a2a6-9a911c5da492 could not be found. Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '935be60e-ab59-41f1-a2a6-9a911c5da492'} Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935be60e-ab59-41f1-a2a6-9a911c5da492 could not be found. Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935be60e-ab59-41f1-a2a6-9a911c5da492 could not be found. Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:52.052057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:52.057482 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:52.057482 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:52.057482 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:52.057482 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:52.057482 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:52.057482 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935be60e-ab59-41f1-a2a6-9a911c5da492 could not be found. Jul 20 04:14:52.057482 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:14:52.057482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5d6b76ef-b452-4ab0-9966-84e03a4e6019 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] Returning 404 to user: Instance 935be60e-ab59-41f1-a2a6-9a911c5da492 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:52.058218 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5d6b76ef-b452-4ab0-9966-84e03a4e6019 tempest-MultipleCreateTestJSON-841894515 tempest-MultipleCreateTestJSON-841894515-project] 10.222.0.59 "GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492" status: 404 len: 111 microversion: 2.1 time: 0.094556 Jul 20 04:14:52.064243 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 944/1926] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/servers/935be60e-ab59-41f1-a2a6-9a911c5da492 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:52.309617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2f682bf1-3e8d-4f80-af6d-d2c8e6097877 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.315048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2f682bf1-3e8d-4f80-af6d-d2c8e6097877 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:52.328057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f682bf1-3e8d-4f80-af6d-d2c8e6097877 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:52.330628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f682bf1-3e8d-4f80-af6d-d2c8e6097877 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:52.333844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f682bf1-3e8d-4f80-af6d-d2c8e6097877 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:52.341066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f682bf1-3e8d-4f80-af6d-d2c8e6097877 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:52.861535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2f682bf1-3e8d-4f80-af6d-d2c8e6097877 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:52.875193 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2f682bf1-3e8d-4f80-af6d-d2c8e6097877 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1315 microversion: 2.1 time: 0.569922 Jul 20 04:14:52.877648 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 945/1927] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:52 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:52.891725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-437420181", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1e0d2311-d339-4891-b078-0145e672206a"}], "security_groups": [{"name": "tempest-securitygroup--1648520472"}], "key_name": "tempest-keypair-1321823951", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:53.257635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] validate_networks() for [('1e0d2311-d339-4891-b078-0145e672206a', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:54.047207 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-99c2df84-5ce9-44b3-aedd-661627bbf801 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.618649 Jul 20 04:14:54.047862 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 983/1928] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:14:51 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:54.053038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6dd3dfdf-b005-44c4-b081-71c6313b4693 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.056682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6dd3dfdf-b005-44c4-b081-71c6313b4693 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:54.072145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6dd3dfdf-b005-44c4-b081-71c6313b4693 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.073207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6dd3dfdf-b005-44c4-b081-71c6313b4693 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:54.079914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6dd3dfdf-b005-44c4-b081-71c6313b4693 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.092173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6dd3dfdf-b005-44c4-b081-71c6313b4693 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:54.377892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6dd3dfdf-b005-44c4-b081-71c6313b4693 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:54.390968 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6dd3dfdf-b005-44c4-b081-71c6313b4693 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1315 microversion: 2.1 time: 0.341635 Jul 20 04:14:54.391593 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 984/1929] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:54 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:54.401410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b9ee9d4-48cb-4876-bbd1-48405160bc60 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Calling method '.version_select at 0x7fb841a66c10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.594367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:55.157903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:55.180549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Getting quotas for project d5bbe7152cf74f0f8d207134071a4be5. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:55.198208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Getting quotas for user 0f066ff310d64feea8e45f1b7e401da7 and project d5bbe7152cf74f0f8d207134071a4be5. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:55.227949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:55.228510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:55.229057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:55.229497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:55.230501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:55.250180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.251252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.252947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.253872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.280186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Getting quotas for project d5bbe7152cf74f0f8d207134071a4be5. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:55.287717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Getting quotas for user 0f066ff310d64feea8e45f1b7e401da7 and project d5bbe7152cf74f0f8d207134071a4be5. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:55.309588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:55.318099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:55.403058 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aacc405b-4b28-4c61-9f35-97760d9cca75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.522835 Jul 20 04:14:55.406220 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 946/1930] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:52 2022] POST /compute/v2.1/servers => generated 407 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:14:55.413110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-bf4d17f8-08bb-48df-8b07-faec48b169b2 req-6bb13a1c-c7db-4ceb-baf7-b66d8a94c2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "206ee904-1894-4f54-b06c-e8a01c6f08f3", "tag": "c7a6d515-10e3-43ee-8615-d871ff35bab2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:55.427281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bf4d17f8-08bb-48df-8b07-faec48b169b2 req-6bb13a1c-c7db-4ceb-baf7-b66d8a94c2cf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.428156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bf4d17f8-08bb-48df-8b07-faec48b169b2 req-6bb13a1c-c7db-4ceb-baf7-b66d8a94c2cf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.452023 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-bf4d17f8-08bb-48df-8b07-faec48b169b2 req-6bb13a1c-c7db-4ceb-baf7-b66d8a94c2cf service nova] Creating event network-changed:c7a6d515-10e3-43ee-8615-d871ff35bab2 for instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 on n-h2-760456-11 Jul 20 04:14:55.460896 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-bf4d17f8-08bb-48df-8b07-faec48b169b2 req-6bb13a1c-c7db-4ceb-baf7-b66d8a94c2cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052196 Jul 20 04:14:55.463279 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 947/1931] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:55.789162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2056149729", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:55.854927 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b9ee9d4-48cb-4876-bbd1-48405160bc60 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/d4aa03ec-a3cc-4fa0-b19b-6091013159a4" status: 202 len: 0 microversion: 2.1 time: 1.461362 Jul 20 04:14:55.856143 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 985/1932] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:14:54 2022] DELETE /compute/v2.1/os-floating-ips/d4aa03ec-a3cc-4fa0-b19b-6091013159a4 => generated 0 bytes in 1464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:55.862508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0bb45b5-c5ee-4247-bb3d-a0987946c530 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:55.863564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e0bb45b5-c5ee-4247-bb3d-a0987946c530 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:55.887003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0bb45b5-c5ee-4247-bb3d-a0987946c530 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.888076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0bb45b5-c5ee-4247-bb3d-a0987946c530 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.899323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0bb45b5-c5ee-4247-bb3d-a0987946c530 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:55.902236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0bb45b5-c5ee-4247-bb3d-a0987946c530 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:55.912398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:56.208767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e0bb45b5-c5ee-4247-bb3d-a0987946c530 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:56.224437 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0bb45b5-c5ee-4247-bb3d-a0987946c530 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1315 microversion: 2.1 time: 0.366984 Jul 20 04:14:56.226941 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 986/1933] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:55 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:56.234130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9fd94dd-f68c-4201-be72-4887e45f24e6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:56.235195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9fd94dd-f68c-4201-be72-4887e45f24e6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:56.243870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9fd94dd-f68c-4201-be72-4887e45f24e6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.245438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9fd94dd-f68c-4201-be72-4887e45f24e6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.247250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9fd94dd-f68c-4201-be72-4887e45f24e6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.248011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9fd94dd-f68c-4201-be72-4887e45f24e6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.402891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9fd94dd-f68c-4201-be72-4887e45f24e6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:56.414110 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9fd94dd-f68c-4201-be72-4887e45f24e6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1273 microversion: 2.1 time: 0.185726 Jul 20 04:14:56.415128 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 987/1934] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:56 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:56.422351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a551ef1-8b49-4046-9974-11d8cb8605c4 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Calling method '.version_select at 0x7fb841a079d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:56.489256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:56.489740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:56.490342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:56.490848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:56.491328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:56.504024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-1a551ef1-8b49-4046-9974-11d8cb8605c4 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d4aa03ec-a3cc-4fa0-b19b-6091013159a4 could not be found", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:14:56.505844 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-1a551ef1-8b49-4046-9974-11d8cb8605c4 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] HTTP exception thrown: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a551ef1-8b49-4046-9974-11d8cb8605c4 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Request method failure captured: Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-floating-ips/d4aa03ec-a3cc-4fa0-b19b-6091013159a4 HTTP/1.1 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14EwtY_LXuq_Wpur1Mhe9nZ0_nDhB1L-jivZsDKVmi5pCBberTtAbw5fp-7TxeOwtCqrr3BK0Mk1s9hK281Air7V_Hfd8dL6Shfahh4_7xGlYE3qnDMc_5-YwrA3F79UUHp9WRrurhJ-ZV8A4z8I48YfSAog-QjfdypJfNlDe8zpxAo Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 7ade2ed7a3e74a41a04dbd77842ce67b Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FloatingIPsTestJSON-265604452 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7ade2ed7a3e74a41a04dbd77842ce67b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ade2ed7a3e74a41a04dbd77842ce67b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ade2ed7a3e74a41a04dbd77842ce67b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7ade2ed7a3e74a41a04dbd77842ce67b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FloatingIPsTestJSON-265604452 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 7ade2ed7a3e74a41a04dbd77842ce67b Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FloatingIPsTestJSON-265604452 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FloatingIPsTestJSON-265604452-project Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 1364f2a135374007ad6fc27eadf8cc14 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FloatingIPsTestJSON-265604452-project Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: exception: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'd4aa03ec-a3cc-4fa0-b19b-6091013159a4'} Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d4aa03ec-a3cc-4fa0-b19b-6091013159a4 could not be found Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-864da8c9-9363-4b42-b2f8-9b4e37a70658'] Jul 20 04:14:56.508396 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4. Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4 Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4 Jul 20 04:14:56.518709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.525860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.525860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.530072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a551ef1-8b49-4046-9974-11d8cb8605c4 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Returning 404 to user: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4 {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:56.531314 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a551ef1-8b49-4046-9974-11d8cb8605c4 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips/d4aa03ec-a3cc-4fa0-b19b-6091013159a4" status: 404 len: 111 microversion: 2.1 time: 0.114291 Jul 20 04:14:56.532153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.532920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.533575 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 988/1935] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:14:56 2022] GET /compute/v2.1/os-floating-ips/d4aa03ec-a3cc-4fa0-b19b-6091013159a4 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:56.542237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-794f51f6-012e-44f5-902f-7c1420dfdec0 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Calling method '.version_select at 0x7fb841a07160>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:56.585034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Getting quotas for project 9b5aa17d4e3344c9b1a474ed1e0e3f64. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:56.605762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Getting quotas for user 4753f6cc24204b008e6753c4ee8e12d1 and project 9b5aa17d4e3344c9b1a474ed1e0e3f64. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:56.626766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:56.630824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:56.653798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-794f51f6-012e-44f5-902f-7c1420dfdec0 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d4aa03ec-a3cc-4fa0-b19b-6091013159a4 could not be found", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:14:56.654932 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-794f51f6-012e-44f5-902f-7c1420dfdec0 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] HTTP exception thrown: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-794f51f6-012e-44f5-902f-7c1420dfdec0 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Request method failure captured: Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-floating-ips/d4aa03ec-a3cc-4fa0-b19b-6091013159a4 HTTP/1.1 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14EwtY_LXuq_Wpur1Mhe9nZ0_nDhB1L-jivZsDKVmi5pCBberTtAbw5fp-7TxeOwtCqrr3BK0Mk1s9hK281Air7V_Hfd8dL6Shfahh4_7xGlYE3qnDMc_5-YwrA3F79UUHp9WRrurhJ-ZV8A4z8I48YfSAog-QjfdypJfNlDe8zpxAo Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 7ade2ed7a3e74a41a04dbd77842ce67b Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FloatingIPsTestJSON-265604452 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7ade2ed7a3e74a41a04dbd77842ce67b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ade2ed7a3e74a41a04dbd77842ce67b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ade2ed7a3e74a41a04dbd77842ce67b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7ade2ed7a3e74a41a04dbd77842ce67b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FloatingIPsTestJSON-265604452 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 7ade2ed7a3e74a41a04dbd77842ce67b Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FloatingIPsTestJSON-265604452 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FloatingIPsTestJSON-265604452-project Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 1364f2a135374007ad6fc27eadf8cc14 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FloatingIPsTestJSON-265604452-project Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: exception: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'd4aa03ec-a3cc-4fa0-b19b-6091013159a4'} Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d4aa03ec-a3cc-4fa0-b19b-6091013159a4 could not be found Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db150869-b204-4db6-89de-8575184cb0b9'] Jul 20 04:14:56.657126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4. Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4 Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4 Jul 20 04:14:56.665480 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.674133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-794f51f6-012e-44f5-902f-7c1420dfdec0 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] Returning 404 to user: Floating IP not found for ID d4aa03ec-a3cc-4fa0-b19b-6091013159a4 {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:56.675595 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-794f51f6-012e-44f5-902f-7c1420dfdec0 tempest-FloatingIPsTestJSON-265604452 tempest-FloatingIPsTestJSON-265604452-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/d4aa03ec-a3cc-4fa0-b19b-6091013159a4" status: 404 len: 111 microversion: 2.1 time: 0.138058 Jul 20 04:14:56.676908 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 989/1936] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:14:56 2022] DELETE /compute/v2.1/os-floating-ips/d4aa03ec-a3cc-4fa0-b19b-6091013159a4 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:56.735308 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a7f1cdd3-5f0e-44f2-b946-7599fb48c9f2 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270054 Jul 20 04:14:56.736704 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 948/1937] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:14:56.757511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5b7f4ed5-1459-4e1b-9b01-b291a8abfb14 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:56.773574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5b7f4ed5-1459-4e1b-9b01-b291a8abfb14 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:56.994166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b7f4ed5-1459-4e1b-9b01-b291a8abfb14 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:57.007218 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5b7f4ed5-1459-4e1b-9b01-b291a8abfb14 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1223 microversion: 2.1 time: 0.263654 Jul 20 04:14:57.011060 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 990/1938] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:56 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1223 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:57.246617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dbc9ee40-f0f1-44ce-a373-79172b600f09 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:57.247309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dbc9ee40-f0f1-44ce-a373-79172b600f09 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:57.264158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbc9ee40-f0f1-44ce-a373-79172b600f09 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.264607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbc9ee40-f0f1-44ce-a373-79172b600f09 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:57.290960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbc9ee40-f0f1-44ce-a373-79172b600f09 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.291556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbc9ee40-f0f1-44ce-a373-79172b600f09 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:57.437092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-411c81ee-80a6-4832-a89b-09259bb56c6d tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:57.438006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-411c81ee-80a6-4832-a89b-09259bb56c6d tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:57.453903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-411c81ee-80a6-4832-a89b-09259bb56c6d tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.455117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-411c81ee-80a6-4832-a89b-09259bb56c6d tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:57.458620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-411c81ee-80a6-4832-a89b-09259bb56c6d tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.459413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-411c81ee-80a6-4832-a89b-09259bb56c6d tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:57.732298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-411c81ee-80a6-4832-a89b-09259bb56c6d tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:57.742812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-411c81ee-80a6-4832-a89b-09259bb56c6d tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1339 microversion: 2.1 time: 0.314092 Jul 20 04:14:57.771239 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 991/1939] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:57 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1339 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:57.776117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1775591831", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "aca274f9-d664-47a2-aeef-a3985bda5141"}], "block_device_mapping_v2": [{"uuid": "580919bb-5b1a-43fb-8d93-e48a3ac02fd9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:57.935869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] validate_networks() for [('aca274f9-d664-47a2-aeef-a3985bda5141', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:58.086088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dbc9ee40-f0f1-44ce-a373-79172b600f09 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:58.097298 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dbc9ee40-f0f1-44ce-a373-79172b600f09 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1315 microversion: 2.1 time: 0.856365 Jul 20 04:14:58.097896 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 949/1940] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:57 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:58.136101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-319205eb-c962-4d3d-8982-02c75713fc30 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:58.138515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-319205eb-c962-4d3d-8982-02c75713fc30 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:58.159873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-319205eb-c962-4d3d-8982-02c75713fc30 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.163048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-319205eb-c962-4d3d-8982-02c75713fc30 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.165281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-319205eb-c962-4d3d-8982-02c75713fc30 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.168765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-319205eb-c962-4d3d-8982-02c75713fc30 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.287216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-319205eb-c962-4d3d-8982-02c75713fc30 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:58.298187 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-319205eb-c962-4d3d-8982-02c75713fc30 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1275 microversion: 2.1 time: 0.177337 Jul 20 04:14:58.318800 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 950/1941] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:58 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:58.763589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d8480d3-95dd-4848-80c7-63ce30a857aa tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:58.764671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4d8480d3-95dd-4848-80c7-63ce30a857aa tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:58.769674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:58.783613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d8480d3-95dd-4848-80c7-63ce30a857aa tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.784436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d8480d3-95dd-4848-80c7-63ce30a857aa tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.786459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d8480d3-95dd-4848-80c7-63ce30a857aa tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:58.786942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d8480d3-95dd-4848-80c7-63ce30a857aa tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.075732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4d8480d3-95dd-4848-80c7-63ce30a857aa tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:59.088671 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4d8480d3-95dd-4848-80c7-63ce30a857aa tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1327 microversion: 2.1 time: 0.331486 Jul 20 04:14:59.100588 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 951/1942] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:58 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1327 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:59.116393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5a54476b-ce83-4a9c-8fab-426f3838b6bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.117475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5a54476b-ce83-4a9c-8fab-426f3838b6bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:59.128532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a54476b-ce83-4a9c-8fab-426f3838b6bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.129332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a54476b-ce83-4a9c-8fab-426f3838b6bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.130716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a54476b-ce83-4a9c-8fab-426f3838b6bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.131324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a54476b-ce83-4a9c-8fab-426f3838b6bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.509923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a54476b-ce83-4a9c-8fab-426f3838b6bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:59.520682 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5a54476b-ce83-4a9c-8fab-426f3838b6bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1315 microversion: 2.1 time: 0.409039 Jul 20 04:14:59.521277 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 952/1943] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:59 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:59.531933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a8dce62b-80e2-4193-9810-6a38888c66bf tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.532067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a8dce62b-80e2-4193-9810-6a38888c66bf tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:59.546808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8dce62b-80e2-4193-9810-6a38888c66bf tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.547385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8dce62b-80e2-4193-9810-6a38888c66bf tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.551990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8dce62b-80e2-4193-9810-6a38888c66bf tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.552923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8dce62b-80e2-4193-9810-6a38888c66bf tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.563923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:59.634058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:59.634891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:59.635126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:59.635801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:59.636729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:59.649290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.649769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.650678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.651395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.661850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:59.678477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Getting quotas for project 1ec8a3f7a123436c825135d50dd93865. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:59.686429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Getting quotas for user 04547e35c8c541af914c30e9083cda85 and project 1ec8a3f7a123436c825135d50dd93865. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:59.770885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:59.773183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='580919bb-5b1a-43fb-8d93-e48a3ac02fd9',volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:00.062344 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-96c88087-9c05-4d29-8594-f6cf1e9e84a9 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.289550 Jul 20 04:15:00.063086 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 992/1944] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:00.081891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-df089746-bc84-4a0d-92d1-36682d5c8818 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.083160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-df089746-bc84-4a0d-92d1-36682d5c8818 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:00.191013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a8dce62b-80e2-4193-9810-6a38888c66bf tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:00.201199 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a8dce62b-80e2-4193-9810-6a38888c66bf tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1281 microversion: 2.1 time: 0.678343 Jul 20 04:15:00.201554 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 953/1945] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:59 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1281 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:00.221464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2770f30a-ffa2-449a-a35f-d3edae9937e2 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.222286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2770f30a-ffa2-449a-a35f-d3edae9937e2 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:00.241643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2770f30a-ffa2-449a-a35f-d3edae9937e2 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.242157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2770f30a-ffa2-449a-a35f-d3edae9937e2 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.243097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2770f30a-ffa2-449a-a35f-d3edae9937e2 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.243519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2770f30a-ffa2-449a-a35f-d3edae9937e2 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.394697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-df089746-bc84-4a0d-92d1-36682d5c8818 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:00.405255 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-df089746-bc84-4a0d-92d1-36682d5c8818 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1053 microversion: 2.1 time: 0.335441 Jul 20 04:15:00.405945 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 993/1946] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1053 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:00.543654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-833a2b98-fc78-486e-852b-bbbd5bdcb723 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.544580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-833a2b98-fc78-486e-852b-bbbd5bdcb723 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:00.551538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-833a2b98-fc78-486e-852b-bbbd5bdcb723 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.552341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-833a2b98-fc78-486e-852b-bbbd5bdcb723 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.553376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-833a2b98-fc78-486e-852b-bbbd5bdcb723 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.553996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-833a2b98-fc78-486e-852b-bbbd5bdcb723 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.727664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2770f30a-ffa2-449a-a35f-d3edae9937e2 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:00.747268 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2770f30a-ffa2-449a-a35f-d3edae9937e2 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1395 microversion: 2.1 time: 0.537755 Jul 20 04:15:00.748244 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 954/1947] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1395 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:01.092798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-833a2b98-fc78-486e-852b-bbbd5bdcb723 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:01.102104 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-833a2b98-fc78-486e-852b-bbbd5bdcb723 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1315 microversion: 2.1 time: 0.566436 Jul 20 04:15:01.103241 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 994/1948] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:01.219503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6fb1d357-cb74-45d0-8f06-bcea897ced45 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.220458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6fb1d357-cb74-45d0-8f06-bcea897ced45 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:01.229182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fb1d357-cb74-45d0-8f06-bcea897ced45 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.229995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fb1d357-cb74-45d0-8f06-bcea897ced45 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.231191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fb1d357-cb74-45d0-8f06-bcea897ced45 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.231989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6fb1d357-cb74-45d0-8f06-bcea897ced45 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.334461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6fb1d357-cb74-45d0-8f06-bcea897ced45 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:01.344800 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6fb1d357-cb74-45d0-8f06-bcea897ced45 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1281 microversion: 2.1 time: 0.129991 Jul 20 04:15:01.356006 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 955/1949] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:01 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:01.455317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a9a5122-8ac3-4ca4-a4da-fae0660634ac tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.455985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6a9a5122-8ac3-4ca4-a4da-fae0660634ac tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:01.473772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a9a5122-8ac3-4ca4-a4da-fae0660634ac tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.474872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a9a5122-8ac3-4ca4-a4da-fae0660634ac tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.476161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a9a5122-8ac3-4ca4-a4da-fae0660634ac tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.479707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a9a5122-8ac3-4ca4-a4da-fae0660634ac tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.765434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c1a6a05-9e1d-49ba-a8ac-e6b6f4f33bdf tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.766807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c1a6a05-9e1d-49ba-a8ac-e6b6f4f33bdf tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:01.778184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c1a6a05-9e1d-49ba-a8ac-e6b6f4f33bdf tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.779157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c1a6a05-9e1d-49ba-a8ac-e6b6f4f33bdf tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.780548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c1a6a05-9e1d-49ba-a8ac-e6b6f4f33bdf tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.781467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c1a6a05-9e1d-49ba-a8ac-e6b6f4f33bdf tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.786208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6a9a5122-8ac3-4ca4-a4da-fae0660634ac tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:01.795407 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6a9a5122-8ac3-4ca4-a4da-fae0660634ac tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1151 microversion: 2.1 time: 0.372044 Jul 20 04:15:01.810599 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 995/1950] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:01 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1151 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:02.120229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f099cb14-b2bb-4717-9ad8-f530c403800c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.127570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f099cb14-b2bb-4717-9ad8-f530c403800c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:02.135171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f099cb14-b2bb-4717-9ad8-f530c403800c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.135871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f099cb14-b2bb-4717-9ad8-f530c403800c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.137499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f099cb14-b2bb-4717-9ad8-f530c403800c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.138116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f099cb14-b2bb-4717-9ad8-f530c403800c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.293300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c1a6a05-9e1d-49ba-a8ac-e6b6f4f33bdf tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:02.306874 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c1a6a05-9e1d-49ba-a8ac-e6b6f4f33bdf tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1395 microversion: 2.1 time: 0.545264 Jul 20 04:15:02.310464 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 956/1951] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:01 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1395 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:02.322961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a3b77164-bbe3-4af0-999f-7d57ac9b1338 req-bb84ac12-deb9-4972-acfc-f3633dc4335e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206ee904-1894-4f54-b06c-e8a01c6f08f3", "name": "network-vif-plugged", "status": "completed", "tag": "c7a6d515-10e3-43ee-8615-d871ff35bab2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:02.345439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a3b77164-bbe3-4af0-999f-7d57ac9b1338 req-bb84ac12-deb9-4972-acfc-f3633dc4335e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.346611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a3b77164-bbe3-4af0-999f-7d57ac9b1338 req-bb84ac12-deb9-4972-acfc-f3633dc4335e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.382109 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a3b77164-bbe3-4af0-999f-7d57ac9b1338 req-bb84ac12-deb9-4972-acfc-f3633dc4335e service nova] Creating event network-vif-plugged:c7a6d515-10e3-43ee-8615-d871ff35bab2 for instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 on n-h2-760456-11 Jul 20 04:15:02.395718 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a3b77164-bbe3-4af0-999f-7d57ac9b1338 req-bb84ac12-deb9-4972-acfc-f3633dc4335e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083422 Jul 20 04:15:02.398446 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 957/1952] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:02.408803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e7fb4a62-ce82-40d0-a7d0-f755cf71b2f1 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.412753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e7fb4a62-ce82-40d0-a7d0-f755cf71b2f1 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:02.445871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7fb4a62-ce82-40d0-a7d0-f755cf71b2f1 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.449934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7fb4a62-ce82-40d0-a7d0-f755cf71b2f1 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.454598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7fb4a62-ce82-40d0-a7d0-f755cf71b2f1 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.456244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7fb4a62-ce82-40d0-a7d0-f755cf71b2f1 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.572123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7fb4a62-ce82-40d0-a7d0-f755cf71b2f1 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:02.581197 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e7fb4a62-ce82-40d0-a7d0-f755cf71b2f1 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1281 microversion: 2.1 time: 0.181188 Jul 20 04:15:02.582093 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 958/1953] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:02.820206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aed37553-4e8d-44f1-bcc0-346dd9e8c980 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.821414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aed37553-4e8d-44f1-bcc0-346dd9e8c980 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:02.832638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aed37553-4e8d-44f1-bcc0-346dd9e8c980 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.833732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aed37553-4e8d-44f1-bcc0-346dd9e8c980 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.835134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aed37553-4e8d-44f1-bcc0-346dd9e8c980 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.835771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aed37553-4e8d-44f1-bcc0-346dd9e8c980 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.856291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f099cb14-b2bb-4717-9ad8-f530c403800c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:02.889830 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f099cb14-b2bb-4717-9ad8-f530c403800c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1315 microversion: 2.1 time: 0.773577 Jul 20 04:15:02.890549 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 996/1954] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:03.036705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3ea08fd1-dec9-47a3-a269-20eff0208ccb req-9d8239e3-fcfe-4a77-91af-671638ae3907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93a774b-f6ab-4eb7-a406-57d1ef3f6168", "tag": "f1355d83-3e28-49e8-a05a-c36da373924a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:03.047202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3ea08fd1-dec9-47a3-a269-20eff0208ccb req-9d8239e3-fcfe-4a77-91af-671638ae3907 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.047691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3ea08fd1-dec9-47a3-a269-20eff0208ccb req-9d8239e3-fcfe-4a77-91af-671638ae3907 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.068286 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3ea08fd1-dec9-47a3-a269-20eff0208ccb req-9d8239e3-fcfe-4a77-91af-671638ae3907 service nova] Creating event network-changed:f1355d83-3e28-49e8-a05a-c36da373924a for instance d93a774b-f6ab-4eb7-a406-57d1ef3f6168 on n-h1-760456-11 Jul 20 04:15:03.078272 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3ea08fd1-dec9-47a3-a269-20eff0208ccb req-9d8239e3-fcfe-4a77-91af-671638ae3907 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045368 Jul 20 04:15:03.079269 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 997/1955] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:03.085985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aed37553-4e8d-44f1-bcc0-346dd9e8c980 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.098076 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aed37553-4e8d-44f1-bcc0-346dd9e8c980 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1169 microversion: 2.1 time: 0.282132 Jul 20 04:15:03.103149 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 959/1956] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1169 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:03.328221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8eb1390b-b6e1-49b2-b58e-0d2e76435f6e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.329541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8eb1390b-b6e1-49b2-b58e-0d2e76435f6e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:03.354277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb1390b-b6e1-49b2-b58e-0d2e76435f6e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.355100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb1390b-b6e1-49b2-b58e-0d2e76435f6e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.356941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb1390b-b6e1-49b2-b58e-0d2e76435f6e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.357568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb1390b-b6e1-49b2-b58e-0d2e76435f6e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.599215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-741fcaa0-4956-43dc-a4f8-b3e13da6860b tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.600170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-741fcaa0-4956-43dc-a4f8-b3e13da6860b tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:03.624415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-741fcaa0-4956-43dc-a4f8-b3e13da6860b tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.626503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-741fcaa0-4956-43dc-a4f8-b3e13da6860b tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:03.629216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-741fcaa0-4956-43dc-a4f8-b3e13da6860b tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:03.631831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-741fcaa0-4956-43dc-a4f8-b3e13da6860b tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.045221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8eb1390b-b6e1-49b2-b58e-0d2e76435f6e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:04.053017 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8eb1390b-b6e1-49b2-b58e-0d2e76435f6e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1395 microversion: 2.1 time: 0.730463 Jul 20 04:15:04.053982 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 998/1957] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1395 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:04.058927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-40a7d0ca-a286-4ca9-a50e-bc0bcfe35af8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:04.065480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-40a7d0ca-a286-4ca9-a50e-bc0bcfe35af8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:04.076586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40a7d0ca-a286-4ca9-a50e-bc0bcfe35af8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.077302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40a7d0ca-a286-4ca9-a50e-bc0bcfe35af8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.078305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40a7d0ca-a286-4ca9-a50e-bc0bcfe35af8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.091059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40a7d0ca-a286-4ca9-a50e-bc0bcfe35af8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.220799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-741fcaa0-4956-43dc-a4f8-b3e13da6860b tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:04.233855 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-741fcaa0-4956-43dc-a4f8-b3e13da6860b tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1323 microversion: 2.1 time: 0.638886 Jul 20 04:15:04.234969 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 960/1958] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1323 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:04.240951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-42de5b62-e734-4bcb-92af-7087e45f9a6c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:04.241962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-42de5b62-e734-4bcb-92af-7087e45f9a6c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:04.249222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42de5b62-e734-4bcb-92af-7087e45f9a6c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.250362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42de5b62-e734-4bcb-92af-7087e45f9a6c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.251504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42de5b62-e734-4bcb-92af-7087e45f9a6c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.252212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-42de5b62-e734-4bcb-92af-7087e45f9a6c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.363967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-42de5b62-e734-4bcb-92af-7087e45f9a6c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:04.374872 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-42de5b62-e734-4bcb-92af-7087e45f9a6c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1169 microversion: 2.1 time: 0.137723 Jul 20 04:15:04.391286 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 961/1959] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:04 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1169 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:04.671894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-40a7d0ca-a286-4ca9-a50e-bc0bcfe35af8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:04.680468 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-40a7d0ca-a286-4ca9-a50e-bc0bcfe35af8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1502 microversion: 2.1 time: 0.625189 Jul 20 04:15:04.682646 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 999/1960] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:04 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1502 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:04.699167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-803ed2c6-1b8b-4357-a100-53a9a1cfc54e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:04.699821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-803ed2c6-1b8b-4357-a100-53a9a1cfc54e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:04.709108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-803ed2c6-1b8b-4357-a100-53a9a1cfc54e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.713730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-803ed2c6-1b8b-4357-a100-53a9a1cfc54e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.715114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-803ed2c6-1b8b-4357-a100-53a9a1cfc54e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.716351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-803ed2c6-1b8b-4357-a100-53a9a1cfc54e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.771671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-803ed2c6-1b8b-4357-a100-53a9a1cfc54e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:04.927904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-803ed2c6-1b8b-4357-a100-53a9a1cfc54e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 204 len: 0 microversion: 2.1 time: 0.232549 Jul 20 04:15:04.929163 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 962/1961] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:04 2022] DELETE /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:04.938815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb6358fe-6ba3-4d76-ba1d-c90839ebb021 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:04.939971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb6358fe-6ba3-4d76-ba1d-c90839ebb021 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:04.947098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb6358fe-6ba3-4d76-ba1d-c90839ebb021 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.947825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb6358fe-6ba3-4d76-ba1d-c90839ebb021 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.948982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb6358fe-6ba3-4d76-ba1d-c90839ebb021 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.950846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb6358fe-6ba3-4d76-ba1d-c90839ebb021 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.071573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-52bb1593-4e77-4bc4-bffb-52d12a0f86c1 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:05.073566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-52bb1593-4e77-4bc4-bffb-52d12a0f86c1 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:05.084162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52bb1593-4e77-4bc4-bffb-52d12a0f86c1 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.085029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52bb1593-4e77-4bc4-bffb-52d12a0f86c1 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.086373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52bb1593-4e77-4bc4-bffb-52d12a0f86c1 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.088055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52bb1593-4e77-4bc4-bffb-52d12a0f86c1 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.367362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb6358fe-6ba3-4d76-ba1d-c90839ebb021 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:05.378118 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb6358fe-6ba3-4d76-ba1d-c90839ebb021 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1508 microversion: 2.1 time: 0.443449 Jul 20 04:15:05.391613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-52bb1593-4e77-4bc4-bffb-52d12a0f86c1 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:05.414167 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1000/1962] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:04 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1508 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:05.420153 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-52bb1593-4e77-4bc4-bffb-52d12a0f86c1 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1395 microversion: 2.1 time: 0.353453 Jul 20 04:15:05.424711 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 963/1963] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:05 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1395 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:05.425444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6b535dbc-a9a9-480f-8fc5-29ecbb3954d8 req-60157b35-2fc5-49fa-8517-a8804a751cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c415a038-aa6b-4a15-bc65-025e22d1538b", "tag": "d482578a-c666-4044-8d65-fc9f23840998"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:05.432139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73b33596-6bc5-46bc-a1aa-9eb572c0b1be tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:05.440883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-73b33596-6bc5-46bc-a1aa-9eb572c0b1be tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:05.443986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6b535dbc-a9a9-480f-8fc5-29ecbb3954d8 req-60157b35-2fc5-49fa-8517-a8804a751cdb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.444439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6b535dbc-a9a9-480f-8fc5-29ecbb3954d8 req-60157b35-2fc5-49fa-8517-a8804a751cdb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.459002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73b33596-6bc5-46bc-a1aa-9eb572c0b1be tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.459579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73b33596-6bc5-46bc-a1aa-9eb572c0b1be tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.462428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73b33596-6bc5-46bc-a1aa-9eb572c0b1be tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.465653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73b33596-6bc5-46bc-a1aa-9eb572c0b1be tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.468964 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6b535dbc-a9a9-480f-8fc5-29ecbb3954d8 req-60157b35-2fc5-49fa-8517-a8804a751cdb service nova] Creating event network-changed:d482578a-c666-4044-8d65-fc9f23840998 for instance c415a038-aa6b-4a15-bc65-025e22d1538b on n-h2-760456-11 Jul 20 04:15:05.482602 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6b535dbc-a9a9-480f-8fc5-29ecbb3954d8 req-60157b35-2fc5-49fa-8517-a8804a751cdb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064460 Jul 20 04:15:05.483252 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1001/1964] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:05.489184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b2d81c31-c49a-4d6e-933e-d7ba66fc2e9e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:05.489887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b2d81c31-c49a-4d6e-933e-d7ba66fc2e9e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:05.513412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2d81c31-c49a-4d6e-933e-d7ba66fc2e9e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.514159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2d81c31-c49a-4d6e-933e-d7ba66fc2e9e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.515220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2d81c31-c49a-4d6e-933e-d7ba66fc2e9e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.515872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2d81c31-c49a-4d6e-933e-d7ba66fc2e9e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.777410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b2d81c31-c49a-4d6e-933e-d7ba66fc2e9e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:05.790271 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b2d81c31-c49a-4d6e-933e-d7ba66fc2e9e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1211 microversion: 2.1 time: 0.305084 Jul 20 04:15:05.797161 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1002/1965] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:05 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1211 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:05.945484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-73b33596-6bc5-46bc-a1aa-9eb572c0b1be tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:05.959733 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-73b33596-6bc5-46bc-a1aa-9eb572c0b1be tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1323 microversion: 2.1 time: 0.530464 Jul 20 04:15:05.960359 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 964/1966] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:05 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1323 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:06.417002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32ec7a95-c157-4291-8153-ae50f25e59a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:06.418969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-32ec7a95-c157-4291-8153-ae50f25e59a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:06.440654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-263c08f9-d153-4de2-91db-355561af4b15 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:06.441962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-263c08f9-d153-4de2-91db-355561af4b15 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:06.447817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32ec7a95-c157-4291-8153-ae50f25e59a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:06.451416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32ec7a95-c157-4291-8153-ae50f25e59a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:06.456460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32ec7a95-c157-4291-8153-ae50f25e59a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:06.456973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-263c08f9-d153-4de2-91db-355561af4b15 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:06.457594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32ec7a95-c157-4291-8153-ae50f25e59a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:06.461146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-263c08f9-d153-4de2-91db-355561af4b15 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:06.466733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-263c08f9-d153-4de2-91db-355561af4b15 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:06.467389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-263c08f9-d153-4de2-91db-355561af4b15 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:06.564548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:06.622000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=16 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:06.938926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-263c08f9-d153-4de2-91db-355561af4b15 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:06.948350 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-263c08f9-d153-4de2-91db-355561af4b15 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1395 microversion: 2.1 time: 0.511419 Jul 20 04:15:06.958206 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 965/1967] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:06 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1395 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:06.976577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3152a51f-d048-4eba-b35c-39fcc6011212 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:06.987382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3152a51f-d048-4eba-b35c-39fcc6011212 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:07.006858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3152a51f-d048-4eba-b35c-39fcc6011212 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.008071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3152a51f-d048-4eba-b35c-39fcc6011212 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.009471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3152a51f-d048-4eba-b35c-39fcc6011212 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.010093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3152a51f-d048-4eba-b35c-39fcc6011212 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.460434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-32ec7a95-c157-4291-8153-ae50f25e59a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:07.473882 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-32ec7a95-c157-4291-8153-ae50f25e59a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1508 microversion: 2.1 time: 1.060571 Jul 20 04:15:07.475220 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1003/1968] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:06 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1508 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:07.486376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-38285bbf-99c2-4b56-b929-117838e604f4 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:07.487458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-38285bbf-99c2-4b56-b929-117838e604f4 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:07.497687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-38285bbf-99c2-4b56-b929-117838e604f4 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.499464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-38285bbf-99c2-4b56-b929-117838e604f4 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.501255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-38285bbf-99c2-4b56-b929-117838e604f4 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.504057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-38285bbf-99c2-4b56-b929-117838e604f4 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.575598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3152a51f-d048-4eba-b35c-39fcc6011212 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:07.590755 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3152a51f-d048-4eba-b35c-39fcc6011212 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1211 microversion: 2.1 time: 0.629770 Jul 20 04:15:07.592571 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 966/1969] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:06 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1211 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:07.934460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-38285bbf-99c2-4b56-b929-117838e604f4 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:07.946781 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-38285bbf-99c2-4b56-b929-117838e604f4 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1323 microversion: 2.1 time: 0.468789 Jul 20 04:15:07.950645 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1004/1970] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:07 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:07.976286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ac31d84b-d10d-406f-b0d1-fa8a37d5262b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:07.976927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ac31d84b-d10d-406f-b0d1-fa8a37d5262b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:08.008728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac31d84b-d10d-406f-b0d1-fa8a37d5262b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.011534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac31d84b-d10d-406f-b0d1-fa8a37d5262b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.014555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac31d84b-d10d-406f-b0d1-fa8a37d5262b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.015297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac31d84b-d10d-406f-b0d1-fa8a37d5262b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.264169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d1d8261-720d-4272-9133-3e36f2024045 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:08.265133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7d1d8261-720d-4272-9133-3e36f2024045 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:08.273099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d1d8261-720d-4272-9133-3e36f2024045 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.273881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d1d8261-720d-4272-9133-3e36f2024045 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.274889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d1d8261-720d-4272-9133-3e36f2024045 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.275580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d1d8261-720d-4272-9133-3e36f2024045 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.694160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-7d1d8261-720d-4272-9133-3e36f2024045 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid 358c5f50-cf9e-4577-a295-0aa87e318810 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:08.713008 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d1d8261-720d-4272-9133-3e36f2024045 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 2346 microversion: 2.25 time: 0.455318 Jul 20 04:15:08.715395 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1005/1971] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:08 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 2346 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:08.720908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-29b53afe-c2e7-4036-b648-473d82013212 req-7abc50f3-35f6-4ede-94d4-c062a77e69cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2ae540-9679-4d32-a12c-4ac56e81f928", "tag": "7dadbe99-6cc6-433e-ada6-72d466f63f3c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:08.732413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-29b53afe-c2e7-4036-b648-473d82013212 req-7abc50f3-35f6-4ede-94d4-c062a77e69cb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.733131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-29b53afe-c2e7-4036-b648-473d82013212 req-7abc50f3-35f6-4ede-94d4-c062a77e69cb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.769454 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-29b53afe-c2e7-4036-b648-473d82013212 req-7abc50f3-35f6-4ede-94d4-c062a77e69cb service nova] Creating event network-changed:7dadbe99-6cc6-433e-ada6-72d466f63f3c for instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 on n-h1-760456-11 Jul 20 04:15:08.777706 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-29b53afe-c2e7-4036-b648-473d82013212 req-7abc50f3-35f6-4ede-94d4-c062a77e69cb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060022 Jul 20 04:15:08.779790 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1006/1972] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:08.789408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-85d12f1c-ef29-4206-812b-b3085550df8a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:08.793259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-85d12f1c-ef29-4206-812b-b3085550df8a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:08.809331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85d12f1c-ef29-4206-812b-b3085550df8a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.810488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85d12f1c-ef29-4206-812b-b3085550df8a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.811661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85d12f1c-ef29-4206-812b-b3085550df8a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.813338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85d12f1c-ef29-4206-812b-b3085550df8a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.845050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ac31d84b-d10d-406f-b0d1-fa8a37d5262b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:08.861144 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ac31d84b-d10d-406f-b0d1-fa8a37d5262b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1395 microversion: 2.1 time: 0.889304 Jul 20 04:15:08.863934 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 967/1973] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:07 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1395 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:08.880404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5184c018-7422-4721-be7d-a7ac40a71d31 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:08.881464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5184c018-7422-4721-be7d-a7ac40a71d31 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:08.901554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5184c018-7422-4721-be7d-a7ac40a71d31 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.902014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5184c018-7422-4721-be7d-a7ac40a71d31 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.902839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5184c018-7422-4721-be7d-a7ac40a71d31 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:08.903272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5184c018-7422-4721-be7d-a7ac40a71d31 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:08.972499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-85d12f1c-ef29-4206-812b-b3085550df8a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:08.987294 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-85d12f1c-ef29-4206-812b-b3085550df8a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1466 microversion: 2.1 time: 0.206077 Jul 20 04:15:08.990762 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1007/1974] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:08 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1466 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:09.001528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-adc74a9b-2dd4-4a12-943f-a6c5d7e6ed70 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.003455 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:09.003455 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:15:09.008201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adc74a9b-2dd4-4a12-943f-a6c5d7e6ed70 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.010198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adc74a9b-2dd4-4a12-943f-a6c5d7e6ed70 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.011216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adc74a9b-2dd4-4a12-943f-a6c5d7e6ed70 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.019087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adc74a9b-2dd4-4a12-943f-a6c5d7e6ed70 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.083939 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-adc74a9b-2dd4-4a12-943f-a6c5d7e6ed70 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.091612 Jul 20 04:15:09.108072 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1008/1975] 10.222.0.59 () {60 vars in 1216 bytes} [Wed Jul 20 04:15:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:09.115572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ba97892c-15d1-462f-ae64-fe4a3d2ddce6 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.116840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ba97892c-15d1-462f-ae64-fe4a3d2ddce6 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:09.134414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba97892c-15d1-462f-ae64-fe4a3d2ddce6 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.139428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba97892c-15d1-462f-ae64-fe4a3d2ddce6 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.147473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba97892c-15d1-462f-ae64-fe4a3d2ddce6 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.148231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba97892c-15d1-462f-ae64-fe4a3d2ddce6 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.399970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5184c018-7422-4721-be7d-a7ac40a71d31 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:09.405905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:09.413785 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5184c018-7422-4721-be7d-a7ac40a71d31 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1211 microversion: 2.1 time: 0.547278 Jul 20 04:15:09.425704 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 968/1976] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:08 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1211 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:09.434584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-21a6f2cd-4db8-4a65-ad31-e329cca2c79a req-48855170-3d79-4c0a-a6ce-342f31ba6f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206ee904-1894-4f54-b06c-e8a01c6f08f3", "name": "network-vif-deleted", "tag": "c7a6d515-10e3-43ee-8615-d871ff35bab2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:09.446048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-21a6f2cd-4db8-4a65-ad31-e329cca2c79a req-48855170-3d79-4c0a-a6ce-342f31ba6f54 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.446978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-21a6f2cd-4db8-4a65-ad31-e329cca2c79a req-48855170-3d79-4c0a-a6ce-342f31ba6f54 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.468132 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-21a6f2cd-4db8-4a65-ad31-e329cca2c79a req-48855170-3d79-4c0a-a6ce-342f31ba6f54 service nova] Creating event network-vif-deleted:c7a6d515-10e3-43ee-8615-d871ff35bab2 for instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 on n-h2-760456-11 Jul 20 04:15:09.474025 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-21a6f2cd-4db8-4a65-ad31-e329cca2c79a req-48855170-3d79-4c0a-a6ce-342f31ba6f54 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046610 Jul 20 04:15:09.475147 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 969/1977] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:09.716697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ba97892c-15d1-462f-ae64-fe4a3d2ddce6 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:09.732959 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ba97892c-15d1-462f-ae64-fe4a3d2ddce6 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1323 microversion: 2.1 time: 0.622443 Jul 20 04:15:09.735217 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1009/1978] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1323 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:09.888332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6900eec3-ff84-4dad-ba8f-a166b80cd110 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.888332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6900eec3-ff84-4dad-ba8f-a166b80cd110 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:09.912991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6900eec3-ff84-4dad-ba8f-a166b80cd110 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.913460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6900eec3-ff84-4dad-ba8f-a166b80cd110 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.918822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6900eec3-ff84-4dad-ba8f-a166b80cd110 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.919436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6900eec3-ff84-4dad-ba8f-a166b80cd110 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.010371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.013184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:10.037453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.039704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.040638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.041097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.144345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.145781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.146700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lazy-loading 'fault' on Instance uuid 206ee904-1894-4f54-b06c-e8a01c6f08f3 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:10.295129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6900eec3-ff84-4dad-ba8f-a166b80cd110 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:10.317998 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6900eec3-ff84-4dad-ba8f-a166b80cd110 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1395 microversion: 2.1 time: 0.438980 Jul 20 04:15:10.322234 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 970/1979] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1395 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:10.343674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:10.369644 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1807498c-7e30-4c4c-a559-f03ab2d160d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 200 len: 1305 microversion: 2.1 time: 0.359926 Jul 20 04:15:10.377339 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1010/1980] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 1305 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:10.438808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-32ef6d19-bf90-411c-bdc3-d5da05c8787f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.442763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-32ef6d19-bf90-411c-bdc3-d5da05c8787f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:10.465373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32ef6d19-bf90-411c-bdc3-d5da05c8787f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.465865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32ef6d19-bf90-411c-bdc3-d5da05c8787f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.471917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32ef6d19-bf90-411c-bdc3-d5da05c8787f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.472650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32ef6d19-bf90-411c-bdc3-d5da05c8787f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.753885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8ac7fe92-58c3-4744-9f02-850095e5e642 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.754959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8ac7fe92-58c3-4744-9f02-850095e5e642 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:10.757338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=14 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:10.766080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:10.797176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ac7fe92-58c3-4744-9f02-850095e5e642 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.800911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ac7fe92-58c3-4744-9f02-850095e5e642 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.804445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ac7fe92-58c3-4744-9f02-850095e5e642 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.805404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ac7fe92-58c3-4744-9f02-850095e5e642 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.951117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-32ef6d19-bf90-411c-bdc3-d5da05c8787f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:10.972833 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-32ef6d19-bf90-411c-bdc3-d5da05c8787f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1199 microversion: 2.1 time: 0.544761 Jul 20 04:15:10.975487 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 971/1981] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1199 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:11.112541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8ac7fe92-58c3-4744-9f02-850095e5e642 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:11.125829 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8ac7fe92-58c3-4744-9f02-850095e5e642 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1323 microversion: 2.1 time: 0.376657 Jul 20 04:15:11.144950 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1011/1982] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:11.276316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1cb94924-025a-4670-8c3c-22d4808fbba4 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Calling method '.version_select at 0x7fb841d21700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:11.315444 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-1cb94924-025a-4670-8c3c-22d4808fbba4 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] HTTP exception thrown: Image not found. Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1cb94924-025a-4670-8c3c-22d4808fbba4 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Request method failure captured: Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/images/536dfd1e-3ae2-4394-b967-02329e7efbcd/metadata/os_distro HTTP/1.1 Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14FOrS2wZlyMfNTFVuigHU9osRWndO75mgzBY8dr05DZ44ijAVKQ51wJthWNOseWlFKS-oitiz60uLJ9cZRogSUXBVNFLBjnYnHqlErnzuK7wdsEUFPYa36d8TF6AdcCojy6aBFok7JNx4NT7DOtpwh_yAYHAW0KaSvykynr8G6b6Zk Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/755330956d0d439281a57579446d91a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_755330956d0d439281a57579446d91a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 745ac39c72f14e128460281edd2e7a16 Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'image_id': '536dfd1e-3ae2-4394-b967-02329e7efbcd', 'id': 'os_distro'} Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 536dfd1e-3ae2-4394-b967-02329e7efbcd Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:15:11.341865 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 536dfd1e-3ae2-4394-b967-02329e7efbcd could not be found. Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:15:11.348060 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.355597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1cb94924-025a-4670-8c3c-22d4808fbba4 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:11.357336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-74a41bca-1c02-4925-8273-b12e788fa816 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:11.358217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-74a41bca-1c02-4925-8273-b12e788fa816 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:11.358714 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1cb94924-025a-4670-8c3c-22d4808fbba4 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] 10.222.0.59 "DELETE /compute/v2.1/images/536dfd1e-3ae2-4394-b967-02329e7efbcd/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.375602 Jul 20 04:15:11.366326 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 972/1983] 10.222.0.59 () {58 vars in 1292 bytes} [Wed Jul 20 04:15:10 2022] DELETE /compute/v2.1/images/536dfd1e-3ae2-4394-b967-02329e7efbcd/metadata/os_distro => generated 62 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:11.373679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74a41bca-1c02-4925-8273-b12e788fa816 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.375013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74a41bca-1c02-4925-8273-b12e788fa816 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.384085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74a41bca-1c02-4925-8273-b12e788fa816 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.399542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74a41bca-1c02-4925-8273-b12e788fa816 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.402401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-52fdc91c-f9b7-4b29-b7c6-cc89a8ac1ec0 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Calling method '.version_select at 0x7fb841dd21f0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:11.429098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:11.480956 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-52fdc91c-f9b7-4b29-b7c6-cc89a8ac1ec0 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] HTTP exception thrown: Image not found. Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-52fdc91c-f9b7-4b29-b7c6-cc89a8ac1ec0 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Request method failure captured: Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/images/fc8bd3c1-bb9c-4764-aa1f-187301f65e78/metadata/os_version HTTP/1.1 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14FOrS2wZlyMfNTFVuigHU9osRWndO75mgzBY8dr05DZ44ijAVKQ51wJthWNOseWlFKS-oitiz60uLJ9cZRogSUXBVNFLBjnYnHqlErnzuK7wdsEUFPYa36d8TF6AdcCojy6aBFok7JNx4NT7DOtpwh_yAYHAW0KaSvykynr8G6b6Zk Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/755330956d0d439281a57579446d91a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_755330956d0d439281a57579446d91a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 745ac39c72f14e128460281edd2e7a16 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'image_id': 'fc8bd3c1-bb9c-4764-aa1f-187301f65e78', 'id': 'os_version'} Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fc8bd3c1-bb9c-4764-aa1f-187301f65e78 Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:15:11.483263 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fc8bd3c1-bb9c-4764-aa1f-187301f65e78 could not be found. Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-52fdc91c-f9b7-4b29-b7c6-cc89a8ac1ec0 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-52fdc91c-f9b7-4b29-b7c6-cc89a8ac1ec0 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] 10.222.0.59 "GET /compute/v2.1/images/fc8bd3c1-bb9c-4764-aa1f-187301f65e78/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.108176 Jul 20 04:15:11.489894 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 973/1984] 10.222.0.59 () {58 vars in 1292 bytes} [Wed Jul 20 04:15:11 2022] GET /compute/v2.1/images/fc8bd3c1-bb9c-4764-aa1f-187301f65e78/metadata/os_version => generated 62 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:11.504968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-501ec951-6121-450b-bd59-322275b66d4e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:11.505649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-501ec951-6121-450b-bd59-322275b66d4e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:11.524386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-501ec951-6121-450b-bd59-322275b66d4e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.527551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-501ec951-6121-450b-bd59-322275b66d4e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.530680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-501ec951-6121-450b-bd59-322275b66d4e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.536047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-501ec951-6121-450b-bd59-322275b66d4e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.590210 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-501ec951-6121-450b-bd59-322275b66d4e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-501ec951-6121-450b-bd59-322275b66d4e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 HTTP/1.1 Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '206ee904-1894-4f54-b06c-e8a01c6f08f3'} Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.593779 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.599646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.599646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.599646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.599646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:11.599646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:11.599646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:15:11.599646 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.599646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-501ec951-6121-450b-bd59-322275b66d4e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:11.599646 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-501ec951-6121-450b-bd59-322275b66d4e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 404 len: 111 microversion: 2.1 time: 0.105850 Jul 20 04:15:11.612783 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 974/1985] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:11 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:11.626168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f47c4a39-831b-4163-9389-2fc8f2795879 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Calling method '.version_select at 0x7fb841d218b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:11.667414 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-f47c4a39-831b-4163-9389-2fc8f2795879 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] HTTP exception thrown: Image not found. Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f47c4a39-831b-4163-9389-2fc8f2795879 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Request method failure captured: Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/images/cb83657f-d119-4349-bc15-12ca151cae2a/metadata HTTP/1.1 Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14FOrS2wZlyMfNTFVuigHU9osRWndO75mgzBY8dr05DZ44ijAVKQ51wJthWNOseWlFKS-oitiz60uLJ9cZRogSUXBVNFLBjnYnHqlErnzuK7wdsEUFPYa36d8TF6AdcCojy6aBFok7JNx4NT7DOtpwh_yAYHAW0KaSvykynr8G6b6Zk Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/755330956d0d439281a57579446d91a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_755330956d0d439281a57579446d91a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 745ac39c72f14e128460281edd2e7a16 Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'image_id': 'cb83657f-d119-4349-bc15-12ca151cae2a'} Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cb83657f-d119-4349-bc15-12ca151cae2a Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:15:11.671327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb83657f-d119-4349-bc15-12ca151cae2a could not be found. Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.680740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f47c4a39-831b-4163-9389-2fc8f2795879 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:11.693565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-74a41bca-1c02-4925-8273-b12e788fa816 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:11.693743 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f47c4a39-831b-4163-9389-2fc8f2795879 tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] 10.222.0.59 "GET /compute/v2.1/images/cb83657f-d119-4349-bc15-12ca151cae2a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.061903 Jul 20 04:15:11.693743 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 975/1986] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:15:11 2022] GET /compute/v2.1/images/cb83657f-d119-4349-bc15-12ca151cae2a/metadata => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:11.694041 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-74a41bca-1c02-4925-8273-b12e788fa816 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1395 microversion: 2.1 time: 0.353842 Jul 20 04:15:11.699833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58756548-1755-4a9c-8747-ec8a9dbc0a7e tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Action: 'update_all', calling method: .version_select at 0x7fb841d21af0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:11.705448 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1012/1987] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:11 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1395 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:11.747540 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-58756548-1755-4a9c-8747-ec8a9dbc0a7e tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] HTTP exception thrown: Image not found. Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58756548-1755-4a9c-8747-ec8a9dbc0a7e tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Request method failure captured: Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: request: PUT /compute/v2.1/images/4934017a-50d4-41f2-ab4e-7a9ce7b683fa/metadata HTTP/1.1 Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 57 Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14FOrS2wZlyMfNTFVuigHU9osRWndO75mgzBY8dr05DZ44ijAVKQ51wJthWNOseWlFKS-oitiz60uLJ9cZRogSUXBVNFLBjnYnHqlErnzuK7wdsEUFPYa36d8TF6AdcCojy6aBFok7JNx4NT7DOtpwh_yAYHAW0KaSvykynr8G6b6Zk Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/755330956d0d439281a57579446d91a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_755330956d0d439281a57579446d91a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 745ac39c72f14e128460281edd2e7a16 Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'image_id': '4934017a-50d4-41f2-ab4e-7a9ce7b683fa', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4934017a-50d4-41f2-ab4e-7a9ce7b683fa Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:15:11.750954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4934017a-50d4-41f2-ab4e-7a9ce7b683fa could not be found. Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58756548-1755-4a9c-8747-ec8a9dbc0a7e tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-58756548-1755-4a9c-8747-ec8a9dbc0a7e tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] 10.222.0.59 "PUT /compute/v2.1/images/4934017a-50d4-41f2-ab4e-7a9ce7b683fa/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065947 Jul 20 04:15:11.756489 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 976/1988] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:15:11 2022] PUT /compute/v2.1/images/4934017a-50d4-41f2-ab4e-7a9ce7b683fa/metadata => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:11.768004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b74e18b-3a8e-461a-b8b1-cb1a314bc38b tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Action: 'update', calling method: .version_select at 0x7fb841b23b80>, body: {"meta": {"os_distro": "alt"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:11.797474 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3b74e18b-3a8e-461a-b8b1-cb1a314bc38b tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] HTTP exception thrown: Image not found. Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b74e18b-3a8e-461a-b8b1-cb1a314bc38b tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Request method failure captured: Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/images/276f9062-08cf-4679-a61e-94719c5a2f9f/metadata/os_distro HTTP/1.1 Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 30 Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14FOrS2wZlyMfNTFVuigHU9osRWndO75mgzBY8dr05DZ44ijAVKQ51wJthWNOseWlFKS-oitiz60uLJ9cZRogSUXBVNFLBjnYnHqlErnzuK7wdsEUFPYa36d8TF6AdcCojy6aBFok7JNx4NT7DOtpwh_yAYHAW0KaSvykynr8G6b6Zk Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/755330956d0d439281a57579446d91a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_755330956d0d439281a57579446d91a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 745ac39c72f14e128460281edd2e7a16 Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: {"meta": {"os_distro": "alt"}} Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: exception: Image not found. Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'image_id': '276f9062-08cf-4679-a61e-94719c5a2f9f', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 276f9062-08cf-4679-a61e-94719c5a2f9f Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:15:11.800478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 276f9062-08cf-4679-a61e-94719c5a2f9f could not be found. Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b74e18b-3a8e-461a-b8b1-cb1a314bc38b tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Returning 404 to user: Image not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b74e18b-3a8e-461a-b8b1-cb1a314bc38b tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] 10.222.0.59 "PUT /compute/v2.1/images/276f9062-08cf-4679-a61e-94719c5a2f9f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.038767 Jul 20 04:15:11.815407 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1013/1989] 10.222.0.59 () {60 vars in 1309 bytes} [Wed Jul 20 04:15:11 2022] PUT /compute/v2.1/images/276f9062-08cf-4679-a61e-94719c5a2f9f/metadata/os_distro => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:11.826855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-150d7ec7-3d5d-44dc-bad8-7b2c477fdaaa tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Action: 'create', calling method: .version_select at 0x7fb841d1a0d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:11.849509 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-150d7ec7-3d5d-44dc-bad8-7b2c477fdaaa tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] HTTP exception thrown: Image not found. Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-150d7ec7-3d5d-44dc-bad8-7b2c477fdaaa tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Request method failure captured: Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/images/30953745-7b6d-43b6-b7fa-baf41da56511/metadata HTTP/1.1 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 57 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14FOrS2wZlyMfNTFVuigHU9osRWndO75mgzBY8dr05DZ44ijAVKQ51wJthWNOseWlFKS-oitiz60uLJ9cZRogSUXBVNFLBjnYnHqlErnzuK7wdsEUFPYa36d8TF6AdcCojy6aBFok7JNx4NT7DOtpwh_yAYHAW0KaSvykynr8G6b6Zk Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/755330956d0d439281a57579446d91a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/755330956d0d439281a57579446d91a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_755330956d0d439281a57579446d91a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 755330956d0d439281a57579446d91a4 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-729764225 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 745ac39c72f14e128460281edd2e7a16 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-729764225-project Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'image_id': '30953745-7b6d-43b6-b7fa-baf41da56511', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 30953745-7b6d-43b6-b7fa-baf41da56511 Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:15:11.852660 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 30953745-7b6d-43b6-b7fa-baf41da56511 could not be found. Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-150d7ec7-3d5d-44dc-bad8-7b2c477fdaaa tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:11.860186 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-150d7ec7-3d5d-44dc-bad8-7b2c477fdaaa tempest-ImagesMetadataNegativeTestJSON-729764225 tempest-ImagesMetadataNegativeTestJSON-729764225-project] 10.222.0.59 "POST /compute/v2.1/images/30953745-7b6d-43b6-b7fa-baf41da56511/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048586 Jul 20 04:15:11.865381 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 977/1990] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Jul 20 04:15:11 2022] POST /compute/v2.1/images/30953745-7b6d-43b6-b7fa-baf41da56511/metadata => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:11.912728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-499266990", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "191d678e-1adc-40c3-b7b1-1a7cb20ca675"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:11.995055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-19e893f8-526d-49bd-afde-15073190bcb0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:11.995799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-19e893f8-526d-49bd-afde-15073190bcb0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:12.010151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19e893f8-526d-49bd-afde-15073190bcb0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.010629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19e893f8-526d-49bd-afde-15073190bcb0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.011448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19e893f8-526d-49bd-afde-15073190bcb0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.011677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] validate_networks() for [('191d678e-1adc-40c3-b7b1-1a7cb20ca675', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:12.011890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19e893f8-526d-49bd-afde-15073190bcb0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.480278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-19e893f8-526d-49bd-afde-15073190bcb0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:12.498162 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-19e893f8-526d-49bd-afde-15073190bcb0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1199 microversion: 2.1 time: 0.505337 Jul 20 04:15:12.499186 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 978/1991] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:11 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1199 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:12.514160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5a800502-fa81-4079-ae0b-32469c4e88d8 req-783f845c-b888-49e6-b3d3-080a3a9e737f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93a774b-f6ab-4eb7-a406-57d1ef3f6168", "name": "network-vif-plugged", "status": "completed", "tag": "f1355d83-3e28-49e8-a05a-c36da373924a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:12.539706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5a800502-fa81-4079-ae0b-32469c4e88d8 req-783f845c-b888-49e6-b3d3-080a3a9e737f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.540263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5a800502-fa81-4079-ae0b-32469c4e88d8 req-783f845c-b888-49e6-b3d3-080a3a9e737f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.556900 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5a800502-fa81-4079-ae0b-32469c4e88d8 req-783f845c-b888-49e6-b3d3-080a3a9e737f service nova] Creating event network-vif-plugged:f1355d83-3e28-49e8-a05a-c36da373924a for instance d93a774b-f6ab-4eb7-a406-57d1ef3f6168 on n-h1-760456-11 Jul 20 04:15:12.565704 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5a800502-fa81-4079-ae0b-32469c4e88d8 req-783f845c-b888-49e6-b3d3-080a3a9e737f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062891 Jul 20 04:15:12.566623 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 979/1992] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:12.587850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-27ca4976-25b9-4a75-8ba2-2abe01877336 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "217e91b6-8de6-432b-b218-150adf73ef94", "device": "/dev/xvdb"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:12.612685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-27ca4976-25b9-4a75-8ba2-2abe01877336 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:12.635327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27ca4976-25b9-4a75-8ba2-2abe01877336 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.638396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27ca4976-25b9-4a75-8ba2-2abe01877336 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.639392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27ca4976-25b9-4a75-8ba2-2abe01877336 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.643152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27ca4976-25b9-4a75-8ba2-2abe01877336 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.843309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:12.843974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:12.844539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:12.846955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:12.848315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:12.904031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.904630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.909447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.911034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.964795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:12.979914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for user 9f053f31c02c412394d48ce65350d153 and project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:13.013335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:13.016390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:13.086496 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-27ca4976-25b9-4a75-8ba2-2abe01877336 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "POST /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.517619 Jul 20 04:15:13.108779 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 980/1993] 10.222.0.59 () {62 vars in 1363 bytes} [Wed Jul 20 04:15:12 2022] POST /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:13.127855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6d1610b-bc74-4022-93fc-78b14b83cc9f tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.134396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e6d1610b-bc74-4022-93fc-78b14b83cc9f tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:13.166322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6d1610b-bc74-4022-93fc-78b14b83cc9f tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.168018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6d1610b-bc74-4022-93fc-78b14b83cc9f tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.169326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6d1610b-bc74-4022-93fc-78b14b83cc9f tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.170468 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-052eae4e-7841-49f1-ada4-b67cebca31bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.263771 Jul 20 04:15:13.172292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6d1610b-bc74-4022-93fc-78b14b83cc9f tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.179175 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1014/1994] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:13.199009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62448f62-52f8-41d1-83f1-ac3f9fc5d225 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.202011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-62448f62-52f8-41d1-83f1-ac3f9fc5d225 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:13.216560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62448f62-52f8-41d1-83f1-ac3f9fc5d225 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.218746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62448f62-52f8-41d1-83f1-ac3f9fc5d225 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.219638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62448f62-52f8-41d1-83f1-ac3f9fc5d225 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.220694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62448f62-52f8-41d1-83f1-ac3f9fc5d225 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.507492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-62448f62-52f8-41d1-83f1-ac3f9fc5d225 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:13.523215 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62448f62-52f8-41d1-83f1-ac3f9fc5d225 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1395 microversion: 2.1 time: 0.338427 Jul 20 04:15:13.526507 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1015/1995] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1395 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:13.542709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e614061f-3f61-4603-94b6-79aa8a579844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.543720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e614061f-3f61-4603-94b6-79aa8a579844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:13.618139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e614061f-3f61-4603-94b6-79aa8a579844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:13.628954 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e614061f-3f61-4603-94b6-79aa8a579844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1214 microversion: 2.1 time: 0.093337 Jul 20 04:15:13.629820 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1016/1996] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:13.641535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-58af09db-3c89-492b-b1fe-d85bc1240534 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.642718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-58af09db-3c89-492b-b1fe-d85bc1240534 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:13.652892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6d1610b-bc74-4022-93fc-78b14b83cc9f tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:13.672192 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6d1610b-bc74-4022-93fc-78b14b83cc9f tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1323 microversion: 2.1 time: 0.556505 Jul 20 04:15:13.673106 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 981/1997] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1323 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:13.674104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58af09db-3c89-492b-b1fe-d85bc1240534 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.676426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58af09db-3c89-492b-b1fe-d85bc1240534 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.679630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58af09db-3c89-492b-b1fe-d85bc1240534 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.680443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58af09db-3c89-492b-b1fe-d85bc1240534 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.375255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-58af09db-3c89-492b-b1fe-d85bc1240534 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.384663 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-58af09db-3c89-492b-b1fe-d85bc1240534 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1199 microversion: 2.1 time: 0.753148 Jul 20 04:15:14.385267 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1017/1998] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1199 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:14.546712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e4bf38cf-ac47-46af-b33e-e33fe23e154c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.549453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e4bf38cf-ac47-46af-b33e-e33fe23e154c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:14.558173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4bf38cf-ac47-46af-b33e-e33fe23e154c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.560646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4bf38cf-ac47-46af-b33e-e33fe23e154c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.561766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4bf38cf-ac47-46af-b33e-e33fe23e154c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.562223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4bf38cf-ac47-46af-b33e-e33fe23e154c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.648377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0368a55-28a9-40d2-b8ea-2507987c7148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.649931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0368a55-28a9-40d2-b8ea-2507987c7148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:14.658275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0368a55-28a9-40d2-b8ea-2507987c7148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.660152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0368a55-28a9-40d2-b8ea-2507987c7148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.661183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0368a55-28a9-40d2-b8ea-2507987c7148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.661829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0368a55-28a9-40d2-b8ea-2507987c7148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.758938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a0368a55-28a9-40d2-b8ea-2507987c7148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.769038 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0368a55-28a9-40d2-b8ea-2507987c7148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1266 microversion: 2.1 time: 0.124457 Jul 20 04:15:14.780227 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1018/1999] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:14.785480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fa160378-53b4-4720-b246-80f599afc23a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.786468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fa160378-53b4-4720-b246-80f599afc23a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:14.793561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa160378-53b4-4720-b246-80f599afc23a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.794291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa160378-53b4-4720-b246-80f599afc23a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.795292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa160378-53b4-4720-b246-80f599afc23a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.795914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa160378-53b4-4720-b246-80f599afc23a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.820100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e4bf38cf-ac47-46af-b33e-e33fe23e154c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.832531 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e4bf38cf-ac47-46af-b33e-e33fe23e154c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1575 microversion: 2.1 time: 0.290474 Jul 20 04:15:14.842370 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 982/2000] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1575 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:14.855547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0d1ce3b0-b45d-4434-9d9e-9a5a931bf0e4 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.856228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0d1ce3b0-b45d-4434-9d9e-9a5a931bf0e4 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:14.864693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d1ce3b0-b45d-4434-9d9e-9a5a931bf0e4 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.865147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d1ce3b0-b45d-4434-9d9e-9a5a931bf0e4 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.869902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d1ce3b0-b45d-4434-9d9e-9a5a931bf0e4 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.876790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d1ce3b0-b45d-4434-9d9e-9a5a931bf0e4 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.006659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fa160378-53b4-4720-b246-80f599afc23a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:15.017225 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fa160378-53b4-4720-b246-80f599afc23a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1323 microversion: 2.1 time: 0.235578 Jul 20 04:15:15.018893 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1019/2001] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1323 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:15.402523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da1049f0-7f3d-45ac-9a62-d6f08a9b2309 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:15.403803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-da1049f0-7f3d-45ac-9a62-d6f08a9b2309 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:15.421888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da1049f0-7f3d-45ac-9a62-d6f08a9b2309 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.422695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da1049f0-7f3d-45ac-9a62-d6f08a9b2309 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.424872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da1049f0-7f3d-45ac-9a62-d6f08a9b2309 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.428154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da1049f0-7f3d-45ac-9a62-d6f08a9b2309 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.554791 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0d1ce3b0-b45d-4434-9d9e-9a5a931bf0e4 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.706834 Jul 20 04:15:15.555389 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 983/2002] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168/os-interface => generated 284 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:15.561595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-8ccde12a-b9b9-4860-8909-37e863af2b08 req-c81e9184-f028-4462-af42-c2fc6ecd5c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c415a038-aa6b-4a15-bc65-025e22d1538b", "name": "network-vif-plugged", "status": "completed", "tag": "d482578a-c666-4044-8d65-fc9f23840998"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:15.580637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8ccde12a-b9b9-4860-8909-37e863af2b08 req-c81e9184-f028-4462-af42-c2fc6ecd5c31 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.583252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8ccde12a-b9b9-4860-8909-37e863af2b08 req-c81e9184-f028-4462-af42-c2fc6ecd5c31 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.611500 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8ccde12a-b9b9-4860-8909-37e863af2b08 req-c81e9184-f028-4462-af42-c2fc6ecd5c31 service nova] Creating event network-vif-plugged:d482578a-c666-4044-8d65-fc9f23840998 for instance c415a038-aa6b-4a15-bc65-025e22d1538b on n-h2-760456-11 Jul 20 04:15:15.628065 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-8ccde12a-b9b9-4860-8909-37e863af2b08 req-c81e9184-f028-4462-af42-c2fc6ecd5c31 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071378 Jul 20 04:15:15.629016 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 984/2003] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:15.789911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-85f49720-5252-4a2b-bcd9-9005c7c482d4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:15.790574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-85f49720-5252-4a2b-bcd9-9005c7c482d4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:15.808688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85f49720-5252-4a2b-bcd9-9005c7c482d4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.809146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85f49720-5252-4a2b-bcd9-9005c7c482d4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.812678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85f49720-5252-4a2b-bcd9-9005c7c482d4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.814599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85f49720-5252-4a2b-bcd9-9005c7c482d4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.977886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-da1049f0-7f3d-45ac-9a62-d6f08a9b2309 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:15.987392 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-da1049f0-7f3d-45ac-9a62-d6f08a9b2309 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1199 microversion: 2.1 time: 0.590113 Jul 20 04:15:15.991492 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1020/2004] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:15 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1199 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:16.035787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-89767106-826f-4b1e-a06e-fbf6e5fa6629 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.036729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-89767106-826f-4b1e-a06e-fbf6e5fa6629 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:16.048578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89767106-826f-4b1e-a06e-fbf6e5fa6629 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.055198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89767106-826f-4b1e-a06e-fbf6e5fa6629 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.056393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89767106-826f-4b1e-a06e-fbf6e5fa6629 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.057046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89767106-826f-4b1e-a06e-fbf6e5fa6629 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.467689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-89767106-826f-4b1e-a06e-fbf6e5fa6629 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:16.468476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-85f49720-5252-4a2b-bcd9-9005c7c482d4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:16.477276 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-85f49720-5252-4a2b-bcd9-9005c7c482d4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1272 microversion: 2.1 time: 0.693373 Jul 20 04:15:16.478517 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-89767106-826f-4b1e-a06e-fbf6e5fa6629 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1323 microversion: 2.1 time: 0.446735 Jul 20 04:15:16.480064 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 985/2005] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:15 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1272 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:16.482369 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1021/2006] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1323 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:17.009747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9924775b-262f-430d-a308-10af9d559e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.010413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9924775b-262f-430d-a308-10af9d559e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.023776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9924775b-262f-430d-a308-10af9d559e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.025913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9924775b-262f-430d-a308-10af9d559e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.027433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9924775b-262f-430d-a308-10af9d559e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.027878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9924775b-262f-430d-a308-10af9d559e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.181654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a36f763-e9af-4e4d-a5ea-47fdc16b5b61 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.183919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6a36f763-e9af-4e4d-a5ea-47fdc16b5b61 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.202707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a36f763-e9af-4e4d-a5ea-47fdc16b5b61 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.204389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a36f763-e9af-4e4d-a5ea-47fdc16b5b61 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.205983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a36f763-e9af-4e4d-a5ea-47fdc16b5b61 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.208254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a36f763-e9af-4e4d-a5ea-47fdc16b5b61 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.385119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6a36f763-e9af-4e4d-a5ea-47fdc16b5b61 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:17.396769 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6a36f763-e9af-4e4d-a5ea-47fdc16b5b61 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1575 microversion: 2.1 time: 0.219818 Jul 20 04:15:17.398289 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1022/2007] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:17.403752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5eff9d1d-8d93-4a9b-9251-e127811126fe req-d6e009d6-8e8e-42b2-b307-ecbfe399148a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93a774b-f6ab-4eb7-a406-57d1ef3f6168", "tag": "f1355d83-3e28-49e8-a05a-c36da373924a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:17.415758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5eff9d1d-8d93-4a9b-9251-e127811126fe req-d6e009d6-8e8e-42b2-b307-ecbfe399148a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.416331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5eff9d1d-8d93-4a9b-9251-e127811126fe req-d6e009d6-8e8e-42b2-b307-ecbfe399148a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.433321 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5eff9d1d-8d93-4a9b-9251-e127811126fe req-d6e009d6-8e8e-42b2-b307-ecbfe399148a service nova] Creating event network-changed:f1355d83-3e28-49e8-a05a-c36da373924a for instance d93a774b-f6ab-4eb7-a406-57d1ef3f6168 on n-h1-760456-11 Jul 20 04:15:17.440276 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5eff9d1d-8d93-4a9b-9251-e127811126fe req-d6e009d6-8e8e-42b2-b307-ecbfe399148a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039958 Jul 20 04:15:17.444569 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1023/2008] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:17.498708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2f482f18-1355-4909-aa8d-73b854d20524 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.500266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f482f18-1355-4909-aa8d-73b854d20524 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.518955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f482f18-1355-4909-aa8d-73b854d20524 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.520222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f482f18-1355-4909-aa8d-73b854d20524 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.523627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f482f18-1355-4909-aa8d-73b854d20524 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.525400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f482f18-1355-4909-aa8d-73b854d20524 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.779817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2f482f18-1355-4909-aa8d-73b854d20524 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:17.793570 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2f482f18-1355-4909-aa8d-73b854d20524 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1272 microversion: 2.1 time: 0.295270 Jul 20 04:15:17.810047 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1024/2009] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1272 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:17.828104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-36c944b8-e414-4804-8ba0-e90db4933447 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.828740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-36c944b8-e414-4804-8ba0-e90db4933447 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.845584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36c944b8-e414-4804-8ba0-e90db4933447 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.846057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36c944b8-e414-4804-8ba0-e90db4933447 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.850683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36c944b8-e414-4804-8ba0-e90db4933447 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.851157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36c944b8-e414-4804-8ba0-e90db4933447 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.875828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9924775b-262f-430d-a308-10af9d559e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:17.883873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9924775b-262f-430d-a308-10af9d559e7e tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1199 microversion: 2.1 time: 0.879463 Jul 20 04:15:17.887959 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 986/2010] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1199 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:18.434097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-36c944b8-e414-4804-8ba0-e90db4933447 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:18.457732 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-36c944b8-e414-4804-8ba0-e90db4933447 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1472 microversion: 2.1 time: 0.636371 Jul 20 04:15:18.465041 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1025/2011] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1472 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:18.481765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-391d1654-065e-4e43-82da-04bdefffd10d tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.482490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-391d1654-065e-4e43-82da-04bdefffd10d tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.496124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-391d1654-065e-4e43-82da-04bdefffd10d tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.498343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-391d1654-065e-4e43-82da-04bdefffd10d tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.499707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-391d1654-065e-4e43-82da-04bdefffd10d tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.502144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-391d1654-065e-4e43-82da-04bdefffd10d tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.565069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-391d1654-065e-4e43-82da-04bdefffd10d tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-391d1654-065e-4e43-82da-04bdefffd10d tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Request method failure captured: Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b/diagnostics HTTP/1.1 Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14E9eaIpzV5R90wqhq7h56sYm9Y6_KuICJLu4mIpl_Ni6ONvXBx8qb2dRL-d138EYD2yDLx2grRzL3MFMsplZCCwGnFaNFglnpLF5I7fE5Q20LCVvlDLK50locC6MApnW7fBE6aModsrGbcdXE-6_53w0fVJru7ZD3cjl3WQfOEkwCg Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 9b5aa17d4e3344c9b1a474ed1e0e3f64 Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-243015457 Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9b5aa17d4e3344c9b1a474ed1e0e3f64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9b5aa17d4e3344c9b1a474ed1e0e3f64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9b5aa17d4e3344c9b1a474ed1e0e3f64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9b5aa17d4e3344c9b1a474ed1e0e3f64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-243015457 Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 9b5aa17d4e3344c9b1a474ed1e0e3f64 Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-243015457 Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerDiagnosticsNegativeTest-243015457-project Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4753f6cc24204b008e6753c4ee8e12d1 Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-243015457-project Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'server_id': 'c415a038-aa6b-4a15-bc65-025e22d1538b'} Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:18.573070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:18.579555 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:18.579555 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:18.579555 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:18.579555 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:18.579555 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:15:18.579555 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:18.579555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-391d1654-065e-4e43-82da-04bdefffd10d tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:18.579555 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-391d1654-065e-4e43-82da-04bdefffd10d tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.100026 Jul 20 04:15:18.584928 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 987/2012] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:15:18 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b/diagnostics => generated 117 bytes in 104 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:18.589967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f9a35206-b0b5-47ad-9606-79d30fb2e60a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.590550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f9a35206-b0b5-47ad-9606-79d30fb2e60a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.610925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a35206-b0b5-47ad-9606-79d30fb2e60a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.611356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a35206-b0b5-47ad-9606-79d30fb2e60a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.612157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a35206-b0b5-47ad-9606-79d30fb2e60a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.612628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a35206-b0b5-47ad-9606-79d30fb2e60a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.701016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f9a35206-b0b5-47ad-9606-79d30fb2e60a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:18.827486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-325cc951-f1bb-4b45-81dd-c91d5e0477ba tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.828750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-325cc951-f1bb-4b45-81dd-c91d5e0477ba tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.840415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-325cc951-f1bb-4b45-81dd-c91d5e0477ba tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.841265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-325cc951-f1bb-4b45-81dd-c91d5e0477ba tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.842729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-325cc951-f1bb-4b45-81dd-c91d5e0477ba tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.844436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-325cc951-f1bb-4b45-81dd-c91d5e0477ba tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.933051 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f9a35206-b0b5-47ad-9606-79d30fb2e60a tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 204 len: 0 microversion: 2.1 time: 0.343864 Jul 20 04:15:18.937251 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1026/2013] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:18 2022] DELETE /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:18.959875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baa0f4c0-b6b4-4d2e-93e9-b3e957d716f3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.962773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-baa0f4c0-b6b4-4d2e-93e9-b3e957d716f3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.984266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa0f4c0-b6b4-4d2e-93e9-b3e957d716f3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.984749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa0f4c0-b6b4-4d2e-93e9-b3e957d716f3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.985573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa0f4c0-b6b4-4d2e-93e9-b3e957d716f3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.986025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa0f4c0-b6b4-4d2e-93e9-b3e957d716f3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:19.935991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-325cc951-f1bb-4b45-81dd-c91d5e0477ba tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:19.950241 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-325cc951-f1bb-4b45-81dd-c91d5e0477ba tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1314 microversion: 2.1 time: 1.127112 Jul 20 04:15:19.960963 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 988/2014] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:18 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1314 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:19.975976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4c0c5fac-bd68-4b02-8848-ed73963e81c5 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:19.976984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4c0c5fac-bd68-4b02-8848-ed73963e81c5 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:19.995278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c0c5fac-bd68-4b02-8848-ed73963e81c5 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:19.996002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c0c5fac-bd68-4b02-8848-ed73963e81c5 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.000271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c0c5fac-bd68-4b02-8848-ed73963e81c5 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.000742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c0c5fac-bd68-4b02-8848-ed73963e81c5 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.001353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-baa0f4c0-b6b4-4d2e-93e9-b3e957d716f3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.043817 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-baa0f4c0-b6b4-4d2e-93e9-b3e957d716f3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1199 microversion: 2.1 time: 1.100226 Jul 20 04:15:20.045512 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1027/2015] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:18 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1199 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:20.056704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb82a848-0dac-45f7-a3da-63d60672b3ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:20.061318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb82a848-0dac-45f7-a3da-63d60672b3ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:20.068595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb82a848-0dac-45f7-a3da-63d60672b3ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.070077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb82a848-0dac-45f7-a3da-63d60672b3ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.071704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb82a848-0dac-45f7-a3da-63d60672b3ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.072748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb82a848-0dac-45f7-a3da-63d60672b3ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.360216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb82a848-0dac-45f7-a3da-63d60672b3ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.380392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb82a848-0dac-45f7-a3da-63d60672b3ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.384442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb82a848-0dac-45f7-a3da-63d60672b3ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.386839 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb82a848-0dac-45f7-a3da-63d60672b3ed tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 2956 microversion: 2.42 time: 0.337769 Jul 20 04:15:20.389636 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1028/2016] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:20 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 2956 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:20.410046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f2dd14f-e15b-40b3-85af-9ee03bf5cb3c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:20.410583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9f2dd14f-e15b-40b3-85af-9ee03bf5cb3c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:20.420827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f2dd14f-e15b-40b3-85af-9ee03bf5cb3c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.424757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f2dd14f-e15b-40b3-85af-9ee03bf5cb3c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.427926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f2dd14f-e15b-40b3-85af-9ee03bf5cb3c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.431699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f2dd14f-e15b-40b3-85af-9ee03bf5cb3c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.616067 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f2dd14f-e15b-40b3-85af-9ee03bf5cb3c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.210158 Jul 20 04:15:20.618492 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1029/2017] 10.222.0.59 () {60 vars in 1315 bytes} [Wed Jul 20 04:15:20 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b/os-interface => generated 1833 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:20.875480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6875cc3b-235a-40da-8be5-e5dbd0cdea0b req-b4491c90-028b-4242-b595-6e62a8fade19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2ae540-9679-4d32-a12c-4ac56e81f928", "name": "network-vif-plugged", "status": "completed", "tag": "7dadbe99-6cc6-433e-ada6-72d466f63f3c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:20.886073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6875cc3b-235a-40da-8be5-e5dbd0cdea0b req-b4491c90-028b-4242-b595-6e62a8fade19 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.887023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6875cc3b-235a-40da-8be5-e5dbd0cdea0b req-b4491c90-028b-4242-b595-6e62a8fade19 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.905879 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6875cc3b-235a-40da-8be5-e5dbd0cdea0b req-b4491c90-028b-4242-b595-6e62a8fade19 service nova] Creating event network-vif-plugged:7dadbe99-6cc6-433e-ada6-72d466f63f3c for instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 on n-h1-760456-11 Jul 20 04:15:20.913249 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6875cc3b-235a-40da-8be5-e5dbd0cdea0b req-b4491c90-028b-4242-b595-6e62a8fade19 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043138 Jul 20 04:15:20.914283 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1030/2018] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:20.969777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e5eadf79-c4c3-41e0-b83a-8b275facb701 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:20.970972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e5eadf79-c4c3-41e0-b83a-8b275facb701 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:20.993566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5eadf79-c4c3-41e0-b83a-8b275facb701 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.996942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5eadf79-c4c3-41e0-b83a-8b275facb701 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.001868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5eadf79-c4c3-41e0-b83a-8b275facb701 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.002593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5eadf79-c4c3-41e0-b83a-8b275facb701 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.314573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e5eadf79-c4c3-41e0-b83a-8b275facb701 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:21.318405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:21.330229 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e5eadf79-c4c3-41e0-b83a-8b275facb701 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1314 microversion: 2.1 time: 0.366504 Jul 20 04:15:21.332219 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1031/2019] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:20 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:21.337393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b1b201aa-3bd1-4b39-ba1c-caa671ade8c3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:21.338004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b1b201aa-3bd1-4b39-ba1c-caa671ade8c3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:21.346768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1b201aa-3bd1-4b39-ba1c-caa671ade8c3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.347645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1b201aa-3bd1-4b39-ba1c-caa671ade8c3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.348650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1b201aa-3bd1-4b39-ba1c-caa671ade8c3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.349340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1b201aa-3bd1-4b39-ba1c-caa671ade8c3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.511803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b1b201aa-3bd1-4b39-ba1c-caa671ade8c3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:21.521045 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b1b201aa-3bd1-4b39-ba1c-caa671ade8c3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1199 microversion: 2.1 time: 0.187439 Jul 20 04:15:21.522588 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1032/2020] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:21 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1199 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:21.676599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4c0c5fac-bd68-4b02-8848-ed73963e81c5 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:21.697142 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4c0c5fac-bd68-4b02-8848-ed73963e81c5 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1478 microversion: 2.1 time: 1.734852 Jul 20 04:15:21.698497 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 989/2021] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:19 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1478 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:22.351487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d5afddee-fadc-4c06-8544-f64344e66e7e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.353071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d5afddee-fadc-4c06-8544-f64344e66e7e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:22.368451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5afddee-fadc-4c06-8544-f64344e66e7e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.369194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5afddee-fadc-4c06-8544-f64344e66e7e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.370751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5afddee-fadc-4c06-8544-f64344e66e7e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.371510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5afddee-fadc-4c06-8544-f64344e66e7e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.479728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f8f94bec-cabb-4991-aabb-db773c44154f req-6baec23f-9cdf-40cf-b288-c111cc40fc69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c415a038-aa6b-4a15-bc65-025e22d1538b", "name": "network-vif-deleted", "tag": "d482578a-c666-4044-8d65-fc9f23840998"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:22.501535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f8f94bec-cabb-4991-aabb-db773c44154f req-6baec23f-9cdf-40cf-b288-c111cc40fc69 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.508911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f8f94bec-cabb-4991-aabb-db773c44154f req-6baec23f-9cdf-40cf-b288-c111cc40fc69 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.544136 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f8f94bec-cabb-4991-aabb-db773c44154f req-6baec23f-9cdf-40cf-b288-c111cc40fc69 service nova] Creating event network-vif-deleted:d482578a-c666-4044-8d65-fc9f23840998 for instance c415a038-aa6b-4a15-bc65-025e22d1538b on n-h2-760456-11 Jul 20 04:15:22.559233 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f8f94bec-cabb-4991-aabb-db773c44154f req-6baec23f-9cdf-40cf-b288-c111cc40fc69 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078543 Jul 20 04:15:22.560234 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 990/2022] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:22.566787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d5afddee-fadc-4c06-8544-f64344e66e7e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:22.569905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5607f95f-26ee-4633-8f14-2d8744b55420 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.570710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5607f95f-26ee-4633-8f14-2d8744b55420 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:22.577879 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d5afddee-fadc-4c06-8544-f64344e66e7e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1314 microversion: 2.1 time: 0.231829 Jul 20 04:15:22.579022 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1033/2023] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:22.583250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5607f95f-26ee-4633-8f14-2d8744b55420 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.583857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5607f95f-26ee-4633-8f14-2d8744b55420 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.584660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5607f95f-26ee-4633-8f14-2d8744b55420 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.585156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5607f95f-26ee-4633-8f14-2d8744b55420 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.718344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.726106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:22.744239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.744695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.745552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.745996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.782114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.782650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.783240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lazy-loading 'fault' on Instance uuid c415a038-aa6b-4a15-bc65-025e22d1538b {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:22.841054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4753f6cc24204b008e6753c4ee8e12d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5aa17d4e3344c9b1a474ed1e0e3f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:22.849172 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-069596d5-a7d2-4d40-b96e-e2e4a75931fb tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 200 len: 1313 microversion: 2.1 time: 0.137268 Jul 20 04:15:22.850553 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1034/2024] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:23.293479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5607f95f-26ee-4633-8f14-2d8744b55420 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:23.307019 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5607f95f-26ee-4633-8f14-2d8744b55420 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1199 microversion: 2.1 time: 0.742167 Jul 20 04:15:23.308066 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 991/2025] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1199 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:23.315069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:23.520052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1990498064", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:23.587789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] validate_networks() for [('7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:23.597569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ee8eaa86-4d03-475d-ac38-b6be016e911b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:23.598561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ee8eaa86-4d03-475d-ac38-b6be016e911b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:23.614950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee8eaa86-4d03-475d-ac38-b6be016e911b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.616323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee8eaa86-4d03-475d-ac38-b6be016e911b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.617431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee8eaa86-4d03-475d-ac38-b6be016e911b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.618064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee8eaa86-4d03-475d-ac38-b6be016e911b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.626917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:23.990340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ee8eaa86-4d03-475d-ac38-b6be016e911b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:24.008022 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ee8eaa86-4d03-475d-ac38-b6be016e911b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1314 microversion: 2.1 time: 0.416227 Jul 20 04:15:24.023226 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 992/2026] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:23 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:24.032412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f14ea0d-6ffa-44a8-a90b-50bc78bd5048 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.033937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f14ea0d-6ffa-44a8-a90b-50bc78bd5048 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] [instance: c415a038-aa6b-4a15-bc65-025e22d1538b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:24.044254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f14ea0d-6ffa-44a8-a90b-50bc78bd5048 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.045305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f14ea0d-6ffa-44a8-a90b-50bc78bd5048 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.046599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f14ea0d-6ffa-44a8-a90b-50bc78bd5048 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.048162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f14ea0d-6ffa-44a8-a90b-50bc78bd5048 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.082009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:24.100488 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-3f14ea0d-6ffa-44a8-a90b-50bc78bd5048 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] HTTP exception thrown: Instance c415a038-aa6b-4a15-bc65-025e22d1538b could not be found. Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f14ea0d-6ffa-44a8-a90b-50bc78bd5048 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Request method failure captured: Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b HTTP/1.1 Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14E9eaIpzV5R90wqhq7h56sYm9Y6_KuICJLu4mIpl_Ni6ONvXBx8qb2dRL-d138EYD2yDLx2grRzL3MFMsplZCCwGnFaNFglnpLF5I7fE5Q20LCVvlDLK50locC6MApnW7fBE6aModsrGbcdXE-6_53w0fVJru7ZD3cjl3WQfOEkwCg Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 9b5aa17d4e3344c9b1a474ed1e0e3f64 Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-243015457 Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9b5aa17d4e3344c9b1a474ed1e0e3f64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9b5aa17d4e3344c9b1a474ed1e0e3f64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9b5aa17d4e3344c9b1a474ed1e0e3f64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9b5aa17d4e3344c9b1a474ed1e0e3f64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-243015457 Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 9b5aa17d4e3344c9b1a474ed1e0e3f64 Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-243015457 Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerDiagnosticsNegativeTest-243015457-project Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4753f6cc24204b008e6753c4ee8e12d1 Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-243015457-project Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c415a038-aa6b-4a15-bc65-025e22d1538b could not be found. Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c415a038-aa6b-4a15-bc65-025e22d1538b'} Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c415a038-aa6b-4a15-bc65-025e22d1538b could not be found. Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c415a038-aa6b-4a15-bc65-025e22d1538b could not be found. Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.105173 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:24.111085 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.111085 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.111085 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:24.111085 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:24.111085 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:24.111085 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:24.111085 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c415a038-aa6b-4a15-bc65-025e22d1538b could not be found. Jul 20 04:15:24.111085 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.122034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f14ea0d-6ffa-44a8-a90b-50bc78bd5048 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] Returning 404 to user: Instance c415a038-aa6b-4a15-bc65-025e22d1538b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:24.125964 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f14ea0d-6ffa-44a8-a90b-50bc78bd5048 tempest-ServerDiagnosticsNegativeTest-243015457 tempest-ServerDiagnosticsNegativeTest-243015457-project] 10.222.0.59 "GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b" status: 404 len: 111 microversion: 2.1 time: 0.100462 Jul 20 04:15:24.126870 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 993/2027] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:24 2022] GET /compute/v2.1/servers/c415a038-aa6b-4a15-bc65-025e22d1538b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:24.328800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-24fa5b03-2def-4592-941b-ba715c3ed5d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.329550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:24.329550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:24.329992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-24fa5b03-2def-4592-941b-ba715c3ed5d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:24.330263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:24.330263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:24.330689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:24.350560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24fa5b03-2def-4592-941b-ba715c3ed5d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.355694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24fa5b03-2def-4592-941b-ba715c3ed5d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.356380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.356844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24fa5b03-2def-4592-941b-ba715c3ed5d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.356985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.357478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24fa5b03-2def-4592-941b-ba715c3ed5d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.357932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.359367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.422458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Getting quotas for project a3133719938a40ebb9ed9a17f54f12aa. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:24.443862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Getting quotas for user b3c23bc77ca34820a90e49492fd014f2 and project a3133719938a40ebb9ed9a17f54f12aa. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:24.496928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:24.505899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:24.623324 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-85165fc7-c176-475c-a726-1d14f1ec0c18 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.313559 Jul 20 04:15:24.624704 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1035/2028] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:24.637671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c44bdcd0-7662-41e4-92b8-742a245a97e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.638898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c44bdcd0-7662-41e4-92b8-742a245a97e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:24.732871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c44bdcd0-7662-41e4-92b8-742a245a97e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:24.773059 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c44bdcd0-7662-41e4-92b8-742a245a97e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1224 microversion: 2.1 time: 0.140319 Jul 20 04:15:24.783739 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1036/2029] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:24 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:24.787573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-97972b57-811e-418b-b620-353579a9086d req-b86a380c-90e3-4c3b-8413-13461a2e5a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ca8a00-3d0f-485c-a7ce-9028d31e7035", "tag": "d2215e8e-977d-4a09-aac2-debfdafc6d86"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.814063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-97972b57-811e-418b-b620-353579a9086d req-b86a380c-90e3-4c3b-8413-13461a2e5a51 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.815499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-97972b57-811e-418b-b620-353579a9086d req-b86a380c-90e3-4c3b-8413-13461a2e5a51 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.841043 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-97972b57-811e-418b-b620-353579a9086d req-b86a380c-90e3-4c3b-8413-13461a2e5a51 service nova] Creating event network-changed:d2215e8e-977d-4a09-aac2-debfdafc6d86 for instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 on n-h2-760456-11 Jul 20 04:15:24.864830 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-97972b57-811e-418b-b620-353579a9086d req-b86a380c-90e3-4c3b-8413-13461a2e5a51 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072025 Jul 20 04:15:24.867566 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1037/2030] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:25.032541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d2b28a9-d877-4c82-9531-ffa929f400d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.037981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d2b28a9-d877-4c82-9531-ffa929f400d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:25.059316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d2b28a9-d877-4c82-9531-ffa929f400d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.064312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d2b28a9-d877-4c82-9531-ffa929f400d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.065352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d2b28a9-d877-4c82-9531-ffa929f400d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.066216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d2b28a9-d877-4c82-9531-ffa929f400d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.351993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d2b28a9-d877-4c82-9531-ffa929f400d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:25.371687 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d2b28a9-d877-4c82-9531-ffa929f400d9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1314 microversion: 2.1 time: 0.344841 Jul 20 04:15:25.375834 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1038/2031] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:25.572049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24fa5b03-2def-4592-941b-ba715c3ed5d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:25.594090 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-24fa5b03-2def-4592-941b-ba715c3ed5d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1382 microversion: 2.1 time: 1.272474 Jul 20 04:15:25.597495 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 994/2032] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:24 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1382 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:25.791473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b5f27187-fbcb-41d8-b393-4f0d634efdeb tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.793086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b5f27187-fbcb-41d8-b393-4f0d634efdeb tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:25.827355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5f27187-fbcb-41d8-b393-4f0d634efdeb tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.827820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5f27187-fbcb-41d8-b393-4f0d634efdeb tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.828613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5f27187-fbcb-41d8-b393-4f0d634efdeb tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.829592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5f27187-fbcb-41d8-b393-4f0d634efdeb tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.039093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ad542fb1-2c3c-4012-8816-be19c3db838c tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.039731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ad542fb1-2c3c-4012-8816-be19c3db838c tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:26.057794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad542fb1-2c3c-4012-8816-be19c3db838c tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.060037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad542fb1-2c3c-4012-8816-be19c3db838c tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.061936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad542fb1-2c3c-4012-8816-be19c3db838c tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.064311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad542fb1-2c3c-4012-8816-be19c3db838c tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.126499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b5f27187-fbcb-41d8-b393-4f0d634efdeb tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:26.137933 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b5f27187-fbcb-41d8-b393-4f0d634efdeb tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1220 microversion: 2.1 time: 0.350536 Jul 20 04:15:26.138576 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 995/2033] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1220 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:26.393532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f2d7576f-8d4b-47dd-9829-ef8a1d5e2618 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.394547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f2d7576f-8d4b-47dd-9829-ef8a1d5e2618 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:26.404352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2d7576f-8d4b-47dd-9829-ef8a1d5e2618 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.405872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2d7576f-8d4b-47dd-9829-ef8a1d5e2618 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.406920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2d7576f-8d4b-47dd-9829-ef8a1d5e2618 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.407551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2d7576f-8d4b-47dd-9829-ef8a1d5e2618 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.499375 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ad542fb1-2c3c-4012-8816-be19c3db838c tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1535 microversion: 2.1 time: 0.890038 Jul 20 04:15:26.503275 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1039/2034] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1535 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:26.519483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-38dcb100-84c1-4dfa-99f2-adb3bc616a59 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.520377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-38dcb100-84c1-4dfa-99f2-adb3bc616a59 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:26.531371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-38dcb100-84c1-4dfa-99f2-adb3bc616a59 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.533113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-38dcb100-84c1-4dfa-99f2-adb3bc616a59 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.542289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-38dcb100-84c1-4dfa-99f2-adb3bc616a59 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.546572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-38dcb100-84c1-4dfa-99f2-adb3bc616a59 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.859221 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-38dcb100-84c1-4dfa-99f2-adb3bc616a59 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1535 microversion: 2.1 time: 0.343832 Jul 20 04:15:26.859811 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1040/2035] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:26 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1535 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:26.879166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4d04d4e1-e6cb-4754-a5e2-c7626ae1e8c0 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.881482 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:26.881482 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:15:26.882956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d04d4e1-e6cb-4754-a5e2-c7626ae1e8c0 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.883478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d04d4e1-e6cb-4754-a5e2-c7626ae1e8c0 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.884620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d04d4e1-e6cb-4754-a5e2-c7626ae1e8c0 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.887899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d04d4e1-e6cb-4754-a5e2-c7626ae1e8c0 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.964014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:26.983335 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4d04d4e1-e6cb-4754-a5e2-c7626ae1e8c0 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.106574 Jul 20 04:15:26.984311 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1041/2036] 10.222.0.59 () {58 vars in 1175 bytes} [Wed Jul 20 04:15:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:27.002522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dfd46ad4-65cd-455a-b019-37de8cc3c6bd tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-760456-11", "block_migration": false, "disk_over_commit": false}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:27.004041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dfd46ad4-65cd-455a-b019-37de8cc3c6bd tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:27.013101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfd46ad4-65cd-455a-b019-37de8cc3c6bd tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.014069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfd46ad4-65cd-455a-b019-37de8cc3c6bd tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.015106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfd46ad4-65cd-455a-b019-37de8cc3c6bd tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.015723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfd46ad4-65cd-455a-b019-37de8cc3c6bd tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.040544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f2d7576f-8d4b-47dd-9829-ef8a1d5e2618 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:27.055054 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f2d7576f-8d4b-47dd-9829-ef8a1d5e2618 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1314 microversion: 2.1 time: 0.666131 Jul 20 04:15:27.057264 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 996/2037] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:26 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:27.083116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-dfd46ad4-65cd-455a-b019-37de8cc3c6bd tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lazy-loading 'flavor' on Instance uuid 1c2ae540-9679-4d32-a12c-4ac56e81f928 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:27.099137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dfd46ad4-65cd-455a-b019-37de8cc3c6bd tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Going to try to live migrate instance to n-h2-760456-11 {{(pid=119606) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:15:27.162200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-559751be-a9ed-4c58-9516-23d29b90379f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.163044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-559751be-a9ed-4c58-9516-23d29b90379f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:27.186605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-559751be-a9ed-4c58-9516-23d29b90379f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.187840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-559751be-a9ed-4c58-9516-23d29b90379f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.191711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-559751be-a9ed-4c58-9516-23d29b90379f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.193352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-559751be-a9ed-4c58-9516-23d29b90379f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.363229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-559751be-a9ed-4c58-9516-23d29b90379f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:27.375382 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-559751be-a9ed-4c58-9516-23d29b90379f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1282 microversion: 2.1 time: 0.217484 Jul 20 04:15:27.378999 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 997/2038] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:27 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:28.073666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fe9a47e6-243c-4588-b466-ebd1922975c4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.074658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fe9a47e6-243c-4588-b466-ebd1922975c4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:28.089109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe9a47e6-243c-4588-b466-ebd1922975c4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.089582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe9a47e6-243c-4588-b466-ebd1922975c4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.090426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe9a47e6-243c-4588-b466-ebd1922975c4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.090878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe9a47e6-243c-4588-b466-ebd1922975c4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.418671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fe9a47e6-243c-4588-b466-ebd1922975c4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:28.426733 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fe9a47e6-243c-4588-b466-ebd1922975c4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1314 microversion: 2.1 time: 0.358114 Jul 20 04:15:28.432985 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 998/2039] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:28.442036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2201461e-38e3-49b0-9a4e-46db5fe12095 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.442698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2201461e-38e3-49b0-9a4e-46db5fe12095 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:28.449711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2201461e-38e3-49b0-9a4e-46db5fe12095 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.452688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2201461e-38e3-49b0-9a4e-46db5fe12095 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.455444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2201461e-38e3-49b0-9a4e-46db5fe12095 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.456313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2201461e-38e3-49b0-9a4e-46db5fe12095 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.912383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-2201461e-38e3-49b0-9a4e-46db5fe12095 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid 358c5f50-cf9e-4577-a295-0aa87e318810 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:28.928648 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2201461e-38e3-49b0-9a4e-46db5fe12095 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 2424 microversion: 2.25 time: 0.494033 Jul 20 04:15:28.929838 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 999/2040] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 2424 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:28.935056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f815b8a-af59-4dfc-b7a5-c26082871b65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.936157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f815b8a-af59-4dfc-b7a5-c26082871b65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:28.943265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:28.945790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f815b8a-af59-4dfc-b7a5-c26082871b65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.946735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f815b8a-af59-4dfc-b7a5-c26082871b65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.948129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f815b8a-af59-4dfc-b7a5-c26082871b65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.948838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f815b8a-af59-4dfc-b7a5-c26082871b65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.474068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5f815b8a-af59-4dfc-b7a5-c26082871b65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:29.485341 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f815b8a-af59-4dfc-b7a5-c26082871b65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1324 microversion: 2.1 time: 0.554189 Jul 20 04:15:29.499151 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1000/2041] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1324 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:29.503960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a9448891-3a9c-4e29-83c0-9d0b0ede5418 req-0e9c698f-253a-416d-907f-02092780883d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ca8a00-3d0f-485c-a7ce-9028d31e7035", "name": "network-vif-plugged", "status": "completed", "tag": "d2215e8e-977d-4a09-aac2-debfdafc6d86"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:29.522582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a9448891-3a9c-4e29-83c0-9d0b0ede5418 req-0e9c698f-253a-416d-907f-02092780883d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.523173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a9448891-3a9c-4e29-83c0-9d0b0ede5418 req-0e9c698f-253a-416d-907f-02092780883d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.543260 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a9448891-3a9c-4e29-83c0-9d0b0ede5418 req-0e9c698f-253a-416d-907f-02092780883d service nova] Creating event network-vif-plugged:d2215e8e-977d-4a09-aac2-debfdafc6d86 for instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 on n-h2-760456-11 Jul 20 04:15:29.549744 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a9448891-3a9c-4e29-83c0-9d0b0ede5418 req-0e9c698f-253a-416d-907f-02092780883d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053111 Jul 20 04:15:29.551520 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1001/2042] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:29.564560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c3c1c79-dbf8-4131-8327-64c6aed4d51c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-760456-11", "block_migration": "auto"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:29.565984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c3c1c79-dbf8-4131-8327-64c6aed4d51c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:29.582107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c3c1c79-dbf8-4131-8327-64c6aed4d51c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.582963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c3c1c79-dbf8-4131-8327-64c6aed4d51c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.583970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c3c1c79-dbf8-4131-8327-64c6aed4d51c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.586419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c3c1c79-dbf8-4131-8327-64c6aed4d51c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.636446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-6c3c1c79-dbf8-4131-8327-64c6aed4d51c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'flavor' on Instance uuid 358c5f50-cf9e-4577-a295-0aa87e318810 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:29.656169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c3c1c79-dbf8-4131-8327-64c6aed4d51c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Going to try to live migrate instance to n-h1-760456-11 {{(pid=119605) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:15:30.097633 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dfd46ad4-65cd-455a-b019-37de8cc3c6bd tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928/action" status: 202 len: 0 microversion: 2.1 time: 3.101350 Jul 20 04:15:30.098947 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1042/2043] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:15:26 2022] POST /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928/action => generated 0 bytes in 3103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:30.105756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b4dfb9aa-6de7-4de8-a491-2f68ce4b5b25 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:30.107968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b4dfb9aa-6de7-4de8-a491-2f68ce4b5b25 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:30.125689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4dfb9aa-6de7-4de8-a491-2f68ce4b5b25 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.131806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4dfb9aa-6de7-4de8-a491-2f68ce4b5b25 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.135283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4dfb9aa-6de7-4de8-a491-2f68ce4b5b25 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.137056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4dfb9aa-6de7-4de8-a491-2f68ce4b5b25 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.682928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b4dfb9aa-6de7-4de8-a491-2f68ce4b5b25 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:30.703141 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b4dfb9aa-6de7-4de8-a491-2f68ce4b5b25 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1314 microversion: 2.1 time: 0.602783 Jul 20 04:15:30.703791 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1043/2044] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:30 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:31.011976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4a7e793-83b4-46bd-bfcf-cc223d256745 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Action: 'create', calling method: .version_select at 0x7fb841bfcb80>, body: {"keypair": {"name": "tempest-keypair-1573247158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE/MPVROAGQloVu/ziiG2OhWViVyI8/M872mBwO/MK3qfyahl68g2mGviy2enObmsom7yZi20VRUhMStcP+teSERt7DhvSGRFC++1g3oRkLTOQMc5UYC39Z449KlIO9UA=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:31.059674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-a4a7e793-83b4-46bd-bfcf-cc223d256745 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Getting quotas for project d536e3aeba614601973cd64fbe3ee196. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:31.078625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-a4a7e793-83b4-46bd-bfcf-cc223d256745 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Getting quotas for user 4374208f84014632b8a3451b6997b8e9 and project d536e3aeba614601973cd64fbe3ee196. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:31.136009 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a4a7e793-83b4-46bd-bfcf-cc223d256745 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.430977 Jul 20 04:15:31.142434 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1044/2045] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:15:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:31.148169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1b93a266-18d8-4c3e-9947-fe5345edf020 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:31.148962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1b93a266-18d8-4c3e-9947-fe5345edf020 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:31.157733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b93a266-18d8-4c3e-9947-fe5345edf020 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.158379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b93a266-18d8-4c3e-9947-fe5345edf020 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.159315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b93a266-18d8-4c3e-9947-fe5345edf020 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.159928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b93a266-18d8-4c3e-9947-fe5345edf020 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.794826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1b93a266-18d8-4c3e-9947-fe5345edf020 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:31.818682 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1b93a266-18d8-4c3e-9947-fe5345edf020 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.665973 Jul 20 04:15:31.819339 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1045/2046] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:31 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:31.852545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bb175c32-02c3-4f38-88f9-5d8cfadd6d8b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:31.853373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bb175c32-02c3-4f38-88f9-5d8cfadd6d8b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:31.873024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb175c32-02c3-4f38-88f9-5d8cfadd6d8b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.873614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb175c32-02c3-4f38-88f9-5d8cfadd6d8b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.875840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb175c32-02c3-4f38-88f9-5d8cfadd6d8b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.878040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb175c32-02c3-4f38-88f9-5d8cfadd6d8b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.390207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bb175c32-02c3-4f38-88f9-5d8cfadd6d8b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:32.415305 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bb175c32-02c3-4f38-88f9-5d8cfadd6d8b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1324 microversion: 2.1 time: 0.588170 Jul 20 04:15:32.417030 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1046/2047] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:31 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1324 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:32.437091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-45413160-473c-49f4-9044-e3c1d384e314 req-80186732-dd06-414d-b58a-9dbb23d120e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3445ff1-ac59-48ce-9640-16869a5c36dd", "tag": "637ecc0f-86f3-419a-89d0-22609f03b91d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:32.449976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-45413160-473c-49f4-9044-e3c1d384e314 req-80186732-dd06-414d-b58a-9dbb23d120e1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.450993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-45413160-473c-49f4-9044-e3c1d384e314 req-80186732-dd06-414d-b58a-9dbb23d120e1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.484416 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-45413160-473c-49f4-9044-e3c1d384e314 req-80186732-dd06-414d-b58a-9dbb23d120e1 service nova] Creating event network-changed:637ecc0f-86f3-419a-89d0-22609f03b91d for instance c3445ff1-ac59-48ce-9640-16869a5c36dd on n-h2-760456-11 Jul 20 04:15:32.498971 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-45413160-473c-49f4-9044-e3c1d384e314 req-80186732-dd06-414d-b58a-9dbb23d120e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076948 Jul 20 04:15:32.500256 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1047/2048] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:32.506455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d9fe565f-6e4d-4557-8551-5579ee5c1fcd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:32.507643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d9fe565f-6e4d-4557-8551-5579ee5c1fcd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:32.517168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9fe565f-6e4d-4557-8551-5579ee5c1fcd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.517867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9fe565f-6e4d-4557-8551-5579ee5c1fcd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.518943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9fe565f-6e4d-4557-8551-5579ee5c1fcd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.519595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9fe565f-6e4d-4557-8551-5579ee5c1fcd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.063525 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6c3c1c79-dbf8-4131-8327-64c6aed4d51c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/action" status: 202 len: 0 microversion: 2.25 time: 3.510526 Jul 20 04:15:33.064830 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1002/2049] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:15:29 2022] POST /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/action => generated 0 bytes in 3513 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:33.070611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-167c7b8c-6728-4366-ad72-ea45db7e0021 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:33.071546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-167c7b8c-6728-4366-ad72-ea45db7e0021 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:33.081562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-167c7b8c-6728-4366-ad72-ea45db7e0021 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.085613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-167c7b8c-6728-4366-ad72-ea45db7e0021 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.087907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-167c7b8c-6728-4366-ad72-ea45db7e0021 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.088703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-167c7b8c-6728-4366-ad72-ea45db7e0021 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.145597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d9fe565f-6e4d-4557-8551-5579ee5c1fcd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:33.165928 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d9fe565f-6e4d-4557-8551-5579ee5c1fcd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1501 microversion: 2.1 time: 0.664147 Jul 20 04:15:33.182649 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1048/2050] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:32 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1501 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:33.184297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-15efd4d1-0c8c-4e84-8dc1-789a52bc8605 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:33.191551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-15efd4d1-0c8c-4e84-8dc1-789a52bc8605 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:33.208118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15efd4d1-0c8c-4e84-8dc1-789a52bc8605 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.208579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15efd4d1-0c8c-4e84-8dc1-789a52bc8605 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.209368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15efd4d1-0c8c-4e84-8dc1-789a52bc8605 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.209811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15efd4d1-0c8c-4e84-8dc1-789a52bc8605 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.363136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-167c7b8c-6728-4366-ad72-ea45db7e0021 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:33.383587 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-167c7b8c-6728-4366-ad72-ea45db7e0021 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.317124 Jul 20 04:15:33.384253 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1003/2051] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:33 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:33.435141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-28b9fa1c-b6f0-4655-947e-db3eb1edca54 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:33.435982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-28b9fa1c-b6f0-4655-947e-db3eb1edca54 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:33.457110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28b9fa1c-b6f0-4655-947e-db3eb1edca54 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.457576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28b9fa1c-b6f0-4655-947e-db3eb1edca54 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.458403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28b9fa1c-b6f0-4655-947e-db3eb1edca54 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.458842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28b9fa1c-b6f0-4655-947e-db3eb1edca54 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.565549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-15efd4d1-0c8c-4e84-8dc1-789a52bc8605 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:33.585584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-15efd4d1-0c8c-4e84-8dc1-789a52bc8605 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:33.590481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-15efd4d1-0c8c-4e84-8dc1-789a52bc8605 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:33.592419 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-15efd4d1-0c8c-4e84-8dc1-789a52bc8605 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.418574 Jul 20 04:15:33.603027 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1049/2052] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:33 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:34.259493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-28b9fa1c-b6f0-4655-947e-db3eb1edca54 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:34.275273 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-28b9fa1c-b6f0-4655-947e-db3eb1edca54 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1324 microversion: 2.1 time: 0.845717 Jul 20 04:15:34.288727 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1004/2053] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:33 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1324 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:34.402922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c92ff515-94cd-4967-afb6-abe66dcb4415 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:34.404510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c92ff515-94cd-4967-afb6-abe66dcb4415 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:34.417261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c92ff515-94cd-4967-afb6-abe66dcb4415 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.418473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c92ff515-94cd-4967-afb6-abe66dcb4415 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.419489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c92ff515-94cd-4967-afb6-abe66dcb4415 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.420139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c92ff515-94cd-4967-afb6-abe66dcb4415 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.615153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b2bea06a-0f83-4c6b-bf8f-7cc99e4b1fad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:34.615764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b2bea06a-0f83-4c6b-bf8f-7cc99e4b1fad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:34.627919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2bea06a-0f83-4c6b-bf8f-7cc99e4b1fad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.630061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2bea06a-0f83-4c6b-bf8f-7cc99e4b1fad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.632554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2bea06a-0f83-4c6b-bf8f-7cc99e4b1fad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.633996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2bea06a-0f83-4c6b-bf8f-7cc99e4b1fad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.090501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b2bea06a-0f83-4c6b-bf8f-7cc99e4b1fad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:35.104866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b2bea06a-0f83-4c6b-bf8f-7cc99e4b1fad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:35.106798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b2bea06a-0f83-4c6b-bf8f-7cc99e4b1fad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:35.112607 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b2bea06a-0f83-4c6b-bf8f-7cc99e4b1fad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.501899 Jul 20 04:15:35.115291 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1005/2054] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:34 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:35.297296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bab32024-4be7-4664-b72f-951a4a31ac9c tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.297922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bab32024-4be7-4664-b72f-951a4a31ac9c tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:35.309547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c92ff515-94cd-4967-afb6-abe66dcb4415 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:35.312678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:35.321085 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c92ff515-94cd-4967-afb6-abe66dcb4415 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.923778 Jul 20 04:15:35.327246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab32024-4be7-4664-b72f-951a4a31ac9c tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.327713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab32024-4be7-4664-b72f-951a4a31ac9c tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.328524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab32024-4be7-4664-b72f-951a4a31ac9c tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.328968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab32024-4be7-4664-b72f-951a4a31ac9c tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.341188 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1050/2055] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:34 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:36.065692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bab32024-4be7-4664-b72f-951a4a31ac9c tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:36.083020 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bab32024-4be7-4664-b72f-951a4a31ac9c tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1324 microversion: 2.1 time: 0.784562 Jul 20 04:15:36.084640 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1006/2056] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1324 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:36.136879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ee4bd995-8750-4ccb-b402-c39a6f8ab8a1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.137829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ee4bd995-8750-4ccb-b402-c39a6f8ab8a1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:36.153429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee4bd995-8750-4ccb-b402-c39a6f8ab8a1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.154006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee4bd995-8750-4ccb-b402-c39a6f8ab8a1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.159414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee4bd995-8750-4ccb-b402-c39a6f8ab8a1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.159414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee4bd995-8750-4ccb-b402-c39a6f8ab8a1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.194712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35d1f83e-f7d5-403a-bd4e-ee78a21a1910 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a3622bc-b8e3-4321-ae89-f389ef83de7e"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:36.195870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-35d1f83e-f7d5-403a-bd4e-ee78a21a1910 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:36.214826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35d1f83e-f7d5-403a-bd4e-ee78a21a1910 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.223773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35d1f83e-f7d5-403a-bd4e-ee78a21a1910 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.224695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35d1f83e-f7d5-403a-bd4e-ee78a21a1910 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.225558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35d1f83e-f7d5-403a-bd4e-ee78a21a1910 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.589852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ee4bd995-8750-4ccb-b402-c39a6f8ab8a1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:36.613214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ee4bd995-8750-4ccb-b402-c39a6f8ab8a1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:36.623671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ee4bd995-8750-4ccb-b402-c39a6f8ab8a1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:36.625193 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ee4bd995-8750-4ccb-b402-c39a6f8ab8a1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.495146 Jul 20 04:15:36.626217 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1051/2057] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:36.631185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3551920e-9c56-429c-b72f-26cbabebfbdb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.634648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3551920e-9c56-429c-b72f-26cbabebfbdb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:36.646193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3551920e-9c56-429c-b72f-26cbabebfbdb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.647084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3551920e-9c56-429c-b72f-26cbabebfbdb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.648193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3551920e-9c56-429c-b72f-26cbabebfbdb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.648847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3551920e-9c56-429c-b72f-26cbabebfbdb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.919666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3551920e-9c56-429c-b72f-26cbabebfbdb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:36.922093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:36.932533 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3551920e-9c56-429c-b72f-26cbabebfbdb tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.304728 Jul 20 04:15:36.944806 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1052/2058] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:37.101228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2dc02903-d279-4d3d-8c3a-a64f28210ef5 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.102178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2dc02903-d279-4d3d-8c3a-a64f28210ef5 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:37.126211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2dc02903-d279-4d3d-8c3a-a64f28210ef5 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.126211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2dc02903-d279-4d3d-8c3a-a64f28210ef5 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.126211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2dc02903-d279-4d3d-8c3a-a64f28210ef5 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.126211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2dc02903-d279-4d3d-8c3a-a64f28210ef5 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.546400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2dc02903-d279-4d3d-8c3a-a64f28210ef5 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.561031 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2dc02903-d279-4d3d-8c3a-a64f28210ef5 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1324 microversion: 2.1 time: 0.457223 Jul 20 04:15:37.561699 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1053/2059] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1324 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:37.644956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-abc4ff9d-3a80-4207-a154-caac8ed21deb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.645581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-abc4ff9d-3a80-4207-a154-caac8ed21deb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:37.652633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abc4ff9d-3a80-4207-a154-caac8ed21deb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.653304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abc4ff9d-3a80-4207-a154-caac8ed21deb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.654277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abc4ff9d-3a80-4207-a154-caac8ed21deb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.655063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abc4ff9d-3a80-4207-a154-caac8ed21deb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.933396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-abc4ff9d-3a80-4207-a154-caac8ed21deb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.968369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-abc4ff9d-3a80-4207-a154-caac8ed21deb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.970231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-abc4ff9d-3a80-4207-a154-caac8ed21deb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.971667 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-abc4ff9d-3a80-4207-a154-caac8ed21deb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.330947 Jul 20 04:15:37.985239 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1054/2060] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:37.990977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-842c4cd5-4b2f-4e97-9906-93f7ddddf466 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.991779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-842c4cd5-4b2f-4e97-9906-93f7ddddf466 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:37.998510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-842c4cd5-4b2f-4e97-9906-93f7ddddf466 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.998967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-842c4cd5-4b2f-4e97-9906-93f7ddddf466 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.999751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-842c4cd5-4b2f-4e97-9906-93f7ddddf466 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.000188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-842c4cd5-4b2f-4e97-9906-93f7ddddf466 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.268969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-842c4cd5-4b2f-4e97-9906-93f7ddddf466 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:38.280896 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-842c4cd5-4b2f-4e97-9906-93f7ddddf466 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.294009 Jul 20 04:15:38.281494 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1055/2061] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:38.565993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4d0ae603-2bfd-46a4-a894-ca7afb89aa15 req-4adbefbf-7768-4ad0-a7e1-96ebedc9fe6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3445ff1-ac59-48ce-9640-16869a5c36dd", "name": "network-vif-plugged", "status": "completed", "tag": "637ecc0f-86f3-419a-89d0-22609f03b91d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:38.588006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4d0ae603-2bfd-46a4-a894-ca7afb89aa15 req-4adbefbf-7768-4ad0-a7e1-96ebedc9fe6e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.591604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4d0ae603-2bfd-46a4-a894-ca7afb89aa15 req-4adbefbf-7768-4ad0-a7e1-96ebedc9fe6e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.622193 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4d0ae603-2bfd-46a4-a894-ca7afb89aa15 req-4adbefbf-7768-4ad0-a7e1-96ebedc9fe6e service nova] Creating event network-vif-plugged:637ecc0f-86f3-419a-89d0-22609f03b91d for instance c3445ff1-ac59-48ce-9640-16869a5c36dd on n-h2-760456-11 Jul 20 04:15:38.632996 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4d0ae603-2bfd-46a4-a894-ca7afb89aa15 req-4adbefbf-7768-4ad0-a7e1-96ebedc9fe6e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073714 Jul 20 04:15:38.637554 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1056/2062] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:38.649317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-07509704-ead1-4be6-9ef2-dd85bd8e9da6 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:38.654167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-07509704-ead1-4be6-9ef2-dd85bd8e9da6 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:38.672138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07509704-ead1-4be6-9ef2-dd85bd8e9da6 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.675295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07509704-ead1-4be6-9ef2-dd85bd8e9da6 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.676212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07509704-ead1-4be6-9ef2-dd85bd8e9da6 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.676787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07509704-ead1-4be6-9ef2-dd85bd8e9da6 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.927147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-07509704-ead1-4be6-9ef2-dd85bd8e9da6 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:38.936770 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-07509704-ead1-4be6-9ef2-dd85bd8e9da6 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1324 microversion: 2.1 time: 0.296429 Jul 20 04:15:38.937599 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1057/2063] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:38 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:38.992418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e81b7aeb-fe22-412c-96a5-fea87c5ff343 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:38.993276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e81b7aeb-fe22-412c-96a5-fea87c5ff343 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:39.002143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e81b7aeb-fe22-412c-96a5-fea87c5ff343 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.005019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e81b7aeb-fe22-412c-96a5-fea87c5ff343 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.005861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e81b7aeb-fe22-412c-96a5-fea87c5ff343 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.006334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e81b7aeb-fe22-412c-96a5-fea87c5ff343 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.199169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e81b7aeb-fe22-412c-96a5-fea87c5ff343 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:39.208134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e81b7aeb-fe22-412c-96a5-fea87c5ff343 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:39.209707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e81b7aeb-fe22-412c-96a5-fea87c5ff343 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:39.210922 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e81b7aeb-fe22-412c-96a5-fea87c5ff343 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.222734 Jul 20 04:15:39.211485 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1058/2064] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:38 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:15:39.278026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-793857474", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "1a43fe56-8d80-4b5b-b8b5-acda422e3506"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:39.335350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] validate_networks() for [('1a43fe56-8d80-4b5b-b8b5-acda422e3506', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:39.731619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:39.733320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:39.733806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:39.734231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:39.737934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:39.759058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.759579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.762777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.764710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.802951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Getting quotas for project 4466f0a240f74efbad843243399adb84. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:39.810513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Getting quotas for user e31b85d83596495aa6e75967cf486dca and project 4466f0a240f74efbad843243399adb84. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:39.842683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:39.847481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:39.924972 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8b8bfb9a-7da6-4efc-a5ed-c9c6c20555b6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710944 Jul 20 04:15:39.926115 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1059/2065] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:39.930837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b45ef46-2bb5-433d-8e52-f9ee23e7f0b6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:39.931529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b45ef46-2bb5-433d-8e52-f9ee23e7f0b6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:39.940304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b45ef46-2bb5-433d-8e52-f9ee23e7f0b6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.940772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b45ef46-2bb5-433d-8e52-f9ee23e7f0b6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.941636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b45ef46-2bb5-433d-8e52-f9ee23e7f0b6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.954657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b45ef46-2bb5-433d-8e52-f9ee23e7f0b6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.194159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b45ef46-2bb5-433d-8e52-f9ee23e7f0b6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.205118 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b45ef46-2bb5-433d-8e52-f9ee23e7f0b6 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.277572 Jul 20 04:15:40.206010 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1060/2066] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:39 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:40.218466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d32e62db-d998-45c3-ac15-1b605ea2c160 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.219102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d32e62db-d998-45c3-ac15-1b605ea2c160 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.285134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d32e62db-d998-45c3-ac15-1b605ea2c160 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.293478 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d32e62db-d998-45c3-ac15-1b605ea2c160 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1231 microversion: 2.1 time: 0.085997 Jul 20 04:15:40.294115 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1061/2067] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1231 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:40.298904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-41a6ea26-896d-4b08-872a-ea2399be7ac9 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.299502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-41a6ea26-896d-4b08-872a-ea2399be7ac9 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.322597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41a6ea26-896d-4b08-872a-ea2399be7ac9 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.323282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41a6ea26-896d-4b08-872a-ea2399be7ac9 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.324575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41a6ea26-896d-4b08-872a-ea2399be7ac9 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.325168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41a6ea26-896d-4b08-872a-ea2399be7ac9 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.484593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-41a6ea26-896d-4b08-872a-ea2399be7ac9 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.494104 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-41a6ea26-896d-4b08-872a-ea2399be7ac9 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1520 microversion: 2.1 time: 0.198822 Jul 20 04:15:40.495699 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1062/2068] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:40.520747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0aaefd8-71f7-4a4f-8839-d48ad47e690e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.521589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d0aaefd8-71f7-4a4f-8839-d48ad47e690e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.529126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0aaefd8-71f7-4a4f-8839-d48ad47e690e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.529818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0aaefd8-71f7-4a4f-8839-d48ad47e690e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.530834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0aaefd8-71f7-4a4f-8839-d48ad47e690e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.531755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0aaefd8-71f7-4a4f-8839-d48ad47e690e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.711439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d0aaefd8-71f7-4a4f-8839-d48ad47e690e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.726735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d0aaefd8-71f7-4a4f-8839-d48ad47e690e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.735348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d0aaefd8-71f7-4a4f-8839-d48ad47e690e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.737364 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d0aaefd8-71f7-4a4f-8839-d48ad47e690e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.223465 Jul 20 04:15:40.746390 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1063/2069] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:40.756748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1fa7081-807b-4c33-b320-3c6e2c8fa766 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-573731254", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1fa7081-807b-4c33-b320-3c6e2c8fa766 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Request method failure captured: Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 242 Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14FbkhHl2a2_3mJU_Zy60F6J7b-WqWpdWYUBbbTqzFyNB4QEz3ylhzo55kVwBsnqTse4PoqKwnw_vszW_AOTVWi8P_m7UXc8f2rkZ4OypGQWV_T0fvtHs887uQUgt7hXpYZZkqwEjfS2CPX4b0iXozjbJkBHZBNidNUMgcEQJycxGys Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: b3c23bc77ca34820a90e49492fd014f2 Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-573731254", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-573731254', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56'}]}}} Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:40.760722 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1fa7081-807b-4c33-b320-3c6e2c8fa766 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1fa7081-807b-4c33-b320-3c6e2c8fa766 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.016783 Jul 20 04:15:40.764000 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1064/2070] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:40 2022] POST /compute/v2.1/servers => generated 175 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:15:40.784093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d2c2ab0f-51c6-448e-97ea-cf4c643c4446 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.784609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d2c2ab0f-51c6-448e-97ea-cf4c643c4446 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: 05a95a06-21c2-42fb-b9cf-abfebd7dd815] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.792590 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d2c2ab0f-51c6-448e-97ea-cf4c643c4446 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] HTTP exception thrown: Instance 05a95a06-21c2-42fb-b9cf-abfebd7dd815 could not be found. Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d2c2ab0f-51c6-448e-97ea-cf4c643c4446 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Request method failure captured: Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/05a95a06-21c2-42fb-b9cf-abfebd7dd815/metadata HTTP/1.1 Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14FbkhHl2a2_3mJU_Zy60F6J7b-WqWpdWYUBbbTqzFyNB4QEz3ylhzo55kVwBsnqTse4PoqKwnw_vszW_AOTVWi8P_m7UXc8f2rkZ4OypGQWV_T0fvtHs887uQUgt7hXpYZZkqwEjfS2CPX4b0iXozjbJkBHZBNidNUMgcEQJycxGys Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: b3c23bc77ca34820a90e49492fd014f2 Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 05a95a06-21c2-42fb-b9cf-abfebd7dd815 could not be found. Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'server_id': '05a95a06-21c2-42fb-b9cf-abfebd7dd815'} Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a95a06-21c2-42fb-b9cf-abfebd7dd815 could not be found. Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a95a06-21c2-42fb-b9cf-abfebd7dd815 could not be found. Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:40.800523 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:40.816155 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:40.816155 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:40.816155 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a95a06-21c2-42fb-b9cf-abfebd7dd815 could not be found. Jul 20 04:15:40.816155 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.816155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d2c2ab0f-51c6-448e-97ea-cf4c643c4446 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Returning 404 to user: Instance 05a95a06-21c2-42fb-b9cf-abfebd7dd815 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:40.816155 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d2c2ab0f-51c6-448e-97ea-cf4c643c4446 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/05a95a06-21c2-42fb-b9cf-abfebd7dd815/metadata" status: 404 len: 111 microversion: 2.1 time: 0.032909 Jul 20 04:15:40.816155 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1065/2071] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/05a95a06-21c2-42fb-b9cf-abfebd7dd815/metadata => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:15:40.862379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d41ceeda-3e84-424d-a0f1-2a6a78e9aa65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-161812099", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d41ceeda-3e84-424d-a0f1-2a6a78e9aa65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Request method failure captured: Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 498 Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14FbkhHl2a2_3mJU_Zy60F6J7b-WqWpdWYUBbbTqzFyNB4QEz3ylhzo55kVwBsnqTse4PoqKwnw_vszW_AOTVWi8P_m7UXc8f2rkZ4OypGQWV_T0fvtHs887uQUgt7hXpYZZkqwEjfS2CPX4b0iXozjbJkBHZBNidNUMgcEQJycxGys Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: b3c23bc77ca34820a90e49492fd014f2 Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-161812099", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-161812099', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56'}]}}} Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:15:40.866026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.869808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.872995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d41ceeda-3e84-424d-a0f1-2a6a78e9aa65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:40.874021 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d41ceeda-3e84-424d-a0f1-2a6a78e9aa65 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.017488 Jul 20 04:15:40.875034 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1066/2072] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:40 2022] POST /compute/v2.1/servers => generated 687 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:15:40.927618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-193874d9-18c2-49e3-a808-a7dbd4ed547f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-946155314", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-193874d9-18c2-49e3-a808-a7dbd4ed547f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Request method failure captured: Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 499 Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14FbkhHl2a2_3mJU_Zy60F6J7b-WqWpdWYUBbbTqzFyNB4QEz3ylhzo55kVwBsnqTse4PoqKwnw_vszW_AOTVWi8P_m7UXc8f2rkZ4OypGQWV_T0fvtHs887uQUgt7hXpYZZkqwEjfS2CPX4b0iXozjbJkBHZBNidNUMgcEQJycxGys Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: b3c23bc77ca34820a90e49492fd014f2 Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-946155314", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-946155314', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56'}]}}} Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:15:40.931270 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.934808 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.937104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-193874d9-18c2-49e3-a808-a7dbd4ed547f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:40.937972 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-193874d9-18c2-49e3-a808-a7dbd4ed547f tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.014688 Jul 20 04:15:40.942292 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1067/2073] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:40 2022] POST /compute/v2.1/servers => generated 689 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:15:40.993248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4831a717-13ff-4d9f-87d3-78108659cab3 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1438378703", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4831a717-13ff-4d9f-87d3-78108659cab3 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Request method failure captured: Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 754 Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14FbkhHl2a2_3mJU_Zy60F6J7b-WqWpdWYUBbbTqzFyNB4QEz3ylhzo55kVwBsnqTse4PoqKwnw_vszW_AOTVWi8P_m7UXc8f2rkZ4OypGQWV_T0fvtHs887uQUgt7hXpYZZkqwEjfS2CPX4b0iXozjbJkBHZBNidNUMgcEQJycxGys Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: b3c23bc77ca34820a90e49492fd014f2 Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1438378703", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1438378703', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56'}]}}} Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:40.997064 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:40.999897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:41.002229 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:41.002229 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.003381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4831a717-13ff-4d9f-87d3-78108659cab3 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:41.004789 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4831a717-13ff-4d9f-87d3-78108659cab3 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.015490 Jul 20 04:15:41.016178 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1068/2074] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:40 2022] POST /compute/v2.1/servers => generated 1197 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 20 04:15:41.061791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0298cb31-0f5e-4767-98ed-9a2123bfb423 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-46899398", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0298cb31-0f5e-4767-98ed-9a2123bfb423 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Request method failure captured: Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 1264 Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14FbkhHl2a2_3mJU_Zy60F6J7b-WqWpdWYUBbbTqzFyNB4QEz3ylhzo55kVwBsnqTse4PoqKwnw_vszW_AOTVWi8P_m7UXc8f2rkZ4OypGQWV_T0fvtHs887uQUgt7hXpYZZkqwEjfS2CPX4b0iXozjbJkBHZBNidNUMgcEQJycxGys Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: b3c23bc77ca34820a90e49492fd014f2 Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-46899398", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56"}]}} Jul 20 04:15:41.064823 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-46899398', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7c0dcbbe-2e61-4ad6-bb3c-5fd48b9c2d56'}]}}} Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.067009 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:41.068143 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:41.070983 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:15:41.070983 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.070983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0298cb31-0f5e-4767-98ed-9a2123bfb423 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:41.070983 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0298cb31-0f5e-4767-98ed-9a2123bfb423 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010188 Jul 20 04:15:41.072084 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1069/2075] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Jul 20 04:15:41 2022] POST /compute/v2.1/servers => generated 2221 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 20 04:15:41.077700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c21ea6eb-3ebd-42c2-8178-bae8d076029b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.078209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c21ea6eb-3ebd-42c2-8178-bae8d076029b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: 88d2a4bf-dae7-421f-ab2f-9f2da298972f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.084833 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-c21ea6eb-3ebd-42c2-8178-bae8d076029b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] HTTP exception thrown: Instance 88d2a4bf-dae7-421f-ab2f-9f2da298972f could not be found. Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c21ea6eb-3ebd-42c2-8178-bae8d076029b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Request method failure captured: Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/88d2a4bf-dae7-421f-ab2f-9f2da298972f/metadata/test2 HTTP/1.1 Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14FbkhHl2a2_3mJU_Zy60F6J7b-WqWpdWYUBbbTqzFyNB4QEz3ylhzo55kVwBsnqTse4PoqKwnw_vszW_AOTVWi8P_m7UXc8f2rkZ4OypGQWV_T0fvtHs887uQUgt7hXpYZZkqwEjfS2CPX4b0iXozjbJkBHZBNidNUMgcEQJycxGys Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: b3c23bc77ca34820a90e49492fd014f2 Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 88d2a4bf-dae7-421f-ab2f-9f2da298972f could not be found. Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'server_id': '88d2a4bf-dae7-421f-ab2f-9f2da298972f', 'id': 'test2'} Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d2a4bf-dae7-421f-ab2f-9f2da298972f could not be found. Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d2a4bf-dae7-421f-ab2f-9f2da298972f could not be found. Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:41.086424 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:41.091371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:41.091371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:41.091371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d2a4bf-dae7-421f-ab2f-9f2da298972f could not be found. Jul 20 04:15:41.091371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:41.091371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c21ea6eb-3ebd-42c2-8178-bae8d076029b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Returning 404 to user: Instance 88d2a4bf-dae7-421f-ab2f-9f2da298972f could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:41.091371 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c21ea6eb-3ebd-42c2-8178-bae8d076029b tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/88d2a4bf-dae7-421f-ab2f-9f2da298972f/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014423 Jul 20 04:15:41.094901 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1070/2076] 10.222.0.59 () {58 vars in 1280 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/servers/88d2a4bf-dae7-421f-ab2f-9f2da298972f/metadata/test2 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:41.102457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-156f60a0-deb7-4dc1-8f6c-b0079b44d0e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.103053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-156f60a0-deb7-4dc1-8f6c-b0079b44d0e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.111331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-156f60a0-deb7-4dc1-8f6c-b0079b44d0e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.111913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-156f60a0-deb7-4dc1-8f6c-b0079b44d0e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.112840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-156f60a0-deb7-4dc1-8f6c-b0079b44d0e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.113409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-156f60a0-deb7-4dc1-8f6c-b0079b44d0e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.148606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-156f60a0-deb7-4dc1-8f6c-b0079b44d0e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:41.242605 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-156f60a0-deb7-4dc1-8f6c-b0079b44d0e4 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 204 len: 0 microversion: 2.1 time: 0.143769 Jul 20 04:15:41.243267 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1071/2077] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:41 2022] DELETE /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:15:41.249540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a9c0e355-3d8f-45f0-b914-0f36380b60e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.250665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a9c0e355-3d8f-45f0-b914-0f36380b60e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.257630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9c0e355-3d8f-45f0-b914-0f36380b60e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.258108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9c0e355-3d8f-45f0-b914-0f36380b60e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.258950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9c0e355-3d8f-45f0-b914-0f36380b60e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.259403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9c0e355-3d8f-45f0-b914-0f36380b60e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.439896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a9c0e355-3d8f-45f0-b914-0f36380b60e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:41.452413 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a9c0e355-3d8f-45f0-b914-0f36380b60e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.207442 Jul 20 04:15:41.465262 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1072/2078] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:41.477515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8aabd5a8-aca1-4118-b07a-f700a9a22cec tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.478212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8aabd5a8-aca1-4118-b07a-f700a9a22cec tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.487389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aabd5a8-aca1-4118-b07a-f700a9a22cec tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.487855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aabd5a8-aca1-4118-b07a-f700a9a22cec tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.488887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aabd5a8-aca1-4118-b07a-f700a9a22cec tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.489494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aabd5a8-aca1-4118-b07a-f700a9a22cec tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.681885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8aabd5a8-aca1-4118-b07a-f700a9a22cec tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:41.691900 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8aabd5a8-aca1-4118-b07a-f700a9a22cec tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1526 microversion: 2.1 time: 0.225563 Jul 20 04:15:41.693072 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1073/2079] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1526 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:41.701183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-091e7b45-949f-4eb8-b0ee-f8d12f1dd44c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.702299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-091e7b45-949f-4eb8-b0ee-f8d12f1dd44c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.710997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-091e7b45-949f-4eb8-b0ee-f8d12f1dd44c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.711655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-091e7b45-949f-4eb8-b0ee-f8d12f1dd44c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.713458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-091e7b45-949f-4eb8-b0ee-f8d12f1dd44c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.717108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-091e7b45-949f-4eb8-b0ee-f8d12f1dd44c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.846908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-091e7b45-949f-4eb8-b0ee-f8d12f1dd44c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:41.856257 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-091e7b45-949f-4eb8-b0ee-f8d12f1dd44c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1291 microversion: 2.1 time: 0.161110 Jul 20 04:15:41.856852 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1074/2080] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1291 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:41.871114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fbe7dbeb-2e33-4a32-939d-69e1c1840ab2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.871814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fbe7dbeb-2e33-4a32-939d-69e1c1840ab2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.891836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe7dbeb-2e33-4a32-939d-69e1c1840ab2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.892612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe7dbeb-2e33-4a32-939d-69e1c1840ab2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.893143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe7dbeb-2e33-4a32-939d-69e1c1840ab2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.893664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe7dbeb-2e33-4a32-939d-69e1c1840ab2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.896899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:42.099398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbe7dbeb-2e33-4a32-939d-69e1c1840ab2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.110050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbe7dbeb-2e33-4a32-939d-69e1c1840ab2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.111734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbe7dbeb-2e33-4a32-939d-69e1c1840ab2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.113594 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fbe7dbeb-2e33-4a32-939d-69e1c1840ab2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.255476 Jul 20 04:15:42.125318 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1075/2081] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:42.472063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-731f2619-3e46-45db-bbc7-672956832b74 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.472982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-731f2619-3e46-45db-bbc7-672956832b74 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:42.486820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-731f2619-3e46-45db-bbc7-672956832b74 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.487583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-731f2619-3e46-45db-bbc7-672956832b74 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.488355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-731f2619-3e46-45db-bbc7-672956832b74 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.492374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-731f2619-3e46-45db-bbc7-672956832b74 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.682209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-731f2619-3e46-45db-bbc7-672956832b74 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.695682 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-731f2619-3e46-45db-bbc7-672956832b74 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.230110 Jul 20 04:15:42.696435 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1076/2082] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:42 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:42.718893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bfbda1af-0d0c-481f-b70b-665dec287b41 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.719989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bfbda1af-0d0c-481f-b70b-665dec287b41 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:42.726786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfbda1af-0d0c-481f-b70b-665dec287b41 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.727547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfbda1af-0d0c-481f-b70b-665dec287b41 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.729761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfbda1af-0d0c-481f-b70b-665dec287b41 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.730719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfbda1af-0d0c-481f-b70b-665dec287b41 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.905766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bfbda1af-0d0c-481f-b70b-665dec287b41 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.917929 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bfbda1af-0d0c-481f-b70b-665dec287b41 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1526 microversion: 2.1 time: 0.204716 Jul 20 04:15:42.918921 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1077/2083] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:42 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1526 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:42.924298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a7768535-4a6f-4039-ae36-12d36d24bb74 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.925130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a7768535-4a6f-4039-ae36-12d36d24bb74 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:42.933202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7768535-4a6f-4039-ae36-12d36d24bb74 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.933671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7768535-4a6f-4039-ae36-12d36d24bb74 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.934500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7768535-4a6f-4039-ae36-12d36d24bb74 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.935039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7768535-4a6f-4039-ae36-12d36d24bb74 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.047057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a7768535-4a6f-4039-ae36-12d36d24bb74 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:43.065163 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a7768535-4a6f-4039-ae36-12d36d24bb74 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1289 microversion: 2.1 time: 0.141136 Jul 20 04:15:43.066167 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1078/2084] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:42 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1289 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:43.138914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b11a6360-c8c1-4b73-9e17-979778eba102 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:43.139971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b11a6360-c8c1-4b73-9e17-979778eba102 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:43.142315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:43.158317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b11a6360-c8c1-4b73-9e17-979778eba102 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.159245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b11a6360-c8c1-4b73-9e17-979778eba102 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.160479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b11a6360-c8c1-4b73-9e17-979778eba102 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.161168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b11a6360-c8c1-4b73-9e17-979778eba102 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.354964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b11a6360-c8c1-4b73-9e17-979778eba102 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:43.364827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b11a6360-c8c1-4b73-9e17-979778eba102 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:43.366402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b11a6360-c8c1-4b73-9e17-979778eba102 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:43.367602 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b11a6360-c8c1-4b73-9e17-979778eba102 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.237233 Jul 20 04:15:43.368699 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1079/2085] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:43 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:43.676415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4a9a7a1d-4d46-4dfd-a5b9-746d09e965ed req-ad11de9d-cea8-4041-847c-bb8a9cb6046f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3445ff1-ac59-48ce-9640-16869a5c36dd", "name": "network-vif-deleted", "tag": "637ecc0f-86f3-419a-89d0-22609f03b91d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:43.715490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4a9a7a1d-4d46-4dfd-a5b9-746d09e965ed req-ad11de9d-cea8-4041-847c-bb8a9cb6046f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.716307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4a9a7a1d-4d46-4dfd-a5b9-746d09e965ed req-ad11de9d-cea8-4041-847c-bb8a9cb6046f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.755615 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4a9a7a1d-4d46-4dfd-a5b9-746d09e965ed req-ad11de9d-cea8-4041-847c-bb8a9cb6046f service nova] Creating event network-vif-deleted:637ecc0f-86f3-419a-89d0-22609f03b91d for instance c3445ff1-ac59-48ce-9640-16869a5c36dd on n-h2-760456-11 Jul 20 04:15:43.763906 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4a9a7a1d-4d46-4dfd-a5b9-746d09e965ed req-ad11de9d-cea8-4041-847c-bb8a9cb6046f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091066 Jul 20 04:15:43.771438 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1080/2086] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:43.779750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94f9e438-3778-457a-ac0b-e2c6cf6b7072 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:43.780472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-94f9e438-3778-457a-ac0b-e2c6cf6b7072 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:43.796912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94f9e438-3778-457a-ac0b-e2c6cf6b7072 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.797374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94f9e438-3778-457a-ac0b-e2c6cf6b7072 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.798172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94f9e438-3778-457a-ac0b-e2c6cf6b7072 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.807806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94f9e438-3778-457a-ac0b-e2c6cf6b7072 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.024691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-94f9e438-3778-457a-ac0b-e2c6cf6b7072 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:44.033282 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94f9e438-3778-457a-ac0b-e2c6cf6b7072 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.260482 Jul 20 04:15:44.034198 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1081/2087] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:43 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:44.048301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.049025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:44.058594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.059067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.059878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.061337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.112307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.114442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.116012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lazy-loading 'fault' on Instance uuid c3445ff1-ac59-48ce-9640-16869a5c36dd {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:44.193691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c23bc77ca34820a90e49492fd014f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3133719938a40ebb9ed9a17f54f12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:44.203402 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3e520d27-bd8d-457d-870b-4442cbd7650d tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 200 len: 1314 microversion: 2.1 time: 0.167980 Jul 20 04:15:44.203991 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1082/2088] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:44 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:44.210017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-eb5bf450-7a61-425c-84ee-680f0399f758 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.210679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-eb5bf450-7a61-425c-84ee-680f0399f758 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:44.217636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb5bf450-7a61-425c-84ee-680f0399f758 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.218234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb5bf450-7a61-425c-84ee-680f0399f758 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.219272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb5bf450-7a61-425c-84ee-680f0399f758 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.219606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb5bf450-7a61-425c-84ee-680f0399f758 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.421167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eb5bf450-7a61-425c-84ee-680f0399f758 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:44.433193 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-eb5bf450-7a61-425c-84ee-680f0399f758 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1331 microversion: 2.1 time: 0.228053 Jul 20 04:15:44.444000 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1083/2089] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:44 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1331 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:44.449821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a68fb30-e7d3-4cc7-8972-f75712f8c609 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.450983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1a68fb30-e7d3-4cc7-8972-f75712f8c609 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:44.458962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a68fb30-e7d3-4cc7-8972-f75712f8c609 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.459595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a68fb30-e7d3-4cc7-8972-f75712f8c609 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.460781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a68fb30-e7d3-4cc7-8972-f75712f8c609 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.461405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a68fb30-e7d3-4cc7-8972-f75712f8c609 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.667920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a68fb30-e7d3-4cc7-8972-f75712f8c609 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:44.689524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a68fb30-e7d3-4cc7-8972-f75712f8c609 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:44.693891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a68fb30-e7d3-4cc7-8972-f75712f8c609 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:44.696969 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a68fb30-e7d3-4cc7-8972-f75712f8c609 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.251184 Jul 20 04:15:44.698122 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1084/2090] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:44 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:45.050709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae31e648-f0fe-4d19-98fa-87a11fc1b56f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:45.052129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ae31e648-f0fe-4d19-98fa-87a11fc1b56f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:45.060625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae31e648-f0fe-4d19-98fa-87a11fc1b56f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.061376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae31e648-f0fe-4d19-98fa-87a11fc1b56f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.062800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae31e648-f0fe-4d19-98fa-87a11fc1b56f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.063397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae31e648-f0fe-4d19-98fa-87a11fc1b56f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.229254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae31e648-f0fe-4d19-98fa-87a11fc1b56f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:45.239161 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae31e648-f0fe-4d19-98fa-87a11fc1b56f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.191852 Jul 20 04:15:45.251256 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1085/2091] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:45 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:45.258364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8360bd32-09d0-4c50-baeb-ce03587418f7 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:45.261723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8360bd32-09d0-4c50-baeb-ce03587418f7 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] [instance: c3445ff1-ac59-48ce-9640-16869a5c36dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:45.269289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8360bd32-09d0-4c50-baeb-ce03587418f7 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.269797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8360bd32-09d0-4c50-baeb-ce03587418f7 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.270855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8360bd32-09d0-4c50-baeb-ce03587418f7 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.271867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8360bd32-09d0-4c50-baeb-ce03587418f7 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.289088 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-8360bd32-09d0-4c50-baeb-ce03587418f7 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] HTTP exception thrown: Instance c3445ff1-ac59-48ce-9640-16869a5c36dd could not be found. Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8360bd32-09d0-4c50-baeb-ce03587418f7 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Request method failure captured: Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd HTTP/1.1 Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14FbkhHl2a2_3mJU_Zy60F6J7b-WqWpdWYUBbbTqzFyNB4QEz3ylhzo55kVwBsnqTse4PoqKwnw_vszW_AOTVWi8P_m7UXc8f2rkZ4OypGQWV_T0fvtHs887uQUgt7hXpYZZkqwEjfS2CPX4b0iXozjbJkBHZBNidNUMgcEQJycxGys Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a3133719938a40ebb9ed9a17f54f12aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: a3133719938a40ebb9ed9a17f54f12aa Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679600775 Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: b3c23bc77ca34820a90e49492fd014f2 Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679600775-project Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance c3445ff1-ac59-48ce-9640-16869a5c36dd could not be found. Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'c3445ff1-ac59-48ce-9640-16869a5c36dd'} Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3445ff1-ac59-48ce-9640-16869a5c36dd could not be found. Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3445ff1-ac59-48ce-9640-16869a5c36dd could not be found. Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:45.291048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:45.295034 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:45.295034 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:45.295034 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:45.295034 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:45.295034 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:45.295034 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:45.295034 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3445ff1-ac59-48ce-9640-16869a5c36dd could not be found. Jul 20 04:15:45.295034 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:15:45.295034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8360bd32-09d0-4c50-baeb-ce03587418f7 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] Returning 404 to user: Instance c3445ff1-ac59-48ce-9640-16869a5c36dd could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:45.295034 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8360bd32-09d0-4c50-baeb-ce03587418f7 tempest-ServerMetadataNegativeTestJSON-1679600775 tempest-ServerMetadataNegativeTestJSON-1679600775-project] 10.222.0.59 "GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd" status: 404 len: 111 microversion: 2.1 time: 0.040144 Jul 20 04:15:45.297302 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1086/2092] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:45 2022] GET /compute/v2.1/servers/c3445ff1-ac59-48ce-9640-16869a5c36dd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:45.454050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e85cd652-8773-4bc8-969b-ad400484c51d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:45.454938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e85cd652-8773-4bc8-969b-ad400484c51d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:45.464288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e85cd652-8773-4bc8-969b-ad400484c51d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.464804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e85cd652-8773-4bc8-969b-ad400484c51d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.465703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e85cd652-8773-4bc8-969b-ad400484c51d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.466371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e85cd652-8773-4bc8-969b-ad400484c51d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.626458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:45.665491 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-35d1f83e-f7d5-403a-bd4e-ee78a21a1910 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.475511 Jul 20 04:15:45.677068 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1007/2093] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:15:36 2022] POST /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035/os-volume_attachments => generated 194 bytes in 9488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:45.692625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e85cd652-8773-4bc8-969b-ad400484c51d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:45.702093 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e85cd652-8773-4bc8-969b-ad400484c51d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1331 microversion: 2.1 time: 0.254515 Jul 20 04:15:45.711381 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1087/2094] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:45 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1331 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:45.747417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d05bd690-348f-4d5e-9d94-c4bca33e9cc8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:45.748146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d05bd690-348f-4d5e-9d94-c4bca33e9cc8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:45.755630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d05bd690-348f-4d5e-9d94-c4bca33e9cc8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.756088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d05bd690-348f-4d5e-9d94-c4bca33e9cc8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.756932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d05bd690-348f-4d5e-9d94-c4bca33e9cc8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.757369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d05bd690-348f-4d5e-9d94-c4bca33e9cc8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.818567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e9f8d62a-96eb-49ec-acf1-71e2d3dd6c40 req-0f5ecfce-c4f9-453a-b02d-adcfc9e44f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24022d95-b1d8-4c2b-bf1c-8cf54046226a", "tag": "427eb412-170d-4821-a11a-5c006106639c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:45.827890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e9f8d62a-96eb-49ec-acf1-71e2d3dd6c40 req-0f5ecfce-c4f9-453a-b02d-adcfc9e44f6b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.828648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e9f8d62a-96eb-49ec-acf1-71e2d3dd6c40 req-0f5ecfce-c4f9-453a-b02d-adcfc9e44f6b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.859391 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e9f8d62a-96eb-49ec-acf1-71e2d3dd6c40 req-0f5ecfce-c4f9-453a-b02d-adcfc9e44f6b service nova] Creating event network-changed:427eb412-170d-4821-a11a-5c006106639c for instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a on n-h2-760456-11 Jul 20 04:15:45.872274 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e9f8d62a-96eb-49ec-acf1-71e2d3dd6c40 req-0f5ecfce-c4f9-453a-b02d-adcfc9e44f6b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057317 Jul 20 04:15:45.873289 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1088/2095] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:46.042763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d05bd690-348f-4d5e-9d94-c4bca33e9cc8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.054044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d05bd690-348f-4d5e-9d94-c4bca33e9cc8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.055687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d05bd690-348f-4d5e-9d94-c4bca33e9cc8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.058517 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d05bd690-348f-4d5e-9d94-c4bca33e9cc8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.345520 Jul 20 04:15:46.059168 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1008/2096] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:45 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:46.261691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-081965d6-049f-4422-9b5d-1ce0eb2aac14 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:46.265029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-081965d6-049f-4422-9b5d-1ce0eb2aac14 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:46.284437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-081965d6-049f-4422-9b5d-1ce0eb2aac14 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.285280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-081965d6-049f-4422-9b5d-1ce0eb2aac14 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.299752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-081965d6-049f-4422-9b5d-1ce0eb2aac14 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.303720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-081965d6-049f-4422-9b5d-1ce0eb2aac14 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.526655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-081965d6-049f-4422-9b5d-1ce0eb2aac14 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.538549 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-081965d6-049f-4422-9b5d-1ce0eb2aac14 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.284744 Jul 20 04:15:46.549864 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1089/2097] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:46 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:46.720014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ed824dc-b754-41cb-bb0b-9c1389843494 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:46.720991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4ed824dc-b754-41cb-bb0b-9c1389843494 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:46.735318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ed824dc-b754-41cb-bb0b-9c1389843494 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.736072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ed824dc-b754-41cb-bb0b-9c1389843494 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.739276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ed824dc-b754-41cb-bb0b-9c1389843494 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.739905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ed824dc-b754-41cb-bb0b-9c1389843494 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.078668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae506054-c101-4776-b2e1-3670213d0225 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:47.079306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ae506054-c101-4776-b2e1-3670213d0225 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:47.099407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae506054-c101-4776-b2e1-3670213d0225 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:47.100049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae506054-c101-4776-b2e1-3670213d0225 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.101578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae506054-c101-4776-b2e1-3670213d0225 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:47.102025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae506054-c101-4776-b2e1-3670213d0225 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.514242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae506054-c101-4776-b2e1-3670213d0225 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:47.543667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae506054-c101-4776-b2e1-3670213d0225 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:47.548760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae506054-c101-4776-b2e1-3670213d0225 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:47.551343 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae506054-c101-4776-b2e1-3670213d0225 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.477485 Jul 20 04:15:47.555345 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1090/2098] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:47 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:15:47.562037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8684a282-e0a4-44d8-9144-b6192349519f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:47.562874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8684a282-e0a4-44d8-9144-b6192349519f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:47.571326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8684a282-e0a4-44d8-9144-b6192349519f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:47.572549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8684a282-e0a4-44d8-9144-b6192349519f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.573331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8684a282-e0a4-44d8-9144-b6192349519f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:47.573987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8684a282-e0a4-44d8-9144-b6192349519f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:47.600261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4ed824dc-b754-41cb-bb0b-9c1389843494 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:47.614448 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ed824dc-b754-41cb-bb0b-9c1389843494 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1331 microversion: 2.1 time: 0.897985 Jul 20 04:15:47.615902 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1009/2099] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:46 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1331 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:47.835500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8684a282-e0a4-44d8-9144-b6192349519f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:47.862542 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8684a282-e0a4-44d8-9144-b6192349519f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.304931 Jul 20 04:15:47.865075 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1091/2100] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:47 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:48.576366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-216dbb97-3b28-41a4-ba29-54bb75ee30cb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.577301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-216dbb97-3b28-41a4-ba29-54bb75ee30cb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:48.598966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-216dbb97-3b28-41a4-ba29-54bb75ee30cb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.599591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-216dbb97-3b28-41a4-ba29-54bb75ee30cb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.600565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-216dbb97-3b28-41a4-ba29-54bb75ee30cb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.601018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-216dbb97-3b28-41a4-ba29-54bb75ee30cb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.635356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30c7d348-5ddb-4cf3-91ef-3c9fbbcece3c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.636709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-30c7d348-5ddb-4cf3-91ef-3c9fbbcece3c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:48.647137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30c7d348-5ddb-4cf3-91ef-3c9fbbcece3c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.648640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30c7d348-5ddb-4cf3-91ef-3c9fbbcece3c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.653787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30c7d348-5ddb-4cf3-91ef-3c9fbbcece3c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.655651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30c7d348-5ddb-4cf3-91ef-3c9fbbcece3c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.883790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-216dbb97-3b28-41a4-ba29-54bb75ee30cb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:48.897196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-216dbb97-3b28-41a4-ba29-54bb75ee30cb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:48.899754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-216dbb97-3b28-41a4-ba29-54bb75ee30cb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:48.901957 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-216dbb97-3b28-41a4-ba29-54bb75ee30cb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.330826 Jul 20 04:15:48.903395 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1010/2101] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:48.919019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-957cc0c5-a948-4755-9c4c-7a5aedaffa12 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.920119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-957cc0c5-a948-4755-9c4c-7a5aedaffa12 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:48.928423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-957cc0c5-a948-4755-9c4c-7a5aedaffa12 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.929608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-957cc0c5-a948-4755-9c4c-7a5aedaffa12 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.930866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-957cc0c5-a948-4755-9c4c-7a5aedaffa12 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.932496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-957cc0c5-a948-4755-9c4c-7a5aedaffa12 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.199562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-957cc0c5-a948-4755-9c4c-7a5aedaffa12 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:49.219467 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-957cc0c5-a948-4755-9c4c-7a5aedaffa12 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.311797 Jul 20 04:15:49.220160 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1011/2102] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:49.532069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-30c7d348-5ddb-4cf3-91ef-3c9fbbcece3c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:49.542765 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-30c7d348-5ddb-4cf3-91ef-3c9fbbcece3c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1331 microversion: 2.1 time: 0.914648 Jul 20 04:15:49.547427 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1092/2103] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1331 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:49.921775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45f8a02b-8aa5-4fa3-af6e-7e061d156ea2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:49.923375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-45f8a02b-8aa5-4fa3-af6e-7e061d156ea2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:49.940909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45f8a02b-8aa5-4fa3-af6e-7e061d156ea2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.942632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45f8a02b-8aa5-4fa3-af6e-7e061d156ea2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.943618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45f8a02b-8aa5-4fa3-af6e-7e061d156ea2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:49.945237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45f8a02b-8aa5-4fa3-af6e-7e061d156ea2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.146285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45f8a02b-8aa5-4fa3-af6e-7e061d156ea2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.162862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45f8a02b-8aa5-4fa3-af6e-7e061d156ea2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.166359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45f8a02b-8aa5-4fa3-af6e-7e061d156ea2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.168713 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-45f8a02b-8aa5-4fa3-af6e-7e061d156ea2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.250830 Jul 20 04:15:50.169817 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1012/2104] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:49 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:50.240066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-295228f8-c184-4926-a135-74252a85e80a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:50.241439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-295228f8-c184-4926-a135-74252a85e80a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:50.249289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:50.256085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-295228f8-c184-4926-a135-74252a85e80a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.257093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-295228f8-c184-4926-a135-74252a85e80a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.258308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-295228f8-c184-4926-a135-74252a85e80a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.258941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-295228f8-c184-4926-a135-74252a85e80a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.278012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:50.289890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=20 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:50.484181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-295228f8-c184-4926-a135-74252a85e80a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.501487 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-295228f8-c184-4926-a135-74252a85e80a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.266952 Jul 20 04:15:50.505459 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1093/2105] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:50 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:50.563730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-da1401da-3e51-4e00-ab26-e9b9611564e4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:50.564365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-da1401da-3e51-4e00-ab26-e9b9611564e4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:50.582162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da1401da-3e51-4e00-ab26-e9b9611564e4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.583185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da1401da-3e51-4e00-ab26-e9b9611564e4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.592280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da1401da-3e51-4e00-ab26-e9b9611564e4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.594228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da1401da-3e51-4e00-ab26-e9b9611564e4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.666666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-30ec199c-da1d-41f7-a4fc-26a5a5f0ba33 req-f05a0e28-ef53-4dd5-bb3a-737554f03334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24022d95-b1d8-4c2b-bf1c-8cf54046226a", "name": "network-vif-plugged", "status": "completed", "tag": "427eb412-170d-4821-a11a-5c006106639c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:50.690446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-30ec199c-da1d-41f7-a4fc-26a5a5f0ba33 req-f05a0e28-ef53-4dd5-bb3a-737554f03334 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.691494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-30ec199c-da1d-41f7-a4fc-26a5a5f0ba33 req-f05a0e28-ef53-4dd5-bb3a-737554f03334 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.723119 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-30ec199c-da1d-41f7-a4fc-26a5a5f0ba33 req-f05a0e28-ef53-4dd5-bb3a-737554f03334 service nova] Creating event network-vif-plugged:427eb412-170d-4821-a11a-5c006106639c for instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a on n-h2-760456-11 Jul 20 04:15:50.736072 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-30ec199c-da1d-41f7-a4fc-26a5a5f0ba33 req-f05a0e28-ef53-4dd5-bb3a-737554f03334 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076408 Jul 20 04:15:50.737219 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1094/2106] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:50.905956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-da1401da-3e51-4e00-ab26-e9b9611564e4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.920007 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-da1401da-3e51-4e00-ab26-e9b9611564e4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1331 microversion: 2.1 time: 0.357279 Jul 20 04:15:50.921118 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1013/2107] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:50 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1331 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:51.189701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5b7070b8-c6c2-40aa-b6d8-a18bf5f52142 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:51.190658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5b7070b8-c6c2-40aa-b6d8-a18bf5f52142 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:51.200409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b7070b8-c6c2-40aa-b6d8-a18bf5f52142 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.203047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b7070b8-c6c2-40aa-b6d8-a18bf5f52142 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.204646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b7070b8-c6c2-40aa-b6d8-a18bf5f52142 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.205352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b7070b8-c6c2-40aa-b6d8-a18bf5f52142 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.485192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b7070b8-c6c2-40aa-b6d8-a18bf5f52142 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:51.503999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b7070b8-c6c2-40aa-b6d8-a18bf5f52142 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:51.505789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b7070b8-c6c2-40aa-b6d8-a18bf5f52142 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:51.507029 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5b7070b8-c6c2-40aa-b6d8-a18bf5f52142 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.323184 Jul 20 04:15:51.514701 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1095/2108] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:51 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:51.526643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-439d4636-3ec7-4556-9654-5bd7b5c5fc21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:51.528407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-439d4636-3ec7-4556-9654-5bd7b5c5fc21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:51.539614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-439d4636-3ec7-4556-9654-5bd7b5c5fc21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.541179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-439d4636-3ec7-4556-9654-5bd7b5c5fc21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.549662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-439d4636-3ec7-4556-9654-5bd7b5c5fc21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.551102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-439d4636-3ec7-4556-9654-5bd7b5c5fc21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.761590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-439d4636-3ec7-4556-9654-5bd7b5c5fc21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:51.772638 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-439d4636-3ec7-4556-9654-5bd7b5c5fc21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.251463 Jul 20 04:15:51.773936 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1014/2109] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:51 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:51.939621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c8343928-be9b-459c-8527-edf8421525db tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:51.940569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c8343928-be9b-459c-8527-edf8421525db tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:51.948918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8343928-be9b-459c-8527-edf8421525db tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.949379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8343928-be9b-459c-8527-edf8421525db tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.950546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8343928-be9b-459c-8527-edf8421525db tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.950996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8343928-be9b-459c-8527-edf8421525db tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.117838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c8343928-be9b-459c-8527-edf8421525db tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.130899 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c8343928-be9b-459c-8527-edf8421525db tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1331 microversion: 2.1 time: 0.196472 Jul 20 04:15:52.142408 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1096/2110] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:51 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1331 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:52.531011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9b7b595-6ef5-4207-a15a-ba9f1aeff647 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.533060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c9b7b595-6ef5-4207-a15a-ba9f1aeff647 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:52.544180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9b7b595-6ef5-4207-a15a-ba9f1aeff647 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.545465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9b7b595-6ef5-4207-a15a-ba9f1aeff647 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.546930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9b7b595-6ef5-4207-a15a-ba9f1aeff647 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.547905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9b7b595-6ef5-4207-a15a-ba9f1aeff647 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.793461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d892c89-5adc-47b2-8c42-83559d95fccc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.794138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d892c89-5adc-47b2-8c42-83559d95fccc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:52.811166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d892c89-5adc-47b2-8c42-83559d95fccc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.811636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d892c89-5adc-47b2-8c42-83559d95fccc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.812454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d892c89-5adc-47b2-8c42-83559d95fccc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.812907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d892c89-5adc-47b2-8c42-83559d95fccc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.844206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9b7b595-6ef5-4207-a15a-ba9f1aeff647 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.871755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9b7b595-6ef5-4207-a15a-ba9f1aeff647 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.877125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9b7b595-6ef5-4207-a15a-ba9f1aeff647 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.883563 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c9b7b595-6ef5-4207-a15a-ba9f1aeff647 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.358081 Jul 20 04:15:52.890406 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1015/2111] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:53.049989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d892c89-5adc-47b2-8c42-83559d95fccc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.066111 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d892c89-5adc-47b2-8c42-83559d95fccc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.277962 Jul 20 04:15:53.076364 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1097/2112] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:53.115064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ede7e933-3ea1-4955-b8fa-9d50373db47c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.119707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ede7e933-3ea1-4955-b8fa-9d50373db47c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.123281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ede7e933-3ea1-4955-b8fa-9d50373db47c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Searching by: {'deleted': False, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:15:53.134097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ede7e933-3ea1-4955-b8fa-9d50373db47c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.136128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ede7e933-3ea1-4955-b8fa-9d50373db47c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.137168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ede7e933-3ea1-4955-b8fa-9d50373db47c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.137991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ede7e933-3ea1-4955-b8fa-9d50373db47c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.156568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0000b315-93e1-4207-af77-b74c83ff4dbe tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.157311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0000b315-93e1-4207-af77-b74c83ff4dbe tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:53.170287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-ede7e933-3ea1-4955-b8fa-9d50373db47c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:15:53.173700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0000b315-93e1-4207-af77-b74c83ff4dbe tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.174211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0000b315-93e1-4207-af77-b74c83ff4dbe tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.177545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0000b315-93e1-4207-af77-b74c83ff4dbe tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.178023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0000b315-93e1-4207-af77-b74c83ff4dbe tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.215756 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ede7e933-3ea1-4955-b8fa-9d50373db47c tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.104059 Jul 20 04:15:53.226223 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1016/2113] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers => generated 333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:53.235019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.242029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.243313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Searching by: {'deleted': False, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:15:53.252737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.255539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.259017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.260237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.309830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:15:53.441105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.448951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.449513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.554083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0000b315-93e1-4207-af77-b74c83ff4dbe tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.575429 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0000b315-93e1-4207-af77-b74c83ff4dbe tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1536 microversion: 2.1 time: 0.423652 Jul 20 04:15:53.576412 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1098/2114] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1536 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:53.592429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4b565b97-0494-49ca-8463-4f004c8864d3 req-3210e85a-883a-4d0d-ae70-3826ee066ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2ae540-9679-4d32-a12c-4ac56e81f928", "name": "network-vif-unplugged", "status": "completed", "tag": "7dadbe99-6cc6-433e-ada6-72d466f63f3c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:53.617160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4b565b97-0494-49ca-8463-4f004c8864d3 req-3210e85a-883a-4d0d-ae70-3826ee066ede service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.617933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4b565b97-0494-49ca-8463-4f004c8864d3 req-3210e85a-883a-4d0d-ae70-3826ee066ede service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.661085 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4b565b97-0494-49ca-8463-4f004c8864d3 req-3210e85a-883a-4d0d-ae70-3826ee066ede service nova] Creating event network-vif-unplugged:7dadbe99-6cc6-433e-ada6-72d466f63f3c for instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 on n-h1-760456-11 Jul 20 04:15:53.667230 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4b565b97-0494-49ca-8463-4f004c8864d3 req-3210e85a-883a-4d0d-ae70-3826ee066ede service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086994 Jul 20 04:15:53.668648 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1099/2115] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:53.684996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e635a51-7b34-4566-adf8-b41d8a77d9a7 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Action: 'create', calling method: .version_select at 0x7fb841d05280>, body: {"pool": "b1f89390-4f46-4a2a-8cc8-f5bf1d50534f"} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:53.971861 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b719288b-6378-4522-8ff4-ea42f82e55c7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.744050 Jul 20 04:15:53.982926 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1017/2116] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:53.990035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-09cb4a0e-bca7-4fcb-915b-5a44049d80e1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.990730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-09cb4a0e-bca7-4fcb-915b-5a44049d80e1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:54.010061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cb4a0e-bca7-4fcb-915b-5a44049d80e1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.011269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cb4a0e-bca7-4fcb-915b-5a44049d80e1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.014834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cb4a0e-bca7-4fcb-915b-5a44049d80e1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.015502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cb4a0e-bca7-4fcb-915b-5a44049d80e1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.604368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-09cb4a0e-bca7-4fcb-915b-5a44049d80e1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:54.623622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-09cb4a0e-bca7-4fcb-915b-5a44049d80e1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:54.628848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-09cb4a0e-bca7-4fcb-915b-5a44049d80e1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:54.632727 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-09cb4a0e-bca7-4fcb-915b-5a44049d80e1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.648441 Jul 20 04:15:54.652073 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1018/2117] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:54.660511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-afb36960-170c-4db0-a07d-7aeffe41262a tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:54.675404 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-afb36960-170c-4db0-a07d-7aeffe41262a tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021470 Jul 20 04:15:54.685741 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1019/2118] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:15:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:54.692334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8527321e-83f9-4a6e-9326-060158d8931d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:54.693248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8527321e-83f9-4a6e-9326-060158d8931d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:54.703564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8527321e-83f9-4a6e-9326-060158d8931d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.704322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8527321e-83f9-4a6e-9326-060158d8931d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.706632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8527321e-83f9-4a6e-9326-060158d8931d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.708714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8527321e-83f9-4a6e-9326-060158d8931d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.154170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8527321e-83f9-4a6e-9326-060158d8931d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.173012 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8527321e-83f9-4a6e-9326-060158d8931d tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.484420 Jul 20 04:15:55.186738 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1020/2119] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:54 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:55.198649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ea0efb27-5484-43ba-bee7-12a370fc6c84 req-190db409-0577-4c85-9e30-67781c0fa01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358c5f50-cf9e-4577-a295-0aa87e318810", "name": "network-vif-unplugged", "status": "completed", "tag": "2cc5c8d5-88eb-4ddb-b127-216dd5aef81c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:55.209645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ea0efb27-5484-43ba-bee7-12a370fc6c84 req-190db409-0577-4c85-9e30-67781c0fa01c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.210185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ea0efb27-5484-43ba-bee7-12a370fc6c84 req-190db409-0577-4c85-9e30-67781c0fa01c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.238036 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ea0efb27-5484-43ba-bee7-12a370fc6c84 req-190db409-0577-4c85-9e30-67781c0fa01c service nova] Creating event network-vif-unplugged:2cc5c8d5-88eb-4ddb-b127-216dd5aef81c for instance 358c5f50-cf9e-4577-a295-0aa87e318810 on n-h2-760456-11 Jul 20 04:15:55.246752 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ea0efb27-5484-43ba-bee7-12a370fc6c84 req-190db409-0577-4c85-9e30-67781c0fa01c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058125 Jul 20 04:15:55.248590 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1021/2120] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:55.255654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-950d4487-0ceb-4e04-8b05-aa942da1fd92 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.256280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-950d4487-0ceb-4e04-8b05-aa942da1fd92 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.271412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-950d4487-0ceb-4e04-8b05-aa942da1fd92 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.272124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-950d4487-0ceb-4e04-8b05-aa942da1fd92 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.274056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-950d4487-0ceb-4e04-8b05-aa942da1fd92 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.275239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-950d4487-0ceb-4e04-8b05-aa942da1fd92 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.352746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-950d4487-0ceb-4e04-8b05-aa942da1fd92 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:55.545967 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-950d4487-0ceb-4e04-8b05-aa942da1fd92 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 204 len: 0 microversion: 2.1 time: 0.295919 Jul 20 04:15:55.546644 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1022/2121] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:55 2022] DELETE /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:55.555813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4168d658-dc21-4b77-9a9d-57ec6fad5468 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.556710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4168d658-dc21-4b77-9a9d-57ec6fad5468 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.564541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4168d658-dc21-4b77-9a9d-57ec6fad5468 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.565556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4168d658-dc21-4b77-9a9d-57ec6fad5468 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.566392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4168d658-dc21-4b77-9a9d-57ec6fad5468 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.566865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4168d658-dc21-4b77-9a9d-57ec6fad5468 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.573921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:55.926034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4168d658-dc21-4b77-9a9d-57ec6fad5468 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.940445 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4168d658-dc21-4b77-9a9d-57ec6fad5468 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1699 microversion: 2.1 time: 0.389383 Jul 20 04:15:55.946133 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1023/2122] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1699 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:55.965117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c7c339f8-52f1-4757-a8d5-f31ef17a0b01 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.966648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c7c339f8-52f1-4757-a8d5-f31ef17a0b01 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.982684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7c339f8-52f1-4757-a8d5-f31ef17a0b01 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.997157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7c339f8-52f1-4757-a8d5-f31ef17a0b01 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.998509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7c339f8-52f1-4757-a8d5-f31ef17a0b01 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.000515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7c339f8-52f1-4757-a8d5-f31ef17a0b01 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.327997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c7c339f8-52f1-4757-a8d5-f31ef17a0b01 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:56.342890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c7c339f8-52f1-4757-a8d5-f31ef17a0b01 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:56.344958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c7c339f8-52f1-4757-a8d5-f31ef17a0b01 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:56.346401 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c7c339f8-52f1-4757-a8d5-f31ef17a0b01 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.398073 Jul 20 04:15:56.347103 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1024/2123] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:56.367786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-9a29d6aa-0774-4bac-87d2-fb36a44b208e req-e1db06f9-cb44-4391-9c95-b606f0032ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2ae540-9679-4d32-a12c-4ac56e81f928", "tag": "7dadbe99-6cc6-433e-ada6-72d466f63f3c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:56.378915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9a29d6aa-0774-4bac-87d2-fb36a44b208e req-e1db06f9-cb44-4391-9c95-b606f0032ac8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.379623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9a29d6aa-0774-4bac-87d2-fb36a44b208e req-e1db06f9-cb44-4391-9c95-b606f0032ac8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.395763 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-9a29d6aa-0774-4bac-87d2-fb36a44b208e req-e1db06f9-cb44-4391-9c95-b606f0032ac8 service nova] Creating event network-changed:7dadbe99-6cc6-433e-ada6-72d466f63f3c for instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 on n-h1-760456-11 Jul 20 04:15:56.402599 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-9a29d6aa-0774-4bac-87d2-fb36a44b208e req-e1db06f9-cb44-4391-9c95-b606f0032ac8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042911 Jul 20 04:15:56.403541 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1025/2124] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:56.429724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9acff216-45cc-4d1f-971c-770c6b06ef0a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.429724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9acff216-45cc-4d1f-971c-770c6b06ef0a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:56.450924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9acff216-45cc-4d1f-971c-770c6b06ef0a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.451291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9acff216-45cc-4d1f-971c-770c6b06ef0a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.452086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9acff216-45cc-4d1f-971c-770c6b06ef0a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.452526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9acff216-45cc-4d1f-971c-770c6b06ef0a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.653853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9acff216-45cc-4d1f-971c-770c6b06ef0a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:56.672584 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9acff216-45cc-4d1f-971c-770c6b06ef0a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.266095 Jul 20 04:15:56.674805 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1026/2125] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:56 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:56.963137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58c25547-6c29-4b0f-a6a2-a7d3803bcc75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.963885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-58c25547-6c29-4b0f-a6a2-a7d3803bcc75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:56.973628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58c25547-6c29-4b0f-a6a2-a7d3803bcc75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.975467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58c25547-6c29-4b0f-a6a2-a7d3803bcc75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.976898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58c25547-6c29-4b0f-a6a2-a7d3803bcc75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.978891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58c25547-6c29-4b0f-a6a2-a7d3803bcc75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.188555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-58c25547-6c29-4b0f-a6a2-a7d3803bcc75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.210438 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-58c25547-6c29-4b0f-a6a2-a7d3803bcc75 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1699 microversion: 2.1 time: 0.250625 Jul 20 04:15:57.211965 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1027/2126] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:56 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1699 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:57.271421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5d007a9b-06ee-4f70-a161-76963ffd4fed req-d729c37d-c7fb-42d2-80a0-2f24fbbecceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358c5f50-cf9e-4577-a295-0aa87e318810", "tag": "2cc5c8d5-88eb-4ddb-b127-216dd5aef81c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:57.284717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5d007a9b-06ee-4f70-a161-76963ffd4fed req-d729c37d-c7fb-42d2-80a0-2f24fbbecceb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.284717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5d007a9b-06ee-4f70-a161-76963ffd4fed req-d729c37d-c7fb-42d2-80a0-2f24fbbecceb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.309336 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5d007a9b-06ee-4f70-a161-76963ffd4fed req-d729c37d-c7fb-42d2-80a0-2f24fbbecceb service nova] Creating event network-changed:2cc5c8d5-88eb-4ddb-b127-216dd5aef81c for instance 358c5f50-cf9e-4577-a295-0aa87e318810 on n-h2-760456-11 Jul 20 04:15:57.315796 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5d007a9b-06ee-4f70-a161-76963ffd4fed req-d729c37d-c7fb-42d2-80a0-2f24fbbecceb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047800 Jul 20 04:15:57.317114 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1028/2127] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:57.371756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-24f4666b-fec5-4669-b7eb-c31390686348 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:57.373061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-24f4666b-fec5-4669-b7eb-c31390686348 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:57.382810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24f4666b-fec5-4669-b7eb-c31390686348 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.383268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24f4666b-fec5-4669-b7eb-c31390686348 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.384590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24f4666b-fec5-4669-b7eb-c31390686348 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.385076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24f4666b-fec5-4669-b7eb-c31390686348 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.551913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24f4666b-fec5-4669-b7eb-c31390686348 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.561712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24f4666b-fec5-4669-b7eb-c31390686348 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.563498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24f4666b-fec5-4669-b7eb-c31390686348 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.564793 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-24f4666b-fec5-4669-b7eb-c31390686348 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.202665 Jul 20 04:15:57.575960 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1029/2128] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:57 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:15:57.692580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-055d389b-fce6-45ec-b142-ce548eb1a2c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:57.693205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-055d389b-fce6-45ec-b142-ce548eb1a2c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:57.707755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-055d389b-fce6-45ec-b142-ce548eb1a2c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.708345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-055d389b-fce6-45ec-b142-ce548eb1a2c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.709267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-055d389b-fce6-45ec-b142-ce548eb1a2c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.709819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-055d389b-fce6-45ec-b142-ce548eb1a2c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.980109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-055d389b-fce6-45ec-b142-ce548eb1a2c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.989641 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-055d389b-fce6-45ec-b142-ce548eb1a2c5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.301335 Jul 20 04:15:58.002828 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1030/2129] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:57 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:58.232192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3701d87-732b-47a8-8376-f22bae964dd6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:58.233010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3701d87-732b-47a8-8376-f22bae964dd6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:58.242884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3701d87-732b-47a8-8376-f22bae964dd6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.244831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3701d87-732b-47a8-8376-f22bae964dd6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.246269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3701d87-732b-47a8-8376-f22bae964dd6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.246838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3701d87-732b-47a8-8376-f22bae964dd6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.553278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3701d87-732b-47a8-8376-f22bae964dd6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:58.563428 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3701d87-732b-47a8-8376-f22bae964dd6 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1699 microversion: 2.1 time: 0.338083 Jul 20 04:15:58.569555 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1031/2130] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:58 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1699 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:58.588024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8909f6b3-88cc-4b34-9a89-ecd7c0def4e6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:58.590109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8909f6b3-88cc-4b34-9a89-ecd7c0def4e6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:58.612004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8909f6b3-88cc-4b34-9a89-ecd7c0def4e6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.612457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8909f6b3-88cc-4b34-9a89-ecd7c0def4e6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.614512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8909f6b3-88cc-4b34-9a89-ecd7c0def4e6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.615016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8909f6b3-88cc-4b34-9a89-ecd7c0def4e6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.712697 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e635a51-7b34-4566-adf8-b41d8a77d9a7 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.041957 Jul 20 04:15:58.716776 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1100/2131] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:15:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:58.729071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Action: 'action', calling method: .version_select at 0x7fb848fae940>, body: {"addFloatingIp": {"address": "172.25.3.185"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:58.730694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:58.748265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.749567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.750879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.751565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.825628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8909f6b3-88cc-4b34-9a89-ecd7c0def4e6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:58.859336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8909f6b3-88cc-4b34-9a89-ecd7c0def4e6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:58.861069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8909f6b3-88cc-4b34-9a89-ecd7c0def4e6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:58.862442 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8909f6b3-88cc-4b34-9a89-ecd7c0def4e6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.282269 Jul 20 04:15:58.865035 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1032/2132] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:58 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:58.889643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Acquired lock "refresh_cache-24022d95-b1d8-4c2b-bf1c-8cf54046226a" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:15:59.007976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-08a8c857-dc3d-411f-a9bf-c723a972488c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:59.009137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-08a8c857-dc3d-411f-a9bf-c723a972488c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:59.011300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:59.022165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08a8c857-dc3d-411f-a9bf-c723a972488c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.022652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08a8c857-dc3d-411f-a9bf-c723a972488c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.023452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08a8c857-dc3d-411f-a9bf-c723a972488c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.023926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08a8c857-dc3d-411f-a9bf-c723a972488c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.281850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-08a8c857-dc3d-411f-a9bf-c723a972488c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:59.292683 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-08a8c857-dc3d-411f-a9bf-c723a972488c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.289083 Jul 20 04:15:59.299158 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1033/2133] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:59 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:59.584476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d75e034-4d78-4b66-9fff-7fe221ab874b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:59.585161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9d75e034-4d78-4b66-9fff-7fe221ab874b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:59.592096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d75e034-4d78-4b66-9fff-7fe221ab874b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.592522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d75e034-4d78-4b66-9fff-7fe221ab874b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.593305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d75e034-4d78-4b66-9fff-7fe221ab874b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.593739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d75e034-4d78-4b66-9fff-7fe221ab874b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.776515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9d75e034-4d78-4b66-9fff-7fe221ab874b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:59.788315 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9d75e034-4d78-4b66-9fff-7fe221ab874b tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1699 microversion: 2.1 time: 0.208567 Jul 20 04:15:59.789442 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1034/2134] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:59 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1699 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:59.885786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7cb7d601-5767-4f40-bcca-f2ba68186fb3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:59.886713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7cb7d601-5767-4f40-bcca-f2ba68186fb3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:59.894773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7cb7d601-5767-4f40-bcca-f2ba68186fb3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.895627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7cb7d601-5767-4f40-bcca-f2ba68186fb3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.896707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7cb7d601-5767-4f40-bcca-f2ba68186fb3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.897330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7cb7d601-5767-4f40-bcca-f2ba68186fb3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.080401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7cb7d601-5767-4f40-bcca-f2ba68186fb3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:00.097366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7cb7d601-5767-4f40-bcca-f2ba68186fb3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:00.100278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7cb7d601-5767-4f40-bcca-f2ba68186fb3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:00.104539 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7cb7d601-5767-4f40-bcca-f2ba68186fb3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.221772 Jul 20 04:16:00.119013 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1035/2135] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:15:59 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:00.312143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8216661c-2b63-4298-b9dc-e8f5db729b21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.312858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8216661c-2b63-4298-b9dc-e8f5db729b21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.324365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8216661c-2b63-4298-b9dc-e8f5db729b21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.325200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8216661c-2b63-4298-b9dc-e8f5db729b21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.325616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8216661c-2b63-4298-b9dc-e8f5db729b21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.326052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8216661c-2b63-4298-b9dc-e8f5db729b21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.496642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8216661c-2b63-4298-b9dc-e8f5db729b21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:00.507185 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8216661c-2b63-4298-b9dc-e8f5db729b21 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.201096 Jul 20 04:16:00.508353 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1036/2136] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:00 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:00.639157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-94b332bf-444b-46c3-90f6-61870968097f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.639871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-94b332bf-444b-46c3-90f6-61870968097f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.649282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94b332bf-444b-46c3-90f6-61870968097f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.655882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94b332bf-444b-46c3-90f6-61870968097f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.656976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94b332bf-444b-46c3-90f6-61870968097f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.657437 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94b332bf-444b-46c3-90f6-61870968097f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.712827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-94b332bf-444b-46c3-90f6-61870968097f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:00.851977 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-94b332bf-444b-46c3-90f6-61870968097f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 204 len: 0 microversion: 2.1 time: 0.216819 Jul 20 04:16:00.854024 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1037/2137] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:00 2022] DELETE /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:16:00.863710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-91d4dfc5-24e4-4e88-b12c-7745072ee2f7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.864498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-91d4dfc5-24e4-4e88-b12c-7745072ee2f7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.873949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91d4dfc5-24e4-4e88-b12c-7745072ee2f7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.876131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91d4dfc5-24e4-4e88-b12c-7745072ee2f7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.877497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91d4dfc5-24e4-4e88-b12c-7745072ee2f7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.880993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91d4dfc5-24e4-4e88-b12c-7745072ee2f7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.998357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-91d4dfc5-24e4-4e88-b12c-7745072ee2f7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.007158 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-91d4dfc5-24e4-4e88-b12c-7745072ee2f7 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1631 microversion: 2.1 time: 0.151299 Jul 20 04:16:01.007913 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1038/2138] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:00 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1631 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:01.013385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e35e21d8-1958-41ca-9ca3-02f2354e6c64 req-e69aa589-9b24-4589-a051-fa15073203fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2ae540-9679-4d32-a12c-4ac56e81f928", "name": "network-vif-unplugged", "status": "completed", "tag": "7dadbe99-6cc6-433e-ada6-72d466f63f3c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:01.022708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e35e21d8-1958-41ca-9ca3-02f2354e6c64 req-e69aa589-9b24-4589-a051-fa15073203fc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.023330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e35e21d8-1958-41ca-9ca3-02f2354e6c64 req-e69aa589-9b24-4589-a051-fa15073203fc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.036113 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e35e21d8-1958-41ca-9ca3-02f2354e6c64 req-e69aa589-9b24-4589-a051-fa15073203fc service nova] Creating event network-vif-unplugged:7dadbe99-6cc6-433e-ada6-72d466f63f3c for instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 on n-h1-760456-11 Jul 20 04:16:01.042275 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e35e21d8-1958-41ca-9ca3-02f2354e6c64 req-e69aa589-9b24-4589-a051-fa15073203fc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032580 Jul 20 04:16:01.043093 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1039/2139] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:01.048898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aff9f448-43f9-455e-b5d0-9aa0e384b275 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.049610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aff9f448-43f9-455e-b5d0-9aa0e384b275 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:01.057847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aff9f448-43f9-455e-b5d0-9aa0e384b275 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.058386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aff9f448-43f9-455e-b5d0-9aa0e384b275 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.059211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aff9f448-43f9-455e-b5d0-9aa0e384b275 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.059654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aff9f448-43f9-455e-b5d0-9aa0e384b275 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.064517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:01.229998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aff9f448-43f9-455e-b5d0-9aa0e384b275 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.238975 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aff9f448-43f9-455e-b5d0-9aa0e384b275 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1553 microversion: 2.1 time: 0.194770 Jul 20 04:16:01.239575 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1040/2140] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:01.245290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d5aeba43-4965-4baf-804d-3c56eda2a154 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.246017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d5aeba43-4965-4baf-804d-3c56eda2a154 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:01.252439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5aeba43-4965-4baf-804d-3c56eda2a154 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.252894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5aeba43-4965-4baf-804d-3c56eda2a154 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.253677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5aeba43-4965-4baf-804d-3c56eda2a154 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.254514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5aeba43-4965-4baf-804d-3c56eda2a154 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.421606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d5aeba43-4965-4baf-804d-3c56eda2a154 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.437710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d5aeba43-4965-4baf-804d-3c56eda2a154 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.440086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d5aeba43-4965-4baf-804d-3c56eda2a154 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.441001 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d5aeba43-4965-4baf-804d-3c56eda2a154 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.200495 Jul 20 04:16:01.445905 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1041/2141] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:01.525472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-441abcbc-1879-4e68-8832-79596584b4d7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.526289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-441abcbc-1879-4e68-8832-79596584b4d7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:01.532493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-441abcbc-1879-4e68-8832-79596584b4d7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.532946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-441abcbc-1879-4e68-8832-79596584b4d7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.533850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-441abcbc-1879-4e68-8832-79596584b4d7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.534323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-441abcbc-1879-4e68-8832-79596584b4d7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.671038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-441abcbc-1879-4e68-8832-79596584b4d7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.685873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-441abcbc-1879-4e68-8832-79596584b4d7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.164603 Jul 20 04:16:01.687706 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1042/2142] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:01.773757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4075297e-a47f-430c-8a79-c87437647bde req-aaf0ef67-d972-40db-b94c-b57cdfe98734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93a774b-f6ab-4eb7-a406-57d1ef3f6168", "name": "network-vif-deleted", "tag": "f1355d83-3e28-49e8-a05a-c36da373924a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:01.789745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4075297e-a47f-430c-8a79-c87437647bde req-aaf0ef67-d972-40db-b94c-b57cdfe98734 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.791151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4075297e-a47f-430c-8a79-c87437647bde req-aaf0ef67-d972-40db-b94c-b57cdfe98734 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.815616 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4075297e-a47f-430c-8a79-c87437647bde req-aaf0ef67-d972-40db-b94c-b57cdfe98734 service nova] Creating event network-vif-deleted:f1355d83-3e28-49e8-a05a-c36da373924a for instance d93a774b-f6ab-4eb7-a406-57d1ef3f6168 on n-h1-760456-11 Jul 20 04:16:01.821390 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4075297e-a47f-430c-8a79-c87437647bde req-aaf0ef67-d972-40db-b94c-b57cdfe98734 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054907 Jul 20 04:16:01.822337 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1043/2143] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:16:02.027111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:02.028427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.045196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.045891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.050799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.052874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.166873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.167485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.169085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lazy-loading 'fault' on Instance uuid d93a774b-f6ab-4eb7-a406-57d1ef3f6168 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:02.233997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f066ff310d64feea8e45f1b7e401da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bbe7152cf74f0f8d207134071a4be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:02.247813 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fb0f0096-f627-499a-bede-a06d86c29e7e tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 200 len: 1359 microversion: 2.1 time: 0.226620 Jul 20 04:16:02.248468 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1044/2144] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:02 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:02.256883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3b279a7-dea9-44f5-b1ab-275151ef697c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:02.257500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f3b279a7-dea9-44f5-b1ab-275151ef697c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.275661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3b279a7-dea9-44f5-b1ab-275151ef697c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.277939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3b279a7-dea9-44f5-b1ab-275151ef697c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.280398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3b279a7-dea9-44f5-b1ab-275151ef697c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.284937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3b279a7-dea9-44f5-b1ab-275151ef697c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.621161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f3b279a7-dea9-44f5-b1ab-275151ef697c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:02.635500 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f3b279a7-dea9-44f5-b1ab-275151ef697c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1553 microversion: 2.1 time: 0.382501 Jul 20 04:16:02.646136 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1045/2145] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:02 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1553 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:02.649158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-380f0dc4-2e9e-458e-bef2-45a485871453 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:02.649158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-380f0dc4-2e9e-458e-bef2-45a485871453 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.667849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-380f0dc4-2e9e-458e-bef2-45a485871453 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.668312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-380f0dc4-2e9e-458e-bef2-45a485871453 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.669112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-380f0dc4-2e9e-458e-bef2-45a485871453 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.669554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-380f0dc4-2e9e-458e-bef2-45a485871453 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.037514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Building network info cache for instance {{(pid=119606) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:16:03.285237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:03.395676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-380f0dc4-2e9e-458e-bef2-45a485871453 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.411849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-380f0dc4-2e9e-458e-bef2-45a485871453 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.413421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-380f0dc4-2e9e-458e-bef2-45a485871453 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.414653 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-380f0dc4-2e9e-458e-bef2-45a485871453 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.774973 Jul 20 04:16:03.415365 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1046/2146] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:02 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:03.428025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4948e50-357a-4d45-94fa-ac9206387eda tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.428579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b4948e50-357a-4d45-94fa-ac9206387eda tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:03.442873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:03.458640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4948e50-357a-4d45-94fa-ac9206387eda tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.458829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4948e50-357a-4d45-94fa-ac9206387eda tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.459609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4948e50-357a-4d45-94fa-ac9206387eda tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.460049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4948e50-357a-4d45-94fa-ac9206387eda tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.947050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Updating instance_info_cache with network_info: [{"id": "427eb412-170d-4821-a11a-5c006106639c", "address": "fa:16:3e:1a:ff:9e", "network": {"id": "1a43fe56-8d80-4b5b-b8b5-acda422e3506", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1302811176-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4466f0a240f74efbad843243399adb84", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap427eb412-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119606) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:16:03.980889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Releasing lock "refresh_cache-24022d95-b1d8-4c2b-bf1c-8cf54046226a" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:16:03.982139 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0126346-be2c-4139-91b2-87c37fe82fa4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action" status: 202 len: 0 microversion: 2.1 time: 5.258556 Jul 20 04:16:03.983101 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1101/2147] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:15:58 2022] POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action => generated 0 bytes in 5260 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 20 04:16:03.989163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d405cedf-c49b-4c3d-b8d6-36d1e0d797f3 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.991563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d405cedf-c49b-4c3d-b8d6-36d1e0d797f3 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [instance: d93a774b-f6ab-4eb7-a406-57d1ef3f6168] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:04.007961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d405cedf-c49b-4c3d-b8d6-36d1e0d797f3 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.008486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d405cedf-c49b-4c3d-b8d6-36d1e0d797f3 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.013221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d405cedf-c49b-4c3d-b8d6-36d1e0d797f3 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.013790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d405cedf-c49b-4c3d-b8d6-36d1e0d797f3 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.050463 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d405cedf-c49b-4c3d-b8d6-36d1e0d797f3 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] HTTP exception thrown: Instance d93a774b-f6ab-4eb7-a406-57d1ef3f6168 could not be found. Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d405cedf-c49b-4c3d-b8d6-36d1e0d797f3 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Request method failure captured: Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 HTTP/1.1 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14E3i9z0T7-IDqDo7tMJDOORpACRtwbgg77vRdZBcTsTuM-yR0-djgJVVKAwj34OBMlv4YDRYc90lUCsmbmzwBQf7N4eqqHNuVimcd5fCnAC_AinhmL-RgvpwNFstg6jIWpK_Tguny2gSrK3cyi1vUC7kiaiEVrNNFFKFFfb96iajX0 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d5bbe7152cf74f0f8d207134071a4be5 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestJSON-1386170921 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d5bbe7152cf74f0f8d207134071a4be5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5bbe7152cf74f0f8d207134071a4be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5bbe7152cf74f0f8d207134071a4be5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d5bbe7152cf74f0f8d207134071a4be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestJSON-1386170921 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d5bbe7152cf74f0f8d207134071a4be5 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestJSON-1386170921 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestJSON-1386170921-project Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 0f066ff310d64feea8e45f1b7e401da7 Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestJSON-1386170921-project Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance d93a774b-f6ab-4eb7-a406-57d1ef3f6168 could not be found. Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'd93a774b-f6ab-4eb7-a406-57d1ef3f6168'} Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93a774b-f6ab-4eb7-a406-57d1ef3f6168 could not be found. Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93a774b-f6ab-4eb7-a406-57d1ef3f6168 could not be found. Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:04.052172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:04.055933 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:04.055933 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:04.055933 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:04.055933 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:04.055933 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93a774b-f6ab-4eb7-a406-57d1ef3f6168 could not be found. Jul 20 04:16:04.055933 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:04.057532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d405cedf-c49b-4c3d-b8d6-36d1e0d797f3 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Returning 404 to user: Instance d93a774b-f6ab-4eb7-a406-57d1ef3f6168 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:04.059125 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d405cedf-c49b-4c3d-b8d6-36d1e0d797f3 tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168" status: 404 len: 111 microversion: 2.1 time: 0.074260 Jul 20 04:16:04.060227 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1102/2148] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/servers/d93a774b-f6ab-4eb7-a406-57d1ef3f6168 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:04.065753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2bbe5946-a553-41b2-aa80-b8e02a830887 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:04.066657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2bbe5946-a553-41b2-aa80-b8e02a830887 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:04.075019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bbe5946-a553-41b2-aa80-b8e02a830887 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.075807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bbe5946-a553-41b2-aa80-b8e02a830887 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.076747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bbe5946-a553-41b2-aa80-b8e02a830887 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.077473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bbe5946-a553-41b2-aa80-b8e02a830887 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.371193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2bbe5946-a553-41b2-aa80-b8e02a830887 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:04.386586 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2bbe5946-a553-41b2-aa80-b8e02a830887 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1553 microversion: 2.1 time: 0.324708 Jul 20 04:16:04.389370 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1103/2149] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:04 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:04.413316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f2539375-1e04-4889-beeb-f693d6a8c9c0 req-40f8ed35-7e04-472a-8c41-d3d9e2c34a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24022d95-b1d8-4c2b-bf1c-8cf54046226a", "tag": "427eb412-170d-4821-a11a-5c006106639c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:04.424421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f2539375-1e04-4889-beeb-f693d6a8c9c0 req-40f8ed35-7e04-472a-8c41-d3d9e2c34a5b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.425232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f2539375-1e04-4889-beeb-f693d6a8c9c0 req-40f8ed35-7e04-472a-8c41-d3d9e2c34a5b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.449098 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f2539375-1e04-4889-beeb-f693d6a8c9c0 req-40f8ed35-7e04-472a-8c41-d3d9e2c34a5b service nova] Creating event network-changed:427eb412-170d-4821-a11a-5c006106639c for instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a on n-h2-760456-11 Jul 20 04:16:04.454933 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f2539375-1e04-4889-beeb-f693d6a8c9c0 req-40f8ed35-7e04-472a-8c41-d3d9e2c34a5b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049304 Jul 20 04:16:04.455898 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1104/2150] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:04.464246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6c4d4736-e6f6-455e-bca4-ef0538f5ffc6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Action: 'create', calling method: .version_select at 0x7fb842f5ef70>, body: {"pool": "b1f89390-4f46-4a2a-8cc8-f5bf1d50534f"} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:04.533424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b4948e50-357a-4d45-94fa-ac9206387eda tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:04.549853 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b4948e50-357a-4d45-94fa-ac9206387eda tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 1.133287 Jul 20 04:16:04.551321 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1047/2151] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:04.567314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aadfba26-1bf4-43d7-84a1-06f34821abfe tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] Calling method '.version_select at 0x7fb841cb3310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:04.577906 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aadfba26-1bf4-43d7-84a1-06f34821abfe tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [820cd5ce-cd9a-49b5-a0da-8c9c48ee2ab7] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 04:16:05.593130 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [None req-aadfba26-1bf4-43d7-84a1-06f34821abfe tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] [820cd5ce-cd9a-49b5-a0da-8c9c48ee2ab7] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50668. Jul 20 04:16:05.632208 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aadfba26-1bf4-43d7-84a1-06f34821abfe tempest-ServersTestJSON-1386170921 tempest-ServersTestJSON-1386170921-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321823951" status: 202 len: 0 microversion: 2.1 time: 1.076695 Jul 20 04:16:05.636090 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1048/2152] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:16:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321823951 => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:05.647967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e8319d75-9a9c-456d-97cb-5dbdf2b7b819 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:05.652038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e8319d75-9a9c-456d-97cb-5dbdf2b7b819 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:05.670517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8319d75-9a9c-456d-97cb-5dbdf2b7b819 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.674760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8319d75-9a9c-456d-97cb-5dbdf2b7b819 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.675792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8319d75-9a9c-456d-97cb-5dbdf2b7b819 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.676245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8319d75-9a9c-456d-97cb-5dbdf2b7b819 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.545020 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6c4d4736-e6f6-455e-bca4-ef0538f5ffc6 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.087384 Jul 20 04:16:06.545680 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1105/2153] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:16:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:06.551067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ac8db3b-ddd8-4725-b51d-dd1ed7ae671a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:06.552021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ac8db3b-ddd8-4725-b51d-dd1ed7ae671a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.579586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ac8db3b-ddd8-4725-b51d-dd1ed7ae671a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.580129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ac8db3b-ddd8-4725-b51d-dd1ed7ae671a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.583192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ac8db3b-ddd8-4725-b51d-dd1ed7ae671a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.584726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ac8db3b-ddd8-4725-b51d-dd1ed7ae671a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.736420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ac8db3b-ddd8-4725-b51d-dd1ed7ae671a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.749879 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ac8db3b-ddd8-4725-b51d-dd1ed7ae671a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1345 microversion: 2.1 time: 0.201693 Jul 20 04:16:06.751149 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1106/2154] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:06 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1345 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:06.756484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e8319d75-9a9c-456d-97cb-5dbdf2b7b819 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.757263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8e2e4d3b-3f31-4c86-b907-d6397fb44b49 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:06.758127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8e2e4d3b-3f31-4c86-b907-d6397fb44b49 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.769609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e2e4d3b-3f31-4c86-b907-d6397fb44b49 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.770611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e2e4d3b-3f31-4c86-b907-d6397fb44b49 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.770802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e8319d75-9a9c-456d-97cb-5dbdf2b7b819 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.772975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e2e4d3b-3f31-4c86-b907-d6397fb44b49 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.773939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e2e4d3b-3f31-4c86-b907-d6397fb44b49 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.777317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e8319d75-9a9c-456d-97cb-5dbdf2b7b819 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.778604 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e8319d75-9a9c-456d-97cb-5dbdf2b7b819 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 1.140048 Jul 20 04:16:06.779193 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1049/2155] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:05 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:06.793864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f9415c83-4990-4f5a-8b38-06f5567802c0 req-7fc860ed-837c-4963-abea-446e13773115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ca8a00-3d0f-485c-a7ce-9028d31e7035", "name": "network-vif-deleted", "tag": "d2215e8e-977d-4a09-aac2-debfdafc6d86"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:06.810770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f9415c83-4990-4f5a-8b38-06f5567802c0 req-7fc860ed-837c-4963-abea-446e13773115 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.811228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f9415c83-4990-4f5a-8b38-06f5567802c0 req-7fc860ed-837c-4963-abea-446e13773115 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.834853 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f9415c83-4990-4f5a-8b38-06f5567802c0 req-7fc860ed-837c-4963-abea-446e13773115 service nova] Creating event network-vif-deleted:d2215e8e-977d-4a09-aac2-debfdafc6d86 for instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 on n-h2-760456-11 Jul 20 04:16:06.852136 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f9415c83-4990-4f5a-8b38-06f5567802c0 req-7fc860ed-837c-4963-abea-446e13773115 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071678 Jul 20 04:16:06.858237 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1050/2156] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:06.869954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Action: 'action', calling method: .version_select at 0x7fb848fae940>, body: {"addFloatingIp": {"address": "172.25.3.17"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:06.871222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.893126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.893585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.894414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.894987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.959377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8e2e4d3b-3f31-4c86-b907-d6397fb44b49 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.969227 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8e2e4d3b-3f31-4c86-b907-d6397fb44b49 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1392 microversion: 2.1 time: 0.216923 Jul 20 04:16:06.970049 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1107/2157] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:06 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1392 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:07.004888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Acquired lock "refresh_cache-24022d95-b1d8-4c2b-bf1c-8cf54046226a" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:16:07.771296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-55475923-1291-4412-919c-fd9f17d6581d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:07.772732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-55475923-1291-4412-919c-fd9f17d6581d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:07.792241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55475923-1291-4412-919c-fd9f17d6581d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:07.796903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55475923-1291-4412-919c-fd9f17d6581d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:07.798537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55475923-1291-4412-919c-fd9f17d6581d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:07.800889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55475923-1291-4412-919c-fd9f17d6581d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:07.944344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-55475923-1291-4412-919c-fd9f17d6581d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:07.962244 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-55475923-1291-4412-919c-fd9f17d6581d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1345 microversion: 2.1 time: 0.196163 Jul 20 04:16:07.963805 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1108/2158] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:07 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1345 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:07.979626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ba3c167b-1977-4539-ba5c-806ce60c98e4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:07.982751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ba3c167b-1977-4539-ba5c-806ce60c98e4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:08.001254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba3c167b-1977-4539-ba5c-806ce60c98e4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.003177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba3c167b-1977-4539-ba5c-806ce60c98e4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.005595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba3c167b-1977-4539-ba5c-806ce60c98e4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.006702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba3c167b-1977-4539-ba5c-806ce60c98e4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.827004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG neutronclient.v2_0.client [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.17 (3a6e5276-a4a3-4fed-af0b-8a35804f63be) with port 427eb412-170d-4821-a11a-5c006106639c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network b1f89390-4f46-4a2a-8cc8-f5bf1d50534f.", "detail": ""}} {{(pid=119605) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:16:08.828609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Releasing lock "refresh_cache-24022d95-b1d8-4c2b-bf1c-8cf54046226a" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:16:08.830191 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.17 (3a6e5276-a4a3-4fed-af0b-8a35804f63be) with port 427eb412-170d-4821-a11a-5c006106639c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network b1f89390-4f46-4a2a-8cc8-f5bf1d50534f. Jul 20 04:16:08.830191 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-513b728f-0bf2-4828-a89d-631c0f58ba5e'] Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Request method failure captured: Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action HTTP/1.1 Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 45 Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14FqK0QNqz1i1arwBnKb_YTxfd9Z1vkuzqWPwx7HT5GBT1P3ZfhOMe-Aa4dtoWeNNo8FduCe2BNDNsbTPm2mB8YmwhGHf-kzQPzex9gVFON00PvNelQ4Hn1U0g10kBYLE9FRhMisHNR6ZdfQ4rjlXPoFwKiKDMRX1VMiWOOOWljclns Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4466f0a240f74efbad843243399adb84 Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4466f0a240f74efbad843243399adb84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4466f0a240f74efbad843243399adb84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4466f0a240f74efbad843243399adb84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4466f0a240f74efbad843243399adb84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4466f0a240f74efbad843243399adb84 Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e31b85d83596495aa6e75967cf486dca Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: {"addFloatingIp": {"address": "172.25.3.17"}} Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: exception: Cannot associate floating IP 172.25.3.17 (3a6e5276-a4a3-4fed-af0b-8a35804f63be) with port 427eb412-170d-4821-a11a-5c006106639c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network b1f89390-4f46-4a2a-8cc8-f5bf1d50534f. Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-513b728f-0bf2-4828-a89d-631c0f58ba5e'] Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '24022d95-b1d8-4c2b-bf1c-8cf54046226a', 'body': {'addFloatingIp': {'address': '172.25.3.17'}}} Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:16:08.834184 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.17 (3a6e5276-a4a3-4fed-af0b-8a35804f63be) with port 427eb412-170d-4821-a11a-5c006106639c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network b1f89390-4f46-4a2a-8cc8-f5bf1d50534f. Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-513b728f-0bf2-4828-a89d-631c0f58ba5e'] Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.17 (3a6e5276-a4a3-4fed-af0b-8a35804f63be) with port 427eb412-170d-4821-a11a-5c006106639c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network b1f89390-4f46-4a2a-8cc8-f5bf1d50534f. Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-513b728f-0bf2-4828-a89d-631c0f58ba5e'] Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.17 (3a6e5276-a4a3-4fed-af0b-8a35804f63be) with port 427eb412-170d-4821-a11a-5c006106639c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network b1f89390-4f46-4a2a-8cc8-f5bf1d50534f. Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-513b728f-0bf2-4828-a89d-631c0f58ba5e'] Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.17 (3a6e5276-a4a3-4fed-af0b-8a35804f63be) with port 427eb412-170d-4821-a11a-5c006106639c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network b1f89390-4f46-4a2a-8cc8-f5bf1d50534f. Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-513b728f-0bf2-4828-a89d-631c0f58ba5e'] Jul 20 04:16:08.839083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:08.842161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Returning 400 to user: Cannot associate floating IP 172.25.3.17 (3a6e5276-a4a3-4fed-af0b-8a35804f63be) with port 427eb412-170d-4821-a11a-5c006106639c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network b1f89390-4f46-4a2a-8cc8-f5bf1d50534f. Jul 20 04:16:08.842161 n-d-760456-11 devstack@n-api.service[119605]: Neutron server returns request_ids: ['req-513b728f-0bf2-4828-a89d-631c0f58ba5e'] {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:08.842161 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0f061b76-f2be-4d95-ae3f-90031de72cf4 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action" status: 400 len: 381 microversion: 2.1 time: 1.977904 Jul 20 04:16:08.842161 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1051/2159] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:06 2022] POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action => generated 381 bytes in 1983 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:16:08.851676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba42dfdd-ea0b-4a3c-a410-e58aec7eb1ed tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:08.852375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ba42dfdd-ea0b-4a3c-a410-e58aec7eb1ed tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:08.872707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba42dfdd-ea0b-4a3c-a410-e58aec7eb1ed tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.873662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba42dfdd-ea0b-4a3c-a410-e58aec7eb1ed tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.873971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba42dfdd-ea0b-4a3c-a410-e58aec7eb1ed tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.874434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba42dfdd-ea0b-4a3c-a410-e58aec7eb1ed tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.100590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ba3c167b-1977-4539-ba5c-806ce60c98e4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:09.137418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ba3c167b-1977-4539-ba5c-806ce60c98e4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:09.139996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ba3c167b-1977-4539-ba5c-806ce60c98e4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:09.143449 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ba3c167b-1977-4539-ba5c-806ce60c98e4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 1.176984 Jul 20 04:16:09.155838 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1109/2160] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:07 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:09.162386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-14fce233-c0f2-4096-8114-bee2d300c3a7 req-06ccaa54-f2e2-4f14-b7b3-d76471acfea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358c5f50-cf9e-4577-a295-0aa87e318810", "name": "network-vif-unplugged", "status": "completed", "tag": "2cc5c8d5-88eb-4ddb-b127-216dd5aef81c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:09.172268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-14fce233-c0f2-4096-8114-bee2d300c3a7 req-06ccaa54-f2e2-4f14-b7b3-d76471acfea6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.172976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-14fce233-c0f2-4096-8114-bee2d300c3a7 req-06ccaa54-f2e2-4f14-b7b3-d76471acfea6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.191790 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-14fce233-c0f2-4096-8114-bee2d300c3a7 req-06ccaa54-f2e2-4f14-b7b3-d76471acfea6 service nova] Creating event network-vif-unplugged:2cc5c8d5-88eb-4ddb-b127-216dd5aef81c for instance 358c5f50-cf9e-4577-a295-0aa87e318810 on n-h2-760456-11 Jul 20 04:16:09.200806 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-14fce233-c0f2-4096-8114-bee2d300c3a7 req-06ccaa54-f2e2-4f14-b7b3-d76471acfea6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041592 Jul 20 04:16:09.201673 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1110/2161] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:09.208737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28af083b-0cab-4369-ae0d-07e135117f71 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '.version_select at 0x7fb841b23790>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.480753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ba42dfdd-ea0b-4a3c-a410-e58aec7eb1ed tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:09.499416 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ba42dfdd-ea0b-4a3c-a410-e58aec7eb1ed tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1382 microversion: 2.1 time: 0.654818 Jul 20 04:16:09.503230 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1052/2162] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:08 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1382 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:09.519777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a4eeae9-5831-4050-bcc7-a312787394e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.524320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2a4eeae9-5831-4050-bcc7-a312787394e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:09.538603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a4eeae9-5831-4050-bcc7-a312787394e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.541754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a4eeae9-5831-4050-bcc7-a312787394e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.543582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a4eeae9-5831-4050-bcc7-a312787394e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.544417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a4eeae9-5831-4050-bcc7-a312787394e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.737553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2a4eeae9-5831-4050-bcc7-a312787394e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:09.766472 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a4eeae9-5831-4050-bcc7-a312787394e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1345 microversion: 2.1 time: 0.260501 Jul 20 04:16:09.781385 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1053/2163] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:09 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1345 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:09.790838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-883aefe3-5306-4e7a-9093-2ae2e1bdaa71 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '.version_select at 0x7fb841c3d430>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.794635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-883aefe3-5306-4e7a-9093-2ae2e1bdaa71 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.795557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-883aefe3-5306-4e7a-9093-2ae2e1bdaa71 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.812816 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-883aefe3-5306-4e7a-9093-2ae2e1bdaa71 tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 2732 microversion: 2.1 time: 0.029439 Jul 20 04:16:09.815588 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1054/2164] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:16:09 2022] GET /compute/v2.1/os-migrations => generated 2732 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:09.828441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-81ad6a01-c12e-4140-beb8-ca4101559afe tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.829871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-81ad6a01-c12e-4140-beb8-ca4101559afe tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:09.839196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81ad6a01-c12e-4140-beb8-ca4101559afe tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.839972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81ad6a01-c12e-4140-beb8-ca4101559afe tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.841052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81ad6a01-c12e-4140-beb8-ca4101559afe tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.841831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81ad6a01-c12e-4140-beb8-ca4101559afe tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.234979 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-81ad6a01-c12e-4140-beb8-ca4101559afe tempest-LiveMigrationTest-1662829713 tempest-LiveMigrationTest-1662829713-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1535 microversion: 2.1 time: 0.410042 Jul 20 04:16:10.239864 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1055/2165] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:09 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1535 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:10.258319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9b2a696-1d35-43c4-9ccb-9a8509d5fbe9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:10.261685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c9b2a696-1d35-43c4-9ccb-9a8509d5fbe9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.282296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9b2a696-1d35-43c4-9ccb-9a8509d5fbe9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.283246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9b2a696-1d35-43c4-9ccb-9a8509d5fbe9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.284429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9b2a696-1d35-43c4-9ccb-9a8509d5fbe9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.285078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9b2a696-1d35-43c4-9ccb-9a8509d5fbe9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.868898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9b2a696-1d35-43c4-9ccb-9a8509d5fbe9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.887230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9b2a696-1d35-43c4-9ccb-9a8509d5fbe9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.892793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9b2a696-1d35-43c4-9ccb-9a8509d5fbe9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.896691 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c9b2a696-1d35-43c4-9ccb-9a8509d5fbe9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1813 microversion: 2.25 time: 0.651334 Jul 20 04:16:10.897807 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1056/2166] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:10 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1813 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:10.909785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b18d564-bf10-4aca-97ed-7d2164b799e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:10.912714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8b18d564-bf10-4aca-97ed-7d2164b799e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.926422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b18d564-bf10-4aca-97ed-7d2164b799e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.929212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b18d564-bf10-4aca-97ed-7d2164b799e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.930263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b18d564-bf10-4aca-97ed-7d2164b799e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.934718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b18d564-bf10-4aca-97ed-7d2164b799e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.993319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8b18d564-bf10-4aca-97ed-7d2164b799e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:11.048758 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-28af083b-0cab-4369-ae0d-07e135117f71 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/3a6e5276-a4a3-4fed-af0b-8a35804f63be" status: 202 len: 0 microversion: 2.1 time: 1.845607 Jul 20 04:16:11.050117 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1111/2167] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:16:09 2022] DELETE /compute/v2.1/os-floating-ips/3a6e5276-a4a3-4fed-af0b-8a35804f63be => generated 0 bytes in 1848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:11.056211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5900c6ed-82de-4d36-b823-bb73b89227d8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.057386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5900c6ed-82de-4d36-b823-bb73b89227d8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.074319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5900c6ed-82de-4d36-b823-bb73b89227d8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.076944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5900c6ed-82de-4d36-b823-bb73b89227d8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.080419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5900c6ed-82de-4d36-b823-bb73b89227d8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.081621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5900c6ed-82de-4d36-b823-bb73b89227d8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.212690 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8b18d564-bf10-4aca-97ed-7d2164b799e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 204 len: 0 microversion: 2.1 time: 0.312454 Jul 20 04:16:11.216629 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1057/2168] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:10 2022] DELETE /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:11.220912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Action: 'action', calling method: .version_select at 0x7fb848faee50>, body: {"removeFloatingIp": {"address": "172.25.3.185"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:11.276443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5900c6ed-82de-4d36-b823-bb73b89227d8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.294991 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5900c6ed-82de-4d36-b823-bb73b89227d8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1345 microversion: 2.1 time: 0.243000 Jul 20 04:16:11.297366 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1112/2169] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1345 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:11.304176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c6368fa0-0323-47c4-a6ca-ca411f7f62d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.308735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c6368fa0-0323-47c4-a6ca-ca411f7f62d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.318161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6368fa0-0323-47c4-a6ca-ca411f7f62d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.319186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6368fa0-0323-47c4-a6ca-ca411f7f62d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.320738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6368fa0-0323-47c4-a6ca-ca411f7f62d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.323259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6368fa0-0323-47c4-a6ca-ca411f7f62d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.465451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.473262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.473725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.475152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.475609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.480685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:11.945917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Acquired lock "refresh_cache-24022d95-b1d8-4c2b-bf1c-8cf54046226a" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:16:11.956873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6368fa0-0323-47c4-a6ca-ca411f7f62d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.979521 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c6368fa0-0323-47c4-a6ca-ca411f7f62d3 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1388 microversion: 2.1 time: 0.679990 Jul 20 04:16:11.980461 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1113/2170] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1388 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:12.205292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1196766169", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:12.288762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] validate_networks() for [('b41e485e-9677-46be-b79c-682925f67dfc', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:13.773204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Building network info cache for instance {{(pid=119605) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:16:14.313229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:14.315529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:14.316306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:14.316900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:14.317743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:14.320521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=68 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:14.334217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.346371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.347880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.348566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.403588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Getting quotas for project 228b024e44374bb3babb59c15bfb37a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:14.420985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Getting quotas for user 99fb64ce15c948f9b09b3d9ad2f50073 and project 228b024e44374bb3babb59c15bfb37a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:14.456778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:14.459448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:14.566029 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2a45a67d-7c8f-4a49-8f89-3299e3c8c740 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.574296 Jul 20 04:16:14.573081 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1114/2171] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:14.603657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1551917701", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ea7784d9-5894-4cfc-9bda-ecb4a2f737f2"}], "security_groups": [{"name": "tempest-securitygroup--1168309894"}], "key_name": "tempest-keypair-1573247158", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "1ab4af84-9602-4d02-97a3-7c8ecc9af16f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:15.579092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Updating instance_info_cache with network_info: [{"id": "427eb412-170d-4821-a11a-5c006106639c", "address": "fa:16:3e:1a:ff:9e", "network": {"id": "1a43fe56-8d80-4b5b-b8b5-acda422e3506", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1302811176-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4466f0a240f74efbad843243399adb84", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap427eb412-17", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119605) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:16:15.594394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Releasing lock "refresh_cache-24022d95-b1d8-4c2b-bf1c-8cf54046226a" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:16:15.595269 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8d7f1081-f925-4b25-9332-2eadbee1da22 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action" status: 202 len: 0 microversion: 2.1 time: 4.379959 Jul 20 04:16:15.595886 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1058/2172] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:11 2022] POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action => generated 0 bytes in 4381 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:16:15.605461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7a5bf0a-f442-47cf-ada0-5977a1793a3a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:15.606513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b7a5bf0a-f442-47cf-ada0-5977a1793a3a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:15.613750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7a5bf0a-f442-47cf-ada0-5977a1793a3a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.614460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7a5bf0a-f442-47cf-ada0-5977a1793a3a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.615461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7a5bf0a-f442-47cf-ada0-5977a1793a3a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.616095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7a5bf0a-f442-47cf-ada0-5977a1793a3a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.928972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b7a5bf0a-f442-47cf-ada0-5977a1793a3a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:15.939682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b7a5bf0a-f442-47cf-ada0-5977a1793a3a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:15.942348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b7a5bf0a-f442-47cf-ada0-5977a1793a3a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:15.944078 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b7a5bf0a-f442-47cf-ada0-5977a1793a3a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1803 microversion: 2.25 time: 0.343114 Jul 20 04:16:15.945287 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1059/2173] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:15 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1803 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:15.961599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ab5e2091-a302-43d2-a1a4-45d13b7c355e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:15.963093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ab5e2091-a302-43d2-a1a4-45d13b7c355e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:15.989427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5e2091-a302-43d2-a1a4-45d13b7c355e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.989902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5e2091-a302-43d2-a1a4-45d13b7c355e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.990861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5e2091-a302-43d2-a1a4-45d13b7c355e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.991317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5e2091-a302-43d2-a1a4-45d13b7c355e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.121213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ab5e2091-a302-43d2-a1a4-45d13b7c355e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:16.142415 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ab5e2091-a302-43d2-a1a4-45d13b7c355e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 200 len: 1345 microversion: 2.1 time: 0.195116 Jul 20 04:16:16.143017 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1060/2174] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:15 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 1345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:16.166478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-44d1300f-cce4-47b9-88f1-697109d02b69 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:16.173640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-44d1300f-cce4-47b9-88f1-697109d02b69 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:16.189281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44d1300f-cce4-47b9-88f1-697109d02b69 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.189940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44d1300f-cce4-47b9-88f1-697109d02b69 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.191731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44d1300f-cce4-47b9-88f1-697109d02b69 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.192814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44d1300f-cce4-47b9-88f1-697109d02b69 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.340983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-44d1300f-cce4-47b9-88f1-697109d02b69 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:16.351818 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-44d1300f-cce4-47b9-88f1-697109d02b69 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1184 microversion: 2.1 time: 0.190019 Jul 20 04:16:16.364181 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1061/2175] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:16 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1184 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:16.382285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-426e02ad-c5bc-4d79-a285-68c6cabf3154 req-c2233fd7-95b7-4abb-8b35-96eafc0be41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2ae540-9679-4d32-a12c-4ac56e81f928", "name": "network-vif-deleted", "tag": "7dadbe99-6cc6-433e-ada6-72d466f63f3c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:16.393985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-426e02ad-c5bc-4d79-a285-68c6cabf3154 req-c2233fd7-95b7-4abb-8b35-96eafc0be41f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.395275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-426e02ad-c5bc-4d79-a285-68c6cabf3154 req-c2233fd7-95b7-4abb-8b35-96eafc0be41f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.425539 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-426e02ad-c5bc-4d79-a285-68c6cabf3154 req-c2233fd7-95b7-4abb-8b35-96eafc0be41f service nova] Creating event network-vif-deleted:7dadbe99-6cc6-433e-ada6-72d466f63f3c for instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 on n-h2-760456-11 Jul 20 04:16:16.432020 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-426e02ad-c5bc-4d79-a285-68c6cabf3154 req-c2233fd7-95b7-4abb-8b35-96eafc0be41f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066354 Jul 20 04:16:16.434094 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1062/2176] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:16.440149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-726a4987-0681-44ec-8ee2-fd6a65556784 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:16.441066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-726a4987-0681-44ec-8ee2-fd6a65556784 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:16.469297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-726a4987-0681-44ec-8ee2-fd6a65556784 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.470026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-726a4987-0681-44ec-8ee2-fd6a65556784 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.471024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-726a4987-0681-44ec-8ee2-fd6a65556784 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.471642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-726a4987-0681-44ec-8ee2-fd6a65556784 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.476694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] validate_networks() for [('ea7784d9-5894-4cfc-9bda-ecb4a2f737f2', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:16.635503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-726a4987-0681-44ec-8ee2-fd6a65556784 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:16.646675 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-726a4987-0681-44ec-8ee2-fd6a65556784 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1283 microversion: 2.1 time: 0.210886 Jul 20 04:16:16.651195 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1063/2177] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:16 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1283 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:16.661109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c52d7251-e886-40d3-8dfa-cb21dd64687c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '.version_select at 0x7fb841b43a60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.117274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Getting quotas for project d536e3aeba614601973cd64fbe3ee196. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:17.124307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Getting quotas for user 4374208f84014632b8a3451b6997b8e9 and project d536e3aeba614601973cd64fbe3ee196. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:17.140008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:17.140950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:17.141579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:17.142239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:17.142872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:17.155002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.155694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.156693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.157511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.178283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Getting quotas for project d536e3aeba614601973cd64fbe3ee196. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:17.183774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Getting quotas for user 4374208f84014632b8a3451b6997b8e9 and project d536e3aeba614601973cd64fbe3ee196. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:17.262955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:17.265842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ab4af84-9602-4d02-97a3-7c8ecc9af16f',volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:17.528561 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-83588a9a-1a61-451a-b453-3ec330d81c7c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.935759 Jul 20 04:16:17.529228 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1115/2178] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:14 2022] POST /compute/v2.1/servers => generated 407 bytes in 2956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:17.541178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9d039479-6610-4853-84b5-5b3f2ca4de38 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '.version_select at 0x7fb842ae6550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.544011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d039479-6610-4853-84b5-5b3f2ca4de38 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.544659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d039479-6610-4853-84b5-5b3f2ca4de38 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.571089 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9d039479-6610-4853-84b5-5b3f2ca4de38 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 2986 microversion: 2.25 time: 0.034972 Jul 20 04:16:17.584072 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1116/2179] 10.222.0.59 () {60 vars in 1183 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/os-migrations => generated 2986 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:17.590870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-911c2f17-b010-4904-9b29-7b6f1c3667ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.591713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-911c2f17-b010-4904-9b29-7b6f1c3667ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:17.598951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-911c2f17-b010-4904-9b29-7b6f1c3667ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.599559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-911c2f17-b010-4904-9b29-7b6f1c3667ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.600644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-911c2f17-b010-4904-9b29-7b6f1c3667ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.601378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-911c2f17-b010-4904-9b29-7b6f1c3667ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.621611 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-911c2f17-b010-4904-9b29-7b6f1c3667ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-911c2f17-b010-4904-9b29-7b6f1c3667ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 HTTP/1.1 Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'c2ca8a00-3d0f-485c-a7ce-9028d31e7035'} Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:17.623692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:17.627945 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:17.627945 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:17.627945 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:17.627945 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:17.627945 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:17.627945 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:16:17.627945 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:17.630056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-911c2f17-b010-4904-9b29-7b6f1c3667ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:17.631431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-911c2f17-b010-4904-9b29-7b6f1c3667ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 404 len: 111 microversion: 2.1 time: 0.046064 Jul 20 04:16:17.635984 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1117/2180] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:17.645578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59399991-6966-451c-8127-364fa63281e0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.648627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-59399991-6966-451c-8127-364fa63281e0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:17.667285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59399991-6966-451c-8127-364fa63281e0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.667885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59399991-6966-451c-8127-364fa63281e0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.668717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59399991-6966-451c-8127-364fa63281e0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.671480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59399991-6966-451c-8127-364fa63281e0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.708456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:17.913315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-59399991-6966-451c-8127-364fa63281e0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:17.931856 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-59399991-6966-451c-8127-364fa63281e0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1184 microversion: 2.1 time: 0.292634 Jul 20 04:16:17.943649 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1118/2181] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1184 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:17.954467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37c4116e-0af2-412a-af98-ea9f5b163cb8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.957525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37c4116e-0af2-412a-af98-ea9f5b163cb8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.083703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-37c4116e-0af2-412a-af98-ea9f5b163cb8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:18.093456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37c4116e-0af2-412a-af98-ea9f5b163cb8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1122 microversion: 2.1 time: 0.148464 Jul 20 04:16:18.094044 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1119/2182] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1122 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:18.122041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2a78bfa7-e614-4461-bda5-34cdb700c5a1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.123274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2a78bfa7-e614-4461-bda5-34cdb700c5a1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.144040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a78bfa7-e614-4461-bda5-34cdb700c5a1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.147434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a78bfa7-e614-4461-bda5-34cdb700c5a1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.151167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a78bfa7-e614-4461-bda5-34cdb700c5a1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.152580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a78bfa7-e614-4461-bda5-34cdb700c5a1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.564311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-2a78bfa7-e614-4461-bda5-34cdb700c5a1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid 358c5f50-cf9e-4577-a295-0aa87e318810 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:18.583887 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2a78bfa7-e614-4461-bda5-34cdb700c5a1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 2424 microversion: 2.25 time: 0.474181 Jul 20 04:16:18.584560 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1120/2183] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 2424 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:18.592947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0ed4081-711a-4c0d-90a0-79bf801b367c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.594233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0ed4081-711a-4c0d-90a0-79bf801b367c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.603890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0ed4081-711a-4c0d-90a0-79bf801b367c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.604555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0ed4081-711a-4c0d-90a0-79bf801b367c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.605611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0ed4081-711a-4c0d-90a0-79bf801b367c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.606159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0ed4081-711a-4c0d-90a0-79bf801b367c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.681365 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c52d7251-e886-40d3-8dfa-cb21dd64687c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/609507e3-ddab-47de-a90d-2c214d619113" status: 202 len: 0 microversion: 2.1 time: 2.028236 Jul 20 04:16:18.687093 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1064/2184] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:16:16 2022] DELETE /compute/v2.1/os-floating-ips/609507e3-ddab-47de-a90d-2c214d619113 => generated 0 bytes in 2035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:18.692349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e69bed6-cb8d-4e60-911e-314e3759722f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.693558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6e69bed6-cb8d-4e60-911e-314e3759722f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.703855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e69bed6-cb8d-4e60-911e-314e3759722f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.704587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e69bed6-cb8d-4e60-911e-314e3759722f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.705516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e69bed6-cb8d-4e60-911e-314e3759722f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.706100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e69bed6-cb8d-4e60-911e-314e3759722f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.724147 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-6e69bed6-cb8d-4e60-911e-314e3759722f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e69bed6-cb8d-4e60-911e-314e3759722f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035/os-volume_attachments HTTP/1.1 Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'server_id': 'c2ca8a00-3d0f-485c-a7ce-9028d31e7035'} Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:18.736614 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:16:18.740459 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.741135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a0ed4081-711a-4c0d-90a0-79bf801b367c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:18.743541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e69bed6-cb8d-4e60-911e-314e3759722f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:18.744747 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6e69bed6-cb8d-4e60-911e-314e3759722f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.056432 Jul 20 04:16:18.745580 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1065/2185] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035/os-volume_attachments => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:18.757909 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0ed4081-711a-4c0d-90a0-79bf801b367c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1281 microversion: 2.1 time: 0.172091 Jul 20 04:16:18.760254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-55209703-1cc0-4a10-9a96-3d177b9f2001 req-90689280-95b0-4ad4-9c1a-83f7170e0154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24022d95-b1d8-4c2b-bf1c-8cf54046226a", "tag": "427eb412-170d-4821-a11a-5c006106639c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:18.760876 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1121/2186] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:18.766277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-812e4d49-be46-411e-892b-95ed9bc3fe9b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.766909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-812e4d49-be46-411e-892b-95ed9bc3fe9b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.775478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-812e4d49-be46-411e-892b-95ed9bc3fe9b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.776078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-812e4d49-be46-411e-892b-95ed9bc3fe9b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.777084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-812e4d49-be46-411e-892b-95ed9bc3fe9b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.777529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-812e4d49-be46-411e-892b-95ed9bc3fe9b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.796751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-55209703-1cc0-4a10-9a96-3d177b9f2001 req-90689280-95b0-4ad4-9c1a-83f7170e0154 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.798727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-55209703-1cc0-4a10-9a96-3d177b9f2001 req-90689280-95b0-4ad4-9c1a-83f7170e0154 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.831979 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-55209703-1cc0-4a10-9a96-3d177b9f2001 req-90689280-95b0-4ad4-9c1a-83f7170e0154 service nova] Creating event network-changed:427eb412-170d-4821-a11a-5c006106639c for instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a on n-h2-760456-11 Jul 20 04:16:18.840468 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-55209703-1cc0-4a10-9a96-3d177b9f2001 req-90689280-95b0-4ad4-9c1a-83f7170e0154 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093125 Jul 20 04:16:18.841387 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1066/2187] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:18.847331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-988991d7-44e8-477e-a8c4-1760d3b1fb0e tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-988991d7-44e8-477e-a8c4-1760d3b1fb0e tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Request method failure captured: Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action HTTP/1.1 Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 34 Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14FqK0QNqz1i1arwBnKb_YTxfd9Z1vkuzqWPwx7HT5GBT1P3ZfhOMe-Aa4dtoWeNNo8FduCe2BNDNsbTPm2mB8YmwhGHf-kzQPzex9gVFON00PvNelQ4Hn1U0g10kBYLE9FRhMisHNR6ZdfQ4rjlXPoFwKiKDMRX1VMiWOOOWljclns Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4466f0a240f74efbad843243399adb84 Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4466f0a240f74efbad843243399adb84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4466f0a240f74efbad843243399adb84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4466f0a240f74efbad843243399adb84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4466f0a240f74efbad843243399adb84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4466f0a240f74efbad843243399adb84 Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e31b85d83596495aa6e75967cf486dca Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: {"addFloatingIp": {"address": ""}} Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '24022d95-b1d8-4c2b-bf1c-8cf54046226a', 'body': {'addFloatingIp': {'address': ''}}} Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi '' Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:16:18.850314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:16:18.853799 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:18.857101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-988991d7-44e8-477e-a8c4-1760d3b1fb0e tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:18.858452 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-988991d7-44e8-477e-a8c4-1760d3b1fb0e tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action" status: 400 len: 142 microversion: 2.1 time: 0.015545 Jul 20 04:16:18.860653 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1067/2188] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:18 2022] POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action => generated 142 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:16:18.880445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:18.887666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.898598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.900279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.901709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:18.902380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.939073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Acquired lock "refresh_cache-24022d95-b1d8-4c2b-bf1c-8cf54046226a" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:16:18.949807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-812e4d49-be46-411e-892b-95ed9bc3fe9b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid 358c5f50-cf9e-4577-a295-0aa87e318810 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:18.972259 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-812e4d49-be46-411e-892b-95ed9bc3fe9b tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 2424 microversion: 2.25 time: 0.209730 Jul 20 04:16:18.972916 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1122/2189] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 2424 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:18.979180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-99ae36e3-7cc8-42f2-80db-35cb3c0683fc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:18.980096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-99ae36e3-7cc8-42f2-80db-35cb3c0683fc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:18.999968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99ae36e3-7cc8-42f2-80db-35cb3c0683fc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.001429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99ae36e3-7cc8-42f2-80db-35cb3c0683fc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.002585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99ae36e3-7cc8-42f2-80db-35cb3c0683fc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.003495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99ae36e3-7cc8-42f2-80db-35cb3c0683fc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.128420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-99ae36e3-7cc8-42f2-80db-35cb3c0683fc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:19.151062 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-99ae36e3-7cc8-42f2-80db-35cb3c0683fc tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1184 microversion: 2.1 time: 0.176837 Jul 20 04:16:19.155587 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1123/2190] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:18 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1184 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:19.163423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-517968589", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "191d678e-1adc-40c3-b7b1-1a7cb20ca675"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:19.227071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] validate_networks() for [('191d678e-1adc-40c3-b7b1-1a7cb20ca675', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:19.547935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Releasing lock "refresh_cache-24022d95-b1d8-4c2b-bf1c-8cf54046226a" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:16:19.548636 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] HTTP exception thrown: floating IP not found Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Request method failure captured: Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action HTTP/1.1 Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 41 Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14FqK0QNqz1i1arwBnKb_YTxfd9Z1vkuzqWPwx7HT5GBT1P3ZfhOMe-Aa4dtoWeNNo8FduCe2BNDNsbTPm2mB8YmwhGHf-kzQPzex9gVFON00PvNelQ4Hn1U0g10kBYLE9FRhMisHNR6ZdfQ4rjlXPoFwKiKDMRX1VMiWOOOWljclns Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4466f0a240f74efbad843243399adb84 Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4466f0a240f74efbad843243399adb84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4466f0a240f74efbad843243399adb84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4466f0a240f74efbad843243399adb84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4466f0a240f74efbad843243399adb84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4466f0a240f74efbad843243399adb84 Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e31b85d83596495aa6e75967cf486dca Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: exception: floating IP not found Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '24022d95-b1d8-4c2b-bf1c-8cf54046226a', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 20 04:16:19.550741 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Returning 404 to user: floating IP not found {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:19.554351 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-790e3f48-2dc2-4c8c-a2c4-491b0bdf7b08 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action" status: 404 len: 67 microversion: 2.1 time: 0.678313 Jul 20 04:16:19.560913 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1068/2191] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:18 2022] POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action => generated 67 bytes in 686 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:16:19.568711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6230aab9-41db-4255-b600-a9a9cdc0dba0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:19.574509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6230aab9-41db-4255-b600-a9a9cdc0dba0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:19.588535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6230aab9-41db-4255-b600-a9a9cdc0dba0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.591277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6230aab9-41db-4255-b600-a9a9cdc0dba0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.592224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6230aab9-41db-4255-b600-a9a9cdc0dba0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.592772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6230aab9-41db-4255-b600-a9a9cdc0dba0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.270742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:20.277481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:20.278178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:20.278653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:20.279094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:20.303391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.303778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.304611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.305716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.370464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:20.379170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for user 9f053f31c02c412394d48ce65350d153 and project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:20.409310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:20.411947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:20.501752 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac34b599-d192-411b-96eb-2e252a6e5de4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.343086 Jul 20 04:16:20.504543 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1124/2192] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:20.511493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-82ad5a14-d8cc-4169-9578-8eed06fbdddc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:20.512131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-82ad5a14-d8cc-4169-9578-8eed06fbdddc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:20.520954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82ad5a14-d8cc-4169-9578-8eed06fbdddc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.521476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82ad5a14-d8cc-4169-9578-8eed06fbdddc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.523239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82ad5a14-d8cc-4169-9578-8eed06fbdddc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.523239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82ad5a14-d8cc-4169-9578-8eed06fbdddc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.686411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-82ad5a14-d8cc-4169-9578-8eed06fbdddc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:20.699084 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-82ad5a14-d8cc-4169-9578-8eed06fbdddc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1238 microversion: 2.1 time: 0.190221 Jul 20 04:16:20.701504 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1125/2193] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:20 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1238 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:20.741519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c472004b-acff-4cd8-96ac-c4acce8f454d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Action: 'action', calling method: .version_select at 0x7fb848faee50>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:20.852760 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-c472004b-acff-4cd8-96ac-c4acce8f454d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c472004b-acff-4cd8-96ac-c4acce8f454d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Request method failure captured: Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action HTTP/1.1 Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 44 Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14FqK0QNqz1i1arwBnKb_YTxfd9Z1vkuzqWPwx7HT5GBT1P3ZfhOMe-Aa4dtoWeNNo8FduCe2BNDNsbTPm2mB8YmwhGHf-kzQPzex9gVFON00PvNelQ4Hn1U0g10kBYLE9FRhMisHNR6ZdfQ4rjlXPoFwKiKDMRX1VMiWOOOWljclns Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4466f0a240f74efbad843243399adb84 Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4466f0a240f74efbad843243399adb84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4466f0a240f74efbad843243399adb84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4466f0a240f74efbad843243399adb84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4466f0a240f74efbad843243399adb84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4466f0a240f74efbad843243399adb84 Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e31b85d83596495aa6e75967cf486dca Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: exception: Floating IP not found for address 0.0.0.0. Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '24022d95-b1d8-4c2b-bf1c-8cf54046226a', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 20 04:16:20.855144 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c472004b-acff-4cd8-96ac-c4acce8f454d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c472004b-acff-4cd8-96ac-c4acce8f454d tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action" status: 404 len: 88 microversion: 2.1 time: 0.153268 Jul 20 04:16:20.858984 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1126/2194] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:20 2022] POST /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a/action => generated 88 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:16:20.872023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7e73d34d-364f-4b63-a4c9-be312884bd72 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:20.876483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7e73d34d-364f-4b63-a4c9-be312884bd72 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:20.893624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e73d34d-364f-4b63-a4c9-be312884bd72 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.894100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e73d34d-364f-4b63-a4c9-be312884bd72 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.898355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e73d34d-364f-4b63-a4c9-be312884bd72 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.901757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e73d34d-364f-4b63-a4c9-be312884bd72 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.728490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7e73d34d-364f-4b63-a4c9-be312884bd72 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.741401 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7e73d34d-364f-4b63-a4c9-be312884bd72 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1323 microversion: 2.1 time: 0.882687 Jul 20 04:16:21.743860 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1127/2195] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:20 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1323 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:21.751472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8a01312-03ba-465f-b2e5-fa25a17b6336 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:21.752330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f8a01312-03ba-465f-b2e5-fa25a17b6336 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:21.772047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8a01312-03ba-465f-b2e5-fa25a17b6336 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:21.772520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8a01312-03ba-465f-b2e5-fa25a17b6336 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.773335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8a01312-03ba-465f-b2e5-fa25a17b6336 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:21.774736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8a01312-03ba-465f-b2e5-fa25a17b6336 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.953975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f8a01312-03ba-465f-b2e5-fa25a17b6336 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.972647 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f8a01312-03ba-465f-b2e5-fa25a17b6336 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1184 microversion: 2.1 time: 0.226962 Jul 20 04:16:21.973380 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1128/2196] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:21 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1184 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:21.985988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9aec20aa-82fd-4c0f-967d-82793124aa6a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:21.986985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9aec20aa-82fd-4c0f-967d-82793124aa6a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.003564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9aec20aa-82fd-4c0f-967d-82793124aa6a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.004574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9aec20aa-82fd-4c0f-967d-82793124aa6a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.005761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9aec20aa-82fd-4c0f-967d-82793124aa6a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.007779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9aec20aa-82fd-4c0f-967d-82793124aa6a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.111478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9aec20aa-82fd-4c0f-967d-82793124aa6a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.125205 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9aec20aa-82fd-4c0f-967d-82793124aa6a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1274 microversion: 2.1 time: 0.150453 Jul 20 04:16:22.127591 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1129/2197] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:21 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:22.137134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-060413dc-f887-42f6-8ede-5ad7f8ac3805 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.137941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-060413dc-f887-42f6-8ede-5ad7f8ac3805 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.148464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-060413dc-f887-42f6-8ede-5ad7f8ac3805 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.149241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-060413dc-f887-42f6-8ede-5ad7f8ac3805 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.153668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-060413dc-f887-42f6-8ede-5ad7f8ac3805 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.154387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-060413dc-f887-42f6-8ede-5ad7f8ac3805 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.190675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-060413dc-f887-42f6-8ede-5ad7f8ac3805 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:22.344331 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-060413dc-f887-42f6-8ede-5ad7f8ac3805 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "DELETE /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 204 len: 0 microversion: 2.1 time: 0.211141 Jul 20 04:16:22.346095 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1130/2198] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:22 2022] DELETE /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:22.355931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-d6c89502-1208-4c02-8a70-617f66ad075e req-43ddd6ac-dc2d-419a-9cf8-b506722e5526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3edbf03b-c74b-4814-81de-4645c207d91a", "tag": "df3fbf6a-1fad-4c47-af81-2713c574b472"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:22.371132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d6c89502-1208-4c02-8a70-617f66ad075e req-43ddd6ac-dc2d-419a-9cf8-b506722e5526 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.372723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d6c89502-1208-4c02-8a70-617f66ad075e req-43ddd6ac-dc2d-419a-9cf8-b506722e5526 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.391211 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-d6c89502-1208-4c02-8a70-617f66ad075e req-43ddd6ac-dc2d-419a-9cf8-b506722e5526 service nova] Creating event network-changed:df3fbf6a-1fad-4c47-af81-2713c574b472 for instance 3edbf03b-c74b-4814-81de-4645c207d91a on n-h2-760456-11 Jul 20 04:16:22.397177 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-d6c89502-1208-4c02-8a70-617f66ad075e req-43ddd6ac-dc2d-419a-9cf8-b506722e5526 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049244 Jul 20 04:16:22.398218 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1131/2199] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:22.409486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8dc5c07e-213c-4de2-b8ae-2bca1d711728 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.411563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8dc5c07e-213c-4de2-b8ae-2bca1d711728 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.421830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8dc5c07e-213c-4de2-b8ae-2bca1d711728 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.423416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8dc5c07e-213c-4de2-b8ae-2bca1d711728 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.425682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8dc5c07e-213c-4de2-b8ae-2bca1d711728 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.426499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8dc5c07e-213c-4de2-b8ae-2bca1d711728 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.848599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8dc5c07e-213c-4de2-b8ae-2bca1d711728 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.867038 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8dc5c07e-213c-4de2-b8ae-2bca1d711728 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1306 microversion: 2.1 time: 0.466598 Jul 20 04:16:22.871752 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1132/2200] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:22 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1306 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:22.900282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea7c0186-27ea-475a-8dab-6a78fd3cfbec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.900842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea7c0186-27ea-475a-8dab-6a78fd3cfbec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.914413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea7c0186-27ea-475a-8dab-6a78fd3cfbec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.915300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea7c0186-27ea-475a-8dab-6a78fd3cfbec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.916139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea7c0186-27ea-475a-8dab-6a78fd3cfbec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.916597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea7c0186-27ea-475a-8dab-6a78fd3cfbec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.950954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea7c0186-27ea-475a-8dab-6a78fd3cfbec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:23.057563 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea7c0186-27ea-475a-8dab-6a78fd3cfbec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 204 len: 0 microversion: 2.1 time: 0.183133 Jul 20 04:16:23.059029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1133/2201] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:22 2022] DELETE /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:23.065990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac7a5efc-f2ba-404c-9a5d-bbbbd3ff9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:23.068213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac7a5efc-f2ba-404c-9a5d-bbbbd3ff9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:23.075808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:23.082209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac7a5efc-f2ba-404c-9a5d-bbbbd3ff9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.083059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac7a5efc-f2ba-404c-9a5d-bbbbd3ff9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.084547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac7a5efc-f2ba-404c-9a5d-bbbbd3ff9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.085213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac7a5efc-f2ba-404c-9a5d-bbbbd3ff9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.098066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-6230aab9-41db-4255-b600-a9a9cdc0dba0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lazy-loading 'services' on Instance uuid 358c5f50-cf9e-4577-a295-0aa87e318810 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:23.120269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:23.255041 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6230aab9-41db-4255-b600-a9a9cdc0dba0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "DELETE /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments/217e91b6-8de6-432b-b218-150adf73ef94" status: 202 len: 0 microversion: 2.25 time: 3.692160 Jul 20 04:16:23.259323 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1069/2202] 10.222.0.59 () {60 vars in 1456 bytes} [Wed Jul 20 04:16:19 2022] DELETE /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments/217e91b6-8de6-432b-b218-150adf73ef94 => generated 0 bytes in 3698 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:23.277290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-72eff367-0965-43ba-96cf-5a6ed7b6f8a5 req-b32bc79b-f994-4059-af84-700054c0e29a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2d80d9-de8c-4fce-852f-3c7d1947dca0", "tag": "b1127e50-3431-47b8-a063-a07fc1fe34f2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:23.301928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-72eff367-0965-43ba-96cf-5a6ed7b6f8a5 req-b32bc79b-f994-4059-af84-700054c0e29a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.302531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-72eff367-0965-43ba-96cf-5a6ed7b6f8a5 req-b32bc79b-f994-4059-af84-700054c0e29a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.346852 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-72eff367-0965-43ba-96cf-5a6ed7b6f8a5 req-b32bc79b-f994-4059-af84-700054c0e29a service nova] Creating event network-changed:b1127e50-3431-47b8-a063-a07fc1fe34f2 for instance 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 on n-h1-760456-11 Jul 20 04:16:23.355525 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-72eff367-0965-43ba-96cf-5a6ed7b6f8a5 req-b32bc79b-f994-4059-af84-700054c0e29a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094512 Jul 20 04:16:23.358507 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1070/2203] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:23.378687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bd7d765-5a43-45ba-a568-c0087179f06c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:23.381830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6bd7d765-5a43-45ba-a568-c0087179f06c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:23.395942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bd7d765-5a43-45ba-a568-c0087179f06c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.400068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bd7d765-5a43-45ba-a568-c0087179f06c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.406665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bd7d765-5a43-45ba-a568-c0087179f06c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.407863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bd7d765-5a43-45ba-a568-c0087179f06c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.535162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ac7a5efc-f2ba-404c-9a5d-bbbbd3ff9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:23.547601 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac7a5efc-f2ba-404c-9a5d-bbbbd3ff9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1542 microversion: 2.1 time: 0.486697 Jul 20 04:16:23.558854 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1134/2204] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:23 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1542 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:23.711117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-891904652", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "dfcd571a-b428-4039-b4b1-a896dbfff77f"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:23.721748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6bd7d765-5a43-45ba-a568-c0087179f06c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:23.733917 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6bd7d765-5a43-45ba-a568-c0087179f06c tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1323 microversion: 2.1 time: 0.370741 Jul 20 04:16:23.734700 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1071/2205] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:23 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1323 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:23.744705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b2cef875-9735-4605-9ad9-279bc689092f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:23.745589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b2cef875-9735-4605-9ad9-279bc689092f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:23.754606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2cef875-9735-4605-9ad9-279bc689092f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.755461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2cef875-9735-4605-9ad9-279bc689092f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.756330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2cef875-9735-4605-9ad9-279bc689092f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.757330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2cef875-9735-4605-9ad9-279bc689092f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.799423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] validate_networks() for [('dfcd571a-b428-4039-b4b1-a896dbfff77f', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:23.930098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b2cef875-9735-4605-9ad9-279bc689092f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:23.938182 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b2cef875-9735-4605-9ad9-279bc689092f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 200 len: 1184 microversion: 2.1 time: 0.202586 Jul 20 04:16:23.941283 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1072/2206] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:23 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 1184 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:23.957702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aba2bab9-b36f-4d56-baf8-a1ad3565ded4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:23.959315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aba2bab9-b36f-4d56-baf8-a1ad3565ded4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:23.995778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aba2bab9-b36f-4d56-baf8-a1ad3565ded4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.996542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aba2bab9-b36f-4d56-baf8-a1ad3565ded4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.997581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aba2bab9-b36f-4d56-baf8-a1ad3565ded4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.998345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aba2bab9-b36f-4d56-baf8-a1ad3565ded4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.128041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aba2bab9-b36f-4d56-baf8-a1ad3565ded4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.140446 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aba2bab9-b36f-4d56-baf8-a1ad3565ded4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1272 microversion: 2.1 time: 0.197691 Jul 20 04:16:24.141371 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1073/2207] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:23 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:24.148168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c4a3b730-a421-454b-83a6-9ae79d5150ab tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.149575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c4a3b730-a421-454b-83a6-9ae79d5150ab tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.158080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4a3b730-a421-454b-83a6-9ae79d5150ab tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.158842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4a3b730-a421-454b-83a6-9ae79d5150ab tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.159853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4a3b730-a421-454b-83a6-9ae79d5150ab tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.160528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4a3b730-a421-454b-83a6-9ae79d5150ab tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.222906 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c4a3b730-a421-454b-83a6-9ae79d5150ab tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079471 Jul 20 04:16:24.223609 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1074/2208] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:24.234243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-79e19bbe-69c9-4cdc-afc0-e6ab2513b0f8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.236076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-79e19bbe-69c9-4cdc-afc0-e6ab2513b0f8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.244450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79e19bbe-69c9-4cdc-afc0-e6ab2513b0f8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.245150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79e19bbe-69c9-4cdc-afc0-e6ab2513b0f8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.246086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79e19bbe-69c9-4cdc-afc0-e6ab2513b0f8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.246912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79e19bbe-69c9-4cdc-afc0-e6ab2513b0f8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.638846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-79e19bbe-69c9-4cdc-afc0-e6ab2513b0f8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.648006 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-79e19bbe-69c9-4cdc-afc0-e6ab2513b0f8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1306 microversion: 2.1 time: 0.423098 Jul 20 04:16:24.655218 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1075/2209] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1306 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:24.673553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-355df474-99fb-48b8-b6e9-072c2ee4c028 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.674904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-355df474-99fb-48b8-b6e9-072c2ee4c028 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.691268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-355df474-99fb-48b8-b6e9-072c2ee4c028 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.692058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-355df474-99fb-48b8-b6e9-072c2ee4c028 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.694651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-355df474-99fb-48b8-b6e9-072c2ee4c028 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.695838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-355df474-99fb-48b8-b6e9-072c2ee4c028 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.808566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:24.809500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:24.809671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:24.810383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:24.810814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:24.839165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.840712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.845159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.853850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.905010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Getting quotas for project 3e2cccff703842c19f80047348ef088d. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:24.926023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Getting quotas for user 2206264735814d3ea25b0217601d101f and project 3e2cccff703842c19f80047348ef088d. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:24.964713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:24.971394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:25.093795 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-314bec4a-3363-45d1-8167-217c3e0ef930 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533673 Jul 20 04:16:25.109480 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1135/2210] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:25.109480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8a434581-07f7-483d-ab55-b7bc14882b09 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.110436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8a434581-07f7-483d-ab55-b7bc14882b09 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.145962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a434581-07f7-483d-ab55-b7bc14882b09 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.147293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a434581-07f7-483d-ab55-b7bc14882b09 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.148393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a434581-07f7-483d-ab55-b7bc14882b09 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.150095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a434581-07f7-483d-ab55-b7bc14882b09 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.447484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8a434581-07f7-483d-ab55-b7bc14882b09 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.457827 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8a434581-07f7-483d-ab55-b7bc14882b09 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1323 microversion: 2.1 time: 0.357062 Jul 20 04:16:25.468232 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1136/2211] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:25 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:25.476112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0514654a-a524-41c5-8810-c86a87b9ed27 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.477682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0514654a-a524-41c5-8810-c86a87b9ed27 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 1c2ae540-9679-4d32-a12c-4ac56e81f928] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.487834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0514654a-a524-41c5-8810-c86a87b9ed27 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.488407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0514654a-a524-41c5-8810-c86a87b9ed27 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.489333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0514654a-a524-41c5-8810-c86a87b9ed27 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.489887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0514654a-a524-41c5-8810-c86a87b9ed27 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.511221 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-0514654a-a524-41c5-8810-c86a87b9ed27 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] HTTP exception thrown: Instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 could not be found. Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0514654a-a524-41c5-8810-c86a87b9ed27 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Request method failure captured: Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 HTTP/1.1 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13_uK_xP9ODNPpaQ-ecTO2Rf_YPcAp2c-N8IHy-wvXju7JprTZ-mri4Y1XPcsbGAVEh4AexlfSN_kneWlba42yui0SKx3hErzFWghrYzktkHLddiecxtsDjG8K8ce4T-zKktw7ZcdAnTgFj4OyW8_GQUkdFv10gHbbCKYzu0CyKsmx0 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1ec8a3f7a123436c825135d50dd93865 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-LiveMigrationTest-1979290209 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-LiveMigrationTest-1979290209 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1ec8a3f7a123436c825135d50dd93865 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-LiveMigrationTest-1979290209 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-LiveMigrationTest-1979290209-project Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 04547e35c8c541af914c30e9083cda85 Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-LiveMigrationTest-1979290209-project Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 could not be found. Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '1c2ae540-9679-4d32-a12c-4ac56e81f928'} Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 could not be found. Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 could not be found. Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:25.513172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.517631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:25.517631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:25.517631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:25.517631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:25.517631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:25.517631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 could not be found. Jul 20 04:16:25.517631 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.517631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0514654a-a524-41c5-8810-c86a87b9ed27 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Returning 404 to user: Instance 1c2ae540-9679-4d32-a12c-4ac56e81f928 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:25.517631 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0514654a-a524-41c5-8810-c86a87b9ed27 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928" status: 404 len: 111 microversion: 2.1 time: 0.044850 Jul 20 04:16:25.518914 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1137/2212] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:25 2022] GET /compute/v2.1/servers/1c2ae540-9679-4d32-a12c-4ac56e81f928 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:25.526146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-98f3f308-1a58-45fa-a21a-0877fb98c346 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.527019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-98f3f308-1a58-45fa-a21a-0877fb98c346 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.535779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98f3f308-1a58-45fa-a21a-0877fb98c346 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.536295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98f3f308-1a58-45fa-a21a-0877fb98c346 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.537178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98f3f308-1a58-45fa-a21a-0877fb98c346 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.537769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98f3f308-1a58-45fa-a21a-0877fb98c346 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.830171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-98f3f308-1a58-45fa-a21a-0877fb98c346 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.854956 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-98f3f308-1a58-45fa-a21a-0877fb98c346 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1314 microversion: 2.1 time: 0.333426 Jul 20 04:16:25.856892 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1138/2213] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:25 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:25.880778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-995647927", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "dfcd571a-b428-4039-b4b1-a896dbfff77f"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:26.007605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] validate_networks() for [('dfcd571a-b428-4039-b4b1-a896dbfff77f', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:26.048778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-355df474-99fb-48b8-b6e9-072c2ee4c028 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:26.059804 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-355df474-99fb-48b8-b6e9-072c2ee4c028 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1542 microversion: 2.1 time: 1.400588 Jul 20 04:16:26.068661 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1076/2214] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1542 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:26.074713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f931f28-51fe-40c3-810d-64fabb0b9ab5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:26.078537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f931f28-51fe-40c3-810d-64fabb0b9ab5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:26.097672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f931f28-51fe-40c3-810d-64fabb0b9ab5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.098234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f931f28-51fe-40c3-810d-64fabb0b9ab5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.099610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f931f28-51fe-40c3-810d-64fabb0b9ab5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.100059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f931f28-51fe-40c3-810d-64fabb0b9ab5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.185163 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f931f28-51fe-40c3-810d-64fabb0b9ab5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119227 Jul 20 04:16:26.189055 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1077/2215] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:26 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:26.199511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d14842b-3d63-4ed2-a37e-b626cb343c96 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:26.201294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8d14842b-3d63-4ed2-a37e-b626cb343c96 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:26.215491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:26.217634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d14842b-3d63-4ed2-a37e-b626cb343c96 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.218999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d14842b-3d63-4ed2-a37e-b626cb343c96 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.221813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d14842b-3d63-4ed2-a37e-b626cb343c96 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.223111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d14842b-3d63-4ed2-a37e-b626cb343c96 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.270476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:26.622750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:26.624097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:26.624791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:26.625417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:26.626046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:26.639260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.640087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.641171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.641836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.667117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Getting quotas for project 3e2cccff703842c19f80047348ef088d. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:26.676462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Getting quotas for user 2206264735814d3ea25b0217601d101f and project 3e2cccff703842c19f80047348ef088d. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:26.696382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:26.699315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: c561dbb2-7811-4eeb-b05c-0df4ee20c622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:26.768685 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f7c77da9-f374-428b-b9a6-9adabe455619 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903054 Jul 20 04:16:26.776786 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1139/2216] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:26.800184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-29f481b9-32e5-44ed-89c2-94272eb3abee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:26.802988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-29f481b9-32e5-44ed-89c2-94272eb3abee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:26.825036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29f481b9-32e5-44ed-89c2-94272eb3abee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.826810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29f481b9-32e5-44ed-89c2-94272eb3abee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.827805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29f481b9-32e5-44ed-89c2-94272eb3abee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.829678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29f481b9-32e5-44ed-89c2-94272eb3abee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.958966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8d14842b-3d63-4ed2-a37e-b626cb343c96 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:26.975220 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8d14842b-3d63-4ed2-a37e-b626cb343c96 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1306 microversion: 2.1 time: 0.784986 Jul 20 04:16:26.985316 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1078/2217] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:26 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1306 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:26.997878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-12701c3f-a6f8-496b-8b4f-afc8e043b6c6 req-3a97b5b3-7e82-4a3d-95d6-00034de591e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edbf03b-c74b-4814-81de-4645c207d91a", "name": "network-vif-plugged", "status": "completed", "tag": "df3fbf6a-1fad-4c47-af81-2713c574b472"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:27.017754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-12701c3f-a6f8-496b-8b4f-afc8e043b6c6 req-3a97b5b3-7e82-4a3d-95d6-00034de591e5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.019427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-12701c3f-a6f8-496b-8b4f-afc8e043b6c6 req-3a97b5b3-7e82-4a3d-95d6-00034de591e5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.036435 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-12701c3f-a6f8-496b-8b4f-afc8e043b6c6 req-3a97b5b3-7e82-4a3d-95d6-00034de591e5 service nova] Creating event network-vif-plugged:df3fbf6a-1fad-4c47-af81-2713c574b472 for instance 3edbf03b-c74b-4814-81de-4645c207d91a on n-h2-760456-11 Jul 20 04:16:27.062546 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-12701c3f-a6f8-496b-8b4f-afc8e043b6c6 req-3a97b5b3-7e82-4a3d-95d6-00034de591e5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067607 Jul 20 04:16:27.064322 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1079/2218] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:27.076637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a487ea53-08f3-4687-a5f1-88207d419a5e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:27.080499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a487ea53-08f3-4687-a5f1-88207d419a5e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:27.088007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a487ea53-08f3-4687-a5f1-88207d419a5e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.088844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a487ea53-08f3-4687-a5f1-88207d419a5e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.089898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a487ea53-08f3-4687-a5f1-88207d419a5e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.090671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a487ea53-08f3-4687-a5f1-88207d419a5e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.558421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-29f481b9-32e5-44ed-89c2-94272eb3abee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.573713 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-29f481b9-32e5-44ed-89c2-94272eb3abee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1323 microversion: 2.1 time: 0.793664 Jul 20 04:16:27.574869 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1140/2219] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:26 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1323 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:27.594684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-408932145", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "451", "networks": [{"uuid": "dfcd571a-b428-4039-b4b1-a896dbfff77f"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:27.699815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] validate_networks() for [('dfcd571a-b428-4039-b4b1-a896dbfff77f', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:27.749087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a487ea53-08f3-4687-a5f1-88207d419a5e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.762508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a487ea53-08f3-4687-a5f1-88207d419a5e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1314 microversion: 2.1 time: 0.694595 Jul 20 04:16:27.763457 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1080/2220] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:27 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:27.771882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e26f13c6-213b-428f-a1ad-4a4cd2b6c685 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:27.777555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e26f13c6-213b-428f-a1ad-4a4cd2b6c685 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:27.791379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e26f13c6-213b-428f-a1ad-4a4cd2b6c685 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.794944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e26f13c6-213b-428f-a1ad-4a4cd2b6c685 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.796024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e26f13c6-213b-428f-a1ad-4a4cd2b6c685 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.796624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e26f13c6-213b-428f-a1ad-4a4cd2b6c685 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.936644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e26f13c6-213b-428f-a1ad-4a4cd2b6c685 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31b85d83596495aa6e75967cf486dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466f0a240f74efbad843243399adb84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.951055 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e26f13c6-213b-428f-a1ad-4a4cd2b6c685 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 200 len: 1500 microversion: 2.1 time: 0.186075 Jul 20 04:16:27.956262 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1081/2221] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:27 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 1500 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:27.962465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9189fd16-705a-418a-ba90-07f44bd5fd91 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:27.968055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9189fd16-705a-418a-ba90-07f44bd5fd91 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:27.981987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9189fd16-705a-418a-ba90-07f44bd5fd91 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.982875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9189fd16-705a-418a-ba90-07f44bd5fd91 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.983890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9189fd16-705a-418a-ba90-07f44bd5fd91 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.984553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9189fd16-705a-418a-ba90-07f44bd5fd91 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.051916 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9189fd16-705a-418a-ba90-07f44bd5fd91 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093886 Jul 20 04:16:28.055377 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1082/2222] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:27 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:28.067102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4b645cba-ff3c-47f7-acc6-1ea46405f14c req-3b443206-218d-4ea2-846e-32abd6578786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24022d95-b1d8-4c2b-bf1c-8cf54046226a", "name": "network-vif-deleted", "tag": "427eb412-170d-4821-a11a-5c006106639c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:28.105386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4b645cba-ff3c-47f7-acc6-1ea46405f14c req-3b443206-218d-4ea2-846e-32abd6578786 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.110163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4b645cba-ff3c-47f7-acc6-1ea46405f14c req-3b443206-218d-4ea2-846e-32abd6578786 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.143136 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4b645cba-ff3c-47f7-acc6-1ea46405f14c req-3b443206-218d-4ea2-846e-32abd6578786 service nova] Creating event network-vif-deleted:427eb412-170d-4821-a11a-5c006106639c for instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a on n-h2-760456-11 Jul 20 04:16:28.150602 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4b645cba-ff3c-47f7-acc6-1ea46405f14c req-3b443206-218d-4ea2-846e-32abd6578786 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091072 Jul 20 04:16:28.156092 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1083/2223] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:28.173421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7693058c-8671-4299-99c3-46a0416d3618 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:28.174395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7693058c-8671-4299-99c3-46a0416d3618 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:28.191204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7693058c-8671-4299-99c3-46a0416d3618 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.192041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7693058c-8671-4299-99c3-46a0416d3618 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.193084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7693058c-8671-4299-99c3-46a0416d3618 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.194310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7693058c-8671-4299-99c3-46a0416d3618 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.594744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7693058c-8671-4299-99c3-46a0416d3618 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:28.610387 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7693058c-8671-4299-99c3-46a0416d3618 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1306 microversion: 2.1 time: 0.452604 Jul 20 04:16:28.610981 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1084/2224] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:28 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1306 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:28.615926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fe1dbf27-b738-4a9f-923a-ba099454d469 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:28.616725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fe1dbf27-b738-4a9f-923a-ba099454d469 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:28.623572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe1dbf27-b738-4a9f-923a-ba099454d469 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.624022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe1dbf27-b738-4a9f-923a-ba099454d469 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.624798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe1dbf27-b738-4a9f-923a-ba099454d469 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.625239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe1dbf27-b738-4a9f-923a-ba099454d469 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.708272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:28.708789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:28.709369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:28.709899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:28.710459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:28.726138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.727506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.728606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.729081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.785149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Getting quotas for project 3e2cccff703842c19f80047348ef088d. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:28.797408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Getting quotas for user 2206264735814d3ea25b0217601d101f and project 3e2cccff703842c19f80047348ef088d. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:28.829738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fe1dbf27-b738-4a9f-923a-ba099454d469 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:28.837554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:28.839320 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fe1dbf27-b738-4a9f-923a-ba099454d469 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1517 microversion: 2.1 time: 0.226877 Jul 20 04:16:28.841682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:28.851122 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1085/2225] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:28 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1517 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:28.851122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a2473eb7-b8ce-4953-a5e6-a3a0baa0ed4f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:28.851122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a2473eb7-b8ce-4953-a5e6-a3a0baa0ed4f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:28.853635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2473eb7-b8ce-4953-a5e6-a3a0baa0ed4f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.854368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2473eb7-b8ce-4953-a5e6-a3a0baa0ed4f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.855413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2473eb7-b8ce-4953-a5e6-a3a0baa0ed4f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.863343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2473eb7-b8ce-4953-a5e6-a3a0baa0ed4f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.929466 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac84dea3-2ac1-41c5-9fb2-02ea8e3b2c6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.344507 Jul 20 04:16:28.932583 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1141/2226] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:28.947724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ec037317-5922-40b9-9a35-c38d0d9c9827 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:28.949358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ec037317-5922-40b9-9a35-c38d0d9c9827 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:28.977829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec037317-5922-40b9-9a35-c38d0d9c9827 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.978581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec037317-5922-40b9-9a35-c38d0d9c9827 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.980111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec037317-5922-40b9-9a35-c38d0d9c9827 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.981469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec037317-5922-40b9-9a35-c38d0d9c9827 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.038783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-ec037317-5922-40b9-9a35-c38d0d9c9827 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lazy-loading 'flavor' on Instance uuid 3edbf03b-c74b-4814-81de-4645c207d91a {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:29.135241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a2473eb7-b8ce-4953-a5e6-a3a0baa0ed4f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:29.160190 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a2473eb7-b8ce-4953-a5e6-a3a0baa0ed4f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1314 microversion: 2.1 time: 0.318528 Jul 20 04:16:29.166170 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1086/2227] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:28 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:29.184611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-004207a2-89e4-49a3-90ed-15dd67b721a4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:29.185648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-004207a2-89e4-49a3-90ed-15dd67b721a4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:29.451058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-004207a2-89e4-49a3-90ed-15dd67b721a4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:29.462353 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-004207a2-89e4-49a3-90ed-15dd67b721a4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1220 microversion: 2.1 time: 0.294837 Jul 20 04:16:29.464415 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1087/2228] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:29 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1220 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:29.482838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec4a484b-f993-4127-8072-83927de7a22c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:29.485995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ec4a484b-f993-4127-8072-83927de7a22c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] [instance: 24022d95-b1d8-4c2b-bf1c-8cf54046226a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:29.505715 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ec037317-5922-40b9-9a35-c38d0d9c9827 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "POST /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a/action" status: 200 len: 32 microversion: 2.1 time: 0.560394 Jul 20 04:16:29.505715 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1142/2229] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:28 2022] POST /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a/action => generated 32 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:16:29.507097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec4a484b-f993-4127-8072-83927de7a22c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.507567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec4a484b-f993-4127-8072-83927de7a22c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.515070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec4a484b-f993-4127-8072-83927de7a22c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.515528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec4a484b-f993-4127-8072-83927de7a22c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.527513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-56a20301-b880-46e8-81c4-88a14b7fdd09 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:29.529856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-56a20301-b880-46e8-81c4-88a14b7fdd09 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:29.544984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56a20301-b880-46e8-81c4-88a14b7fdd09 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.545465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56a20301-b880-46e8-81c4-88a14b7fdd09 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.546358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56a20301-b880-46e8-81c4-88a14b7fdd09 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.546842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56a20301-b880-46e8-81c4-88a14b7fdd09 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.553716 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-ec4a484b-f993-4127-8072-83927de7a22c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] HTTP exception thrown: Instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a could not be found. Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec4a484b-f993-4127-8072-83927de7a22c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Request method failure captured: Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a HTTP/1.1 Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14FqK0QNqz1i1arwBnKb_YTxfd9Z1vkuzqWPwx7HT5GBT1P3ZfhOMe-Aa4dtoWeNNo8FduCe2BNDNsbTPm2mB8YmwhGHf-kzQPzex9gVFON00PvNelQ4Hn1U0g10kBYLE9FRhMisHNR6ZdfQ4rjlXPoFwKiKDMRX1VMiWOOOWljclns Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4466f0a240f74efbad843243399adb84 Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4466f0a240f74efbad843243399adb84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4466f0a240f74efbad843243399adb84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4466f0a240f74efbad843243399adb84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4466f0a240f74efbad843243399adb84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4466f0a240f74efbad843243399adb84 Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e31b85d83596495aa6e75967cf486dca Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a could not be found. Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '24022d95-b1d8-4c2b-bf1c-8cf54046226a'} Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a could not be found. Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a could not be found. Jul 20 04:16:29.556809 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a could not be found. Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec4a484b-f993-4127-8072-83927de7a22c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] Returning 404 to user: Instance 24022d95-b1d8-4c2b-bf1c-8cf54046226a could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:29.560379 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec4a484b-f993-4127-8072-83927de7a22c tempest-FloatingIPsAssociationNegativeTestJSON-1573748104 tempest-FloatingIPsAssociationNegativeTestJSON-1573748104-project] 10.222.0.59 "GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a" status: 404 len: 111 microversion: 2.1 time: 0.093823 Jul 20 04:16:29.561104 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1088/2230] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:29 2022] GET /compute/v2.1/servers/24022d95-b1d8-4c2b-bf1c-8cf54046226a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:29.577386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-358cdc32-c1ef-42a7-ba8e-4e9433f47e20 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:29.578291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-358cdc32-c1ef-42a7-ba8e-4e9433f47e20 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:29.593092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-358cdc32-c1ef-42a7-ba8e-4e9433f47e20 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.595266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-358cdc32-c1ef-42a7-ba8e-4e9433f47e20 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.597457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-358cdc32-c1ef-42a7-ba8e-4e9433f47e20 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.599551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-358cdc32-c1ef-42a7-ba8e-4e9433f47e20 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.634575 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-56a20301-b880-46e8-81c4-88a14b7fdd09 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125113 Jul 20 04:16:29.638592 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1143/2231] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:29 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:29.645141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9b0c64ef-1b48-41d4-a900-edf20af53ae5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:29.646712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9b0c64ef-1b48-41d4-a900-edf20af53ae5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:29.664051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b0c64ef-1b48-41d4-a900-edf20af53ae5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.664355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b0c64ef-1b48-41d4-a900-edf20af53ae5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.665285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b0c64ef-1b48-41d4-a900-edf20af53ae5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.666575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b0c64ef-1b48-41d4-a900-edf20af53ae5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.088513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-358cdc32-c1ef-42a7-ba8e-4e9433f47e20 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.103873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-358cdc32-c1ef-42a7-ba8e-4e9433f47e20 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.541503 Jul 20 04:16:30.105025 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1089/2232] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:29 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:30.177076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c56e1a80-3267-4a95-bbc6-105453aeb046 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:30.179048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c56e1a80-3267-4a95-bbc6-105453aeb046 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:30.190545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c56e1a80-3267-4a95-bbc6-105453aeb046 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.191266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c56e1a80-3267-4a95-bbc6-105453aeb046 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.193601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c56e1a80-3267-4a95-bbc6-105453aeb046 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.194218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c56e1a80-3267-4a95-bbc6-105453aeb046 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.768042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9b0c64ef-1b48-41d4-a900-edf20af53ae5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.777552 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9b0c64ef-1b48-41d4-a900-edf20af53ae5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1306 microversion: 2.1 time: 1.140843 Jul 20 04:16:30.800205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c56e1a80-3267-4a95-bbc6-105453aeb046 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.801749 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1144/2233] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:29 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1306 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:30.808015 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c56e1a80-3267-4a95-bbc6-105453aeb046 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1314 microversion: 2.1 time: 0.634679 Jul 20 04:16:30.808857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a903a189-2fb2-4ad1-826b-67f776591bc8 req-b600c33c-7294-4719-b059-b45decb1d0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc9bd9c-e200-4378-ba53-b9ad6e75188e", "tag": "d18001fe-d6ba-482f-9446-aadb25160845"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:30.809104 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1090/2234] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:30 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:30.829069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6cbc4e31-f162-4610-ab3c-3a1388d6e76e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:30.832019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6cbc4e31-f162-4610-ab3c-3a1388d6e76e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:30.845913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cbc4e31-f162-4610-ab3c-3a1388d6e76e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.846417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cbc4e31-f162-4610-ab3c-3a1388d6e76e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.847219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cbc4e31-f162-4610-ab3c-3a1388d6e76e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.847660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cbc4e31-f162-4610-ab3c-3a1388d6e76e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.862947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a903a189-2fb2-4ad1-826b-67f776591bc8 req-b600c33c-7294-4719-b059-b45decb1d0ba service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.866550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a903a189-2fb2-4ad1-826b-67f776591bc8 req-b600c33c-7294-4719-b059-b45decb1d0ba service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.902015 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a903a189-2fb2-4ad1-826b-67f776591bc8 req-b600c33c-7294-4719-b059-b45decb1d0ba service nova] Creating event network-changed:d18001fe-d6ba-482f-9446-aadb25160845 for instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e on n-h2-760456-11 Jul 20 04:16:30.909637 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a903a189-2fb2-4ad1-826b-67f776591bc8 req-b600c33c-7294-4719-b059-b45decb1d0ba service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106057 Jul 20 04:16:30.911238 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1145/2235] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:30.926376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1ff3b03-b1fb-4eab-98ae-09ad5aa8eaf2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:30.927477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1ff3b03-b1fb-4eab-98ae-09ad5aa8eaf2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:30.942462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ff3b03-b1fb-4eab-98ae-09ad5aa8eaf2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.942856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ff3b03-b1fb-4eab-98ae-09ad5aa8eaf2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.943662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ff3b03-b1fb-4eab-98ae-09ad5aa8eaf2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.944113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ff3b03-b1fb-4eab-98ae-09ad5aa8eaf2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.032759 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1ff3b03-b1fb-4eab-98ae-09ad5aa8eaf2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118718 Jul 20 04:16:31.037153 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1146/2236] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:30 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:31.056257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6cbc4e31-f162-4610-ab3c-3a1388d6e76e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.069172 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6cbc4e31-f162-4610-ab3c-3a1388d6e76e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1280 microversion: 2.1 time: 0.245247 Jul 20 04:16:31.071531 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1091/2237] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:30 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1280 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:31.122364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f4c8cbec-c536-4aed-a388-ad0c3a909c76 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.129959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f4c8cbec-c536-4aed-a388-ad0c3a909c76 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.143620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4c8cbec-c536-4aed-a388-ad0c3a909c76 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.146736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4c8cbec-c536-4aed-a388-ad0c3a909c76 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.147937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4c8cbec-c536-4aed-a388-ad0c3a909c76 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.151682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4c8cbec-c536-4aed-a388-ad0c3a909c76 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.451974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f4c8cbec-c536-4aed-a388-ad0c3a909c76 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.468391 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f4c8cbec-c536-4aed-a388-ad0c3a909c76 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.351104 Jul 20 04:16:31.499782 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1147/2238] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:31.779575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-94b724ec-1204-4303-8882-e706cf9a84b8 req-4623b583-4362-4ca7-8573-abf3743abac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107af339-79a5-4614-9494-f7e7c9b35159", "tag": "8fca47bf-d3d3-4b61-b662-85932e9972a7"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:31.809028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9e79e4f2-8c14-4b80-9213-5ad24b5033d8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.809665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9e79e4f2-8c14-4b80-9213-5ad24b5033d8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.834290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e79e4f2-8c14-4b80-9213-5ad24b5033d8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.834761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e79e4f2-8c14-4b80-9213-5ad24b5033d8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.835856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e79e4f2-8c14-4b80-9213-5ad24b5033d8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.837571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e79e4f2-8c14-4b80-9213-5ad24b5033d8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.839189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-94b724ec-1204-4303-8882-e706cf9a84b8 req-4623b583-4362-4ca7-8573-abf3743abac6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.862027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-94b724ec-1204-4303-8882-e706cf9a84b8 req-4623b583-4362-4ca7-8573-abf3743abac6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.911908 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-94b724ec-1204-4303-8882-e706cf9a84b8 req-4623b583-4362-4ca7-8573-abf3743abac6 service nova] Creating event network-changed:8fca47bf-d3d3-4b61-b662-85932e9972a7 for instance 107af339-79a5-4614-9494-f7e7c9b35159 on n-h1-760456-11 Jul 20 04:16:31.934629 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-94b724ec-1204-4303-8882-e706cf9a84b8 req-4623b583-4362-4ca7-8573-abf3743abac6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153480 Jul 20 04:16:31.935682 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1092/2239] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:31.950486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba35a6d9-75f6-413c-889f-40231618ad52 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.951548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ba35a6d9-75f6-413c-889f-40231618ad52 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.969599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba35a6d9-75f6-413c-889f-40231618ad52 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.972377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba35a6d9-75f6-413c-889f-40231618ad52 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.977114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba35a6d9-75f6-413c-889f-40231618ad52 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.978797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba35a6d9-75f6-413c-889f-40231618ad52 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.577271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9e79e4f2-8c14-4b80-9213-5ad24b5033d8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:32.586684 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9e79e4f2-8c14-4b80-9213-5ad24b5033d8 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1306 microversion: 2.1 time: 0.782969 Jul 20 04:16:32.590939 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1148/2240] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1306 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:32.596016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5aacc38f-519a-4620-95b8-16b90ae3ba05 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:32.599770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5aacc38f-519a-4620-95b8-16b90ae3ba05 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:32.614850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5aacc38f-519a-4620-95b8-16b90ae3ba05 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.621200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5aacc38f-519a-4620-95b8-16b90ae3ba05 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.622517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5aacc38f-519a-4620-95b8-16b90ae3ba05 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.622781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5aacc38f-519a-4620-95b8-16b90ae3ba05 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.687484 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5aacc38f-519a-4620-95b8-16b90ae3ba05 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.095239 Jul 20 04:16:32.698024 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1149/2241] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:32 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:32.705610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3394fbe4-a297-4c9d-b0f6-dc847ab4cdf5 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:32.708212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3394fbe4-a297-4c9d-b0f6-dc847ab4cdf5 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:32.728233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3394fbe4-a297-4c9d-b0f6-dc847ab4cdf5 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.728762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3394fbe4-a297-4c9d-b0f6-dc847ab4cdf5 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.729684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3394fbe4-a297-4c9d-b0f6-dc847ab4cdf5 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.730236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3394fbe4-a297-4c9d-b0f6-dc847ab4cdf5 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.905918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3394fbe4-a297-4c9d-b0f6-dc847ab4cdf5 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:32.917154 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3394fbe4-a297-4c9d-b0f6-dc847ab4cdf5 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1278 microversion: 2.1 time: 0.221890 Jul 20 04:16:32.920267 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1150/2242] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:32 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1278 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:32.929591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c3e1e262-8d2d-4985-8951-2a47306b34f5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:32.932248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c3e1e262-8d2d-4985-8951-2a47306b34f5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:32.956608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3e1e262-8d2d-4985-8951-2a47306b34f5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.957342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3e1e262-8d2d-4985-8951-2a47306b34f5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.958343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3e1e262-8d2d-4985-8951-2a47306b34f5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.958787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3e1e262-8d2d-4985-8951-2a47306b34f5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.344804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ba35a6d9-75f6-413c-889f-40231618ad52 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.355755 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ba35a6d9-75f6-413c-889f-40231618ad52 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1314 microversion: 2.1 time: 1.415343 Jul 20 04:16:33.356589 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1093/2243] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1314 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:33.463178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c3e1e262-8d2d-4985-8951-2a47306b34f5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.475222 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c3e1e262-8d2d-4985-8951-2a47306b34f5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.553473 Jul 20 04:16:33.479797 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1151/2244] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:32 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:33.607868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7afb1ae6-3d0c-4c26-b2f8-cebebef351b4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.608726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7afb1ae6-3d0c-4c26-b2f8-cebebef351b4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.622560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7afb1ae6-3d0c-4c26-b2f8-cebebef351b4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.623671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7afb1ae6-3d0c-4c26-b2f8-cebebef351b4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.627563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7afb1ae6-3d0c-4c26-b2f8-cebebef351b4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.629246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7afb1ae6-3d0c-4c26-b2f8-cebebef351b4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.706940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc047e6c-c6d2-4d76-8575-865c5b1e75d9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.707928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc047e6c-c6d2-4d76-8575-865c5b1e75d9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.720335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc047e6c-c6d2-4d76-8575-865c5b1e75d9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.720820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc047e6c-c6d2-4d76-8575-865c5b1e75d9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.721637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc047e6c-c6d2-4d76-8575-865c5b1e75d9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.722088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc047e6c-c6d2-4d76-8575-865c5b1e75d9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.759848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:33.790361 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc047e6c-c6d2-4d76-8575-865c5b1e75d9 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.088429 Jul 20 04:16:33.798441 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1152/2245] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:16:33.939223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-63b182ac-2d11-4a88-afe2-ea21d7f5c306 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.943083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63b182ac-2d11-4a88-afe2-ea21d7f5c306 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.973523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b182ac-2d11-4a88-afe2-ea21d7f5c306 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.974210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b182ac-2d11-4a88-afe2-ea21d7f5c306 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.975104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b182ac-2d11-4a88-afe2-ea21d7f5c306 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.978545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b182ac-2d11-4a88-afe2-ea21d7f5c306 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.290772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-63b182ac-2d11-4a88-afe2-ea21d7f5c306 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.302806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7afb1ae6-3d0c-4c26-b2f8-cebebef351b4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.303292 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-63b182ac-2d11-4a88-afe2-ea21d7f5c306 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1320 microversion: 2.1 time: 0.369610 Jul 20 04:16:34.304330 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1153/2246] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:34.331970 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7afb1ae6-3d0c-4c26-b2f8-cebebef351b4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1306 microversion: 2.1 time: 0.728159 Jul 20 04:16:34.345934 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1094/2247] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1306 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:34.374100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b375a8b8-76b1-4068-8a5c-4d5d1e17e0fd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.374934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b375a8b8-76b1-4068-8a5c-4d5d1e17e0fd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:34.393937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b375a8b8-76b1-4068-8a5c-4d5d1e17e0fd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.394595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b375a8b8-76b1-4068-8a5c-4d5d1e17e0fd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.395502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b375a8b8-76b1-4068-8a5c-4d5d1e17e0fd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.396189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b375a8b8-76b1-4068-8a5c-4d5d1e17e0fd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.499229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2d0e7c55-c9f0-41af-896e-af303e99f75f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.500697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2d0e7c55-c9f0-41af-896e-af303e99f75f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:34.520208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d0e7c55-c9f0-41af-896e-af303e99f75f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.521120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d0e7c55-c9f0-41af-896e-af303e99f75f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.522830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d0e7c55-c9f0-41af-896e-af303e99f75f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.523615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d0e7c55-c9f0-41af-896e-af303e99f75f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.804048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b375a8b8-76b1-4068-8a5c-4d5d1e17e0fd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.819464 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b375a8b8-76b1-4068-8a5c-4d5d1e17e0fd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1314 microversion: 2.1 time: 0.448322 Jul 20 04:16:34.822738 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1154/2248] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:34.827998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2d5a70dc-549b-48c1-837a-6b04e8108107 req-90a093b2-8d4c-403e-a004-4fc5ae90d673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc9bd9c-e200-4378-ba53-b9ad6e75188e", "name": "network-vif-plugged", "status": "completed", "tag": "d18001fe-d6ba-482f-9446-aadb25160845"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:34.853103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2d5a70dc-549b-48c1-837a-6b04e8108107 req-90a093b2-8d4c-403e-a004-4fc5ae90d673 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.853721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2d5a70dc-549b-48c1-837a-6b04e8108107 req-90a093b2-8d4c-403e-a004-4fc5ae90d673 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.872737 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2d5a70dc-549b-48c1-837a-6b04e8108107 req-90a093b2-8d4c-403e-a004-4fc5ae90d673 service nova] Creating event network-vif-plugged:d18001fe-d6ba-482f-9446-aadb25160845 for instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e on n-h2-760456-11 Jul 20 04:16:34.891233 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2d5a70dc-549b-48c1-837a-6b04e8108107 req-90a093b2-8d4c-403e-a004-4fc5ae90d673 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066742 Jul 20 04:16:34.903424 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1155/2249] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:34.909131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-82358326-dc98-4623-856b-e0a0da93fe30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.910264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-82358326-dc98-4623-856b-e0a0da93fe30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:34.924720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82358326-dc98-4623-856b-e0a0da93fe30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.925542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82358326-dc98-4623-856b-e0a0da93fe30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.926563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82358326-dc98-4623-856b-e0a0da93fe30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.927172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82358326-dc98-4623-856b-e0a0da93fe30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.001346 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-82358326-dc98-4623-856b-e0a0da93fe30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096454 Jul 20 04:16:35.003068 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1156/2250] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:35.164903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2d0e7c55-c9f0-41af-896e-af303e99f75f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.172925 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2d0e7c55-c9f0-41af-896e-af303e99f75f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.678546 Jul 20 04:16:35.186234 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1095/2251] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:35.321782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9b2ead2c-8270-4462-83e0-59d192dc9f33 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:35.323916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9b2ead2c-8270-4462-83e0-59d192dc9f33 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:35.334201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b2ead2c-8270-4462-83e0-59d192dc9f33 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.335501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b2ead2c-8270-4462-83e0-59d192dc9f33 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.337976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b2ead2c-8270-4462-83e0-59d192dc9f33 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.339054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b2ead2c-8270-4462-83e0-59d192dc9f33 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.357948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-697fe0c2-6694-49ca-8d13-882cb881fc24 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:35.359415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-697fe0c2-6694-49ca-8d13-882cb881fc24 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:35.388540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-697fe0c2-6694-49ca-8d13-882cb881fc24 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.395009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-697fe0c2-6694-49ca-8d13-882cb881fc24 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.395866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-697fe0c2-6694-49ca-8d13-882cb881fc24 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.396314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-697fe0c2-6694-49ca-8d13-882cb881fc24 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.919144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-697fe0c2-6694-49ca-8d13-882cb881fc24 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.935815 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-697fe0c2-6694-49ca-8d13-882cb881fc24 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1306 microversion: 2.1 time: 0.585499 Jul 20 04:16:35.940948 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1096/2252] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:35 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1306 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:35.946592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-98f025f2-dd06-40e2-8f53-635ab600f2b3 req-fa791520-a89a-4870-98ed-eda8b408ecaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c561dbb2-7811-4eeb-b05c-0df4ee20c622", "tag": "a6706761-958b-4296-a870-aeec2c2ceae8"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:35.966028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-98f025f2-dd06-40e2-8f53-635ab600f2b3 req-fa791520-a89a-4870-98ed-eda8b408ecaa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.967369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-98f025f2-dd06-40e2-8f53-635ab600f2b3 req-fa791520-a89a-4870-98ed-eda8b408ecaa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.005562 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-98f025f2-dd06-40e2-8f53-635ab600f2b3 req-fa791520-a89a-4870-98ed-eda8b408ecaa service nova] Creating event network-changed:a6706761-958b-4296-a870-aeec2c2ceae8 for instance c561dbb2-7811-4eeb-b05c-0df4ee20c622 on n-h2-760456-11 Jul 20 04:16:36.023779 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-98f025f2-dd06-40e2-8f53-635ab600f2b3 req-fa791520-a89a-4870-98ed-eda8b408ecaa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080091 Jul 20 04:16:36.024947 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1097/2253] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:36.035867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bfd5af9-303d-48fa-9c97-17402de8d14f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:36.036957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6bfd5af9-303d-48fa-9c97-17402de8d14f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:36.051473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bfd5af9-303d-48fa-9c97-17402de8d14f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.056283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bfd5af9-303d-48fa-9c97-17402de8d14f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.057816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bfd5af9-303d-48fa-9c97-17402de8d14f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.058620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bfd5af9-303d-48fa-9c97-17402de8d14f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.173318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9b2ead2c-8270-4462-83e0-59d192dc9f33 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.187854 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9b2ead2c-8270-4462-83e0-59d192dc9f33 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1320 microversion: 2.1 time: 0.870851 Jul 20 04:16:36.191870 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1157/2254] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:35 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1320 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:36.198623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-00f95d12-fe86-4946-bdaf-2350cae561f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:36.205174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-00f95d12-fe86-4946-bdaf-2350cae561f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:36.223486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00f95d12-fe86-4946-bdaf-2350cae561f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.224649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00f95d12-fe86-4946-bdaf-2350cae561f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.228028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00f95d12-fe86-4946-bdaf-2350cae561f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.228744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00f95d12-fe86-4946-bdaf-2350cae561f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.297997 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-00f95d12-fe86-4946-bdaf-2350cae561f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104123 Jul 20 04:16:36.299368 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1158/2255] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:36 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:36.305069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1dcae4bb-6005-49aa-b06e-9652bef51b82 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:36.306295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1dcae4bb-6005-49aa-b06e-9652bef51b82 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:36.314407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dcae4bb-6005-49aa-b06e-9652bef51b82 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.317250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dcae4bb-6005-49aa-b06e-9652bef51b82 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.318954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dcae4bb-6005-49aa-b06e-9652bef51b82 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.319678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dcae4bb-6005-49aa-b06e-9652bef51b82 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.782339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1dcae4bb-6005-49aa-b06e-9652bef51b82 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.798591 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1dcae4bb-6005-49aa-b06e-9652bef51b82 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.492060 Jul 20 04:16:36.802080 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1159/2256] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:36 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:36.958789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4c1aa3d-8419-4def-bae1-288357f2cf99 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:36.959859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a4c1aa3d-8419-4def-bae1-288357f2cf99 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:36.969338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4c1aa3d-8419-4def-bae1-288357f2cf99 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.970005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4c1aa3d-8419-4def-bae1-288357f2cf99 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.971411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4c1aa3d-8419-4def-bae1-288357f2cf99 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.972314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4c1aa3d-8419-4def-bae1-288357f2cf99 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.219797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6bfd5af9-303d-48fa-9c97-17402de8d14f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.237423 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6bfd5af9-303d-48fa-9c97-17402de8d14f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1314 microversion: 2.1 time: 1.211083 Jul 20 04:16:37.248547 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1098/2257] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:36 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1314 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:37.275793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-82ce5799-a274-49a5-9df3-ddc35fb0fdef tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:37.276937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-82ce5799-a274-49a5-9df3-ddc35fb0fdef tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:37.292212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82ce5799-a274-49a5-9df3-ddc35fb0fdef tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.292669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82ce5799-a274-49a5-9df3-ddc35fb0fdef tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.293472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82ce5799-a274-49a5-9df3-ddc35fb0fdef tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.293925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82ce5799-a274-49a5-9df3-ddc35fb0fdef tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.341400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:37.412242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a4c1aa3d-8419-4def-bae1-288357f2cf99 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.421527 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a4c1aa3d-8419-4def-bae1-288357f2cf99 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1306 microversion: 2.1 time: 0.468266 Jul 20 04:16:37.422701 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1160/2258] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:36 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1306 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:37.435548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-331d0aec-5af7-4dca-8ad2-40d3da4e895f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:37.436868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-331d0aec-5af7-4dca-8ad2-40d3da4e895f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:37.450162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-331d0aec-5af7-4dca-8ad2-40d3da4e895f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.452085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-331d0aec-5af7-4dca-8ad2-40d3da4e895f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.453440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-331d0aec-5af7-4dca-8ad2-40d3da4e895f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.454760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-331d0aec-5af7-4dca-8ad2-40d3da4e895f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.497501 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-331d0aec-5af7-4dca-8ad2-40d3da4e895f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.073490 Jul 20 04:16:37.507391 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1161/2259] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:37 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:37.513900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-7aa9af90-2abf-4534-87b6-456219c44035 req-eeb515fc-f04c-4a07-8209-007b168fbb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107af339-79a5-4614-9494-f7e7c9b35159", "name": "network-vif-plugged", "status": "completed", "tag": "8fca47bf-d3d3-4b61-b662-85932e9972a7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:37.528757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7aa9af90-2abf-4534-87b6-456219c44035 req-eeb515fc-f04c-4a07-8209-007b168fbb0c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.529383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7aa9af90-2abf-4534-87b6-456219c44035 req-eeb515fc-f04c-4a07-8209-007b168fbb0c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.562495 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-7aa9af90-2abf-4534-87b6-456219c44035 req-eeb515fc-f04c-4a07-8209-007b168fbb0c service nova] Creating event network-vif-plugged:8fca47bf-d3d3-4b61-b662-85932e9972a7 for instance 107af339-79a5-4614-9494-f7e7c9b35159 on n-h1-760456-11 Jul 20 04:16:37.568531 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-7aa9af90-2abf-4534-87b6-456219c44035 req-eeb515fc-f04c-4a07-8209-007b168fbb0c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058306 Jul 20 04:16:37.569867 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1162/2260] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:37.820862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea1e9611-53d0-4e54-89ce-0baa4f15c7e8 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:37.821575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea1e9611-53d0-4e54-89ce-0baa4f15c7e8 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:37.833084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:37.837672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea1e9611-53d0-4e54-89ce-0baa4f15c7e8 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.838143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea1e9611-53d0-4e54-89ce-0baa4f15c7e8 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.840584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea1e9611-53d0-4e54-89ce-0baa4f15c7e8 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.845222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea1e9611-53d0-4e54-89ce-0baa4f15c7e8 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.125692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-82ce5799-a274-49a5-9df3-ddc35fb0fdef tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.149400 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-82ce5799-a274-49a5-9df3-ddc35fb0fdef tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1320 microversion: 2.1 time: 0.898428 Jul 20 04:16:38.150895 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1099/2261] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:37 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1320 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:38.156199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-be850aeb-a96b-4f2b-87c0-9270798be6f2 req-aad1c1c0-a30b-470a-bdfa-4b58cfda6528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1abff566-159f-47af-9776-f4a4d9e7db92", "tag": "49bfe6c2-2deb-45cd-96e2-da9e640c6623"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:38.184587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-be850aeb-a96b-4f2b-87c0-9270798be6f2 req-aad1c1c0-a30b-470a-bdfa-4b58cfda6528 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.185365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-be850aeb-a96b-4f2b-87c0-9270798be6f2 req-aad1c1c0-a30b-470a-bdfa-4b58cfda6528 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.204484 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-be850aeb-a96b-4f2b-87c0-9270798be6f2 req-aad1c1c0-a30b-470a-bdfa-4b58cfda6528 service nova] Creating event network-changed:49bfe6c2-2deb-45cd-96e2-da9e640c6623 for instance 1abff566-159f-47af-9776-f4a4d9e7db92 on n-h2-760456-11 Jul 20 04:16:38.213536 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-be850aeb-a96b-4f2b-87c0-9270798be6f2 req-aad1c1c0-a30b-470a-bdfa-4b58cfda6528 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061237 Jul 20 04:16:38.214999 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1100/2262] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:38.263692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ea1e9611-53d0-4e54-89ce-0baa4f15c7e8 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.273915 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea1e9611-53d0-4e54-89ce-0baa4f15c7e8 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.458141 Jul 20 04:16:38.277529 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1163/2263] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:37 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:38.280216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4bbd888-f6b1-4052-8d33-fb1c4eebc363 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:38.281961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b4bbd888-f6b1-4052-8d33-fb1c4eebc363 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:38.291837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4bbd888-f6b1-4052-8d33-fb1c4eebc363 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.294688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4bbd888-f6b1-4052-8d33-fb1c4eebc363 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.296034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4bbd888-f6b1-4052-8d33-fb1c4eebc363 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.298549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4bbd888-f6b1-4052-8d33-fb1c4eebc363 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.440902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-43697fd4-6f06-4b54-96a7-ed68c97ffc4e tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:38.442229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-43697fd4-6f06-4b54-96a7-ed68c97ffc4e tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:38.461470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43697fd4-6f06-4b54-96a7-ed68c97ffc4e tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.462651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43697fd4-6f06-4b54-96a7-ed68c97ffc4e tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.463759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43697fd4-6f06-4b54-96a7-ed68c97ffc4e tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.464444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43697fd4-6f06-4b54-96a7-ed68c97ffc4e tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.762222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:38.813494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b4bbd888-f6b1-4052-8d33-fb1c4eebc363 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.817782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=42 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:38.828907 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b4bbd888-f6b1-4052-8d33-fb1c4eebc363 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1272 microversion: 2.1 time: 0.575397 Jul 20 04:16:38.838667 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1101/2264] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:38 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1272 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:38.909208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-43697fd4-6f06-4b54-96a7-ed68c97ffc4e tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.919060 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-43697fd4-6f06-4b54-96a7-ed68c97ffc4e tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1306 microversion: 2.1 time: 0.484066 Jul 20 04:16:38.932199 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1164/2265] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:38 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1306 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:39.168045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa61d3fd-f560-4fb4-84ea-78abe5b404b6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:39.168678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fa61d3fd-f560-4fb4-84ea-78abe5b404b6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:39.187625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa61d3fd-f560-4fb4-84ea-78abe5b404b6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.189929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa61d3fd-f560-4fb4-84ea-78abe5b404b6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.191035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa61d3fd-f560-4fb4-84ea-78abe5b404b6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.194513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa61d3fd-f560-4fb4-84ea-78abe5b404b6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.294634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-421bffb0-bd9e-445a-bc60-f7fb371aeba3 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:39.295223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-421bffb0-bd9e-445a-bc60-f7fb371aeba3 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:39.302206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-421bffb0-bd9e-445a-bc60-f7fb371aeba3 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.302703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-421bffb0-bd9e-445a-bc60-f7fb371aeba3 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.303727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-421bffb0-bd9e-445a-bc60-f7fb371aeba3 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.320647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-421bffb0-bd9e-445a-bc60-f7fb371aeba3 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.455364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:39.497150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-421bffb0-bd9e-445a-bc60-f7fb371aeba3 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.506299 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-421bffb0-bd9e-445a-bc60-f7fb371aeba3 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.215560 Jul 20 04:16:39.519426 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1165/2266] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:39.852356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb18e618-48a7-4424-b7c3-d35153ed2844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:39.852999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb18e618-48a7-4424-b7c3-d35153ed2844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:39.870857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb18e618-48a7-4424-b7c3-d35153ed2844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.871368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb18e618-48a7-4424-b7c3-d35153ed2844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.880660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb18e618-48a7-4424-b7c3-d35153ed2844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.883594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb18e618-48a7-4424-b7c3-d35153ed2844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.944288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fa61d3fd-f560-4fb4-84ea-78abe5b404b6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.957003 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa61d3fd-f560-4fb4-84ea-78abe5b404b6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1320 microversion: 2.1 time: 0.794019 Jul 20 04:16:39.957594 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1102/2267] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1320 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:40.000669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-28e30ec1-aaf6-452b-81c4-7b0f70bccc7f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:40.003661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-28e30ec1-aaf6-452b-81c4-7b0f70bccc7f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:40.018722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28e30ec1-aaf6-452b-81c4-7b0f70bccc7f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.020038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28e30ec1-aaf6-452b-81c4-7b0f70bccc7f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.021041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28e30ec1-aaf6-452b-81c4-7b0f70bccc7f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.021754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28e30ec1-aaf6-452b-81c4-7b0f70bccc7f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.068543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb18e618-48a7-4424-b7c3-d35153ed2844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:40.085415 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb18e618-48a7-4424-b7c3-d35153ed2844 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1293 microversion: 2.1 time: 0.237287 Jul 20 04:16:40.091994 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1166/2268] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1293 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:40.258467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-69df66a7-a1af-4005-b025-2a22f8a05709 req-191e4b04-68e2-41e9-be71-5cee1ff92589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc9bd9c-e200-4378-ba53-b9ad6e75188e", "name": "network-vif-deleted", "tag": "d18001fe-d6ba-482f-9446-aadb25160845"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:40.277868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-69df66a7-a1af-4005-b025-2a22f8a05709 req-191e4b04-68e2-41e9-be71-5cee1ff92589 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.280101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-69df66a7-a1af-4005-b025-2a22f8a05709 req-191e4b04-68e2-41e9-be71-5cee1ff92589 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.307601 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-69df66a7-a1af-4005-b025-2a22f8a05709 req-191e4b04-68e2-41e9-be71-5cee1ff92589 service nova] Creating event network-vif-deleted:d18001fe-d6ba-482f-9446-aadb25160845 for instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e on n-h2-760456-11 Jul 20 04:16:40.320825 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-69df66a7-a1af-4005-b025-2a22f8a05709 req-191e4b04-68e2-41e9-be71-5cee1ff92589 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066492 Jul 20 04:16:40.323656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-28e30ec1-aaf6-452b-81c4-7b0f70bccc7f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:40.324884 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1167/2269] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:16:40.340494 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-28e30ec1-aaf6-452b-81c4-7b0f70bccc7f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1294 microversion: 2.1 time: 0.370107 Jul 20 04:16:40.342181 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1103/2270] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1294 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:40.526124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4c5b2938-3801-4f83-87bd-5c31cf327c7b tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:40.527617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4c5b2938-3801-4f83-87bd-5c31cf327c7b tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:40.547670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c5b2938-3801-4f83-87bd-5c31cf327c7b tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.556146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c5b2938-3801-4f83-87bd-5c31cf327c7b tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.558775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c5b2938-3801-4f83-87bd-5c31cf327c7b tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.560090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c5b2938-3801-4f83-87bd-5c31cf327c7b tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.953631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4c5b2938-3801-4f83-87bd-5c31cf327c7b tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:40.966797 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4c5b2938-3801-4f83-87bd-5c31cf327c7b tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.445191 Jul 20 04:16:40.974995 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1168/2271] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:40 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:40.979633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-989d0641-7a38-4791-8bb9-0a047a5e90c4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:40.984831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-989d0641-7a38-4791-8bb9-0a047a5e90c4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.001314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-989d0641-7a38-4791-8bb9-0a047a5e90c4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.001781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-989d0641-7a38-4791-8bb9-0a047a5e90c4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.002606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-989d0641-7a38-4791-8bb9-0a047a5e90c4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.003052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-989d0641-7a38-4791-8bb9-0a047a5e90c4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.117542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06c3dc83-70cb-49c1-bb5c-77afa888db78 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.118301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-06c3dc83-70cb-49c1-bb5c-77afa888db78 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.141051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06c3dc83-70cb-49c1-bb5c-77afa888db78 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.141510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06c3dc83-70cb-49c1-bb5c-77afa888db78 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.142346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06c3dc83-70cb-49c1-bb5c-77afa888db78 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.142796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06c3dc83-70cb-49c1-bb5c-77afa888db78 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.213299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-989d0641-7a38-4791-8bb9-0a047a5e90c4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:41.227336 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-989d0641-7a38-4791-8bb9-0a047a5e90c4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1320 microversion: 2.1 time: 0.255502 Jul 20 04:16:41.229987 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1104/2272] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:40 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:41.277488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-06c3dc83-70cb-49c1-bb5c-77afa888db78 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:41.288259 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-06c3dc83-70cb-49c1-bb5c-77afa888db78 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1293 microversion: 2.1 time: 0.177790 Jul 20 04:16:41.288908 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1169/2273] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1293 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:41.358680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-78ae08c6-25f1-452a-9a50-c70123b1b8bd tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.360109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-78ae08c6-25f1-452a-9a50-c70123b1b8bd tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.369520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ae08c6-25f1-452a-9a50-c70123b1b8bd tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.371198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ae08c6-25f1-452a-9a50-c70123b1b8bd tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.372736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ae08c6-25f1-452a-9a50-c70123b1b8bd tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.373684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ae08c6-25f1-452a-9a50-c70123b1b8bd tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.665381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-78ae08c6-25f1-452a-9a50-c70123b1b8bd tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:41.681384 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-78ae08c6-25f1-452a-9a50-c70123b1b8bd tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1294 microversion: 2.1 time: 0.327485 Jul 20 04:16:41.682439 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1105/2274] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1294 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:41.983699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-969af77f-52d0-40a9-90c9-6ec45405b7f6 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.985041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-969af77f-52d0-40a9-90c9-6ec45405b7f6 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.991930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-969af77f-52d0-40a9-90c9-6ec45405b7f6 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.992959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-969af77f-52d0-40a9-90c9-6ec45405b7f6 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.994207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-969af77f-52d0-40a9-90c9-6ec45405b7f6 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.994896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-969af77f-52d0-40a9-90c9-6ec45405b7f6 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.118196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7dcce2c1-d995-4b69-82e0-3363e38aa695 tempest-ListImagesTestJSON-327080655 tempest-ListImagesTestJSON-327080655-project] Calling method '.version_select at 0x7fb8422d4d30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.175641 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7dcce2c1-d995-4b69-82e0-3363e38aa695 tempest-ListImagesTestJSON-327080655 tempest-ListImagesTestJSON-327080655-project] 10.222.0.59 "GET /compute/v2.1/images/e42aeec8-ce44-4145-9a4d-e614edbe956b" status: 200 len: 784 microversion: 2.1 time: 0.199845 Jul 20 04:16:42.176889 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1170/2275] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/images/e42aeec8-ce44-4145-9a4d-e614edbe956b => generated 784 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:42.191218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3934efa-9191-4c6a-bc15-e6c471ac9285 tempest-ListImagesTestJSON-327080655 tempest-ListImagesTestJSON-327080655-project] Calling method '.version_select at 0x7fb841d33040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.281855 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d3934efa-9191-4c6a-bc15-e6c471ac9285 tempest-ListImagesTestJSON-327080655 tempest-ListImagesTestJSON-327080655-project] 10.222.0.59 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.096132 Jul 20 04:16:42.282899 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1171/2276] 10.222.0.59 () {58 vars in 1121 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/images => generated 445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:42.290115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e82240d8-4545-46d2-bec9-377dd255f7d9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.290999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e82240d8-4545-46d2-bec9-377dd255f7d9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.299790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e82240d8-4545-46d2-bec9-377dd255f7d9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.300599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e82240d8-4545-46d2-bec9-377dd255f7d9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.301806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e82240d8-4545-46d2-bec9-377dd255f7d9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.302446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e82240d8-4545-46d2-bec9-377dd255f7d9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.475061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e82240d8-4545-46d2-bec9-377dd255f7d9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.481010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:42.505061 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e82240d8-4545-46d2-bec9-377dd255f7d9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1320 microversion: 2.1 time: 0.210132 Jul 20 04:16:42.506387 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1172/2277] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:42.512630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d29b231-985e-49df-92c9-717f6609e0ce tempest-ListImagesTestJSON-327080655 tempest-ListImagesTestJSON-327080655-project] Calling method '.version_select at 0x7fb8422d4e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.576246 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d29b231-985e-49df-92c9-717f6609e0ce tempest-ListImagesTestJSON-327080655 tempest-ListImagesTestJSON-327080655-project] 10.222.0.59 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.068483 Jul 20 04:16:42.577098 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1173/2278] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:42.582489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-46acbaaa-0d31-429f-975c-38af160a03a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.583528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-46acbaaa-0d31-429f-975c-38af160a03a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.614865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46acbaaa-0d31-429f-975c-38af160a03a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.617328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46acbaaa-0d31-429f-975c-38af160a03a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.618317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46acbaaa-0d31-429f-975c-38af160a03a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.618888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46acbaaa-0d31-429f-975c-38af160a03a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.815930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-969af77f-52d0-40a9-90c9-6ec45405b7f6 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.822975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-46acbaaa-0d31-429f-975c-38af160a03a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.827270 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-969af77f-52d0-40a9-90c9-6ec45405b7f6 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.847334 Jul 20 04:16:42.839063 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1106/2279] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:42.852432 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-46acbaaa-0d31-429f-975c-38af160a03a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 200 len: 1293 microversion: 2.1 time: 0.271014 Jul 20 04:16:42.853783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6916334-9a0c-4625-a8e3-6c9697553ac9 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.853926 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1174/2280] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 1293 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:42.854738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6916334-9a0c-4625-a8e3-6c9697553ac9 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.862095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6916334-9a0c-4625-a8e3-6c9697553ac9 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.862857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6916334-9a0c-4625-a8e3-6c9697553ac9 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.863889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6916334-9a0c-4625-a8e3-6c9697553ac9 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.864986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6916334-9a0c-4625-a8e3-6c9697553ac9 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.942788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-36f1b1ca-fe14-47cb-85a7-1ab67d7a4318 req-e7dc6149-40d9-4f16-9aed-8d5812b7f142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c561dbb2-7811-4eeb-b05c-0df4ee20c622", "name": "network-vif-plugged", "status": "completed", "tag": "a6706761-958b-4296-a870-aeec2c2ceae8"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:42.960059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-36f1b1ca-fe14-47cb-85a7-1ab67d7a4318 req-e7dc6149-40d9-4f16-9aed-8d5812b7f142 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.967230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-36f1b1ca-fe14-47cb-85a7-1ab67d7a4318 req-e7dc6149-40d9-4f16-9aed-8d5812b7f142 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.032637 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-36f1b1ca-fe14-47cb-85a7-1ab67d7a4318 req-e7dc6149-40d9-4f16-9aed-8d5812b7f142 service nova] Creating event network-vif-plugged:a6706761-958b-4296-a870-aeec2c2ceae8 for instance c561dbb2-7811-4eeb-b05c-0df4ee20c622 on n-h2-760456-11 Jul 20 04:16:43.054025 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-36f1b1ca-fe14-47cb-85a7-1ab67d7a4318 req-e7dc6149-40d9-4f16-9aed-8d5812b7f142 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114475 Jul 20 04:16:43.055458 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1175/2281] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:16:43.311515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f6916334-9a0c-4625-a8e3-6c9697553ac9 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:43.319579 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6916334-9a0c-4625-a8e3-6c9697553ac9 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1294 microversion: 2.1 time: 0.479195 Jul 20 04:16:43.324078 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1107/2282] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1294 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:43.522989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-91a16a9a-559c-4b81-ba53-20d7ea76e887 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.524285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-91a16a9a-559c-4b81-ba53-20d7ea76e887 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.541448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a16a9a-559c-4b81-ba53-20d7ea76e887 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.541909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a16a9a-559c-4b81-ba53-20d7ea76e887 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.542728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a16a9a-559c-4b81-ba53-20d7ea76e887 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.543169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a16a9a-559c-4b81-ba53-20d7ea76e887 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.784663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-91a16a9a-559c-4b81-ba53-20d7ea76e887 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:43.801997 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-91a16a9a-559c-4b81-ba53-20d7ea76e887 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1320 microversion: 2.1 time: 0.283091 Jul 20 04:16:43.803838 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1176/2283] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:43.849186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-499deea9-336b-45e2-8215-c561759b4440 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.850042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-499deea9-336b-45e2-8215-c561759b4440 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.858116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-499deea9-336b-45e2-8215-c561759b4440 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.858942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-499deea9-336b-45e2-8215-c561759b4440 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.860161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-499deea9-336b-45e2-8215-c561759b4440 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.860792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-499deea9-336b-45e2-8215-c561759b4440 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.873444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cdaf03a2-8d86-4c69-b254-88b265cfa19c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.873996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cdaf03a2-8d86-4c69-b254-88b265cfa19c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.883995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cdaf03a2-8d86-4c69-b254-88b265cfa19c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.884467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cdaf03a2-8d86-4c69-b254-88b265cfa19c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.889065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cdaf03a2-8d86-4c69-b254-88b265cfa19c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.890946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cdaf03a2-8d86-4c69-b254-88b265cfa19c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.917502 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-cdaf03a2-8d86-4c69-b254-88b265cfa19c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cdaf03a2-8d86-4c69-b254-88b265cfa19c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e HTTP/1.1 Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'cfc9bd9c-e200-4378-ba53-b9ad6e75188e'} Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:43.919402 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:43.923875 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:43.923875 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:43.923875 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:43.923875 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:43.923875 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:43.923875 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:16:43.923875 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:43.925342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cdaf03a2-8d86-4c69-b254-88b265cfa19c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:43.926418 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cdaf03a2-8d86-4c69-b254-88b265cfa19c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 404 len: 111 microversion: 2.1 time: 0.060024 Jul 20 04:16:43.927433 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1177/2284] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:44.081880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-499deea9-336b-45e2-8215-c561759b4440 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.090194 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-499deea9-336b-45e2-8215-c561759b4440 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.244833 Jul 20 04:16:44.090814 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1108/2285] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:44.107243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1039683235", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "191d678e-1adc-40c3-b7b1-1a7cb20ca675"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:44.184792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] validate_networks() for [('191d678e-1adc-40c3-b7b1-1a7cb20ca675', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:44.268954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c6475e2-ffd6-4a83-bc0a-441ba136180a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.269637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c6475e2-ffd6-4a83-bc0a-441ba136180a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.282777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c6475e2-ffd6-4a83-bc0a-441ba136180a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.284226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c6475e2-ffd6-4a83-bc0a-441ba136180a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.285840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c6475e2-ffd6-4a83-bc0a-441ba136180a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.287175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c6475e2-ffd6-4a83-bc0a-441ba136180a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.339940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c6475e2-ffd6-4a83-bc0a-441ba136180a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:44.455416 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c6475e2-ffd6-4a83-bc0a-441ba136180a tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 204 len: 0 microversion: 2.1 time: 0.189789 Jul 20 04:16:44.456874 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1109/2286] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:44 2022] DELETE /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:44.468263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4b217e8c-fe65-4aa6-a312-c862f6f54a01 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.469228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4b217e8c-fe65-4aa6-a312-c862f6f54a01 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.484004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b217e8c-fe65-4aa6-a312-c862f6f54a01 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.485272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b217e8c-fe65-4aa6-a312-c862f6f54a01 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.501003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b217e8c-fe65-4aa6-a312-c862f6f54a01 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.501835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b217e8c-fe65-4aa6-a312-c862f6f54a01 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.734239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4b217e8c-fe65-4aa6-a312-c862f6f54a01 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.750417 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4b217e8c-fe65-4aa6-a312-c862f6f54a01 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1294 microversion: 2.1 time: 0.291554 Jul 20 04:16:44.766808 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1110/2287] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1294 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:44.779771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-30fec238-754e-42db-95ab-d06b6c004270 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.780989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-30fec238-754e-42db-95ab-d06b6c004270 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.791617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30fec238-754e-42db-95ab-d06b6c004270 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.792436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30fec238-754e-42db-95ab-d06b6c004270 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.793767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30fec238-754e-42db-95ab-d06b6c004270 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.794620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30fec238-754e-42db-95ab-d06b6c004270 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.921094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:44.921631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:44.921998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:44.922689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:44.923110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:44.940638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.941105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.945559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.946106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.022234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:45.033593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for user 9f053f31c02c412394d48ce65350d153 and project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:45.069997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:45.075281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:45.098687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-30fec238-754e-42db-95ab-d06b6c004270 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.140015 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-30fec238-754e-42db-95ab-d06b6c004270 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1667 microversion: 2.1 time: 0.352968 Jul 20 04:16:45.146958 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1111/2288] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1667 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:45.162754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6e89cd2-8dae-4814-85f7-2343e83fa880 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.162754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6e89cd2-8dae-4814-85f7-2343e83fa880 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.172572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6e89cd2-8dae-4814-85f7-2343e83fa880 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.173041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6e89cd2-8dae-4814-85f7-2343e83fa880 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.174692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6e89cd2-8dae-4814-85f7-2343e83fa880 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.175246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6e89cd2-8dae-4814-85f7-2343e83fa880 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.190993 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f102ecbd-9f40-475f-ad61-073699500c2e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085967 Jul 20 04:16:45.199998 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1178/2289] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:45.231929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c93d60bd-861e-4d23-ad40-a8cb09cc8bee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.232594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c93d60bd-861e-4d23-ad40-a8cb09cc8bee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.248288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c93d60bd-861e-4d23-ad40-a8cb09cc8bee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.251724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c93d60bd-861e-4d23-ad40-a8cb09cc8bee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.252560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c93d60bd-861e-4d23-ad40-a8cb09cc8bee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.253019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c93d60bd-861e-4d23-ad40-a8cb09cc8bee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.487946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f6e89cd2-8dae-4814-85f7-2343e83fa880 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.499834 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6e89cd2-8dae-4814-85f7-2343e83fa880 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1320 microversion: 2.1 time: 0.350113 Jul 20 04:16:45.500435 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1112/2290] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1320 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:45.511383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e1e700d7-e3c5-4393-8207-3b518818c000 req-257f9078-e1ad-4fc7-ac01-774fadc2e885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1abff566-159f-47af-9776-f4a4d9e7db92", "name": "network-vif-plugged", "status": "completed", "tag": "49bfe6c2-2deb-45cd-96e2-da9e640c6623"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:45.525905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c93d60bd-861e-4d23-ad40-a8cb09cc8bee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.534307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e1e700d7-e3c5-4393-8207-3b518818c000 req-257f9078-e1ad-4fc7-ac01-774fadc2e885 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.534757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e1e700d7-e3c5-4393-8207-3b518818c000 req-257f9078-e1ad-4fc7-ac01-774fadc2e885 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.538885 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c93d60bd-861e-4d23-ad40-a8cb09cc8bee tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.336298 Jul 20 04:16:45.540606 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1179/2291] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:45.547227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-936e3adf-d897-435c-b450-20d2b1f2c96b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.548286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-936e3adf-d897-435c-b450-20d2b1f2c96b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.563678 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e1e700d7-e3c5-4393-8207-3b518818c000 req-257f9078-e1ad-4fc7-ac01-774fadc2e885 service nova] Creating event network-vif-plugged:49bfe6c2-2deb-45cd-96e2-da9e640c6623 for instance 1abff566-159f-47af-9776-f4a4d9e7db92 on n-h2-760456-11 Jul 20 04:16:45.572198 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e1e700d7-e3c5-4393-8207-3b518818c000 req-257f9078-e1ad-4fc7-ac01-774fadc2e885 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069911 Jul 20 04:16:45.573655 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1113/2292] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:45.758706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-936e3adf-d897-435c-b450-20d2b1f2c96b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.770853 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-936e3adf-d897-435c-b450-20d2b1f2c96b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1215 microversion: 2.1 time: 0.228955 Jul 20 04:16:45.775148 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1180/2293] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:45.781021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1f1af146-e192-4d31-b8df-3e6e8f7e9263 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.781912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1f1af146-e192-4d31-b8df-3e6e8f7e9263 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.809553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f1af146-e192-4d31-b8df-3e6e8f7e9263 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.813260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f1af146-e192-4d31-b8df-3e6e8f7e9263 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.815333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f1af146-e192-4d31-b8df-3e6e8f7e9263 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.818185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f1af146-e192-4d31-b8df-3e6e8f7e9263 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.883155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-712919e4-881e-45d8-9756-672f564932cd tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Action: 'create', calling method: .version_select at 0x7fb841cb0dc0>, body: {"keypair": {"name": "tempest-keypair-1788840042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRdIBuhKFPiigi5rbdaC85X7GgierpQ6vihdhOaLBTF2+AWsM79X/qmZNSNnchiozr1bjEepInxhvo7BeO0omj65GlZ4dzNzfOBMGkYN0Gen6Ur48/jxRJut6vsfPS6Lg=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:45.930682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-712919e4-881e-45d8-9756-672f564932cd tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:45.937200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-712919e4-881e-45d8-9756-672f564932cd tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for user 41eb73e335d04bb69661f4180e36a131 and project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:45.965176 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-712919e4-881e-45d8-9756-672f564932cd tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.389938 Jul 20 04:16:45.966221 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1114/2294] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:16:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:45.980395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8c79907-26f7-4706-a19e-1bc17c8b326e tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Calling method '.version_select at 0x7fb841c62940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.989736 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c8c79907-26f7-4706-a19e-1bc17c8b326e tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs/tempest-keypair-1788840042" status: 200 len: 498 microversion: 2.1 time: 0.017413 Jul 20 04:16:45.990613 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1115/2295] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1788840042 => generated 498 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:16:46.005439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b5b8f0f8-fb8a-4e70-bd23-d9b4f2d28e9b tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Calling method '.version_select at 0x7fb841c525e0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.025950 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b5b8f0f8-fb8a-4e70-bd23-d9b4f2d28e9b tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788840042" status: 202 len: 0 microversion: 2.1 time: 0.027638 Jul 20 04:16:46.026872 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1116/2296] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:16:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788840042 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:16:46.038188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c70372b3-e74e-4769-8115-a05ac8e40c76 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Action: 'create', calling method: .version_select at 0x7fb841c52af0>, body: {"keypair": {"name": "tempest-keypair-1364782717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhs6maivqZmTlTzjdRuGpavXlqkV1FWo8I+9y9i39Jj5qcYLHudH78Cx6R6oLHXMiMtrdu/H4A25KdP2y11d97E9mStw3kNMZUp2O+ESUAinXxdEooxHj67LZHlMazvMg=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:46.047605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1f1af146-e192-4d31-b8df-3e6e8f7e9263 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.049611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:46.058936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-c70372b3-e74e-4769-8115-a05ac8e40c76 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:46.062007 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1f1af146-e192-4d31-b8df-3e6e8f7e9263 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1294 microversion: 2.1 time: 0.285170 Jul 20 04:16:46.063321 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1181/2297] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1294 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:46.067660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-c70372b3-e74e-4769-8115-a05ac8e40c76 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for user 41eb73e335d04bb69661f4180e36a131 and project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:46.097255 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c70372b3-e74e-4769-8115-a05ac8e40c76 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062929 Jul 20 04:16:46.098414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1117/2298] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:16:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:46.109340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5854124f-d7c1-4ed5-9a85-3d662ca3e1fa tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Calling method '.version_select at 0x7fb8424a5820>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.137731 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5854124f-d7c1-4ed5-9a85-3d662ca3e1fa tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364782717" status: 202 len: 0 microversion: 2.1 time: 0.032533 Jul 20 04:16:46.144442 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1182/2299] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:16:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364782717 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:46.151972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b8b8147e-8c4c-4abf-9d3f-9007b8a442ab tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Action: 'create', calling method: .version_select at 0x7fb841c620d0>, body: {"keypair": {"name": "tempest-keypair-2069908711", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:46.166686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83ac482e-a45f-4312-a31c-695e1a388844 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.167460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-83ac482e-a45f-4312-a31c-695e1a388844 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.176256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83ac482e-a45f-4312-a31c-695e1a388844 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.177025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83ac482e-a45f-4312-a31c-695e1a388844 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.177537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b8b8147e-8c4c-4abf-9d3f-9007b8a442ab tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:46.178518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83ac482e-a45f-4312-a31c-695e1a388844 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.180188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83ac482e-a45f-4312-a31c-695e1a388844 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.187477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b8b8147e-8c4c-4abf-9d3f-9007b8a442ab tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for user 41eb73e335d04bb69661f4180e36a131 and project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:46.231367 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b8b8147e-8c4c-4abf-9d3f-9007b8a442ab tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.083317 Jul 20 04:16:46.234128 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1118/2300] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:16:46 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:46.242999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a8fa7a0-133c-4ecd-8390-5df33fccd32f tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Calling method '.version_select at 0x7fb841c54160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.265525 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a8fa7a0-133c-4ecd-8390-5df33fccd32f tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069908711" status: 202 len: 0 microversion: 2.1 time: 0.027693 Jul 20 04:16:46.274125 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1119/2301] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:16:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069908711 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:16:46.282216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-83ac482e-a45f-4312-a31c-695e1a388844 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.294470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-09a26059-5cd9-44dd-9514-04d9f1b9d41b tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Action: 'create', calling method: .version_select at 0x7fb841c56e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2035167279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJhRF66caM8y7PhdUCxv01chp+pqVB0f5K1JdTaRV7uS++8xY7LcuaZBHSwGv+AP5VvUBmbZH8obEzPo9+1XVA0S3lrvEmjJWgVEqyeWJIFHBvARN/kEbzeBIndXqxaJA=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:46.294779 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-83ac482e-a45f-4312-a31c-695e1a388844 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1600 microversion: 2.1 time: 0.131519 Jul 20 04:16:46.296454 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1183/2302] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1600 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:46.313950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-09a26059-5cd9-44dd-9514-04d9f1b9d41b tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:46.320553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-09a26059-5cd9-44dd-9514-04d9f1b9d41b tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for user 41eb73e335d04bb69661f4180e36a131 and project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:46.356983 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-09a26059-5cd9-44dd-9514-04d9f1b9d41b tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.073319 Jul 20 04:16:46.357665 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1120/2303] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:16:46 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:46.373619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-53086650-61cd-44c4-9055-81b551beab9c tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Action: 'create', calling method: .version_select at 0x7fb8422d4040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1837772687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdNEDoZIVNhtYIad2RaTDdV0Vqup5i3zPT6jGRifu2wNC9+CtIiS0csL/HvjRJraJmwqhwWVwQwZcEVBy62V7+hkefvJ67MSCP/Hk6OZNa1YCmpyYSzbfxQlY/WMcXnnA=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:46.401607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-53086650-61cd-44c4-9055-81b551beab9c tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:46.417120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-53086650-61cd-44c4-9055-81b551beab9c tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for user 41eb73e335d04bb69661f4180e36a131 and project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:46.448237 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-53086650-61cd-44c4-9055-81b551beab9c tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.081938 Jul 20 04:16:46.450343 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1184/2304] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:16:46 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:46.464609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dd1ce5a0-5009-4ec7-a011-5f4b2c17d4dd tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Action: 'create', calling method: .version_select at 0x7fb841cb0b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-406441088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+rtI39vmWubOndc2RcB2r3JmtaKEFUENGhyCibgUW/NHlzpxjinX701MpsKum51Y8yZg6vvT8viYtu/ftsW1o/a6GoG3p86ITL+Tqnw0qIUSnwH9+r8gYPpOQxXgNmzg=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:46.485724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-dd1ce5a0-5009-4ec7-a011-5f4b2c17d4dd tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:46.501960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-dd1ce5a0-5009-4ec7-a011-5f4b2c17d4dd tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Getting quotas for user 41eb73e335d04bb69661f4180e36a131 and project 34f4991e7c04435f8f805606669717f2. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:46.518173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d648a971-366c-4bdf-a074-c0671ab46c29 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.519779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d648a971-366c-4bdf-a074-c0671ab46c29 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.531147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d648a971-366c-4bdf-a074-c0671ab46c29 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.534338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d648a971-366c-4bdf-a074-c0671ab46c29 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.538225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d648a971-366c-4bdf-a074-c0671ab46c29 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.540281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d648a971-366c-4bdf-a074-c0671ab46c29 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.565643 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dd1ce5a0-5009-4ec7-a011-5f4b2c17d4dd tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.106592 Jul 20 04:16:46.566473 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1121/2305] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:16:46 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:46.576051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-623a6bf1-e16b-49ce-bac6-e2cf9c234acc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.576779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-623a6bf1-e16b-49ce-bac6-e2cf9c234acc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.587950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-623a6bf1-e16b-49ce-bac6-e2cf9c234acc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.588391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-623a6bf1-e16b-49ce-bac6-e2cf9c234acc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.589181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-623a6bf1-e16b-49ce-bac6-e2cf9c234acc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.589881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-623a6bf1-e16b-49ce-bac6-e2cf9c234acc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.786759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d648a971-366c-4bdf-a074-c0671ab46c29 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.810046 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d648a971-366c-4bdf-a074-c0671ab46c29 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1320 microversion: 2.1 time: 0.296484 Jul 20 04:16:46.812284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-623a6bf1-e16b-49ce-bac6-e2cf9c234acc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.814273 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1185/2306] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:46.822162 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-623a6bf1-e16b-49ce-bac6-e2cf9c234acc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.249920 Jul 20 04:16:46.822899 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1122/2307] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:46.828948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f2f9e291-043a-4ea9-921b-cf854c2c0f62 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Calling method '.version_select at 0x7fb841b6c700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.830848 n-d-760456-11 devstack@n-api.service[119605]: WARNING oslo_db.sqlalchemy.utils [None req-f2f9e291-043a-4ea9-921b-cf854c2c0f62 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:16:46.835169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-811c14ce-3284-421f-9328-b1d7652e6aed req-6723ebeb-2c3f-468e-907c-017db6ae7c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a7ceeb-daba-4132-93a5-95c891a45687", "name": "network-vif-deleted", "tag": "1ae0744b-76c2-48e9-882c-17cee7beb535"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:46.837228 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f2f9e291-043a-4ea9-921b-cf854c2c0f62 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.013215 Jul 20 04:16:46.838288 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1123/2308] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:46.843201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-be26b6d2-76ef-44c9-a42b-99869de7c612 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.844056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-be26b6d2-76ef-44c9-a42b-99869de7c612 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.853918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be26b6d2-76ef-44c9-a42b-99869de7c612 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.854505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be26b6d2-76ef-44c9-a42b-99869de7c612 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.856129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be26b6d2-76ef-44c9-a42b-99869de7c612 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.856646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be26b6d2-76ef-44c9-a42b-99869de7c612 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.863108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-811c14ce-3284-421f-9328-b1d7652e6aed req-6723ebeb-2c3f-468e-907c-017db6ae7c44 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.865351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-811c14ce-3284-421f-9328-b1d7652e6aed req-6723ebeb-2c3f-468e-907c-017db6ae7c44 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.886697 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-811c14ce-3284-421f-9328-b1d7652e6aed req-6723ebeb-2c3f-468e-907c-017db6ae7c44 service nova] Creating event network-vif-deleted:1ae0744b-76c2-48e9-882c-17cee7beb535 for instance b0a7ceeb-daba-4132-93a5-95c891a45687 on n-h2-760456-11 Jul 20 04:16:46.893270 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-811c14ce-3284-421f-9328-b1d7652e6aed req-6723ebeb-2c3f-468e-907c-017db6ae7c44 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077350 Jul 20 04:16:46.898921 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1186/2309] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:46.904643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-92c1b84a-478a-40b2-b7c5-92264d06bf99 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Calling method '.version_select at 0x7fb8421ac550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.929420 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-92c1b84a-478a-40b2-b7c5-92264d06bf99 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-406441088" status: 202 len: 0 microversion: 2.1 time: 0.029032 Jul 20 04:16:46.931064 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1187/2310] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:16:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-406441088 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:46.938973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ec9f637-8506-4e7c-8611-49adb5eb7d83 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Calling method '.version_select at 0x7fb842afa310>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.973233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-be26b6d2-76ef-44c9-a42b-99869de7c612 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.976724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:46.988614 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-be26b6d2-76ef-44c9-a42b-99869de7c612 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1267 microversion: 2.1 time: 0.149099 Jul 20 04:16:46.989968 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1124/2311] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:47.004473 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ec9f637-8506-4e7c-8611-49adb5eb7d83 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1837772687" status: 202 len: 0 microversion: 2.1 time: 0.068341 Jul 20 04:16:47.005848 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1188/2312] 10.222.0.59 () {58 vars in 1277 bytes} [Wed Jul 20 04:16:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1837772687 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:16:47.017280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e5c6d618-2400-4e42-bf96-4d96edec4ba8 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] Calling method '.version_select at 0x7fb841c62700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.046393 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e5c6d618-2400-4e42-bf96-4d96edec4ba8 tempest-KeyPairsV2TestJSON-332103938 tempest-KeyPairsV2TestJSON-332103938-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2035167279" status: 202 len: 0 microversion: 2.1 time: 0.034991 Jul 20 04:16:47.048123 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1125/2313] 10.222.0.59 () {58 vars in 1277 bytes} [Wed Jul 20 04:16:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2035167279 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:47.082396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-23726408-3b66-483a-8e6c-56ddfbc77e60 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.083614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-23726408-3b66-483a-8e6c-56ddfbc77e60 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.099360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23726408-3b66-483a-8e6c-56ddfbc77e60 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.102290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23726408-3b66-483a-8e6c-56ddfbc77e60 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.105609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23726408-3b66-483a-8e6c-56ddfbc77e60 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.106090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23726408-3b66-483a-8e6c-56ddfbc77e60 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.315125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.315481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.329113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.329585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.332704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.333170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.435605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.437195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.437694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lazy-loading 'fault' on Instance uuid b0a7ceeb-daba-4132-93a5-95c891a45687 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:47.534146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.549023 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-562c8037-2f12-4ff3-885c-5aa93987d394 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 200 len: 1325 microversion: 2.1 time: 0.239308 Jul 20 04:16:47.555044 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1126/2314] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 1325 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:47.829825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ad14dac3-4803-40d0-80ab-0c1a5c005f13 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.837824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ad14dac3-4803-40d0-80ab-0c1a5c005f13 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.847515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-23726408-3b66-483a-8e6c-56ddfbc77e60 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.847981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad14dac3-4803-40d0-80ab-0c1a5c005f13 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.849089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad14dac3-4803-40d0-80ab-0c1a5c005f13 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.852138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad14dac3-4803-40d0-80ab-0c1a5c005f13 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.853265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad14dac3-4803-40d0-80ab-0c1a5c005f13 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.873842 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-23726408-3b66-483a-8e6c-56ddfbc77e60 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1294 microversion: 2.1 time: 0.796851 Jul 20 04:16:47.885910 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1189/2315] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1294 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:47.899396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aa5362c4-6e3e-4b3b-9928-7237a0722667 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.902363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aa5362c4-6e3e-4b3b-9928-7237a0722667 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.914982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa5362c4-6e3e-4b3b-9928-7237a0722667 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.915458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa5362c4-6e3e-4b3b-9928-7237a0722667 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.916415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa5362c4-6e3e-4b3b-9928-7237a0722667 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.918451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa5362c4-6e3e-4b3b-9928-7237a0722667 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.228520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ad14dac3-4803-40d0-80ab-0c1a5c005f13 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:48.237067 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ad14dac3-4803-40d0-80ab-0c1a5c005f13 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1511 microversion: 2.1 time: 0.411038 Jul 20 04:16:48.238209 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1127/2316] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:48.243629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-53811688-bff0-4a4a-ae29-67a92e6cdb9a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.255830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-53811688-bff0-4a4a-ae29-67a92e6cdb9a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:48.264011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53811688-bff0-4a4a-ae29-67a92e6cdb9a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.264475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53811688-bff0-4a4a-ae29-67a92e6cdb9a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.265299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53811688-bff0-4a4a-ae29-67a92e6cdb9a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.265702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53811688-bff0-4a4a-ae29-67a92e6cdb9a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.312707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aa5362c4-6e3e-4b3b-9928-7237a0722667 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:48.321114 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aa5362c4-6e3e-4b3b-9928-7237a0722667 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.435157 Jul 20 04:16:48.325381 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1190/2317] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:48.338185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-58966847-6d1c-4a17-85eb-ef28f709aa00 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.339001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-58966847-6d1c-4a17-85eb-ef28f709aa00 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:48.353440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58966847-6d1c-4a17-85eb-ef28f709aa00 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.359825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58966847-6d1c-4a17-85eb-ef28f709aa00 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.360810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58966847-6d1c-4a17-85eb-ef28f709aa00 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.361352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58966847-6d1c-4a17-85eb-ef28f709aa00 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.431290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-53811688-bff0-4a4a-ae29-67a92e6cdb9a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:48.475266 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-53811688-bff0-4a4a-ae29-67a92e6cdb9a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1273 microversion: 2.1 time: 0.233804 Jul 20 04:16:48.489138 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1128/2318] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:48.568460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8e35ea6c-40ee-44df-971d-4954f94084fa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.569131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8e35ea6c-40ee-44df-971d-4954f94084fa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: b0a7ceeb-daba-4132-93a5-95c891a45687] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:48.591152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e35ea6c-40ee-44df-971d-4954f94084fa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.592732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e35ea6c-40ee-44df-971d-4954f94084fa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.594645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e35ea6c-40ee-44df-971d-4954f94084fa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.596141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e35ea6c-40ee-44df-971d-4954f94084fa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.629708 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8e35ea6c-40ee-44df-971d-4954f94084fa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] HTTP exception thrown: Instance b0a7ceeb-daba-4132-93a5-95c891a45687 could not be found. Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8e35ea6c-40ee-44df-971d-4954f94084fa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Request method failure captured: Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 HTTP/1.1 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13_uK_xP9ODNPpaQ-ecTO2Rf_YPcAp2c-N8IHy-wvXju7JprTZ-mri4Y1XPcsbGAVEh4AexlfSN_kneWlba42yui0SKx3hErzFWghrYzktkHLddiecxtsDjG8K8ce4T-zKktw7ZcdAnTgFj4OyW8_GQUkdFv10gHbbCKYzu0CyKsmx0 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1ec8a3f7a123436c825135d50dd93865 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-LiveMigrationTest-1979290209 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-LiveMigrationTest-1979290209 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1ec8a3f7a123436c825135d50dd93865 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-LiveMigrationTest-1979290209 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-LiveMigrationTest-1979290209-project Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 04547e35c8c541af914c30e9083cda85 Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-LiveMigrationTest-1979290209-project Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance b0a7ceeb-daba-4132-93a5-95c891a45687 could not be found. Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'b0a7ceeb-daba-4132-93a5-95c891a45687'} Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a7ceeb-daba-4132-93a5-95c891a45687 could not be found. Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a7ceeb-daba-4132-93a5-95c891a45687 could not be found. Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:48.633636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:48.638047 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:48.638047 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:48.638047 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:48.638047 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:48.638047 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:48.638047 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a7ceeb-daba-4132-93a5-95c891a45687 could not be found. Jul 20 04:16:48.638047 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:48.640520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8e35ea6c-40ee-44df-971d-4954f94084fa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Returning 404 to user: Instance b0a7ceeb-daba-4132-93a5-95c891a45687 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:48.646233 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8e35ea6c-40ee-44df-971d-4954f94084fa tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687" status: 404 len: 111 microversion: 2.1 time: 0.079072 Jul 20 04:16:48.647725 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1129/2319] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/servers/b0a7ceeb-daba-4132-93a5-95c891a45687 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:16:48.662811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e864106-2442-40be-a8f8-8c3489120929 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '.version_select at 0x7fb841c52af0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.713745 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e864106-2442-40be-a8f8-8c3489120929 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283323942" status: 202 len: 0 microversion: 2.1 time: 0.058362 Jul 20 04:16:48.715244 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1130/2320] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:16:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283323942 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:48.726575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-58966847-6d1c-4a17-85eb-ef28f709aa00 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:48.735907 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-58966847-6d1c-4a17-85eb-ef28f709aa00 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1512 microversion: 2.1 time: 0.409229 Jul 20 04:16:48.754128 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1191/2321] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:48.761928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2d4af5f6-4e10-4e86-88ba-d9be10ffa035 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.764376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2d4af5f6-4e10-4e86-88ba-d9be10ffa035 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: c561dbb2-7811-4eeb-b05c-0df4ee20c622] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:48.770581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d4af5f6-4e10-4e86-88ba-d9be10ffa035 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.771174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d4af5f6-4e10-4e86-88ba-d9be10ffa035 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.772079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d4af5f6-4e10-4e86-88ba-d9be10ffa035 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.772602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d4af5f6-4e10-4e86-88ba-d9be10ffa035 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.893669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1e483b69-3b7f-4ac7-957c-5dc0a5551948 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.894340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1e483b69-3b7f-4ac7-957c-5dc0a5551948 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:48.907328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e483b69-3b7f-4ac7-957c-5dc0a5551948 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.907798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e483b69-3b7f-4ac7-957c-5dc0a5551948 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.908611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e483b69-3b7f-4ac7-957c-5dc0a5551948 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.909060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e483b69-3b7f-4ac7-957c-5dc0a5551948 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.068227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2d4af5f6-4e10-4e86-88ba-d9be10ffa035 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.077819 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2d4af5f6-4e10-4e86-88ba-d9be10ffa035 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622" status: 200 len: 1511 microversion: 2.1 time: 0.321578 Jul 20 04:16:49.079185 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1131/2322] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622 => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:49.120250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:49.131035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.131493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:49.172572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.173682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.176743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.178190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.381212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:16:49.600726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.618099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.618614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.771733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1e483b69-3b7f-4ac7-957c-5dc0a5551948 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.787024 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1e483b69-3b7f-4ac7-957c-5dc0a5551948 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1294 microversion: 2.1 time: 0.896240 Jul 20 04:16:49.799246 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1192/2323] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1294 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:49.808000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a8c276f7-a388-4900-945b-358bcfc3b3f2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:49.809405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a8c276f7-a388-4900-945b-358bcfc3b3f2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:49.820420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8c276f7-a388-4900-945b-358bcfc3b3f2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.821361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8c276f7-a388-4900-945b-358bcfc3b3f2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.822756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8c276f7-a388-4900-945b-358bcfc3b3f2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.823770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8c276f7-a388-4900-945b-358bcfc3b3f2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.856266 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4a75674a-1335-4b65-91c5-2b912cdd3ad2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.761548 Jul 20 04:16:49.856266 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1132/2324] 10.222.0.59 () {58 vars in 1166 bytes} [Wed Jul 20 04:16:49 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:49.869264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16bb3f4c-eea4-4159-8382-b49280edf15a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:49.871240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16bb3f4c-eea4-4159-8382-b49280edf15a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:49.890104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16bb3f4c-eea4-4159-8382-b49280edf15a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.892191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16bb3f4c-eea4-4159-8382-b49280edf15a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.893459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16bb3f4c-eea4-4159-8382-b49280edf15a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.897431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16bb3f4c-eea4-4159-8382-b49280edf15a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.104725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-16bb3f4c-eea4-4159-8382-b49280edf15a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.117101 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16bb3f4c-eea4-4159-8382-b49280edf15a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1315 microversion: 2.1 time: 0.253286 Jul 20 04:16:50.122491 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1133/2325] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:49 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:50.128318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a8c276f7-a388-4900-945b-358bcfc3b3f2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.129065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-8b61abbf-257d-4629-b4a1-a525c4f7f9e1 req-bf521706-fbb6-4aa3-8b25-6bf7c9c82977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2d80d9-de8c-4fce-852f-3c7d1947dca0", "name": "network-vif-plugged", "status": "completed", "tag": "b1127e50-3431-47b8-a063-a07fc1fe34f2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:50.137291 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a8c276f7-a388-4900-945b-358bcfc3b3f2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.336366 Jul 20 04:16:50.138085 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1193/2326] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:49 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:50.138201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8b61abbf-257d-4629-b4a1-a525c4f7f9e1 req-bf521706-fbb6-4aa3-8b25-6bf7c9c82977 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.139342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8b61abbf-257d-4629-b4a1-a525c4f7f9e1 req-bf521706-fbb6-4aa3-8b25-6bf7c9c82977 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.154562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.155384 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8b61abbf-257d-4629-b4a1-a525c4f7f9e1 req-bf521706-fbb6-4aa3-8b25-6bf7c9c82977 service nova] Creating event network-vif-plugged:b1127e50-3431-47b8-a063-a07fc1fe34f2 for instance 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 on n-h1-760456-11 Jul 20 04:16:50.160606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.161681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-891904652', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:50.164111 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-8b61abbf-257d-4629-b4a1-a525c4f7f9e1 req-bf521706-fbb6-4aa3-8b25-6bf7c9c82977 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039426 Jul 20 04:16:50.164965 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1134/2327] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:50.173639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.174186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.175261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.175907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.294895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:16:50.401539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.402531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c1f59a2a-ba0e-4a56-84e9-12ab5f5620e1 tempest-AbsoluteLimitsTestJSON-956654154 tempest-AbsoluteLimitsTestJSON-956654154-project] Calling method '.version_select at 0x7fb841db25e0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.408277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.408745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.419754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1f59a2a-ba0e-4a56-84e9-12ab5f5620e1 tempest-AbsoluteLimitsTestJSON-956654154 tempest-AbsoluteLimitsTestJSON-956654154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.420213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1f59a2a-ba0e-4a56-84e9-12ab5f5620e1 tempest-AbsoluteLimitsTestJSON-956654154 tempest-AbsoluteLimitsTestJSON-956654154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.421023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1f59a2a-ba0e-4a56-84e9-12ab5f5620e1 tempest-AbsoluteLimitsTestJSON-956654154 tempest-AbsoluteLimitsTestJSON-956654154-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.421459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1f59a2a-ba0e-4a56-84e9-12ab5f5620e1 tempest-AbsoluteLimitsTestJSON-956654154 tempest-AbsoluteLimitsTestJSON-956654154-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.442712 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c1f59a2a-ba0e-4a56-84e9-12ab5f5620e1 tempest-AbsoluteLimitsTestJSON-956654154 tempest-AbsoluteLimitsTestJSON-956654154-project] 10.222.0.59 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.276655 Jul 20 04:16:50.443468 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1135/2328] 10.222.0.59 () {58 vars in 1121 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/limits => generated 511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:50.458612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b3fa12fd-7e49-4aeb-a4ad-bebe4a0d55de tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.459271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b3fa12fd-7e49-4aeb-a4ad-bebe4a0d55de tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:50.466128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3fa12fd-7e49-4aeb-a4ad-bebe4a0d55de tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.466614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3fa12fd-7e49-4aeb-a4ad-bebe4a0d55de tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.467398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3fa12fd-7e49-4aeb-a4ad-bebe4a0d55de tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.467844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3fa12fd-7e49-4aeb-a4ad-bebe4a0d55de tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.497487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b3fa12fd-7e49-4aeb-a4ad-bebe4a0d55de tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:50.600298 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b3fa12fd-7e49-4aeb-a4ad-bebe4a0d55de tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 204 len: 0 microversion: 2.1 time: 0.149811 Jul 20 04:16:50.602528 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1136/2329] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:50 2022] DELETE /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:50.611801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d22d3677-2409-4327-bb57-a0740b366ca4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.612676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d22d3677-2409-4327-bb57-a0740b366ca4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:50.616850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:50.622301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22d3677-2409-4327-bb57-a0740b366ca4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.623059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22d3677-2409-4327-bb57-a0740b366ca4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.624807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22d3677-2409-4327-bb57-a0740b366ca4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.625460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22d3677-2409-4327-bb57-a0740b366ca4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.687572 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6caac122-a438-4e51-abab-2bcc7e5be328 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-891904652" status: 200 len: 1515 microversion: 2.1 time: 0.548148 Jul 20 04:16:50.688432 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1194/2330] 10.222.0.59 () {58 vars in 1260 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-891904652 => generated 1515 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:50.693400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5529fe45-f67c-449c-822f-25e7567b9122 req-1a8dd50a-7d5e-4783-9266-ba2af614e4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b03898-0556-4522-836d-fa47215c2cd3", "tag": "b1853d3d-cbf5-40f4-8eb3-5ebcbb273858"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:50.712347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5529fe45-f67c-449c-822f-25e7567b9122 req-1a8dd50a-7d5e-4783-9266-ba2af614e4ae service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.713537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5529fe45-f67c-449c-822f-25e7567b9122 req-1a8dd50a-7d5e-4783-9266-ba2af614e4ae service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.729589 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5529fe45-f67c-449c-822f-25e7567b9122 req-1a8dd50a-7d5e-4783-9266-ba2af614e4ae service nova] Creating event network-changed:b1853d3d-cbf5-40f4-8eb3-5ebcbb273858 for instance 04b03898-0556-4522-836d-fa47215c2cd3 on n-h1-760456-11 Jul 20 04:16:50.738158 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5529fe45-f67c-449c-822f-25e7567b9122 req-1a8dd50a-7d5e-4783-9266-ba2af614e4ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048146 Jul 20 04:16:50.739007 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1195/2331] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:50.748595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.752689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.754166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:50.761666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.762486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.763835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.764609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.887358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d22d3677-2409-4327-bb57-a0740b366ca4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.899448 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d22d3677-2409-4327-bb57-a0740b366ca4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1484 microversion: 2.1 time: 0.292621 Jul 20 04:16:50.900851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:16:50.901487 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1137/2332] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1484 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:50.908825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b37db43b-8338-4eac-9f0d-fcffcd554bb1 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.910834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b37db43b-8338-4eac-9f0d-fcffcd554bb1 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:50.919926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b37db43b-8338-4eac-9f0d-fcffcd554bb1 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.920661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b37db43b-8338-4eac-9f0d-fcffcd554bb1 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.921718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b37db43b-8338-4eac-9f0d-fcffcd554bb1 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.922171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b37db43b-8338-4eac-9f0d-fcffcd554bb1 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.006017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.018368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.019058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.103778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b37db43b-8338-4eac-9f0d-fcffcd554bb1 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.112941 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b37db43b-8338-4eac-9f0d-fcffcd554bb1 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1294 microversion: 2.1 time: 0.209384 Jul 20 04:16:51.113547 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1138/2333] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1294 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.140522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-174bb93a-c55d-4582-8d0b-5785e2c588f3 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.141223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-174bb93a-c55d-4582-8d0b-5785e2c588f3 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.149845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-174bb93a-c55d-4582-8d0b-5785e2c588f3 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.150418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-174bb93a-c55d-4582-8d0b-5785e2c588f3 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.151276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-174bb93a-c55d-4582-8d0b-5785e2c588f3 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.152086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-174bb93a-c55d-4582-8d0b-5785e2c588f3 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.222935 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b8256842-1683-4450-b8d8-a85baf29f256 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.478031 Jul 20 04:16:51.223591 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1196/2334] 10.222.0.59 () {58 vars in 1172 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.223591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fdd1d0f9-0b07-4f4e-8fa3-6810841cfe0d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.223591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fdd1d0f9-0b07-4f4e-8fa3-6810841cfe0d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.245340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fdd1d0f9-0b07-4f4e-8fa3-6810841cfe0d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.246303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fdd1d0f9-0b07-4f4e-8fa3-6810841cfe0d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.247258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fdd1d0f9-0b07-4f4e-8fa3-6810841cfe0d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.247863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fdd1d0f9-0b07-4f4e-8fa3-6810841cfe0d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.275796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:51.335951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-174bb93a-c55d-4582-8d0b-5785e2c588f3 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.343986 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-174bb93a-c55d-4582-8d0b-5785e2c588f3 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1315 microversion: 2.1 time: 0.208235 Jul 20 04:16:51.352831 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1139/2335] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.368693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.373498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.374141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.compute.servers [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Removing options 'limit' from query {{(pid=119605) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:16:51.375431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:51.381874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.383647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.384491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.384917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.423386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.430589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.431051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.551685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fdd1d0f9-0b07-4f4e-8fa3-6810841cfe0d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.560160 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fdd1d0f9-0b07-4f4e-8fa3-6810841cfe0d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.334911 Jul 20 04:16:51.560751 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1197/2336] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.565792 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0e381b96-6168-4451-973a-a124d9f13312 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.211517 Jul 20 04:16:51.567120 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1140/2337] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.588420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a9a8310-621f-4555-8ab9-cc920059d728 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.591892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a9a8310-621f-4555-8ab9-cc920059d728 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.602518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1a9a8310-621f-4555-8ab9-cc920059d728 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:51.604596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:51.618320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a9a8310-621f-4555-8ab9-cc920059d728 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.624569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a9a8310-621f-4555-8ab9-cc920059d728 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.625452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a9a8310-621f-4555-8ab9-cc920059d728 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.625892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a9a8310-621f-4555-8ab9-cc920059d728 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.746913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-1a9a8310-621f-4555-8ab9-cc920059d728 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:16:51.841040 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a9a8310-621f-4555-8ab9-cc920059d728 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.256470 Jul 20 04:16:51.850194 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1198/2338] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.856197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4c5872c7-8823-40ec-aa60-f6a76e21473e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.860395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4c5872c7-8823-40ec-aa60-f6a76e21473e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.865839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.compute.servers [None req-4c5872c7-8823-40ec-aa60-f6a76e21473e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Removing options 'limit' from query {{(pid=119605) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:16:51.867170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4c5872c7-8823-40ec-aa60-f6a76e21473e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:51.881155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c5872c7-8823-40ec-aa60-f6a76e21473e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.886130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c5872c7-8823-40ec-aa60-f6a76e21473e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.886130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c5872c7-8823-40ec-aa60-f6a76e21473e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.886480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c5872c7-8823-40ec-aa60-f6a76e21473e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.922457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6d34c665-c1e2-444a-9726-8d659bbf8bd0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.923611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6d34c665-c1e2-444a-9726-8d659bbf8bd0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.930843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d34c665-c1e2-444a-9726-8d659bbf8bd0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.931440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d34c665-c1e2-444a-9726-8d659bbf8bd0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.932719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d34c665-c1e2-444a-9726-8d659bbf8bd0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.933708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d34c665-c1e2-444a-9726-8d659bbf8bd0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.969386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-4c5872c7-8823-40ec-aa60-f6a76e21473e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:16:52.014360 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4c5872c7-8823-40ec-aa60-f6a76e21473e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.163619 Jul 20 04:16:52.015652 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1141/2339] 10.222.0.59 () {58 vars in 1149 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.027610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bebaa735-ceca-4e6f-aceb-2fdf7ac9efd8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.035041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bebaa735-ceca-4e6f-aceb-2fdf7ac9efd8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.035774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bebaa735-ceca-4e6f-aceb-2fdf7ac9efd8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:52.042714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bebaa735-ceca-4e6f-aceb-2fdf7ac9efd8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.043174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bebaa735-ceca-4e6f-aceb-2fdf7ac9efd8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.044613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bebaa735-ceca-4e6f-aceb-2fdf7ac9efd8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.045048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bebaa735-ceca-4e6f-aceb-2fdf7ac9efd8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.082997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-bebaa735-ceca-4e6f-aceb-2fdf7ac9efd8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:16:52.089667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:52.129108 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bebaa735-ceca-4e6f-aceb-2fdf7ac9efd8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.106012 Jul 20 04:16:52.130347 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1142/2340] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers => generated 1009 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.139800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fcbe8590-4947-4c12-8290-2e3948349338 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.140451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fcbe8590-4947-4c12-8290-2e3948349338 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.147783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fcbe8590-4947-4c12-8290-2e3948349338 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.148426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fcbe8590-4947-4c12-8290-2e3948349338 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.149456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fcbe8590-4947-4c12-8290-2e3948349338 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.150053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fcbe8590-4947-4c12-8290-2e3948349338 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.259422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6d34c665-c1e2-444a-9726-8d659bbf8bd0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.270013 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6d34c665-c1e2-444a-9726-8d659bbf8bd0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1484 microversion: 2.1 time: 0.351971 Jul 20 04:16:52.275244 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1199/2341] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1484 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.289797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32195b36-2e2d-470a-af32-7445405d4e6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.296629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-32195b36-2e2d-470a-af32-7445405d4e6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.296822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-32195b36-2e2d-470a-af32-7445405d4e6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:52.299601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fcbe8590-4947-4c12-8290-2e3948349338 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.312712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32195b36-2e2d-470a-af32-7445405d4e6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.313566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32195b36-2e2d-470a-af32-7445405d4e6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.313902 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fcbe8590-4947-4c12-8290-2e3948349338 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1486 microversion: 2.1 time: 0.180915 Jul 20 04:16:52.314540 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1143/2342] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1486 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.326476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32195b36-2e2d-470a-af32-7445405d4e6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.327083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32195b36-2e2d-470a-af32-7445405d4e6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.337284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26576071-bde7-479b-a9b4-96d23f6df2dc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.339762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-26576071-bde7-479b-a9b4-96d23f6df2dc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.352405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26576071-bde7-479b-a9b4-96d23f6df2dc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.357010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26576071-bde7-479b-a9b4-96d23f6df2dc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.358096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26576071-bde7-479b-a9b4-96d23f6df2dc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.358937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26576071-bde7-479b-a9b4-96d23f6df2dc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.433673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-32195b36-2e2d-470a-af32-7445405d4e6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:16:52.505841 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-32195b36-2e2d-470a-af32-7445405d4e6e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.221018 Jul 20 04:16:52.507119 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1200/2343] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:52.517777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-89befb29-6dab-4cce-92d1-883302729148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.519644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-89befb29-6dab-4cce-92d1-883302729148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.535596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89befb29-6dab-4cce-92d1-883302729148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.536937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89befb29-6dab-4cce-92d1-883302729148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.539936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89befb29-6dab-4cce-92d1-883302729148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.540901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89befb29-6dab-4cce-92d1-883302729148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.565544 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-26576071-bde7-479b-a9b4-96d23f6df2dc tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.236972 Jul 20 04:16:52.566785 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1144/2344] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:52.595457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d674761e-ec60-44e3-8d5c-71bf6f8c3742 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.606541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d674761e-ec60-44e3-8d5c-71bf6f8c3742 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.613986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.compute.servers [None req-d674761e-ec60-44e3-8d5c-71bf6f8c3742 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Removing options 'limit' from query {{(pid=119605) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:16:52.615866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d674761e-ec60-44e3-8d5c-71bf6f8c3742 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:52.624810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d674761e-ec60-44e3-8d5c-71bf6f8c3742 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.625363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d674761e-ec60-44e3-8d5c-71bf6f8c3742 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.626422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d674761e-ec60-44e3-8d5c-71bf6f8c3742 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.626882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d674761e-ec60-44e3-8d5c-71bf6f8c3742 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.663116 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d674761e-ec60-44e3-8d5c-71bf6f8c3742 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.093431 Jul 20 04:16:52.665354 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1145/2345] 10.222.0.59 () {58 vars in 1139 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:52.670197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3a6e178-54c6-4330-932d-8488a226f04a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.670966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f3a6e178-54c6-4330-932d-8488a226f04a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.680483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3a6e178-54c6-4330-932d-8488a226f04a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.681189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3a6e178-54c6-4330-932d-8488a226f04a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.682083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3a6e178-54c6-4330-932d-8488a226f04a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.682705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3a6e178-54c6-4330-932d-8488a226f04a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.893397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-89befb29-6dab-4cce-92d1-883302729148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.906613 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-89befb29-6dab-4cce-92d1-883302729148 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1315 microversion: 2.1 time: 0.396652 Jul 20 04:16:52.907665 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1201/2346] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.912917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f73bbe71-64b5-4e41-b08d-77a9e588ff46 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.916916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f73bbe71-64b5-4e41-b08d-77a9e588ff46 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.917601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f73bbe71-64b5-4e41-b08d-77a9e588ff46 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-891904652', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:52.923833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f73bbe71-64b5-4e41-b08d-77a9e588ff46 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.924449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f73bbe71-64b5-4e41-b08d-77a9e588ff46 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.925100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f73bbe71-64b5-4e41-b08d-77a9e588ff46 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.925852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f73bbe71-64b5-4e41-b08d-77a9e588ff46 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.036845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-f73bbe71-64b5-4e41-b08d-77a9e588ff46 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:16:53.100244 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f73bbe71-64b5-4e41-b08d-77a9e588ff46 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-891904652" status: 200 len: 345 microversion: 2.1 time: 0.191459 Jul 20 04:16:53.102383 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1202/2347] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-891904652 => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:53.107351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-379898ac-d83d-43b1-9351-89559fd8d48f req-4c35b0d5-cad2-477b-909d-f35afea533ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a23765b5-80ca-4a5d-bd2e-480d92222c04", "name": "network-vif-deleted", "tag": "40f5fbe1-7bda-48e3-886f-5b7124d37017"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:53.116047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-379898ac-d83d-43b1-9351-89559fd8d48f req-4c35b0d5-cad2-477b-909d-f35afea533ef service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.116971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-379898ac-d83d-43b1-9351-89559fd8d48f req-4c35b0d5-cad2-477b-909d-f35afea533ef service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.132040 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-379898ac-d83d-43b1-9351-89559fd8d48f req-4c35b0d5-cad2-477b-909d-f35afea533ef service nova] Creating event network-vif-deleted:40f5fbe1-7bda-48e3-886f-5b7124d37017 for instance a23765b5-80ca-4a5d-bd2e-480d92222c04 on n-h1-760456-11 Jul 20 04:16:53.137683 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-379898ac-d83d-43b1-9351-89559fd8d48f req-4c35b0d5-cad2-477b-909d-f35afea533ef service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033773 Jul 20 04:16:53.138678 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1203/2348] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:53.287609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8ec93ae5-71d9-4207-aceb-253d82e87086 tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] Calling method '.version_select at 0x7fb8421f1670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.298813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ec93ae5-71d9-4207-aceb-253d82e87086 tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.299600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ec93ae5-71d9-4207-aceb-253d82e87086 tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.300049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ec93ae5-71d9-4207-aceb-253d82e87086 tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.300487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ec93ae5-71d9-4207-aceb-253d82e87086 tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.302315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f3a6e178-54c6-4330-932d-8488a226f04a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.317404 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f3a6e178-54c6-4330-932d-8488a226f04a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.651594 Jul 20 04:16:53.330290 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1146/2349] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:53.330500 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8ec93ae5-71d9-4207-aceb-253d82e87086 tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] 10.222.0.59 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.183619 Jul 20 04:16:53.330500 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1204/2350] 10.222.0.59 () {58 vars in 1121 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/limits => generated 511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:53.330500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c2e6414-96fa-41cd-bb63-e2f6fd7e53e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.330500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3c2e6414-96fa-41cd-bb63-e2f6fd7e53e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.335540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c2e6414-96fa-41cd-bb63-e2f6fd7e53e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.336184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c2e6414-96fa-41cd-bb63-e2f6fd7e53e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.336970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c2e6414-96fa-41cd-bb63-e2f6fd7e53e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.337408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c2e6414-96fa-41cd-bb63-e2f6fd7e53e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.337852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-987cb420-bfdd-43eb-96f5-d36384ad80bb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:53.344608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-987cb420-bfdd-43eb-96f5-d36384ad80bb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.345511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-987cb420-bfdd-43eb-96f5-d36384ad80bb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.418803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-987cb420-bfdd-43eb-96f5-d36384ad80bb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Going to try to stop instance {{(pid=119605) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:16:53.429973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3c2e6414-96fa-41cd-bb63-e2f6fd7e53e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.452363 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3c2e6414-96fa-41cd-bb63-e2f6fd7e53e7 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1442 microversion: 2.1 time: 0.127258 Jul 20 04:16:53.453275 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1205/2351] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1442 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:53.459307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bab2513b-3a36-4b18-b1ae-15bf9f8ce1ba tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1140595585", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:53.485108 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-987cb420-bfdd-43eb-96f5-d36384ad80bb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "POST /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159/action" status: 202 len: 0 microversion: 2.1 time: 0.162031 Jul 20 04:16:53.486188 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1147/2352] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:53 2022] POST /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:53.495134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c4d0e25c-7a5b-4ae4-a2c8-69f8f08345f9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.496789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c4d0e25c-7a5b-4ae4-a2c8-69f8f08345f9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.523485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4d0e25c-7a5b-4ae4-a2c8-69f8f08345f9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.524094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4d0e25c-7a5b-4ae4-a2c8-69f8f08345f9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.525589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4d0e25c-7a5b-4ae4-a2c8-69f8f08345f9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.526185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4d0e25c-7a5b-4ae4-a2c8-69f8f08345f9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.533969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-bab2513b-3a36-4b18-b1ae-15bf9f8ce1ba tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:53.899034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-bab2513b-3a36-4b18-b1ae-15bf9f8ce1ba tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] Getting quotas for project c62f963e46a244eea4e0f2199e446a6c. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:53.905981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-bab2513b-3a36-4b18-b1ae-15bf9f8ce1ba tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] Getting quotas for user 45e7f8372b244822ad16386ac94a1b73 and project c62f963e46a244eea4e0f2199e446a6c. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:53.924149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c4d0e25c-7a5b-4ae4-a2c8-69f8f08345f9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.926929 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-bab2513b-3a36-4b18-b1ae-15bf9f8ce1ba tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bab2513b-3a36-4b18-b1ae-15bf9f8ce1ba tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] Request method failure captured: Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 1752 Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14G0JVLdp10Nk_5k_qUJxrRQ29g437LKoKAQWzRKWZK9vh92Nw5yFwsY4ZUge6LmJerCwHx399iP6NFRcRgFoRYulPEAz15mxi559x4-nxMZ4l1r8OXL9npSGxVp-JWnEBQxW741XC4Xy8AM6O6D7BP3Wvxj2bVp6fjeqz7tLl8c5OA Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: c62f963e46a244eea4e0f2199e446a6c Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-574067144 Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c62f963e46a244eea4e0f2199e446a6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c62f963e46a244eea4e0f2199e446a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c62f963e46a244eea4e0f2199e446a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c62f963e46a244eea4e0f2199e446a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-574067144 Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: c62f963e46a244eea4e0f2199e446a6c Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-574067144 Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-574067144-project Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 45e7f8372b244822ad16386ac94a1b73 Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-574067144-project Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1140595585", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:16:53.930849 n-d-760456-11 devstack@n-api.service[119606]: exception: Maximum number of metadata items exceeds 128 Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1140595585', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:53.933016 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bab2513b-3a36-4b18-b1ae-15bf9f8ce1ba tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bab2513b-3a36-4b18-b1ae-15bf9f8ce1ba tempest-AbsoluteLimitsNegativeTestJSON-574067144 tempest-AbsoluteLimitsNegativeTestJSON-574067144-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.478053 Jul 20 04:16:53.936814 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1206/2353] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Jul 20 04:16:53 2022] POST /compute/v2.1/servers => generated 87 bytes in 479 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:16:53.939744 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c4d0e25c-7a5b-4ae4-a2c8-69f8f08345f9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.443073 Jul 20 04:16:53.939744 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1148/2354] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:53.946733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1008d953-7922-45ae-b254-92d9916bfd0b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.948331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1008d953-7922-45ae-b254-92d9916bfd0b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.958786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1008d953-7922-45ae-b254-92d9916bfd0b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.959455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1008d953-7922-45ae-b254-92d9916bfd0b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.971278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1008d953-7922-45ae-b254-92d9916bfd0b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.976416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1008d953-7922-45ae-b254-92d9916bfd0b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.259306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1008d953-7922-45ae-b254-92d9916bfd0b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.268579 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1008d953-7922-45ae-b254-92d9916bfd0b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1315 microversion: 2.1 time: 0.333976 Jul 20 04:16:54.268579 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1207/2355] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:54.337904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a773a0db-a703-4203-a173-102b1493a4b2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.338549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a773a0db-a703-4203-a173-102b1493a4b2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.345520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a773a0db-a703-4203-a173-102b1493a4b2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.346826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a773a0db-a703-4203-a173-102b1493a4b2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.347851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a773a0db-a703-4203-a173-102b1493a4b2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.348461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a773a0db-a703-4203-a173-102b1493a4b2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.472404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.473031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.485550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.486013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.486834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.491196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.620556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.621260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.621789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lazy-loading 'fault' on Instance uuid a23765b5-80ca-4a5d-bd2e-480d92222c04 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:54.665431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a773a0db-a703-4203-a173-102b1493a4b2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.684067 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a773a0db-a703-4203-a173-102b1493a4b2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.344215 Jul 20 04:16:54.685077 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1149/2356] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:54.701248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0d1d85b1-6ed8-4b6d-939d-ccdb85b8e49f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.702300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0d1d85b1-6ed8-4b6d-939d-ccdb85b8e49f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.723717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d1d85b1-6ed8-4b6d-939d-ccdb85b8e49f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.724575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d1d85b1-6ed8-4b6d-939d-ccdb85b8e49f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.728533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d1d85b1-6ed8-4b6d-939d-ccdb85b8e49f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.731505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d1d85b1-6ed8-4b6d-939d-ccdb85b8e49f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.830312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.841772 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-16c19d9d-4dad-4737-8de7-60f85bff5ce4 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 200 len: 1300 microversion: 2.1 time: 0.372943 Jul 20 04:16:54.842409 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1208/2357] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 1300 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:54.855935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-cab59958-293b-4c7e-b482-934e086667f8 req-d03f2ad4-797c-4f1a-8e0f-1d4d514b5131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2d80d9-de8c-4fce-852f-3c7d1947dca0", "tag": "b1127e50-3431-47b8-a063-a07fc1fe34f2"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:54.886361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cab59958-293b-4c7e-b482-934e086667f8 req-d03f2ad4-797c-4f1a-8e0f-1d4d514b5131 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.902639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cab59958-293b-4c7e-b482-934e086667f8 req-d03f2ad4-797c-4f1a-8e0f-1d4d514b5131 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.946982 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-cab59958-293b-4c7e-b482-934e086667f8 req-d03f2ad4-797c-4f1a-8e0f-1d4d514b5131 service nova] Creating event network-changed:b1127e50-3431-47b8-a063-a07fc1fe34f2 for instance 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 on n-h1-760456-11 Jul 20 04:16:54.970075 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-cab59958-293b-4c7e-b482-934e086667f8 req-d03f2ad4-797c-4f1a-8e0f-1d4d514b5131 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124089 Jul 20 04:16:54.972463 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1209/2358] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:54.979467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0d1d85b1-6ed8-4b6d-939d-ccdb85b8e49f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.985903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-592a4da1-cf92-42c4-ad7c-7e3ef9a0283e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.986670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-592a4da1-cf92-42c4-ad7c-7e3ef9a0283e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.991890 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0d1d85b1-6ed8-4b6d-939d-ccdb85b8e49f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1486 microversion: 2.1 time: 0.305284 Jul 20 04:16:55.000940 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1150/2359] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1486 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:55.001601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-592a4da1-cf92-42c4-ad7c-7e3ef9a0283e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.002065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-592a4da1-cf92-42c4-ad7c-7e3ef9a0283e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.002881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-592a4da1-cf92-42c4-ad7c-7e3ef9a0283e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.003324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-592a4da1-cf92-42c4-ad7c-7e3ef9a0283e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.287084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c1c76a8-c8c9-447e-97a4-b4e53c9f91ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.287713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c1c76a8-c8c9-447e-97a4-b4e53c9f91ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.298654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c1c76a8-c8c9-447e-97a4-b4e53c9f91ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.299244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c1c76a8-c8c9-447e-97a4-b4e53c9f91ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.300694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c1c76a8-c8c9-447e-97a4-b4e53c9f91ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.305857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-592a4da1-cf92-42c4-ad7c-7e3ef9a0283e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:55.310160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c1c76a8-c8c9-447e-97a4-b4e53c9f91ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.317324 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-592a4da1-cf92-42c4-ad7c-7e3ef9a0283e tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.342691 Jul 20 04:16:55.321422 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1210/2360] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:55.588908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c1c76a8-c8c9-447e-97a4-b4e53c9f91ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:55.600027 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c1c76a8-c8c9-447e-97a4-b4e53c9f91ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1315 microversion: 2.1 time: 0.318900 Jul 20 04:16:55.602119 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1151/2361] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:55.702654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc28cc30-c694-4a5d-9186-292b66725b16 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.703294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc28cc30-c694-4a5d-9186-292b66725b16 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.718193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc28cc30-c694-4a5d-9186-292b66725b16 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.718714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc28cc30-c694-4a5d-9186-292b66725b16 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.719525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc28cc30-c694-4a5d-9186-292b66725b16 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.719974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc28cc30-c694-4a5d-9186-292b66725b16 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.859881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f380415-b06f-4575-8fa7-be7e05ef2b9f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.860418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f380415-b06f-4575-8fa7-be7e05ef2b9f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: a23765b5-80ca-4a5d-bd2e-480d92222c04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.874922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f380415-b06f-4575-8fa7-be7e05ef2b9f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.875379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f380415-b06f-4575-8fa7-be7e05ef2b9f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.876185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f380415-b06f-4575-8fa7-be7e05ef2b9f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.876628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f380415-b06f-4575-8fa7-be7e05ef2b9f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.906658 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-5f380415-b06f-4575-8fa7-be7e05ef2b9f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] HTTP exception thrown: Instance a23765b5-80ca-4a5d-bd2e-480d92222c04 could not be found. Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f380415-b06f-4575-8fa7-be7e05ef2b9f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Request method failure captured: Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 HTTP/1.1 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi13_uK_xP9ODNPpaQ-ecTO2Rf_YPcAp2c-N8IHy-wvXju7JprTZ-mri4Y1XPcsbGAVEh4AexlfSN_kneWlba42yui0SKx3hErzFWghrYzktkHLddiecxtsDjG8K8ce4T-zKktw7ZcdAnTgFj4OyW8_GQUkdFv10gHbbCKYzu0CyKsmx0 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1ec8a3f7a123436c825135d50dd93865 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-LiveMigrationTest-1979290209 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-LiveMigrationTest-1979290209 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1ec8a3f7a123436c825135d50dd93865 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-LiveMigrationTest-1979290209 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-LiveMigrationTest-1979290209-project Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 04547e35c8c541af914c30e9083cda85 Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-LiveMigrationTest-1979290209-project Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance a23765b5-80ca-4a5d-bd2e-480d92222c04 could not be found. Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'a23765b5-80ca-4a5d-bd2e-480d92222c04'} Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a23765b5-80ca-4a5d-bd2e-480d92222c04 could not be found. Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a23765b5-80ca-4a5d-bd2e-480d92222c04 could not be found. Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:55.911749 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:55.916899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:55.916899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:55.916899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:55.916899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:55.916899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:55.916899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a23765b5-80ca-4a5d-bd2e-480d92222c04 could not be found. Jul 20 04:16:55.916899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:16:55.916899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f380415-b06f-4575-8fa7-be7e05ef2b9f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Returning 404 to user: Instance a23765b5-80ca-4a5d-bd2e-480d92222c04 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:55.916899 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f380415-b06f-4575-8fa7-be7e05ef2b9f tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04" status: 404 len: 111 microversion: 2.1 time: 0.058328 Jul 20 04:16:55.916899 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1152/2362] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/servers/a23765b5-80ca-4a5d-bd2e-480d92222c04 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:16:55.924546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-829e2086-0296-4d0a-80f8-0344d5585288 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.924761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-829e2086-0296-4d0a-80f8-0344d5585288 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.932337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-829e2086-0296-4d0a-80f8-0344d5585288 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.933259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-829e2086-0296-4d0a-80f8-0344d5585288 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.933714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-829e2086-0296-4d0a-80f8-0344d5585288 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.934232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-829e2086-0296-4d0a-80f8-0344d5585288 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.987660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-829e2086-0296-4d0a-80f8-0344d5585288 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:56.059598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc28cc30-c694-4a5d-9186-292b66725b16 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.071674 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc28cc30-c694-4a5d-9186-292b66725b16 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.373798 Jul 20 04:16:56.088632 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1211/2363] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:56.135359 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-829e2086-0296-4d0a-80f8-0344d5585288 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 204 len: 0 microversion: 2.1 time: 0.215575 Jul 20 04:16:56.136061 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1153/2364] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:55 2022] DELETE /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:56.146931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72ffdd5b-5e22-4ee2-b0ed-898bf48144d0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.148375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-72ffdd5b-5e22-4ee2-b0ed-898bf48144d0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.168333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72ffdd5b-5e22-4ee2-b0ed-898bf48144d0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.169682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72ffdd5b-5e22-4ee2-b0ed-898bf48144d0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.172328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72ffdd5b-5e22-4ee2-b0ed-898bf48144d0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.174410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72ffdd5b-5e22-4ee2-b0ed-898bf48144d0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.339247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a87615ec-e9ab-4a9e-b84c-2e742c631146 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.341595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a87615ec-e9ab-4a9e-b84c-2e742c631146 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.358023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a87615ec-e9ab-4a9e-b84c-2e742c631146 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.359433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a87615ec-e9ab-4a9e-b84c-2e742c631146 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.360969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a87615ec-e9ab-4a9e-b84c-2e742c631146 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.363042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a87615ec-e9ab-4a9e-b84c-2e742c631146 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.401544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72ffdd5b-5e22-4ee2-b0ed-898bf48144d0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.423151 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72ffdd5b-5e22-4ee2-b0ed-898bf48144d0 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1498 microversion: 2.1 time: 0.282571 Jul 20 04:16:56.426116 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1212/2365] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1498 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:56.605715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a87615ec-e9ab-4a9e-b84c-2e742c631146 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.617635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31d916ea-8609-4fa4-96f2-f046f26864f0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.618472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31d916ea-8609-4fa4-96f2-f046f26864f0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.619316 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a87615ec-e9ab-4a9e-b84c-2e742c631146 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.284748 Jul 20 04:16:56.621759 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1154/2366] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:56.629582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d916ea-8609-4fa4-96f2-f046f26864f0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.630331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d916ea-8609-4fa4-96f2-f046f26864f0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.633408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d916ea-8609-4fa4-96f2-f046f26864f0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.634260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d916ea-8609-4fa4-96f2-f046f26864f0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.056124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31d916ea-8609-4fa4-96f2-f046f26864f0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.076707 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31d916ea-8609-4fa4-96f2-f046f26864f0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1315 microversion: 2.1 time: 0.459208 Jul 20 04:16:57.078581 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1213/2367] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:57.093141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-410cdf9c-1ce8-46b5-9082-2eeda2c73d8d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.093811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-410cdf9c-1ce8-46b5-9082-2eeda2c73d8d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.101746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-410cdf9c-1ce8-46b5-9082-2eeda2c73d8d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.102470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-410cdf9c-1ce8-46b5-9082-2eeda2c73d8d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.103447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-410cdf9c-1ce8-46b5-9082-2eeda2c73d8d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.104041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-410cdf9c-1ce8-46b5-9082-2eeda2c73d8d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.443273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f4dce50-9a14-410d-bc0d-767421eb609c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.443907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8f4dce50-9a14-410d-bc0d-767421eb609c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.458003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4dce50-9a14-410d-bc0d-767421eb609c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.458926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4dce50-9a14-410d-bc0d-767421eb609c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.460690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4dce50-9a14-410d-bc0d-767421eb609c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.463202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4dce50-9a14-410d-bc0d-767421eb609c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.542708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-410cdf9c-1ce8-46b5-9082-2eeda2c73d8d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.551381 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-410cdf9c-1ce8-46b5-9082-2eeda2c73d8d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.462489 Jul 20 04:16:57.564258 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1155/2368] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:57.573513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-fbe290e9-adc6-4135-8a8f-9ac46462a5a0 req-907ae6bf-c3ca-4a6f-8cc5-dda9a1daeee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b03898-0556-4522-836d-fa47215c2cd3", "name": "network-vif-plugged", "status": "completed", "tag": "b1853d3d-cbf5-40f4-8eb3-5ebcbb273858"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:57.597212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fbe290e9-adc6-4135-8a8f-9ac46462a5a0 req-907ae6bf-c3ca-4a6f-8cc5-dda9a1daeee3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.598067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fbe290e9-adc6-4135-8a8f-9ac46462a5a0 req-907ae6bf-c3ca-4a6f-8cc5-dda9a1daeee3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.623646 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-fbe290e9-adc6-4135-8a8f-9ac46462a5a0 req-907ae6bf-c3ca-4a6f-8cc5-dda9a1daeee3 service nova] Creating event network-vif-plugged:b1853d3d-cbf5-40f4-8eb3-5ebcbb273858 for instance 04b03898-0556-4522-836d-fa47215c2cd3 on n-h1-760456-11 Jul 20 04:16:57.632933 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-fbe290e9-adc6-4135-8a8f-9ac46462a5a0 req-907ae6bf-c3ca-4a6f-8cc5-dda9a1daeee3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065898 Jul 20 04:16:57.634633 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1156/2369] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:57.641361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-224c24a0-2ef5-4299-b5c6-8196a0e0e4b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.644414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-224c24a0-2ef5-4299-b5c6-8196a0e0e4b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.652833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-224c24a0-2ef5-4299-b5c6-8196a0e0e4b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.653660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-224c24a0-2ef5-4299-b5c6-8196a0e0e4b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.654693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-224c24a0-2ef5-4299-b5c6-8196a0e0e4b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.655309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-224c24a0-2ef5-4299-b5c6-8196a0e0e4b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.866637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-224c24a0-2ef5-4299-b5c6-8196a0e0e4b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.878986 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-224c24a0-2ef5-4299-b5c6-8196a0e0e4b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.241490 Jul 20 04:16:57.879821 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1157/2370] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:58.095504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-22954794-e943-488a-8701-fbc601d5d49d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.096439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22954794-e943-488a-8701-fbc601d5d49d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.112859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22954794-e943-488a-8701-fbc601d5d49d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.114279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22954794-e943-488a-8701-fbc601d5d49d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.115427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22954794-e943-488a-8701-fbc601d5d49d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.116768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22954794-e943-488a-8701-fbc601d5d49d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.170044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:58.478609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8f4dce50-9a14-410d-bc0d-767421eb609c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.505991 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8f4dce50-9a14-410d-bc0d-767421eb609c tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1498 microversion: 2.1 time: 1.066529 Jul 20 04:16:58.516125 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1214/2371] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1498 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:58.528564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-0882ddf7-52b8-4cd2-be57-d31f3b23f97c req-ab6a45f1-a05d-41aa-87ac-5f737235eafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd742b1-082a-4a00-b6af-75b41ac08235", "name": "network-vif-deleted", "tag": "0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:58.551152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0882ddf7-52b8-4cd2-be57-d31f3b23f97c req-ab6a45f1-a05d-41aa-87ac-5f737235eafd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.551603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0882ddf7-52b8-4cd2-be57-d31f3b23f97c req-ab6a45f1-a05d-41aa-87ac-5f737235eafd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.583198 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-0882ddf7-52b8-4cd2-be57-d31f3b23f97c req-ab6a45f1-a05d-41aa-87ac-5f737235eafd service nova] Creating event network-vif-deleted:0bb3b09d-2560-4a0f-9dac-d99b67fc3f3e for instance 0dd742b1-082a-4a00-b6af-75b41ac08235 on n-h1-760456-11 Jul 20 04:16:58.590954 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-0882ddf7-52b8-4cd2-be57-d31f3b23f97c req-ab6a45f1-a05d-41aa-87ac-5f737235eafd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079079 Jul 20 04:16:58.593148 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1215/2372] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:58.605003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-22954794-e943-488a-8701-fbc601d5d49d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.613585 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-22954794-e943-488a-8701-fbc601d5d49d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1315 microversion: 2.1 time: 0.522700 Jul 20 04:16:58.614523 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1158/2373] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:58.622345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-96ec7e04-b09e-4f3c-8bd3-f29a550257a5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.623243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-96ec7e04-b09e-4f3c-8bd3-f29a550257a5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.631045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96ec7e04-b09e-4f3c-8bd3-f29a550257a5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.632425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96ec7e04-b09e-4f3c-8bd3-f29a550257a5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.633930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96ec7e04-b09e-4f3c-8bd3-f29a550257a5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.634553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96ec7e04-b09e-4f3c-8bd3-f29a550257a5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.661411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:58.906853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-96ec7e04-b09e-4f3c-8bd3-f29a550257a5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.908891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73337ea9-9e65-4067-b80c-4fde3e37eced tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.910060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-73337ea9-9e65-4067-b80c-4fde3e37eced tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.920781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73337ea9-9e65-4067-b80c-4fde3e37eced tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.921657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73337ea9-9e65-4067-b80c-4fde3e37eced tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.922753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73337ea9-9e65-4067-b80c-4fde3e37eced tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.923349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73337ea9-9e65-4067-b80c-4fde3e37eced tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.924791 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-96ec7e04-b09e-4f3c-8bd3-f29a550257a5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.308975 Jul 20 04:16:58.925381 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1216/2374] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.339939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-73337ea9-9e65-4067-b80c-4fde3e37eced tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.348847 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-73337ea9-9e65-4067-b80c-4fde3e37eced tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.454974 Jul 20 04:16:59.350297 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1159/2375] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:59.523995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.524890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.535000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.540424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.543949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.544434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.590576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.591040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.591631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lazy-loading 'fault' on Instance uuid 0dd742b1-082a-4a00-b6af-75b41ac08235 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:59.633158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-41ea37f1-f53d-4a5e-aac5-10117e2646b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.633869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-41ea37f1-f53d-4a5e-aac5-10117e2646b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.641624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ea37f1-f53d-4a5e-aac5-10117e2646b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.642148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ea37f1-f53d-4a5e-aac5-10117e2646b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.642977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ea37f1-f53d-4a5e-aac5-10117e2646b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.643426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ea37f1-f53d-4a5e-aac5-10117e2646b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.677471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04547e35c8c541af914c30e9083cda85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec8a3f7a123436c825135d50dd93865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.692203 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9087715d-71f0-420b-8e5f-842af57d82e5 tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 200 len: 1300 microversion: 2.1 time: 0.173137 Jul 20 04:16:59.692975 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1217/2376] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.933878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-41ea37f1-f53d-4a5e-aac5-10117e2646b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.941602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-29ed0005-f6cf-4b00-acca-c4b2557e51a0 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.942240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-29ed0005-f6cf-4b00-acca-c4b2557e51a0 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.948638 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-41ea37f1-f53d-4a5e-aac5-10117e2646b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1315 microversion: 2.1 time: 0.321127 Jul 20 04:16:59.949925 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1160/2377] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:59.957564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29ed0005-f6cf-4b00-acca-c4b2557e51a0 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.958024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29ed0005-f6cf-4b00-acca-c4b2557e51a0 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.970471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29ed0005-f6cf-4b00-acca-c4b2557e51a0 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.971426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29ed0005-f6cf-4b00-acca-c4b2557e51a0 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.191557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-29ed0005-f6cf-4b00-acca-c4b2557e51a0 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.202072 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-29ed0005-f6cf-4b00-acca-c4b2557e51a0 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.264951 Jul 20 04:17:00.204183 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1218/2378] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:00.368362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3ae294a-1e62-4505-b610-8a464c8bac25 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.369269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f3ae294a-1e62-4505-b610-8a464c8bac25 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:00.375993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3ae294a-1e62-4505-b610-8a464c8bac25 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.376447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3ae294a-1e62-4505-b610-8a464c8bac25 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.377255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3ae294a-1e62-4505-b610-8a464c8bac25 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.377676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3ae294a-1e62-4505-b610-8a464c8bac25 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.602231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f3ae294a-1e62-4505-b610-8a464c8bac25 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.610442 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f3ae294a-1e62-4505-b610-8a464c8bac25 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.247013 Jul 20 04:17:00.621314 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1161/2379] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:00.711541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30a35860-4d9e-46c2-ba36-37860ff0a7ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.712325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-30a35860-4d9e-46c2-ba36-37860ff0a7ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] [instance: 0dd742b1-082a-4a00-b6af-75b41ac08235] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:00.726335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30a35860-4d9e-46c2-ba36-37860ff0a7ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.726884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30a35860-4d9e-46c2-ba36-37860ff0a7ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.727693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30a35860-4d9e-46c2-ba36-37860ff0a7ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.728140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30a35860-4d9e-46c2-ba36-37860ff0a7ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.762797 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-30a35860-4d9e-46c2-ba36-37860ff0a7ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] HTTP exception thrown: Instance 0dd742b1-082a-4a00-b6af-75b41ac08235 could not be found. Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30a35860-4d9e-46c2-ba36-37860ff0a7ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Request method failure captured: Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 HTTP/1.1 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi13_uK_xP9ODNPpaQ-ecTO2Rf_YPcAp2c-N8IHy-wvXju7JprTZ-mri4Y1XPcsbGAVEh4AexlfSN_kneWlba42yui0SKx3hErzFWghrYzktkHLddiecxtsDjG8K8ce4T-zKktw7ZcdAnTgFj4OyW8_GQUkdFv10gHbbCKYzu0CyKsmx0 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1ec8a3f7a123436c825135d50dd93865 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-LiveMigrationTest-1979290209 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ec8a3f7a123436c825135d50dd93865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-LiveMigrationTest-1979290209 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1ec8a3f7a123436c825135d50dd93865 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-LiveMigrationTest-1979290209 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-LiveMigrationTest-1979290209-project Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 04547e35c8c541af914c30e9083cda85 Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-LiveMigrationTest-1979290209-project Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 0dd742b1-082a-4a00-b6af-75b41ac08235 could not be found. Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '0dd742b1-082a-4a00-b6af-75b41ac08235'} Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd742b1-082a-4a00-b6af-75b41ac08235 could not be found. Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd742b1-082a-4a00-b6af-75b41ac08235 could not be found. Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:00.764801 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:00.768670 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:00.768670 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:00.768670 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:00.768670 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:00.768670 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:00.768670 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd742b1-082a-4a00-b6af-75b41ac08235 could not be found. Jul 20 04:17:00.768670 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:00.775804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30a35860-4d9e-46c2-ba36-37860ff0a7ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] Returning 404 to user: Instance 0dd742b1-082a-4a00-b6af-75b41ac08235 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:00.778658 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-30a35860-4d9e-46c2-ba36-37860ff0a7ae tempest-LiveMigrationTest-1979290209 tempest-LiveMigrationTest-1979290209-project] 10.222.0.59 "GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235" status: 404 len: 111 microversion: 2.1 time: 0.071963 Jul 20 04:17:00.780850 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1219/2380] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/servers/0dd742b1-082a-4a00-b6af-75b41ac08235 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:00.971503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e21c409-d105-4828-a8d8-b3b6cec85b31 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.972736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e21c409-d105-4828-a8d8-b3b6cec85b31 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:00.982061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e21c409-d105-4828-a8d8-b3b6cec85b31 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.982787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e21c409-d105-4828-a8d8-b3b6cec85b31 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.984212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e21c409-d105-4828-a8d8-b3b6cec85b31 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.984817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e21c409-d105-4828-a8d8-b3b6cec85b31 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.224011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1fe6437c-a21d-421e-9c31-4cde76ca485d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.229556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e21c409-d105-4828-a8d8-b3b6cec85b31 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:01.235604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1fe6437c-a21d-421e-9c31-4cde76ca485d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.243995 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e21c409-d105-4828-a8d8-b3b6cec85b31 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1503 microversion: 2.1 time: 0.277291 Jul 20 04:17:01.257719 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1162/2381] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:01.263376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe6437c-a21d-421e-9c31-4cde76ca485d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.264187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe6437c-a21d-421e-9c31-4cde76ca485d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.266759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe6437c-a21d-421e-9c31-4cde76ca485d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.267370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe6437c-a21d-421e-9c31-4cde76ca485d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.273497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dda1f50a-614b-4605-82d6-fcf908c3436a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:01.278691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dda1f50a-614b-4605-82d6-fcf908c3436a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.294241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dda1f50a-614b-4605-82d6-fcf908c3436a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.294962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dda1f50a-614b-4605-82d6-fcf908c3436a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.295951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dda1f50a-614b-4605-82d6-fcf908c3436a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.297835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dda1f50a-614b-4605-82d6-fcf908c3436a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.421069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=26 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:01.454429 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dda1f50a-614b-4605-82d6-fcf908c3436a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3/action" status: 202 len: 0 microversion: 2.1 time: 0.185099 Jul 20 04:17:01.455943 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1163/2382] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:01 2022] POST /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:17:01.467738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f195d03d-a94a-4d85-ace8-3887917ebc81 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.470707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f195d03d-a94a-4d85-ace8-3887917ebc81 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.487610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f195d03d-a94a-4d85-ace8-3887917ebc81 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.504162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f195d03d-a94a-4d85-ace8-3887917ebc81 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.505299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f195d03d-a94a-4d85-ace8-3887917ebc81 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.515108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f195d03d-a94a-4d85-ace8-3887917ebc81 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.781760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1fe6437c-a21d-421e-9c31-4cde76ca485d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:01.798845 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1fe6437c-a21d-421e-9c31-4cde76ca485d tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.581070 Jul 20 04:17:01.812362 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1220/2383] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:01.824028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b8aa2bf9-9972-4a2e-951d-64cf5f4e5a6a tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.824931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b8aa2bf9-9972-4a2e-951d-64cf5f4e5a6a tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.836617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8aa2bf9-9972-4a2e-951d-64cf5f4e5a6a tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.838121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8aa2bf9-9972-4a2e-951d-64cf5f4e5a6a tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.840003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8aa2bf9-9972-4a2e-951d-64cf5f4e5a6a tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.842100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8aa2bf9-9972-4a2e-951d-64cf5f4e5a6a tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.095360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f195d03d-a94a-4d85-ace8-3887917ebc81 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:02.109495 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f195d03d-a94a-4d85-ace8-3887917ebc81 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1508 microversion: 2.1 time: 0.647449 Jul 20 04:17:02.125650 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1164/2384] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:02.417482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b8aa2bf9-9972-4a2e-951d-64cf5f4e5a6a tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:02.425858 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b8aa2bf9-9972-4a2e-951d-64cf5f4e5a6a tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.607822 Jul 20 04:17:02.426489 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1221/2385] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:02.818032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-64f0d405-ba9c-42f6-bf59-28267cc753bd tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:02.820243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-64f0d405-ba9c-42f6-bf59-28267cc753bd tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:02.836975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=12 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:02.845424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64f0d405-ba9c-42f6-bf59-28267cc753bd tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.846995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64f0d405-ba9c-42f6-bf59-28267cc753bd tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.849128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64f0d405-ba9c-42f6-bf59-28267cc753bd tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.852989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64f0d405-ba9c-42f6-bf59-28267cc753bd tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.137897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6c6153de-39c5-4ab0-9bd8-980eea637202 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.138934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6c6153de-39c5-4ab0-9bd8-980eea637202 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.146506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c6153de-39c5-4ab0-9bd8-980eea637202 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.147364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c6153de-39c5-4ab0-9bd8-980eea637202 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.148425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c6153de-39c5-4ab0-9bd8-980eea637202 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.149228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c6153de-39c5-4ab0-9bd8-980eea637202 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.257372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-64f0d405-ba9c-42f6-bf59-28267cc753bd tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.266372 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-64f0d405-ba9c-42f6-bf59-28267cc753bd tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.453376 Jul 20 04:17:03.267581 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1165/2386] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:02 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:03.314677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=14 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:03.465263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-efde96bb-e09e-4ef6-9a32-f34b4a385443 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.465813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-efde96bb-e09e-4ef6-9a32-f34b4a385443 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.476057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efde96bb-e09e-4ef6-9a32-f34b4a385443 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.476784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efde96bb-e09e-4ef6-9a32-f34b4a385443 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.478557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efde96bb-e09e-4ef6-9a32-f34b4a385443 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.479188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efde96bb-e09e-4ef6-9a32-f34b4a385443 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.636487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6c6153de-39c5-4ab0-9bd8-980eea637202 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.657572 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6c6153de-39c5-4ab0-9bd8-980eea637202 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1488 microversion: 2.1 time: 0.529144 Jul 20 04:17:03.658899 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1222/2387] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1488 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:03.682044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0b056235-76ba-4110-878d-7d161940e8fa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.683701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0b056235-76ba-4110-878d-7d161940e8fa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.693433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b056235-76ba-4110-878d-7d161940e8fa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.695118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b056235-76ba-4110-878d-7d161940e8fa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.696408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b056235-76ba-4110-878d-7d161940e8fa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.697017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b056235-76ba-4110-878d-7d161940e8fa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.757806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0b056235-76ba-4110-878d-7d161940e8fa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:03.915302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=22 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:03.954324 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0b056235-76ba-4110-878d-7d161940e8fa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 204 len: 0 microversion: 2.1 time: 0.274460 Jul 20 04:17:03.955320 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1223/2388] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:03 2022] DELETE /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:03.970426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d2595d9d-ea4b-4473-a829-3c789e2f534b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.974282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d2595d9d-ea4b-4473-a829-3c789e2f534b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.989981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2595d9d-ea4b-4473-a829-3c789e2f534b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.990477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2595d9d-ea4b-4473-a829-3c789e2f534b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.991466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2595d9d-ea4b-4473-a829-3c789e2f534b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.991922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2595d9d-ea4b-4473-a829-3c789e2f534b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.336205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d2595d9d-ea4b-4473-a829-3c789e2f534b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.347312 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d2595d9d-ea4b-4473-a829-3c789e2f534b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1494 microversion: 2.1 time: 0.385375 Jul 20 04:17:04.350612 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1224/2389] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1494 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:04.359489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6018c74c-9cfc-4ca3-a5ef-1f9d43441c9f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.359997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6018c74c-9cfc-4ca3-a5ef-1f9d43441c9f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.376458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6018c74c-9cfc-4ca3-a5ef-1f9d43441c9f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.377397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6018c74c-9cfc-4ca3-a5ef-1f9d43441c9f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.377852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6018c74c-9cfc-4ca3-a5ef-1f9d43441c9f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.381050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6018c74c-9cfc-4ca3-a5ef-1f9d43441c9f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.536534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-efde96bb-e09e-4ef6-9a32-f34b4a385443 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.551082 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-efde96bb-e09e-4ef6-9a32-f34b4a385443 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 1.110784 Jul 20 04:17:04.554157 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1166/2390] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:04.688908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6018c74c-9cfc-4ca3-a5ef-1f9d43441c9f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.715595 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6018c74c-9cfc-4ca3-a5ef-1f9d43441c9f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1523 microversion: 2.1 time: 0.363807 Jul 20 04:17:04.731035 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1225/2391] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:04.796467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75b84536-2558-4ae5-a85b-ef23e5e5cb9e tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841e38550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1396839941", "description": "tempest-description-390373169"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:05.083756 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75b84536-2558-4ae5-a85b-ef23e5e5cb9e tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.382847 Jul 20 04:17:05.095926 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1167/2392] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:04 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:05.098171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ec4eb596-03c5-48d6-9a3b-03d56e6e648f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841e01af0>, body: {"security_group_rule": {"parent_group_id": "b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:05.365325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-395fc4d7-298f-41e5-9d76-a5070a679d54 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.366072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-395fc4d7-298f-41e5-9d76-a5070a679d54 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.375977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-395fc4d7-298f-41e5-9d76-a5070a679d54 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.376440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-395fc4d7-298f-41e5-9d76-a5070a679d54 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.377250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-395fc4d7-298f-41e5-9d76-a5070a679d54 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.377680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-395fc4d7-298f-41e5-9d76-a5070a679d54 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.469394 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ec4eb596-03c5-48d6-9a3b-03d56e6e648f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.376606 Jul 20 04:17:05.470212 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1226/2393] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:05 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:05.481569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3eb131e5-30bb-4d61-afe1-2311a71b7bfc tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841eab1f0>, body: {"security_group_rule": {"parent_group_id": "b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:05.598898 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3eb131e5-30bb-4d61-afe1-2311a71b7bfc tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] HTTP exception thrown: This rule already exists in group b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3eb131e5-30bb-4d61-afe1-2311a71b7bfc tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Request method failure captured: Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 138 Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HAb_qORjnV_K--ERJ42bdRO1X4If53E9IFE47nJ9dJUMobj9G4WuWdQDZVJ1Uqy6vlzak7kKmLLBZVxta1cmo7QuXReZ6wFmWcEhYp4SMTPVyfMGCiazcYPr-I1_7tQJsI_owOJudrACArGPy6Cdr_HcIH5Y6Fz-fL0AZJiV15N6g Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_51db347ce1b54d17a429ddd84259f720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 96941c8786294295ac5d95efd5f42f28 Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: {"security_group_rule": {"parent_group_id": "b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: exception: This rule already exists in group b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:05.601771 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:05.606876 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:05.606876 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:05.606876 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a Jul 20 04:17:05.606876 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.606876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3eb131e5-30bb-4d61-afe1-2311a71b7bfc tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Returning 400 to user: This rule already exists in group b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:05.606876 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3eb131e5-30bb-4d61-afe1-2311a71b7bfc tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.127557 Jul 20 04:17:05.619775 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1227/2394] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:05 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:17:05.628990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ab86e0d2-b797-4fdb-9aaa-bc676a2016c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.636449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ab86e0d2-b797-4fdb-9aaa-bc676a2016c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.652233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab86e0d2-b797-4fdb-9aaa-bc676a2016c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.652697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab86e0d2-b797-4fdb-9aaa-bc676a2016c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.653706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab86e0d2-b797-4fdb-9aaa-bc676a2016c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.654334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab86e0d2-b797-4fdb-9aaa-bc676a2016c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.785030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-395fc4d7-298f-41e5-9d76-a5070a679d54 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.795249 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-395fc4d7-298f-41e5-9d76-a5070a679d54 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1494 microversion: 2.1 time: 0.433231 Jul 20 04:17:05.799268 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1168/2395] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1494 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:05.810390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4a457a63-b0f8-48c6-a9af-9b1982841e2f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Calling method '.version_select at 0x7fb841df6b80>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.939922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ab86e0d2-b797-4fdb-9aaa-bc676a2016c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.957016 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ab86e0d2-b797-4fdb-9aaa-bc676a2016c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.335602 Jul 20 04:17:05.972121 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1228/2396] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:05.991891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0b547a0f-d617-4bd5-b0d5-313267909189 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.994132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0b547a0f-d617-4bd5-b0d5-313267909189 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:06.012689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b547a0f-d617-4bd5-b0d5-313267909189 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.016352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b547a0f-d617-4bd5-b0d5-313267909189 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.017431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b547a0f-d617-4bd5-b0d5-313267909189 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.020990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b547a0f-d617-4bd5-b0d5-313267909189 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.264999 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4a457a63-b0f8-48c6-a9af-9b1982841e2f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-group-rules/ec584a79-6844-4867-9383-fad2d6fa0a3b" status: 202 len: 0 microversion: 2.1 time: 0.463841 Jul 20 04:17:06.266151 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1169/2397] 10.222.0.59 () {58 vars in 1286 bytes} [Wed Jul 20 04:17:05 2022] DELETE /compute/v2.1/os-security-group-rules/ec584a79-6844-4867-9383-fad2d6fa0a3b => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:06.273201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1258711681", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d7df1a6a-edf6-4e43-8286-ec664673f3ed"}], "block_device_mapping_v2": [{"uuid": "19bfb5ff-1808-4fbf-aa2d-7ad1d0c97705", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:06.371679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0b547a0f-d617-4bd5-b0d5-313267909189 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.383158 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0b547a0f-d617-4bd5-b0d5-313267909189 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1503 microversion: 2.1 time: 0.409070 Jul 20 04:17:06.386632 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1229/2398] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1503 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:06.407707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] validate_networks() for [('d7df1a6a-edf6-4e43-8286-ec664673f3ed', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:06.415400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a112e46e-007e-4f66-8156-ac8cdf26ab96 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841ee80d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1386646577", "description": "tempest-description-434538293"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:07.236948 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a112e46e-007e-4f66-8156-ac8cdf26ab96 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.835699 Jul 20 04:17:07.244266 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1230/2399] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:06 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:07.249937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c15f378b-d5f6-4e8a-ad77-59913e9df4dd tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Action: 'create', calling method: .version_select at 0x7fb841a669d0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-489462097", "description": "tempest-description-1521705677"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:07.530585 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c15f378b-d5f6-4e8a-ad77-59913e9df4dd tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.284773 Jul 20 04:17:07.531620 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1231/2400] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:07 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:07.536889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:07.538037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:07.554603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.555223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.556051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.556508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.608913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.610377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.611007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lazy-loading 'fault' on Instance uuid 04b03898-0556-4522-836d-fa47215c2cd3 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:07.663208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:07.673337 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f783cb04-eb4f-4645-92c7-c477c43d4fb5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 200 len: 1305 microversion: 2.1 time: 0.140294 Jul 20 04:17:07.674740 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1232/2401] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:07 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 1305 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:07.677772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:07.679655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:07.680507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:07.681138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:07.681768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:07.696766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.699993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.701409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-76778494-f9e5-4bb5-852c-06ed51c63fb4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:07.703025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.703913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-76778494-f9e5-4bb5-852c-06ed51c63fb4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:07.704538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.717479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76778494-f9e5-4bb5-852c-06ed51c63fb4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.720217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76778494-f9e5-4bb5-852c-06ed51c63fb4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.721183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76778494-f9e5-4bb5-852c-06ed51c63fb4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.725590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76778494-f9e5-4bb5-852c-06ed51c63fb4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.753333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Getting quotas for project d2323a93fbfb432f81cd11b542380af8. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:07.764895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Getting quotas for user df3e2faf94584fc99a59e3839e18f8b1 and project d2323a93fbfb432f81cd11b542380af8. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:07.901630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:07.904311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19bfb5ff-1808-4fbf-aa2d-7ad1d0c97705',volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:08.042984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-76778494-f9e5-4bb5-852c-06ed51c63fb4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.055270 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-76778494-f9e5-4bb5-852c-06ed51c63fb4 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.363828 Jul 20 04:17:08.056623 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1233/2402] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:07 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:08.061804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-044ee67b-a764-4506-acbc-2f75d431a46b req-20006e5b-ee13-433b-9cc8-61bffb102b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b03898-0556-4522-836d-fa47215c2cd3", "name": "network-vif-deleted", "tag": "b1853d3d-cbf5-40f4-8eb3-5ebcbb273858"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:08.071241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-044ee67b-a764-4506-acbc-2f75d431a46b req-20006e5b-ee13-433b-9cc8-61bffb102b57 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.071697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-044ee67b-a764-4506-acbc-2f75d431a46b req-20006e5b-ee13-433b-9cc8-61bffb102b57 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.098555 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-044ee67b-a764-4506-acbc-2f75d431a46b req-20006e5b-ee13-433b-9cc8-61bffb102b57 service nova] Creating event network-vif-deleted:b1853d3d-cbf5-40f4-8eb3-5ebcbb273858 for instance 04b03898-0556-4522-836d-fa47215c2cd3 on n-h1-760456-11 Jul 20 04:17:08.110793 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-044ee67b-a764-4506-acbc-2f75d431a46b req-20006e5b-ee13-433b-9cc8-61bffb102b57 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052665 Jul 20 04:17:08.112069 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1234/2403] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:08.118568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59c707f0-bd28-4ff0-91de-358dacf6ea28 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841436040>, body: {"security_group_rule": {"parent_group_id": "22ace0d4-69fb-48dc-a5bf-791bb0731690", "ip_protocol": "tcp", "from_port": 2110578386, "to_port": 22}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:08.152872 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4d908987-0001-45de-b991-3c00c60a602e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.885314 Jul 20 04:17:08.154028 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1170/2404] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:17:08.159951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ffa743b-087d-468f-a532-5d5bd88def2f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-489462097"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:08.160691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8ffa743b-087d-468f-a532-5d5bd88def2f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.171314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ffa743b-087d-468f-a532-5d5bd88def2f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.171879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ffa743b-087d-468f-a532-5d5bd88def2f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.172801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ffa743b-087d-468f-a532-5d5bd88def2f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.173378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ffa743b-087d-468f-a532-5d5bd88def2f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.183727 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-59c707f0-bd28-4ff0-91de-358dacf6ea28 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] HTTP exception thrown: Invalid port range 2110578386:22. Former value cannot be greater than the later Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59c707f0-bd28-4ff0-91de-358dacf6ea28 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Request method failure captured: Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 146 Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HAb_qORjnV_K--ERJ42bdRO1X4If53E9IFE47nJ9dJUMobj9G4WuWdQDZVJ1Uqy6vlzak7kKmLLBZVxta1cmo7QuXReZ6wFmWcEhYp4SMTPVyfMGCiazcYPr-I1_7tQJsI_owOJudrACArGPy6Cdr_HcIH5Y6Fz-fL0AZJiV15N6g Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_51db347ce1b54d17a429ddd84259f720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 96941c8786294295ac5d95efd5f42f28 Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: {"security_group_rule": {"parent_group_id": "22ace0d4-69fb-48dc-a5bf-791bb0731690", "ip_protocol": "tcp", "from_port": 2110578386, "to_port": 22}} Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid port range 2110578386:22. Former value cannot be greater than the later Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'security_group_rule': {'parent_group_id': '22ace0d4-69fb-48dc-a5bf-791bb0731690', 'ip_protocol': 'tcp', 'from_port': 2110578386, 'to_port': 22}}} Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2110578386:22. Former value cannot be greater than the later Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2110578386:22. Former value cannot be greater than the later Jul 20 04:17:08.186068 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.190344 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:08.190344 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.190344 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.190344 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:08.190344 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:08.190344 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:08.190344 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:08.190344 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2110578386:22. Former value cannot be greater than the later Jul 20 04:17:08.190344 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.192768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59c707f0-bd28-4ff0-91de-358dacf6ea28 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Returning 400 to user: Invalid port range 2110578386:22. Former value cannot be greater than the later {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:08.195858 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-59c707f0-bd28-4ff0-91de-358dacf6ea28 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.080839 Jul 20 04:17:08.196469 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1235/2405] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:08 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:08.202572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b54a3de1-566a-460f-a1d0-85488c4a5561 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.203303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b54a3de1-566a-460f-a1d0-85488c4a5561 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.274940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b54a3de1-566a-460f-a1d0-85488c4a5561 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.285712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b54a3de1-566a-460f-a1d0-85488c4a5561 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.288122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b54a3de1-566a-460f-a1d0-85488c4a5561 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.289584 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b54a3de1-566a-460f-a1d0-85488c4a5561 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1104 microversion: 2.25 time: 0.091417 Jul 20 04:17:08.301243 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1236/2406] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1104 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:08.308645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-89f7bcb2-351d-4653-bad7-0f943eafb294 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841436310>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1055441622", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:08.310763 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-89f7bcb2-351d-4653-bad7-0f943eafb294 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] HTTP exception thrown: Security group id should be uuid Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-89f7bcb2-351d-4653-bad7-0f943eafb294 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Request method failure captured: Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 131 Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HAb_qORjnV_K--ERJ42bdRO1X4If53E9IFE47nJ9dJUMobj9G4WuWdQDZVJ1Uqy6vlzak7kKmLLBZVxta1cmo7QuXReZ6wFmWcEhYp4SMTPVyfMGCiazcYPr-I1_7tQJsI_owOJudrACArGPy6Cdr_HcIH5Y6Fz-fL0AZJiV15N6g Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_51db347ce1b54d17a429ddd84259f720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 96941c8786294295ac5d95efd5f42f28 Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1055441622", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: exception: Security group id should be uuid Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1055441622', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:08.312581 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:08.316879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 20 04:17:08.316879 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.317798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-89f7bcb2-351d-4653-bad7-0f943eafb294 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Returning 400 to user: Security group id should be uuid {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:08.318970 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-89f7bcb2-351d-4653-bad7-0f943eafb294 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016217 Jul 20 04:17:08.320171 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1237/2407] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:08 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:17:08.329537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9865f3bd-e4a8-435f-8e3a-a73087629f57 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841a66b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1911626696", "description": "tempest-description-508669083"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:08.481550 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.network.security_group_api [None req-8ffa743b-087d-468f-a532-5d5bd88def2f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Adding security group f621cdcb-6380-4844-9ff8-3180d237e283 to port df3fbf6a-1fad-4c47-af81-2713c574b472 Jul 20 04:17:08.556391 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9865f3bd-e4a8-435f-8e3a-a73087629f57 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.230654 Jul 20 04:17:08.557653 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1238/2408] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:08 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:08.570196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-96af88cf-cda1-4064-985b-1837c5ace362 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb842163dc0>, body: {"security_group_rule": {"parent_group_id": "d3f5961a-c7bc-49e1-a513-dc8611be3436", "ip_protocol": "tempest-999-522857521", "from_port": 22, "to_port": 22}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:08.635333 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-96af88cf-cda1-4064-985b-1837c5ace362 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] HTTP exception thrown: Invalid IP protocol tempest-999-522857521. Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-96af88cf-cda1-4064-985b-1837c5ace362 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Request method failure captured: Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 156 Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HAb_qORjnV_K--ERJ42bdRO1X4If53E9IFE47nJ9dJUMobj9G4WuWdQDZVJ1Uqy6vlzak7kKmLLBZVxta1cmo7QuXReZ6wFmWcEhYp4SMTPVyfMGCiazcYPr-I1_7tQJsI_owOJudrACArGPy6Cdr_HcIH5Y6Fz-fL0AZJiV15N6g Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_51db347ce1b54d17a429ddd84259f720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 96941c8786294295ac5d95efd5f42f28 Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: {"security_group_rule": {"parent_group_id": "d3f5961a-c7bc-49e1-a513-dc8611be3436", "ip_protocol": "tempest-999-522857521", "from_port": 22, "to_port": 22}} Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid IP protocol tempest-999-522857521. Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd3f5961a-c7bc-49e1-a513-dc8611be3436', 'ip_protocol': 'tempest-999-522857521', 'from_port': 22, 'to_port': 22}}} Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-522857521. Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-522857521. Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.636994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-522857521. Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-96af88cf-cda1-4064-985b-1837c5ace362 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Returning 400 to user: Invalid IP protocol tempest-999-522857521. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-96af88cf-cda1-4064-985b-1837c5ace362 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.074115 Jul 20 04:17:08.640981 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1239/2409] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:08 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:17:08.649228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-af12ee88-49de-4597-8d62-bf2c236f070b tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb8429cf9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-356955402", "description": "tempest-description-417235229"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:08.827880 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-af12ee88-49de-4597-8d62-bf2c236f070b tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.183513 Jul 20 04:17:08.828542 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1240/2410] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:08 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:08.842205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17ea95e2-8f9d-4b1e-83a3-3fc0b9c040a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.843588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-17ea95e2-8f9d-4b1e-83a3-3fc0b9c040a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.852728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17ea95e2-8f9d-4b1e-83a3-3fc0b9c040a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.853418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17ea95e2-8f9d-4b1e-83a3-3fc0b9c040a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.854273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17ea95e2-8f9d-4b1e-83a3-3fc0b9c040a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.854722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17ea95e2-8f9d-4b1e-83a3-3fc0b9c040a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.883477 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-17ea95e2-8f9d-4b1e-83a3-3fc0b9c040a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17ea95e2-8f9d-4b1e-83a3-3fc0b9c040a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 HTTP/1.1 Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '04b03898-0556-4522-836d-fa47215c2cd3'} Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:08.885515 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.890100 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:08.890100 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:08.890100 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:08.890100 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:08.890100 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:08.890100 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:17:08.890100 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:08.892620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17ea95e2-8f9d-4b1e-83a3-3fc0b9c040a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:08.894321 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-17ea95e2-8f9d-4b1e-83a3-3fc0b9c040a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 404 len: 111 microversion: 2.1 time: 0.056875 Jul 20 04:17:08.895482 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1241/2411] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:08.931718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94ce22bc-18fd-4248-9eda-74d13f919d4b tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841436ca0>, body: {"security_group_rule": {"parent_group_id": "34ab018b-12da-49ce-aaa5-b02df03f41ad", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:09.015535 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-94ce22bc-18fd-4248-9eda-74d13f919d4b tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94ce22bc-18fd-4248-9eda-74d13f919d4b tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Request method failure captured: Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 138 Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HAb_qORjnV_K--ERJ42bdRO1X4If53E9IFE47nJ9dJUMobj9G4WuWdQDZVJ1Uqy6vlzak7kKmLLBZVxta1cmo7QuXReZ6wFmWcEhYp4SMTPVyfMGCiazcYPr-I1_7tQJsI_owOJudrACArGPy6Cdr_HcIH5Y6Fz-fL0AZJiV15N6g Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_51db347ce1b54d17a429ddd84259f720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 96941c8786294295ac5d95efd5f42f28 Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: {"security_group_rule": {"parent_group_id": "34ab018b-12da-49ce-aaa5-b02df03f41ad", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'security_group_rule': {'parent_group_id': '34ab018b-12da-49ce-aaa5-b02df03f41ad', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:17:09.017393 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:09.020880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:09.020880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:09.020880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:09.020880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:09.020880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:09.020880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:09.020880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:09.020880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:17:09.020880 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:09.032692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94ce22bc-18fd-4248-9eda-74d13f919d4b tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:09.034047 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94ce22bc-18fd-4248-9eda-74d13f919d4b tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.137185 Jul 20 04:17:09.035257 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1242/2412] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:08 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:09.048348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-55e88da2-03b5-418f-ad0e-10743741eafd tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841eab0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-81205159", "description": "tempest-description-1825166290"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:09.168491 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8ffa743b-087d-468f-a532-5d5bd88def2f tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "POST /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a/action" status: 202 len: 0 microversion: 2.1 time: 1.012607 Jul 20 04:17:09.170014 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1171/2413] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:08 2022] POST /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a/action => generated 0 bytes in 1015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:09.177487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-de06d338-bdd1-46bc-b6ff-be8ad2110b03 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:09.178581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-de06d338-bdd1-46bc-b6ff-be8ad2110b03 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:09.192210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de06d338-bdd1-46bc-b6ff-be8ad2110b03 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.192778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de06d338-bdd1-46bc-b6ff-be8ad2110b03 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.194565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de06d338-bdd1-46bc-b6ff-be8ad2110b03 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.196252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de06d338-bdd1-46bc-b6ff-be8ad2110b03 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.321456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-55e88da2-03b5-418f-ad0e-10743741eafd tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.280445 Jul 20 04:17:09.334352 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1243/2414] 10.222.0.59 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:09 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:09.342137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1469949001", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "191d678e-1adc-40c3-b7b1-1a7cb20ca675"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:09.426842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] validate_networks() for [('191d678e-1adc-40c3-b7b1-1a7cb20ca675', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:09.717739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-de06d338-bdd1-46bc-b6ff-be8ad2110b03 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:09.731622 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-de06d338-bdd1-46bc-b6ff-be8ad2110b03 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.559515 Jul 20 04:17:09.742636 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1172/2415] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:09 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:09.747076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2d80b1eb-c210-49bf-803a-3c4f8170648e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-489462097"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:09.747594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2d80b1eb-c210-49bf-803a-3c4f8170648e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:09.756903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d80b1eb-c210-49bf-803a-3c4f8170648e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.759876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d80b1eb-c210-49bf-803a-3c4f8170648e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.760731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d80b1eb-c210-49bf-803a-3c4f8170648e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.762225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d80b1eb-c210-49bf-803a-3c4f8170648e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.180077 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.network.security_group_api [None req-2d80b1eb-c210-49bf-803a-3c4f8170648e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Removing security group f621cdcb-6380-4844-9ff8-3180d237e283 from port df3fbf6a-1fad-4c47-af81-2713c574b472 Jul 20 04:17:10.508543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:10.509066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:10.509443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:10.509858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:10.510486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:10.513354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:10.524715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.525465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.527560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.528758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.564029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:10.571680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for user 9f053f31c02c412394d48ce65350d153 and project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:10.612553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:10.622184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:10.695919 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-baf57cc8-b9c1-4b85-9edb-fe493ef4647c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.359186 Jul 20 04:17:10.698337 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1244/2416] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:10.708902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-70a930c8-b303-4ab6-8baf-dc6cf537e7bc req-7c2fda4d-7e61-4752-9adf-91f8cf8d3b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3edbf03b-c74b-4814-81de-4645c207d91a", "tag": "df3fbf6a-1fad-4c47-af81-2713c574b472"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:10.722519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-70a930c8-b303-4ab6-8baf-dc6cf537e7bc req-7c2fda4d-7e61-4752-9adf-91f8cf8d3b16 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.723254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-70a930c8-b303-4ab6-8baf-dc6cf537e7bc req-7c2fda4d-7e61-4752-9adf-91f8cf8d3b16 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.743587 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-70a930c8-b303-4ab6-8baf-dc6cf537e7bc req-7c2fda4d-7e61-4752-9adf-91f8cf8d3b16 service nova] Creating event network-changed:df3fbf6a-1fad-4c47-af81-2713c574b472 for instance 3edbf03b-c74b-4814-81de-4645c207d91a on n-h2-760456-11 Jul 20 04:17:10.750004 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-70a930c8-b303-4ab6-8baf-dc6cf537e7bc req-7c2fda4d-7e61-4752-9adf-91f8cf8d3b16 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050112 Jul 20 04:17:10.751350 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1245/2417] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:10.757955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-42b1c29d-484d-499c-801b-be29e082cc72 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:10.758910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-42b1c29d-484d-499c-801b-be29e082cc72 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:10.766286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42b1c29d-484d-499c-801b-be29e082cc72 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.766965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42b1c29d-484d-499c-801b-be29e082cc72 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.768237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42b1c29d-484d-499c-801b-be29e082cc72 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.768882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42b1c29d-484d-499c-801b-be29e082cc72 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.774669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:11.101462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-42b1c29d-484d-499c-801b-be29e082cc72 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.122492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-42b1c29d-484d-499c-801b-be29e082cc72 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.125323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-42b1c29d-484d-499c-801b-be29e082cc72 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.125323 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-42b1c29d-484d-499c-801b-be29e082cc72 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1293 microversion: 2.25 time: 0.371818 Jul 20 04:17:11.125323 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1246/2418] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:10 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1293 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:11.141120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-981b86a9-a3d9-45c9-ae29-6b7247990dd1 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841e4a790>, body: {"security_group_rule": {"parent_group_id": "f38da6da-e953-4ce4-93a7-44fc4d8359a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 674454981}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:11.342140 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2d80b1eb-c210-49bf-803a-3c4f8170648e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "POST /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a/action" status: 202 len: 0 microversion: 2.1 time: 1.607995 Jul 20 04:17:11.343975 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1173/2419] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:09 2022] POST /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a/action => generated 0 bytes in 1611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:11.352243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eb1f6c7b-933f-43ea-89d0-f4d061623232 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.353514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eb1f6c7b-933f-43ea-89d0-f4d061623232 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.493520 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-981b86a9-a3d9-45c9-ae29-6b7247990dd1 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] HTTP exception thrown: Invalid port range 22:674454981. Valid TCP ports should be between 1-65535 Jul 20 04:17:11.497220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eb1f6c7b-933f-43ea-89d0-f4d061623232 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-981b86a9-a3d9-45c9-ae29-6b7247990dd1 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Request method failure captured: Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 145 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HAb_qORjnV_K--ERJ42bdRO1X4If53E9IFE47nJ9dJUMobj9G4WuWdQDZVJ1Uqy6vlzak7kKmLLBZVxta1cmo7QuXReZ6wFmWcEhYp4SMTPVyfMGCiazcYPr-I1_7tQJsI_owOJudrACArGPy6Cdr_HcIH5Y6Fz-fL0AZJiV15N6g Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_51db347ce1b54d17a429ddd84259f720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 96941c8786294295ac5d95efd5f42f28 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: {"security_group_rule": {"parent_group_id": "f38da6da-e953-4ce4-93a7-44fc4d8359a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 674454981}} Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid port range 22:674454981. Valid TCP ports should be between 1-65535 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f38da6da-e953-4ce4-93a7-44fc4d8359a9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 674454981}}} Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:674454981. Valid TCP ports should be between 1-65535 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:674454981. Valid TCP ports should be between 1-65535 Jul 20 04:17:11.498967 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:11.505827 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:11.505827 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:11.505827 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:11.505827 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:11.505827 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:11.505827 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:11.505827 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:11.505827 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:674454981. Valid TCP ports should be between 1-65535 Jul 20 04:17:11.505827 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:11.511075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-981b86a9-a3d9-45c9-ae29-6b7247990dd1 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Returning 400 to user: Invalid port range 22:674454981. Valid TCP ports should be between 1-65535 {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:11.514940 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-981b86a9-a3d9-45c9-ae29-6b7247990dd1 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.388400 Jul 20 04:17:11.516830 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1247/2420] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:11 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 391 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:11.530516 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eb1f6c7b-933f-43ea-89d0-f4d061623232 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1215 microversion: 2.1 time: 0.185162 Jul 20 04:17:11.533099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0e479a7f-7ea0-43c0-a12c-1b8dcb2c58b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.544011 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1174/2421] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:11.549024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0e479a7f-7ea0-43c0-a12c-1b8dcb2c58b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.558809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66b0f570-14b3-470e-91b4-e4953e9f84df tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Action: 'create', calling method: .version_select at 0x7fb8426a2160>, body: {"pool": null} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:11.567637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0e479a7f-7ea0-43c0-a12c-1b8dcb2c58b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.569966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0e479a7f-7ea0-43c0-a12c-1b8dcb2c58b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.573240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0e479a7f-7ea0-43c0-a12c-1b8dcb2c58b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.573876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0e479a7f-7ea0-43c0-a12c-1b8dcb2c58b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.982217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0e479a7f-7ea0-43c0-a12c-1b8dcb2c58b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.992990 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0e479a7f-7ea0-43c0-a12c-1b8dcb2c58b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1522 microversion: 2.1 time: 0.473332 Jul 20 04:17:11.996975 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1248/2422] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:12.012768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a40bf0ea-a1c2-43a6-bdd7-000925fbaa6f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Action: 'create', calling method: .version_select at 0x7fb841436c10>, body: {"security_group_rule": {"parent_group_id": "52dc24f7-9e4a-4a4a-a169-ae7cce796b88", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:12.166471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-a40bf0ea-a1c2-43a6-bdd7-000925fbaa6f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 52dc24f7-9e4a-4a4a-a169-ae7cce796b88 does not exist", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:17:12.167538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.security_group_api [None req-a40bf0ea-a1c2-43a6-bdd7-000925fbaa6f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Neutron security group 52dc24f7-9e4a-4a4a-a169-ae7cce796b88 not found {{(pid=119606) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:17:12.168456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a40bf0ea-a1c2-43a6-bdd7-000925fbaa6f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] HTTP exception thrown: Security group 52dc24f7-9e4a-4a4a-a169-ae7cce796b88 does not exist Jul 20 04:17:12.168456 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-0de78928-4914-42b4-b368-219202f251b4'] Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a40bf0ea-a1c2-43a6-bdd7-000925fbaa6f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Request method failure captured: Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 138 Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HAb_qORjnV_K--ERJ42bdRO1X4If53E9IFE47nJ9dJUMobj9G4WuWdQDZVJ1Uqy6vlzak7kKmLLBZVxta1cmo7QuXReZ6wFmWcEhYp4SMTPVyfMGCiazcYPr-I1_7tQJsI_owOJudrACArGPy6Cdr_HcIH5Y6Fz-fL0AZJiV15N6g Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_51db347ce1b54d17a429ddd84259f720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 96941c8786294295ac5d95efd5f42f28 Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: {"security_group_rule": {"parent_group_id": "52dc24f7-9e4a-4a4a-a169-ae7cce796b88", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: exception: Security group 52dc24f7-9e4a-4a4a-a169-ae7cce796b88 does not exist Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-0de78928-4914-42b4-b368-219202f251b4'] Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'security_group_rule': {'parent_group_id': '52dc24f7-9e4a-4a4a-a169-ae7cce796b88', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:17:12.171083 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 52dc24f7-9e4a-4a4a-a169-ae7cce796b88 does not exist Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de78928-4914-42b4-b368-219202f251b4'] Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 52dc24f7-9e4a-4a4a-a169-ae7cce796b88 does not exist Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de78928-4914-42b4-b368-219202f251b4'] Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 52dc24f7-9e4a-4a4a-a169-ae7cce796b88 does not exist Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de78928-4914-42b4-b368-219202f251b4'] Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 52dc24f7-9e4a-4a4a-a169-ae7cce796b88 does not exist Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0de78928-4914-42b4-b368-219202f251b4'] Jul 20 04:17:12.176121 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.180771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a40bf0ea-a1c2-43a6-bdd7-000925fbaa6f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Returning 404 to user: Security group 52dc24f7-9e4a-4a4a-a169-ae7cce796b88 does not exist Jul 20 04:17:12.180771 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-0de78928-4914-42b4-b368-219202f251b4'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:12.182807 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a40bf0ea-a1c2-43a6-bdd7-000925fbaa6f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.182644 Jul 20 04:17:12.184032 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1249/2423] 10.222.0.59 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:11 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:12.197711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d531efa-3792-452c-a017-5dd149e42036 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.200882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d531efa-3792-452c-a017-5dd149e42036 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.220107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d531efa-3792-452c-a017-5dd149e42036 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.222103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d531efa-3792-452c-a017-5dd149e42036 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.225829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d531efa-3792-452c-a017-5dd149e42036 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.226533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d531efa-3792-452c-a017-5dd149e42036 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.736323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d531efa-3792-452c-a017-5dd149e42036 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.761613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d531efa-3792-452c-a017-5dd149e42036 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.763840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d531efa-3792-452c-a017-5dd149e42036 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.765408 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d531efa-3792-452c-a017-5dd149e42036 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1293 microversion: 2.25 time: 0.579095 Jul 20 04:17:12.766288 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1250/2424] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1293 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:12.772511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a72971eb-bb92-4e11-9e0f-baad025741df tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Calling method '.version_select at 0x7fb841e4a160>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.845622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-a72971eb-bb92-4e11-9e0f-baad025741df tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 9baadbf1-dff5-44d6-b6c5-dba14284a743 does not exist", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:17:12.846680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.security_group_api [None req-a72971eb-bb92-4e11-9e0f-baad025741df tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Neutron security group rule 9baadbf1-dff5-44d6-b6c5-dba14284a743 not found {{(pid=119606) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 20 04:17:12.847544 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a72971eb-bb92-4e11-9e0f-baad025741df tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] HTTP exception thrown: Security group rule 9baadbf1-dff5-44d6-b6c5-dba14284a743 does not exist Jul 20 04:17:12.847544 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-873e1e15-3a5a-4fc6-aa0c-dd04f52c5ae6'] Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a72971eb-bb92-4e11-9e0f-baad025741df tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Request method failure captured: Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-security-group-rules/9baadbf1-dff5-44d6-b6c5-dba14284a743 HTTP/1.1 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HAb_qORjnV_K--ERJ42bdRO1X4If53E9IFE47nJ9dJUMobj9G4WuWdQDZVJ1Uqy6vlzak7kKmLLBZVxta1cmo7QuXReZ6wFmWcEhYp4SMTPVyfMGCiazcYPr-I1_7tQJsI_owOJudrACArGPy6Cdr_HcIH5Y6Fz-fL0AZJiV15N6g Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/51db347ce1b54d17a429ddd84259f720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_51db347ce1b54d17a429ddd84259f720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 51db347ce1b54d17a429ddd84259f720 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 96941c8786294295ac5d95efd5f42f28 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: exception: Security group rule 9baadbf1-dff5-44d6-b6c5-dba14284a743 does not exist Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-873e1e15-3a5a-4fc6-aa0c-dd04f52c5ae6'] Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '9baadbf1-dff5-44d6-b6c5-dba14284a743'} Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:17:12.849712 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 9baadbf1-dff5-44d6-b6c5-dba14284a743 does not exist Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-873e1e15-3a5a-4fc6-aa0c-dd04f52c5ae6'] Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 9baadbf1-dff5-44d6-b6c5-dba14284a743 does not exist Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-873e1e15-3a5a-4fc6-aa0c-dd04f52c5ae6'] Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 9baadbf1-dff5-44d6-b6c5-dba14284a743 does not exist Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-873e1e15-3a5a-4fc6-aa0c-dd04f52c5ae6'] Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 9baadbf1-dff5-44d6-b6c5-dba14284a743 does not exist Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-873e1e15-3a5a-4fc6-aa0c-dd04f52c5ae6'] Jul 20 04:17:12.853481 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:12.858151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a72971eb-bb92-4e11-9e0f-baad025741df tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Returning 404 to user: Security group rule 9baadbf1-dff5-44d6-b6c5-dba14284a743 does not exist Jul 20 04:17:12.858151 n-d-760456-11 devstack@n-api.service[119606]: Neutron server returns request_ids: ['req-873e1e15-3a5a-4fc6-aa0c-dd04f52c5ae6'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:12.859578 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a72971eb-bb92-4e11-9e0f-baad025741df tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-group-rules/9baadbf1-dff5-44d6-b6c5-dba14284a743" status: 404 len: 199 microversion: 2.1 time: 0.091605 Jul 20 04:17:12.860246 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1251/2425] 10.222.0.59 () {58 vars in 1286 bytes} [Wed Jul 20 04:17:12 2022] DELETE /compute/v2.1/os-security-group-rules/9baadbf1-dff5-44d6-b6c5-dba14284a743 => generated 199 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:12.869362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-428758b0-1126-4bd0-9037-269d8e2b7384 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.872704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-428758b0-1126-4bd0-9037-269d8e2b7384 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.891554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-428758b0-1126-4bd0-9037-269d8e2b7384 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.892226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-428758b0-1126-4bd0-9037-269d8e2b7384 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.901708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-428758b0-1126-4bd0-9037-269d8e2b7384 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.902455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-428758b0-1126-4bd0-9037-269d8e2b7384 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.218989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-428758b0-1126-4bd0-9037-269d8e2b7384 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.231136 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-428758b0-1126-4bd0-9037-269d8e2b7384 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1273 microversion: 2.1 time: 0.369433 Jul 20 04:17:13.238005 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1252/2426] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1273 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:13.252891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-0f2e86a8-2dcc-4202-9c61-4314c94827a7 req-80272c42-f3ca-4fec-927d-58df439af1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3edbf03b-c74b-4814-81de-4645c207d91a", "tag": "df3fbf6a-1fad-4c47-af81-2713c574b472"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:13.270498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0f2e86a8-2dcc-4202-9c61-4314c94827a7 req-80272c42-f3ca-4fec-927d-58df439af1ca service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.270980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0f2e86a8-2dcc-4202-9c61-4314c94827a7 req-80272c42-f3ca-4fec-927d-58df439af1ca service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.285885 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-0f2e86a8-2dcc-4202-9c61-4314c94827a7 req-80272c42-f3ca-4fec-927d-58df439af1ca service nova] Creating event network-changed:df3fbf6a-1fad-4c47-af81-2713c574b472 for instance 3edbf03b-c74b-4814-81de-4645c207d91a on n-h2-760456-11 Jul 20 04:17:13.292280 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-0f2e86a8-2dcc-4202-9c61-4314c94827a7 req-80272c42-f3ca-4fec-927d-58df439af1ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052284 Jul 20 04:17:13.293494 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1253/2427] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:13.299838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-289d6303-1518-4c36-83ef-48023668be12 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Calling method '.version_select at 0x7fb8414363a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.170865 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-289d6303-1518-4c36-83ef-48023668be12 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/f38da6da-e953-4ce4-93a7-44fc4d8359a9" status: 202 len: 0 microversion: 2.1 time: 0.875717 Jul 20 04:17:14.171567 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1254/2428] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:13 2022] DELETE /compute/v2.1/os-security-groups/f38da6da-e953-4ce4-93a7-44fc4d8359a9 => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:14.176766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7c72fcd5-b311-42e3-afe9-909aa0a50b28 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.177846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7c72fcd5-b311-42e3-afe9-909aa0a50b28 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.191822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7c72fcd5-b311-42e3-afe9-909aa0a50b28 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.202938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7c72fcd5-b311-42e3-afe9-909aa0a50b28 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.203991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7c72fcd5-b311-42e3-afe9-909aa0a50b28 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.204581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7c72fcd5-b311-42e3-afe9-909aa0a50b28 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.606182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7c72fcd5-b311-42e3-afe9-909aa0a50b28 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.621145 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7c72fcd5-b311-42e3-afe9-909aa0a50b28 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1499 microversion: 2.1 time: 0.448180 Jul 20 04:17:14.635582 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1255/2429] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1499 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:14.915160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-914d1c7b-4192-4497-a27d-8972811b90d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.916184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-914d1c7b-4192-4497-a27d-8972811b90d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.927762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-914d1c7b-4192-4497-a27d-8972811b90d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.936874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-914d1c7b-4192-4497-a27d-8972811b90d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.938001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-914d1c7b-4192-4497-a27d-8972811b90d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.953603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-914d1c7b-4192-4497-a27d-8972811b90d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.521247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-914d1c7b-4192-4497-a27d-8972811b90d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.530087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-914d1c7b-4192-4497-a27d-8972811b90d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.533052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-914d1c7b-4192-4497-a27d-8972811b90d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.535310 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-914d1c7b-4192-4497-a27d-8972811b90d6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1293 microversion: 2.25 time: 0.897419 Jul 20 04:17:15.546559 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1256/2430] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1293 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:15.551418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5dedbcc9-29e8-49c0-9db4-e37c56945e1e req-d5fa7f47-2c3b-41a4-9010-04f805e580d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a486b5-316e-4426-972b-71b474a08ec1", "tag": "b20cde1f-e1ac-4d80-81e4-5833da356db0"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:15.560946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5dedbcc9-29e8-49c0-9db4-e37c56945e1e req-d5fa7f47-2c3b-41a4-9010-04f805e580d0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.561605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5dedbcc9-29e8-49c0-9db4-e37c56945e1e req-d5fa7f47-2c3b-41a4-9010-04f805e580d0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.576965 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5dedbcc9-29e8-49c0-9db4-e37c56945e1e req-d5fa7f47-2c3b-41a4-9010-04f805e580d0 service nova] Creating event network-changed:b20cde1f-e1ac-4d80-81e4-5833da356db0 for instance d7a486b5-316e-4426-972b-71b474a08ec1 on n-h1-760456-11 Jul 20 04:17:15.584343 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5dedbcc9-29e8-49c0-9db4-e37c56945e1e req-d5fa7f47-2c3b-41a4-9010-04f805e580d0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036436 Jul 20 04:17:15.585571 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1257/2431] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:15.590812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e2e6328d-71dd-4607-8c11-65cfbe7890fa tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Calling method '.version_select at 0x7fb8413da3a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:15.732884 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-66b0f570-14b3-470e-91b4-e4953e9f84df tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.188349 Jul 20 04:17:15.740350 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1175/2432] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:17:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:15.748159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e573bb81-119f-40cf-b29a-66b1a4427356 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:15.749722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e573bb81-119f-40cf-b29a-66b1a4427356 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:15.763860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e573bb81-119f-40cf-b29a-66b1a4427356 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.764506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e573bb81-119f-40cf-b29a-66b1a4427356 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.765772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e573bb81-119f-40cf-b29a-66b1a4427356 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.766942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e573bb81-119f-40cf-b29a-66b1a4427356 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.114422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e573bb81-119f-40cf-b29a-66b1a4427356 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:16.128280 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e573bb81-119f-40cf-b29a-66b1a4427356 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1315 microversion: 2.1 time: 0.393483 Jul 20 04:17:16.140103 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1176/2433] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:15 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:16.152179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ee6d296-602f-43b3-8501-a3492364a821 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.158282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8ee6d296-602f-43b3-8501-a3492364a821 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:16.159605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8ee6d296-602f-43b3-8501-a3492364a821 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:16.167830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ee6d296-602f-43b3-8501-a3492364a821 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.168709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ee6d296-602f-43b3-8501-a3492364a821 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.170044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ee6d296-602f-43b3-8501-a3492364a821 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.171578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ee6d296-602f-43b3-8501-a3492364a821 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.211124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-8ee6d296-602f-43b3-8501-a3492364a821 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:16.250285 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8ee6d296-602f-43b3-8501-a3492364a821 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.107666 Jul 20 04:17:16.251469 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1177/2434] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Jul 20 04:17:16 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:16.264828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.212"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:16.266399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:16.269473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:16.275585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.276242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.277373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.277991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.310057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Acquired lock "refresh_cache-3edbf03b-c74b-4814-81de-4645c207d91a" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:17:16.626037 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e2e6328d-71dd-4607-8c11-65cfbe7890fa tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/34ab018b-12da-49ce-aaa5-b02df03f41ad" status: 202 len: 0 microversion: 2.1 time: 1.038989 Jul 20 04:17:16.630304 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1258/2435] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:15 2022] DELETE /compute/v2.1/os-security-groups/34ab018b-12da-49ce-aaa5-b02df03f41ad => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:16.636480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2679e9da-781b-4f81-a4cd-100d379a6889 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:16.656979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2679e9da-781b-4f81-a4cd-100d379a6889 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.657453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2679e9da-781b-4f81-a4cd-100d379a6889 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.711238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2679e9da-781b-4f81-a4cd-100d379a6889 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Going to try to start instance {{(pid=119606) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:17:16.795483 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2679e9da-781b-4f81-a4cd-100d379a6889 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "POST /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159/action" status: 202 len: 0 microversion: 2.1 time: 0.163638 Jul 20 04:17:16.797455 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1259/2436] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:16 2022] POST /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:16.803332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f681152b-6d64-4e51-bd40-58c22a4f104c req-7d969ff9-d48c-4ebc-a5ee-3dafb3a8e6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021c9592-bd4c-4506-8422-4ff0c8e2f141", "tag": "4da41aa3-a22e-4da5-ad9b-4f4e3bfea0bc"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:16.813064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f681152b-6d64-4e51-bd40-58c22a4f104c req-7d969ff9-d48c-4ebc-a5ee-3dafb3a8e6a4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.813779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f681152b-6d64-4e51-bd40-58c22a4f104c req-7d969ff9-d48c-4ebc-a5ee-3dafb3a8e6a4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.829449 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f681152b-6d64-4e51-bd40-58c22a4f104c req-7d969ff9-d48c-4ebc-a5ee-3dafb3a8e6a4 service nova] Creating event network-changed:4da41aa3-a22e-4da5-ad9b-4f4e3bfea0bc for instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 on n-h2-760456-11 Jul 20 04:17:16.835988 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f681152b-6d64-4e51-bd40-58c22a4f104c req-7d969ff9-d48c-4ebc-a5ee-3dafb3a8e6a4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037047 Jul 20 04:17:16.836986 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1260/2437] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:16.844763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1302d9dd-b5d5-4053-806b-1432bdaf475d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.845811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1302d9dd-b5d5-4053-806b-1432bdaf475d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:16.853519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1302d9dd-b5d5-4053-806b-1432bdaf475d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.854213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1302d9dd-b5d5-4053-806b-1432bdaf475d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.855250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1302d9dd-b5d5-4053-806b-1432bdaf475d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.855884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1302d9dd-b5d5-4053-806b-1432bdaf475d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.279210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1302d9dd-b5d5-4053-806b-1432bdaf475d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.288174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1302d9dd-b5d5-4053-806b-1432bdaf475d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.296853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1302d9dd-b5d5-4053-806b-1432bdaf475d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.298812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1302d9dd-b5d5-4053-806b-1432bdaf475d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1293 microversion: 2.25 time: 0.459964 Jul 20 04:17:17.299553 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1261/2438] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:16 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1293 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:17.314495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b2d6cca-e320-41a6-af92-1a3b6337f1a7 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Calling method '.version_select at 0x7fb841e4a1f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.657395 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b2d6cca-e320-41a6-af92-1a3b6337f1a7 tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/d3f5961a-c7bc-49e1-a513-dc8611be3436" status: 202 len: 0 microversion: 2.1 time: 0.356122 Jul 20 04:17:17.662021 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1262/2439] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:17 2022] DELETE /compute/v2.1/os-security-groups/d3f5961a-c7bc-49e1-a513-dc8611be3436 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:17.667827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50adff82-9240-4961-bc73-6743b988ec83 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.668567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-50adff82-9240-4961-bc73-6743b988ec83 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:17.676101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50adff82-9240-4961-bc73-6743b988ec83 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.676691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50adff82-9240-4961-bc73-6743b988ec83 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.677637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50adff82-9240-4961-bc73-6743b988ec83 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.678842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50adff82-9240-4961-bc73-6743b988ec83 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.826928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-50adff82-9240-4961-bc73-6743b988ec83 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.842091 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-50adff82-9240-4961-bc73-6743b988ec83 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1508 microversion: 2.1 time: 0.178242 Jul 20 04:17:17.842717 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1263/2440] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:17.847609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4f9c7a76-e101-43da-be94-d19615303a8c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.848229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4f9c7a76-e101-43da-be94-d19615303a8c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:17.855373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f9c7a76-e101-43da-be94-d19615303a8c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.855838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f9c7a76-e101-43da-be94-d19615303a8c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.856813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f9c7a76-e101-43da-be94-d19615303a8c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.857262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f9c7a76-e101-43da-be94-d19615303a8c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.074044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4f9c7a76-e101-43da-be94-d19615303a8c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.085705 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4f9c7a76-e101-43da-be94-d19615303a8c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1315 microversion: 2.1 time: 0.241701 Jul 20 04:17:18.095348 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1264/2441] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:18.095348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f56f89f-4962-40d0-b9f0-0c3c4be7201e tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Calling method '.version_select at 0x7fb8413c9670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.400301 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f56f89f-4962-40d0-b9f0-0c3c4be7201e tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/22ace0d4-69fb-48dc-a5bf-791bb0731690" status: 202 len: 0 microversion: 2.1 time: 0.310217 Jul 20 04:17:18.400778 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1265/2442] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:18 2022] DELETE /compute/v2.1/os-security-groups/22ace0d4-69fb-48dc-a5bf-791bb0731690 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:18.409624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c00cb04-ae04-4402-9180-0b38ab10d085 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.410319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3c00cb04-ae04-4402-9180-0b38ab10d085 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:18.430136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c00cb04-ae04-4402-9180-0b38ab10d085 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.431267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c00cb04-ae04-4402-9180-0b38ab10d085 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.432077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c00cb04-ae04-4402-9180-0b38ab10d085 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.432535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c00cb04-ae04-4402-9180-0b38ab10d085 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.545004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Building network info cache for instance {{(pid=119605) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:17:18.634467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3c00cb04-ae04-4402-9180-0b38ab10d085 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.644102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3c00cb04-ae04-4402-9180-0b38ab10d085 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.648290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3c00cb04-ae04-4402-9180-0b38ab10d085 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.649845 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3c00cb04-ae04-4402-9180-0b38ab10d085 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1281 microversion: 2.25 time: 0.247811 Jul 20 04:17:18.651043 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1266/2443] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1281 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:18.656643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-48e501ac-3d8e-4776-95ae-e78f8e1b8b2f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] Calling method '.version_select at 0x7fb8413f5af0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.997061 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-48e501ac-3d8e-4776-95ae-e78f8e1b8b2f tempest-SecurityGroupRulesNegativeTestJSON-1031517366 tempest-SecurityGroupRulesNegativeTestJSON-1031517366-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a" status: 202 len: 0 microversion: 2.1 time: 0.343886 Jul 20 04:17:19.000739 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1267/2444] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:18 2022] DELETE /compute/v2.1/os-security-groups/b4bc06d2-fa7b-4dbe-9a91-0432ed0eb28a => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:19.010094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c093bfe8-1267-4007-9825-ef7a238ef248 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.011897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c093bfe8-1267-4007-9825-ef7a238ef248 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.042456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c093bfe8-1267-4007-9825-ef7a238ef248 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.044571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c093bfe8-1267-4007-9825-ef7a238ef248 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.047536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c093bfe8-1267-4007-9825-ef7a238ef248 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.049119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c093bfe8-1267-4007-9825-ef7a238ef248 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.492310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c093bfe8-1267-4007-9825-ef7a238ef248 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:19.506578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Updating instance_info_cache with network_info: [{"id": "df3fbf6a-1fad-4c47-af81-2713c574b472", "address": "fa:16:3e:b2:1d:79", "network": {"id": "b41e485e-9677-46be-b79c-682925f67dfc", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-382677529-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "228b024e44374bb3babb59c15bfb37a1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdf3fbf6a-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119605) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:17:19.514178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:19.515471 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c093bfe8-1267-4007-9825-ef7a238ef248 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1512 microversion: 2.1 time: 0.513323 Jul 20 04:17:19.530955 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1268/2445] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1512 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:19.538734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-af557794-cb09-4be1-83fa-dd1a4a3ded0a req-b12de028-511a-4c60-afd5-d3b533675417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3edbf03b-c74b-4814-81de-4645c207d91a", "tag": "df3fbf6a-1fad-4c47-af81-2713c574b472"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:19.552570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Releasing lock "refresh_cache-3edbf03b-c74b-4814-81de-4645c207d91a" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:17:19.554163 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8a8b97dd-3333-4d77-8550-657d1dac435a tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "POST /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a/action" status: 202 len: 0 microversion: 2.1 time: 3.301648 Jul 20 04:17:19.555182 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1178/2446] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:16 2022] POST /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a/action => generated 0 bytes in 3303 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:17:19.560384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-62e82366-80fc-4e18-953b-2fe465486761 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.561013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-62e82366-80fc-4e18-953b-2fe465486761 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.568748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-af557794-cb09-4be1-83fa-dd1a4a3ded0a req-b12de028-511a-4c60-afd5-d3b533675417 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.568969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-af557794-cb09-4be1-83fa-dd1a4a3ded0a req-b12de028-511a-4c60-afd5-d3b533675417 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.577055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62e82366-80fc-4e18-953b-2fe465486761 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.581476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62e82366-80fc-4e18-953b-2fe465486761 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.583233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62e82366-80fc-4e18-953b-2fe465486761 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.583860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62e82366-80fc-4e18-953b-2fe465486761 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.593246 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-af557794-cb09-4be1-83fa-dd1a4a3ded0a req-b12de028-511a-4c60-afd5-d3b533675417 service nova] Creating event network-changed:df3fbf6a-1fad-4c47-af81-2713c574b472 for instance 3edbf03b-c74b-4814-81de-4645c207d91a on n-h2-760456-11 Jul 20 04:17:19.607035 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-af557794-cb09-4be1-83fa-dd1a4a3ded0a req-b12de028-511a-4c60-afd5-d3b533675417 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073881 Jul 20 04:17:19.608278 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1269/2447] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:19.620575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cadc3267-6be8-4a1d-a250-c60dec36d3b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.626701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cadc3267-6be8-4a1d-a250-c60dec36d3b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:19.627213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.compute.servers [None req-cadc3267-6be8-4a1d-a250-c60dec36d3b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Removing options 'limit' from query {{(pid=119606) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:17:19.630648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cadc3267-6be8-4a1d-a250-c60dec36d3b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:19.635455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cadc3267-6be8-4a1d-a250-c60dec36d3b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.636476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cadc3267-6be8-4a1d-a250-c60dec36d3b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.638915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cadc3267-6be8-4a1d-a250-c60dec36d3b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.639895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cadc3267-6be8-4a1d-a250-c60dec36d3b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.642557 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cadc3267-6be8-4a1d-a250-c60dec36d3b2 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.032079 Jul 20 04:17:19.644501 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1270/2448] 10.222.0.59 () {58 vars in 1139 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:17:19.657103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.212"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:19.957171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-62e82366-80fc-4e18-953b-2fe465486761 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:19.966534 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-62e82366-80fc-4e18-953b-2fe465486761 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1315 microversion: 2.1 time: 0.409433 Jul 20 04:17:19.968481 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1179/2449] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:19.973432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eb573b0d-33e2-49ae-860c-6de2f6a1849f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.974306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eb573b0d-33e2-49ae-860c-6de2f6a1849f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.981391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.982895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb573b0d-33e2-49ae-860c-6de2f6a1849f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.983571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb573b0d-33e2-49ae-860c-6de2f6a1849f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.984652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb573b0d-33e2-49ae-860c-6de2f6a1849f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.985094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb573b0d-33e2-49ae-860c-6de2f6a1849f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.989616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.990088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.990964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.994240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.247792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eb573b0d-33e2-49ae-860c-6de2f6a1849f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.257319 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eb573b0d-33e2-49ae-860c-6de2f6a1849f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1512 microversion: 2.1 time: 0.287439 Jul 20 04:17:20.258274 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1180/2450] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.265137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0df16cfd-bb6b-4407-ac56-7d4d690197dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.265994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0df16cfd-bb6b-4407-ac56-7d4d690197dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.273874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0df16cfd-bb6b-4407-ac56-7d4d690197dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.274368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0df16cfd-bb6b-4407-ac56-7d4d690197dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.275260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0df16cfd-bb6b-4407-ac56-7d4d690197dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.276029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0df16cfd-bb6b-4407-ac56-7d4d690197dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.509282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0df16cfd-bb6b-4407-ac56-7d4d690197dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.517910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0df16cfd-bb6b-4407-ac56-7d4d690197dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.519512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0df16cfd-bb6b-4407-ac56-7d4d690197dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.520947 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0df16cfd-bb6b-4407-ac56-7d4d690197dc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1281 microversion: 2.25 time: 0.261072 Jul 20 04:17:20.521536 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1181/2451] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1281 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:20.527189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-05b96c3d-e487-4174-b03b-5b51824053d8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.528064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05b96c3d-e487-4174-b03b-5b51824053d8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: c561dbb2-7811-4eeb-b05c-0df4ee20c622] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.534921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05b96c3d-e487-4174-b03b-5b51824053d8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.535624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05b96c3d-e487-4174-b03b-5b51824053d8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.536550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05b96c3d-e487-4174-b03b-5b51824053d8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.537807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05b96c3d-e487-4174-b03b-5b51824053d8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.548090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:20.595048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:20.688961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05b96c3d-e487-4174-b03b-5b51824053d8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.698447 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-05b96c3d-e487-4174-b03b-5b51824053d8 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622" status: 200 len: 1511 microversion: 2.1 time: 0.175606 Jul 20 04:17:20.699046 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1182/2452] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622 => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.715779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-817bfa7e-2f13-4a06-9fde-554bb8662173 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.716405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-817bfa7e-2f13-4a06-9fde-554bb8662173 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.723520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-817bfa7e-2f13-4a06-9fde-554bb8662173 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.724198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-817bfa7e-2f13-4a06-9fde-554bb8662173 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.725454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-817bfa7e-2f13-4a06-9fde-554bb8662173 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.725907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-817bfa7e-2f13-4a06-9fde-554bb8662173 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.848525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Acquired lock "refresh_cache-3edbf03b-c74b-4814-81de-4645c207d91a" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:17:20.988920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-817bfa7e-2f13-4a06-9fde-554bb8662173 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:21.001801 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-817bfa7e-2f13-4a06-9fde-554bb8662173 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1511 microversion: 2.1 time: 0.290359 Jul 20 04:17:21.003269 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1183/2453] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:21.010569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bb3a4867-2739-4b4a-9520-18ced2283cdb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:21.011421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bb3a4867-2739-4b4a-9520-18ced2283cdb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:21.020931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb3a4867-2739-4b4a-9520-18ced2283cdb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.021735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb3a4867-2739-4b4a-9520-18ced2283cdb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.023290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb3a4867-2739-4b4a-9520-18ced2283cdb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.023934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb3a4867-2739-4b4a-9520-18ced2283cdb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.273397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bb3a4867-2739-4b4a-9520-18ced2283cdb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:21.281626 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bb3a4867-2739-4b4a-9520-18ced2283cdb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1315 microversion: 2.1 time: 0.276412 Jul 20 04:17:21.291383 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1184/2454] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:21 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:21.296204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-acfccd96-30a5-4928-aee2-67d91f237080 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:21.300117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-acfccd96-30a5-4928-aee2-67d91f237080 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:21.301497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-acfccd96-30a5-4928-aee2-67d91f237080 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:21.427758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acfccd96-30a5-4928-aee2-67d91f237080 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.429539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acfccd96-30a5-4928-aee2-67d91f237080 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.430660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acfccd96-30a5-4928-aee2-67d91f237080 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.431100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acfccd96-30a5-4928-aee2-67d91f237080 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.532496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:21.537880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-acfccd96-30a5-4928-aee2-67d91f237080 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:21.601945 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-acfccd96-30a5-4928-aee2-67d91f237080 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 0.309350 Jul 20 04:17:21.606340 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1185/2455] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Jul 20 04:17:21 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:21.607635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3de96d99-8e0b-4cb9-b410-b45db5296dfb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:21.609455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3de96d99-8e0b-4cb9-b410-b45db5296dfb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:21.614818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3de96d99-8e0b-4cb9-b410-b45db5296dfb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.615867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3de96d99-8e0b-4cb9-b410-b45db5296dfb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.616632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3de96d99-8e0b-4cb9-b410-b45db5296dfb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.617238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3de96d99-8e0b-4cb9-b410-b45db5296dfb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.133065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3de96d99-8e0b-4cb9-b410-b45db5296dfb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:22.142031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3de96d99-8e0b-4cb9-b410-b45db5296dfb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:22.145623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3de96d99-8e0b-4cb9-b410-b45db5296dfb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:22.147099 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3de96d99-8e0b-4cb9-b410-b45db5296dfb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1281 microversion: 2.25 time: 0.543191 Jul 20 04:17:22.147750 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1186/2456] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:21 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1281 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:22.152920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-61270fa8-3819-438f-87bb-f39eaaecf870 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.154001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-61270fa8-3819-438f-87bb-f39eaaecf870 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:22.164741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61270fa8-3819-438f-87bb-f39eaaecf870 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.165235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61270fa8-3819-438f-87bb-f39eaaecf870 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.166212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61270fa8-3819-438f-87bb-f39eaaecf870 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.166756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61270fa8-3819-438f-87bb-f39eaaecf870 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.339653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-61270fa8-3819-438f-87bb-f39eaaecf870 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:22.349002 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-61270fa8-3819-438f-87bb-f39eaaecf870 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1512 microversion: 2.1 time: 0.199753 Jul 20 04:17:22.360283 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1187/2457] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:22 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:22.360283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1e1fc088-119c-4fd2-a36a-ac23be2d9e08 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.360283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1e1fc088-119c-4fd2-a36a-ac23be2d9e08 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:22.362798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e1fc088-119c-4fd2-a36a-ac23be2d9e08 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.363264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e1fc088-119c-4fd2-a36a-ac23be2d9e08 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.364133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e1fc088-119c-4fd2-a36a-ac23be2d9e08 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.364690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e1fc088-119c-4fd2-a36a-ac23be2d9e08 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.575087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Building network info cache for instance {{(pid=119606) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:17:22.578977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1e1fc088-119c-4fd2-a36a-ac23be2d9e08 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:22.601940 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1e1fc088-119c-4fd2-a36a-ac23be2d9e08 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1315 microversion: 2.1 time: 0.239558 Jul 20 04:17:22.606920 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1188/2458] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:22 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:22.616150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ff3d90b-90d4-4a97-9c1e-4ff0126d038d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.619179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ff3d90b-90d4-4a97-9c1e-4ff0126d038d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: c561dbb2-7811-4eeb-b05c-0df4ee20c622] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:22.627488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ff3d90b-90d4-4a97-9c1e-4ff0126d038d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.628280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ff3d90b-90d4-4a97-9c1e-4ff0126d038d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.629623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ff3d90b-90d4-4a97-9c1e-4ff0126d038d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.630287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ff3d90b-90d4-4a97-9c1e-4ff0126d038d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.824869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ff3d90b-90d4-4a97-9c1e-4ff0126d038d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:22.835273 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ff3d90b-90d4-4a97-9c1e-4ff0126d038d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622" status: 200 len: 1511 microversion: 2.1 time: 0.226832 Jul 20 04:17:22.845627 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1189/2459] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:22 2022] GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622 => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:22.845627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3f3b763b-780b-40a8-b510-68a1639f3ae5 req-3365fe94-5f35-456a-b5db-874d2097357c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3edbf03b-c74b-4814-81de-4645c207d91a", "tag": "df3fbf6a-1fad-4c47-af81-2713c574b472"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:22.855200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3f3b763b-780b-40a8-b510-68a1639f3ae5 req-3365fe94-5f35-456a-b5db-874d2097357c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.855768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3f3b763b-780b-40a8-b510-68a1639f3ae5 req-3365fe94-5f35-456a-b5db-874d2097357c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.871098 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3f3b763b-780b-40a8-b510-68a1639f3ae5 req-3365fe94-5f35-456a-b5db-874d2097357c service nova] Creating event network-changed:df3fbf6a-1fad-4c47-af81-2713c574b472 for instance 3edbf03b-c74b-4814-81de-4645c207d91a on n-h2-760456-11 Jul 20 04:17:22.877927 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3f3b763b-780b-40a8-b510-68a1639f3ae5 req-3365fe94-5f35-456a-b5db-874d2097357c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039550 Jul 20 04:17:22.879955 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1190/2460] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:22.886391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7060eb65-3902-4d54-acce-a83e4c3b2db9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.888299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7060eb65-3902-4d54-acce-a83e4c3b2db9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:22.898387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7060eb65-3902-4d54-acce-a83e4c3b2db9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.899021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7060eb65-3902-4d54-acce-a83e4c3b2db9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.899903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7060eb65-3902-4d54-acce-a83e4c3b2db9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.900465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7060eb65-3902-4d54-acce-a83e4c3b2db9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.211125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7060eb65-3902-4d54-acce-a83e4c3b2db9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.225049 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7060eb65-3902-4d54-acce-a83e4c3b2db9 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1511 microversion: 2.1 time: 0.343257 Jul 20 04:17:23.231066 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1191/2461] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:22 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:23.242362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d9b858a9-d5da-47ef-8d33-6c31e5736a35 req-f287e5b4-e7b9-486a-9bc6-6d7d79801413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021c9592-bd4c-4506-8422-4ff0c8e2f141", "name": "network-vif-plugged", "status": "completed", "tag": "4da41aa3-a22e-4da5-ad9b-4f4e3bfea0bc"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:23.266369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d9b858a9-d5da-47ef-8d33-6c31e5736a35 req-f287e5b4-e7b9-486a-9bc6-6d7d79801413 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.272542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d9b858a9-d5da-47ef-8d33-6c31e5736a35 req-f287e5b4-e7b9-486a-9bc6-6d7d79801413 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.305873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d9b858a9-d5da-47ef-8d33-6c31e5736a35 req-f287e5b4-e7b9-486a-9bc6-6d7d79801413 service nova] Creating event network-vif-plugged:4da41aa3-a22e-4da5-ad9b-4f4e3bfea0bc for instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 on n-h2-760456-11 Jul 20 04:17:23.312172 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d9b858a9-d5da-47ef-8d33-6c31e5736a35 req-f287e5b4-e7b9-486a-9bc6-6d7d79801413 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079449 Jul 20 04:17:23.319751 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1192/2462] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:23.325887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3f09101-575e-446a-b849-a6dca91b0d30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:23.326911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e3f09101-575e-446a-b849-a6dca91b0d30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:23.340834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3f09101-575e-446a-b849-a6dca91b0d30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.341568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3f09101-575e-446a-b849-a6dca91b0d30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.342621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3f09101-575e-446a-b849-a6dca91b0d30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.343240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3f09101-575e-446a-b849-a6dca91b0d30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.726116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3f09101-575e-446a-b849-a6dca91b0d30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.744051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3f09101-575e-446a-b849-a6dca91b0d30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.746456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3f09101-575e-446a-b849-a6dca91b0d30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.749824 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e3f09101-575e-446a-b849-a6dca91b0d30 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1281 microversion: 2.25 time: 0.428142 Jul 20 04:17:23.758998 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1193/2463] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:23 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1281 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:23.763994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:23.767361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.768185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:23.789079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.789914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.791104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.791732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.865842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:23.961414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.993857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.995248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.313137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Updating instance_info_cache with network_info: [{"id": "df3fbf6a-1fad-4c47-af81-2713c574b472", "address": "fa:16:3e:b2:1d:79", "network": {"id": "b41e485e-9677-46be-b79c-682925f67dfc", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-382677529-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "228b024e44374bb3babb59c15bfb37a1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdf3fbf6a-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119606) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:17:24.344766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Releasing lock "refresh_cache-3edbf03b-c74b-4814-81de-4645c207d91a" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:17:24.346014 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-501029bc-9735-4426-9861-29afd9938cb2 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "POST /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a/action" status: 202 len: 0 microversion: 2.1 time: 4.692890 Jul 20 04:17:24.347251 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1271/2464] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:19 2022] POST /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a/action => generated 0 bytes in 4694 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:17:24.352632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2a7e06e1-7caf-4189-869b-546250661246 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.354206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2a7e06e1-7caf-4189-869b-546250661246 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:24.375166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a7e06e1-7caf-4189-869b-546250661246 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.375923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a7e06e1-7caf-4189-869b-546250661246 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.376882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a7e06e1-7caf-4189-869b-546250661246 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.383296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a7e06e1-7caf-4189-869b-546250661246 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.470817 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-012d1598-85a4-4e51-9a5d-f70f4537fd17 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.710524 Jul 20 04:17:24.486562 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1194/2465] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:17:23 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:24.493286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-870079b0-0c8c-4fdb-92f4-3f6ce0c4c175 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '.version_select at 0x7fb841e38820>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.680403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2a7e06e1-7caf-4189-869b-546250661246 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.683231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:24.703810 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2a7e06e1-7caf-4189-869b-546250661246 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1315 microversion: 2.1 time: 0.353912 Jul 20 04:17:24.715093 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1272/2466] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:24.721157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd1e98c0-b24a-49e1-9be7-c8c788f8d89b tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.726202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cd1e98c0-b24a-49e1-9be7-c8c788f8d89b tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.727292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd1e98c0-b24a-49e1-9be7-c8c788f8d89b tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:25.024789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd1e98c0-b24a-49e1-9be7-c8c788f8d89b tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.027198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd1e98c0-b24a-49e1-9be7-c8c788f8d89b tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.035152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd1e98c0-b24a-49e1-9be7-c8c788f8d89b tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.039038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd1e98c0-b24a-49e1-9be7-c8c788f8d89b tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.197571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-cd1e98c0-b24a-49e1-9be7-c8c788f8d89b tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:25.277049 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd1e98c0-b24a-49e1-9be7-c8c788f8d89b tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.560329 Jul 20 04:17:25.284866 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1273/2467] 10.222.0.59 () {58 vars in 1149 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:25.285588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1775f8f4-a881-47b0-acac-0337235d704d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:25.286305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1775f8f4-a881-47b0-acac-0337235d704d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:25.295048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1775f8f4-a881-47b0-acac-0337235d704d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.295654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1775f8f4-a881-47b0-acac-0337235d704d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.297192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1775f8f4-a881-47b0-acac-0337235d704d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.297669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1775f8f4-a881-47b0-acac-0337235d704d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.569775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1775f8f4-a881-47b0-acac-0337235d704d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.586670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1775f8f4-a881-47b0-acac-0337235d704d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.588736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1775f8f4-a881-47b0-acac-0337235d704d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.592808 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1775f8f4-a881-47b0-acac-0337235d704d tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1281 microversion: 2.25 time: 0.313498 Jul 20 04:17:25.593978 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1274/2468] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:25 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1281 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:25.610108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-25797e35-1747-42a2-9a05-641ce6fa17d3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:25.615793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-25797e35-1747-42a2-9a05-641ce6fa17d3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.616724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-25797e35-1747-42a2-9a05-641ce6fa17d3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:25.623832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25797e35-1747-42a2-9a05-641ce6fa17d3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.625092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25797e35-1747-42a2-9a05-641ce6fa17d3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.626965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25797e35-1747-42a2-9a05-641ce6fa17d3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.627592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25797e35-1747-42a2-9a05-641ce6fa17d3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.742903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-25797e35-1747-42a2-9a05-641ce6fa17d3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:25.827845 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-25797e35-1747-42a2-9a05-641ce6fa17d3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.231852 Jul 20 04:17:25.830038 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1275/2469] 10.222.0.59 () {58 vars in 1211 bytes} [Wed Jul 20 04:17:25 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:25.835573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c358e26-4acb-4397-a06b-205865a22fd6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:25.836460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2c358e26-4acb-4397-a06b-205865a22fd6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:25.845015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c358e26-4acb-4397-a06b-205865a22fd6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.845908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c358e26-4acb-4397-a06b-205865a22fd6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.847555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c358e26-4acb-4397-a06b-205865a22fd6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.848287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c358e26-4acb-4397-a06b-205865a22fd6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.112837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c358e26-4acb-4397-a06b-205865a22fd6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:26.124318 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c358e26-4acb-4397-a06b-205865a22fd6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1503 microversion: 2.1 time: 0.292722 Jul 20 04:17:26.126848 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1276/2470] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:25 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:26.139929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8593d250-01c9-4631-a478-3513df68c696 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:26.144421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8593d250-01c9-4631-a478-3513df68c696 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:26.150727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8593d250-01c9-4631-a478-3513df68c696 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:26.163455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8593d250-01c9-4631-a478-3513df68c696 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.164549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8593d250-01c9-4631-a478-3513df68c696 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.168724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8593d250-01c9-4631-a478-3513df68c696 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.171816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8593d250-01c9-4631-a478-3513df68c696 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.316229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-8593d250-01c9-4631-a478-3513df68c696 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:26.821227 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8593d250-01c9-4631-a478-3513df68c696 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.693035 Jul 20 04:17:26.828046 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1277/2471] 10.222.0.59 () {58 vars in 1195 bytes} [Wed Jul 20 04:17:26 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:26.835191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-42dc7006-8b2d-4f99-ad61-6e901bd520ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:26.836052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-42dc7006-8b2d-4f99-ad61-6e901bd520ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:26.855509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42dc7006-8b2d-4f99-ad61-6e901bd520ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.856129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42dc7006-8b2d-4f99-ad61-6e901bd520ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.857037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42dc7006-8b2d-4f99-ad61-6e901bd520ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.857747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42dc7006-8b2d-4f99-ad61-6e901bd520ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.888909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-42dc7006-8b2d-4f99-ad61-6e901bd520ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lazy-loading 'flavor' on Instance uuid 021c9592-bd4c-4506-8422-4ff0c8e2f141 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:26.914082 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-870079b0-0c8c-4fdb-92f4-3f6ce0c4c175 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/22346e4c-bbbc-4a57-8e98-01dd87376df3" status: 202 len: 0 microversion: 2.1 time: 2.426039 Jul 20 04:17:26.914814 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1195/2472] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:17:24 2022] DELETE /compute/v2.1/os-floating-ips/22346e4c-bbbc-4a57-8e98-01dd87376df3 => generated 0 bytes in 2427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:26.922117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a75a621-9e5c-4fef-9c42-e9013d438bdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:26.923042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2a75a621-9e5c-4fef-9c42-e9013d438bdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:26.936258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a75a621-9e5c-4fef-9c42-e9013d438bdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.937201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a75a621-9e5c-4fef-9c42-e9013d438bdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.938068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a75a621-9e5c-4fef-9c42-e9013d438bdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.938542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a75a621-9e5c-4fef-9c42-e9013d438bdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.995212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:27.186746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2a75a621-9e5c-4fef-9c42-e9013d438bdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.201737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2a75a621-9e5c-4fef-9c42-e9013d438bdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.203219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2a75a621-9e5c-4fef-9c42-e9013d438bdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.204355 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a75a621-9e5c-4fef-9c42-e9013d438bdb tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1281 microversion: 2.25 time: 0.288705 Jul 20 04:17:27.210680 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1196/2473] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:26 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1281 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:27.215317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9159fc2a-525b-42a9-82a7-5679098c0590 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:27.220068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9159fc2a-525b-42a9-82a7-5679098c0590 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.220768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9159fc2a-525b-42a9-82a7-5679098c0590 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'name': '-891904652', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:27.235901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9159fc2a-525b-42a9-82a7-5679098c0590 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.236556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9159fc2a-525b-42a9-82a7-5679098c0590 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.237601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9159fc2a-525b-42a9-82a7-5679098c0590 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.238216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9159fc2a-525b-42a9-82a7-5679098c0590 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.317848 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-42dc7006-8b2d-4f99-ad61-6e901bd520ee tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141/action" status: 202 len: 0 microversion: 2.1 time: 0.488430 Jul 20 04:17:27.322928 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1278/2474] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:26 2022] POST /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:27.328156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-100f546d-1daf-4418-93f5-eeaa72438ba1 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '.version_select at 0x7fb8413c9ee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:27.367335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-9159fc2a-525b-42a9-82a7-5679098c0590 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:27.439639 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9159fc2a-525b-42a9-82a7-5679098c0590 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?name=-891904652" status: 200 len: 345 microversion: 2.1 time: 0.226586 Jul 20 04:17:27.447796 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1197/2475] 10.222.0.59 () {58 vars in 1155 bytes} [Wed Jul 20 04:17:27 2022] GET /compute/v2.1/servers?name=-891904652 => generated 345 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:27.447796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b1b5c58b-3117-4690-a497-be5f5c56faec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:27.448320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b1b5c58b-3117-4690-a497-be5f5c56faec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:27.455171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1b5c58b-3117-4690-a497-be5f5c56faec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.455697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1b5c58b-3117-4690-a497-be5f5c56faec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.456718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1b5c58b-3117-4690-a497-be5f5c56faec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.457209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1b5c58b-3117-4690-a497-be5f5c56faec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.616804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b1b5c58b-3117-4690-a497-be5f5c56faec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.625231 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b1b5c58b-3117-4690-a497-be5f5c56faec tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.183620 Jul 20 04:17:27.625833 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1198/2476] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:27 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:27.632817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ece9cb2-6849-4e36-a012-8d0f49ec943d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:27.638404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ece9cb2-6849-4e36-a012-8d0f49ec943d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.639435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ece9cb2-6849-4e36-a012-8d0f49ec943d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:27.648937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ece9cb2-6849-4e36-a012-8d0f49ec943d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.649749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ece9cb2-6849-4e36-a012-8d0f49ec943d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.650836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ece9cb2-6849-4e36-a012-8d0f49ec943d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.651441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ece9cb2-6849-4e36-a012-8d0f49ec943d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.745104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-7ece9cb2-6849-4e36-a012-8d0f49ec943d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:27.816239 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ece9cb2-6849-4e36-a012-8d0f49ec943d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.189100 Jul 20 04:17:27.817431 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1199/2477] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Jul 20 04:17:27 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:28.060390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d541457d-3f1a-4967-b3f1-6a2a5ade4450 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.061263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d541457d-3f1a-4967-b3f1-6a2a5ade4450 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.068121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d541457d-3f1a-4967-b3f1-6a2a5ade4450 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.068764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d541457d-3f1a-4967-b3f1-6a2a5ade4450 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.069664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d541457d-3f1a-4967-b3f1-6a2a5ade4450 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.070118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d541457d-3f1a-4967-b3f1-6a2a5ade4450 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.098750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d541457d-3f1a-4967-b3f1-6a2a5ade4450 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:28.204639 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d541457d-3f1a-4967-b3f1-6a2a5ade4450 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "DELETE /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 204 len: 0 microversion: 2.42 time: 0.385359 Jul 20 04:17:28.205531 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1200/2478] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:17:27 2022] DELETE /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:17:28.212064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-60504212-c7e2-4160-9280-fe1d1102f192 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.219272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-60504212-c7e2-4160-9280-fe1d1102f192 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.220229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-60504212-c7e2-4160-9280-fe1d1102f192 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-89190465', 'deleted': False, 'project_id': '3e2cccff703842c19f80047348ef088d'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:28.227058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60504212-c7e2-4160-9280-fe1d1102f192 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.227511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60504212-c7e2-4160-9280-fe1d1102f192 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.228315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60504212-c7e2-4160-9280-fe1d1102f192 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.228751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60504212-c7e2-4160-9280-fe1d1102f192 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.336111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-60504212-c7e2-4160-9280-fe1d1102f192 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:28.384794 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-100f546d-1daf-4418-93f5-eeaa72438ba1 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/f621cdcb-6380-4844-9ff8-3180d237e283" status: 202 len: 0 microversion: 2.1 time: 1.060824 Jul 20 04:17:28.385767 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1279/2479] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:27 2022] DELETE /compute/v2.1/os-security-groups/f621cdcb-6380-4844-9ff8-3180d237e283 => generated 0 bytes in 1062 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:28.394191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b71d2727-915e-4a22-b3ff-da02c281399b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.395129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b71d2727-915e-4a22-b3ff-da02c281399b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.413317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b71d2727-915e-4a22-b3ff-da02c281399b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.414904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b71d2727-915e-4a22-b3ff-da02c281399b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.415915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b71d2727-915e-4a22-b3ff-da02c281399b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.417492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b71d2727-915e-4a22-b3ff-da02c281399b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.510853 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-60504212-c7e2-4160-9280-fe1d1102f192 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-89190465" status: 200 len: 345 microversion: 2.1 time: 0.303627 Jul 20 04:17:28.515640 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1201/2480] 10.222.0.59 () {58 vars in 1225 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-89190465 => generated 345 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:28.536204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0abcd58e-c86e-4798-9b52-36e81a8d9668 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.539529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0abcd58e-c86e-4798-9b52-36e81a8d9668 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.550160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0abcd58e-c86e-4798-9b52-36e81a8d9668 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.551682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0abcd58e-c86e-4798-9b52-36e81a8d9668 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.552634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0abcd58e-c86e-4798-9b52-36e81a8d9668 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.553890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0abcd58e-c86e-4798-9b52-36e81a8d9668 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.813632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0abcd58e-c86e-4798-9b52-36e81a8d9668 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.821126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b71d2727-915e-4a22-b3ff-da02c281399b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.841989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b71d2727-915e-4a22-b3ff-da02c281399b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.846905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0abcd58e-c86e-4798-9b52-36e81a8d9668 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.847900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b71d2727-915e-4a22-b3ff-da02c281399b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.851256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0abcd58e-c86e-4798-9b52-36e81a8d9668 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.854569 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0abcd58e-c86e-4798-9b52-36e81a8d9668 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1281 microversion: 2.25 time: 0.336593 Jul 20 04:17:28.855131 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b71d2727-915e-4a22-b3ff-da02c281399b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 2962 microversion: 2.42 time: 0.463141 Jul 20 04:17:28.856592 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1202/2481] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1281 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:28.857335 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1280/2482] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 2962 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:28.868974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-98e27898-0c78-4a8d-a9e5-b33cab493e1b req-2bef66b6-59c8-4e6e-bf58-d1be6051e0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a486b5-316e-4426-972b-71b474a08ec1", "name": "network-vif-plugged", "status": "completed", "tag": "b20cde1f-e1ac-4d80-81e4-5833da356db0"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:28.869281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d5e0dd61-85d0-43f8-aafc-393996d346e5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.870162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d5e0dd61-85d0-43f8-aafc-393996d346e5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.888570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5e0dd61-85d0-43f8-aafc-393996d346e5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.889348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5e0dd61-85d0-43f8-aafc-393996d346e5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.890529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5e0dd61-85d0-43f8-aafc-393996d346e5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.891136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5e0dd61-85d0-43f8-aafc-393996d346e5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.900752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-98e27898-0c78-4a8d-a9e5-b33cab493e1b req-2bef66b6-59c8-4e6e-bf58-d1be6051e0c7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.901512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-98e27898-0c78-4a8d-a9e5-b33cab493e1b req-2bef66b6-59c8-4e6e-bf58-d1be6051e0c7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.932874 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-98e27898-0c78-4a8d-a9e5-b33cab493e1b req-2bef66b6-59c8-4e6e-bf58-d1be6051e0c7 service nova] Creating event network-vif-plugged:b20cde1f-e1ac-4d80-81e4-5833da356db0 for instance d7a486b5-316e-4426-972b-71b474a08ec1 on n-h1-760456-11 Jul 20 04:17:28.935192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d5e0dd61-85d0-43f8-aafc-393996d346e5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:28.945321 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-98e27898-0c78-4a8d-a9e5-b33cab493e1b req-2bef66b6-59c8-4e6e-bf58-d1be6051e0c7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086012 Jul 20 04:17:28.952237 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1203/2483] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:28.966044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-874a5b30-13ae-4ef1-a5ba-35c46ad248eb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.967277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-874a5b30-13ae-4ef1-a5ba-35c46ad248eb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.982186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-874a5b30-13ae-4ef1-a5ba-35c46ad248eb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.984206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-874a5b30-13ae-4ef1-a5ba-35c46ad248eb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.987808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-874a5b30-13ae-4ef1-a5ba-35c46ad248eb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.999675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-874a5b30-13ae-4ef1-a5ba-35c46ad248eb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.078822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-874a5b30-13ae-4ef1-a5ba-35c46ad248eb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:29.103279 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d5e0dd61-85d0-43f8-aafc-393996d346e5 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 204 len: 0 microversion: 2.1 time: 0.242821 Jul 20 04:17:29.104306 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1281/2484] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:28 2022] DELETE /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:29.113149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6c0b1450-3e7e-4cbc-a861-00aa36b65286 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.118541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6c0b1450-3e7e-4cbc-a861-00aa36b65286 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.132701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c0b1450-3e7e-4cbc-a861-00aa36b65286 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.136915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c0b1450-3e7e-4cbc-a861-00aa36b65286 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.137793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c0b1450-3e7e-4cbc-a861-00aa36b65286 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.141251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c0b1450-3e7e-4cbc-a861-00aa36b65286 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.228795 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-874a5b30-13ae-4ef1-a5ba-35c46ad248eb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 204 len: 0 microversion: 2.1 time: 0.272240 Jul 20 04:17:29.229840 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1204/2485] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:28 2022] DELETE /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:29.235580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-12f7ce4a-99f1-42d1-a877-8c35be8c436e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.236608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-12f7ce4a-99f1-42d1-a877-8c35be8c436e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.244689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12f7ce4a-99f1-42d1-a877-8c35be8c436e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.245247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12f7ce4a-99f1-42d1-a877-8c35be8c436e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.246392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12f7ce4a-99f1-42d1-a877-8c35be8c436e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.246939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12f7ce4a-99f1-42d1-a877-8c35be8c436e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.520872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6c0b1450-3e7e-4cbc-a861-00aa36b65286 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.530423 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6c0b1450-3e7e-4cbc-a861-00aa36b65286 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.424602 Jul 20 04:17:29.531995 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1282/2486] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:29.537760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-430c96ff-7be4-4bbb-940f-047e7a510cda tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.538809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-430c96ff-7be4-4bbb-940f-047e7a510cda tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.547010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-430c96ff-7be4-4bbb-940f-047e7a510cda tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.547735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-430c96ff-7be4-4bbb-940f-047e7a510cda tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.548693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-430c96ff-7be4-4bbb-940f-047e7a510cda tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.549287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-430c96ff-7be4-4bbb-940f-047e7a510cda tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.758032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-430c96ff-7be4-4bbb-940f-047e7a510cda tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.778165 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-430c96ff-7be4-4bbb-940f-047e7a510cda tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1517 microversion: 2.1 time: 0.244340 Jul 20 04:17:29.789595 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1283/2487] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1517 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:29.818069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-12f7ce4a-99f1-42d1-a877-8c35be8c436e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.826044 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-12f7ce4a-99f1-42d1-a877-8c35be8c436e tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1509 microversion: 2.1 time: 0.594681 Jul 20 04:17:29.827069 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1205/2488] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1509 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:29.881296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6f3473f4-328d-45c1-8b7e-9732a8d117a7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.881765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6f3473f4-328d-45c1-8b7e-9732a8d117a7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.884801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-67fc44e6-0bea-45a3-adda-76ff372dcd30 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.886063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-67fc44e6-0bea-45a3-adda-76ff372dcd30 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.902427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67fc44e6-0bea-45a3-adda-76ff372dcd30 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.902959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67fc44e6-0bea-45a3-adda-76ff372dcd30 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.903884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67fc44e6-0bea-45a3-adda-76ff372dcd30 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.908652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f3473f4-328d-45c1-8b7e-9732a8d117a7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.910664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f3473f4-328d-45c1-8b7e-9732a8d117a7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.911355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67fc44e6-0bea-45a3-adda-76ff372dcd30 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.914044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f3473f4-328d-45c1-8b7e-9732a8d117a7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.918605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f3473f4-328d-45c1-8b7e-9732a8d117a7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.236044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6f3473f4-328d-45c1-8b7e-9732a8d117a7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.251668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6f3473f4-328d-45c1-8b7e-9732a8d117a7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.254692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6f3473f4-328d-45c1-8b7e-9732a8d117a7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.256395 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6f3473f4-328d-45c1-8b7e-9732a8d117a7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1281 microversion: 2.25 time: 0.380970 Jul 20 04:17:30.258332 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1284/2489] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1281 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:30.435598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-67fc44e6-0bea-45a3-adda-76ff372dcd30 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.445398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-67fc44e6-0bea-45a3-adda-76ff372dcd30 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.446959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-67fc44e6-0bea-45a3-adda-76ff372dcd30 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.448959 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-67fc44e6-0bea-45a3-adda-76ff372dcd30 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 2962 microversion: 2.42 time: 0.576101 Jul 20 04:17:30.453147 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1206/2490] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 2962 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:30.549191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d00e0381-51ce-4b6f-b046-69ac4dd08c70 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.550210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d00e0381-51ce-4b6f-b046-69ac4dd08c70 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.559539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d00e0381-51ce-4b6f-b046-69ac4dd08c70 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.560172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d00e0381-51ce-4b6f-b046-69ac4dd08c70 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.561377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d00e0381-51ce-4b6f-b046-69ac4dd08c70 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.562286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d00e0381-51ce-4b6f-b046-69ac4dd08c70 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.798711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6893c50-5a89-4336-9ef4-4f9cdf1a11c7 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.799396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a6893c50-5a89-4336-9ef4-4f9cdf1a11c7 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.807708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6893c50-5a89-4336-9ef4-4f9cdf1a11c7 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.808399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6893c50-5a89-4336-9ef4-4f9cdf1a11c7 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.809476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6893c50-5a89-4336-9ef4-4f9cdf1a11c7 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.810195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6893c50-5a89-4336-9ef4-4f9cdf1a11c7 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.889622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d00e0381-51ce-4b6f-b046-69ac4dd08c70 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.896236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:30.900203 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d00e0381-51ce-4b6f-b046-69ac4dd08c70 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.355117 Jul 20 04:17:30.910637 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1285/2491] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:30.919430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-01583c81-1611-4cf7-b25f-00724bb590ba tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.920381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-01583c81-1611-4cf7-b25f-00724bb590ba tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.928557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01583c81-1611-4cf7-b25f-00724bb590ba tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.929018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01583c81-1611-4cf7-b25f-00724bb590ba tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.929816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01583c81-1611-4cf7-b25f-00724bb590ba tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.930309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01583c81-1611-4cf7-b25f-00724bb590ba tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.048179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a6893c50-5a89-4336-9ef4-4f9cdf1a11c7 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.063151 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a6893c50-5a89-4336-9ef4-4f9cdf1a11c7 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1517 microversion: 2.1 time: 0.269801 Jul 20 04:17:31.064128 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1207/2492] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1517 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:31.252488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-01583c81-1611-4cf7-b25f-00724bb590ba tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.267084 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-01583c81-1611-4cf7-b25f-00724bb590ba tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1509 microversion: 2.1 time: 0.354223 Jul 20 04:17:31.267779 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1286/2493] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:31.290628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4f31a4e8-1728-4c54-881e-56a3ca0d9da3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.291507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4f31a4e8-1728-4c54-881e-56a3ca0d9da3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:31.299161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f31a4e8-1728-4c54-881e-56a3ca0d9da3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.299708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f31a4e8-1728-4c54-881e-56a3ca0d9da3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.300559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f31a4e8-1728-4c54-881e-56a3ca0d9da3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.301003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f31a4e8-1728-4c54-881e-56a3ca0d9da3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.473271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7c46b7d3-dbf0-4660-b398-2765088227ee tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.474034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7c46b7d3-dbf0-4660-b398-2765088227ee tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:31.483362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7c46b7d3-dbf0-4660-b398-2765088227ee tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.486432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7c46b7d3-dbf0-4660-b398-2765088227ee tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.487650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7c46b7d3-dbf0-4660-b398-2765088227ee tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.488326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7c46b7d3-dbf0-4660-b398-2765088227ee tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.536214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f31a4e8-1728-4c54-881e-56a3ca0d9da3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.550167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f31a4e8-1728-4c54-881e-56a3ca0d9da3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.553567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f31a4e8-1728-4c54-881e-56a3ca0d9da3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.556020 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4f31a4e8-1728-4c54-881e-56a3ca0d9da3 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1281 microversion: 2.25 time: 0.273277 Jul 20 04:17:31.557183 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1208/2494] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:31.779495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7c46b7d3-dbf0-4660-b398-2765088227ee tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.792273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7c46b7d3-dbf0-4660-b398-2765088227ee tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.796580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7c46b7d3-dbf0-4660-b398-2765088227ee tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.801599 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7c46b7d3-dbf0-4660-b398-2765088227ee tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 2962 microversion: 2.42 time: 0.332360 Jul 20 04:17:31.812556 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1287/2495] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 2962 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:31.918688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8dd083c5-eeed-4de5-84cf-74a7de06bf94 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.919664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8dd083c5-eeed-4de5-84cf-74a7de06bf94 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:31.936559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8dd083c5-eeed-4de5-84cf-74a7de06bf94 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.937582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8dd083c5-eeed-4de5-84cf-74a7de06bf94 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.938636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8dd083c5-eeed-4de5-84cf-74a7de06bf94 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.939491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8dd083c5-eeed-4de5-84cf-74a7de06bf94 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.945606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:32.089918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e571da97-f94e-4732-82af-ec8f31a6890f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.091031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e571da97-f94e-4732-82af-ec8f31a6890f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.099275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e571da97-f94e-4732-82af-ec8f31a6890f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.101442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e571da97-f94e-4732-82af-ec8f31a6890f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.102549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e571da97-f94e-4732-82af-ec8f31a6890f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.103843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e571da97-f94e-4732-82af-ec8f31a6890f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.513054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8dd083c5-eeed-4de5-84cf-74a7de06bf94 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:32.523644 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8dd083c5-eeed-4de5-84cf-74a7de06bf94 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.609770 Jul 20 04:17:32.536292 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1209/2496] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:32.553213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-17b759b5-582c-410a-8ce0-c105ad423b57 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.555008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-17b759b5-582c-410a-8ce0-c105ad423b57 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.557263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e571da97-f94e-4732-82af-ec8f31a6890f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:32.574332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17b759b5-582c-410a-8ce0-c105ad423b57 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.574929 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e571da97-f94e-4732-82af-ec8f31a6890f tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1517 microversion: 2.1 time: 0.488689 Jul 20 04:17:32.577098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17b759b5-582c-410a-8ce0-c105ad423b57 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.577584 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1288/2497] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1517 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:32.578421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17b759b5-582c-410a-8ce0-c105ad423b57 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.581094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17b759b5-582c-410a-8ce0-c105ad423b57 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.594157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8980538c-9dd3-4431-9758-16f51ca23835 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.595680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8980538c-9dd3-4431-9758-16f51ca23835 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.616211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8980538c-9dd3-4431-9758-16f51ca23835 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.624827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8980538c-9dd3-4431-9758-16f51ca23835 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.626587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8980538c-9dd3-4431-9758-16f51ca23835 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.627292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8980538c-9dd3-4431-9758-16f51ca23835 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.097546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8980538c-9dd3-4431-9758-16f51ca23835 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.115944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8980538c-9dd3-4431-9758-16f51ca23835 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.121567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8980538c-9dd3-4431-9758-16f51ca23835 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.123593 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8980538c-9dd3-4431-9758-16f51ca23835 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1477 microversion: 2.25 time: 0.542808 Jul 20 04:17:33.128893 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1289/2498] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1477 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:33.135412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8671833e-7d96-413b-b75b-e7a307d4ef55 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.142222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8671833e-7d96-413b-b75b-e7a307d4ef55 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.177167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8671833e-7d96-413b-b75b-e7a307d4ef55 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.181645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8671833e-7d96-413b-b75b-e7a307d4ef55 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.185054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8671833e-7d96-413b-b75b-e7a307d4ef55 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.186132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8671833e-7d96-413b-b75b-e7a307d4ef55 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.520431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8671833e-7d96-413b-b75b-e7a307d4ef55 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.536999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8671833e-7d96-413b-b75b-e7a307d4ef55 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.542757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8671833e-7d96-413b-b75b-e7a307d4ef55 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.544175 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8671833e-7d96-413b-b75b-e7a307d4ef55 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 2962 microversion: 2.42 time: 0.413886 Jul 20 04:17:33.545192 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1290/2499] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 2962 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:33.561336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-014d7649-a2ea-465e-82e1-ba8e3edf61c1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.563414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-014d7649-a2ea-465e-82e1-ba8e3edf61c1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.582173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-014d7649-a2ea-465e-82e1-ba8e3edf61c1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.584860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-014d7649-a2ea-465e-82e1-ba8e3edf61c1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.587141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-014d7649-a2ea-465e-82e1-ba8e3edf61c1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.588251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-014d7649-a2ea-465e-82e1-ba8e3edf61c1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.953713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:34.071039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-014d7649-a2ea-465e-82e1-ba8e3edf61c1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid d7a486b5-316e-4426-972b-71b474a08ec1 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:34.113054 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-014d7649-a2ea-465e-82e1-ba8e3edf61c1 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1972 microversion: 2.25 time: 0.564967 Jul 20 04:17:34.125259 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1291/2500] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1972 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:34.139514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f4cf5d00-1f6e-418f-8cee-ddfb09566b22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.140364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f4cf5d00-1f6e-418f-8cee-ddfb09566b22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:34.157308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4cf5d00-1f6e-418f-8cee-ddfb09566b22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.157308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4cf5d00-1f6e-418f-8cee-ddfb09566b22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.163065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4cf5d00-1f6e-418f-8cee-ddfb09566b22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.163546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4cf5d00-1f6e-418f-8cee-ddfb09566b22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.426826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-17b759b5-582c-410a-8ce0-c105ad423b57 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:34.455886 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-17b759b5-582c-410a-8ce0-c105ad423b57 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1509 microversion: 2.1 time: 1.916967 Jul 20 04:17:34.464025 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1210/2501] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1509 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:34.473094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-08358c00-d86b-4c17-9252-a77cd1687224 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.473967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-08358c00-d86b-4c17-9252-a77cd1687224 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:34.490403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08358c00-d86b-4c17-9252-a77cd1687224 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.491099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08358c00-d86b-4c17-9252-a77cd1687224 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.491861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08358c00-d86b-4c17-9252-a77cd1687224 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.492309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08358c00-d86b-4c17-9252-a77cd1687224 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.676538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f4cf5d00-1f6e-418f-8cee-ddfb09566b22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:34.690757 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f4cf5d00-1f6e-418f-8cee-ddfb09566b22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.562251 Jul 20 04:17:34.696711 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1292/2502] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:34.701821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-33cf3cba-4b32-45bd-b323-d95a7d56dc82 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.707788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-33cf3cba-4b32-45bd-b323-d95a7d56dc82 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:34.720139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33cf3cba-4b32-45bd-b323-d95a7d56dc82 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.721062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33cf3cba-4b32-45bd-b323-d95a7d56dc82 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.722136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33cf3cba-4b32-45bd-b323-d95a7d56dc82 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.737499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33cf3cba-4b32-45bd-b323-d95a7d56dc82 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.967568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-08358c00-d86b-4c17-9252-a77cd1687224 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:34.982159 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-08358c00-d86b-4c17-9252-a77cd1687224 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 200 len: 1517 microversion: 2.1 time: 0.513584 Jul 20 04:17:34.997877 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1211/2503] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 1517 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:35.012339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d70f0f4-9c1f-45e5-b564-fa95055e3a7b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.012999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8d70f0f4-9c1f-45e5-b564-fa95055e3a7b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.013546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-33cf3cba-4b32-45bd-b323-d95a7d56dc82 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid d7a486b5-316e-4426-972b-71b474a08ec1 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:35.030431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d70f0f4-9c1f-45e5-b564-fa95055e3a7b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.032436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d70f0f4-9c1f-45e5-b564-fa95055e3a7b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.035407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d70f0f4-9c1f-45e5-b564-fa95055e3a7b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.036112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d70f0f4-9c1f-45e5-b564-fa95055e3a7b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.046753 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-33cf3cba-4b32-45bd-b323-d95a7d56dc82 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1972 microversion: 2.25 time: 0.348543 Jul 20 04:17:35.048029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1293/2504] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1972 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:35.077569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-871c2158-00c9-467b-bc1f-70c0331de0ac tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.080473 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:35.080473 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:17:35.086117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-871c2158-00c9-467b-bc1f-70c0331de0ac tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.088003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-871c2158-00c9-467b-bc1f-70c0331de0ac tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.089420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-871c2158-00c9-467b-bc1f-70c0331de0ac tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.091916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-871c2158-00c9-467b-bc1f-70c0331de0ac tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.153676 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-871c2158-00c9-467b-bc1f-70c0331de0ac tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.087426 Jul 20 04:17:35.154313 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1294/2505] 10.222.0.59 () {60 vars in 1216 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:17:35.419913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b8f9fa45-0d45-412e-9625-39f6e84fe0e5 req-f3d49a7f-5de7-4c67-adba-c2ceca8b3738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-unplugged", "status": "completed", "tag": "34ed3285-dde5-4027-a99c-c92741329ec4"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:35.440469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:35.449781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b8f9fa45-0d45-412e-9625-39f6e84fe0e5 req-f3d49a7f-5de7-4c67-adba-c2ceca8b3738 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.452353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b8f9fa45-0d45-412e-9625-39f6e84fe0e5 req-f3d49a7f-5de7-4c67-adba-c2ceca8b3738 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.500078 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b8f9fa45-0d45-412e-9625-39f6e84fe0e5 req-f3d49a7f-5de7-4c67-adba-c2ceca8b3738 service nova] Creating event network-vif-unplugged:34ed3285-dde5-4027-a99c-c92741329ec4 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:17:35.517371 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b8f9fa45-0d45-412e-9625-39f6e84fe0e5 req-f3d49a7f-5de7-4c67-adba-c2ceca8b3738 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.361815 Jul 20 04:17:35.519780 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1295/2506] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:35.531784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-087e523b-362f-468a-9bd1-f44d91fd7519 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-760456-11", "block_migration": "auto"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:35.533809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-087e523b-362f-468a-9bd1-f44d91fd7519 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.567522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-087e523b-362f-468a-9bd1-f44d91fd7519 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.568833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-087e523b-362f-468a-9bd1-f44d91fd7519 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.572384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-087e523b-362f-468a-9bd1-f44d91fd7519 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.577297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-087e523b-362f-468a-9bd1-f44d91fd7519 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.642516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-087e523b-362f-468a-9bd1-f44d91fd7519 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'flavor' on Instance uuid d7a486b5-316e-4426-972b-71b474a08ec1 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:35.681917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-087e523b-362f-468a-9bd1-f44d91fd7519 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Going to try to live migrate instance to n-h2-760456-11 {{(pid=119606) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:17:36.314652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8d70f0f4-9c1f-45e5-b564-fa95055e3a7b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.335421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8d70f0f4-9c1f-45e5-b564-fa95055e3a7b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.346013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8d70f0f4-9c1f-45e5-b564-fa95055e3a7b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.347727 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8d70f0f4-9c1f-45e5-b564-fa95055e3a7b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 2920 microversion: 2.42 time: 1.348214 Jul 20 04:17:36.348742 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1212/2507] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 2920 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:36.362837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-24ecbfe3-1281-47c2-821c-70a903b8f0fc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.364243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-24ecbfe3-1281-47c2-821c-70a903b8f0fc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.378638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24ecbfe3-1281-47c2-821c-70a903b8f0fc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.379545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24ecbfe3-1281-47c2-821c-70a903b8f0fc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.381007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24ecbfe3-1281-47c2-821c-70a903b8f0fc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.383251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24ecbfe3-1281-47c2-821c-70a903b8f0fc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.607604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24ecbfe3-1281-47c2-821c-70a903b8f0fc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99fb64ce15c948f9b09b3d9ad2f50073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228b024e44374bb3babb59c15bfb37a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.623179 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-24ecbfe3-1281-47c2-821c-70a903b8f0fc tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 200 len: 1467 microversion: 2.1 time: 0.272284 Jul 20 04:17:36.626611 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1213/2508] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 1467 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:36.642993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c982f82f-a83d-4cdd-92f0-6e67e22b493f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.644655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c982f82f-a83d-4cdd-92f0-6e67e22b493f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.656240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c982f82f-a83d-4cdd-92f0-6e67e22b493f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.657732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c982f82f-a83d-4cdd-92f0-6e67e22b493f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.658764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c982f82f-a83d-4cdd-92f0-6e67e22b493f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.659371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c982f82f-a83d-4cdd-92f0-6e67e22b493f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.372782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c982f82f-a83d-4cdd-92f0-6e67e22b493f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.391904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c982f82f-a83d-4cdd-92f0-6e67e22b493f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.754613 Jul 20 04:17:37.393262 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1214/2509] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:37.408458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a5e4bad4-9522-4308-b92a-86afde3d2c9c tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.413450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a5e4bad4-9522-4308-b92a-86afde3d2c9c tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 1abff566-159f-47af-9776-f4a4d9e7db92] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.428150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5e4bad4-9522-4308-b92a-86afde3d2c9c tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.435815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5e4bad4-9522-4308-b92a-86afde3d2c9c tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.438124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5e4bad4-9522-4308-b92a-86afde3d2c9c tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.439378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5e4bad4-9522-4308-b92a-86afde3d2c9c tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.481601 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a5e4bad4-9522-4308-b92a-86afde3d2c9c tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] HTTP exception thrown: Instance 1abff566-159f-47af-9776-f4a4d9e7db92 could not be found. Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a5e4bad4-9522-4308-b92a-86afde3d2c9c tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Request method failure captured: Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 HTTP/1.1 Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14GWwQljeM1Qt4YCrLNIg1iSa9BTttwnNyGsH9-W7xnyLldMEpY8RDZpEaIoLxsYmR8fNq18uLjbGB8BlOcL7hvALrva_8NsrvfyoM-LUj-WVohfxWxzQ9-xLtMBfQucK2QOMsYRAOhTDYjQrbVXC-O08LsrHTud40rjUgiP-_KTetI Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 3e2cccff703842c19f80047348ef088d Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ListServerFiltersTestJSON-1836687829 Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3e2cccff703842c19f80047348ef088d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3e2cccff703842c19f80047348ef088d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3e2cccff703842c19f80047348ef088d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3e2cccff703842c19f80047348ef088d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ListServerFiltersTestJSON-1836687829 Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 3e2cccff703842c19f80047348ef088d Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1836687829 Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ListServerFiltersTestJSON-1836687829-project Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2206264735814d3ea25b0217601d101f Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ListServerFiltersTestJSON-1836687829-project Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 1abff566-159f-47af-9776-f4a4d9e7db92 could not be found. Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1abff566-159f-47af-9776-f4a4d9e7db92'} Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1abff566-159f-47af-9776-f4a4d9e7db92 could not be found. Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1abff566-159f-47af-9776-f4a4d9e7db92 could not be found. Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:37.487629 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:17:37.494000 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:37.494000 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:37.494000 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:37.494000 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:37.494000 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:37.494000 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1abff566-159f-47af-9776-f4a4d9e7db92 could not be found. Jul 20 04:17:37.494000 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:17:37.494000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a5e4bad4-9522-4308-b92a-86afde3d2c9c tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Returning 404 to user: Instance 1abff566-159f-47af-9776-f4a4d9e7db92 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:37.499994 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a5e4bad4-9522-4308-b92a-86afde3d2c9c tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92" status: 404 len: 111 microversion: 2.1 time: 0.099354 Jul 20 04:17:37.503938 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1215/2510] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/servers/1abff566-159f-47af-9776-f4a4d9e7db92 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:37.507718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a28d37ed-9ff4-442a-b114-ff1e210dba99 req-a266d1ef-2b6c-4c00-8d02-1e690b1ed758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-deleted", "tag": "58c84e4d-21a1-4739-b37c-080f055491f3"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:37.516486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a28d37ed-9ff4-442a-b114-ff1e210dba99 req-a266d1ef-2b6c-4c00-8d02-1e690b1ed758 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.517034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a28d37ed-9ff4-442a-b114-ff1e210dba99 req-a266d1ef-2b6c-4c00-8d02-1e690b1ed758 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.543174 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a28d37ed-9ff4-442a-b114-ff1e210dba99 req-a266d1ef-2b6c-4c00-8d02-1e690b1ed758 service nova] Creating event network-vif-deleted:58c84e4d-21a1-4739-b37c-080f055491f3 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:17:37.557310 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a28d37ed-9ff4-442a-b114-ff1e210dba99 req-a266d1ef-2b6c-4c00-8d02-1e690b1ed758 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054964 Jul 20 04:17:37.558294 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1216/2511] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:37.689524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f9706dc5-ffe0-401d-95c2-eab7ba9f13e1 req-0344fd08-4c02-4a51-ad8a-27cc3fe4e8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1abff566-159f-47af-9776-f4a4d9e7db92", "name": "network-vif-deleted", "tag": "49bfe6c2-2deb-45cd-96e2-da9e640c6623"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:37.716962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f9706dc5-ffe0-401d-95c2-eab7ba9f13e1 req-0344fd08-4c02-4a51-ad8a-27cc3fe4e8e1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.718030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f9706dc5-ffe0-401d-95c2-eab7ba9f13e1 req-0344fd08-4c02-4a51-ad8a-27cc3fe4e8e1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.750524 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f9706dc5-ffe0-401d-95c2-eab7ba9f13e1 req-0344fd08-4c02-4a51-ad8a-27cc3fe4e8e1 service nova] Creating event network-vif-deleted:49bfe6c2-2deb-45cd-96e2-da9e640c6623 for instance 1abff566-159f-47af-9776-f4a4d9e7db92 on n-h2-760456-11 Jul 20 04:17:37.765047 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f9706dc5-ffe0-401d-95c2-eab7ba9f13e1 req-0344fd08-4c02-4a51-ad8a-27cc3fe4e8e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202265 Jul 20 04:17:37.766185 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1217/2512] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:37.775243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5a2cfd28-c29a-414f-b5b1-21ffdff59f75 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.776302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5a2cfd28-c29a-414f-b5b1-21ffdff59f75 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.785196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a2cfd28-c29a-414f-b5b1-21ffdff59f75 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.785907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a2cfd28-c29a-414f-b5b1-21ffdff59f75 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.788461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a2cfd28-c29a-414f-b5b1-21ffdff59f75 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.789288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a2cfd28-c29a-414f-b5b1-21ffdff59f75 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.261634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=14 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:38.533763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a2cfd28-c29a-414f-b5b1-21ffdff59f75 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.544282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a2cfd28-c29a-414f-b5b1-21ffdff59f75 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.545978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a2cfd28-c29a-414f-b5b1-21ffdff59f75 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:38.547270 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5a2cfd28-c29a-414f-b5b1-21ffdff59f75 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 2712 microversion: 2.42 time: 0.779537 Jul 20 04:17:38.566704 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1218/2513] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 2712 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:38.572939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aed55dae-1112-43c1-8a2b-555841d210c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.573453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aed55dae-1112-43c1-8a2b-555841d210c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: c561dbb2-7811-4eeb-b05c-0df4ee20c622] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.589994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aed55dae-1112-43c1-8a2b-555841d210c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.590495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aed55dae-1112-43c1-8a2b-555841d210c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.591293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aed55dae-1112-43c1-8a2b-555841d210c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.591740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aed55dae-1112-43c1-8a2b-555841d210c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.647859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aed55dae-1112-43c1-8a2b-555841d210c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: c561dbb2-7811-4eeb-b05c-0df4ee20c622] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:38.790021 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aed55dae-1112-43c1-8a2b-555841d210c1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622" status: 204 len: 0 microversion: 2.1 time: 0.221887 Jul 20 04:17:38.790931 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1219/2514] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:38 2022] DELETE /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:38.796795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-881dcee9-c144-4a45-bfcf-6a5615f990bf req-3d25175c-2f76-4c58-b931-038aa742b72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-unplugged", "status": "completed", "tag": "de42dbfb-8539-4cfd-926d-fee4979c1aba"}, {"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-unplugged", "status": "completed", "tag": "6cd82c0a-6158-4750-9342-bab7ea3f563d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:38.805349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:38.824137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-881dcee9-c144-4a45-bfcf-6a5615f990bf req-3d25175c-2f76-4c58-b931-038aa742b72e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.824989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-881dcee9-c144-4a45-bfcf-6a5615f990bf req-3d25175c-2f76-4c58-b931-038aa742b72e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.848677 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-881dcee9-c144-4a45-bfcf-6a5615f990bf req-3d25175c-2f76-4c58-b931-038aa742b72e service nova] Creating event network-vif-unplugged:de42dbfb-8539-4cfd-926d-fee4979c1aba for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:17:38.849622 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-881dcee9-c144-4a45-bfcf-6a5615f990bf req-3d25175c-2f76-4c58-b931-038aa742b72e service nova] Creating event network-vif-unplugged:6cd82c0a-6158-4750-9342-bab7ea3f563d for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:17:38.855662 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-881dcee9-c144-4a45-bfcf-6a5615f990bf req-3d25175c-2f76-4c58-b931-038aa742b72e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.063065 Jul 20 04:17:38.867427 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1220/2515] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:38.873552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3dc552f-49f1-4e35-956d-eba14653d239 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.874477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f3dc552f-49f1-4e35-956d-eba14653d239 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] [instance: 3edbf03b-c74b-4814-81de-4645c207d91a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.894988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3dc552f-49f1-4e35-956d-eba14653d239 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.895695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3dc552f-49f1-4e35-956d-eba14653d239 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.897430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3dc552f-49f1-4e35-956d-eba14653d239 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.900146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3dc552f-49f1-4e35-956d-eba14653d239 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.920301 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-f3dc552f-49f1-4e35-956d-eba14653d239 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] HTTP exception thrown: Instance 3edbf03b-c74b-4814-81de-4645c207d91a could not be found. Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3dc552f-49f1-4e35-956d-eba14653d239 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Request method failure captured: Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a HTTP/1.1 Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14GLAj3FryuXvnoD1qMCoCiNLmIeG9uSQ9dNfll9XO5a5khuMmaTMSWZ1Udq5LGOG5k7Jei2eh5L39g-36sQ7ngYA5qTYxe_sKptY9oXnju1BZ2GGgBxdGgoX9RT5kfNuXy5nEIpYJnzQF5ggUdRZnyKPwds6jCav9bMUHkHC_kKHdA Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 228b024e44374bb3babb59c15bfb37a1 Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1531208484 Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/228b024e44374bb3babb59c15bfb37a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/228b024e44374bb3babb59c15bfb37a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/228b024e44374bb3babb59c15bfb37a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_228b024e44374bb3babb59c15bfb37a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1531208484 Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 228b024e44374bb3babb59c15bfb37a1 Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1531208484 Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerRescueTestJSONUnderV235-1531208484-project Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 99fb64ce15c948f9b09b3d9ad2f50073 Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1531208484-project Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 3edbf03b-c74b-4814-81de-4645c207d91a could not be found. Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '3edbf03b-c74b-4814-81de-4645c207d91a'} Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3edbf03b-c74b-4814-81de-4645c207d91a could not be found. Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3edbf03b-c74b-4814-81de-4645c207d91a could not be found. Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.936683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:38.941111 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.941111 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:38.941111 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:38.941111 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:38.941111 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:38.941111 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:38.941111 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3edbf03b-c74b-4814-81de-4645c207d91a could not be found. Jul 20 04:17:38.941111 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.941111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3dc552f-49f1-4e35-956d-eba14653d239 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] Returning 404 to user: Instance 3edbf03b-c74b-4814-81de-4645c207d91a could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:38.942730 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f3dc552f-49f1-4e35-956d-eba14653d239 tempest-ServerRescueTestJSONUnderV235-1531208484 tempest-ServerRescueTestJSONUnderV235-1531208484-project] 10.222.0.59 "GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a" status: 404 len: 111 microversion: 2.1 time: 0.073767 Jul 20 04:17:38.951304 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1221/2516] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/3edbf03b-c74b-4814-81de-4645c207d91a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:38.960030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4158b730-09d8-4073-86b7-2ad21dbe93b4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.963062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4158b730-09d8-4073-86b7-2ad21dbe93b4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.979501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4158b730-09d8-4073-86b7-2ad21dbe93b4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.980531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4158b730-09d8-4073-86b7-2ad21dbe93b4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.981564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4158b730-09d8-4073-86b7-2ad21dbe93b4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.986963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4158b730-09d8-4073-86b7-2ad21dbe93b4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.165751 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-087e523b-362f-468a-9bd1-f44d91fd7519 tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1/action" status: 202 len: 0 microversion: 2.25 time: 3.644211 Jul 20 04:17:39.169733 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1296/2517] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:17:35 2022] POST /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1/action => generated 0 bytes in 3646 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:39.177298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-46579e1f-d1bf-4db6-87f4-a3db947c7d80 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.182850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-46579e1f-d1bf-4db6-87f4-a3db947c7d80 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: c561dbb2-7811-4eeb-b05c-0df4ee20c622] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.227194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46579e1f-d1bf-4db6-87f4-a3db947c7d80 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.228733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46579e1f-d1bf-4db6-87f4-a3db947c7d80 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.235274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46579e1f-d1bf-4db6-87f4-a3db947c7d80 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.235766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46579e1f-d1bf-4db6-87f4-a3db947c7d80 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.684062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4158b730-09d8-4073-86b7-2ad21dbe93b4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.694499 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4158b730-09d8-4073-86b7-2ad21dbe93b4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.741521 Jul 20 04:17:39.700858 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1222/2518] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:39.710876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1eefa47f-c3ef-41b9-bf1a-e458c033c903 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.711651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1eefa47f-c3ef-41b9-bf1a-e458c033c903 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.728365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eefa47f-c3ef-41b9-bf1a-e458c033c903 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.732331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eefa47f-c3ef-41b9-bf1a-e458c033c903 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.733323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eefa47f-c3ef-41b9-bf1a-e458c033c903 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.740848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eefa47f-c3ef-41b9-bf1a-e458c033c903 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.869504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-46579e1f-d1bf-4db6-87f4-a3db947c7d80 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.949184 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-46579e1f-d1bf-4db6-87f4-a3db947c7d80 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622" status: 200 len: 1517 microversion: 2.1 time: 0.769325 Jul 20 04:17:39.951767 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1297/2519] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622 => generated 1517 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:39.961974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c92f8d5-bba9-4da3-a311-1502491bdc64 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.963216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0c92f8d5-bba9-4da3-a311-1502491bdc64 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.979711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c92f8d5-bba9-4da3-a311-1502491bdc64 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.980502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c92f8d5-bba9-4da3-a311-1502491bdc64 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.984356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c92f8d5-bba9-4da3-a311-1502491bdc64 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.985005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c92f8d5-bba9-4da3-a311-1502491bdc64 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.516913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1eefa47f-c3ef-41b9-bf1a-e458c033c903 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.528857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1eefa47f-c3ef-41b9-bf1a-e458c033c903 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.533195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1eefa47f-c3ef-41b9-bf1a-e458c033c903 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.548302 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1eefa47f-c3ef-41b9-bf1a-e458c033c903 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.845941 Jul 20 04:17:40.552897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1223/2520] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:40.568869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-fef697c4-e4e5-43f0-8e26-9fb665de29d0 req-29abb8be-7314-4d8f-9697-0d607a7fc753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-deleted", "tag": "c6f02ab9-a2a7-47dd-896e-14309db365f1"}, {"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-deleted", "tag": "de42dbfb-8539-4cfd-926d-fee4979c1aba"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:40.594970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fef697c4-e4e5-43f0-8e26-9fb665de29d0 req-29abb8be-7314-4d8f-9697-0d607a7fc753 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.600531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fef697c4-e4e5-43f0-8e26-9fb665de29d0 req-29abb8be-7314-4d8f-9697-0d607a7fc753 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.635855 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-fef697c4-e4e5-43f0-8e26-9fb665de29d0 req-29abb8be-7314-4d8f-9697-0d607a7fc753 service nova] Creating event network-vif-deleted:c6f02ab9-a2a7-47dd-896e-14309db365f1 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:17:40.636784 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-fef697c4-e4e5-43f0-8e26-9fb665de29d0 req-29abb8be-7314-4d8f-9697-0d607a7fc753 service nova] Creating event network-vif-deleted:de42dbfb-8539-4cfd-926d-fee4979c1aba for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:17:40.649356 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-fef697c4-e4e5-43f0-8e26-9fb665de29d0 req-29abb8be-7314-4d8f-9697-0d607a7fc753 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094763 Jul 20 04:17:40.650689 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1224/2521] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:40.662327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-03d9892c-837d-4136-ab75-018908a68b61 req-304f9edd-b75e-47b0-8627-c1d542574dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edbf03b-c74b-4814-81de-4645c207d91a", "name": "network-vif-deleted", "tag": "df3fbf6a-1fad-4c47-af81-2713c574b472"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:40.688164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-03d9892c-837d-4136-ab75-018908a68b61 req-304f9edd-b75e-47b0-8627-c1d542574dac service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.690303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-03d9892c-837d-4136-ab75-018908a68b61 req-304f9edd-b75e-47b0-8627-c1d542574dac service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.765020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0c92f8d5-bba9-4da3-a311-1502491bdc64 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.771646 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-03d9892c-837d-4136-ab75-018908a68b61 req-304f9edd-b75e-47b0-8627-c1d542574dac service nova] Creating event network-vif-deleted:df3fbf6a-1fad-4c47-af81-2713c574b472 for instance 3edbf03b-c74b-4814-81de-4645c207d91a on n-h2-760456-11 Jul 20 04:17:40.782150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0c92f8d5-bba9-4da3-a311-1502491bdc64 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.787814 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-03d9892c-837d-4136-ab75-018908a68b61 req-304f9edd-b75e-47b0-8627-c1d542574dac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130091 Jul 20 04:17:40.788977 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1225/2522] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:40.791543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0c92f8d5-bba9-4da3-a311-1502491bdc64 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.793046 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0c92f8d5-bba9-4da3-a311-1502491bdc64 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 2618 microversion: 2.42 time: 0.839502 Jul 20 04:17:40.805382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0c2de751-0fdc-4f94-9a1c-cf5014d3b8eb tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.813347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0c2de751-0fdc-4f94-9a1c-cf5014d3b8eb tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.815893 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1298/2523] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 2618 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:40.816813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0c2de751-0fdc-4f94-9a1c-cf5014d3b8eb tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Searching by: {'deleted': False, 'project_id': 'd536e3aeba614601973cd64fbe3ee196'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:40.831080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94f3ec6a-dec5-403a-ac9c-f7e6e96a48aa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.831720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-94f3ec6a-dec5-403a-ac9c-f7e6e96a48aa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:40.835967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c2de751-0fdc-4f94-9a1c-cf5014d3b8eb tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.836667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c2de751-0fdc-4f94-9a1c-cf5014d3b8eb tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.837646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c2de751-0fdc-4f94-9a1c-cf5014d3b8eb tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.844570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c2de751-0fdc-4f94-9a1c-cf5014d3b8eb tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.847905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94f3ec6a-dec5-403a-ac9c-f7e6e96a48aa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.848608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94f3ec6a-dec5-403a-ac9c-f7e6e96a48aa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.850936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94f3ec6a-dec5-403a-ac9c-f7e6e96a48aa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.852618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94f3ec6a-dec5-403a-ac9c-f7e6e96a48aa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.918103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-0c2de751-0fdc-4f94-9a1c-cf5014d3b8eb tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:41.001521 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0c2de751-0fdc-4f94-9a1c-cf5014d3b8eb tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.204462 Jul 20 04:17:41.002460 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1226/2524] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers => generated 344 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:41.010675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-61ca9e4f-716b-4e84-9209-f9a23fc06a70 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.012452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-61ca9e4f-716b-4e84-9209-f9a23fc06a70 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: c561dbb2-7811-4eeb-b05c-0df4ee20c622] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.022374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61ca9e4f-716b-4e84-9209-f9a23fc06a70 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.023182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61ca9e4f-716b-4e84-9209-f9a23fc06a70 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.024232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61ca9e4f-716b-4e84-9209-f9a23fc06a70 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.024900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61ca9e4f-716b-4e84-9209-f9a23fc06a70 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.432274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-94f3ec6a-dec5-403a-ac9c-f7e6e96a48aa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.444192 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94f3ec6a-dec5-403a-ac9c-f7e6e96a48aa tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.624434 Jul 20 04:17:41.445876 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1299/2525] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:41.460103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.463816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.464894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Searching by: {'deleted': False, 'project_id': 'd536e3aeba614601973cd64fbe3ee196'} {{(pid=119606) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:41.470988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.471639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.472595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.473195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.541197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.multi_cell_list [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119606) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:41.588447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:41.620934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.629285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.629988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.838264 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-87ef6961-b09d-4390-b6af-b36abeb97c20 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 1608 microversion: 2.1 time: 0.388868 Jul 20 04:17:41.838878 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1300/2526] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/detail => generated 1608 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:41.844364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a8796d10-8d2e-42a8-86a7-0e4dc3562fef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.845256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a8796d10-8d2e-42a8-86a7-0e4dc3562fef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.863997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8796d10-8d2e-42a8-86a7-0e4dc3562fef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.865004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8796d10-8d2e-42a8-86a7-0e4dc3562fef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.877461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8796d10-8d2e-42a8-86a7-0e4dc3562fef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.877973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8796d10-8d2e-42a8-86a7-0e4dc3562fef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.113327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a8796d10-8d2e-42a8-86a7-0e4dc3562fef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.132836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a8796d10-8d2e-42a8-86a7-0e4dc3562fef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.149095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a8796d10-8d2e-42a8-86a7-0e4dc3562fef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.151413 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a8796d10-8d2e-42a8-86a7-0e4dc3562fef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.310984 Jul 20 04:17:42.157427 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1301/2527] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:42.163475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3d1331ef-5bf6-4064-8ea1-fa41112f70f9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.165145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3d1331ef-5bf6-4064-8ea1-fa41112f70f9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.173060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d1331ef-5bf6-4064-8ea1-fa41112f70f9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.173835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d1331ef-5bf6-4064-8ea1-fa41112f70f9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.175020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d1331ef-5bf6-4064-8ea1-fa41112f70f9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.175687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d1331ef-5bf6-4064-8ea1-fa41112f70f9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.261726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3d1331ef-5bf6-4064-8ea1-fa41112f70f9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.277878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3d1331ef-5bf6-4064-8ea1-fa41112f70f9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.279940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3d1331ef-5bf6-4064-8ea1-fa41112f70f9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.281466 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3d1331ef-5bf6-4064-8ea1-fa41112f70f9 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.122420 Jul 20 04:17:42.293109 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1302/2528] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:42.293109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-21709cab-3a4e-4c35-b34d-18cfebf20193 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.307425 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-21709cab-3a4e-4c35-b34d-18cfebf20193 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023685 Jul 20 04:17:42.308586 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1303/2529] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:42.465522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-352a9b73-d1e0-4d02-80a9-f18e2fb68976 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.466338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-352a9b73-d1e0-4d02-80a9-f18e2fb68976 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.477189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-352a9b73-d1e0-4d02-80a9-f18e2fb68976 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.477760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-352a9b73-d1e0-4d02-80a9-f18e2fb68976 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.478448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-61ca9e4f-716b-4e84-9209-f9a23fc06a70 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.478898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-352a9b73-d1e0-4d02-80a9-f18e2fb68976 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.479392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-352a9b73-d1e0-4d02-80a9-f18e2fb68976 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.488216 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-61ca9e4f-716b-4e84-9209-f9a23fc06a70 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622" status: 200 len: 1517 microversion: 2.1 time: 1.481702 Jul 20 04:17:42.492951 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1227/2530] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622 => generated 1517 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:42.672918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2628870-5201-4f0d-9ea4-d12bd1bdfe80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.673807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e2628870-5201-4f0d-9ea4-d12bd1bdfe80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.705103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2628870-5201-4f0d-9ea4-d12bd1bdfe80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.710103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2628870-5201-4f0d-9ea4-d12bd1bdfe80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.711327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2628870-5201-4f0d-9ea4-d12bd1bdfe80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.711994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2628870-5201-4f0d-9ea4-d12bd1bdfe80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.742397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:42.760249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e2628870-5201-4f0d-9ea4-d12bd1bdfe80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:42.773489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-352a9b73-d1e0-4d02-80a9-f18e2fb68976 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.787258 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-352a9b73-d1e0-4d02-80a9-f18e2fb68976 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.327860 Jul 20 04:17:42.788083 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1304/2531] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:42.800160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9e90fc38-cb25-4f1a-9e1c-0a3d89981b58 req-770a4c43-8da2-42c5-b13c-50a2d2bbbd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-deleted", "tag": "34ed3285-dde5-4027-a99c-c92741329ec4"}, {"server_uuid": "27ee62c2-a702-438e-ae91-9f1bf6846f1b", "name": "network-vif-deleted", "tag": "6cd82c0a-6158-4750-9342-bab7ea3f563d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:42.829077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9e90fc38-cb25-4f1a-9e1c-0a3d89981b58 req-770a4c43-8da2-42c5-b13c-50a2d2bbbd60 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.829698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9e90fc38-cb25-4f1a-9e1c-0a3d89981b58 req-770a4c43-8da2-42c5-b13c-50a2d2bbbd60 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.867325 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9e90fc38-cb25-4f1a-9e1c-0a3d89981b58 req-770a4c43-8da2-42c5-b13c-50a2d2bbbd60 service nova] Creating event network-vif-deleted:34ed3285-dde5-4027-a99c-c92741329ec4 for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:17:42.867940 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9e90fc38-cb25-4f1a-9e1c-0a3d89981b58 req-770a4c43-8da2-42c5-b13c-50a2d2bbbd60 service nova] Creating event network-vif-deleted:6cd82c0a-6158-4750-9342-bab7ea3f563d for instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b on n-h1-760456-11 Jul 20 04:17:42.874298 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9e90fc38-cb25-4f1a-9e1c-0a3d89981b58 req-770a4c43-8da2-42c5-b13c-50a2d2bbbd60 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083500 Jul 20 04:17:42.875159 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1305/2532] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:42.913720 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e2628870-5201-4f0d-9ea4-d12bd1bdfe80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 204 len: 0 microversion: 2.1 time: 0.246635 Jul 20 04:17:42.918031 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1228/2533] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:42 2022] DELETE /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:42.924432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aebe42d3-a5d8-4386-8ac0-41a4e4767f8c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.925535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aebe42d3-a5d8-4386-8ac0-41a4e4767f8c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.953562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aebe42d3-a5d8-4386-8ac0-41a4e4767f8c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.954045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aebe42d3-a5d8-4386-8ac0-41a4e4767f8c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.954874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aebe42d3-a5d8-4386-8ac0-41a4e4767f8c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.955386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aebe42d3-a5d8-4386-8ac0-41a4e4767f8c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.185040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c25f0a7-5ed7-477e-8aac-eea4056abac7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.189982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c25f0a7-5ed7-477e-8aac-eea4056abac7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.207509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c25f0a7-5ed7-477e-8aac-eea4056abac7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.209728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c25f0a7-5ed7-477e-8aac-eea4056abac7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.210833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c25f0a7-5ed7-477e-8aac-eea4056abac7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.212557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c25f0a7-5ed7-477e-8aac-eea4056abac7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.230843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aebe42d3-a5d8-4386-8ac0-41a4e4767f8c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:43.241406 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aebe42d3-a5d8-4386-8ac0-41a4e4767f8c tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1611 microversion: 2.1 time: 0.322295 Jul 20 04:17:43.242446 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1306/2534] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1611 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:43.302624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93e149a5-d024-48af-8c7e-8b2d54cad6be tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.303322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-93e149a5-d024-48af-8c7e-8b2d54cad6be tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.316767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93e149a5-d024-48af-8c7e-8b2d54cad6be tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.317241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93e149a5-d024-48af-8c7e-8b2d54cad6be tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.319918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93e149a5-d024-48af-8c7e-8b2d54cad6be tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.320391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93e149a5-d024-48af-8c7e-8b2d54cad6be tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.436661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-93e149a5-d024-48af-8c7e-8b2d54cad6be tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:43.450412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-93e149a5-d024-48af-8c7e-8b2d54cad6be tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:43.452671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-93e149a5-d024-48af-8c7e-8b2d54cad6be tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:43.455061 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-93e149a5-d024-48af-8c7e-8b2d54cad6be tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.157740 Jul 20 04:17:43.455898 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1307/2535] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:43.477655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-788ceeca-a823-40d8-9be8-e92a70c0058c req-92b1f3d9-bf26-4c94-ba29-5cb500e34e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c561dbb2-7811-4eeb-b05c-0df4ee20c622", "name": "network-vif-deleted", "tag": "a6706761-958b-4296-a870-aeec2c2ceae8"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:43.487057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-788ceeca-a823-40d8-9be8-e92a70c0058c req-92b1f3d9-bf26-4c94-ba29-5cb500e34e63 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.487613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-788ceeca-a823-40d8-9be8-e92a70c0058c req-92b1f3d9-bf26-4c94-ba29-5cb500e34e63 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.511446 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-788ceeca-a823-40d8-9be8-e92a70c0058c req-92b1f3d9-bf26-4c94-ba29-5cb500e34e63 service nova] Creating event network-vif-deleted:a6706761-958b-4296-a870-aeec2c2ceae8 for instance c561dbb2-7811-4eeb-b05c-0df4ee20c622 on n-h2-760456-11 Jul 20 04:17:43.516622 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-788ceeca-a823-40d8-9be8-e92a70c0058c req-92b1f3d9-bf26-4c94-ba29-5cb500e34e63 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048541 Jul 20 04:17:43.518359 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1308/2536] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:43.523623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fd9b6446-311a-4a89-af2d-91daa4d003a1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.524455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fd9b6446-311a-4a89-af2d-91daa4d003a1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: c561dbb2-7811-4eeb-b05c-0df4ee20c622] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.531605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd9b6446-311a-4a89-af2d-91daa4d003a1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.532061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd9b6446-311a-4a89-af2d-91daa4d003a1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.532846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd9b6446-311a-4a89-af2d-91daa4d003a1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.533294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd9b6446-311a-4a89-af2d-91daa4d003a1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.629074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fd9b6446-311a-4a89-af2d-91daa4d003a1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:43.640563 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fd9b6446-311a-4a89-af2d-91daa4d003a1 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622" status: 200 len: 1305 microversion: 2.1 time: 0.121459 Jul 20 04:17:43.642174 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1309/2537] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622 => generated 1305 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:43.822879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4ddaa8ba-bf15-4a08-9c91-c658930b6c2d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.823833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4ddaa8ba-bf15-4a08-9c91-c658930b6c2d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.843170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ddaa8ba-bf15-4a08-9c91-c658930b6c2d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.843947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ddaa8ba-bf15-4a08-9c91-c658930b6c2d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.847943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ddaa8ba-bf15-4a08-9c91-c658930b6c2d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.854095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ddaa8ba-bf15-4a08-9c91-c658930b6c2d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.145262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4ddaa8ba-bf15-4a08-9c91-c658930b6c2d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.158129 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4ddaa8ba-bf15-4a08-9c91-c658930b6c2d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.348848 Jul 20 04:17:44.167725 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1310/2538] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:44.220057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c25f0a7-5ed7-477e-8aac-eea4056abac7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.237101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c25f0a7-5ed7-477e-8aac-eea4056abac7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.240119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c25f0a7-5ed7-477e-8aac-eea4056abac7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.241342 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c25f0a7-5ed7-477e-8aac-eea4056abac7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 1.067224 Jul 20 04:17:44.242872 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1229/2539] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:44.260173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fbf46dca-b26c-42ca-8cd1-14592471e5ae tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.261113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fbf46dca-b26c-42ca-8cd1-14592471e5ae tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.278206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf46dca-b26c-42ca-8cd1-14592471e5ae tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.278206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf46dca-b26c-42ca-8cd1-14592471e5ae tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.279096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf46dca-b26c-42ca-8cd1-14592471e5ae tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.279644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf46dca-b26c-42ca-8cd1-14592471e5ae tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.480289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d25f6b3-bc43-401b-af76-2b77b024941f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.480919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d25f6b3-bc43-401b-af76-2b77b024941f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.491665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d25f6b3-bc43-401b-af76-2b77b024941f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.492501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d25f6b3-bc43-401b-af76-2b77b024941f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.493586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d25f6b3-bc43-401b-af76-2b77b024941f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.494024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d25f6b3-bc43-401b-af76-2b77b024941f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.501315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbf46dca-b26c-42ca-8cd1-14592471e5ae tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.519575 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fbf46dca-b26c-42ca-8cd1-14592471e5ae tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1611 microversion: 2.1 time: 0.263883 Jul 20 04:17:44.531539 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1311/2540] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1611 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:44.624548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d25f6b3-bc43-401b-af76-2b77b024941f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.648729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d25f6b3-bc43-401b-af76-2b77b024941f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.655901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d25f6b3-bc43-401b-af76-2b77b024941f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:44.658776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d25f6b3-bc43-401b-af76-2b77b024941f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.182352 Jul 20 04:17:44.671634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c357172-81e4-43b4-aaed-a543a5e752b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.675917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5c357172-81e4-43b4-aaed-a543a5e752b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: c561dbb2-7811-4eeb-b05c-0df4ee20c622] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.676887 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1230/2541] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:44.689892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c357172-81e4-43b4-aaed-a543a5e752b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.691013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c357172-81e4-43b4-aaed-a543a5e752b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.696712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c357172-81e4-43b4-aaed-a543a5e752b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.698744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c357172-81e4-43b4-aaed-a543a5e752b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.778186 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5c357172-81e4-43b4-aaed-a543a5e752b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] HTTP exception thrown: Instance c561dbb2-7811-4eeb-b05c-0df4ee20c622 could not be found. Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c357172-81e4-43b4-aaed-a543a5e752b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Request method failure captured: Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622 HTTP/1.1 Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14GWwQljeM1Qt4YCrLNIg1iSa9BTttwnNyGsH9-W7xnyLldMEpY8RDZpEaIoLxsYmR8fNq18uLjbGB8BlOcL7hvALrva_8NsrvfyoM-LUj-WVohfxWxzQ9-xLtMBfQucK2QOMsYRAOhTDYjQrbVXC-O08LsrHTud40rjUgiP-_KTetI Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 3e2cccff703842c19f80047348ef088d Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ListServerFiltersTestJSON-1836687829 Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3e2cccff703842c19f80047348ef088d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3e2cccff703842c19f80047348ef088d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3e2cccff703842c19f80047348ef088d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3e2cccff703842c19f80047348ef088d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ListServerFiltersTestJSON-1836687829 Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 3e2cccff703842c19f80047348ef088d Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1836687829 Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ListServerFiltersTestJSON-1836687829-project Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2206264735814d3ea25b0217601d101f Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ListServerFiltersTestJSON-1836687829-project Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance c561dbb2-7811-4eeb-b05c-0df4ee20c622 could not be found. Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'c561dbb2-7811-4eeb-b05c-0df4ee20c622'} Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c561dbb2-7811-4eeb-b05c-0df4ee20c622 could not be found. Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c561dbb2-7811-4eeb-b05c-0df4ee20c622 could not be found. Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:44.783349 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:44.789992 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:44.789992 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:44.789992 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:44.789992 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:44.789992 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:44.789992 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c561dbb2-7811-4eeb-b05c-0df4ee20c622 could not be found. Jul 20 04:17:44.789992 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:44.794678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c357172-81e4-43b4-aaed-a543a5e752b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Returning 404 to user: Instance c561dbb2-7811-4eeb-b05c-0df4ee20c622 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:44.799390 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5c357172-81e4-43b4-aaed-a543a5e752b3 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622" status: 404 len: 111 microversion: 2.1 time: 0.142305 Jul 20 04:17:44.804430 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1312/2542] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/servers/c561dbb2-7811-4eeb-b05c-0df4ee20c622 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:44.812939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-429a40c0-29c7-47bb-983c-38d88d1cc643 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.813781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-429a40c0-29c7-47bb-983c-38d88d1cc643 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:44.831343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-429a40c0-29c7-47bb-983c-38d88d1cc643 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.832486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-429a40c0-29c7-47bb-983c-38d88d1cc643 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.832793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-429a40c0-29c7-47bb-983c-38d88d1cc643 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.838764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-429a40c0-29c7-47bb-983c-38d88d1cc643 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.918770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-429a40c0-29c7-47bb-983c-38d88d1cc643 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:45.118180 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-429a40c0-29c7-47bb-983c-38d88d1cc643 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "DELETE /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 204 len: 0 microversion: 2.1 time: 0.309798 Jul 20 04:17:45.119405 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1231/2543] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:44 2022] DELETE /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:45.144985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-eda763e3-2c66-449a-b6f5-21c0b9bcb2fb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.160110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-eda763e3-2c66-449a-b6f5-21c0b9bcb2fb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.183408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eda763e3-2c66-449a-b6f5-21c0b9bcb2fb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.185969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eda763e3-2c66-449a-b6f5-21c0b9bcb2fb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.186953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c89e93d7-697c-4d94-8bd1-537643729128 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.188925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eda763e3-2c66-449a-b6f5-21c0b9bcb2fb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.189302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c89e93d7-697c-4d94-8bd1-537643729128 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.189963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eda763e3-2c66-449a-b6f5-21c0b9bcb2fb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.206400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c89e93d7-697c-4d94-8bd1-537643729128 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.211375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c89e93d7-697c-4d94-8bd1-537643729128 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.215688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c89e93d7-697c-4d94-8bd1-537643729128 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.216739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c89e93d7-697c-4d94-8bd1-537643729128 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.554061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eda763e3-2c66-449a-b6f5-21c0b9bcb2fb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.562723 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-eda763e3-2c66-449a-b6f5-21c0b9bcb2fb tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1518 microversion: 2.1 time: 0.427682 Jul 20 04:17:45.563319 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1313/2544] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1518 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:45.574667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32980b83-901b-49db-9877-14a7b9fe72f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.575980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-32980b83-901b-49db-9877-14a7b9fe72f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.593216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32980b83-901b-49db-9877-14a7b9fe72f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.593674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32980b83-901b-49db-9877-14a7b9fe72f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.598142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32980b83-901b-49db-9877-14a7b9fe72f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.598741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32980b83-901b-49db-9877-14a7b9fe72f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.970344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-32980b83-901b-49db-9877-14a7b9fe72f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.981236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-32980b83-901b-49db-9877-14a7b9fe72f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.982829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-32980b83-901b-49db-9877-14a7b9fe72f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.986401 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-32980b83-901b-49db-9877-14a7b9fe72f7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.419901 Jul 20 04:17:45.989123 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1314/2545] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:45.995294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06e00450-be0d-49eb-a61e-20da0443918d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.995914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-06e00450-be0d-49eb-a61e-20da0443918d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:46.011440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c89e93d7-697c-4d94-8bd1-537643729128 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.014031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06e00450-be0d-49eb-a61e-20da0443918d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.014628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06e00450-be0d-49eb-a61e-20da0443918d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.015540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06e00450-be0d-49eb-a61e-20da0443918d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.017009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06e00450-be0d-49eb-a61e-20da0443918d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.026294 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c89e93d7-697c-4d94-8bd1-537643729128 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.848873 Jul 20 04:17:46.027293 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1232/2546] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:46.036984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3abfcad3-18d2-4226-8ee4-ff175c0d3e79 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:46.043521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3abfcad3-18d2-4226-8ee4-ff175c0d3e79 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:46.055018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3abfcad3-18d2-4226-8ee4-ff175c0d3e79 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.058233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3abfcad3-18d2-4226-8ee4-ff175c0d3e79 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.059350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3abfcad3-18d2-4226-8ee4-ff175c0d3e79 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.061127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3abfcad3-18d2-4226-8ee4-ff175c0d3e79 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.227848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-06e00450-be0d-49eb-a61e-20da0443918d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.238529 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-06e00450-be0d-49eb-a61e-20da0443918d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1543 microversion: 2.1 time: 0.246987 Jul 20 04:17:46.242499 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1315/2547] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1543 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:46.279421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3abfcad3-18d2-4226-8ee4-ff175c0d3e79 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.293455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3abfcad3-18d2-4226-8ee4-ff175c0d3e79 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.301442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3abfcad3-18d2-4226-8ee4-ff175c0d3e79 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.303859 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3abfcad3-18d2-4226-8ee4-ff175c0d3e79 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.275373 Jul 20 04:17:46.310933 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1233/2548] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:46 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:46.411678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ab975b8a-5228-433a-aa13-9b53a5e6ca2a req-70f958b5-2a63-4258-a60b-536381906e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2d80d9-de8c-4fce-852f-3c7d1947dca0", "name": "network-vif-deleted", "tag": "b1127e50-3431-47b8-a063-a07fc1fe34f2"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:46.421696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ab975b8a-5228-433a-aa13-9b53a5e6ca2a req-70f958b5-2a63-4258-a60b-536381906e00 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.422239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ab975b8a-5228-433a-aa13-9b53a5e6ca2a req-70f958b5-2a63-4258-a60b-536381906e00 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.438719 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ab975b8a-5228-433a-aa13-9b53a5e6ca2a req-70f958b5-2a63-4258-a60b-536381906e00 service nova] Creating event network-vif-deleted:b1127e50-3431-47b8-a063-a07fc1fe34f2 for instance 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 on n-h1-760456-11 Jul 20 04:17:46.444959 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ab975b8a-5228-433a-aa13-9b53a5e6ca2a req-70f958b5-2a63-4258-a60b-536381906e00 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037436 Jul 20 04:17:46.446000 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1316/2549] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:46.581076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0e8ae8ce-2ef0-4943-83eb-e0a9616a2b1d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:46.582218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0e8ae8ce-2ef0-4943-83eb-e0a9616a2b1d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:46.589851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e8ae8ce-2ef0-4943-83eb-e0a9616a2b1d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.590681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e8ae8ce-2ef0-4943-83eb-e0a9616a2b1d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.591691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e8ae8ce-2ef0-4943-83eb-e0a9616a2b1d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.592340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e8ae8ce-2ef0-4943-83eb-e0a9616a2b1d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.010024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fe02c06d-d1fb-46eb-b760-aa8f5297c134 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:47.010799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fe02c06d-d1fb-46eb-b760-aa8f5297c134 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:47.026073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe02c06d-d1fb-46eb-b760-aa8f5297c134 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.026686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe02c06d-d1fb-46eb-b760-aa8f5297c134 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.027541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe02c06d-d1fb-46eb-b760-aa8f5297c134 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.028002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe02c06d-d1fb-46eb-b760-aa8f5297c134 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.125143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0e8ae8ce-2ef0-4943-83eb-e0a9616a2b1d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.152909 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0e8ae8ce-2ef0-4943-83eb-e0a9616a2b1d tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1518 microversion: 2.1 time: 0.575709 Jul 20 04:17:47.158392 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1234/2550] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:46 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1518 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:47.164632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-adca2e0a-5cb0-4a3e-88dd-0c952c24e609 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:47.165258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-adca2e0a-5cb0-4a3e-88dd-0c952c24e609 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:47.201015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adca2e0a-5cb0-4a3e-88dd-0c952c24e609 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.202846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adca2e0a-5cb0-4a3e-88dd-0c952c24e609 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.205836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adca2e0a-5cb0-4a3e-88dd-0c952c24e609 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.212420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adca2e0a-5cb0-4a3e-88dd-0c952c24e609 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.405095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fe02c06d-d1fb-46eb-b760-aa8f5297c134 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.423577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fe02c06d-d1fb-46eb-b760-aa8f5297c134 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.427369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fe02c06d-d1fb-46eb-b760-aa8f5297c134 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.428728 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fe02c06d-d1fb-46eb-b760-aa8f5297c134 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.423127 Jul 20 04:17:47.440568 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1317/2551] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:47 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:47.448964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aa1aef55-0f44-4503-95a0-c5d48fe1e63f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:47.449977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aa1aef55-0f44-4503-95a0-c5d48fe1e63f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:47.459542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa1aef55-0f44-4503-95a0-c5d48fe1e63f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.460313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa1aef55-0f44-4503-95a0-c5d48fe1e63f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.461316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa1aef55-0f44-4503-95a0-c5d48fe1e63f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.461966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa1aef55-0f44-4503-95a0-c5d48fe1e63f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.563369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aa1aef55-0f44-4503-95a0-c5d48fe1e63f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.575304 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aa1aef55-0f44-4503-95a0-c5d48fe1e63f tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.131659 Jul 20 04:17:47.576717 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1318/2552] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:47 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:47.582666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e64d6747-d50a-4c24-a074-1514b50f049a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:47.583798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e64d6747-d50a-4c24-a074-1514b50f049a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:47.593904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e64d6747-d50a-4c24-a074-1514b50f049a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.596653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e64d6747-d50a-4c24-a074-1514b50f049a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.600373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e64d6747-d50a-4c24-a074-1514b50f049a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.601362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e64d6747-d50a-4c24-a074-1514b50f049a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.753818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e64d6747-d50a-4c24-a074-1514b50f049a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.767980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e64d6747-d50a-4c24-a074-1514b50f049a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.769519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e64d6747-d50a-4c24-a074-1514b50f049a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.771349 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e64d6747-d50a-4c24-a074-1514b50f049a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.193068 Jul 20 04:17:47.783895 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1319/2553] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:47 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:47.838867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-adca2e0a-5cb0-4a3e-88dd-0c952c24e609 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.852851 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-adca2e0a-5cb0-4a3e-88dd-0c952c24e609 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.693310 Jul 20 04:17:47.853448 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1235/2554] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:47 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:48.176748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.178057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.193280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.193745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.194677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.195116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.272953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.280724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.281135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lazy-loading 'fault' on Instance uuid 107af339-79a5-4614-9494-f7e7c9b35159 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:48.294890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:48.354299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206264735814d3ea25b0217601d101f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2cccff703842c19f80047348ef088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.365044 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3e944e89-4e39-492f-a9f8-388f6aeb9e18 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 200 len: 1310 microversion: 2.1 time: 0.192327 Jul 20 04:17:48.374995 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1320/2555] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:48.448000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4f753b9e-dff3-41b9-b4e5-6293c61f78d5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.450163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4f753b9e-dff3-41b9-b4e5-6293c61f78d5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.465943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-dd888659-94d8-45c1-891d-64f809305719 req-b323267d-e51f-4d65-9bf2-28e65715636b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107af339-79a5-4614-9494-f7e7c9b35159", "name": "network-vif-deleted", "tag": "8fca47bf-d3d3-4b61-b662-85932e9972a7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:48.469122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f753b9e-dff3-41b9-b4e5-6293c61f78d5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.471251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f753b9e-dff3-41b9-b4e5-6293c61f78d5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.472471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f753b9e-dff3-41b9-b4e5-6293c61f78d5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.474931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f753b9e-dff3-41b9-b4e5-6293c61f78d5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.492336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-dd888659-94d8-45c1-891d-64f809305719 req-b323267d-e51f-4d65-9bf2-28e65715636b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.492808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-dd888659-94d8-45c1-891d-64f809305719 req-b323267d-e51f-4d65-9bf2-28e65715636b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.562227 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-dd888659-94d8-45c1-891d-64f809305719 req-b323267d-e51f-4d65-9bf2-28e65715636b service nova] Creating event network-vif-deleted:8fca47bf-d3d3-4b61-b662-85932e9972a7 for instance 107af339-79a5-4614-9494-f7e7c9b35159 on n-h1-760456-11 Jul 20 04:17:48.576397 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-dd888659-94d8-45c1-891d-64f809305719 req-b323267d-e51f-4d65-9bf2-28e65715636b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113858 Jul 20 04:17:48.577737 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1321/2556] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:48.600624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2acb638b-2251-45e4-afe3-8c231253b1ff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.601386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2acb638b-2251-45e4-afe3-8c231253b1ff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.631906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2acb638b-2251-45e4-afe3-8c231253b1ff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.632398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2acb638b-2251-45e4-afe3-8c231253b1ff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.633366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2acb638b-2251-45e4-afe3-8c231253b1ff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.635049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2acb638b-2251-45e4-afe3-8c231253b1ff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.765747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2acb638b-2251-45e4-afe3-8c231253b1ff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.794913 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2acb638b-2251-45e4-afe3-8c231253b1ff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.206071 Jul 20 04:17:48.805668 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1322/2557] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:48.811163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e54f6bbe-1c78-4dd2-a53c-0a44ebb2efdd tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.811802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e54f6bbe-1c78-4dd2-a53c-0a44ebb2efdd tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.819420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e54f6bbe-1c78-4dd2-a53c-0a44ebb2efdd tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.819420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e54f6bbe-1c78-4dd2-a53c-0a44ebb2efdd tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.820174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e54f6bbe-1c78-4dd2-a53c-0a44ebb2efdd tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.821384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e54f6bbe-1c78-4dd2-a53c-0a44ebb2efdd tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.889844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e54f6bbe-1c78-4dd2-a53c-0a44ebb2efdd tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.900192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e54f6bbe-1c78-4dd2-a53c-0a44ebb2efdd tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.901737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e54f6bbe-1c78-4dd2-a53c-0a44ebb2efdd tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.903142 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e54f6bbe-1c78-4dd2-a53c-0a44ebb2efdd tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.096303 Jul 20 04:17:48.915941 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1323/2558] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:48.922474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9592fcf7-0577-43b5-b39f-398a0881e4e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.923102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9592fcf7-0577-43b5-b39f-398a0881e4e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.929741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9592fcf7-0577-43b5-b39f-398a0881e4e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.930210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9592fcf7-0577-43b5-b39f-398a0881e4e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.931133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9592fcf7-0577-43b5-b39f-398a0881e4e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.931590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9592fcf7-0577-43b5-b39f-398a0881e4e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.013073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f753b9e-dff3-41b9-b4e5-6293c61f78d5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.029848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f753b9e-dff3-41b9-b4e5-6293c61f78d5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.041665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f753b9e-dff3-41b9-b4e5-6293c61f78d5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.045457 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4f753b9e-dff3-41b9-b4e5-6293c61f78d5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.602965 Jul 20 04:17:49.054101 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1236/2559] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:49.321673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9592fcf7-0577-43b5-b39f-398a0881e4e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.336727 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9592fcf7-0577-43b5-b39f-398a0881e4e4 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.419588 Jul 20 04:17:49.343822 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1324/2560] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:49.383156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9181aed3-0532-4658-842b-bae137c4a9e6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.383795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9181aed3-0532-4658-842b-bae137c4a9e6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] [instance: 107af339-79a5-4614-9494-f7e7c9b35159] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.400278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9181aed3-0532-4658-842b-bae137c4a9e6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.400665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9181aed3-0532-4658-842b-bae137c4a9e6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.401463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9181aed3-0532-4658-842b-bae137c4a9e6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.401933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9181aed3-0532-4658-842b-bae137c4a9e6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.436398 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-9181aed3-0532-4658-842b-bae137c4a9e6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] HTTP exception thrown: Instance 107af339-79a5-4614-9494-f7e7c9b35159 could not be found. Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9181aed3-0532-4658-842b-bae137c4a9e6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Request method failure captured: Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 HTTP/1.1 Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14GWwQljeM1Qt4YCrLNIg1iSa9BTttwnNyGsH9-W7xnyLldMEpY8RDZpEaIoLxsYmR8fNq18uLjbGB8BlOcL7hvALrva_8NsrvfyoM-LUj-WVohfxWxzQ9-xLtMBfQucK2QOMsYRAOhTDYjQrbVXC-O08LsrHTud40rjUgiP-_KTetI Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 3e2cccff703842c19f80047348ef088d Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ListServerFiltersTestJSON-1836687829 Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3e2cccff703842c19f80047348ef088d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3e2cccff703842c19f80047348ef088d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3e2cccff703842c19f80047348ef088d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3e2cccff703842c19f80047348ef088d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ListServerFiltersTestJSON-1836687829 Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 3e2cccff703842c19f80047348ef088d Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1836687829 Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ListServerFiltersTestJSON-1836687829-project Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2206264735814d3ea25b0217601d101f Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ListServerFiltersTestJSON-1836687829-project Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 107af339-79a5-4614-9494-f7e7c9b35159 could not be found. Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '107af339-79a5-4614-9494-f7e7c9b35159'} Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 107af339-79a5-4614-9494-f7e7c9b35159 could not be found. Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 107af339-79a5-4614-9494-f7e7c9b35159 could not be found. Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:49.438139 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:49.443922 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:49.443922 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:49.443922 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:49.443922 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:49.443922 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:49.443922 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 107af339-79a5-4614-9494-f7e7c9b35159 could not be found. Jul 20 04:17:49.443922 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:17:49.443922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9181aed3-0532-4658-842b-bae137c4a9e6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] Returning 404 to user: Instance 107af339-79a5-4614-9494-f7e7c9b35159 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:49.444974 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9181aed3-0532-4658-842b-bae137c4a9e6 tempest-ListServerFiltersTestJSON-1836687829 tempest-ListServerFiltersTestJSON-1836687829-project] 10.222.0.59 "GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159" status: 404 len: 111 microversion: 2.1 time: 0.061516 Jul 20 04:17:49.449555 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1325/2561] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/servers/107af339-79a5-4614-9494-f7e7c9b35159 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:49.528030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec7751f8-add3-4918-b5d2-6d5d8f4f6d67 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Action: 'create', calling method: .version_select at 0x7fb841f19ca0>, body: {"keypair": {"name": "tempest-keypair-164623887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLeYf6YbTS2X5UeDJddxfUsyFYAMqmQ/F3lESMl8ad+yV1Gk5KY1HKMhuu5ou5w+7zbXiOtPIigTdOeZ/PLg/vbY8zvoXLGE6zuZwqGw22TVbpfFgAxamXPizXe/kTllw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:49.563155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ec7751f8-add3-4918-b5d2-6d5d8f4f6d67 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Getting quotas for project 0be768b73a844766a2407ac16a2b7304. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:49.579710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ec7751f8-add3-4918-b5d2-6d5d8f4f6d67 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Getting quotas for user 0458026d4c4f43b1a770140d09b2e164 and project 0be768b73a844766a2407ac16a2b7304. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:49.630610 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec7751f8-add3-4918-b5d2-6d5d8f4f6d67 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.313852 Jul 20 04:17:49.638197 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1237/2562] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:17:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:49.764889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1101392959", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "e13e2da2-9e3c-4274-877d-f49bd33e9e48"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:49.811228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-33476ce4-cb19-4bf8-ae1f-0c83ca992b77 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.812199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-33476ce4-cb19-4bf8-ae1f-0c83ca992b77 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.833196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33476ce4-cb19-4bf8-ae1f-0c83ca992b77 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.833404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33476ce4-cb19-4bf8-ae1f-0c83ca992b77 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.841190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33476ce4-cb19-4bf8-ae1f-0c83ca992b77 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.841869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33476ce4-cb19-4bf8-ae1f-0c83ca992b77 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.890797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] validate_networks() for [('e13e2da2-9e3c-4274-877d-f49bd33e9e48', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:50.070030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-33476ce4-cb19-4bf8-ae1f-0c83ca992b77 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.079996 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-33476ce4-cb19-4bf8-ae1f-0c83ca992b77 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.272431 Jul 20 04:17:50.087471 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1238/2563] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:50.092994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-70e2b1fd-06e7-4e36-8a88-00b544eaadec tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.095106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-70e2b1fd-06e7-4e36-8a88-00b544eaadec tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.110299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70e2b1fd-06e7-4e36-8a88-00b544eaadec tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.111201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70e2b1fd-06e7-4e36-8a88-00b544eaadec tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.123581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70e2b1fd-06e7-4e36-8a88-00b544eaadec tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.124372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70e2b1fd-06e7-4e36-8a88-00b544eaadec tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.287718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-70e2b1fd-06e7-4e36-8a88-00b544eaadec tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.305325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-70e2b1fd-06e7-4e36-8a88-00b544eaadec tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.310056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-70e2b1fd-06e7-4e36-8a88-00b544eaadec tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.315663 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-70e2b1fd-06e7-4e36-8a88-00b544eaadec tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.226615 Jul 20 04:17:50.317216 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1239/2564] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:50.328624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f77170e5-b8aa-4821-98e2-561acec90cf1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.329361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f77170e5-b8aa-4821-98e2-561acec90cf1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.344122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f77170e5-b8aa-4821-98e2-561acec90cf1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.344829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f77170e5-b8aa-4821-98e2-561acec90cf1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.346006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f77170e5-b8aa-4821-98e2-561acec90cf1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.349114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f77170e5-b8aa-4821-98e2-561acec90cf1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.640727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:50.640727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:50.647939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:50.648610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:50.648972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:50.664976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.665452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.666300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.666762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.710364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=11 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:50.739403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Getting quotas for project 65a9c17c56e94930a159f00d0c8e0e7f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:50.748596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Getting quotas for user 43de2b946fd7474dbc2a48e5fcaa518d and project 65a9c17c56e94930a159f00d0c8e0e7f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:50.779095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:50.781444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:50.871966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:50.900711 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-acfe62aa-77df-4347-99c5-1b65c1a9863f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229748 Jul 20 04:17:50.901661 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1326/2565] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:50.907634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-02f931cd-d2c3-447b-85cf-88792f41c072 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.908525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-02f931cd-d2c3-447b-85cf-88792f41c072 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:50.936651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-02f931cd-d2c3-447b-85cf-88792f41c072 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.937836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-02f931cd-d2c3-447b-85cf-88792f41c072 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.938908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-02f931cd-d2c3-447b-85cf-88792f41c072 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.939583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-02f931cd-d2c3-447b-85cf-88792f41c072 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.445052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f77170e5-b8aa-4821-98e2-561acec90cf1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.453692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-02f931cd-d2c3-447b-85cf-88792f41c072 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.465234 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-02f931cd-d2c3-447b-85cf-88792f41c072 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.562114 Jul 20 04:17:51.467475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f77170e5-b8aa-4821-98e2-561acec90cf1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.471577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f77170e5-b8aa-4821-98e2-561acec90cf1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.475897 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f77170e5-b8aa-4821-98e2-561acec90cf1 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 1.157115 Jul 20 04:17:51.476473 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1240/2566] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:51.477966 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1327/2567] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.483887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d0f7a53-7f02-4a8d-8cd7-08a64cd9ac53 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.484434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d0f7a53-7f02-4a8d-8cd7-08a64cd9ac53 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.488627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f1ae837-bb38-442b-9b80-3808e3f1ae15 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.490922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8f1ae837-bb38-442b-9b80-3808e3f1ae15 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.508818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f1ae837-bb38-442b-9b80-3808e3f1ae15 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.510922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f1ae837-bb38-442b-9b80-3808e3f1ae15 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.511962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f1ae837-bb38-442b-9b80-3808e3f1ae15 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.514103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f1ae837-bb38-442b-9b80-3808e3f1ae15 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.652641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8f1ae837-bb38-442b-9b80-3808e3f1ae15 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.667618 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8f1ae837-bb38-442b-9b80-3808e3f1ae15 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.186789 Jul 20 04:17:51.679631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3d0f7a53-7f02-4a8d-8cd7-08a64cd9ac53 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.680908 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1328/2568] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.688292 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d0f7a53-7f02-4a8d-8cd7-08a64cd9ac53 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1218 microversion: 2.1 time: 0.210020 Jul 20 04:17:51.688878 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1241/2569] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1218 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.692379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-954fb4df-5be0-475c-97c0-895ab4e65247 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.693415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-954fb4df-5be0-475c-97c0-895ab4e65247 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.733300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-954fb4df-5be0-475c-97c0-895ab4e65247 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.733758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-954fb4df-5be0-475c-97c0-895ab4e65247 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.735602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-954fb4df-5be0-475c-97c0-895ab4e65247 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.737212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-954fb4df-5be0-475c-97c0-895ab4e65247 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.990523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-954fb4df-5be0-475c-97c0-895ab4e65247 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.006871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-954fb4df-5be0-475c-97c0-895ab4e65247 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.015749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-954fb4df-5be0-475c-97c0-895ab4e65247 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:52.031515 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-954fb4df-5be0-475c-97c0-895ab4e65247 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.343328 Jul 20 04:17:52.033638 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1329/2570] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:52.484160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-21d0f184-e454-4be9-aedd-b2f6aed8b07c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.484775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-21d0f184-e454-4be9-aedd-b2f6aed8b07c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.496278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a734a80-596e-4598-9e9d-8a8f7b7da384 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.497083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1a734a80-596e-4598-9e9d-8a8f7b7da384 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:52.510476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a734a80-596e-4598-9e9d-8a8f7b7da384 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.512204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a734a80-596e-4598-9e9d-8a8f7b7da384 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.515003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a734a80-596e-4598-9e9d-8a8f7b7da384 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.516122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a734a80-596e-4598-9e9d-8a8f7b7da384 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.519852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21d0f184-e454-4be9-aedd-b2f6aed8b07c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.525532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21d0f184-e454-4be9-aedd-b2f6aed8b07c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.529314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21d0f184-e454-4be9-aedd-b2f6aed8b07c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.532192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21d0f184-e454-4be9-aedd-b2f6aed8b07c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.068074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-21d0f184-e454-4be9-aedd-b2f6aed8b07c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.079938 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-21d0f184-e454-4be9-aedd-b2f6aed8b07c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1509 microversion: 2.1 time: 0.600447 Jul 20 04:17:53.081661 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1242/2571] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1509 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.093390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10eeae8f-cf19-4086-812c-11fbcc6a4d21 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.094039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10eeae8f-cf19-4086-812c-11fbcc6a4d21 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.105860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10eeae8f-cf19-4086-812c-11fbcc6a4d21 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.120049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10eeae8f-cf19-4086-812c-11fbcc6a4d21 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.123092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10eeae8f-cf19-4086-812c-11fbcc6a4d21 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.125364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10eeae8f-cf19-4086-812c-11fbcc6a4d21 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.519018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10eeae8f-cf19-4086-812c-11fbcc6a4d21 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.530205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:53.536864 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10eeae8f-cf19-4086-812c-11fbcc6a4d21 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.448456 Jul 20 04:17:53.537772 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1243/2572] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.548821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-382635a4-d19f-4efe-b3e9-d2d48fda2fce tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.552465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-382635a4-d19f-4efe-b3e9-d2d48fda2fce tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.571455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-382635a4-d19f-4efe-b3e9-d2d48fda2fce tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.574027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-382635a4-d19f-4efe-b3e9-d2d48fda2fce tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.575102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-382635a4-d19f-4efe-b3e9-d2d48fda2fce tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.585350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-382635a4-d19f-4efe-b3e9-d2d48fda2fce tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.750826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-382635a4-d19f-4efe-b3e9-d2d48fda2fce tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.762722 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-382635a4-d19f-4efe-b3e9-d2d48fda2fce tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1276 microversion: 2.1 time: 0.219116 Jul 20 04:17:53.767785 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1244/2573] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.779473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66a1b2a8-e642-4761-a552-5c5b8e0fead0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.780107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-66a1b2a8-e642-4761-a552-5c5b8e0fead0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.796604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a1b2a8-e642-4761-a552-5c5b8e0fead0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.797061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a1b2a8-e642-4761-a552-5c5b8e0fead0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.798190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a1b2a8-e642-4761-a552-5c5b8e0fead0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.798843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a1b2a8-e642-4761-a552-5c5b8e0fead0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.885616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a734a80-596e-4598-9e9d-8a8f7b7da384 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.912258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a734a80-596e-4598-9e9d-8a8f7b7da384 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.915733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a734a80-596e-4598-9e9d-8a8f7b7da384 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.922222 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a734a80-596e-4598-9e9d-8a8f7b7da384 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 1.430726 Jul 20 04:17:53.922955 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1330/2574] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:54.041554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66a1b2a8-e642-4761-a552-5c5b8e0fead0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.069390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66a1b2a8-e642-4761-a552-5c5b8e0fead0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.073206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66a1b2a8-e642-4761-a552-5c5b8e0fead0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.078914 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-66a1b2a8-e642-4761-a552-5c5b8e0fead0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.308238 Jul 20 04:17:54.079579 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1245/2575] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:54.100427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ded8d34-9368-4d55-9480-8e657f224aa8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.101648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ded8d34-9368-4d55-9480-8e657f224aa8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.112173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ded8d34-9368-4d55-9480-8e657f224aa8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.112661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ded8d34-9368-4d55-9480-8e657f224aa8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.113456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ded8d34-9368-4d55-9480-8e657f224aa8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.122414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ded8d34-9368-4d55-9480-8e657f224aa8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.554654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c08f3e7-0d4a-4931-8e30-e765020a0976 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.555343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c08f3e7-0d4a-4931-8e30-e765020a0976 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.605860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c08f3e7-0d4a-4931-8e30-e765020a0976 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.609938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c08f3e7-0d4a-4931-8e30-e765020a0976 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.619737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c08f3e7-0d4a-4931-8e30-e765020a0976 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.620468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c08f3e7-0d4a-4931-8e30-e765020a0976 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.671438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ded8d34-9368-4d55-9480-8e657f224aa8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.691639 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ded8d34-9368-4d55-9480-8e657f224aa8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1530 microversion: 2.1 time: 0.596157 Jul 20 04:17:54.718349 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1331/2576] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1530 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:54.780932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce632db1-db34-4c5e-9097-45d73d6d3ba5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.781823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce632db1-db34-4c5e-9097-45d73d6d3ba5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.789350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce632db1-db34-4c5e-9097-45d73d6d3ba5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.791288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce632db1-db34-4c5e-9097-45d73d6d3ba5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.793347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce632db1-db34-4c5e-9097-45d73d6d3ba5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.794193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce632db1-db34-4c5e-9097-45d73d6d3ba5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.026396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c08f3e7-0d4a-4931-8e30-e765020a0976 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.035316 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c08f3e7-0d4a-4931-8e30-e765020a0976 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.486134 Jul 20 04:17:55.035985 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1246/2577] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:55.049232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f2136d1-215e-4930-95a8-2c05ddedbe52 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:55.049790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1f2136d1-215e-4930-95a8-2c05ddedbe52 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:55.083491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f2136d1-215e-4930-95a8-2c05ddedbe52 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.083965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f2136d1-215e-4930-95a8-2c05ddedbe52 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.084771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f2136d1-215e-4930-95a8-2c05ddedbe52 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.085209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f2136d1-215e-4930-95a8-2c05ddedbe52 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.095218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce632db1-db34-4c5e-9097-45d73d6d3ba5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.109307 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce632db1-db34-4c5e-9097-45d73d6d3ba5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1276 microversion: 2.1 time: 0.332143 Jul 20 04:17:55.117148 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1332/2578] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1276 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:55.129060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c5cf8f30-3586-400a-a93b-a52d9c0d52e1 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:55.137200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c5cf8f30-3586-400a-a93b-a52d9c0d52e1 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:55.157787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5cf8f30-3586-400a-a93b-a52d9c0d52e1 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.159414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5cf8f30-3586-400a-a93b-a52d9c0d52e1 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.161379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5cf8f30-3586-400a-a93b-a52d9c0d52e1 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.162418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5cf8f30-3586-400a-a93b-a52d9c0d52e1 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.327313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5cf8f30-3586-400a-a93b-a52d9c0d52e1 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.356469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5cf8f30-3586-400a-a93b-a52d9c0d52e1 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.362096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5cf8f30-3586-400a-a93b-a52d9c0d52e1 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.366463 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c5cf8f30-3586-400a-a93b-a52d9c0d52e1 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.247663 Jul 20 04:17:55.372832 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1333/2579] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:55 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:55.660359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f2136d1-215e-4930-95a8-2c05ddedbe52 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.671483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f2136d1-215e-4930-95a8-2c05ddedbe52 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.676150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f2136d1-215e-4930-95a8-2c05ddedbe52 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.681694 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1f2136d1-215e-4930-95a8-2c05ddedbe52 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.640339 Jul 20 04:17:55.698855 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1247/2580] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:55 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:55.719187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4d0ae5fc-4add-4bc1-aa73-f11fd55d2b80 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:55.719840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4d0ae5fc-4add-4bc1-aa73-f11fd55d2b80 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:55.736684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d0ae5fc-4add-4bc1-aa73-f11fd55d2b80 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.737185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d0ae5fc-4add-4bc1-aa73-f11fd55d2b80 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.738046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d0ae5fc-4add-4bc1-aa73-f11fd55d2b80 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.738573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d0ae5fc-4add-4bc1-aa73-f11fd55d2b80 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.052758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8362330b-d29b-4d4f-913d-6efaa8235010 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.053394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8362330b-d29b-4d4f-913d-6efaa8235010 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.131727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8362330b-d29b-4d4f-913d-6efaa8235010 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.132151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8362330b-d29b-4d4f-913d-6efaa8235010 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.138031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8362330b-d29b-4d4f-913d-6efaa8235010 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.138598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8362330b-d29b-4d4f-913d-6efaa8235010 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.216718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4d0ae5fc-4add-4bc1-aa73-f11fd55d2b80 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.227121 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4d0ae5fc-4add-4bc1-aa73-f11fd55d2b80 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.512777 Jul 20 04:17:56.228310 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1334/2581] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:55 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:56.237883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9695d653-4b8e-4fe3-a253-13ba6086128d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.260100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9695d653-4b8e-4fe3-a253-13ba6086128d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.269009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:56.280980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9695d653-4b8e-4fe3-a253-13ba6086128d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.281631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9695d653-4b8e-4fe3-a253-13ba6086128d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.284154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9695d653-4b8e-4fe3-a253-13ba6086128d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.284939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9695d653-4b8e-4fe3-a253-13ba6086128d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.347321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8362330b-d29b-4d4f-913d-6efaa8235010 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.359060 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8362330b-d29b-4d4f-913d-6efaa8235010 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.310592 Jul 20 04:17:56.359665 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1248/2582] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:56.404461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9fc5d04e-fa01-43a1-a7a7-0e339c03c317 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.422203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9fc5d04e-fa01-43a1-a7a7-0e339c03c317 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.447094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9fc5d04e-fa01-43a1-a7a7-0e339c03c317 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.447784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9fc5d04e-fa01-43a1-a7a7-0e339c03c317 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.448907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9fc5d04e-fa01-43a1-a7a7-0e339c03c317 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.450452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9fc5d04e-fa01-43a1-a7a7-0e339c03c317 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.668749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9695d653-4b8e-4fe3-a253-13ba6086128d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.694398 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9695d653-4b8e-4fe3-a253-13ba6086128d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1318 microversion: 2.1 time: 0.464655 Jul 20 04:17:56.695009 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1335/2583] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:56.718391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1003886995", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "635129a9-dca1-4aaf-b500-8ea126800731"}], "security_groups": [{"name": "tempest-securitygroup--1419170860"}], "key_name": "tempest-keypair-164623887", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:56.824814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9fc5d04e-fa01-43a1-a7a7-0e339c03c317 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.843420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9fc5d04e-fa01-43a1-a7a7-0e339c03c317 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.852399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9fc5d04e-fa01-43a1-a7a7-0e339c03c317 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.858222 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9fc5d04e-fa01-43a1-a7a7-0e339c03c317 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.457742 Jul 20 04:17:56.866432 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1249/2584] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:56.871531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-03730d82-c6ab-4917-a8be-88e3b09f0403 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.872150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-03730d82-c6ab-4917-a8be-88e3b09f0403 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.935135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03730d82-c6ab-4917-a8be-88e3b09f0403 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.935609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03730d82-c6ab-4917-a8be-88e3b09f0403 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.936493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03730d82-c6ab-4917-a8be-88e3b09f0403 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.959688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03730d82-c6ab-4917-a8be-88e3b09f0403 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.153009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] validate_networks() for [('635129a9-dca1-4aaf-b500-8ea126800731', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:57.949884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-03730d82-c6ab-4917-a8be-88e3b09f0403 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.967960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-03730d82-c6ab-4917-a8be-88e3b09f0403 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.982603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-03730d82-c6ab-4917-a8be-88e3b09f0403 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.983660 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-03730d82-c6ab-4917-a8be-88e3b09f0403 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 1.115948 Jul 20 04:17:57.993225 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1250/2585] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:58.466394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-432315892", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": "none"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:58.548603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:58.549036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:58.549768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:58.551475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:58.552519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:58.567165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.568239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.569236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.569848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.602992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Getting quotas for project 3578e315af5d4bdaa40141ec17b58d5c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:58.612684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Getting quotas for user 2206121222c14ac687771c2e710d92e1 and project 3578e315af5d4bdaa40141ec17b58d5c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:58.634450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:58.638050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:58.674519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:58.705800 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48d3c9fa-a6db-47ee-a3e1-ebdd78b0073a tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.711268 Jul 20 04:17:58.714628 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1251/2586] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:17:58.722621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4c80f93c-ea41-46f7-b1be-5822076e202d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.722621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4c80f93c-ea41-46f7-b1be-5822076e202d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.733191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c80f93c-ea41-46f7-b1be-5822076e202d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.734026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c80f93c-ea41-46f7-b1be-5822076e202d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.735187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c80f93c-ea41-46f7-b1be-5822076e202d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.736044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c80f93c-ea41-46f7-b1be-5822076e202d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.198739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:59.199181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:59.199881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:59.200468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:59.201140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:59.227287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.234293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.235420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.239674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.343842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Getting quotas for project 0be768b73a844766a2407ac16a2b7304. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:59.372470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Getting quotas for user 0458026d4c4f43b1a770140d09b2e164 and project 0be768b73a844766a2407ac16a2b7304. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:59.428724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4c80f93c-ea41-46f7-b1be-5822076e202d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.446361 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4c80f93c-ea41-46f7-b1be-5822076e202d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.729209 Jul 20 04:17:59.448683 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1252/2587] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:59.465068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e13b305d-4d42-43b8-a7a0-3c59a6d8559a tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.465318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:59.466179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e13b305d-4d42-43b8-a7a0-3c59a6d8559a tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.476918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:59.480256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e13b305d-4d42-43b8-a7a0-3c59a6d8559a tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.481185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e13b305d-4d42-43b8-a7a0-3c59a6d8559a tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.484742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e13b305d-4d42-43b8-a7a0-3c59a6d8559a tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.485828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e13b305d-4d42-43b8-a7a0-3c59a6d8559a tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.590211 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-18029bc5-2d47-4ee5-a080-57f3dba16691 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.891503 Jul 20 04:17:59.603547 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1336/2588] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 2908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:59.612038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1ac7b26d-dee3-40b1-919c-fd18acb6e593 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.613100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1ac7b26d-dee3-40b1-919c-fd18acb6e593 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.622483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ac7b26d-dee3-40b1-919c-fd18acb6e593 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.623415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ac7b26d-dee3-40b1-919c-fd18acb6e593 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.624595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ac7b26d-dee3-40b1-919c-fd18acb6e593 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.625264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ac7b26d-dee3-40b1-919c-fd18acb6e593 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.830684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e13b305d-4d42-43b8-a7a0-3c59a6d8559a tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.843385 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e13b305d-4d42-43b8-a7a0-3c59a6d8559a tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.383415 Jul 20 04:17:59.856201 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1253/2589] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:59.863069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f4cd74e-841b-44bb-99fe-86750505db6e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.864378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6f4cd74e-841b-44bb-99fe-86750505db6e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.872458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f4cd74e-841b-44bb-99fe-86750505db6e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.873118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f4cd74e-841b-44bb-99fe-86750505db6e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.877620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f4cd74e-841b-44bb-99fe-86750505db6e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.891183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f4cd74e-841b-44bb-99fe-86750505db6e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.977206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1ac7b26d-dee3-40b1-919c-fd18acb6e593 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.989703 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1ac7b26d-dee3-40b1-919c-fd18acb6e593 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1318 microversion: 2.1 time: 0.383574 Jul 20 04:17:59.990996 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1337/2590] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:00.081362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6f4cd74e-841b-44bb-99fe-86750505db6e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.099356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2029176302", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": "none"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:00.115412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6f4cd74e-841b-44bb-99fe-86750505db6e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.145066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6f4cd74e-841b-44bb-99fe-86750505db6e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.171350 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f4cd74e-841b-44bb-99fe-86750505db6e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.306717 Jul 20 04:18:00.190948 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1254/2591] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:00.246329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-12d3b881-eb24-432f-83c9-c86e60245229 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.252082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-12d3b881-eb24-432f-83c9-c86e60245229 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:00.280985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12d3b881-eb24-432f-83c9-c86e60245229 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.281638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12d3b881-eb24-432f-83c9-c86e60245229 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.284025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12d3b881-eb24-432f-83c9-c86e60245229 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.284485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12d3b881-eb24-432f-83c9-c86e60245229 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.339912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:00.342783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:00.343750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:00.345808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:00.346590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:00.371840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.376235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.379119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.381172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.452985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Getting quotas for project d3648eec6bd9498e811fcd54d4a74a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:00.488998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Getting quotas for user 90440a594d7b49aa9cf9eca682a620fe and project d3648eec6bd9498e811fcd54d4a74a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:00.530817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-12d3b881-eb24-432f-83c9-c86e60245229 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.544557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-12d3b881-eb24-432f-83c9-c86e60245229 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.546851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:00.548561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-12d3b881-eb24-432f-83c9-c86e60245229 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.552557 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-12d3b881-eb24-432f-83c9-c86e60245229 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da" status: 200 len: 1276 microversion: 2.47 time: 0.360390 Jul 20 04:18:00.553198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: 4801c818-b8aa-48fd-b501-22551037516a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:00.555296 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1255/2592] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da => generated 1276 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:00.629953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-740186a6-1672-4d80-a502-f08646015fd0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.630624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-740186a6-1672-4d80-a502-f08646015fd0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:00.653185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-740186a6-1672-4d80-a502-f08646015fd0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.653659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-740186a6-1672-4d80-a502-f08646015fd0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.657418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-740186a6-1672-4d80-a502-f08646015fd0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.662730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-740186a6-1672-4d80-a502-f08646015fd0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.708914 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dd176405-0601-4b98-9515-df61fc6527e4 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.716625 Jul 20 04:18:00.715008 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1338/2593] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:17:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:18:00.720031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-156a50a0-6dd3-485e-bc6d-a1a333247306 req-41964818-5c14-4459-bc18-51f065b51959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021c9592-bd4c-4506-8422-4ff0c8e2f141", "name": "network-vif-plugged", "status": "completed", "tag": "4da41aa3-a22e-4da5-ad9b-4f4e3bfea0bc"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:00.733577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-156a50a0-6dd3-485e-bc6d-a1a333247306 req-41964818-5c14-4459-bc18-51f065b51959 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.734370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-156a50a0-6dd3-485e-bc6d-a1a333247306 req-41964818-5c14-4459-bc18-51f065b51959 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.746530 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-156a50a0-6dd3-485e-bc6d-a1a333247306 req-41964818-5c14-4459-bc18-51f065b51959 service nova] Creating event network-vif-plugged:4da41aa3-a22e-4da5-ad9b-4f4e3bfea0bc for instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 on n-h2-760456-11 Jul 20 04:18:00.757258 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-156a50a0-6dd3-485e-bc6d-a1a333247306 req-41964818-5c14-4459-bc18-51f065b51959 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040704 Jul 20 04:18:00.759341 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1339/2594] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:00.774681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3d2f5539-12b7-4a13-aa73-2e49080e8b3b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.775862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3d2f5539-12b7-4a13-aa73-2e49080e8b3b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:00.792147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d2f5539-12b7-4a13-aa73-2e49080e8b3b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.796477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d2f5539-12b7-4a13-aa73-2e49080e8b3b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.809387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d2f5539-12b7-4a13-aa73-2e49080e8b3b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.814644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d2f5539-12b7-4a13-aa73-2e49080e8b3b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.962938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3d2f5539-12b7-4a13-aa73-2e49080e8b3b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.976479 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3d2f5539-12b7-4a13-aa73-2e49080e8b3b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1245 microversion: 2.1 time: 0.212380 Jul 20 04:18:00.987659 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1340/2595] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1245 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:00.993943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-09e62e3a-b79f-46ff-ad64-1955deff638b req-1f3d16d8-f14f-4035-b196-c2208d3debb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955c1609-40d3-47fd-9eac-8b879ecae2c8", "tag": "384b5cd6-b0be-4fd8-994b-7c96785fc89b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:01.025635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-09e62e3a-b79f-46ff-ad64-1955deff638b req-1f3d16d8-f14f-4035-b196-c2208d3debb9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.031955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-09e62e3a-b79f-46ff-ad64-1955deff638b req-1f3d16d8-f14f-4035-b196-c2208d3debb9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.050358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:01.074171 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-09e62e3a-b79f-46ff-ad64-1955deff638b req-1f3d16d8-f14f-4035-b196-c2208d3debb9 service nova] Creating event network-changed:384b5cd6-b0be-4fd8-994b-7c96785fc89b for instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 on n-h2-760456-11 Jul 20 04:18:01.086510 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-09e62e3a-b79f-46ff-ad64-1955deff638b req-1f3d16d8-f14f-4035-b196-c2208d3debb9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097207 Jul 20 04:18:01.087990 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1341/2596] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:01.094386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0a962377-59cd-48bd-ab63-fac01f4ece19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.095319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0a962377-59cd-48bd-ab63-fac01f4ece19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.113259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a962377-59cd-48bd-ab63-fac01f4ece19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.114535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a962377-59cd-48bd-ab63-fac01f4ece19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.115734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a962377-59cd-48bd-ab63-fac01f4ece19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.116349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a962377-59cd-48bd-ab63-fac01f4ece19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.453150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0a962377-59cd-48bd-ab63-fac01f4ece19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.467261 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0a962377-59cd-48bd-ab63-fac01f4ece19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.377195 Jul 20 04:18:01.469623 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1342/2597] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:01.485130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-69826579-8e2f-428e-b1eb-37ebe29f6667 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.487290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-69826579-8e2f-428e-b1eb-37ebe29f6667 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: 4801c818-b8aa-48fd-b501-22551037516a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.576417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-69826579-8e2f-428e-b1eb-37ebe29f6667 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.586428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-69826579-8e2f-428e-b1eb-37ebe29f6667 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.589298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-69826579-8e2f-428e-b1eb-37ebe29f6667 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.590775 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-69826579-8e2f-428e-b1eb-37ebe29f6667 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a" status: 200 len: 1278 microversion: 2.47 time: 0.119568 Jul 20 04:18:01.593868 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1343/2598] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:01.599871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d302c65d-e1b6-4cec-81f5-23501e3f64c7 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.600705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d302c65d-e1b6-4cec-81f5-23501e3f64c7 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.612424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d302c65d-e1b6-4cec-81f5-23501e3f64c7 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.613746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d302c65d-e1b6-4cec-81f5-23501e3f64c7 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.615292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d302c65d-e1b6-4cec-81f5-23501e3f64c7 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.616234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d302c65d-e1b6-4cec-81f5-23501e3f64c7 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.765157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d302c65d-e1b6-4cec-81f5-23501e3f64c7 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.778054 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d302c65d-e1b6-4cec-81f5-23501e3f64c7 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.182739 Jul 20 04:18:01.787365 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1344/2599] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:01.792404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9d1bf7e4-3550-4e76-9717-b90d4dfcb0ad tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.792981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9d1bf7e4-3550-4e76-9717-b90d4dfcb0ad tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.800017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d1bf7e4-3550-4e76-9717-b90d4dfcb0ad tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.800476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d1bf7e4-3550-4e76-9717-b90d4dfcb0ad tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.801488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d1bf7e4-3550-4e76-9717-b90d4dfcb0ad tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.801951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d1bf7e4-3550-4e76-9717-b90d4dfcb0ad tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.858809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-740186a6-1672-4d80-a502-f08646015fd0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.869730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-740186a6-1672-4d80-a502-f08646015fd0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.871693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-740186a6-1672-4d80-a502-f08646015fd0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.873151 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-740186a6-1672-4d80-a502-f08646015fd0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 1.316325 Jul 20 04:18:01.887662 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1256/2600] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:01.894201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c96fbb99-89cd-44f4-aa19-c7f0b1d7c3e3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.895770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c96fbb99-89cd-44f4-aa19-c7f0b1d7c3e3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.904761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c96fbb99-89cd-44f4-aa19-c7f0b1d7c3e3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.905484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c96fbb99-89cd-44f4-aa19-c7f0b1d7c3e3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.907174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c96fbb99-89cd-44f4-aa19-c7f0b1d7c3e3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.908369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c96fbb99-89cd-44f4-aa19-c7f0b1d7c3e3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.041327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c96fbb99-89cd-44f4-aa19-c7f0b1d7c3e3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.045550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9d1bf7e4-3550-4e76-9717-b90d4dfcb0ad tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.056549 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9d1bf7e4-3550-4e76-9717-b90d4dfcb0ad tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1318 microversion: 2.1 time: 0.267995 Jul 20 04:18:02.064276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c96fbb99-89cd-44f4-aa19-c7f0b1d7c3e3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.065802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c96fbb99-89cd-44f4-aa19-c7f0b1d7c3e3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.070559 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1345/2601] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:02.075879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2df9b7f4-3413-4eb8-87e2-baee637d15a1 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.076124 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c96fbb99-89cd-44f4-aa19-c7f0b1d7c3e3 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.178047 Jul 20 04:18:02.077047 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1257/2602] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:02.077845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2df9b7f4-3413-4eb8-87e2-baee637d15a1 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.084912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-794130765", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": "none"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:02.094934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2df9b7f4-3413-4eb8-87e2-baee637d15a1 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.095717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2df9b7f4-3413-4eb8-87e2-baee637d15a1 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.097068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2df9b7f4-3413-4eb8-87e2-baee637d15a1 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.097784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2df9b7f4-3413-4eb8-87e2-baee637d15a1 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.171894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:02.172574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:02.173224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:02.173791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:02.174420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:02.199552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.200019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.200854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.201287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.208612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2df9b7f4-3413-4eb8-87e2-baee637d15a1 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.217738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2df9b7f4-3413-4eb8-87e2-baee637d15a1 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.219591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2df9b7f4-3413-4eb8-87e2-baee637d15a1 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.220978 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2df9b7f4-3413-4eb8-87e2-baee637d15a1 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da" status: 200 len: 1338 microversion: 2.47 time: 0.149233 Jul 20 04:18:02.224089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Getting quotas for project d3648eec6bd9498e811fcd54d4a74a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:02.229816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Getting quotas for user 90440a594d7b49aa9cf9eca682a620fe and project d3648eec6bd9498e811fcd54d4a74a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:02.233464 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1346/2603] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da => generated 1338 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:02.239679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c5628ffd-dcdd-4b49-a4d1-8c366d8a34aa tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.240607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c5628ffd-dcdd-4b49-a4d1-8c366d8a34aa tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.244181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:02.246708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:02.249143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5628ffd-dcdd-4b49-a4d1-8c366d8a34aa tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.249880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5628ffd-dcdd-4b49-a4d1-8c366d8a34aa tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.250930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5628ffd-dcdd-4b49-a4d1-8c366d8a34aa tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.251594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5628ffd-dcdd-4b49-a4d1-8c366d8a34aa tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.330630 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f642c7df-9066-4a6f-9b4b-345b0a21e7c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.248263 Jul 20 04:18:02.332385 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1258/2604] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:18:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 254 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:18:02.341529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5dd8adc4-210d-4105-a91a-21fc0195ac1c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:02.347517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5628ffd-dcdd-4b49-a4d1-8c366d8a34aa tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.362376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5dd8adc4-210d-4105-a91a-21fc0195ac1c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.367839 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c5628ffd-dcdd-4b49-a4d1-8c366d8a34aa tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1301 microversion: 2.1 time: 0.132761 Jul 20 04:18:02.368617 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1347/2605] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1301 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:02.425196 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5dd8adc4-210d-4105-a91a-21fc0195ac1c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "PUT /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 991 microversion: 2.47 time: 0.087660 Jul 20 04:18:02.426932 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1259/2606] 10.222.0.59 () {62 vars in 1296 bytes} [Wed Jul 20 04:18:02 2022] PUT /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:18:02.442492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-44210164-20bb-4b1d-8e58-d8300e6a4d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.443522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-44210164-20bb-4b1d-8e58-d8300e6a4d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.486411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a8382335-911b-4a93-beba-750e29c7a9be tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.487037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a8382335-911b-4a93-beba-750e29c7a9be tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.495277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8382335-911b-4a93-beba-750e29c7a9be tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.495741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8382335-911b-4a93-beba-750e29c7a9be tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.496683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8382335-911b-4a93-beba-750e29c7a9be tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.497134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8382335-911b-4a93-beba-750e29c7a9be tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.529539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-44210164-20bb-4b1d-8e58-d8300e6a4d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.541032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-44210164-20bb-4b1d-8e58-d8300e6a4d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.542995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-44210164-20bb-4b1d-8e58-d8300e6a4d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.544946 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-44210164-20bb-4b1d-8e58-d8300e6a4d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1277 microversion: 2.47 time: 0.106503 Jul 20 04:18:02.557542 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1348/2607] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:02.796980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-68813e8a-0fb3-4b91-9dce-014a2e31caff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.800113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-68813e8a-0fb3-4b91-9dce-014a2e31caff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.819201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68813e8a-0fb3-4b91-9dce-014a2e31caff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.819970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68813e8a-0fb3-4b91-9dce-014a2e31caff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.821218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68813e8a-0fb3-4b91-9dce-014a2e31caff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.821812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68813e8a-0fb3-4b91-9dce-014a2e31caff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.826927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a8382335-911b-4a93-beba-750e29c7a9be tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:02.837836 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a8382335-911b-4a93-beba-750e29c7a9be tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.355241 Jul 20 04:18:02.852292 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1260/2608] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:02.899464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4fc06742-f344-4f98-b169-ec07f5afc365 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.901066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4fc06742-f344-4f98-b169-ec07f5afc365 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.911124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fc06742-f344-4f98-b169-ec07f5afc365 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.911990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fc06742-f344-4f98-b169-ec07f5afc365 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.914562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fc06742-f344-4f98-b169-ec07f5afc365 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.916039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fc06742-f344-4f98-b169-ec07f5afc365 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.038904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-68813e8a-0fb3-4b91-9dce-014a2e31caff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.055281 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-68813e8a-0fb3-4b91-9dce-014a2e31caff tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.264210 Jul 20 04:18:03.056203 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1349/2609] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:03.089483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dec2e97e-660e-4c81-812d-85df6e4e1205 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.091540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dec2e97e-660e-4c81-812d-85df6e4e1205 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.099684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dec2e97e-660e-4c81-812d-85df6e4e1205 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.107966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dec2e97e-660e-4c81-812d-85df6e4e1205 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.112641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dec2e97e-660e-4c81-812d-85df6e4e1205 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.114448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dec2e97e-660e-4c81-812d-85df6e4e1205 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.257854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4fc06742-f344-4f98-b169-ec07f5afc365 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.270955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4fc06742-f344-4f98-b169-ec07f5afc365 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.275828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4fc06742-f344-4f98-b169-ec07f5afc365 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.278375 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4fc06742-f344-4f98-b169-ec07f5afc365 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.388464 Jul 20 04:18:03.279289 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1261/2610] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:03.284505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a7e81883-ae4c-4b0a-8805-c3dc65ac17ce tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.299263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7e81883-ae4c-4b0a-8805-c3dc65ac17ce tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.312408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7e81883-ae4c-4b0a-8805-c3dc65ac17ce tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.313166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7e81883-ae4c-4b0a-8805-c3dc65ac17ce tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.317283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7e81883-ae4c-4b0a-8805-c3dc65ac17ce tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.318953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7e81883-ae4c-4b0a-8805-c3dc65ac17ce tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.393675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dec2e97e-660e-4c81-812d-85df6e4e1205 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.408816 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dec2e97e-660e-4c81-812d-85df6e4e1205 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1318 microversion: 2.1 time: 0.324039 Jul 20 04:18:03.420184 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1350/2611] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:03.440201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5b61955a-1f58-4dff-904c-93d7c650becf tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.441087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5b61955a-1f58-4dff-904c-93d7c650becf tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.458186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b61955a-1f58-4dff-904c-93d7c650becf tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.461104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b61955a-1f58-4dff-904c-93d7c650becf tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.462187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b61955a-1f58-4dff-904c-93d7c650becf tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.464330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b61955a-1f58-4dff-904c-93d7c650becf tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.556168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a7e81883-ae4c-4b0a-8805-c3dc65ac17ce tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.560399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:03.573722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a7e81883-ae4c-4b0a-8805-c3dc65ac17ce tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.575681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a7e81883-ae4c-4b0a-8805-c3dc65ac17ce tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.578118 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a7e81883-ae4c-4b0a-8805-c3dc65ac17ce tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.297583 Jul 20 04:18:03.588065 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1262/2612] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:03.600696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c5a7f25-6300-422d-be1a-873bb35c96ef tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.601640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c5a7f25-6300-422d-be1a-873bb35c96ef tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.611974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5a7f25-6300-422d-be1a-873bb35c96ef tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.612743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5a7f25-6300-422d-be1a-873bb35c96ef tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.614491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5a7f25-6300-422d-be1a-873bb35c96ef tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.615726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c5a7f25-6300-422d-be1a-873bb35c96ef tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.686368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b61955a-1f58-4dff-904c-93d7c650becf tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.696847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b61955a-1f58-4dff-904c-93d7c650becf tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.702607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b61955a-1f58-4dff-904c-93d7c650becf tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.709910 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5b61955a-1f58-4dff-904c-93d7c650becf tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da" status: 200 len: 1338 microversion: 2.47 time: 0.285685 Jul 20 04:18:03.722674 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1351/2613] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da => generated 1338 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:03.731506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c3b0fc71-f4f0-4b93-b0f5-0e07a0658c9c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.732589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c3b0fc71-f4f0-4b93-b0f5-0e07a0658c9c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.742012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3b0fc71-f4f0-4b93-b0f5-0e07a0658c9c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.743153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3b0fc71-f4f0-4b93-b0f5-0e07a0658c9c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.744612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3b0fc71-f4f0-4b93-b0f5-0e07a0658c9c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.745291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3b0fc71-f4f0-4b93-b0f5-0e07a0658c9c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.840551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c5a7f25-6300-422d-be1a-873bb35c96ef tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.855951 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c5a7f25-6300-422d-be1a-873bb35c96ef tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1299 microversion: 2.1 time: 0.260359 Jul 20 04:18:03.869128 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1263/2614] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1299 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:03.877260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-db1a3d42-6924-4c58-b517-33f85d453389 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:03.877946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-db1a3d42-6924-4c58-b517-33f85d453389 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:03.886162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c3b0fc71-f4f0-4b93-b0f5-0e07a0658c9c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.898861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db1a3d42-6924-4c58-b517-33f85d453389 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.899608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db1a3d42-6924-4c58-b517-33f85d453389 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.901066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db1a3d42-6924-4c58-b517-33f85d453389 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:03.902764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db1a3d42-6924-4c58-b517-33f85d453389 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:03.908666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c3b0fc71-f4f0-4b93-b0f5-0e07a0658c9c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.914946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c3b0fc71-f4f0-4b93-b0f5-0e07a0658c9c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.932690 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c3b0fc71-f4f0-4b93-b0f5-0e07a0658c9c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1329 microversion: 2.47 time: 0.206102 Jul 20 04:18:03.935935 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1352/2615] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1329 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:04.074201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0a0f2395-ca2a-4820-9277-1358a8992de4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.075153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0a0f2395-ca2a-4820-9277-1358a8992de4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.088737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a0f2395-ca2a-4820-9277-1358a8992de4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.091572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a0f2395-ca2a-4820-9277-1358a8992de4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.093962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a0f2395-ca2a-4820-9277-1358a8992de4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.094787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a0f2395-ca2a-4820-9277-1358a8992de4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.203084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-db1a3d42-6924-4c58-b517-33f85d453389 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.212639 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-db1a3d42-6924-4c58-b517-33f85d453389 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.341145 Jul 20 04:18:04.213935 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1264/2616] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:03 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:04.231396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0a0f2395-ca2a-4820-9277-1358a8992de4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.243680 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0a0f2395-ca2a-4820-9277-1358a8992de4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.174643 Jul 20 04:18:04.246655 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1353/2617] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:04.297579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca6fecc4-d859-46c1-9c64-6193e92e1578 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.298632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ca6fecc4-d859-46c1-9c64-6193e92e1578 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.310823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca6fecc4-d859-46c1-9c64-6193e92e1578 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.313079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca6fecc4-d859-46c1-9c64-6193e92e1578 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.313869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca6fecc4-d859-46c1-9c64-6193e92e1578 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.314388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca6fecc4-d859-46c1-9c64-6193e92e1578 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.428337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-65e18f0e-30e6-4281-84d7-d798cc7132ee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.429269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-65e18f0e-30e6-4281-84d7-d798cc7132ee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.450500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65e18f0e-30e6-4281-84d7-d798cc7132ee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.453803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65e18f0e-30e6-4281-84d7-d798cc7132ee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.455430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65e18f0e-30e6-4281-84d7-d798cc7132ee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.455885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65e18f0e-30e6-4281-84d7-d798cc7132ee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.507464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ca6fecc4-d859-46c1-9c64-6193e92e1578 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.523036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ca6fecc4-d859-46c1-9c64-6193e92e1578 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.528041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ca6fecc4-d859-46c1-9c64-6193e92e1578 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.529729 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ca6fecc4-d859-46c1-9c64-6193e92e1578 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.236582 Jul 20 04:18:04.541973 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1265/2618] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:04.609141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b8e94d20-385b-469b-9689-2b5be2fce8cf tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.609993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b8e94d20-385b-469b-9689-2b5be2fce8cf tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.622755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8e94d20-385b-469b-9689-2b5be2fce8cf tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.623216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8e94d20-385b-469b-9689-2b5be2fce8cf tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.624097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8e94d20-385b-469b-9689-2b5be2fce8cf tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.624537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8e94d20-385b-469b-9689-2b5be2fce8cf tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.689102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-65e18f0e-30e6-4281-84d7-d798cc7132ee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.699936 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-65e18f0e-30e6-4281-84d7-d798cc7132ee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1318 microversion: 2.1 time: 0.277431 Jul 20 04:18:04.700852 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1354/2619] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:04.733297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4c88040e-9f25-4a8f-b41d-e2c5a4e8d7e7 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.733931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4c88040e-9f25-4a8f-b41d-e2c5a4e8d7e7 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.736205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b8e94d20-385b-469b-9689-2b5be2fce8cf tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.744128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c88040e-9f25-4a8f-b41d-e2c5a4e8d7e7 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.744603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c88040e-9f25-4a8f-b41d-e2c5a4e8d7e7 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.745407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c88040e-9f25-4a8f-b41d-e2c5a4e8d7e7 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.745859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c88040e-9f25-4a8f-b41d-e2c5a4e8d7e7 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.753823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b8e94d20-385b-469b-9689-2b5be2fce8cf tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.757469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b8e94d20-385b-469b-9689-2b5be2fce8cf tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.758921 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b8e94d20-385b-469b-9689-2b5be2fce8cf tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.153774 Jul 20 04:18:04.759924 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1266/2620] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:04.881835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4a23bcf0-cf93-4146-b904-34e058b9c752 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.884087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4a23bcf0-cf93-4146-b904-34e058b9c752 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.900195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a23bcf0-cf93-4146-b904-34e058b9c752 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.900853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a23bcf0-cf93-4146-b904-34e058b9c752 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.901581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a23bcf0-cf93-4146-b904-34e058b9c752 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.902031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a23bcf0-cf93-4146-b904-34e058b9c752 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.982797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4c88040e-9f25-4a8f-b41d-e2c5a4e8d7e7 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:04.999174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4c88040e-9f25-4a8f-b41d-e2c5a4e8d7e7 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.020424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4c88040e-9f25-4a8f-b41d-e2c5a4e8d7e7 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.020424 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4c88040e-9f25-4a8f-b41d-e2c5a4e8d7e7 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da" status: 200 len: 1359 microversion: 2.47 time: 0.282623 Jul 20 04:18:05.020424 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1355/2621] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da => generated 1359 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:05.046974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-feecd60d-4586-4b89-9df8-80926b787e36 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.050813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-feecd60d-4586-4b89-9df8-80926b787e36 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.082337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feecd60d-4586-4b89-9df8-80926b787e36 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.083901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feecd60d-4586-4b89-9df8-80926b787e36 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.088036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feecd60d-4586-4b89-9df8-80926b787e36 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.089579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feecd60d-4586-4b89-9df8-80926b787e36 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.320805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-feecd60d-4586-4b89-9df8-80926b787e36 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.340094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-feecd60d-4586-4b89-9df8-80926b787e36 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.343720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-feecd60d-4586-4b89-9df8-80926b787e36 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.346966 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-feecd60d-4586-4b89-9df8-80926b787e36 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1337 microversion: 2.47 time: 0.333784 Jul 20 04:18:05.358532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4a23bcf0-cf93-4146-b904-34e058b9c752 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.362210 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1356/2622] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1337 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:05.371635 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4a23bcf0-cf93-4146-b904-34e058b9c752 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1367 microversion: 2.1 time: 0.500337 Jul 20 04:18:05.376278 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1267/2623] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:05.392785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dae5bffe-952b-43ac-86f4-eadf8d514f69 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.394915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fc096ac2-4109-47eb-995b-9948ec8c1a4d tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2141696523"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:05.396456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fc096ac2-4109-47eb-995b-9948ec8c1a4d tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.397409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dae5bffe-952b-43ac-86f4-eadf8d514f69 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.413475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dae5bffe-952b-43ac-86f4-eadf8d514f69 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.416584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dae5bffe-952b-43ac-86f4-eadf8d514f69 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.418501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dae5bffe-952b-43ac-86f4-eadf8d514f69 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.418779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc096ac2-4109-47eb-995b-9948ec8c1a4d tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.419291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc096ac2-4109-47eb-995b-9948ec8c1a4d tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.419770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dae5bffe-952b-43ac-86f4-eadf8d514f69 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.420230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc096ac2-4109-47eb-995b-9948ec8c1a4d tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.420717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc096ac2-4109-47eb-995b-9948ec8c1a4d tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.757308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dae5bffe-952b-43ac-86f4-eadf8d514f69 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.774542 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dae5bffe-952b-43ac-86f4-eadf8d514f69 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.390106 Jul 20 04:18:05.786976 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1268/2624] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:05.798698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-885176ec-6ed1-4e02-be1b-7c8f14649be4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.799457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-885176ec-6ed1-4e02-be1b-7c8f14649be4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.814707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-885176ec-6ed1-4e02-be1b-7c8f14649be4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.815738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-885176ec-6ed1-4e02-be1b-7c8f14649be4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.816527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-885176ec-6ed1-4e02-be1b-7c8f14649be4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.817402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-885176ec-6ed1-4e02-be1b-7c8f14649be4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.974285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-885176ec-6ed1-4e02-be1b-7c8f14649be4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.984873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-885176ec-6ed1-4e02-be1b-7c8f14649be4 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.196994 Jul 20 04:18:05.986288 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1269/2625] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:05.991821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d14c4a5-7681-4aaf-9a5a-0b531cf27c0a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.992738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d14c4a5-7681-4aaf-9a5a-0b531cf27c0a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.999547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d14c4a5-7681-4aaf-9a5a-0b531cf27c0a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.000707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d14c4a5-7681-4aaf-9a5a-0b531cf27c0a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.002208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d14c4a5-7681-4aaf-9a5a-0b531cf27c0a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.002999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d14c4a5-7681-4aaf-9a5a-0b531cf27c0a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.075872 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fc096ac2-4109-47eb-995b-9948ec8c1a4d tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "POST /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da/action" status: 202 len: 52 microversion: 2.47 time: 0.700228 Jul 20 04:18:06.087502 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1357/2626] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:18:05 2022] POST /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da/action => generated 52 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:18:06.101082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1ea80b0d-6b63-457c-8db0-45a3d7f224ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.105431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1ea80b0d-6b63-457c-8db0-45a3d7f224ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.137358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ea80b0d-6b63-457c-8db0-45a3d7f224ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.138069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ea80b0d-6b63-457c-8db0-45a3d7f224ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.143360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ea80b0d-6b63-457c-8db0-45a3d7f224ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.143848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ea80b0d-6b63-457c-8db0-45a3d7f224ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.487152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d14c4a5-7681-4aaf-9a5a-0b531cf27c0a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.527570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d14c4a5-7681-4aaf-9a5a-0b531cf27c0a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.534733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d14c4a5-7681-4aaf-9a5a-0b531cf27c0a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.536841 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d14c4a5-7681-4aaf-9a5a-0b531cf27c0a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.549193 Jul 20 04:18:06.552785 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1270/2627] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:06.552785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-49e76bf6-0c21-4863-8a89-e9782da9a6f0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.553199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-49e76bf6-0c21-4863-8a89-e9782da9a6f0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.570799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49e76bf6-0c21-4863-8a89-e9782da9a6f0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.571528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49e76bf6-0c21-4863-8a89-e9782da9a6f0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.574474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49e76bf6-0c21-4863-8a89-e9782da9a6f0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.574947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49e76bf6-0c21-4863-8a89-e9782da9a6f0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.692613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1ea80b0d-6b63-457c-8db0-45a3d7f224ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.712462 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1ea80b0d-6b63-457c-8db0-45a3d7f224ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1318 microversion: 2.1 time: 0.621209 Jul 20 04:18:06.726281 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1358/2628] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:06.730131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb0d1bb9-a512-433a-a881-d722c75aa980 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.734304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb0d1bb9-a512-433a-a881-d722c75aa980 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.751408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb0d1bb9-a512-433a-a881-d722c75aa980 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.752520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb0d1bb9-a512-433a-a881-d722c75aa980 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.758197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb0d1bb9-a512-433a-a881-d722c75aa980 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.760664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb0d1bb9-a512-433a-a881-d722c75aa980 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.771953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:06.784082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-49e76bf6-0c21-4863-8a89-e9782da9a6f0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.801675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-49e76bf6-0c21-4863-8a89-e9782da9a6f0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.805431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-49e76bf6-0c21-4863-8a89-e9782da9a6f0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:06.810357 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-49e76bf6-0c21-4863-8a89-e9782da9a6f0 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.269763 Jul 20 04:18:06.810964 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1271/2629] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:06.837845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb0d1bb9-a512-433a-a881-d722c75aa980 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:06.853616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a0020c2d-f40e-4e4c-bcd3-fd2120ee17ef tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.860153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a0020c2d-f40e-4e4c-bcd3-fd2120ee17ef tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.908310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0020c2d-f40e-4e4c-bcd3-fd2120ee17ef tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.911328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0020c2d-f40e-4e4c-bcd3-fd2120ee17ef tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.912266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0020c2d-f40e-4e4c-bcd3-fd2120ee17ef tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.912814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0020c2d-f40e-4e4c-bcd3-fd2120ee17ef tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.070024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a0020c2d-f40e-4e4c-bcd3-fd2120ee17ef tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.090649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a0020c2d-f40e-4e4c-bcd3-fd2120ee17ef tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.100849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a0020c2d-f40e-4e4c-bcd3-fd2120ee17ef tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.106525 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a0020c2d-f40e-4e4c-bcd3-fd2120ee17ef tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1335 microversion: 2.47 time: 0.263139 Jul 20 04:18:07.126315 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1272/2630] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1335 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:07.127795 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb0d1bb9-a512-433a-a881-d722c75aa980 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da" status: 204 len: 0 microversion: 2.47 time: 0.410370 Jul 20 04:18:07.134369 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1359/2631] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:18:06 2022] DELETE /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:07.142322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cb5f766d-2a9e-4c9d-a0cf-3b2a394acb2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.146494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cb5f766d-2a9e-4c9d-a0cf-3b2a394acb2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.150793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3539d4e0-5517-4785-b5b7-419833d1e284 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.151737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3539d4e0-5517-4785-b5b7-419833d1e284 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.157839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb5f766d-2a9e-4c9d-a0cf-3b2a394acb2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.158353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb5f766d-2a9e-4c9d-a0cf-3b2a394acb2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.159160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb5f766d-2a9e-4c9d-a0cf-3b2a394acb2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.162611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb5f766d-2a9e-4c9d-a0cf-3b2a394acb2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.171560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3539d4e0-5517-4785-b5b7-419833d1e284 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.172556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3539d4e0-5517-4785-b5b7-419833d1e284 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.176250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3539d4e0-5517-4785-b5b7-419833d1e284 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.177664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3539d4e0-5517-4785-b5b7-419833d1e284 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.469635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cb5f766d-2a9e-4c9d-a0cf-3b2a394acb2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.480976 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cb5f766d-2a9e-4c9d-a0cf-3b2a394acb2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1367 microversion: 2.1 time: 0.353256 Jul 20 04:18:07.492952 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1273/2632] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:07.499393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8da83a9-b5eb-4b87-a060-171cca5f6c80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.500264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c8da83a9-b5eb-4b87-a060-171cca5f6c80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.511360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8da83a9-b5eb-4b87-a060-171cca5f6c80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.512163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8da83a9-b5eb-4b87-a060-171cca5f6c80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.514079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8da83a9-b5eb-4b87-a060-171cca5f6c80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.514862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8da83a9-b5eb-4b87-a060-171cca5f6c80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.737361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c8da83a9-b5eb-4b87-a060-171cca5f6c80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.748862 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c8da83a9-b5eb-4b87-a060-171cca5f6c80 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.253053 Jul 20 04:18:07.753426 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1274/2633] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:07.771207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d0787b36-9273-4534-8ee4-96b92fc590af tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.772031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d0787b36-9273-4534-8ee4-96b92fc590af tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.784304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0787b36-9273-4534-8ee4-96b92fc590af tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.784771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0787b36-9273-4534-8ee4-96b92fc590af tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.786441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0787b36-9273-4534-8ee4-96b92fc590af tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.786904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0787b36-9273-4534-8ee4-96b92fc590af tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.829143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3539d4e0-5517-4785-b5b7-419833d1e284 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.845473 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3539d4e0-5517-4785-b5b7-419833d1e284 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.711331 Jul 20 04:18:07.846527 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1360/2634] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:07.998076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d0787b36-9273-4534-8ee4-96b92fc590af tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.022190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d0787b36-9273-4534-8ee4-96b92fc590af tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.022635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9af5ef80-f751-410f-b9e0-5bfd6b7f9b13 req-37df6be5-f468-4112-aa05-5f04d6192822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea899275-fe75-439a-aec1-824f5cf75382", "tag": "eda254b3-c753-4cfe-bbf6-f11de433af64"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:08.025013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d0787b36-9273-4534-8ee4-96b92fc590af tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.028512 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d0787b36-9273-4534-8ee4-96b92fc590af tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da" status: 200 len: 1365 microversion: 2.47 time: 0.271888 Jul 20 04:18:08.032451 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1275/2635] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:08.040913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9af5ef80-f751-410f-b9e0-5bfd6b7f9b13 req-37df6be5-f468-4112-aa05-5f04d6192822 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.041729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9af5ef80-f751-410f-b9e0-5bfd6b7f9b13 req-37df6be5-f468-4112-aa05-5f04d6192822 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.044092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-61489879-edd8-4c0d-ab6f-4f573d8e712d req-90147aea-9a01-4222-9839-4a221fb31221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955c1609-40d3-47fd-9eac-8b879ecae2c8", "name": "network-vif-plugged", "status": "completed", "tag": "384b5cd6-b0be-4fd8-994b-7c96785fc89b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:08.068594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-61489879-edd8-4c0d-ab6f-4f573d8e712d req-90147aea-9a01-4222-9839-4a221fb31221 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.069057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-61489879-edd8-4c0d-ab6f-4f573d8e712d req-90147aea-9a01-4222-9839-4a221fb31221 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.070778 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9af5ef80-f751-410f-b9e0-5bfd6b7f9b13 req-37df6be5-f468-4112-aa05-5f04d6192822 service nova] Creating event network-changed:eda254b3-c753-4cfe-bbf6-f11de433af64 for instance ea899275-fe75-439a-aec1-824f5cf75382 on n-h1-760456-11 Jul 20 04:18:08.077711 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9af5ef80-f751-410f-b9e0-5bfd6b7f9b13 req-37df6be5-f468-4112-aa05-5f04d6192822 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228725 Jul 20 04:18:08.079963 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1361/2636] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:08.087156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f0e5612c-0c44-4ff5-87e2-d5ff93eb7cd8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.088754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f0e5612c-0c44-4ff5-87e2-d5ff93eb7cd8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.090794 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-61489879-edd8-4c0d-ab6f-4f573d8e712d req-90147aea-9a01-4222-9839-4a221fb31221 service nova] Creating event network-vif-plugged:384b5cd6-b0be-4fd8-994b-7c96785fc89b for instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 on n-h2-760456-11 Jul 20 04:18:08.097592 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-61489879-edd8-4c0d-ab6f-4f573d8e712d req-90147aea-9a01-4222-9839-4a221fb31221 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063648 Jul 20 04:18:08.102416 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1276/2637] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:08.118040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0e5612c-0c44-4ff5-87e2-d5ff93eb7cd8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.118669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0e5612c-0c44-4ff5-87e2-d5ff93eb7cd8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.119855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0e5612c-0c44-4ff5-87e2-d5ff93eb7cd8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.120813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0e5612c-0c44-4ff5-87e2-d5ff93eb7cd8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.126367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8161594d-4721-441e-897b-64fd58443de0 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.126367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8161594d-4721-441e-897b-64fd58443de0 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.132683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8161594d-4721-441e-897b-64fd58443de0 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.133143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8161594d-4721-441e-897b-64fd58443de0 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.134070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8161594d-4721-441e-897b-64fd58443de0 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.134574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8161594d-4721-441e-897b-64fd58443de0 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.350918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f0e5612c-0c44-4ff5-87e2-d5ff93eb7cd8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.366428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f0e5612c-0c44-4ff5-87e2-d5ff93eb7cd8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.368002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f0e5612c-0c44-4ff5-87e2-d5ff93eb7cd8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.369230 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f0e5612c-0c44-4ff5-87e2-d5ff93eb7cd8 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.287605 Jul 20 04:18:08.369826 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1362/2638] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:08.377615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-09c90dd7-3397-40e6-b53f-05a51906959f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.378831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-09c90dd7-3397-40e6-b53f-05a51906959f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.403673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09c90dd7-3397-40e6-b53f-05a51906959f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.403841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09c90dd7-3397-40e6-b53f-05a51906959f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.404920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09c90dd7-3397-40e6-b53f-05a51906959f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.405181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09c90dd7-3397-40e6-b53f-05a51906959f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.443696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8161594d-4721-441e-897b-64fd58443de0 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.452276 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8161594d-4721-441e-897b-64fd58443de0 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1318 microversion: 2.1 time: 0.348336 Jul 20 04:18:08.453127 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1277/2639] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:08.476079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-44136179-7793-448e-9b9d-8f01fde7ad49 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.476693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-44136179-7793-448e-9b9d-8f01fde7ad49 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.491659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44136179-7793-448e-9b9d-8f01fde7ad49 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.491899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44136179-7793-448e-9b9d-8f01fde7ad49 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.492653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44136179-7793-448e-9b9d-8f01fde7ad49 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.493094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44136179-7793-448e-9b9d-8f01fde7ad49 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.522323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09c90dd7-3397-40e6-b53f-05a51906959f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.549695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09c90dd7-3397-40e6-b53f-05a51906959f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.553523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09c90dd7-3397-40e6-b53f-05a51906959f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.557104 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-09c90dd7-3397-40e6-b53f-05a51906959f tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.183386 Jul 20 04:18:08.561157 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1363/2640] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:08.584144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-deff0ca2-2d0b-4708-8634-01cbcec97cc3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:08.587327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-deff0ca2-2d0b-4708-8634-01cbcec97cc3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.603214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-deff0ca2-2d0b-4708-8634-01cbcec97cc3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.608758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-deff0ca2-2d0b-4708-8634-01cbcec97cc3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.613423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-deff0ca2-2d0b-4708-8634-01cbcec97cc3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.614114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-deff0ca2-2d0b-4708-8634-01cbcec97cc3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.667240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-44136179-7793-448e-9b9d-8f01fde7ad49 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.681128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-44136179-7793-448e-9b9d-8f01fde7ad49 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.684888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-44136179-7793-448e-9b9d-8f01fde7ad49 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.687055 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-44136179-7793-448e-9b9d-8f01fde7ad49 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1356 microversion: 2.47 time: 0.215564 Jul 20 04:18:08.698916 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1278/2641] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1356 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:08.710059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:08.712774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.719708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.720905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.721940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.722667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.851573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:08.852417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:08.853134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:08.853814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:08.854493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:08.865059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:08.968360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:08.977058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.977519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.978348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.979212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.997646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-deff0ca2-2d0b-4708-8634-01cbcec97cc3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.017943 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-deff0ca2-2d0b-4708-8634-01cbcec97cc3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1367 microversion: 2.1 time: 0.455348 Jul 20 04:18:09.021368 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1364/2642] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:08 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:09.037848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5db68f3f-e906-43dd-8892-42a624cd96c5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.039032 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40884e22-3057-4d43-a51d-7e53591d448e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "POST /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a/action" status: 202 len: 1078 microversion: 2.47 time: 0.334183 Jul 20 04:18:09.040027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5db68f3f-e906-43dd-8892-42a624cd96c5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.041133 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1279/2643] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:18:08 2022] POST /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a/action => generated 1078 bytes in 338 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:18:09.046808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf63fc41-79e2-4431-a8ea-1ddd80ece1ce tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.047056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:09.047625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cf63fc41-79e2-4431-a8ea-1ddd80ece1ce tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.055609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf63fc41-79e2-4431-a8ea-1ddd80ece1ce tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.056202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf63fc41-79e2-4431-a8ea-1ddd80ece1ce tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.057130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf63fc41-79e2-4431-a8ea-1ddd80ece1ce tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.057662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf63fc41-79e2-4431-a8ea-1ddd80ece1ce tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.058408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5db68f3f-e906-43dd-8892-42a624cd96c5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.059032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5db68f3f-e906-43dd-8892-42a624cd96c5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.060138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5db68f3f-e906-43dd-8892-42a624cd96c5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.061149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5db68f3f-e906-43dd-8892-42a624cd96c5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.147160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5db68f3f-e906-43dd-8892-42a624cd96c5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.156580 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5db68f3f-e906-43dd-8892-42a624cd96c5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1253 microversion: 2.1 time: 0.132352 Jul 20 04:18:09.158904 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1365/2644] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1253 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:09.165367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6091ea2f-01a4-440a-987e-de916a797c73 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.166205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6091ea2f-01a4-440a-987e-de916a797c73 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.174592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6091ea2f-01a4-440a-987e-de916a797c73 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.175477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6091ea2f-01a4-440a-987e-de916a797c73 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.177262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6091ea2f-01a4-440a-987e-de916a797c73 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.177936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6091ea2f-01a4-440a-987e-de916a797c73 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.293192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cf63fc41-79e2-4431-a8ea-1ddd80ece1ce tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.303832 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf63fc41-79e2-4431-a8ea-1ddd80ece1ce tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.261203 Jul 20 04:18:09.305375 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1280/2645] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:09.310348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-011b69fb-77f5-4979-8f56-499996d2f3c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.311212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-011b69fb-77f5-4979-8f56-499996d2f3c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.317967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-011b69fb-77f5-4979-8f56-499996d2f3c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.318788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-011b69fb-77f5-4979-8f56-499996d2f3c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.319844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-011b69fb-77f5-4979-8f56-499996d2f3c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.320503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-011b69fb-77f5-4979-8f56-499996d2f3c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.360403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6091ea2f-01a4-440a-987e-de916a797c73 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.384658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6091ea2f-01a4-440a-987e-de916a797c73 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.400510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6091ea2f-01a4-440a-987e-de916a797c73 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.413475 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6091ea2f-01a4-440a-987e-de916a797c73 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da" status: 200 len: 1365 microversion: 2.47 time: 0.253258 Jul 20 04:18:09.423148 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1366/2646] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:09.431866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e1fee4d1-d483-4812-ad00-8d86751ec533 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.435581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e1fee4d1-d483-4812-ad00-8d86751ec533 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.453440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1fee4d1-d483-4812-ad00-8d86751ec533 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.454235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1fee4d1-d483-4812-ad00-8d86751ec533 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.455938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1fee4d1-d483-4812-ad00-8d86751ec533 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.458321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1fee4d1-d483-4812-ad00-8d86751ec533 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.474310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-011b69fb-77f5-4979-8f56-499996d2f3c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.480621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-011b69fb-77f5-4979-8f56-499996d2f3c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.482920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-011b69fb-77f5-4979-8f56-499996d2f3c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.484241 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-011b69fb-77f5-4979-8f56-499996d2f3c9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.177586 Jul 20 04:18:09.495303 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1281/2647] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:09.507755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ed6d975-2ec9-4cea-8f68-ec1211190bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.508444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ed6d975-2ec9-4cea-8f68-ec1211190bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.516551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ed6d975-2ec9-4cea-8f68-ec1211190bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.517038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ed6d975-2ec9-4cea-8f68-ec1211190bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.517853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ed6d975-2ec9-4cea-8f68-ec1211190bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.518363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ed6d975-2ec9-4cea-8f68-ec1211190bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.796702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5ed6d975-2ec9-4cea-8f68-ec1211190bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.810639 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ed6d975-2ec9-4cea-8f68-ec1211190bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1318 microversion: 2.1 time: 0.314078 Jul 20 04:18:09.819867 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1282/2648] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:09.826526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1965267e-8471-4ac1-a221-cce512611c47 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:09.828119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1965267e-8471-4ac1-a221-cce512611c47 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:09.836198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e1fee4d1-d483-4812-ad00-8d86751ec533 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.839115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1965267e-8471-4ac1-a221-cce512611c47 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.839509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1965267e-8471-4ac1-a221-cce512611c47 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.840782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1965267e-8471-4ac1-a221-cce512611c47 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:09.841694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1965267e-8471-4ac1-a221-cce512611c47 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:09.850560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e1fee4d1-d483-4812-ad00-8d86751ec533 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.854017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e1fee4d1-d483-4812-ad00-8d86751ec533 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.855866 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e1fee4d1-d483-4812-ad00-8d86751ec533 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.431323 Jul 20 04:18:09.856954 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1367/2649] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:09.932017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1965267e-8471-4ac1-a221-cce512611c47 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.945624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1965267e-8471-4ac1-a221-cce512611c47 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.947516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1965267e-8471-4ac1-a221-cce512611c47 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:09.948824 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1965267e-8471-4ac1-a221-cce512611c47 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.130406 Jul 20 04:18:09.949608 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1283/2650] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:09 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:10.038106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-948950db-1447-455f-97ce-f7d2e349b5a5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.038774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-948950db-1447-455f-97ce-f7d2e349b5a5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.054902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-948950db-1447-455f-97ce-f7d2e349b5a5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.055478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-948950db-1447-455f-97ce-f7d2e349b5a5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.058615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-948950db-1447-455f-97ce-f7d2e349b5a5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.064305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-948950db-1447-455f-97ce-f7d2e349b5a5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.175805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.177378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.191655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.197376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.199320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.200908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.251436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.251436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.251860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lazy-loading 'fault' on Instance uuid 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:10.261819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-948950db-1447-455f-97ce-f7d2e349b5a5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.274786 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-948950db-1447-455f-97ce-f7d2e349b5a5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1367 microversion: 2.1 time: 0.241199 Jul 20 04:18:10.275381 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1368/2651] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:10.305058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4374208f84014632b8a3451b6997b8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd536e3aeba614601973cd64fbe3ee196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.312691 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-abaaf9dd-fb7c-4815-a542-aa7d13397f6d tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 200 len: 1258 microversion: 2.1 time: 0.141250 Jul 20 04:18:10.322507 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1284/2652] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:10.322715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1037193c-56f4-4a3d-9ab6-45d6da6ea8cc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.323640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1037193c-56f4-4a3d-9ab6-45d6da6ea8cc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.334187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1037193c-56f4-4a3d-9ab6-45d6da6ea8cc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.334814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1037193c-56f4-4a3d-9ab6-45d6da6ea8cc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.335746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1037193c-56f4-4a3d-9ab6-45d6da6ea8cc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.336308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1037193c-56f4-4a3d-9ab6-45d6da6ea8cc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.407337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=5 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:10.444709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-00d1a5c8-8a16-4d05-941b-fbe0b27284c9 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.445335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-00d1a5c8-8a16-4d05-941b-fbe0b27284c9 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.452305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00d1a5c8-8a16-4d05-941b-fbe0b27284c9 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.452524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00d1a5c8-8a16-4d05-941b-fbe0b27284c9 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.453170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00d1a5c8-8a16-4d05-941b-fbe0b27284c9 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.453610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00d1a5c8-8a16-4d05-941b-fbe0b27284c9 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.539937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-00d1a5c8-8a16-4d05-941b-fbe0b27284c9 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.549892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-00d1a5c8-8a16-4d05-941b-fbe0b27284c9 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.553974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-00d1a5c8-8a16-4d05-941b-fbe0b27284c9 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2206121222c14ac687771c2e710d92e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3578e315af5d4bdaa40141ec17b58d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.555828 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-00d1a5c8-8a16-4d05-941b-fbe0b27284c9 tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da" status: 200 len: 1365 microversion: 2.47 time: 0.115215 Jul 20 04:18:10.568815 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1285/2653] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da => generated 1365 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:10.577687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1b215e0d-fe25-4a2f-9d4e-c110de59e939 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.578350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1b215e0d-fe25-4a2f-9d4e-c110de59e939 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.584576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1037193c-56f4-4a3d-9ab6-45d6da6ea8cc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.585055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b215e0d-fe25-4a2f-9d4e-c110de59e939 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.585168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b215e0d-fe25-4a2f-9d4e-c110de59e939 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.586440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b215e0d-fe25-4a2f-9d4e-c110de59e939 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.586753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b215e0d-fe25-4a2f-9d4e-c110de59e939 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.604487 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1037193c-56f4-4a3d-9ab6-45d6da6ea8cc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.287023 Jul 20 04:18:10.625023 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1369/2654] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:10.703902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1b215e0d-fe25-4a2f-9d4e-c110de59e939 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.714546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1b215e0d-fe25-4a2f-9d4e-c110de59e939 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.716812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1b215e0d-fe25-4a2f-9d4e-c110de59e939 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:10.718302 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1b215e0d-fe25-4a2f-9d4e-c110de59e939 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.146679 Jul 20 04:18:10.719270 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1286/2655] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:10.828865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-69007b73-5aa5-4ab6-b950-3a495b9b5413 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.830288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-69007b73-5aa5-4ab6-b950-3a495b9b5413 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.850120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69007b73-5aa5-4ab6-b950-3a495b9b5413 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.850623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69007b73-5aa5-4ab6-b950-3a495b9b5413 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.852100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69007b73-5aa5-4ab6-b950-3a495b9b5413 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.856811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69007b73-5aa5-4ab6-b950-3a495b9b5413 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.876223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-563719ca-699f-42c8-9d34-143671a912a4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:10.876857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-563719ca-699f-42c8-9d34-143671a912a4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:10.886350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-563719ca-699f-42c8-9d34-143671a912a4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.886350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-563719ca-699f-42c8-9d34-143671a912a4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:10.886996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-563719ca-699f-42c8-9d34-143671a912a4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:10.887459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-563719ca-699f-42c8-9d34-143671a912a4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.090293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-563719ca-699f-42c8-9d34-143671a912a4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.103950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-563719ca-699f-42c8-9d34-143671a912a4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.105521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-563719ca-699f-42c8-9d34-143671a912a4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.106798 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-563719ca-699f-42c8-9d34-143671a912a4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.236058 Jul 20 04:18:11.107816 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1287/2656] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:11.135518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-778a7b59-b8ec-496a-8209-8df2a62fb977 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.136273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-778a7b59-b8ec-496a-8209-8df2a62fb977 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.148534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:11.150100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-778a7b59-b8ec-496a-8209-8df2a62fb977 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.150624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-778a7b59-b8ec-496a-8209-8df2a62fb977 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.151567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-778a7b59-b8ec-496a-8209-8df2a62fb977 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.152007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-778a7b59-b8ec-496a-8209-8df2a62fb977 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.237184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-69007b73-5aa5-4ab6-b950-3a495b9b5413 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.249586 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-69007b73-5aa5-4ab6-b950-3a495b9b5413 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1507 microversion: 2.1 time: 0.425826 Jul 20 04:18:11.261937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-778a7b59-b8ec-496a-8209-8df2a62fb977 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.264399 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1370/2657] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:10 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1507 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:11.271151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9ae6f0e-43ab-4252-af49-1c20b2389c69 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.272112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9ae6f0e-43ab-4252-af49-1c20b2389c69 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.277103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-778a7b59-b8ec-496a-8209-8df2a62fb977 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.279171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-778a7b59-b8ec-496a-8209-8df2a62fb977 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.280354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9ae6f0e-43ab-4252-af49-1c20b2389c69 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.280929 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-778a7b59-b8ec-496a-8209-8df2a62fb977 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.172165 Jul 20 04:18:11.281184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9ae6f0e-43ab-4252-af49-1c20b2389c69 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.294286 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1288/2658] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:11.299557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9ae6f0e-43ab-4252-af49-1c20b2389c69 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.299716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4299bd72-4b7e-42b7-ab62-7205f78327e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.300115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4299bd72-4b7e-42b7-ab62-7205f78327e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.300517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9ae6f0e-43ab-4252-af49-1c20b2389c69 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.311340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4299bd72-4b7e-42b7-ab62-7205f78327e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.311886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4299bd72-4b7e-42b7-ab62-7205f78327e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.312691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4299bd72-4b7e-42b7-ab62-7205f78327e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.313189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4299bd72-4b7e-42b7-ab62-7205f78327e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.529390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4299bd72-4b7e-42b7-ab62-7205f78327e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.544883 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4299bd72-4b7e-42b7-ab62-7205f78327e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1367 microversion: 2.1 time: 0.251898 Jul 20 04:18:11.546449 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1289/2659] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:11.552693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-524de216-6818-41d1-a77a-38432012d904 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.554382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-524de216-6818-41d1-a77a-38432012d904 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] [instance: 7c2d80d9-de8c-4fce-852f-3c7d1947dca0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.561443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-524de216-6818-41d1-a77a-38432012d904 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.562470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-524de216-6818-41d1-a77a-38432012d904 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.564193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-524de216-6818-41d1-a77a-38432012d904 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.564904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-524de216-6818-41d1-a77a-38432012d904 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.604173 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-524de216-6818-41d1-a77a-38432012d904 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] HTTP exception thrown: Instance 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 could not be found. Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-524de216-6818-41d1-a77a-38432012d904 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Request method failure captured: Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 HTTP/1.1 Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Fht2xQPyeHPd0-BY55vSyMaydRZ86pGyeTOhP49VmU2cw9ld2VFq94SqxW8BPYLrkOSxWn8HwFYgVy9iI3Q0YhUAogkVnz0SG_mwE65wGXLwi6qLX2AfBMoJaCQIJwn_ku4SOOJNxcQ29e8bEgiHiNuncNJeFaecCnaqDCiilf9cc Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d536e3aeba614601973cd64fbe3ee196 Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestBootFromVolume-1484227067 Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d536e3aeba614601973cd64fbe3ee196"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d536e3aeba614601973cd64fbe3ee196"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d536e3aeba614601973cd64fbe3ee196"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d536e3aeba614601973cd64fbe3ee196"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestBootFromVolume-1484227067 Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d536e3aeba614601973cd64fbe3ee196 Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1484227067 Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestBootFromVolume-1484227067-project Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4374208f84014632b8a3451b6997b8e9 Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestBootFromVolume-1484227067-project Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 could not be found. Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7c2d80d9-de8c-4fce-852f-3c7d1947dca0'} Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 could not be found. Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 could not be found. Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:11.608012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:11.612796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:11.612796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:11.612796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:11.612796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:11.612796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:11.612796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 could not be found. Jul 20 04:18:11.612796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:11.612796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-524de216-6818-41d1-a77a-38432012d904 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Returning 404 to user: Instance 7c2d80d9-de8c-4fce-852f-3c7d1947dca0 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:11.621575 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-524de216-6818-41d1-a77a-38432012d904 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0" status: 404 len: 111 microversion: 2.1 time: 0.067367 Jul 20 04:18:11.621575 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1290/2660] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/7c2d80d9-de8c-4fce-852f-3c7d1947dca0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:11.630206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-79e0be8a-0fbf-4f7d-8987-fe68048143fe tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.643761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-79e0be8a-0fbf-4f7d-8987-fe68048143fe tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] [instance: cfc85b7f-9d97-4a9b-a2ec-24381eff76da] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.658833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79e0be8a-0fbf-4f7d-8987-fe68048143fe tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.659312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79e0be8a-0fbf-4f7d-8987-fe68048143fe tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.660687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79e0be8a-0fbf-4f7d-8987-fe68048143fe tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.661319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79e0be8a-0fbf-4f7d-8987-fe68048143fe tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.684905 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-79e0be8a-0fbf-4f7d-8987-fe68048143fe tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] HTTP exception thrown: Instance cfc85b7f-9d97-4a9b-a2ec-24381eff76da could not be found. Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-79e0be8a-0fbf-4f7d-8987-fe68048143fe tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Request method failure captured: Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da HTTP/1.1 Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14H0ZWNW-QuiswA4ZoGjwgdw4Ej-vRZOPIlqnr4mGo3fJJ1CBZ2uVXkcd1CicLDKwQ2Q_KJXfNy9BzmuC3tT5OynewYdadbWj8jJnd6GD0j6yy-11FndS7zl113Bf2i9BrO4Tb45PyS-Mv5_X481W7PL1dMijhUe_LM2ta7W43GUhWA Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 3578e315af5d4bdaa40141ec17b58d5c Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersAaction247Test-944348105 Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3578e315af5d4bdaa40141ec17b58d5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3578e315af5d4bdaa40141ec17b58d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3578e315af5d4bdaa40141ec17b58d5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3578e315af5d4bdaa40141ec17b58d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersAaction247Test-944348105 Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 3578e315af5d4bdaa40141ec17b58d5c Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersAaction247Test-944348105 Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersAaction247Test-944348105-project Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2206121222c14ac687771c2e710d92e1 Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersAaction247Test-944348105-project Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance cfc85b7f-9d97-4a9b-a2ec-24381eff76da could not be found. Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'cfc85b7f-9d97-4a9b-a2ec-24381eff76da'} Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc85b7f-9d97-4a9b-a2ec-24381eff76da could not be found. Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc85b7f-9d97-4a9b-a2ec-24381eff76da could not be found. Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:11.686959 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:11.690818 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:11.690818 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:11.690818 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:11.690818 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:11.690818 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:11.690818 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc85b7f-9d97-4a9b-a2ec-24381eff76da could not be found. Jul 20 04:18:11.690818 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:11.690818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-79e0be8a-0fbf-4f7d-8987-fe68048143fe tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] Returning 404 to user: Instance cfc85b7f-9d97-4a9b-a2ec-24381eff76da could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:11.690818 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-79e0be8a-0fbf-4f7d-8987-fe68048143fe tempest-ServersAaction247Test-944348105 tempest-ServersAaction247Test-944348105-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da" status: 404 len: 111 microversion: 2.47 time: 0.063848 Jul 20 04:18:11.692226 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1291/2661] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/cfc85b7f-9d97-4a9b-a2ec-24381eff76da => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:11.699708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-95702b01-dcf0-4644-b1a4-dceef6b2f1f5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] Calling method '.version_select at 0x7fb841b079d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.728239 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-95702b01-dcf0-4644-b1a4-dceef6b2f1f5 tempest-ServersTestBootFromVolume-1484227067 tempest-ServersTestBootFromVolume-1484227067-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573247158" status: 202 len: 0 microversion: 2.1 time: 0.034718 Jul 20 04:18:11.729700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9ae6f0e-43ab-4252-af49-1c20b2389c69 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.745552 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9ae6f0e-43ab-4252-af49-1c20b2389c69 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1507 microversion: 2.1 time: 0.479773 Jul 20 04:18:11.752276 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1292/2662] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573247158 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:11.760053 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1371/2663] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:11.773534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d720be4f-b00f-4a85-9e20-3d7d0bc1c60c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.774181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d720be4f-b00f-4a85-9e20-3d7d0bc1c60c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.789411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4212fa43-2e56-450f-98f4-801c7cfae0bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.790026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4212fa43-2e56-450f-98f4-801c7cfae0bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.790793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d720be4f-b00f-4a85-9e20-3d7d0bc1c60c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.791258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d720be4f-b00f-4a85-9e20-3d7d0bc1c60c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.793713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d720be4f-b00f-4a85-9e20-3d7d0bc1c60c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.794603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d720be4f-b00f-4a85-9e20-3d7d0bc1c60c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.830375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4212fa43-2e56-450f-98f4-801c7cfae0bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.834502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4212fa43-2e56-450f-98f4-801c7cfae0bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.835592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4212fa43-2e56-450f-98f4-801c7cfae0bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.836064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4212fa43-2e56-450f-98f4-801c7cfae0bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.956928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d720be4f-b00f-4a85-9e20-3d7d0bc1c60c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.970096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d720be4f-b00f-4a85-9e20-3d7d0bc1c60c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.972605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d720be4f-b00f-4a85-9e20-3d7d0bc1c60c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:11.975483 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d720be4f-b00f-4a85-9e20-3d7d0bc1c60c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.213551 Jul 20 04:18:11.986966 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1372/2664] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:11.995826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:11.998555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:12.021375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.021876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.024025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.024486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.186136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4212fa43-2e56-450f-98f4-801c7cfae0bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.195989 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4212fa43-2e56-450f-98f4-801c7cfae0bb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.442509 Jul 20 04:18:12.198468 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1293/2665] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:12.200130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:12.200577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:12.201990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:12.201990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:12.202310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:12.206559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80687b4c-abc4-4914-8d7a-2e04e922aa9a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:12.209122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-80687b4c-abc4-4914-8d7a-2e04e922aa9a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:12.215594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:12.218467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80687b4c-abc4-4914-8d7a-2e04e922aa9a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.219142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80687b4c-abc4-4914-8d7a-2e04e922aa9a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.220961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80687b4c-abc4-4914-8d7a-2e04e922aa9a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.221659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80687b4c-abc4-4914-8d7a-2e04e922aa9a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.250271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=18 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:12.284725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:12.351505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:12.371741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.376233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.377366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.381153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.539998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=24 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:12.557219 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-499b3022-5333-44ba-b72d-dc0b2045d9ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "POST /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8/action" status: 202 len: 1109 microversion: 2.1 time: 0.566618 Jul 20 04:18:12.557887 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1373/2666] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:11 2022] POST /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8/action => generated 1109 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:18:12.587086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d8f9b098-411e-41f3-b946-f08e4ca1101e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:12.587721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d8f9b098-411e-41f3-b946-f08e4ca1101e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:12.608937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-80687b4c-abc4-4914-8d7a-2e04e922aa9a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.617641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8f9b098-411e-41f3-b946-f08e4ca1101e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.620975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8f9b098-411e-41f3-b946-f08e4ca1101e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.625228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-80687b4c-abc4-4914-8d7a-2e04e922aa9a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.625672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8f9b098-411e-41f3-b946-f08e4ca1101e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.626347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8f9b098-411e-41f3-b946-f08e4ca1101e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.629727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-80687b4c-abc4-4914-8d7a-2e04e922aa9a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.631335 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-80687b4c-abc4-4914-8d7a-2e04e922aa9a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.430986 Jul 20 04:18:12.644119 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1294/2667] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:12 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:12.654551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c35942c-7ea6-4fc9-882f-b5777c82aca1 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:12.658984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c35942c-7ea6-4fc9-882f-b5777c82aca1 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:12.686571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c35942c-7ea6-4fc9-882f-b5777c82aca1 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.690244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c35942c-7ea6-4fc9-882f-b5777c82aca1 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.691355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c35942c-7ea6-4fc9-882f-b5777c82aca1 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.693861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c35942c-7ea6-4fc9-882f-b5777c82aca1 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.904684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8f9b098-411e-41f3-b946-f08e4ca1101e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.920427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8f9b098-411e-41f3-b946-f08e4ca1101e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.931249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8f9b098-411e-41f3-b946-f08e4ca1101e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.932663 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d8f9b098-411e-41f3-b946-f08e4ca1101e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.355927 Jul 20 04:18:12.943170 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1374/2668] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:12 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:12.947139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dad377f0-cbe0-4ae7-9df8-ba7e29104661 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:12.953377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dad377f0-cbe0-4ae7-9df8-ba7e29104661 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:12.964767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dad377f0-cbe0-4ae7-9df8-ba7e29104661 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.969836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dad377f0-cbe0-4ae7-9df8-ba7e29104661 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.981035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dad377f0-cbe0-4ae7-9df8-ba7e29104661 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.981663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dad377f0-cbe0-4ae7-9df8-ba7e29104661 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.048148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6c35942c-7ea6-4fc9-882f-b5777c82aca1 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.061778 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6c35942c-7ea6-4fc9-882f-b5777c82aca1 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1367 microversion: 2.1 time: 0.415874 Jul 20 04:18:13.072351 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1295/2669] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:12 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:13.077949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b49b80a0-248b-4be1-8a46-67eac9454a33 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.078935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b49b80a0-248b-4be1-8a46-67eac9454a33 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.086650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b49b80a0-248b-4be1-8a46-67eac9454a33 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.087363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b49b80a0-248b-4be1-8a46-67eac9454a33 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.088426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b49b80a0-248b-4be1-8a46-67eac9454a33 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.089137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b49b80a0-248b-4be1-8a46-67eac9454a33 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.300734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b49b80a0-248b-4be1-8a46-67eac9454a33 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.305348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:13.314118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b49b80a0-248b-4be1-8a46-67eac9454a33 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.317478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b49b80a0-248b-4be1-8a46-67eac9454a33 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.319135 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b49b80a0-248b-4be1-8a46-67eac9454a33 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.245357 Jul 20 04:18:13.321013 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1296/2670] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:13.325861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-096a5818-5652-49f2-a214-14e938c265ae tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.326692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-096a5818-5652-49f2-a214-14e938c265ae tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.340145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-096a5818-5652-49f2-a214-14e938c265ae tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.340896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-096a5818-5652-49f2-a214-14e938c265ae tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.341881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-096a5818-5652-49f2-a214-14e938c265ae tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.342644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-096a5818-5652-49f2-a214-14e938c265ae tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.426554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dad377f0-cbe0-4ae7-9df8-ba7e29104661 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.437312 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dad377f0-cbe0-4ae7-9df8-ba7e29104661 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.502288 Jul 20 04:18:13.447605 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1375/2671] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:12 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:13.605145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-096a5818-5652-49f2-a214-14e938c265ae tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.620022 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-096a5818-5652-49f2-a214-14e938c265ae tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.297688 Jul 20 04:18:13.620639 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1297/2672] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:13.655171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-09f879b4-5131-42f5-9800-c485dd191f59 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.655810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-09f879b4-5131-42f5-9800-c485dd191f59 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.668986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09f879b4-5131-42f5-9800-c485dd191f59 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.669839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09f879b4-5131-42f5-9800-c485dd191f59 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.671326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09f879b4-5131-42f5-9800-c485dd191f59 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.672384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09f879b4-5131-42f5-9800-c485dd191f59 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.956864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d1b26708-04d0-4ce3-9ed9-1c0fc9d0fb62 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.958045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d1b26708-04d0-4ce3-9ed9-1c0fc9d0fb62 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.962002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09f879b4-5131-42f5-9800-c485dd191f59 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.975501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09f879b4-5131-42f5-9800-c485dd191f59 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.978129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09f879b4-5131-42f5-9800-c485dd191f59 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.979661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1b26708-04d0-4ce3-9ed9-1c0fc9d0fb62 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.981014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1b26708-04d0-4ce3-9ed9-1c0fc9d0fb62 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.982884 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-09f879b4-5131-42f5-9800-c485dd191f59 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.333368 Jul 20 04:18:13.985666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1b26708-04d0-4ce3-9ed9-1c0fc9d0fb62 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.986516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1b26708-04d0-4ce3-9ed9-1c0fc9d0fb62 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.995118 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1376/2673] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:14.080995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-660b3a85-e622-48e9-903d-dfe9d7b5b0a0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.081784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-660b3a85-e622-48e9-903d-dfe9d7b5b0a0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.093019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-660b3a85-e622-48e9-903d-dfe9d7b5b0a0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.093649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-660b3a85-e622-48e9-903d-dfe9d7b5b0a0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.095243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-660b3a85-e622-48e9-903d-dfe9d7b5b0a0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.096652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-660b3a85-e622-48e9-903d-dfe9d7b5b0a0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.288507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d1b26708-04d0-4ce3-9ed9-1c0fc9d0fb62 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.312001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d1b26708-04d0-4ce3-9ed9-1c0fc9d0fb62 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.317348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d1b26708-04d0-4ce3-9ed9-1c0fc9d0fb62 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.319018 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d1b26708-04d0-4ce3-9ed9-1c0fc9d0fb62 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.369796 Jul 20 04:18:14.322470 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1298/2674] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:14.339460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-65c41356-9cfd-42a4-8260-39d735e691c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.340372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-65c41356-9cfd-42a4-8260-39d735e691c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.351371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65c41356-9cfd-42a4-8260-39d735e691c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.352666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65c41356-9cfd-42a4-8260-39d735e691c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.353669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65c41356-9cfd-42a4-8260-39d735e691c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.354303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65c41356-9cfd-42a4-8260-39d735e691c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.430850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-660b3a85-e622-48e9-903d-dfe9d7b5b0a0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.444569 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-660b3a85-e622-48e9-903d-dfe9d7b5b0a0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1367 microversion: 2.1 time: 0.368242 Jul 20 04:18:14.448489 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1377/2675] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:14.473907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8db56a7d-0cf0-474c-9b4d-942d98364110 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.474730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8db56a7d-0cf0-474c-9b4d-942d98364110 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.498599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8db56a7d-0cf0-474c-9b4d-942d98364110 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.499037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8db56a7d-0cf0-474c-9b4d-942d98364110 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.499848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8db56a7d-0cf0-474c-9b4d-942d98364110 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.500366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8db56a7d-0cf0-474c-9b4d-942d98364110 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.651583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-65c41356-9cfd-42a4-8260-39d735e691c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.673475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-65c41356-9cfd-42a4-8260-39d735e691c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.678146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-65c41356-9cfd-42a4-8260-39d735e691c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.682772 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-65c41356-9cfd-42a4-8260-39d735e691c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.348427 Jul 20 04:18:14.685041 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1299/2676] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:14.702945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-193bfc3f-283b-44dc-9d6b-46a38de256ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.704139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-193bfc3f-283b-44dc-9d6b-46a38de256ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.725103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-193bfc3f-283b-44dc-9d6b-46a38de256ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.726283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-193bfc3f-283b-44dc-9d6b-46a38de256ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.729575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-193bfc3f-283b-44dc-9d6b-46a38de256ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.733095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-193bfc3f-283b-44dc-9d6b-46a38de256ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.838168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8db56a7d-0cf0-474c-9b4d-942d98364110 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.853271 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8db56a7d-0cf0-474c-9b4d-942d98364110 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.399123 Jul 20 04:18:14.853878 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1378/2677] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:14.871982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-897286b6-9c69-4e39-80f5-9394fa9fbe5b req-dbc9351b-ada3-4689-a2f6-9cd5e89a91d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea899275-fe75-439a-aec1-824f5cf75382", "name": "network-vif-plugged", "status": "completed", "tag": "eda254b3-c753-4cfe-bbf6-f11de433af64"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:14.893478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-897286b6-9c69-4e39-80f5-9394fa9fbe5b req-dbc9351b-ada3-4689-a2f6-9cd5e89a91d4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.894013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-897286b6-9c69-4e39-80f5-9394fa9fbe5b req-dbc9351b-ada3-4689-a2f6-9cd5e89a91d4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.932943 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-897286b6-9c69-4e39-80f5-9394fa9fbe5b req-dbc9351b-ada3-4689-a2f6-9cd5e89a91d4 service nova] Creating event network-vif-plugged:eda254b3-c753-4cfe-bbf6-f11de433af64 for instance ea899275-fe75-439a-aec1-824f5cf75382 on n-h1-760456-11 Jul 20 04:18:14.938123 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-897286b6-9c69-4e39-80f5-9394fa9fbe5b req-dbc9351b-ada3-4689-a2f6-9cd5e89a91d4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073699 Jul 20 04:18:14.938803 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1379/2678] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:15.006914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94531187-a6b0-4571-87dc-cb488d3111ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.007632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-94531187-a6b0-4571-87dc-cb488d3111ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.043641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94531187-a6b0-4571-87dc-cb488d3111ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.044162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94531187-a6b0-4571-87dc-cb488d3111ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.044971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94531187-a6b0-4571-87dc-cb488d3111ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.045420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94531187-a6b0-4571-87dc-cb488d3111ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.400540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-193bfc3f-283b-44dc-9d6b-46a38de256ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.402506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-94531187-a6b0-4571-87dc-cb488d3111ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.413528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-94531187-a6b0-4571-87dc-cb488d3111ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.414611 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-193bfc3f-283b-44dc-9d6b-46a38de256ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.728149 Jul 20 04:18:15.417219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-94531187-a6b0-4571-87dc-cb488d3111ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.418623 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94531187-a6b0-4571-87dc-cb488d3111ef tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.418593 Jul 20 04:18:15.426630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1300/2679] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:15.431895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a52c0c95-1ce1-49a7-9883-c88f5931b615 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.444944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a52c0c95-1ce1-49a7-9883-c88f5931b615 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.445351 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1380/2680] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:15.455659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a52c0c95-1ce1-49a7-9883-c88f5931b615 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.458028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a52c0c95-1ce1-49a7-9883-c88f5931b615 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.461232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a52c0c95-1ce1-49a7-9883-c88f5931b615 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.461974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a52c0c95-1ce1-49a7-9883-c88f5931b615 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.467452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-228035b6-19f5-445f-9342-31c3475dfbd7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.468085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-228035b6-19f5-445f-9342-31c3475dfbd7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.479968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-228035b6-19f5-445f-9342-31c3475dfbd7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.480421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-228035b6-19f5-445f-9342-31c3475dfbd7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.487202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-228035b6-19f5-445f-9342-31c3475dfbd7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.487925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-228035b6-19f5-445f-9342-31c3475dfbd7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.657705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a52c0c95-1ce1-49a7-9883-c88f5931b615 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.674117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a52c0c95-1ce1-49a7-9883-c88f5931b615 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.681096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a52c0c95-1ce1-49a7-9883-c88f5931b615 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.684733 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a52c0c95-1ce1-49a7-9883-c88f5931b615 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.255168 Jul 20 04:18:15.687672 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1301/2681] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:15.702193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6aba2183-72fb-48e6-a8d8-7759806b467c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.702884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6aba2183-72fb-48e6-a8d8-7759806b467c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.717148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6aba2183-72fb-48e6-a8d8-7759806b467c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.717603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6aba2183-72fb-48e6-a8d8-7759806b467c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.718414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6aba2183-72fb-48e6-a8d8-7759806b467c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.720870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6aba2183-72fb-48e6-a8d8-7759806b467c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.958672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6aba2183-72fb-48e6-a8d8-7759806b467c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.983775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6aba2183-72fb-48e6-a8d8-7759806b467c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.994158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6aba2183-72fb-48e6-a8d8-7759806b467c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.001438 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6aba2183-72fb-48e6-a8d8-7759806b467c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.303485 Jul 20 04:18:16.005208 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1302/2682] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:16.020622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cead3d69-d9d9-49c2-9df1-6086a3c5b93c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.021900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cead3d69-d9d9-49c2-9df1-6086a3c5b93c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:16.036555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cead3d69-d9d9-49c2-9df1-6086a3c5b93c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.040781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cead3d69-d9d9-49c2-9df1-6086a3c5b93c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.044897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cead3d69-d9d9-49c2-9df1-6086a3c5b93c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.046006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cead3d69-d9d9-49c2-9df1-6086a3c5b93c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.065856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-228035b6-19f5-445f-9342-31c3475dfbd7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.087874 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-228035b6-19f5-445f-9342-31c3475dfbd7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1367 microversion: 2.1 time: 0.615743 Jul 20 04:18:16.092403 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1381/2683] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1367 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:16.434584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-988e2260-c4db-4751-9028-aa4892106076 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.435223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-988e2260-c4db-4751-9028-aa4892106076 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:16.445404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-988e2260-c4db-4751-9028-aa4892106076 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.445878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-988e2260-c4db-4751-9028-aa4892106076 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.446727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-988e2260-c4db-4751-9028-aa4892106076 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.447181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-988e2260-c4db-4751-9028-aa4892106076 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.507234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cead3d69-d9d9-49c2-9df1-6086a3c5b93c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.517966 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cead3d69-d9d9-49c2-9df1-6086a3c5b93c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.510976 Jul 20 04:18:16.520377 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1303/2684] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:16.534320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5a3b73da-63bc-4c78-a867-3d4690fef90c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.535020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5a3b73da-63bc-4c78-a867-3d4690fef90c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:16.556228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a3b73da-63bc-4c78-a867-3d4690fef90c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.556689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a3b73da-63bc-4c78-a867-3d4690fef90c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.557486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a3b73da-63bc-4c78-a867-3d4690fef90c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.557933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a3b73da-63bc-4c78-a867-3d4690fef90c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.740460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-988e2260-c4db-4751-9028-aa4892106076 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.749408 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-988e2260-c4db-4751-9028-aa4892106076 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.319677 Jul 20 04:18:16.758071 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1382/2685] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:16.777141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e40366f8-7340-4298-9b38-15363c7df41b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.778016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e40366f8-7340-4298-9b38-15363c7df41b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:16.786011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e40366f8-7340-4298-9b38-15363c7df41b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.787031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e40366f8-7340-4298-9b38-15363c7df41b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.788076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e40366f8-7340-4298-9b38-15363c7df41b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.789003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e40366f8-7340-4298-9b38-15363c7df41b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.959884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e40366f8-7340-4298-9b38-15363c7df41b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.985707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e40366f8-7340-4298-9b38-15363c7df41b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.993707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e40366f8-7340-4298-9b38-15363c7df41b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.000848 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e40366f8-7340-4298-9b38-15363c7df41b tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.239584 Jul 20 04:18:17.007154 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1383/2686] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:17.021239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-0c29ac46-72ad-422c-99e5-b8d6c73ea384 req-c2a6c320-9311-429d-a190-e97ba8022d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a486b5-316e-4426-972b-71b474a08ec1", "name": "network-vif-unplugged", "status": "completed", "tag": "b20cde1f-e1ac-4d80-81e4-5833da356db0"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:17.041675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0c29ac46-72ad-422c-99e5-b8d6c73ea384 req-c2a6c320-9311-429d-a190-e97ba8022d7e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.041942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0c29ac46-72ad-422c-99e5-b8d6c73ea384 req-c2a6c320-9311-429d-a190-e97ba8022d7e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.080507 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-0c29ac46-72ad-422c-99e5-b8d6c73ea384 req-c2a6c320-9311-429d-a190-e97ba8022d7e service nova] Creating event network-vif-unplugged:b20cde1f-e1ac-4d80-81e4-5833da356db0 for instance d7a486b5-316e-4426-972b-71b474a08ec1 on n-h1-760456-11 Jul 20 04:18:17.098876 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-0c29ac46-72ad-422c-99e5-b8d6c73ea384 req-c2a6c320-9311-429d-a190-e97ba8022d7e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087675 Jul 20 04:18:17.112431 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1384/2687] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:17.143046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac05d335-84a9-4dec-934a-cf2a1faadf6b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:17.144230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac05d335-84a9-4dec-934a-cf2a1faadf6b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:17.152757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac05d335-84a9-4dec-934a-cf2a1faadf6b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.153437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac05d335-84a9-4dec-934a-cf2a1faadf6b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.158320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac05d335-84a9-4dec-934a-cf2a1faadf6b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.159007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac05d335-84a9-4dec-934a-cf2a1faadf6b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.368134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ac05d335-84a9-4dec-934a-cf2a1faadf6b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.384741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ac05d335-84a9-4dec-934a-cf2a1faadf6b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.400832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ac05d335-84a9-4dec-934a-cf2a1faadf6b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.413167 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac05d335-84a9-4dec-934a-cf2a1faadf6b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.286662 Jul 20 04:18:17.414514 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1385/2688] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:17 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:17.428709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-eeeeb90b-5cdb-4880-82c3-2cd28eaf0d8d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:17.431524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-eeeeb90b-5cdb-4880-82c3-2cd28eaf0d8d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:17.463542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eeeeb90b-5cdb-4880-82c3-2cd28eaf0d8d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.465978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eeeeb90b-5cdb-4880-82c3-2cd28eaf0d8d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.467011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eeeeb90b-5cdb-4880-82c3-2cd28eaf0d8d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.469964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eeeeb90b-5cdb-4880-82c3-2cd28eaf0d8d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.982670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a3b73da-63bc-4c78-a867-3d4690fef90c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.021602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a3b73da-63bc-4c78-a867-3d4690fef90c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.035666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a3b73da-63bc-4c78-a867-3d4690fef90c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.045277 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5a3b73da-63bc-4c78-a867-3d4690fef90c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 1.517271 Jul 20 04:18:18.061120 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1304/2689] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:18.084057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d22ee419-b2bb-4ed2-99df-85fbaed026b1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.086449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d22ee419-b2bb-4ed2-99df-85fbaed026b1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.133957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22ee419-b2bb-4ed2-99df-85fbaed026b1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.135314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22ee419-b2bb-4ed2-99df-85fbaed026b1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.137914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22ee419-b2bb-4ed2-99df-85fbaed026b1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.139552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22ee419-b2bb-4ed2-99df-85fbaed026b1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.280969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eeeeb90b-5cdb-4880-82c3-2cd28eaf0d8d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.297285 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-eeeeb90b-5cdb-4880-82c3-2cd28eaf0d8d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1558 microversion: 2.1 time: 0.881167 Jul 20 04:18:18.311330 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1386/2690] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:17 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1558 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:18.319401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b1a48f6-405f-41a6-95ed-1e7c57854c35 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.327291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3b1a48f6-405f-41a6-95ed-1e7c57854c35 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.340445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b1a48f6-405f-41a6-95ed-1e7c57854c35 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.342201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b1a48f6-405f-41a6-95ed-1e7c57854c35 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.344614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b1a48f6-405f-41a6-95ed-1e7c57854c35 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.345490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b1a48f6-405f-41a6-95ed-1e7c57854c35 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.874427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3b1a48f6-405f-41a6-95ed-1e7c57854c35 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.915797 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b1a48f6-405f-41a6-95ed-1e7c57854c35 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 0.590167 Jul 20 04:18:18.921439 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1387/2691] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:18.940542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bae64b8b-4798-449b-8c00-12ecaff1fec6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.941813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bae64b8b-4798-449b-8c00-12ecaff1fec6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.961963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bae64b8b-4798-449b-8c00-12ecaff1fec6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.970536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bae64b8b-4798-449b-8c00-12ecaff1fec6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.971890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bae64b8b-4798-449b-8c00-12ecaff1fec6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.973798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bae64b8b-4798-449b-8c00-12ecaff1fec6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.173001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d22ee419-b2bb-4ed2-99df-85fbaed026b1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.188580 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d22ee419-b2bb-4ed2-99df-85fbaed026b1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 1.131378 Jul 20 04:18:19.189726 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1305/2692] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:19.208856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b4d8613-4bce-4fbb-812e-0ac49970bfb5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.209710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b4d8613-4bce-4fbb-812e-0ac49970bfb5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.223342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b4d8613-4bce-4fbb-812e-0ac49970bfb5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.228130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b4d8613-4bce-4fbb-812e-0ac49970bfb5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.238016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b4d8613-4bce-4fbb-812e-0ac49970bfb5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.238792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b4d8613-4bce-4fbb-812e-0ac49970bfb5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.427383 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b4d8613-4bce-4fbb-812e-0ac49970bfb5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.236266 Jul 20 04:18:19.428253 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1306/2693] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-interface => generated 285 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:19.431364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bae64b8b-4798-449b-8c00-12ecaff1fec6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.435020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd44f696-626a-4c03-b0d4-af75947f1393 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.435894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd44f696-626a-4c03-b0d4-af75947f1393 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.451494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bae64b8b-4798-449b-8c00-12ecaff1fec6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.464780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bae64b8b-4798-449b-8c00-12ecaff1fec6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.468181 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bae64b8b-4798-449b-8c00-12ecaff1fec6 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.542588 Jul 20 04:18:19.468848 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1388/2694] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:19.484245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a16af014-d9e6-49e7-8d56-4cc3a03e0236 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.484962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd44f696-626a-4c03-b0d4-af75947f1393 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.487750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd44f696-626a-4c03-b0d4-af75947f1393 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.489874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a16af014-d9e6-49e7-8d56-4cc3a03e0236 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.495225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd44f696-626a-4c03-b0d4-af75947f1393 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.499725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd44f696-626a-4c03-b0d4-af75947f1393 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.524101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a16af014-d9e6-49e7-8d56-4cc3a03e0236 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.524708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a16af014-d9e6-49e7-8d56-4cc3a03e0236 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.525578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a16af014-d9e6-49e7-8d56-4cc3a03e0236 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.526039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a16af014-d9e6-49e7-8d56-4cc3a03e0236 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.255995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd44f696-626a-4c03-b0d4-af75947f1393 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.280127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd44f696-626a-4c03-b0d4-af75947f1393 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.281658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd44f696-626a-4c03-b0d4-af75947f1393 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.295545 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd44f696-626a-4c03-b0d4-af75947f1393 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.865798 Jul 20 04:18:20.297772 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1307/2695] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:20.317551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-50b03ad0-5394-4c6c-8d00-36c47f70dbe2 req-45f41a35-a33c-40aa-a087-b7e77bdd9cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a486b5-316e-4426-972b-71b474a08ec1", "tag": "b20cde1f-e1ac-4d80-81e4-5833da356db0"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:20.357597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-50b03ad0-5394-4c6c-8d00-36c47f70dbe2 req-45f41a35-a33c-40aa-a087-b7e77bdd9cee service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.361053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-50b03ad0-5394-4c6c-8d00-36c47f70dbe2 req-45f41a35-a33c-40aa-a087-b7e77bdd9cee service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.406353 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-50b03ad0-5394-4c6c-8d00-36c47f70dbe2 req-45f41a35-a33c-40aa-a087-b7e77bdd9cee service nova] Creating event network-changed:b20cde1f-e1ac-4d80-81e4-5833da356db0 for instance d7a486b5-316e-4426-972b-71b474a08ec1 on n-h1-760456-11 Jul 20 04:18:20.428331 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-50b03ad0-5394-4c6c-8d00-36c47f70dbe2 req-45f41a35-a33c-40aa-a087-b7e77bdd9cee service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122671 Jul 20 04:18:20.438149 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1308/2696] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:20.444801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2b52d599-7142-4f44-ae9c-ecb3e19671e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.475322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2b52d599-7142-4f44-ae9c-ecb3e19671e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.502325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b52d599-7142-4f44-ae9c-ecb3e19671e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.511971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b52d599-7142-4f44-ae9c-ecb3e19671e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.515638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b52d599-7142-4f44-ae9c-ecb3e19671e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.518829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b52d599-7142-4f44-ae9c-ecb3e19671e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.912954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a16af014-d9e6-49e7-8d56-4cc3a03e0236 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.932083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a16af014-d9e6-49e7-8d56-4cc3a03e0236 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.933568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a16af014-d9e6-49e7-8d56-4cc3a03e0236 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.934854 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a16af014-d9e6-49e7-8d56-4cc3a03e0236 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 1.463527 Jul 20 04:18:20.935441 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1389/2697] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:20.981849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c2571878-2941-4ef5-ae8f-8245cf161d8e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.990765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c2571878-2941-4ef5-ae8f-8245cf161d8e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:21.022424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2571878-2941-4ef5-ae8f-8245cf161d8e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.028081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2571878-2941-4ef5-ae8f-8245cf161d8e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.043594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2571878-2941-4ef5-ae8f-8245cf161d8e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.044063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2571878-2941-4ef5-ae8f-8245cf161d8e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.776264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2b52d599-7142-4f44-ae9c-ecb3e19671e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.792066 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2b52d599-7142-4f44-ae9c-ecb3e19671e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1525 microversion: 2.1 time: 1.351927 Jul 20 04:18:21.796599 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1309/2698] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1525 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:21.811037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2baa5da0-9790-4687-b6bb-a33ec724365e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:21.814049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2baa5da0-9790-4687-b6bb-a33ec724365e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:21.831108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2baa5da0-9790-4687-b6bb-a33ec724365e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.832164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2baa5da0-9790-4687-b6bb-a33ec724365e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.833351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2baa5da0-9790-4687-b6bb-a33ec724365e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.839360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2baa5da0-9790-4687-b6bb-a33ec724365e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.250054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2baa5da0-9790-4687-b6bb-a33ec724365e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.280413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2baa5da0-9790-4687-b6bb-a33ec724365e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.288509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2baa5da0-9790-4687-b6bb-a33ec724365e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.289827 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2baa5da0-9790-4687-b6bb-a33ec724365e tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.490917 Jul 20 04:18:22.290558 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1310/2699] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:21 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:22.301786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e7576ce2-debf-49ca-84e6-dba6a8dcf74d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.315246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e7576ce2-debf-49ca-84e6-dba6a8dcf74d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.338069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7576ce2-debf-49ca-84e6-dba6a8dcf74d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.340073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7576ce2-debf-49ca-84e6-dba6a8dcf74d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.343470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7576ce2-debf-49ca-84e6-dba6a8dcf74d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.344167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7576ce2-debf-49ca-84e6-dba6a8dcf74d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.693528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7576ce2-debf-49ca-84e6-dba6a8dcf74d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.708226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7576ce2-debf-49ca-84e6-dba6a8dcf74d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.711823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7576ce2-debf-49ca-84e6-dba6a8dcf74d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.714375 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e7576ce2-debf-49ca-84e6-dba6a8dcf74d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.416738 Jul 20 04:18:22.717241 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1311/2700] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:22.732302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-063be46e-0f45-4428-a188-18b9d05d2c7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.732988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-063be46e-0f45-4428-a188-18b9d05d2c7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.750804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063be46e-0f45-4428-a188-18b9d05d2c7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.751401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063be46e-0f45-4428-a188-18b9d05d2c7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.755856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063be46e-0f45-4428-a188-18b9d05d2c7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.756454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063be46e-0f45-4428-a188-18b9d05d2c7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.066010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c2571878-2941-4ef5-ae8f-8245cf161d8e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.069630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:23.084469 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c2571878-2941-4ef5-ae8f-8245cf161d8e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 2.109846 Jul 20 04:18:23.087079 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1390/2701] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:23.100710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0ca18a2f-8066-4c41-b432-fe7d26701e22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.109425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0ca18a2f-8066-4c41-b432-fe7d26701e22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.132212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ca18a2f-8066-4c41-b432-fe7d26701e22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.138725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ca18a2f-8066-4c41-b432-fe7d26701e22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.141770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ca18a2f-8066-4c41-b432-fe7d26701e22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.144984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ca18a2f-8066-4c41-b432-fe7d26701e22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.582723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-063be46e-0f45-4428-a188-18b9d05d2c7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.591671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-063be46e-0f45-4428-a188-18b9d05d2c7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.593194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-063be46e-0f45-4428-a188-18b9d05d2c7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.594425 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-063be46e-0f45-4428-a188-18b9d05d2c7c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.874962 Jul 20 04:18:23.608641 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1312/2702] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:23.614637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9ff479cc-f401-42fb-802c-6a616206baf4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.615266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9ff479cc-f401-42fb-802c-6a616206baf4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.629818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ff479cc-f401-42fb-802c-6a616206baf4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.630286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ff479cc-f401-42fb-802c-6a616206baf4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.631080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ff479cc-f401-42fb-802c-6a616206baf4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.635739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ff479cc-f401-42fb-802c-6a616206baf4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.851983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0ca18a2f-8066-4c41-b432-fe7d26701e22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.863950 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0ca18a2f-8066-4c41-b432-fe7d26701e22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1507 microversion: 2.1 time: 0.772531 Jul 20 04:18:23.872865 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1391/2703] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1507 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:23.879214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be6fd13a-8410-467f-8984-940c809a639c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.881412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-be6fd13a-8410-467f-8984-940c809a639c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.897075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be6fd13a-8410-467f-8984-940c809a639c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.903466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be6fd13a-8410-467f-8984-940c809a639c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.904557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be6fd13a-8410-467f-8984-940c809a639c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.905230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be6fd13a-8410-467f-8984-940c809a639c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.912549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9ff479cc-f401-42fb-802c-6a616206baf4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.921986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9ff479cc-f401-42fb-802c-6a616206baf4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.924329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9ff479cc-f401-42fb-802c-6a616206baf4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.927403 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9ff479cc-f401-42fb-802c-6a616206baf4 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.316237 Jul 20 04:18:23.928219 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1313/2704] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:24.018297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-be6fd13a-8410-467f-8984-940c809a639c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.034151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-be6fd13a-8410-467f-8984-940c809a639c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.036286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-be6fd13a-8410-467f-8984-940c809a639c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.037716 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-be6fd13a-8410-467f-8984-940c809a639c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.163522 Jul 20 04:18:24.041957 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1392/2705] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:24.103634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-616f1918-8498-4f90-8914-b42ba9441cab tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.104580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-616f1918-8498-4f90-8914-b42ba9441cab tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.122939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-616f1918-8498-4f90-8914-b42ba9441cab tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.123894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-616f1918-8498-4f90-8914-b42ba9441cab tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.124924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-616f1918-8498-4f90-8914-b42ba9441cab tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.125577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-616f1918-8498-4f90-8914-b42ba9441cab tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.193696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:24.482531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-616f1918-8498-4f90-8914-b42ba9441cab tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.497389 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-616f1918-8498-4f90-8914-b42ba9441cab tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.396728 Jul 20 04:18:24.502838 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1314/2706] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:24.511253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-d14d707b-cdbb-4f34-b574-5750a4482694 req-6f98c693-cb33-46a7-b5ff-a8e54703bcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea899275-fe75-439a-aec1-824f5cf75382", "tag": "eda254b3-c753-4cfe-bbf6-f11de433af64"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:24.529679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d14d707b-cdbb-4f34-b574-5750a4482694 req-6f98c693-cb33-46a7-b5ff-a8e54703bcf7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.532215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d14d707b-cdbb-4f34-b574-5750a4482694 req-6f98c693-cb33-46a7-b5ff-a8e54703bcf7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.570399 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-d14d707b-cdbb-4f34-b574-5750a4482694 req-6f98c693-cb33-46a7-b5ff-a8e54703bcf7 service nova] Creating event network-changed:eda254b3-c753-4cfe-bbf6-f11de433af64 for instance ea899275-fe75-439a-aec1-824f5cf75382 on n-h1-760456-11 Jul 20 04:18:24.589678 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-d14d707b-cdbb-4f34-b574-5750a4482694 req-6f98c693-cb33-46a7-b5ff-a8e54703bcf7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082114 Jul 20 04:18:24.592548 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1393/2707] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:24.628360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9f7a886-8c13-4c85-98eb-3fd17fb76d9f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.629091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c9f7a886-8c13-4c85-98eb-3fd17fb76d9f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.647184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9f7a886-8c13-4c85-98eb-3fd17fb76d9f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.648359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9f7a886-8c13-4c85-98eb-3fd17fb76d9f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.649392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9f7a886-8c13-4c85-98eb-3fd17fb76d9f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.650053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9f7a886-8c13-4c85-98eb-3fd17fb76d9f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.861979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9f7a886-8c13-4c85-98eb-3fd17fb76d9f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.876044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9f7a886-8c13-4c85-98eb-3fd17fb76d9f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.877616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9f7a886-8c13-4c85-98eb-3fd17fb76d9f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.879303 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c9f7a886-8c13-4c85-98eb-3fd17fb76d9f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.256775 Jul 20 04:18:24.883011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a63bcbb6-c7d5-463a-9b1c-e9bf77b3ce03 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.883775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a63bcbb6-c7d5-463a-9b1c-e9bf77b3ce03 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.891527 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1315/2708] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:24.894709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a63bcbb6-c7d5-463a-9b1c-e9bf77b3ce03 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.907062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a63bcbb6-c7d5-463a-9b1c-e9bf77b3ce03 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.908151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a63bcbb6-c7d5-463a-9b1c-e9bf77b3ce03 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.908621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a63bcbb6-c7d5-463a-9b1c-e9bf77b3ce03 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.947419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fd78e65b-8a97-47f3-8f4f-ea556e16469c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.947899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fd78e65b-8a97-47f3-8f4f-ea556e16469c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.968449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd78e65b-8a97-47f3-8f4f-ea556e16469c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.972018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd78e65b-8a97-47f3-8f4f-ea556e16469c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.981389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd78e65b-8a97-47f3-8f4f-ea556e16469c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.982090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd78e65b-8a97-47f3-8f4f-ea556e16469c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.219861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a63bcbb6-c7d5-463a-9b1c-e9bf77b3ce03 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.229852 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a63bcbb6-c7d5-463a-9b1c-e9bf77b3ce03 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1507 microversion: 2.1 time: 0.352505 Jul 20 04:18:25.230730 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1394/2709] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:25.240026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b0cbb720-eefb-424c-baf6-bf5ffddf8aa1 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.240897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b0cbb720-eefb-424c-baf6-bf5ffddf8aa1 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:25.252555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0cbb720-eefb-424c-baf6-bf5ffddf8aa1 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.253686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0cbb720-eefb-424c-baf6-bf5ffddf8aa1 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.258506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0cbb720-eefb-424c-baf6-bf5ffddf8aa1 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.259139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0cbb720-eefb-424c-baf6-bf5ffddf8aa1 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.259819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fd78e65b-8a97-47f3-8f4f-ea556e16469c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.280354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fd78e65b-8a97-47f3-8f4f-ea556e16469c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.286519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fd78e65b-8a97-47f3-8f4f-ea556e16469c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.287868 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fd78e65b-8a97-47f3-8f4f-ea556e16469c tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1604 microversion: 2.42 time: 0.344422 Jul 20 04:18:25.294544 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1316/2710] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1604 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:25.378484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0cbb720-eefb-424c-baf6-bf5ffddf8aa1 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.391826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0cbb720-eefb-424c-baf6-bf5ffddf8aa1 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.393713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0cbb720-eefb-424c-baf6-bf5ffddf8aa1 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.403189 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b0cbb720-eefb-424c-baf6-bf5ffddf8aa1 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.171231 Jul 20 04:18:25.404355 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1395/2711] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:25 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:25.422145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-0d9bd20b-cce5-4eb4-b12b-ac55104a0c83 req-a6e9933d-82a5-4b73-ad3c-87ec0139b6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021c9592-bd4c-4506-8422-4ff0c8e2f141", "name": "network-vif-unplugged", "status": "completed", "tag": "4da41aa3-a22e-4da5-ad9b-4f4e3bfea0bc"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:25.443496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-0d9bd20b-cce5-4eb4-b12b-ac55104a0c83 req-a6e9933d-82a5-4b73-ad3c-87ec0139b6bc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.446092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-0d9bd20b-cce5-4eb4-b12b-ac55104a0c83 req-a6e9933d-82a5-4b73-ad3c-87ec0139b6bc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.475607 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-0d9bd20b-cce5-4eb4-b12b-ac55104a0c83 req-a6e9933d-82a5-4b73-ad3c-87ec0139b6bc service nova] Creating event network-vif-unplugged:4da41aa3-a22e-4da5-ad9b-4f4e3bfea0bc for instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 on n-h2-760456-11 Jul 20 04:18:25.486199 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-0d9bd20b-cce5-4eb4-b12b-ac55104a0c83 req-a6e9933d-82a5-4b73-ad3c-87ec0139b6bc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068722 Jul 20 04:18:25.489888 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1317/2712] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:25.522652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08dfdea0-cd32-4d90-973e-5714ccff5111 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.523938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-08dfdea0-cd32-4d90-973e-5714ccff5111 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:25.538469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08dfdea0-cd32-4d90-973e-5714ccff5111 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.539203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08dfdea0-cd32-4d90-973e-5714ccff5111 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.541281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08dfdea0-cd32-4d90-973e-5714ccff5111 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.544370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08dfdea0-cd32-4d90-973e-5714ccff5111 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.899618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-86559574-a323-4341-8358-8d3855f48026 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.900333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-86559574-a323-4341-8358-8d3855f48026 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:25.916141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86559574-a323-4341-8358-8d3855f48026 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.916663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86559574-a323-4341-8358-8d3855f48026 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.919757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86559574-a323-4341-8358-8d3855f48026 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.920254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86559574-a323-4341-8358-8d3855f48026 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.073821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-08dfdea0-cd32-4d90-973e-5714ccff5111 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.082741 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08dfdea0-cd32-4d90-973e-5714ccff5111 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.566518 Jul 20 04:18:26.087013 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1396/2713] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:25 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:26.253494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1d1052b4-1e9d-46a6-8810-72f01808e21a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.256380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1d1052b4-1e9d-46a6-8810-72f01808e21a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.271849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d1052b4-1e9d-46a6-8810-72f01808e21a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.275244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d1052b4-1e9d-46a6-8810-72f01808e21a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.279207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d1052b4-1e9d-46a6-8810-72f01808e21a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.279705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d1052b4-1e9d-46a6-8810-72f01808e21a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.613376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d1052b4-1e9d-46a6-8810-72f01808e21a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.627173 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1d1052b4-1e9d-46a6-8810-72f01808e21a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 200 len: 1510 microversion: 2.1 time: 0.382332 Jul 20 04:18:26.629343 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1397/2714] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:26.635710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.636672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.652499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.654165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.658804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.661154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.726653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-86559574-a323-4341-8358-8d3855f48026 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.732088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.732908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.733854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lazy-loading 'fault' on Instance uuid 27ee62c2-a702-438e-ae91-9f1bf6846f1b {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:26.735101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-86559574-a323-4341-8358-8d3855f48026 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.736567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-86559574-a323-4341-8358-8d3855f48026 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.746386 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-86559574-a323-4341-8358-8d3855f48026 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.843165 Jul 20 04:18:26.747070 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1318/2715] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:25 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:26.756152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-18841ecc-3ed3-4df5-845e-2d98230eced9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.756783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-18841ecc-3ed3-4df5-845e-2d98230eced9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.774202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18841ecc-3ed3-4df5-845e-2d98230eced9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.774727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18841ecc-3ed3-4df5-845e-2d98230eced9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.775477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18841ecc-3ed3-4df5-845e-2d98230eced9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.775933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18841ecc-3ed3-4df5-845e-2d98230eced9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.790085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.800761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.804279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ea3ed970c1348aa922dda7fb3edf866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c19ef6ed5b4e27947af6ce219d18d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.806312 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6af38b0f-4634-44ee-8f35-970db72efc58 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 200 len: 1609 microversion: 2.42 time: 0.175315 Jul 20 04:18:26.821030 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1398/2716] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 1609 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:26.827671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.828829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.839472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.839883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.841210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.842770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.891308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:26.900965 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.compute.api [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Working on deleting snapshot 5759f1a4-b2ad-4ba1-a67e-0ed978443ce6 from shelved instance... Jul 20 04:18:27.031521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-18841ecc-3ed3-4df5-845e-2d98230eced9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.047069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-18841ecc-3ed3-4df5-845e-2d98230eced9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.048599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-18841ecc-3ed3-4df5-845e-2d98230eced9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.066838 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-18841ecc-3ed3-4df5-845e-2d98230eced9 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.317967 Jul 20 04:18:27.076121 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1319/2717] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:27.104386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8aa5413-bf3f-4ad2-9443-c8d3e4cbb6d3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.105259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c8aa5413-bf3f-4ad2-9443-c8d3e4cbb6d3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.122549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8aa5413-bf3f-4ad2-9443-c8d3e4cbb6d3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.122938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8aa5413-bf3f-4ad2-9443-c8d3e4cbb6d3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.123943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8aa5413-bf3f-4ad2-9443-c8d3e4cbb6d3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.124402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8aa5413-bf3f-4ad2-9443-c8d3e4cbb6d3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.530997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c8aa5413-bf3f-4ad2-9443-c8d3e4cbb6d3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.548797 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c8aa5413-bf3f-4ad2-9443-c8d3e4cbb6d3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.448158 Jul 20 04:18:27.551825 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1320/2718] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:27.557787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ba1a3e4f-b039-4f62-8129-35c1a6b53923 req-ccdf7fef-f4ef-44e3-b3ab-a90e905402c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a486b5-316e-4426-972b-71b474a08ec1", "name": "network-vif-unplugged", "status": "completed", "tag": "b20cde1f-e1ac-4d80-81e4-5833da356db0"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:27.577671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ba1a3e4f-b039-4f62-8129-35c1a6b53923 req-ccdf7fef-f4ef-44e3-b3ab-a90e905402c6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.578924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ba1a3e4f-b039-4f62-8129-35c1a6b53923 req-ccdf7fef-f4ef-44e3-b3ab-a90e905402c6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.611347 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ba1a3e4f-b039-4f62-8129-35c1a6b53923 req-ccdf7fef-f4ef-44e3-b3ab-a90e905402c6 service nova] Creating event network-vif-unplugged:b20cde1f-e1ac-4d80-81e4-5833da356db0 for instance d7a486b5-316e-4426-972b-71b474a08ec1 on n-h1-760456-11 Jul 20 04:18:27.618968 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ba1a3e4f-b039-4f62-8129-35c1a6b53923 req-ccdf7fef-f4ef-44e3-b3ab-a90e905402c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065240 Jul 20 04:18:27.623968 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1321/2719] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:27.767320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d619ec0e-9a55-4488-b92a-a1f8826afbb7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.768217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d619ec0e-9a55-4488-b92a-a1f8826afbb7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.779626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d619ec0e-9a55-4488-b92a-a1f8826afbb7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.783469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d619ec0e-9a55-4488-b92a-a1f8826afbb7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.786554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d619ec0e-9a55-4488-b92a-a1f8826afbb7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.788808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d619ec0e-9a55-4488-b92a-a1f8826afbb7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.079098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Doing local delete in cell 0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) {{(pid=119606) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 04:18:28.080565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.081209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.083931 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.compute.api [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 04:18:28.092874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] deallocate_for_instance() {{(pid=119606) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 04:18:28.348171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d619ec0e-9a55-4488-b92a-a1f8826afbb7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.365971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d619ec0e-9a55-4488-b92a-a1f8826afbb7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.371184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d619ec0e-9a55-4488-b92a-a1f8826afbb7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.377341 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d619ec0e-9a55-4488-b92a-a1f8826afbb7 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.615566 Jul 20 04:18:28.392646 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1322/2720] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:28.405486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e1341408-e6fa-4c0e-92b0-0bbb1549562d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.408063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e1341408-e6fa-4c0e-92b0-0bbb1549562d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.423672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1341408-e6fa-4c0e-92b0-0bbb1549562d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.425740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1341408-e6fa-4c0e-92b0-0bbb1549562d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.432488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1341408-e6fa-4c0e-92b0-0bbb1549562d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.433292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1341408-e6fa-4c0e-92b0-0bbb1549562d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.465739 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-e1341408-e6fa-4c0e-92b0-0bbb1549562d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] HTTP exception thrown: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e1341408-e6fa-4c0e-92b0-0bbb1549562d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Request method failure captured: Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b HTTP/1.1 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14BsDqJ-MJiUio37b0uZ8GFq1ShXgYOFtSxmXEFEYgcDRG1m8sNMrAKRXMwtIqBcmyVWHAOYvH1k-v2W6rqdQ6QRsHlshVSVBHNPYfTf3dGjcnGfhJzepzEmYt39PltIXS_URAjdEZXagxzOScbY4g1yHTASVaZ8DgOCfXc-AXh-XQ4 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 29c19ef6ed5b4e27947af6ce219d18d5 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1719754799 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1719754799 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 29c19ef6ed5b4e27947af6ce219d18d5 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1719754799 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TaggedBootDevicesTest_v242-1719754799-project Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2ea3ed970c1348aa922dda7fb3edf866 Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1719754799-project Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '27ee62c2-a702-438e-ae91-9f1bf6846f1b'} Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:28.468813 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:28.473647 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:28.473647 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:28.473647 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:28.473647 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:28.473647 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:28.473647 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:28.473647 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:28.473647 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:28.473647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e1341408-e6fa-4c0e-92b0-0bbb1549562d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Returning 404 to user: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:28.475366 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e1341408-e6fa-4c0e-92b0-0bbb1549562d tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 404 len: 111 microversion: 2.42 time: 0.081261 Jul 20 04:18:28.476806 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1323/2721] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:28.490904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-76d5110b-88e7-4ab6-87c2-1bcb50c995ac tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.493717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-76d5110b-88e7-4ab6-87c2-1bcb50c995ac tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.505949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76d5110b-88e7-4ab6-87c2-1bcb50c995ac tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.506447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76d5110b-88e7-4ab6-87c2-1bcb50c995ac tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.507243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76d5110b-88e7-4ab6-87c2-1bcb50c995ac tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.507694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76d5110b-88e7-4ab6-87c2-1bcb50c995ac tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.780019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-76d5110b-88e7-4ab6-87c2-1bcb50c995ac tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.799369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-76d5110b-88e7-4ab6-87c2-1bcb50c995ac tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.802014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-76d5110b-88e7-4ab6-87c2-1bcb50c995ac tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.803268 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-76d5110b-88e7-4ab6-87c2-1bcb50c995ac tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.325491 Jul 20 04:18:28.807028 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1324/2722] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:28.821902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d92ab597-5459-4a8e-90e6-c8b50740947a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '.version_select at 0x7fb8414c2a60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.864722 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d92ab597-5459-4a8e-90e6-c8b50740947a tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403283623" status: 204 len: 0 microversion: 2.42 time: 0.056173 Jul 20 04:18:28.865931 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1325/2723] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:18:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1403283623 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:28.873863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48df1e00-bd9a-4e0e-ad98-4dce899ae78b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.874809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-48df1e00-bd9a-4e0e-ad98-4dce899ae78b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.888558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48df1e00-bd9a-4e0e-ad98-4dce899ae78b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.889391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48df1e00-bd9a-4e0e-ad98-4dce899ae78b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.890462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48df1e00-bd9a-4e0e-ad98-4dce899ae78b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.891128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48df1e00-bd9a-4e0e-ad98-4dce899ae78b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.446457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-48df1e00-bd9a-4e0e-ad98-4dce899ae78b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:29.458330 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48df1e00-bd9a-4e0e-ad98-4dce899ae78b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.590741 Jul 20 04:18:29.460029 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1326/2724] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:29.487415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca5bf5bb-c0d7-4c9a-8e76-47aa9378fdc6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:29.489416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ca5bf5bb-c0d7-4c9a-8e76-47aa9378fdc6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:29.501119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca5bf5bb-c0d7-4c9a-8e76-47aa9378fdc6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.508677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca5bf5bb-c0d7-4c9a-8e76-47aa9378fdc6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.509906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca5bf5bb-c0d7-4c9a-8e76-47aa9378fdc6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.510660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca5bf5bb-c0d7-4c9a-8e76-47aa9378fdc6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.747200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Updating instance_info_cache with network_info: [] {{(pid=119606) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:18:30.039141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ca5bf5bb-c0d7-4c9a-8e76-47aa9378fdc6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.067035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ca5bf5bb-c0d7-4c9a-8e76-47aa9378fdc6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.072553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ca5bf5bb-c0d7-4c9a-8e76-47aa9378fdc6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.075512 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ca5bf5bb-c0d7-4c9a-8e76-47aa9378fdc6 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.612407 Jul 20 04:18:30.076260 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1327/2725] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:29 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:30.094633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-dde523aa-6fb8-4a2c-bb00-6032209c8427 req-a364407a-3b58-4e10-ae04-39090489f830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021c9592-bd4c-4506-8422-4ff0c8e2f141", "name": "network-vif-deleted", "tag": "4da41aa3-a22e-4da5-ad9b-4f4e3bfea0bc"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:30.108419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-dde523aa-6fb8-4a2c-bb00-6032209c8427 req-a364407a-3b58-4e10-ae04-39090489f830 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.109785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-dde523aa-6fb8-4a2c-bb00-6032209c8427 req-a364407a-3b58-4e10-ae04-39090489f830 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.132615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.compute.server_external_events [req-dde523aa-6fb8-4a2c-bb00-6032209c8427 req-a364407a-3b58-4e10-ae04-39090489f830 service nova] Unable to find a host for instance 021c9592-bd4c-4506-8422-4ff0c8e2f141. Dropping event network-vif-deleted {{(pid=119605) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:18:30.133641 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-dde523aa-6fb8-4a2c-bb00-6032209c8427 req-a364407a-3b58-4e10-ae04-39090489f830 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.056298 Jul 20 04:18:30.139824 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1328/2726] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:18:30.176044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-869618b8-8ec4-492d-93cc-adc545c033ec tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.178343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-869618b8-8ec4-492d-93cc-adc545c033ec tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.204083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-869618b8-8ec4-492d-93cc-adc545c033ec tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.204523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-869618b8-8ec4-492d-93cc-adc545c033ec tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.210411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-869618b8-8ec4-492d-93cc-adc545c033ec tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.210930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-869618b8-8ec4-492d-93cc-adc545c033ec tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.447843 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0474708a-a961-41f9-94cd-528fe45142ef tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 204 len: 0 microversion: 2.1 time: 3.625421 Jul 20 04:18:30.454467 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1399/2727] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:26 2022] DELETE /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 0 bytes in 3633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:30.508411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-869618b8-8ec4-492d-93cc-adc545c033ec tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.518119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-869618b8-8ec4-492d-93cc-adc545c033ec tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.526452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-869618b8-8ec4-492d-93cc-adc545c033ec tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.528114 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-869618b8-8ec4-492d-93cc-adc545c033ec tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.387095 Jul 20 04:18:30.532172 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1329/2728] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:30.540145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75424f53-e889-4a35-bc07-b938f87a2b6d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.541048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-75424f53-e889-4a35-bc07-b938f87a2b6d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.561978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75424f53-e889-4a35-bc07-b938f87a2b6d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.564682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75424f53-e889-4a35-bc07-b938f87a2b6d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.567874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75424f53-e889-4a35-bc07-b938f87a2b6d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.570063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75424f53-e889-4a35-bc07-b938f87a2b6d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.601652 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-75424f53-e889-4a35-bc07-b938f87a2b6d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75424f53-e889-4a35-bc07-b938f87a2b6d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 HTTP/1.1 Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '021c9592-bd4c-4506-8422-4ff0c8e2f141'} Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:30.607418 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:30.611221 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:30.611221 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:30.611221 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:30.611221 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:30.611221 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:30.611221 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:18:30.611221 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:30.616651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75424f53-e889-4a35-bc07-b938f87a2b6d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:30.622369 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75424f53-e889-4a35-bc07-b938f87a2b6d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 404 len: 111 microversion: 2.1 time: 0.088719 Jul 20 04:18:30.623439 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1330/2729] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:30.629870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8a13ea67-1daf-4d20-913a-47cbbccd098c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.637427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8a13ea67-1daf-4d20-913a-47cbbccd098c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.657259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a13ea67-1daf-4d20-913a-47cbbccd098c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.657729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a13ea67-1daf-4d20-913a-47cbbccd098c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.658572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a13ea67-1daf-4d20-913a-47cbbccd098c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.659026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a13ea67-1daf-4d20-913a-47cbbccd098c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.703385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1986889118", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "6c35a84c-1662-419e-85db-9a28329eb82c"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:30.830174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] validate_networks() for [('6c35a84c-1662-419e-85db-9a28329eb82c', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:31.064917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8a13ea67-1daf-4d20-913a-47cbbccd098c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:31.077165 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8a13ea67-1daf-4d20-913a-47cbbccd098c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.452035 Jul 20 04:18:31.079309 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1331/2730] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:31.107393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1169318508", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "191d678e-1adc-40c3-b7b1-1a7cb20ca675"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:31.191711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] validate_networks() for [('191d678e-1adc-40c3-b7b1-1a7cb20ca675', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:31.805608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:31.806017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:31.806779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:31.811016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:31.811385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:31.829708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.830176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.831031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.832051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.886008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Getting quotas for project 2fea3071b7d644f0b3bde8406b2ff995. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:31.902016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Getting quotas for user c64b6d02ce1a450e8826d0b9b46e0551 and project 2fea3071b7d644f0b3bde8406b2ff995. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:31.952466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:31.961089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:32.105199 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-46ab6a20-cd72-4c80-bbd8-461c3610d602 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.646963 Jul 20 04:18:32.112257 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1400/2731] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:18:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:18:32.123078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ba9e67b-f1f0-4ab3-a238-1ee40e01dba5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.183054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ba9e67b-f1f0-4ab3-a238-1ee40e01dba5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.193134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:32.197483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ba9e67b-f1f0-4ab3-a238-1ee40e01dba5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.198623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ba9e67b-f1f0-4ab3-a238-1ee40e01dba5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.200389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ba9e67b-f1f0-4ab3-a238-1ee40e01dba5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.201015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ba9e67b-f1f0-4ab3-a238-1ee40e01dba5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.779227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ba9e67b-f1f0-4ab3-a238-1ee40e01dba5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.807451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ba9e67b-f1f0-4ab3-a238-1ee40e01dba5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.815055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ba9e67b-f1f0-4ab3-a238-1ee40e01dba5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.822565 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ba9e67b-f1f0-4ab3-a238-1ee40e01dba5 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1487 microversion: 2.25 time: 0.708512 Jul 20 04:18:32.838449 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1401/2732] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1487 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:32.866652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ad689989-cde0-4121-8275-8a47dbc51eb5 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.888166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ad689989-cde0-4121-8275-8a47dbc51eb5 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.908545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad689989-cde0-4121-8275-8a47dbc51eb5 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.909241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad689989-cde0-4121-8275-8a47dbc51eb5 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.910189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad689989-cde0-4121-8275-8a47dbc51eb5 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.910969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad689989-cde0-4121-8275-8a47dbc51eb5 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.960683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:33.106125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ad689989-cde0-4121-8275-8a47dbc51eb5 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.126948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ad689989-cde0-4121-8275-8a47dbc51eb5 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.126948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ad689989-cde0-4121-8275-8a47dbc51eb5 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.147004 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ad689989-cde0-4121-8275-8a47dbc51eb5 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.273370 Jul 20 04:18:33.149415 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1402/2733] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:33.167073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c25ee828-8932-4d41-8362-cb308d67481e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.168015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c25ee828-8932-4d41-8362-cb308d67481e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.186763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c25ee828-8932-4d41-8362-cb308d67481e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.187584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c25ee828-8932-4d41-8362-cb308d67481e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.190221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c25ee828-8932-4d41-8362-cb308d67481e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.191895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c25ee828-8932-4d41-8362-cb308d67481e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.549161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:33.549715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:33.550724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:33.551137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:33.551560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:33.565227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.565896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.566981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.567442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.615248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:33.621638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for user 9f053f31c02c412394d48ce65350d153 and project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:33.624288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:33.647784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:33.650906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:33.670564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c25ee828-8932-4d41-8362-cb308d67481e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.683823 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c25ee828-8932-4d41-8362-cb308d67481e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.532846 Jul 20 04:18:33.685987 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1403/2734] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:33.700090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8216e62d-1cef-4807-a6f5-52d211a67133 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.701238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8216e62d-1cef-4807-a6f5-52d211a67133 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.725466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8216e62d-1cef-4807-a6f5-52d211a67133 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.726160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8216e62d-1cef-4807-a6f5-52d211a67133 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.727415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8216e62d-1cef-4807-a6f5-52d211a67133 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.728235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8216e62d-1cef-4807-a6f5-52d211a67133 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.732441 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-46109768-37b6-4d3a-bd63-9138c7cd075e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.642116 Jul 20 04:18:33.746298 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1332/2735] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:33.759058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9f1443cd-cdec-48b0-8a11-3587423914eb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.759484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9f1443cd-cdec-48b0-8a11-3587423914eb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.855129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9f1443cd-cdec-48b0-8a11-3587423914eb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.864057 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9f1443cd-cdec-48b0-8a11-3587423914eb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1215 microversion: 2.1 time: 0.110868 Jul 20 04:18:33.867549 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1333/2736] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:33.882578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-25e61070-7177-4d03-b8f7-3e8fa8879b12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.886677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-25e61070-7177-4d03-b8f7-3e8fa8879b12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.905871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25e61070-7177-4d03-b8f7-3e8fa8879b12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.906791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25e61070-7177-4d03-b8f7-3e8fa8879b12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.908319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25e61070-7177-4d03-b8f7-3e8fa8879b12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.911032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25e61070-7177-4d03-b8f7-3e8fa8879b12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.921038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8216e62d-1cef-4807-a6f5-52d211a67133 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.935416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8216e62d-1cef-4807-a6f5-52d211a67133 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.936984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8216e62d-1cef-4807-a6f5-52d211a67133 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.938406 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8216e62d-1cef-4807-a6f5-52d211a67133 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1314 microversion: 2.26 time: 0.249767 Jul 20 04:18:33.938990 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1404/2737] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:34.169437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-68c643c2-581d-406d-bb47-e3b79e71ace3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.170468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-68c643c2-581d-406d-bb47-e3b79e71ace3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.212613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68c643c2-581d-406d-bb47-e3b79e71ace3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.220773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68c643c2-581d-406d-bb47-e3b79e71ace3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.246281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68c643c2-581d-406d-bb47-e3b79e71ace3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.246875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68c643c2-581d-406d-bb47-e3b79e71ace3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.463584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-25e61070-7177-4d03-b8f7-3e8fa8879b12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:34.478430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-25e61070-7177-4d03-b8f7-3e8fa8879b12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:34.483234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-25e61070-7177-4d03-b8f7-3e8fa8879b12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:34.485501 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-25e61070-7177-4d03-b8f7-3e8fa8879b12 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1477 microversion: 2.25 time: 0.616714 Jul 20 04:18:34.486112 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1334/2738] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1477 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:34.513553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a43074c6-cd98-4d8a-8043-f106f037267c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '.version_select at 0x7fb8414dc9d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.516750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a43074c6-cd98-4d8a-8043-f106f037267c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.517207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a43074c6-cd98-4d8a-8043-f106f037267c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.553526 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a43074c6-cd98-4d8a-8043-f106f037267c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.044873 Jul 20 04:18:34.555075 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1335/2739] 10.222.0.59 () {60 vars in 1183 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:34.567071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-001c89a2-9680-4da4-b6ba-a88e01a9088c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.567687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-001c89a2-9680-4da4-b6ba-a88e01a9088c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.579769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-001c89a2-9680-4da4-b6ba-a88e01a9088c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.580223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-001c89a2-9680-4da4-b6ba-a88e01a9088c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.581025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-001c89a2-9680-4da4-b6ba-a88e01a9088c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.582749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-001c89a2-9680-4da4-b6ba-a88e01a9088c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.814361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-001c89a2-9680-4da4-b6ba-a88e01a9088c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] Lazy-loading 'services' on Instance uuid d7a486b5-316e-4426-972b-71b474a08ec1 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:34.829814 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-001c89a2-9680-4da4-b6ba-a88e01a9088c tempest-LiveAutoBlockMigrationV225Test-571116631 tempest-LiveAutoBlockMigrationV225Test-571116631-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1972 microversion: 2.25 time: 0.266798 Jul 20 04:18:34.831208 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1336/2740] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1972 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:34.836527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-703978bb-0fe4-40d0-b0d3-0a06a78257f9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.837482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-703978bb-0fe4-40d0-b0d3-0a06a78257f9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.846072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-703978bb-0fe4-40d0-b0d3-0a06a78257f9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.847870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-703978bb-0fe4-40d0-b0d3-0a06a78257f9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.850155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-703978bb-0fe4-40d0-b0d3-0a06a78257f9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.850824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-703978bb-0fe4-40d0-b0d3-0a06a78257f9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.879054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:35.033812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-703978bb-0fe4-40d0-b0d3-0a06a78257f9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.039386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-68c643c2-581d-406d-bb47-e3b79e71ace3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.048091 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-703978bb-0fe4-40d0-b0d3-0a06a78257f9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.215344 Jul 20 04:18:35.049497 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1337/2741] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.053169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-68c643c2-581d-406d-bb47-e3b79e71ace3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.055058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-68c643c2-581d-406d-bb47-e3b79e71ace3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.055610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c96ed366-3605-452b-881f-08d6eaca70c0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.056309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c96ed366-3605-452b-881f-08d6eaca70c0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.058860 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-68c643c2-581d-406d-bb47-e3b79e71ace3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.896872 Jul 20 04:18:35.066611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c96ed366-3605-452b-881f-08d6eaca70c0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.067640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c96ed366-3605-452b-881f-08d6eaca70c0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.068883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c96ed366-3605-452b-881f-08d6eaca70c0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.069667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c96ed366-3605-452b-881f-08d6eaca70c0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.071090 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1405/2742] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:35.076668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c5f0ac62-dffa-48d2-8b0f-3fed97b5c388 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.077628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c5f0ac62-dffa-48d2-8b0f-3fed97b5c388 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.085075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5f0ac62-dffa-48d2-8b0f-3fed97b5c388 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.085860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5f0ac62-dffa-48d2-8b0f-3fed97b5c388 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.086815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5f0ac62-dffa-48d2-8b0f-3fed97b5c388 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.087436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5f0ac62-dffa-48d2-8b0f-3fed97b5c388 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.106879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c96ed366-3605-452b-881f-08d6eaca70c0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:35.208527 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c96ed366-3605-452b-881f-08d6eaca70c0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 204 len: 0 microversion: 2.25 time: 0.157367 Jul 20 04:18:35.212193 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1338/2743] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:18:35 2022] DELETE /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:35.215181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3a351bc-3d66-4006-90aa-24e84a24fb2c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.215897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e3a351bc-3d66-4006-90aa-24e84a24fb2c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.222987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3a351bc-3d66-4006-90aa-24e84a24fb2c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.223438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3a351bc-3d66-4006-90aa-24e84a24fb2c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.224219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3a351bc-3d66-4006-90aa-24e84a24fb2c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.224660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3a351bc-3d66-4006-90aa-24e84a24fb2c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.243656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5f0ac62-dffa-48d2-8b0f-3fed97b5c388 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.254902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c5f0ac62-dffa-48d2-8b0f-3fed97b5c388 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1267 microversion: 2.1 time: 0.181997 Jul 20 04:18:35.255859 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1406/2744] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.271977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc5d1089-09bc-4c07-ac82-7eded8ce18f4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.272616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc5d1089-09bc-4c07-ac82-7eded8ce18f4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.279681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc5d1089-09bc-4c07-ac82-7eded8ce18f4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.280149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc5d1089-09bc-4c07-ac82-7eded8ce18f4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.280942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc5d1089-09bc-4c07-ac82-7eded8ce18f4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.281389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc5d1089-09bc-4c07-ac82-7eded8ce18f4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.297927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3a351bc-3d66-4006-90aa-24e84a24fb2c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.310925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3a351bc-3d66-4006-90aa-24e84a24fb2c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.312458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3a351bc-3d66-4006-90aa-24e84a24fb2c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.313629 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e3a351bc-3d66-4006-90aa-24e84a24fb2c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1320 microversion: 2.26 time: 0.102757 Jul 20 04:18:35.319851 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1339/2745] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1320 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:35.751583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc5d1089-09bc-4c07-ac82-7eded8ce18f4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.761989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc5d1089-09bc-4c07-ac82-7eded8ce18f4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.763823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc5d1089-09bc-4c07-ac82-7eded8ce18f4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.765220 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc5d1089-09bc-4c07-ac82-7eded8ce18f4 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1483 microversion: 2.25 time: 0.508266 Jul 20 04:18:35.765790 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1407/2746] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1483 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:36.065189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-90eeaffb-3291-41ef-8a27-5d50f2f79239 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.066604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-90eeaffb-3291-41ef-8a27-5d50f2f79239 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.073936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90eeaffb-3291-41ef-8a27-5d50f2f79239 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.074890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90eeaffb-3291-41ef-8a27-5d50f2f79239 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.075862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90eeaffb-3291-41ef-8a27-5d50f2f79239 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.081700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-304a4441-f189-48fc-9ac0-656d6a85db54 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.082455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-304a4441-f189-48fc-9ac0-656d6a85db54 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.085629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90eeaffb-3291-41ef-8a27-5d50f2f79239 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.093394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-304a4441-f189-48fc-9ac0-656d6a85db54 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.094519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-304a4441-f189-48fc-9ac0-656d6a85db54 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.095776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-304a4441-f189-48fc-9ac0-656d6a85db54 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.096295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-304a4441-f189-48fc-9ac0-656d6a85db54 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.245698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-304a4441-f189-48fc-9ac0-656d6a85db54 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.262278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-304a4441-f189-48fc-9ac0-656d6a85db54 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.273132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-304a4441-f189-48fc-9ac0-656d6a85db54 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.275840 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-304a4441-f189-48fc-9ac0-656d6a85db54 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.197521 Jul 20 04:18:36.277046 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1408/2747] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:36.283022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9b11d577-ac13-4437-8b95-f990f68a6669 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.283936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9b11d577-ac13-4437-8b95-f990f68a6669 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.293851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b11d577-ac13-4437-8b95-f990f68a6669 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.294696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b11d577-ac13-4437-8b95-f990f68a6669 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.296306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b11d577-ac13-4437-8b95-f990f68a6669 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.297083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b11d577-ac13-4437-8b95-f990f68a6669 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.413899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9b11d577-ac13-4437-8b95-f990f68a6669 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.422472 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9b11d577-ac13-4437-8b95-f990f68a6669 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1273 microversion: 2.1 time: 0.143950 Jul 20 04:18:36.434403 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1409/2748] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:36.441994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7f2b9874-42f1-42d0-86ea-25771b591402 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.443079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7f2b9874-42f1-42d0-86ea-25771b591402 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.452020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f2b9874-42f1-42d0-86ea-25771b591402 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.453083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f2b9874-42f1-42d0-86ea-25771b591402 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.454781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f2b9874-42f1-42d0-86ea-25771b591402 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.457520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f2b9874-42f1-42d0-86ea-25771b591402 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.740215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-90eeaffb-3291-41ef-8a27-5d50f2f79239 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.773975 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-90eeaffb-3291-41ef-8a27-5d50f2f79239 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.712692 Jul 20 04:18:36.795957 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1340/2749] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:36.811232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7f2b9874-42f1-42d0-86ea-25771b591402 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.821499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f73dc67-673b-41a9-828b-dc20d9cf4555 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.822124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1f73dc67-673b-41a9-828b-dc20d9cf4555 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.826234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7f2b9874-42f1-42d0-86ea-25771b591402 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.829382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7f2b9874-42f1-42d0-86ea-25771b591402 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.832869 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7f2b9874-42f1-42d0-86ea-25771b591402 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1362 microversion: 2.26 time: 0.394729 Jul 20 04:18:36.838167 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1410/2750] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:36.851056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f73dc67-673b-41a9-828b-dc20d9cf4555 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.851604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f73dc67-673b-41a9-828b-dc20d9cf4555 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.853481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f73dc67-673b-41a9-828b-dc20d9cf4555 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.854552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f73dc67-673b-41a9-828b-dc20d9cf4555 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.273913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f73dc67-673b-41a9-828b-dc20d9cf4555 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.286527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f73dc67-673b-41a9-828b-dc20d9cf4555 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.288334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f73dc67-673b-41a9-828b-dc20d9cf4555 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.294661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-91fd042c-86b4-4b1a-8cec-14363285b9fb tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.295889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-91fd042c-86b4-4b1a-8cec-14363285b9fb tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.305267 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1f73dc67-673b-41a9-828b-dc20d9cf4555 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1483 microversion: 2.25 time: 0.507781 Jul 20 04:18:37.318875 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1341/2751] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1483 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:37.321415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91fd042c-86b4-4b1a-8cec-14363285b9fb tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.323884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91fd042c-86b4-4b1a-8cec-14363285b9fb tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.326297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91fd042c-86b4-4b1a-8cec-14363285b9fb tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.328891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91fd042c-86b4-4b1a-8cec-14363285b9fb tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.429023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-91fd042c-86b4-4b1a-8cec-14363285b9fb tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.442644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-91fd042c-86b4-4b1a-8cec-14363285b9fb tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.445034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-91fd042c-86b4-4b1a-8cec-14363285b9fb tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.447197 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-91fd042c-86b4-4b1a-8cec-14363285b9fb tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.155988 Jul 20 04:18:37.447607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a7bd5cbd-3d99-4869-8bdc-5e7d8efab5a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.449337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7bd5cbd-3d99-4869-8bdc-5e7d8efab5a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.450823 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1411/2752] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:37.466666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7bd5cbd-3d99-4869-8bdc-5e7d8efab5a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.467612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7bd5cbd-3d99-4869-8bdc-5e7d8efab5a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.468906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7bd5cbd-3d99-4869-8bdc-5e7d8efab5a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.469432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7bd5cbd-3d99-4869-8bdc-5e7d8efab5a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.801431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9d272f2-b719-4720-b82f-45467ad73e3d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.802932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e9d272f2-b719-4720-b82f-45467ad73e3d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.830639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d272f2-b719-4720-b82f-45467ad73e3d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.837951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d272f2-b719-4720-b82f-45467ad73e3d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.842026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d272f2-b719-4720-b82f-45467ad73e3d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.843536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d272f2-b719-4720-b82f-45467ad73e3d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.351350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e9d272f2-b719-4720-b82f-45467ad73e3d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:38.368308 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9d272f2-b719-4720-b82f-45467ad73e3d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.571017 Jul 20 04:18:38.368921 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1412/2753] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:38.382626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-601a6571-ce2b-4ccd-b5d8-5bfdb45cb0cd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:38.395379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-601a6571-ce2b-4ccd-b5d8-5bfdb45cb0cd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:38.412429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-601a6571-ce2b-4ccd-b5d8-5bfdb45cb0cd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.413325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-601a6571-ce2b-4ccd-b5d8-5bfdb45cb0cd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.414506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-601a6571-ce2b-4ccd-b5d8-5bfdb45cb0cd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.421196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-601a6571-ce2b-4ccd-b5d8-5bfdb45cb0cd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.803516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a7bd5cbd-3d99-4869-8bdc-5e7d8efab5a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:38.822015 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a7bd5cbd-3d99-4869-8bdc-5e7d8efab5a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1315 microversion: 2.1 time: 1.383424 Jul 20 04:18:38.835329 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1342/2754] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1315 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:38.840307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c004ea29-a77f-453a-933d-0ff20abee09b req-bbc092b1-db87-40b2-a4d7-0f3fa45b3b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93afd1ba-4760-4b7d-bf7a-3fe39780de1d", "tag": "0afd9b9b-77c8-44e8-a450-9b96ce3fe8a2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:38.867242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c004ea29-a77f-453a-933d-0ff20abee09b req-bbc092b1-db87-40b2-a4d7-0f3fa45b3b9f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.867872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c004ea29-a77f-453a-933d-0ff20abee09b req-bbc092b1-db87-40b2-a4d7-0f3fa45b3b9f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.889293 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c004ea29-a77f-453a-933d-0ff20abee09b req-bbc092b1-db87-40b2-a4d7-0f3fa45b3b9f service nova] Creating event network-changed:0afd9b9b-77c8-44e8-a450-9b96ce3fe8a2 for instance 93afd1ba-4760-4b7d-bf7a-3fe39780de1d on n-h1-760456-11 Jul 20 04:18:38.906067 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c004ea29-a77f-453a-933d-0ff20abee09b req-bbc092b1-db87-40b2-a4d7-0f3fa45b3b9f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069271 Jul 20 04:18:38.907265 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1343/2755] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:38.915571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-529198cd-e5c9-4042-b57e-67170b452d47 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:38.916288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-529198cd-e5c9-4042-b57e-67170b452d47 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:38.928142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-529198cd-e5c9-4042-b57e-67170b452d47 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.929024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-529198cd-e5c9-4042-b57e-67170b452d47 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.935789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-529198cd-e5c9-4042-b57e-67170b452d47 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.936261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-529198cd-e5c9-4042-b57e-67170b452d47 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.276860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-601a6571-ce2b-4ccd-b5d8-5bfdb45cb0cd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.285928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-601a6571-ce2b-4ccd-b5d8-5bfdb45cb0cd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.291920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-601a6571-ce2b-4ccd-b5d8-5bfdb45cb0cd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.293559 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-601a6571-ce2b-4ccd-b5d8-5bfdb45cb0cd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1362 microversion: 2.26 time: 0.920885 Jul 20 04:18:39.294393 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1413/2756] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:38 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1362 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:39.299222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc4d137c-cd6c-4833-a50a-9235a05afe53 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.304207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc4d137c-cd6c-4833-a50a-9235a05afe53 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.319304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc4d137c-cd6c-4833-a50a-9235a05afe53 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.320116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc4d137c-cd6c-4833-a50a-9235a05afe53 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.321125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc4d137c-cd6c-4833-a50a-9235a05afe53 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.321804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc4d137c-cd6c-4833-a50a-9235a05afe53 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.357207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-529198cd-e5c9-4042-b57e-67170b452d47 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.368434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-529198cd-e5c9-4042-b57e-67170b452d47 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.374539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-529198cd-e5c9-4042-b57e-67170b452d47 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.384130 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-529198cd-e5c9-4042-b57e-67170b452d47 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1441 microversion: 2.25 time: 0.475631 Jul 20 04:18:39.384730 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1344/2757] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:38 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1441 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:39.394701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f4b82089-9853-4ead-b788-3fbf2ed78fee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.396942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f4b82089-9853-4ead-b788-3fbf2ed78fee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.408490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f4b82089-9853-4ead-b788-3fbf2ed78fee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.411048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f4b82089-9853-4ead-b788-3fbf2ed78fee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.412555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f4b82089-9853-4ead-b788-3fbf2ed78fee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.413518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f4b82089-9853-4ead-b788-3fbf2ed78fee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.488770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc4d137c-cd6c-4833-a50a-9235a05afe53 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.515782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc4d137c-cd6c-4833-a50a-9235a05afe53 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.549315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc4d137c-cd6c-4833-a50a-9235a05afe53 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.552503 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc4d137c-cd6c-4833-a50a-9235a05afe53 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.256203 Jul 20 04:18:39.554213 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1414/2758] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:39.740047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f3f11e63-9bd8-4f53-99e7-fe520a820749 req-4d8c842d-5552-4551-84c1-c539d9e71800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a486b5-316e-4426-972b-71b474a08ec1", "name": "network-vif-deleted", "tag": "b20cde1f-e1ac-4d80-81e4-5833da356db0"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:39.751686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f3f11e63-9bd8-4f53-99e7-fe520a820749 req-4d8c842d-5552-4551-84c1-c539d9e71800 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.752504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f3f11e63-9bd8-4f53-99e7-fe520a820749 req-4d8c842d-5552-4551-84c1-c539d9e71800 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.848865 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f3f11e63-9bd8-4f53-99e7-fe520a820749 req-4d8c842d-5552-4551-84c1-c539d9e71800 service nova] Creating event network-vif-deleted:b20cde1f-e1ac-4d80-81e4-5833da356db0 for instance d7a486b5-316e-4426-972b-71b474a08ec1 on n-h2-760456-11 Jul 20 04:18:39.856641 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f3f11e63-9bd8-4f53-99e7-fe520a820749 req-4d8c842d-5552-4551-84c1-c539d9e71800 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121376 Jul 20 04:18:39.858307 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1415/2759] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:18:39.865039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49d2150b-645f-4761-aa16-65065098ed7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.866131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-49d2150b-645f-4761-aa16-65065098ed7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.873584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49d2150b-645f-4761-aa16-65065098ed7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.874462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49d2150b-645f-4761-aa16-65065098ed7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.875530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49d2150b-645f-4761-aa16-65065098ed7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.876906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49d2150b-645f-4761-aa16-65065098ed7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.179409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f4b82089-9853-4ead-b788-3fbf2ed78fee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.192481 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f4b82089-9853-4ead-b788-3fbf2ed78fee tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.806298 Jul 20 04:18:40.193828 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1345/2760] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:40.313164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-49d2150b-645f-4761-aa16-65065098ed7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.318799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fd5e1a05-0603-4f4c-9e8a-948e1c33f6df tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.319421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fd5e1a05-0603-4f4c-9e8a-948e1c33f6df tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.327570 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-49d2150b-645f-4761-aa16-65065098ed7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1315 microversion: 2.1 time: 0.467728 Jul 20 04:18:40.339597 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1416/2761] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:40.344906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd5e1a05-0603-4f4c-9e8a-948e1c33f6df tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.345395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd5e1a05-0603-4f4c-9e8a-948e1c33f6df tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.350791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd5e1a05-0603-4f4c-9e8a-948e1c33f6df tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.351255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd5e1a05-0603-4f4c-9e8a-948e1c33f6df tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.407604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d126b19-fdf0-4be6-a090-1dd15387321f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.408225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d126b19-fdf0-4be6-a090-1dd15387321f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.421270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d126b19-fdf0-4be6-a090-1dd15387321f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.421738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d126b19-fdf0-4be6-a090-1dd15387321f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.422998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d126b19-fdf0-4be6-a090-1dd15387321f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.427796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d126b19-fdf0-4be6-a090-1dd15387321f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.561417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d126b19-fdf0-4be6-a090-1dd15387321f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.572677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d126b19-fdf0-4be6-a090-1dd15387321f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.576771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d126b19-fdf0-4be6-a090-1dd15387321f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.585963 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d126b19-fdf0-4be6-a090-1dd15387321f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1266 microversion: 2.25 time: 0.182382 Jul 20 04:18:40.587398 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1417/2762] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:40.594747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b2a9ac29-a3ac-433e-8254-52140cac141d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.598216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b2a9ac29-a3ac-433e-8254-52140cac141d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.615061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2a9ac29-a3ac-433e-8254-52140cac141d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.615517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2a9ac29-a3ac-433e-8254-52140cac141d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.616302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2a9ac29-a3ac-433e-8254-52140cac141d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.623086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2a9ac29-a3ac-433e-8254-52140cac141d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.759600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b2a9ac29-a3ac-433e-8254-52140cac141d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.775970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b2a9ac29-a3ac-433e-8254-52140cac141d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.777919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b2a9ac29-a3ac-433e-8254-52140cac141d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.781571 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b2a9ac29-a3ac-433e-8254-52140cac141d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1365 microversion: 2.47 time: 0.192846 Jul 20 04:18:40.784606 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1418/2763] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:40.868639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fd5e1a05-0603-4f4c-9e8a-948e1c33f6df tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.883708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fd5e1a05-0603-4f4c-9e8a-948e1c33f6df tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.885439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fd5e1a05-0603-4f4c-9e8a-948e1c33f6df tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.887019 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fd5e1a05-0603-4f4c-9e8a-948e1c33f6df tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1362 microversion: 2.26 time: 0.575829 Jul 20 04:18:40.891276 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1346/2764] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1362 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:41.171030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a7188747-5fc5-4428-87b2-1850ca77df5d req-1a63e324-d7b8-4009-9c9c-31340072202d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b48b17a-920e-4020-ae3f-0027021d7253", "tag": "6e448566-dce6-4bab-a936-60412c4e3d62"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:41.181899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a7188747-5fc5-4428-87b2-1850ca77df5d req-1a63e324-d7b8-4009-9c9c-31340072202d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.182637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a7188747-5fc5-4428-87b2-1850ca77df5d req-1a63e324-d7b8-4009-9c9c-31340072202d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.199341 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a7188747-5fc5-4428-87b2-1850ca77df5d req-1a63e324-d7b8-4009-9c9c-31340072202d service nova] Creating event network-changed:6e448566-dce6-4bab-a936-60412c4e3d62 for instance 2b48b17a-920e-4020-ae3f-0027021d7253 on n-h1-760456-11 Jul 20 04:18:41.207526 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a7188747-5fc5-4428-87b2-1850ca77df5d req-1a63e324-d7b8-4009-9c9c-31340072202d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039364 Jul 20 04:18:41.210601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d59b2b1-055a-4018-84ab-c011221cfd37 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.211231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d59b2b1-055a-4018-84ab-c011221cfd37 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.211572 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1419/2765] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:41.235719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d59b2b1-055a-4018-84ab-c011221cfd37 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.236560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d59b2b1-055a-4018-84ab-c011221cfd37 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.239236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d59b2b1-055a-4018-84ab-c011221cfd37 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.239893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d59b2b1-055a-4018-84ab-c011221cfd37 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.348251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a27303a1-1023-4c36-aa9a-61f41c5ef860 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.349410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a27303a1-1023-4c36-aa9a-61f41c5ef860 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.370491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a27303a1-1023-4c36-aa9a-61f41c5ef860 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.371255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a27303a1-1023-4c36-aa9a-61f41c5ef860 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.372227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a27303a1-1023-4c36-aa9a-61f41c5ef860 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.372833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a27303a1-1023-4c36-aa9a-61f41c5ef860 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.387198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:41.497594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d59b2b1-055a-4018-84ab-c011221cfd37 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.536569 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d59b2b1-055a-4018-84ab-c011221cfd37 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.321537 Jul 20 04:18:41.537507 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1347/2766] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:41.542659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-64278ad3-ff58-4caa-9414-fa7bdad563f8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.545344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-64278ad3-ff58-4caa-9414-fa7bdad563f8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.566675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64278ad3-ff58-4caa-9414-fa7bdad563f8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.567492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64278ad3-ff58-4caa-9414-fa7bdad563f8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.568527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64278ad3-ff58-4caa-9414-fa7bdad563f8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.569198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64278ad3-ff58-4caa-9414-fa7bdad563f8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.601842 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-64278ad3-ff58-4caa-9414-fa7bdad563f8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] HTTP exception thrown: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-64278ad3-ff58-4caa-9414-fa7bdad563f8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Request method failure captured: Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b HTTP/1.1 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14BsDqJ-MJiUio37b0uZ8GFq1ShXgYOFtSxmXEFEYgcDRG1m8sNMrAKRXMwtIqBcmyVWHAOYvH1k-v2W6rqdQ6QRsHlshVSVBHNPYfTf3dGjcnGfhJzepzEmYt39PltIXS_URAjdEZXagxzOScbY4g1yHTASVaZ8DgOCfXc-AXh-XQ4 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 29c19ef6ed5b4e27947af6ce219d18d5 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1719754799 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1719754799 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 29c19ef6ed5b4e27947af6ce219d18d5 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1719754799 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TaggedBootDevicesTest_v242-1719754799-project Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2ea3ed970c1348aa922dda7fb3edf866 Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1719754799-project Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '27ee62c2-a702-438e-ae91-9f1bf6846f1b'} Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:41.614407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:41.618557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.620961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-64278ad3-ff58-4caa-9414-fa7bdad563f8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Returning 404 to user: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:41.622101 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-64278ad3-ff58-4caa-9414-fa7bdad563f8 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "DELETE /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 404 len: 111 microversion: 2.42 time: 0.083204 Jul 20 04:18:41.628740 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1348/2767] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:18:41 2022] DELETE /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:41.640669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fe153d5-3c92-4efb-bff3-6270bfb1a7ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.641972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1fe153d5-3c92-4efb-bff3-6270bfb1a7ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.653327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fe153d5-3c92-4efb-bff3-6270bfb1a7ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.654025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fe153d5-3c92-4efb-bff3-6270bfb1a7ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.655140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fe153d5-3c92-4efb-bff3-6270bfb1a7ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.655809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fe153d5-3c92-4efb-bff3-6270bfb1a7ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.831810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1fe153d5-3c92-4efb-bff3-6270bfb1a7ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.856309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:41.857613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1fe153d5-3c92-4efb-bff3-6270bfb1a7ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.864633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1fe153d5-3c92-4efb-bff3-6270bfb1a7ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.865990 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1fe153d5-3c92-4efb-bff3-6270bfb1a7ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1266 microversion: 2.25 time: 0.235799 Jul 20 04:18:41.872492 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1349/2768] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:41.887239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c15d78dd-92d0-4083-823e-46125ca53a41 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.888708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c15d78dd-92d0-4083-823e-46125ca53a41 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] [instance: 27ee62c2-a702-438e-ae91-9f1bf6846f1b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.919382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c15d78dd-92d0-4083-823e-46125ca53a41 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.920268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c15d78dd-92d0-4083-823e-46125ca53a41 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.921270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c15d78dd-92d0-4083-823e-46125ca53a41 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.921848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c15d78dd-92d0-4083-823e-46125ca53a41 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.925474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:41.961371 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c15d78dd-92d0-4083-823e-46125ca53a41 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] HTTP exception thrown: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c15d78dd-92d0-4083-823e-46125ca53a41 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Request method failure captured: Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b HTTP/1.1 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14BsDqJ-MJiUio37b0uZ8GFq1ShXgYOFtSxmXEFEYgcDRG1m8sNMrAKRXMwtIqBcmyVWHAOYvH1k-v2W6rqdQ6QRsHlshVSVBHNPYfTf3dGjcnGfhJzepzEmYt39PltIXS_URAjdEZXagxzOScbY4g1yHTASVaZ8DgOCfXc-AXh-XQ4 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 29c19ef6ed5b4e27947af6ce219d18d5 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1719754799 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_29c19ef6ed5b4e27947af6ce219d18d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1719754799 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 29c19ef6ed5b4e27947af6ce219d18d5 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1719754799 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TaggedBootDevicesTest_v242-1719754799-project Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2ea3ed970c1348aa922dda7fb3edf866 Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1719754799-project Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '27ee62c2-a702-438e-ae91-9f1bf6846f1b'} Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.962974 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c15d78dd-92d0-4083-823e-46125ca53a41 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] Returning 404 to user: Instance 27ee62c2-a702-438e-ae91-9f1bf6846f1b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c15d78dd-92d0-4083-823e-46125ca53a41 tempest-TaggedBootDevicesTest_v242-1719754799 tempest-TaggedBootDevicesTest_v242-1719754799-project] 10.222.0.59 "GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b" status: 404 len: 111 microversion: 2.42 time: 0.089442 Jul 20 04:18:41.967404 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1350/2769] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/27ee62c2-a702-438e-ae91-9f1bf6846f1b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:41.970229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b6652f8d-0858-4237-b69c-02d6d732c62e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.970895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b6652f8d-0858-4237-b69c-02d6d732c62e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.977700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b6652f8d-0858-4237-b69c-02d6d732c62e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.978795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b6652f8d-0858-4237-b69c-02d6d732c62e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.979736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b6652f8d-0858-4237-b69c-02d6d732c62e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.980335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b6652f8d-0858-4237-b69c-02d6d732c62e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.056656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a27303a1-1023-4c36-aa9a-61f41c5ef860 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.064358 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a27303a1-1023-4c36-aa9a-61f41c5ef860 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1315 microversion: 2.1 time: 0.722029 Jul 20 04:18:42.064976 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1420/2770] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:42.079619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8aa598b8-27fe-41e9-8f63-242615e79523 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.080252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8aa598b8-27fe-41e9-8f63-242615e79523 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.081481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b6652f8d-0858-4237-b69c-02d6d732c62e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.092094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b6652f8d-0858-4237-b69c-02d6d732c62e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.096681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b6652f8d-0858-4237-b69c-02d6d732c62e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.097592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aa598b8-27fe-41e9-8f63-242615e79523 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.098006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aa598b8-27fe-41e9-8f63-242615e79523 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.099034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aa598b8-27fe-41e9-8f63-242615e79523 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.099355 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b6652f8d-0858-4237-b69c-02d6d732c62e tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1383 microversion: 2.47 time: 0.133157 Jul 20 04:18:42.099658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8aa598b8-27fe-41e9-8f63-242615e79523 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.100642 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1351/2771] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1383 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:42.235270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1330890f-e4e4-49b8-9618-491c862a2561 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Action: 'create', calling method: .version_select at 0x7fb8414884c0>, body: {"keypair": {"name": "tempest-keypair-921542331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6PFrsuESa78Q8dbPaMsiAnQUn+xMD0otUFitdqbJK2giCBfEjrsQT/TtnuHg33V11JHNJvbnEVr5AVlZinnCaKtXbu4Qo+iPatOwsOSKkHXSp4pr/rZMTFlWEMJAK/bQ=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:42.253780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-1330890f-e4e4-49b8-9618-491c862a2561 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Getting quotas for project fa6ab79f10b6402cb29860dd32ec9b40. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:42.260578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-1330890f-e4e4-49b8-9618-491c862a2561 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Getting quotas for user bfd6ea2f064248d992203faeb95b61af and project fa6ab79f10b6402cb29860dd32ec9b40. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:42.290313 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1330890f-e4e4-49b8-9618-491c862a2561 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187447 Jul 20 04:18:42.291818 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1352/2772] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:18:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:42.558279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7a1f309a-a311-487b-9c66-79e8e5aa061c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.559211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7a1f309a-a311-487b-9c66-79e8e5aa061c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.573960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a1f309a-a311-487b-9c66-79e8e5aa061c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.576075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a1f309a-a311-487b-9c66-79e8e5aa061c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.578275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a1f309a-a311-487b-9c66-79e8e5aa061c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.578970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a1f309a-a311-487b-9c66-79e8e5aa061c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.709224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8aa598b8-27fe-41e9-8f63-242615e79523 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.729967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8aa598b8-27fe-41e9-8f63-242615e79523 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.735037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8aa598b8-27fe-41e9-8f63-242615e79523 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.739797 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8aa598b8-27fe-41e9-8f63-242615e79523 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1362 microversion: 2.26 time: 0.672755 Jul 20 04:18:42.742081 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1421/2773] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1362 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:42.877821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7a1f309a-a311-487b-9c66-79e8e5aa061c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.890771 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7a1f309a-a311-487b-9c66-79e8e5aa061c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.337564 Jul 20 04:18:42.891475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9fbf38a5-39de-4d4f-bc8e-4fdecac8529e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.891946 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1353/2774] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:42.892830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9fbf38a5-39de-4d4f-bc8e-4fdecac8529e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.906711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9fbf38a5-39de-4d4f-bc8e-4fdecac8529e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.907526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9fbf38a5-39de-4d4f-bc8e-4fdecac8529e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.908579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9fbf38a5-39de-4d4f-bc8e-4fdecac8529e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.909994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9fbf38a5-39de-4d4f-bc8e-4fdecac8529e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.054895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9fbf38a5-39de-4d4f-bc8e-4fdecac8529e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.064263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9fbf38a5-39de-4d4f-bc8e-4fdecac8529e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.067158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9fbf38a5-39de-4d4f-bc8e-4fdecac8529e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.068648 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9fbf38a5-39de-4d4f-bc8e-4fdecac8529e tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1266 microversion: 2.25 time: 0.181566 Jul 20 04:18:43.069759 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1422/2775] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:43.083977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c56cd1dd-3536-4861-8f64-490e196d8031 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.084719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c56cd1dd-3536-4861-8f64-490e196d8031 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.097382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c56cd1dd-3536-4861-8f64-490e196d8031 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.097866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c56cd1dd-3536-4861-8f64-490e196d8031 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.102219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c56cd1dd-3536-4861-8f64-490e196d8031 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.110039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c56cd1dd-3536-4861-8f64-490e196d8031 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.119126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0753926b-e36d-4442-bf88-b7818eea892c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.119868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0753926b-e36d-4442-bf88-b7818eea892c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.141061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0753926b-e36d-4442-bf88-b7818eea892c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.147906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0753926b-e36d-4442-bf88-b7818eea892c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.149159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0753926b-e36d-4442-bf88-b7818eea892c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.149681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0753926b-e36d-4442-bf88-b7818eea892c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.418453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c56cd1dd-3536-4861-8f64-490e196d8031 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.436673 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c56cd1dd-3536-4861-8f64-490e196d8031 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1315 microversion: 2.1 time: 0.358377 Jul 20 04:18:43.441167 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1354/2776] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:43.530973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0753926b-e36d-4442-bf88-b7818eea892c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.544234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0753926b-e36d-4442-bf88-b7818eea892c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.551756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0753926b-e36d-4442-bf88-b7818eea892c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.553301 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0753926b-e36d-4442-bf88-b7818eea892c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1371 microversion: 2.47 time: 0.438354 Jul 20 04:18:43.556119 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1423/2777] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1371 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:43.762239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ae7a2d4-14ea-443d-aee1-35b09e00cd55 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.762892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ae7a2d4-14ea-443d-aee1-35b09e00cd55 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.773892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:43.784453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ae7a2d4-14ea-443d-aee1-35b09e00cd55 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.785200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ae7a2d4-14ea-443d-aee1-35b09e00cd55 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.786224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ae7a2d4-14ea-443d-aee1-35b09e00cd55 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.786833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ae7a2d4-14ea-443d-aee1-35b09e00cd55 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.829288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:43.911171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1dc2e448-d59b-4884-828b-6c58b683d499 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.914621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1dc2e448-d59b-4884-828b-6c58b683d499 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.928470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc2e448-d59b-4884-828b-6c58b683d499 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.930925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc2e448-d59b-4884-828b-6c58b683d499 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.935601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc2e448-d59b-4884-828b-6c58b683d499 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.939041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc2e448-d59b-4884-828b-6c58b683d499 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.094716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ae7a2d4-14ea-443d-aee1-35b09e00cd55 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.106201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ae7a2d4-14ea-443d-aee1-35b09e00cd55 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.108309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ae7a2d4-14ea-443d-aee1-35b09e00cd55 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.109658 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ae7a2d4-14ea-443d-aee1-35b09e00cd55 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1362 microversion: 2.26 time: 0.353364 Jul 20 04:18:44.111634 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1355/2778] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:44.116674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-458716f0-bffb-4046-a884-1592db2effad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.117521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-458716f0-bffb-4046-a884-1592db2effad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.126545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-458716f0-bffb-4046-a884-1592db2effad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.126545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-458716f0-bffb-4046-a884-1592db2effad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.126545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-458716f0-bffb-4046-a884-1592db2effad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.127094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-458716f0-bffb-4046-a884-1592db2effad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.265293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-458716f0-bffb-4046-a884-1592db2effad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.282589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-458716f0-bffb-4046-a884-1592db2effad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.283418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-458716f0-bffb-4046-a884-1592db2effad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.284650 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-458716f0-bffb-4046-a884-1592db2effad tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1266 microversion: 2.25 time: 0.171662 Jul 20 04:18:44.288144 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1356/2779] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:44.461354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66237e75-caab-45b6-be9e-3129983e6a19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.463345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-66237e75-caab-45b6-be9e-3129983e6a19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.489247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66237e75-caab-45b6-be9e-3129983e6a19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.502015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66237e75-caab-45b6-be9e-3129983e6a19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.504846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66237e75-caab-45b6-be9e-3129983e6a19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.505454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66237e75-caab-45b6-be9e-3129983e6a19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.583163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1dc2e448-d59b-4884-828b-6c58b683d499 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.598423 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1dc2e448-d59b-4884-828b-6c58b683d499 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1514 microversion: 2.1 time: 0.692090 Jul 20 04:18:44.599081 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1424/2780] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1514 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:44.624356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50c0909e-bee7-4ea5-b408-d1d2521b00c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.625608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-50c0909e-bee7-4ea5-b408-d1d2521b00c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.653208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50c0909e-bee7-4ea5-b408-d1d2521b00c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.653958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50c0909e-bee7-4ea5-b408-d1d2521b00c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.655348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50c0909e-bee7-4ea5-b408-d1d2521b00c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.657057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50c0909e-bee7-4ea5-b408-d1d2521b00c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.823540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66237e75-caab-45b6-be9e-3129983e6a19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.833040 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-66237e75-caab-45b6-be9e-3129983e6a19 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1315 microversion: 2.1 time: 0.376423 Jul 20 04:18:44.837504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-50c0909e-bee7-4ea5-b408-d1d2521b00c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.853666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-50c0909e-bee7-4ea5-b408-d1d2521b00c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.855785 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1357/2781] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:44.856853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-50c0909e-bee7-4ea5-b408-d1d2521b00c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.858341 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-50c0909e-bee7-4ea5-b408-d1d2521b00c3 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1371 microversion: 2.47 time: 0.251687 Jul 20 04:18:44.859337 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1425/2782] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:45.038205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-34c2bef0-6cb5-4556-a51f-db4590c549f8 req-b868293e-36f6-4cb4-a61d-318be97a4837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93afd1ba-4760-4b7d-bf7a-3fe39780de1d", "name": "network-vif-plugged", "status": "completed", "tag": "0afd9b9b-77c8-44e8-a450-9b96ce3fe8a2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:45.048414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-34c2bef0-6cb5-4556-a51f-db4590c549f8 req-b868293e-36f6-4cb4-a61d-318be97a4837 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.052686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-34c2bef0-6cb5-4556-a51f-db4590c549f8 req-b868293e-36f6-4cb4-a61d-318be97a4837 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.067776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-34c2bef0-6cb5-4556-a51f-db4590c549f8 req-b868293e-36f6-4cb4-a61d-318be97a4837 service nova] Creating event network-vif-plugged:0afd9b9b-77c8-44e8-a450-9b96ce3fe8a2 for instance 93afd1ba-4760-4b7d-bf7a-3fe39780de1d on n-h1-760456-11 Jul 20 04:18:45.073580 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-34c2bef0-6cb5-4556-a51f-db4590c549f8 req-b868293e-36f6-4cb4-a61d-318be97a4837 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043759 Jul 20 04:18:45.079571 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1358/2783] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:45.135272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8c3ecf54-2f02-4b4c-83c7-732e2095c91a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.136679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8c3ecf54-2f02-4b4c-83c7-732e2095c91a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.145361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c3ecf54-2f02-4b4c-83c7-732e2095c91a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.146139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c3ecf54-2f02-4b4c-83c7-732e2095c91a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.147287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c3ecf54-2f02-4b4c-83c7-732e2095c91a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.148064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c3ecf54-2f02-4b4c-83c7-732e2095c91a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.317666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b3bb65b-4d34-4dc3-842c-ef576a679a2f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.319286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9b3bb65b-4d34-4dc3-842c-ef576a679a2f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.328422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b3bb65b-4d34-4dc3-842c-ef576a679a2f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.329151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b3bb65b-4d34-4dc3-842c-ef576a679a2f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.330390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b3bb65b-4d34-4dc3-842c-ef576a679a2f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.331634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b3bb65b-4d34-4dc3-842c-ef576a679a2f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.448529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c3ecf54-2f02-4b4c-83c7-732e2095c91a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.459820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c3ecf54-2f02-4b4c-83c7-732e2095c91a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.460434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b3bb65b-4d34-4dc3-842c-ef576a679a2f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.469343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b3bb65b-4d34-4dc3-842c-ef576a679a2f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.480687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c3ecf54-2f02-4b4c-83c7-732e2095c91a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.480687 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8c3ecf54-2f02-4b4c-83c7-732e2095c91a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1362 microversion: 2.26 time: 0.344423 Jul 20 04:18:45.480687 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1426/2784] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:45.481955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b3bb65b-4d34-4dc3-842c-ef576a679a2f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.484792 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9b3bb65b-4d34-4dc3-842c-ef576a679a2f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1266 microversion: 2.25 time: 0.183307 Jul 20 04:18:45.485386 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1359/2785] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:45.485502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2016179171", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "55c64c09-b561-4bbe-8c38-cec5bf1c4715"}], "security_groups": [{"name": "tempest-securitygroup--1070120155"}], "key_name": "tempest-keypair-921542331", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:45.616793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa38789e-f857-4597-9821-3811b9a9b9b7 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.619132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] validate_networks() for [('55c64c09-b561-4bbe-8c38-cec5bf1c4715', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:45.622528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fa38789e-f857-4597-9821-3811b9a9b9b7 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.631865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa38789e-f857-4597-9821-3811b9a9b9b7 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.632405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa38789e-f857-4597-9821-3811b9a9b9b7 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.633259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa38789e-f857-4597-9821-3811b9a9b9b7 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.633773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa38789e-f857-4597-9821-3811b9a9b9b7 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.791964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fa38789e-f857-4597-9821-3811b9a9b9b7 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.801274 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa38789e-f857-4597-9821-3811b9a9b9b7 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1520 microversion: 2.1 time: 0.189747 Jul 20 04:18:45.801885 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1360/2786] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:45.873316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e27dc081-ae26-4d63-b913-32b79b135138 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.874298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e27dc081-ae26-4d63-b913-32b79b135138 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.881391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e27dc081-ae26-4d63-b913-32b79b135138 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.882081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e27dc081-ae26-4d63-b913-32b79b135138 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.882884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e27dc081-ae26-4d63-b913-32b79b135138 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.883595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e27dc081-ae26-4d63-b913-32b79b135138 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.052903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e27dc081-ae26-4d63-b913-32b79b135138 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.060682 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e27dc081-ae26-4d63-b913-32b79b135138 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1315 microversion: 2.1 time: 0.191834 Jul 20 04:18:46.061278 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1361/2787] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:46.075464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d94bc91-d025-47c0-9175-fc8738b4a409 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.076330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d94bc91-d025-47c0-9175-fc8738b4a409 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.085105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d94bc91-d025-47c0-9175-fc8738b4a409 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.085796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d94bc91-d025-47c0-9175-fc8738b4a409 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.087060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d94bc91-d025-47c0-9175-fc8738b4a409 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.087647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d94bc91-d025-47c0-9175-fc8738b4a409 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.088649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Getting quotas for project fa6ab79f10b6402cb29860dd32ec9b40. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:46.095760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Getting quotas for user bfd6ea2f064248d992203faeb95b61af and project fa6ab79f10b6402cb29860dd32ec9b40. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:46.116008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:46.116478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:46.117299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:46.118535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:46.122097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:46.133144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.133894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.135155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.135847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.155940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Getting quotas for project fa6ab79f10b6402cb29860dd32ec9b40. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:46.162734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Getting quotas for user bfd6ea2f064248d992203faeb95b61af and project fa6ab79f10b6402cb29860dd32ec9b40. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:46.172599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3d94bc91-d025-47c0-9175-fc8738b4a409 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.178019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:46.181626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:46.188385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3d94bc91-d025-47c0-9175-fc8738b4a409 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.190515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3d94bc91-d025-47c0-9175-fc8738b4a409 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.191914 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d94bc91-d025-47c0-9175-fc8738b4a409 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1371 microversion: 2.47 time: 0.120278 Jul 20 04:18:46.192970 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1362/2788] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:46.268996 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c1c13c5a-ae7f-4bff-bb31-6d4bbcab1b84 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.791114 Jul 20 04:18:46.275158 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1427/2789] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:46.280445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7a638eac-39c9-46e8-a43c-d76843a90a5c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.281061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7a638eac-39c9-46e8-a43c-d76843a90a5c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.360816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7a638eac-39c9-46e8-a43c-d76843a90a5c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.369612 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7a638eac-39c9-46e8-a43c-d76843a90a5c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1277 microversion: 2.1 time: 0.093139 Jul 20 04:18:46.379353 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1363/2790] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:46.497175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-85d83733-4f0b-483d-9c79-c03adbf86abd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.498160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-85d83733-4f0b-483d-9c79-c03adbf86abd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.514903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8db0a459-6b65-4302-bbdf-a3b33e2be66a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.515565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8db0a459-6b65-4302-bbdf-a3b33e2be66a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.515926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85d83733-4f0b-483d-9c79-c03adbf86abd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.516404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85d83733-4f0b-483d-9c79-c03adbf86abd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.520252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85d83733-4f0b-483d-9c79-c03adbf86abd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.520844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85d83733-4f0b-483d-9c79-c03adbf86abd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.523801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8db0a459-6b65-4302-bbdf-a3b33e2be66a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.524263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8db0a459-6b65-4302-bbdf-a3b33e2be66a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.528328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8db0a459-6b65-4302-bbdf-a3b33e2be66a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.528845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8db0a459-6b65-4302-bbdf-a3b33e2be66a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.658678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8db0a459-6b65-4302-bbdf-a3b33e2be66a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.668818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8db0a459-6b65-4302-bbdf-a3b33e2be66a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.670374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8db0a459-6b65-4302-bbdf-a3b33e2be66a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.671538 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8db0a459-6b65-4302-bbdf-a3b33e2be66a tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 200 len: 1266 microversion: 2.25 time: 0.173028 Jul 20 04:18:46.676961 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1364/2791] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:46.810946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-85d83733-4f0b-483d-9c79-c03adbf86abd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.819316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80064fcd-04d0-42c2-aa74-92da9597cb49 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.820280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-80064fcd-04d0-42c2-aa74-92da9597cb49 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.822802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-85d83733-4f0b-483d-9c79-c03adbf86abd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.825631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-85d83733-4f0b-483d-9c79-c03adbf86abd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.826884 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-85d83733-4f0b-483d-9c79-c03adbf86abd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1362 microversion: 2.26 time: 0.337823 Jul 20 04:18:46.828057 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1428/2792] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:46.832319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80064fcd-04d0-42c2-aa74-92da9597cb49 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.833042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80064fcd-04d0-42c2-aa74-92da9597cb49 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.834097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80064fcd-04d0-42c2-aa74-92da9597cb49 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.835000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80064fcd-04d0-42c2-aa74-92da9597cb49 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.063077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-80064fcd-04d0-42c2-aa74-92da9597cb49 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.079850 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-80064fcd-04d0-42c2-aa74-92da9597cb49 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1520 microversion: 2.1 time: 0.264970 Jul 20 04:18:47.080258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d43de140-34bd-4a79-9425-a673e071ed2f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.081555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d43de140-34bd-4a79-9425-a673e071ed2f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.084352 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1365/2793] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:47.091968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d43de140-34bd-4a79-9425-a673e071ed2f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.093274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d43de140-34bd-4a79-9425-a673e071ed2f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.096078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d43de140-34bd-4a79-9425-a673e071ed2f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.098121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d43de140-34bd-4a79-9425-a673e071ed2f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.116736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-7e4c21d4-4777-4aa6-b628-b147b4a5be1c req-e404467d-14e5-4625-88f7-e7bfc149b0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b48b17a-920e-4020-ae3f-0027021d7253", "name": "network-vif-plugged", "status": "completed", "tag": "6e448566-dce6-4bab-a936-60412c4e3d62"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:47.146187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7e4c21d4-4777-4aa6-b628-b147b4a5be1c req-e404467d-14e5-4625-88f7-e7bfc149b0cf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.146958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7e4c21d4-4777-4aa6-b628-b147b4a5be1c req-e404467d-14e5-4625-88f7-e7bfc149b0cf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.166999 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-7e4c21d4-4777-4aa6-b628-b147b4a5be1c req-e404467d-14e5-4625-88f7-e7bfc149b0cf service nova] Creating event network-vif-plugged:6e448566-dce6-4bab-a936-60412c4e3d62 for instance 2b48b17a-920e-4020-ae3f-0027021d7253 on n-h1-760456-11 Jul 20 04:18:47.173187 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-7e4c21d4-4777-4aa6-b628-b147b4a5be1c req-e404467d-14e5-4625-88f7-e7bfc149b0cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061713 Jul 20 04:18:47.174020 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1366/2794] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:18:47.219559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a50f4708-1745-4c80-88e1-1b0e25136487 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.220455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a50f4708-1745-4c80-88e1-1b0e25136487 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.231788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a50f4708-1745-4c80-88e1-1b0e25136487 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.232645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a50f4708-1745-4c80-88e1-1b0e25136487 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.233721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a50f4708-1745-4c80-88e1-1b0e25136487 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.250715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a50f4708-1745-4c80-88e1-1b0e25136487 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.380750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a50f4708-1745-4c80-88e1-1b0e25136487 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.391149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a50f4708-1745-4c80-88e1-1b0e25136487 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.392682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a50f4708-1745-4c80-88e1-1b0e25136487 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.394120 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a50f4708-1745-4c80-88e1-1b0e25136487 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1356 microversion: 2.47 time: 0.182259 Jul 20 04:18:47.394726 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1367/2795] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1356 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:47.411294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b709f693-9d30-4bcc-8420-4a6b0bc6b08e tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.411936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b709f693-9d30-4bcc-8420-4a6b0bc6b08e tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.418188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b709f693-9d30-4bcc-8420-4a6b0bc6b08e tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.418715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b709f693-9d30-4bcc-8420-4a6b0bc6b08e tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.419687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b709f693-9d30-4bcc-8420-4a6b0bc6b08e tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.420142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b709f693-9d30-4bcc-8420-4a6b0bc6b08e tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.502065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b709f693-9d30-4bcc-8420-4a6b0bc6b08e tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.504548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d43de140-34bd-4a79-9425-a673e071ed2f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.511159 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b709f693-9d30-4bcc-8420-4a6b0bc6b08e tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1329 microversion: 2.1 time: 0.115389 Jul 20 04:18:47.512225 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1368/2796] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1329 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:47.522456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d43de140-34bd-4a79-9425-a673e071ed2f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1315 microversion: 2.1 time: 0.447124 Jul 20 04:18:47.523620 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1429/2797] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:47.527401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.531545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.532635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Searching by: {'deleted': False, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:18:47.541174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.541174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.542010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.542505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.677843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:18:47.693772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0daef6a1-eeeb-410f-9fa4-642b54a033ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.694616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0daef6a1-eeeb-410f-9fa4-642b54a033ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: d7a486b5-316e-4426-972b-71b474a08ec1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.700967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0daef6a1-eeeb-410f-9fa4-642b54a033ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.701669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0daef6a1-eeeb-410f-9fa4-642b54a033ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.702641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0daef6a1-eeeb-410f-9fa4-642b54a033ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.703246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0daef6a1-eeeb-410f-9fa4-642b54a033ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.720887 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-0daef6a1-eeeb-410f-9fa4-642b54a033ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] HTTP exception thrown: Instance d7a486b5-316e-4426-972b-71b474a08ec1 could not be found. Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0daef6a1-eeeb-410f-9fa4-642b54a033ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Request method failure captured: Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 HTTP/1.1 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14CEO3G3esOlkeb-7wv-eohmvY86Z1CTdoBef37xRuBAepEKTlbuNjikHie4fM80y6mcBbfFXx42XC8bpKFAPoy7dpu4FGRsTw10tE5ox79nq5ErLJrFKbIe9JRbyal09HM05UeqXSNNmrvq7VCvhp_-V-kJ5ERbMNGdaVMnU3sXwes Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d2323a93fbfb432f81cd11b542380af8 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d2323a93fbfb432f81cd11b542380af8 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-LiveAutoBlockMigrationV225Test-1081269634-project Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: df3e2faf94584fc99a59e3839e18f8b1 Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634-project Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance d7a486b5-316e-4426-972b-71b474a08ec1 could not be found. Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'd7a486b5-316e-4426-972b-71b474a08ec1'} Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a486b5-316e-4426-972b-71b474a08ec1 could not be found. Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a486b5-316e-4426-972b-71b474a08ec1 could not be found. Jul 20 04:18:47.724248 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:18:47.728825 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:47.728825 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:18:47.728825 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:47.728825 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:47.728825 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:47.728825 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:47.728825 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:47.728825 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a486b5-316e-4426-972b-71b474a08ec1 could not be found. Jul 20 04:18:47.728825 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:18:47.730476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0daef6a1-eeeb-410f-9fa4-642b54a033ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Returning 404 to user: Instance d7a486b5-316e-4426-972b-71b474a08ec1 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:47.731873 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0daef6a1-eeeb-410f-9fa4-642b54a033ee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1" status: 404 len: 111 microversion: 2.25 time: 0.042277 Jul 20 04:18:47.733123 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1430/2798] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/d7a486b5-316e-4426-972b-71b474a08ec1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:18:47.849982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5863c023-6f62-4406-b0f8-acc500064465 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.850956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5863c023-6f62-4406-b0f8-acc500064465 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.867342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5863c023-6f62-4406-b0f8-acc500064465 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.869140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5863c023-6f62-4406-b0f8-acc500064465 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.872818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5863c023-6f62-4406-b0f8-acc500064465 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.873306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5863c023-6f62-4406-b0f8-acc500064465 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.086576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.092828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:48.095820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.096604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.112537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.114593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.166347 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-776f4a37-f3db-4cf3-8650-72bddd4a688d tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.652900 Jul 20 04:18:48.167697 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1369/2799] 10.222.0.59 () {60 vars in 1186 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:48.172719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4166855b-4523-4fef-850c-30392b9b4f2a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.173564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4166855b-4523-4fef-850c-30392b9b4f2a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.197793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4166855b-4523-4fef-850c-30392b9b4f2a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.199518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4166855b-4523-4fef-850c-30392b9b4f2a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.200490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4166855b-4523-4fef-850c-30392b9b4f2a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.201281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4166855b-4523-4fef-850c-30392b9b4f2a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.224827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5863c023-6f62-4406-b0f8-acc500064465 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.235705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5863c023-6f62-4406-b0f8-acc500064465 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.239083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5863c023-6f62-4406-b0f8-acc500064465 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.240539 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5863c023-6f62-4406-b0f8-acc500064465 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1547 microversion: 2.26 time: 0.396524 Jul 20 04:18:48.241275 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1431/2800] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1547 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:48.261204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6721b28d-d97c-4898-98f3-32c6c75dc423 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.261960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6721b28d-d97c-4898-98f3-32c6c75dc423 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.268914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6721b28d-d97c-4898-98f3-32c6c75dc423 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.269742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6721b28d-d97c-4898-98f3-32c6c75dc423 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.270920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6721b28d-d97c-4898-98f3-32c6c75dc423 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.271854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6721b28d-d97c-4898-98f3-32c6c75dc423 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.302442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6721b28d-d97c-4898-98f3-32c6c75dc423 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:48.353512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4166855b-4523-4fef-850c-30392b9b4f2a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.361650 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4166855b-4523-4fef-850c-30392b9b4f2a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1520 microversion: 2.1 time: 0.192623 Jul 20 04:18:48.362920 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1370/2801] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:48.368709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb8414e6ee0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.378674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.379144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.379653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.386475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.386853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.387875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.388090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.410966 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6721b28d-d97c-4898-98f3-32c6c75dc423 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 204 len: 0 microversion: 2.47 time: 0.158525 Jul 20 04:18:48.416161 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1432/2802] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:18:48 2022] DELETE /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:48.420140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.420979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.440692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e3b932f1-ba17-454d-8811-a9f50d0fe536 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.442077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.442753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.449192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e3b932f1-ba17-454d-8811-a9f50d0fe536 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.485797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3b932f1-ba17-454d-8811-a9f50d0fe536 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.486682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:48.491766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3b932f1-ba17-454d-8811-a9f50d0fe536 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.496183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3b932f1-ba17-454d-8811-a9f50d0fe536 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.497257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3b932f1-ba17-454d-8811-a9f50d0fe536 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.525523 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-11fb263c-510a-48a4-bb11-287cca093e27 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-1600035705" status: 201 len: 0 microversion: 2.26 time: 0.160827 Jul 20 04:18:48.530720 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1371/2803] 10.222.0.59 () {62 vars in 1379 bytes} [Wed Jul 20 04:18:48 2022] PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-1600035705 => generated 0 bytes in 167 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 04:18:48.541118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bef6a0e2-a75f-4291-b9dc-d97b9b287361 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.541765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bef6a0e2-a75f-4291-b9dc-d97b9b287361 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.569738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bef6a0e2-a75f-4291-b9dc-d97b9b287361 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.570244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bef6a0e2-a75f-4291-b9dc-d97b9b287361 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.571076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bef6a0e2-a75f-4291-b9dc-d97b9b287361 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.571526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bef6a0e2-a75f-4291-b9dc-d97b9b287361 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.576388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:48.691320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e3b932f1-ba17-454d-8811-a9f50d0fe536 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.705475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e3b932f1-ba17-454d-8811-a9f50d0fe536 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.707819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e3b932f1-ba17-454d-8811-a9f50d0fe536 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.711948 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e3b932f1-ba17-454d-8811-a9f50d0fe536 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1362 microversion: 2.47 time: 0.290870 Jul 20 04:18:48.712745 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1433/2804] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:48.751821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bef6a0e2-a75f-4291-b9dc-d97b9b287361 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.756039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d54e6002-d1b6-47a3-b4f1-a36755ab27f0 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841b1edc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.772886 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bef6a0e2-a75f-4291-b9dc-d97b9b287361 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1347 microversion: 2.1 time: 0.230172 Jul 20 04:18:48.782548 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1372/2805] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1347 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:48.788236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d54e6002-d1b6-47a3-b4f1-a36755ab27f0 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.788895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d54e6002-d1b6-47a3-b4f1-a36755ab27f0 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.795285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-51656942-7f98-41d8-b183-c044fe18887d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.795954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-51656942-7f98-41d8-b183-c044fe18887d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.820368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51656942-7f98-41d8-b183-c044fe18887d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.822620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51656942-7f98-41d8-b183-c044fe18887d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.827560 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d54e6002-d1b6-47a3-b4f1-a36755ab27f0 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-1600035705" status: 204 len: 0 microversion: 2.26 time: 0.098466 Jul 20 04:18:48.828423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51656942-7f98-41d8-b183-c044fe18887d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.828918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51656942-7f98-41d8-b183-c044fe18887d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.831959 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1434/2806] 10.222.0.59 () {60 vars in 1360 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-1600035705 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:48.840709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841c8b430>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.877396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.882300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.890343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.916798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:48.919703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.920769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.921835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.923873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.968222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.969697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.008972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:49.058612 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d21a70d0-421e-43ed-8ba1-2b31c9a8c1e9 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 204 len: 0 microversion: 2.26 time: 0.221942 Jul 20 04:18:49.060186 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1435/2807] 10.222.0.59 () {60 vars in 1294 bytes} [Wed Jul 20 04:18:48 2022] DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:18:49.124404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-859188ac-07c2-4bbd-b540-906957cd3f05 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841b71f70>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.165757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859188ac-07c2-4bbd-b540-906957cd3f05 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.166237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859188ac-07c2-4bbd-b540-906957cd3f05 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.188876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:49.192327 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-859188ac-07c2-4bbd-b540-906957cd3f05 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 200 len: 12 microversion: 2.26 time: 0.125960 Jul 20 04:18:49.215372 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1436/2808] 10.222.0.59 () {60 vars in 1291 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 12 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:49.233580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-799c17c5-c5a3-46ad-ac18-67ea34971ca6 req-6b7d45b7-a98a-4d2e-a65f-c7bb427f0cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955c1609-40d3-47fd-9eac-8b879ecae2c8", "name": "network-vif-unplugged", "status": "completed", "tag": "384b5cd6-b0be-4fd8-994b-7c96785fc89b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:49.251323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-799c17c5-c5a3-46ad-ac18-67ea34971ca6 req-6b7d45b7-a98a-4d2e-a65f-c7bb427f0cc5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.251787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-799c17c5-c5a3-46ad-ac18-67ea34971ca6 req-6b7d45b7-a98a-4d2e-a65f-c7bb427f0cc5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.254744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-51656942-7f98-41d8-b183-c044fe18887d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.269258 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-51656942-7f98-41d8-b183-c044fe18887d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1502 microversion: 2.1 time: 0.492601 Jul 20 04:18:49.272015 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1373/2809] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1502 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:49.280187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841ca8a60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.296274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.298022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.299961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.304910 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-799c17c5-c5a3-46ad-ac18-67ea34971ca6 req-6b7d45b7-a98a-4d2e-a65f-c7bb427f0cc5 service nova] Creating event network-vif-unplugged:384b5cd6-b0be-4fd8-994b-7c96785fc89b for instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 on n-h2-760456-11 Jul 20 04:18:49.312070 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-799c17c5-c5a3-46ad-ac18-67ea34971ca6 req-6b7d45b7-a98a-4d2e-a65f-c7bb427f0cc5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095285 Jul 20 04:18:49.312687 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1437/2810] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:49.321026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.322098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.328742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.329011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8fc97d51-8588-4691-aa34-a3cbc42d1e1a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:49.330456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.336624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fc97d51-8588-4691-aa34-a3cbc42d1e1a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.337123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fc97d51-8588-4691-aa34-a3cbc42d1e1a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.367343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8fc97d51-8588-4691-aa34-a3cbc42d1e1a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Going to try to stop instance {{(pid=119606) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:18:49.395174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.396052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.420514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.421026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.431954 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8fc97d51-8588-4691-aa34-a3cbc42d1e1a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253/action" status: 202 len: 0 microversion: 2.1 time: 0.114890 Jul 20 04:18:49.438626 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1438/2811] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:49 2022] POST /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:49.452806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d2bccac-4817-43ae-93c3-5e8f4ad09fe6 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.454924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5d2bccac-4817-43ae-93c3-5e8f4ad09fe6 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.473025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d2bccac-4817-43ae-93c3-5e8f4ad09fe6 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.473419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d2bccac-4817-43ae-93c3-5e8f4ad09fe6 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.478490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d2bccac-4817-43ae-93c3-5e8f4ad09fe6 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.478972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d2bccac-4817-43ae-93c3-5e8f4ad09fe6 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.485555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:49.520849 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e3e14669-09a6-486a-927e-ff39d8e962fa tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-151489643" status: 201 len: 0 microversion: 2.26 time: 0.246721 Jul 20 04:18:49.527133 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1374/2812] 10.222.0.59 () {62 vars in 1376 bytes} [Wed Jul 20 04:18:49 2022] PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-151489643 => generated 0 bytes in 254 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:18:49.533941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-00bf8b27-eb7a-48d3-ad22-96700a7965e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.534743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-00bf8b27-eb7a-48d3-ad22-96700a7965e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.542445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00bf8b27-eb7a-48d3-ad22-96700a7965e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.542903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00bf8b27-eb7a-48d3-ad22-96700a7965e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.543752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00bf8b27-eb7a-48d3-ad22-96700a7965e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.544201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00bf8b27-eb7a-48d3-ad22-96700a7965e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.717445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5d2bccac-4817-43ae-93c3-5e8f4ad09fe6 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.728871 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d2bccac-4817-43ae-93c3-5e8f4ad09fe6 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1520 microversion: 2.1 time: 0.288919 Jul 20 04:18:49.731467 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1439/2813] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:49.736553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-376b83cb-abc4-491c-a426-5ce6d56a1fec tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb84217d5e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.737109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-00bf8b27-eb7a-48d3-ad22-96700a7965e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.748454 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-00bf8b27-eb7a-48d3-ad22-96700a7965e5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.219888 Jul 20 04:18:49.749311 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1375/2814] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:49.760481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8434cb87-e365-46e6-936a-3fac861ae54c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.760860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-376b83cb-abc4-491c-a426-5ce6d56a1fec tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.761321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-376b83cb-abc4-491c-a426-5ce6d56a1fec tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.762376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8434cb87-e365-46e6-936a-3fac861ae54c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.787798 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-376b83cb-abc4-491c-a426-5ce6d56a1fec tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 200 len: 35 microversion: 2.26 time: 0.055215 Jul 20 04:18:49.793151 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1440/2815] 10.222.0.59 () {60 vars in 1291 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 35 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:49.793742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-56ad9506-6b2c-4f77-a0e2-2edeb64d06ac tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.794429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-56ad9506-6b2c-4f77-a0e2-2edeb64d06ac tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.799413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8434cb87-e365-46e6-936a-3fac861ae54c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.800619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8434cb87-e365-46e6-936a-3fac861ae54c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.802779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8434cb87-e365-46e6-936a-3fac861ae54c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.803412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8434cb87-e365-46e6-936a-3fac861ae54c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.811920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56ad9506-6b2c-4f77-a0e2-2edeb64d06ac tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.812384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56ad9506-6b2c-4f77-a0e2-2edeb64d06ac tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.813170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56ad9506-6b2c-4f77-a0e2-2edeb64d06ac tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.813612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56ad9506-6b2c-4f77-a0e2-2edeb64d06ac tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.953703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8434cb87-e365-46e6-936a-3fac861ae54c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.968248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8434cb87-e365-46e6-936a-3fac861ae54c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.970157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8434cb87-e365-46e6-936a-3fac861ae54c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.972228 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8434cb87-e365-46e6-936a-3fac861ae54c tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 200 len: 1362 microversion: 2.47 time: 0.222041 Jul 20 04:18:49.973391 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1376/2816] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:49.980075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb8415379d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.989052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.989929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.990734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.997718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.998562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.999943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.000622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.033430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.034335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.074373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:50.099897 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f1beeba1-0d30-4d9b-a14a-5116216f712f tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-151489643" status: 204 len: 0 microversion: 2.26 time: 0.125082 Jul 20 04:18:50.101821 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1377/2817] 10.222.0.59 () {60 vars in 1360 bytes} [Wed Jul 20 04:18:49 2022] DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-151489643 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:50.111108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d6086ac-8af2-459e-bf80-9f04c3dc5a06 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb8414bed30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.127165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d6086ac-8af2-459e-bf80-9f04c3dc5a06 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.128411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d6086ac-8af2-459e-bf80-9f04c3dc5a06 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.146372 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d6086ac-8af2-459e-bf80-9f04c3dc5a06 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 200 len: 12 microversion: 2.26 time: 0.040160 Jul 20 04:18:50.148255 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1378/2818] 10.222.0.59 () {60 vars in 1291 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 12 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:50.179421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841d1a4c0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.198019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.202049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.207158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.219639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.220618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.221711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.223685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.267976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-56ad9506-6b2c-4f77-a0e2-2edeb64d06ac tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.278461 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-56ad9506-6b2c-4f77-a0e2-2edeb64d06ac tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1403 microversion: 2.1 time: 0.488570 Jul 20 04:18:50.279535 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1441/2819] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1403 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:50.285542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.286141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.309313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:50.326024 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8bea6a4e-e8f7-4e2f-959a-8aa74f0a8b22 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 204 len: 0 microversion: 2.26 time: 0.158279 Jul 20 04:18:50.327336 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1379/2820] 10.222.0.59 () {60 vars in 1294 bytes} [Wed Jul 20 04:18:50 2022] DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:50.338683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841a59af0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.349625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.350082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.350596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.369580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.370042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.370858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.371307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.431514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.432174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.450856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.451317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.511750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:50.548281 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cf73ad95-1145-4e39-86dc-853d00604fe5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-784423650" status: 201 len: 0 microversion: 2.26 time: 0.214850 Jul 20 04:18:50.549108 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1442/2821] 10.222.0.59 () {62 vars in 1376 bytes} [Wed Jul 20 04:18:50 2022] PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-784423650 => generated 0 bytes in 216 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:18:50.561330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841537d30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.575658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.576110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.576592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.591592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.592052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.592888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.593327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.669758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.670359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.692663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.693040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.731744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:50.748866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-231bccb4-0d0f-4603-a645-2f611410448f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.749570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-231bccb4-0d0f-4603-a645-2f611410448f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.754604 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cd6458a4-f1b1-4e97-ad16-221b72947a12 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-952877152" status: 201 len: 0 microversion: 2.26 time: 0.197148 Jul 20 04:18:50.755605 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1380/2822] 10.222.0.59 () {62 vars in 1376 bytes} [Wed Jul 20 04:18:50 2022] PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-952877152 => generated 0 bytes in 199 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:18:50.762625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-231bccb4-0d0f-4603-a645-2f611410448f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.763093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-231bccb4-0d0f-4603-a645-2f611410448f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.765961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-231bccb4-0d0f-4603-a645-2f611410448f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.767426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841c3bdc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.769275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-231bccb4-0d0f-4603-a645-2f611410448f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.781886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.782612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.783223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.792228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.794127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.795215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.795787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.830341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.831733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.850675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:50.874508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6a41d91-b944-4fec-9a16-c26b01ba2153 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 204 len: 0 microversion: 2.26 time: 0.113577 Jul 20 04:18:50.875964 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1381/2823] 10.222.0.59 () {60 vars in 1294 bytes} [Wed Jul 20 04:18:50 2022] DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:50.882111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-247a1007-d177-4a6b-88ca-659e590d7e5c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.883631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-247a1007-d177-4a6b-88ca-659e590d7e5c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.894182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247a1007-d177-4a6b-88ca-659e590d7e5c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.895069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247a1007-d177-4a6b-88ca-659e590d7e5c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.895848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247a1007-d177-4a6b-88ca-659e590d7e5c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.896301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247a1007-d177-4a6b-88ca-659e590d7e5c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.172407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-247a1007-d177-4a6b-88ca-659e590d7e5c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:51.181904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-247a1007-d177-4a6b-88ca-659e590d7e5c tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.304444 Jul 20 04:18:51.183051 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1382/2824] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:51.188625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-022e4593-21a0-42b7-aa93-7a53ae64df40 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841537040>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.197346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-022e4593-21a0-42b7-aa93-7a53ae64df40 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.197975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-022e4593-21a0-42b7-aa93-7a53ae64df40 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.208511 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-022e4593-21a0-42b7-aa93-7a53ae64df40 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 200 len: 12 microversion: 2.26 time: 0.024178 Jul 20 04:18:51.209445 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1383/2825] 10.222.0.59 () {60 vars in 1291 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 12 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:51.215063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-564ddac9-3845-4197-a79e-2630e2c02233 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.215991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-564ddac9-3845-4197-a79e-2630e2c02233 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: e75de308-fc76-40f7-b6d6-3cd32ed4528a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.225934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-564ddac9-3845-4197-a79e-2630e2c02233 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.226691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-564ddac9-3845-4197-a79e-2630e2c02233 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.228037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-564ddac9-3845-4197-a79e-2630e2c02233 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.228649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-564ddac9-3845-4197-a79e-2630e2c02233 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.245744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:51.247394 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-564ddac9-3845-4197-a79e-2630e2c02233 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] HTTP exception thrown: Instance e75de308-fc76-40f7-b6d6-3cd32ed4528a could not be found. Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-564ddac9-3845-4197-a79e-2630e2c02233 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Request method failure captured: Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a HTTP/1.1 Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14H1TwhwTk_q4vmwdKfp2lOWY8NOYfdeABtXg60EWrznNOV6rkk1-RaoJe0VA9feFH4xILj0Pt6SLhbnqIZGA0_IxoFZOqhC1Wq1en4ixvvm8NDq4xDO7NvZzNu_pkO0ow-UOn78eFzbu94a-EEzJykWBdLNN82lCNT6ib1oytsbLrs Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d3648eec6bd9498e811fcd54d4a74a4e Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerShowV247Test-1393442900 Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d3648eec6bd9498e811fcd54d4a74a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3648eec6bd9498e811fcd54d4a74a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3648eec6bd9498e811fcd54d4a74a4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d3648eec6bd9498e811fcd54d4a74a4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerShowV247Test-1393442900 Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d3648eec6bd9498e811fcd54d4a74a4e Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerShowV247Test-1393442900 Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerShowV247Test-1393442900-project Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 90440a594d7b49aa9cf9eca682a620fe Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerShowV247Test-1393442900-project Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance e75de308-fc76-40f7-b6d6-3cd32ed4528a could not be found. Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'e75de308-fc76-40f7-b6d6-3cd32ed4528a'} Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e75de308-fc76-40f7-b6d6-3cd32ed4528a could not be found. Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e75de308-fc76-40f7-b6d6-3cd32ed4528a could not be found. Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:51.249382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:51.254868 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:51.254868 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:51.254868 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:51.254868 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:51.254868 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:51.254868 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e75de308-fc76-40f7-b6d6-3cd32ed4528a could not be found. Jul 20 04:18:51.254868 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:51.256707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-564ddac9-3845-4197-a79e-2630e2c02233 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Returning 404 to user: Instance e75de308-fc76-40f7-b6d6-3cd32ed4528a could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:51.257788 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-564ddac9-3845-4197-a79e-2630e2c02233 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a" status: 404 len: 111 microversion: 2.47 time: 0.047403 Jul 20 04:18:51.261929 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1384/2826] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/e75de308-fc76-40f7-b6d6-3cd32ed4528a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:51.274193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841c3bd30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.302688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.302688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.302688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.306152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.306715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.307542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.307991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.339217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.339669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.353092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:51.369759 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5a6217ae-d406-4fdd-aa3b-3e4b30382c0c tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 204 len: 0 microversion: 2.26 time: 0.103611 Jul 20 04:18:51.370622 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1385/2827] 10.222.0.59 () {60 vars in 1294 bytes} [Wed Jul 20 04:18:51 2022] DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:51.375311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a4ffb04c-f1ae-421f-978b-66328f80d634 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.375820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a4ffb04c-f1ae-421f-978b-66328f80d634 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: 4801c818-b8aa-48fd-b501-22551037516a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.383618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4ffb04c-f1ae-421f-978b-66328f80d634 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.384081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4ffb04c-f1ae-421f-978b-66328f80d634 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.384871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4ffb04c-f1ae-421f-978b-66328f80d634 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.385318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4ffb04c-f1ae-421f-978b-66328f80d634 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.417570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a4ffb04c-f1ae-421f-978b-66328f80d634 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: 4801c818-b8aa-48fd-b501-22551037516a] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:51.497710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-231bccb4-0d0f-4603-a645-2f611410448f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:51.510484 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-231bccb4-0d0f-4603-a645-2f611410448f tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1520 microversion: 2.1 time: 0.765778 Jul 20 04:18:51.511936 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1443/2828] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1520 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:51.517426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-21291b47-7371-4b6e-8843-133230948dbe tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.519751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-21291b47-7371-4b6e-8843-133230948dbe tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.540714 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a4ffb04c-f1ae-421f-978b-66328f80d634 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a" status: 204 len: 0 microversion: 2.47 time: 0.168040 Jul 20 04:18:51.543960 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1386/2829] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:18:51 2022] DELETE /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:51.545865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-511c8a6f-adc2-40c2-af81-58e06183b939 req-6a78e43e-473a-4982-ba78-3519bbad9845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955c1609-40d3-47fd-9eac-8b879ecae2c8", "name": "network-vif-plugged", "status": "completed", "tag": "384b5cd6-b0be-4fd8-994b-7c96785fc89b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:51.556660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-21291b47-7371-4b6e-8843-133230948dbe tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.557575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-21291b47-7371-4b6e-8843-133230948dbe tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.558821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-21291b47-7371-4b6e-8843-133230948dbe tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.560640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-21291b47-7371-4b6e-8843-133230948dbe tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.586641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-511c8a6f-adc2-40c2-af81-58e06183b939 req-6a78e43e-473a-4982-ba78-3519bbad9845 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.593166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-511c8a6f-adc2-40c2-af81-58e06183b939 req-6a78e43e-473a-4982-ba78-3519bbad9845 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.625722 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-511c8a6f-adc2-40c2-af81-58e06183b939 req-6a78e43e-473a-4982-ba78-3519bbad9845 service nova] Creating event network-vif-plugged:384b5cd6-b0be-4fd8-994b-7c96785fc89b for instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 on n-h2-760456-11 Jul 20 04:18:51.636695 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-511c8a6f-adc2-40c2-af81-58e06183b939 req-6a78e43e-473a-4982-ba78-3519bbad9845 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094363 Jul 20 04:18:51.640491 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1387/2830] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:51.663129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb84273a9d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.687053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.692958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.693571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.724950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.726433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.727369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.729812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.784430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.785267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.795692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.796302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.827143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:51.849108 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9753efa2-1bdd-4d09-8aff-7359e31a7acf tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-2060603663" status: 201 len: 0 microversion: 2.26 time: 0.207219 Jul 20 04:18:51.852132 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1388/2831] 10.222.0.59 () {62 vars in 1379 bytes} [Wed Jul 20 04:18:51 2022] PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-2060603663 => generated 0 bytes in 211 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 04:18:51.860166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-14d8a007-85b9-4dda-9c2a-c54682493e81 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.860810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-14d8a007-85b9-4dda-9c2a-c54682493e81 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: 4801c818-b8aa-48fd-b501-22551037516a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.874334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14d8a007-85b9-4dda-9c2a-c54682493e81 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.874917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14d8a007-85b9-4dda-9c2a-c54682493e81 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.875727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14d8a007-85b9-4dda-9c2a-c54682493e81 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.876176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14d8a007-85b9-4dda-9c2a-c54682493e81 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.135325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-14d8a007-85b9-4dda-9c2a-c54682493e81 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.144131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-14d8a007-85b9-4dda-9c2a-c54682493e81 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.145676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-14d8a007-85b9-4dda-9c2a-c54682493e81 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.154082 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-14d8a007-85b9-4dda-9c2a-c54682493e81 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a" status: 200 len: 1363 microversion: 2.47 time: 0.300694 Jul 20 04:18:52.154721 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1389/2832] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:52.167119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841d1a0d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.201427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-21291b47-7371-4b6e-8843-133230948dbe tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.215283 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-21291b47-7371-4b6e-8843-133230948dbe tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1403 microversion: 2.1 time: 0.701857 Jul 20 04:18:52.216040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.216511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.217002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.229686 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1444/2833] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1403 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:52.242812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1dc83af1-857f-465d-b3bf-685dd651bd8d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.245116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.246314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1dc83af1-857f-465d-b3bf-685dd651bd8d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.251439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.252199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.253453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.278502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc83af1-857f-465d-b3bf-685dd651bd8d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.280326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc83af1-857f-465d-b3bf-685dd651bd8d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.283027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc83af1-857f-465d-b3bf-685dd651bd8d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.286184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc83af1-857f-465d-b3bf-685dd651bd8d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.317049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.317606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.362774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.363236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.421211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:52.472209 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1a6dea2e-5188-4614-bca1-359e1a6ad3ab tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-1365784979" status: 201 len: 0 microversion: 2.26 time: 0.316386 Jul 20 04:18:52.473040 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1390/2834] 10.222.0.59 () {62 vars in 1379 bytes} [Wed Jul 20 04:18:52 2022] PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags/tempest-tag-1365784979 => generated 0 bytes in 318 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 04:18:52.477514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1080b91a-b9c2-4531-9b8b-0d31376b5589 req-8178c322-0309-4f3e-9114-cdfb349be7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ef29d2-7202-47d0-9f12-3a9b7999aa49", "tag": "e88a60e1-f505-4b66-8189-731bf232b933"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:52.495400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1080b91a-b9c2-4531-9b8b-0d31376b5589 req-8178c322-0309-4f3e-9114-cdfb349be7a4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.495837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1080b91a-b9c2-4531-9b8b-0d31376b5589 req-8178c322-0309-4f3e-9114-cdfb349be7a4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.509598 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1080b91a-b9c2-4531-9b8b-0d31376b5589 req-8178c322-0309-4f3e-9114-cdfb349be7a4 service nova] Creating event network-changed:e88a60e1-f505-4b66-8189-731bf232b933 for instance 98ef29d2-7202-47d0-9f12-3a9b7999aa49 on n-h1-760456-11 Jul 20 04:18:52.521276 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1080b91a-b9c2-4531-9b8b-0d31376b5589 req-8178c322-0309-4f3e-9114-cdfb349be7a4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047149 Jul 20 04:18:52.524640 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1391/2835] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:52.542700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Action: 'update_all', calling method: .version_select at 0x7fb841f65280>, body: {"tags": ["tempest-tag-22840782", "tempest-tag-1226657535"]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:52.567419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.567955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.568596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.584514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.584978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.585780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.586224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.640171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.640794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.687516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:52.724865 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a555651b-afa5-4763-bb80-e7633c497dfd tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 200 len: 60 microversion: 2.26 time: 0.198945 Jul 20 04:18:52.730343 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1392/2836] 10.222.0.59 () {62 vars in 1311 bytes} [Wed Jul 20 04:18:52 2022] PUT /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 60 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:52.735232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eef1334a-60ab-496d-b4d4-95cde1f82515 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.735860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eef1334a-60ab-496d-b4d4-95cde1f82515 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.763984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eef1334a-60ab-496d-b4d4-95cde1f82515 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.764510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eef1334a-60ab-496d-b4d4-95cde1f82515 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.765371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eef1334a-60ab-496d-b4d4-95cde1f82515 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.765820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eef1334a-60ab-496d-b4d4-95cde1f82515 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.797429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1dc83af1-857f-465d-b3bf-685dd651bd8d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.812324 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1dc83af1-857f-465d-b3bf-685dd651bd8d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.579925 Jul 20 04:18:52.814049 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1445/2837] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:52 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:52.830972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-749abdf1-f2d2-4829-a668-6353e77515d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841b1edc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.861317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-749abdf1-f2d2-4829-a668-6353e77515d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.862933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-749abdf1-f2d2-4829-a668-6353e77515d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.881901 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-749abdf1-f2d2-4829-a668-6353e77515d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 200 len: 60 microversion: 2.26 time: 0.064713 Jul 20 04:18:52.883535 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1446/2838] 10.222.0.59 () {60 vars in 1291 bytes} [Wed Jul 20 04:18:52 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 60 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:52.893636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '.version_select at 0x7fb841109ee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.902374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.903417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.904195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.911997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.913596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.914765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.915460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.948735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.950021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.981624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lazy-loading 'flavor' on Instance uuid 93afd1ba-4760-4b7d-bf7a-3fe39780de1d {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:53.000806 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6468aca9-74ff-4d14-ba1f-00b49a19fdd7 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags" status: 204 len: 0 microversion: 2.26 time: 0.111800 Jul 20 04:18:53.009254 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1447/2839] 10.222.0.59 () {60 vars in 1294 bytes} [Wed Jul 20 04:18:52 2022] DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d/tags => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:53.014873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b2bfbb8c-d43d-4671-8de2-301689a42f7a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.015635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b2bfbb8c-d43d-4671-8de2-301689a42f7a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.023688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2bfbb8c-d43d-4671-8de2-301689a42f7a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.024524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2bfbb8c-d43d-4671-8de2-301689a42f7a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.026210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2bfbb8c-d43d-4671-8de2-301689a42f7a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.026947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2bfbb8c-d43d-4671-8de2-301689a42f7a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.045214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eef1334a-60ab-496d-b4d4-95cde1f82515 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.057092 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eef1334a-60ab-496d-b4d4-95cde1f82515 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1520 microversion: 2.1 time: 0.325579 Jul 20 04:18:53.059033 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1393/2840] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:52 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:53.061235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b2bfbb8c-d43d-4671-8de2-301689a42f7a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:53.177988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-62090b13-14c9-4572-9d34-2c6ff6d9ac8b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.179012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-62090b13-14c9-4572-9d34-2c6ff6d9ac8b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: 4801c818-b8aa-48fd-b501-22551037516a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.200497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62090b13-14c9-4572-9d34-2c6ff6d9ac8b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.202115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62090b13-14c9-4572-9d34-2c6ff6d9ac8b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.205302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62090b13-14c9-4572-9d34-2c6ff6d9ac8b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.206937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62090b13-14c9-4572-9d34-2c6ff6d9ac8b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.230455 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b2bfbb8c-d43d-4671-8de2-301689a42f7a tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 204 len: 0 microversion: 2.26 time: 0.219186 Jul 20 04:18:53.236524 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1448/2841] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:18:53 2022] DELETE /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:18:53.248892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-98a9a645-2239-4e22-b2fd-ef7475d33d15 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.251638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-98a9a645-2239-4e22-b2fd-ef7475d33d15 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.271229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98a9a645-2239-4e22-b2fd-ef7475d33d15 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.271849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98a9a645-2239-4e22-b2fd-ef7475d33d15 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.272866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98a9a645-2239-4e22-b2fd-ef7475d33d15 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.273676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98a9a645-2239-4e22-b2fd-ef7475d33d15 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.320281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-62090b13-14c9-4572-9d34-2c6ff6d9ac8b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.331071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-62090b13-14c9-4572-9d34-2c6ff6d9ac8b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.337497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-62090b13-14c9-4572-9d34-2c6ff6d9ac8b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.338789 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-62090b13-14c9-4572-9d34-2c6ff6d9ac8b tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a" status: 200 len: 1363 microversion: 2.47 time: 0.167600 Jul 20 04:18:53.339869 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1394/2842] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:53.345165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f30f90c-e1da-4f8f-93af-334e34aa0bbc tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.345777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8f30f90c-e1da-4f8f-93af-334e34aa0bbc tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.364798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f30f90c-e1da-4f8f-93af-334e34aa0bbc tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.365273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f30f90c-e1da-4f8f-93af-334e34aa0bbc tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.366088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f30f90c-e1da-4f8f-93af-334e34aa0bbc tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.370512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f30f90c-e1da-4f8f-93af-334e34aa0bbc tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.695708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-98a9a645-2239-4e22-b2fd-ef7475d33d15 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.713330 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-98a9a645-2239-4e22-b2fd-ef7475d33d15 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1403 microversion: 2.1 time: 0.474621 Jul 20 04:18:53.718728 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1449/2843] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1403 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:53.832917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-95cc5783-e1bf-4ea1-88fc-c043e44a977e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.833776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-95cc5783-e1bf-4ea1-88fc-c043e44a977e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.864877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95cc5783-e1bf-4ea1-88fc-c043e44a977e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.869367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95cc5783-e1bf-4ea1-88fc-c043e44a977e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.870857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95cc5783-e1bf-4ea1-88fc-c043e44a977e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.871609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95cc5783-e1bf-4ea1-88fc-c043e44a977e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.879942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:54.100098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8f30f90c-e1da-4f8f-93af-334e34aa0bbc tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.106472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=2,nova_cell1:UPDATE=1,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:54.112561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8f30f90c-e1da-4f8f-93af-334e34aa0bbc tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.114097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8f30f90c-e1da-4f8f-93af-334e34aa0bbc tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.115406 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8f30f90c-e1da-4f8f-93af-334e34aa0bbc tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1553 microversion: 2.26 time: 0.774718 Jul 20 04:18:54.115972 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1395/2844] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1553 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:54.121169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-65340d3d-ec14-4cfb-856e-7ace0dd91778 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.122486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-65340d3d-ec14-4cfb-856e-7ace0dd91778 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.149489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65340d3d-ec14-4cfb-856e-7ace0dd91778 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.150910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65340d3d-ec14-4cfb-856e-7ace0dd91778 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.154135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65340d3d-ec14-4cfb-856e-7ace0dd91778 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.155046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65340d3d-ec14-4cfb-856e-7ace0dd91778 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.162781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-95cc5783-e1bf-4ea1-88fc-c043e44a977e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.174001 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-95cc5783-e1bf-4ea1-88fc-c043e44a977e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.347143 Jul 20 04:18:54.176647 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1450/2845] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:54.358089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.359482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: 4801c818-b8aa-48fd-b501-22551037516a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.371776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.374583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.376428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.378672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.454733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-65340d3d-ec14-4cfb-856e-7ace0dd91778 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.464735 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-65340d3d-ec14-4cfb-856e-7ace0dd91778 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1520 microversion: 2.1 time: 0.347686 Jul 20 04:18:54.466290 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1396/2846] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:54.484371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.485358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.486335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lazy-loading 'fault' on Instance uuid 4801c818-b8aa-48fd-b501-22551037516a {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:54.536476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.553950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.555019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90440a594d7b49aa9cf9eca682a620fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3648eec6bd9498e811fcd54d4a74a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.556233 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b37b5141-3692-4b47-9aff-362a66f1b970 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a" status: 200 len: 1368 microversion: 2.47 time: 0.202476 Jul 20 04:18:54.556803 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1451/2847] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:54.737527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e900b53a-2651-43c7-ac83-05eccac934b7 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.738170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e900b53a-2651-43c7-ac83-05eccac934b7 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.745135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e900b53a-2651-43c7-ac83-05eccac934b7 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.745609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e900b53a-2651-43c7-ac83-05eccac934b7 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.746618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e900b53a-2651-43c7-ac83-05eccac934b7 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.747222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e900b53a-2651-43c7-ac83-05eccac934b7 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.914835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e900b53a-2651-43c7-ac83-05eccac934b7 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.922373 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e900b53a-2651-43c7-ac83-05eccac934b7 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1403 microversion: 2.1 time: 0.190345 Jul 20 04:18:54.923163 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1397/2848] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1403 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:55.135208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d2a94fb5-f050-403d-9b95-5930f5a0c6d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.135869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d2a94fb5-f050-403d-9b95-5930f5a0c6d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.143016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2a94fb5-f050-403d-9b95-5930f5a0c6d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.143817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2a94fb5-f050-403d-9b95-5930f5a0c6d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.144613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2a94fb5-f050-403d-9b95-5930f5a0c6d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.145144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2a94fb5-f050-403d-9b95-5930f5a0c6d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.193057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-51e252c9-7726-4d23-9b28-7131e1788f3b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.193616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-51e252c9-7726-4d23-9b28-7131e1788f3b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.205186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51e252c9-7726-4d23-9b28-7131e1788f3b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.206379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51e252c9-7726-4d23-9b28-7131e1788f3b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.207589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51e252c9-7726-4d23-9b28-7131e1788f3b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.208198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51e252c9-7726-4d23-9b28-7131e1788f3b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.287955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d2a94fb5-f050-403d-9b95-5930f5a0c6d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.297501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d2a94fb5-f050-403d-9b95-5930f5a0c6d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.300456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d2a94fb5-f050-403d-9b95-5930f5a0c6d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.301713 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d2a94fb5-f050-403d-9b95-5930f5a0c6d5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1553 microversion: 2.26 time: 0.171091 Jul 20 04:18:55.302304 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1452/2849] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:55.365240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-51e252c9-7726-4d23-9b28-7131e1788f3b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.373642 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-51e252c9-7726-4d23-9b28-7131e1788f3b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.184445 Jul 20 04:18:55.374552 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1398/2850] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:55.484482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-abd3a632-94a0-4250-9ea6-a4523dce59be tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.489009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-abd3a632-94a0-4250-9ea6-a4523dce59be tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.504097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abd3a632-94a0-4250-9ea6-a4523dce59be tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.504097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abd3a632-94a0-4250-9ea6-a4523dce59be tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.504413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abd3a632-94a0-4250-9ea6-a4523dce59be tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.505055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abd3a632-94a0-4250-9ea6-a4523dce59be tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.575947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3f25693-dd92-4f4c-b52e-4d58ca212d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.577920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d3f25693-dd92-4f4c-b52e-4d58ca212d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] [instance: 4801c818-b8aa-48fd-b501-22551037516a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.589623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3f25693-dd92-4f4c-b52e-4d58ca212d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.590533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3f25693-dd92-4f4c-b52e-4d58ca212d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.592109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3f25693-dd92-4f4c-b52e-4d58ca212d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.592752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3f25693-dd92-4f4c-b52e-4d58ca212d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.618868 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-d3f25693-dd92-4f4c-b52e-4d58ca212d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] HTTP exception thrown: Instance 4801c818-b8aa-48fd-b501-22551037516a could not be found. Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3f25693-dd92-4f4c-b52e-4d58ca212d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Request method failure captured: Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a HTTP/1.1 Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14H1TwhwTk_q4vmwdKfp2lOWY8NOYfdeABtXg60EWrznNOV6rkk1-RaoJe0VA9feFH4xILj0Pt6SLhbnqIZGA0_IxoFZOqhC1Wq1en4ixvvm8NDq4xDO7NvZzNu_pkO0ow-UOn78eFzbu94a-EEzJykWBdLNN82lCNT6ib1oytsbLrs Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d3648eec6bd9498e811fcd54d4a74a4e Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerShowV247Test-1393442900 Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d3648eec6bd9498e811fcd54d4a74a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3648eec6bd9498e811fcd54d4a74a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3648eec6bd9498e811fcd54d4a74a4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d3648eec6bd9498e811fcd54d4a74a4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerShowV247Test-1393442900 Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d3648eec6bd9498e811fcd54d4a74a4e Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerShowV247Test-1393442900 Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerShowV247Test-1393442900-project Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 90440a594d7b49aa9cf9eca682a620fe Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerShowV247Test-1393442900-project Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4801c818-b8aa-48fd-b501-22551037516a could not be found. Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4801c818-b8aa-48fd-b501-22551037516a'} Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4801c818-b8aa-48fd-b501-22551037516a could not be found. Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4801c818-b8aa-48fd-b501-22551037516a could not be found. Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:55.622331 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:55.626192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:55.626192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:55.626192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:55.626192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:55.626192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:55.626192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4801c818-b8aa-48fd-b501-22551037516a could not be found. Jul 20 04:18:55.626192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:18:55.629566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3f25693-dd92-4f4c-b52e-4d58ca212d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] Returning 404 to user: Instance 4801c818-b8aa-48fd-b501-22551037516a could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:55.631040 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d3f25693-dd92-4f4c-b52e-4d58ca212d25 tempest-ServerShowV247Test-1393442900 tempest-ServerShowV247Test-1393442900-project] 10.222.0.59 "GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a" status: 404 len: 111 microversion: 2.47 time: 0.059194 Jul 20 04:18:55.635921 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1399/2851] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/4801c818-b8aa-48fd-b501-22551037516a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:18:55.672953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ee6f296-7e79-40ca-a111-600810410935 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.682941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ee6f296-7e79-40ca-a111-600810410935 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.699776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ee6f296-7e79-40ca-a111-600810410935 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.700025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ee6f296-7e79-40ca-a111-600810410935 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.700780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ee6f296-7e79-40ca-a111-600810410935 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.701221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ee6f296-7e79-40ca-a111-600810410935 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.788442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ee6f296-7e79-40ca-a111-600810410935 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:55.833277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-abd3a632-94a0-4250-9ea6-a4523dce59be tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.853740 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-abd3a632-94a0-4250-9ea6-a4523dce59be tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1505 microversion: 2.1 time: 0.373948 Jul 20 04:18:55.868925 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1453/2852] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:55.893921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0aacd011-ca82-441b-80ea-25e9651c25ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.895485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0aacd011-ca82-441b-80ea-25e9651c25ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.902667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aacd011-ca82-441b-80ea-25e9651c25ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.903138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aacd011-ca82-441b-80ea-25e9651c25ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.904015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aacd011-ca82-441b-80ea-25e9651c25ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.904488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aacd011-ca82-441b-80ea-25e9651c25ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.984701 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ee6f296-7e79-40ca-a111-600810410935 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "DELETE /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 204 len: 0 microversion: 2.25 time: 0.316511 Jul 20 04:18:55.989717 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1400/2853] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:18:55 2022] DELETE /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:18:56.005776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-010e3922-29c9-48bd-a96a-a405e75ac2cb tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:56.008330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-010e3922-29c9-48bd-a96a-a405e75ac2cb tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:56.028387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-010e3922-29c9-48bd-a96a-a405e75ac2cb tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.028849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-010e3922-29c9-48bd-a96a-a405e75ac2cb tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.029644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-010e3922-29c9-48bd-a96a-a405e75ac2cb tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.030082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-010e3922-29c9-48bd-a96a-a405e75ac2cb tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.149749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:56.169590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=10 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:56.310052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-010e3922-29c9-48bd-a96a-a405e75ac2cb tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:56.322590 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-010e3922-29c9-48bd-a96a-a405e75ac2cb tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1403 microversion: 2.1 time: 0.330988 Jul 20 04:18:56.326645 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1401/2854] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1403 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:56.338114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0e2644f8-fd91-4c3b-9884-7b4fe00f63cd tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:56.338853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0e2644f8-fd91-4c3b-9884-7b4fe00f63cd tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:56.350902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e2644f8-fd91-4c3b-9884-7b4fe00f63cd tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.354763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e2644f8-fd91-4c3b-9884-7b4fe00f63cd tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.355820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0aacd011-ca82-441b-80ea-25e9651c25ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:56.356733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e2644f8-fd91-4c3b-9884-7b4fe00f63cd tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.357991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e2644f8-fd91-4c3b-9884-7b4fe00f63cd tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.371303 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0aacd011-ca82-441b-80ea-25e9651c25ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 200 len: 1505 microversion: 2.1 time: 0.501494 Jul 20 04:18:56.372224 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1454/2855] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:56.382401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1fe24997-526c-44d3-96a0-565a94b4f7c5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:56.382892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1fe24997-526c-44d3-96a0-565a94b4f7c5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:56.412562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe24997-526c-44d3-96a0-565a94b4f7c5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.413210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe24997-526c-44d3-96a0-565a94b4f7c5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.415087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe24997-526c-44d3-96a0-565a94b4f7c5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.416801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe24997-526c-44d3-96a0-565a94b4f7c5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.083636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0e2644f8-fd91-4c3b-9884-7b4fe00f63cd tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.092149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0e2644f8-fd91-4c3b-9884-7b4fe00f63cd tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.107029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0e2644f8-fd91-4c3b-9884-7b4fe00f63cd tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.112486 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0e2644f8-fd91-4c3b-9884-7b4fe00f63cd tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1731 microversion: 2.25 time: 0.780008 Jul 20 04:18:57.118934 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1402/2856] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:56 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1731 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:57.124122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56181fed-f8ed-49c3-bd0f-10483253cac2 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.139379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-56181fed-f8ed-49c3-bd0f-10483253cac2 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.140913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:57.159797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56181fed-f8ed-49c3-bd0f-10483253cac2 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.171307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56181fed-f8ed-49c3-bd0f-10483253cac2 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.172461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56181fed-f8ed-49c3-bd0f-10483253cac2 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.173075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56181fed-f8ed-49c3-bd0f-10483253cac2 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.271532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-56181fed-f8ed-49c3-bd0f-10483253cac2 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:57.392644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1fe24997-526c-44d3-96a0-565a94b4f7c5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.396698 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-56181fed-f8ed-49c3-bd0f-10483253cac2 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "DELETE /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 204 len: 0 microversion: 2.1 time: 0.275775 Jul 20 04:18:57.398679 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1403/2857] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:57 2022] DELETE /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:57.419900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1fe24997-526c-44d3-96a0-565a94b4f7c5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.435558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4db4b92-fc2e-436f-94ae-7143424eb8e0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.439459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b4db4b92-fc2e-436f-94ae-7143424eb8e0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.442125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1fe24997-526c-44d3-96a0-565a94b4f7c5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c64b6d02ce1a450e8826d0b9b46e0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea3071b7d644f0b3bde8406b2ff995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.449665 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1fe24997-526c-44d3-96a0-565a94b4f7c5 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 200 len: 1553 microversion: 2.26 time: 1.076326 Jul 20 04:18:57.459618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4db4b92-fc2e-436f-94ae-7143424eb8e0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.460488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4db4b92-fc2e-436f-94ae-7143424eb8e0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.462228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4db4b92-fc2e-436f-94ae-7143424eb8e0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.465786 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1455/2858] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:56 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 1553 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:57.474950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4db4b92-fc2e-436f-94ae-7143424eb8e0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.487015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-aef272ac-6c79-42be-b72e-6a1367655cdc req-deb3c322-a1c9-4d2a-90c8-c6315bb0458b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93afd1ba-4760-4b7d-bf7a-3fe39780de1d", "name": "network-vif-deleted", "tag": "0afd9b9b-77c8-44e8-a450-9b96ce3fe8a2"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:57.545188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-aef272ac-6c79-42be-b72e-6a1367655cdc req-deb3c322-a1c9-4d2a-90c8-c6315bb0458b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.555695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-aef272ac-6c79-42be-b72e-6a1367655cdc req-deb3c322-a1c9-4d2a-90c8-c6315bb0458b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.586932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:57.616509 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-aef272ac-6c79-42be-b72e-6a1367655cdc req-deb3c322-a1c9-4d2a-90c8-c6315bb0458b service nova] Creating event network-vif-deleted:0afd9b9b-77c8-44e8-a450-9b96ce3fe8a2 for instance 93afd1ba-4760-4b7d-bf7a-3fe39780de1d on n-h1-760456-11 Jul 20 04:18:57.630412 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-aef272ac-6c79-42be-b72e-6a1367655cdc req-deb3c322-a1c9-4d2a-90c8-c6315bb0458b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161588 Jul 20 04:18:57.639011 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1456/2859] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:57.665457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a764398-d4fc-4ff7-aba7-2ba0b942ee39 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.670065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1a764398-d4fc-4ff7-aba7-2ba0b942ee39 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.696275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a764398-d4fc-4ff7-aba7-2ba0b942ee39 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.702022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a764398-d4fc-4ff7-aba7-2ba0b942ee39 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.705238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a764398-d4fc-4ff7-aba7-2ba0b942ee39 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.706660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a764398-d4fc-4ff7-aba7-2ba0b942ee39 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.807031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b4db4b92-fc2e-436f-94ae-7143424eb8e0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.815362 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b4db4b92-fc2e-436f-94ae-7143424eb8e0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.414970 Jul 20 04:18:57.816064 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1404/2860] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:57.829699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-391418829", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "e13e2da2-9e3c-4274-877d-f49bd33e9e48"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:58.008608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] validate_networks() for [('e13e2da2-9e3c-4274-877d-f49bd33e9e48', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:58.084205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=16 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:58.792392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a764398-d4fc-4ff7-aba7-2ba0b942ee39 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.804677 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a764398-d4fc-4ff7-aba7-2ba0b942ee39 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1403 microversion: 2.1 time: 1.155302 Jul 20 04:18:58.833322 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1457/2861] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1403 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:58.877564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2df61d6-69bf-4fc9-bd03-93dc39071791 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:58.881755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f2df61d6-69bf-4fc9-bd03-93dc39071791 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:58.903822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2df61d6-69bf-4fc9-bd03-93dc39071791 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.904303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2df61d6-69bf-4fc9-bd03-93dc39071791 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.905118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2df61d6-69bf-4fc9-bd03-93dc39071791 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.905570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2df61d6-69bf-4fc9-bd03-93dc39071791 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.093933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f2df61d6-69bf-4fc9-bd03-93dc39071791 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.112308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f2df61d6-69bf-4fc9-bd03-93dc39071791 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.113853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f2df61d6-69bf-4fc9-bd03-93dc39071791 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.117034 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f2df61d6-69bf-4fc9-bd03-93dc39071791 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1664 microversion: 2.25 time: 0.274184 Jul 20 04:18:59.117728 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1458/2862] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:58 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1664 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:59.126299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3411b893-2c8a-4eea-b908-7e2aa2d80a57 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.137170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:59.137733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3411b893-2c8a-4eea-b908-7e2aa2d80a57 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] [instance: 93afd1ba-4760-4b7d-bf7a-3fe39780de1d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.138592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:59.139241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:59.140616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:59.141209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:59.154235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3411b893-2c8a-4eea-b908-7e2aa2d80a57 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.154757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3411b893-2c8a-4eea-b908-7e2aa2d80a57 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.155577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3411b893-2c8a-4eea-b908-7e2aa2d80a57 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.156026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3411b893-2c8a-4eea-b908-7e2aa2d80a57 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.161329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.164405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.165612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.166236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.198196 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3411b893-2c8a-4eea-b908-7e2aa2d80a57 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] HTTP exception thrown: Instance 93afd1ba-4760-4b7d-bf7a-3fe39780de1d could not be found. Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3411b893-2c8a-4eea-b908-7e2aa2d80a57 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Request method failure captured: Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d HTTP/1.1 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14IWQtHAntQZI0Qnxkk0zwLjxn25MoJeds4QGWXYL7P0P84FqsPNfqFjZAOQ2JLJXavrJQG3rxLtkYz6jg6b9NXvKAn3CrUh5FzrzGHFZH8DR-ZMRfx68f6oFmYovB0t9xNDDtGkpcbktCEKT5WShmWaZ1hZG09fQgDFeRROfepk9T8 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.26 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 2fea3071b7d644f0b3bde8406b2ff995 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerTagsTestJSON-35080250 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2fea3071b7d644f0b3bde8406b2ff995"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2fea3071b7d644f0b3bde8406b2ff995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2fea3071b7d644f0b3bde8406b2ff995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2fea3071b7d644f0b3bde8406b2ff995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerTagsTestJSON-35080250 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 2fea3071b7d644f0b3bde8406b2ff995 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerTagsTestJSON-35080250 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerTagsTestJSON-35080250-project Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: c64b6d02ce1a450e8826d0b9b46e0551 Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerTagsTestJSON-35080250-project Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 93afd1ba-4760-4b7d-bf7a-3fe39780de1d could not be found. Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '93afd1ba-4760-4b7d-bf7a-3fe39780de1d'} Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93afd1ba-4760-4b7d-bf7a-3fe39780de1d could not be found. Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93afd1ba-4760-4b7d-bf7a-3fe39780de1d could not be found. Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:59.200284 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:18:59.205008 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:59.205008 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:59.205008 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:59.205008 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:59.205008 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:59.205008 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93afd1ba-4760-4b7d-bf7a-3fe39780de1d could not be found. Jul 20 04:18:59.205008 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:18:59.209277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3411b893-2c8a-4eea-b908-7e2aa2d80a57 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] Returning 404 to user: Instance 93afd1ba-4760-4b7d-bf7a-3fe39780de1d could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:59.221676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Getting quotas for project 65a9c17c56e94930a159f00d0c8e0e7f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:59.223183 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3411b893-2c8a-4eea-b908-7e2aa2d80a57 tempest-ServerTagsTestJSON-35080250 tempest-ServerTagsTestJSON-35080250-project] 10.222.0.59 "GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d" status: 404 len: 111 microversion: 2.26 time: 0.093343 Jul 20 04:18:59.225113 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1459/2863] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/93afd1ba-4760-4b7d-bf7a-3fe39780de1d => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:59.233020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e2faeacf-b53e-4305-a3ad-8ddf659ed7c0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.233655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e2faeacf-b53e-4305-a3ad-8ddf659ed7c0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.236331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Getting quotas for user 43de2b946fd7474dbc2a48e5fcaa518d and project 65a9c17c56e94930a159f00d0c8e0e7f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:59.260861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2faeacf-b53e-4305-a3ad-8ddf659ed7c0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.262798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2faeacf-b53e-4305-a3ad-8ddf659ed7c0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.265347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2faeacf-b53e-4305-a3ad-8ddf659ed7c0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.266909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2faeacf-b53e-4305-a3ad-8ddf659ed7c0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.277225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:59.282706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:59.387028 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f9fad3a-ce06-45dd-8490-dfe63da2712d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565731 Jul 20 04:18:59.388280 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1405/2864] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:59.394586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4678f8e0-7544-487f-acab-f112df2efb0f req-97bea1fc-1d0c-432e-8dd9-d5b574cf6d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ef29d2-7202-47d0-9f12-3a9b7999aa49", "name": "network-vif-plugged", "status": "completed", "tag": "e88a60e1-f505-4b66-8189-731bf232b933"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:59.404219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4678f8e0-7544-487f-acab-f112df2efb0f req-97bea1fc-1d0c-432e-8dd9-d5b574cf6d32 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.404899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4678f8e0-7544-487f-acab-f112df2efb0f req-97bea1fc-1d0c-432e-8dd9-d5b574cf6d32 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.421944 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4678f8e0-7544-487f-acab-f112df2efb0f req-97bea1fc-1d0c-432e-8dd9-d5b574cf6d32 service nova] Creating event network-vif-plugged:e88a60e1-f505-4b66-8189-731bf232b933 for instance 98ef29d2-7202-47d0-9f12-3a9b7999aa49 on n-h1-760456-11 Jul 20 04:18:59.428308 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4678f8e0-7544-487f-acab-f112df2efb0f req-97bea1fc-1d0c-432e-8dd9-d5b574cf6d32 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038611 Jul 20 04:18:59.428919 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1406/2865] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:59.695878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8895092a-05f4-41c6-adda-5b7000e99d1e tempest-ExtensionsTest-376591913 tempest-ExtensionsTest-376591913-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.697661 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8895092a-05f4-41c6-adda-5b7000e99d1e tempest-ExtensionsTest-376591913 tempest-ExtensionsTest-376591913-project] 10.222.0.59 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.264677 Jul 20 04:18:59.698326 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1407/2866] 10.222.0.59 () {58 vars in 1169 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:59.727474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cda3a5a0-f4fa-45e0-9a22-5080057b2bb4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.728346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cda3a5a0-f4fa-45e0-9a22-5080057b2bb4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.867659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cda3a5a0-f4fa-45e0-9a22-5080057b2bb4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.880099 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cda3a5a0-f4fa-45e0-9a22-5080057b2bb4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1217 microversion: 2.1 time: 0.176011 Jul 20 04:18:59.891943 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1408/2867] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1217 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:59.916745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cfdbe9c2-d5dc-4018-9a24-b2fe7d376f94 tempest-ExtensionsTest-376591913 tempest-ExtensionsTest-376591913-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.923201 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cfdbe9c2-d5dc-4018-9a24-b2fe7d376f94 tempest-ExtensionsTest-376591913 tempest-ExtensionsTest-376591913-project] 10.222.0.59 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.027133 Jul 20 04:18:59.925925 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1409/2868] 10.222.0.59 () {58 vars in 1133 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:18:59.948354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c4d4832-7be0-4146-9bcc-614c9bd21048 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.952995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c4d4832-7be0-4146-9bcc-614c9bd21048 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.974700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c4d4832-7be0-4146-9bcc-614c9bd21048 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.975038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c4d4832-7be0-4146-9bcc-614c9bd21048 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.975870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c4d4832-7be0-4146-9bcc-614c9bd21048 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.976357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c4d4832-7be0-4146-9bcc-614c9bd21048 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.353370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c4d4832-7be0-4146-9bcc-614c9bd21048 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.367127 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c4d4832-7be0-4146-9bcc-614c9bd21048 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1403 microversion: 2.1 time: 0.438787 Jul 20 04:19:00.368359 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1410/2869] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1403 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:00.376145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a0d2414e-ae45-46e5-851d-f8311d18856d req-2ae4eddc-1659-4b59-8ad9-ab612598b6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955c1609-40d3-47fd-9eac-8b879ecae2c8", "name": "network-vif-deleted", "tag": "384b5cd6-b0be-4fd8-994b-7c96785fc89b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:00.386668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a0d2414e-ae45-46e5-851d-f8311d18856d req-2ae4eddc-1659-4b59-8ad9-ab612598b6f6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.387267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a0d2414e-ae45-46e5-851d-f8311d18856d req-2ae4eddc-1659-4b59-8ad9-ab612598b6f6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.407870 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a0d2414e-ae45-46e5-851d-f8311d18856d req-2ae4eddc-1659-4b59-8ad9-ab612598b6f6 service nova] Creating event network-vif-deleted:384b5cd6-b0be-4fd8-994b-7c96785fc89b for instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 on n-h2-760456-11 Jul 20 04:19:00.415883 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a0d2414e-ae45-46e5-851d-f8311d18856d req-2ae4eddc-1659-4b59-8ad9-ab612598b6f6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045829 Jul 20 04:19:00.417096 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1411/2870] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:00.433927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3907853c-5135-41b7-b246-11cb30f29aee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:00.434987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3907853c-5135-41b7-b246-11cb30f29aee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:00.443320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3907853c-5135-41b7-b246-11cb30f29aee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.444075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3907853c-5135-41b7-b246-11cb30f29aee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.445193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3907853c-5135-41b7-b246-11cb30f29aee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.446116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3907853c-5135-41b7-b246-11cb30f29aee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.550728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3907853c-5135-41b7-b246-11cb30f29aee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.561643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3907853c-5135-41b7-b246-11cb30f29aee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.563583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3907853c-5135-41b7-b246-11cb30f29aee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.565576 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3907853c-5135-41b7-b246-11cb30f29aee tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1664 microversion: 2.25 time: 0.137956 Jul 20 04:19:00.567251 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1412/2871] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:00 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1664 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:00.574642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-144e6228-2640-4af5-8e26-5ecaa3505556 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11034c61-98db-4729-993a-80763c55a1f4"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:00.576447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-144e6228-2640-4af5-8e26-5ecaa3505556 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:00.585247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-144e6228-2640-4af5-8e26-5ecaa3505556 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.586087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-144e6228-2640-4af5-8e26-5ecaa3505556 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.587266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-144e6228-2640-4af5-8e26-5ecaa3505556 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.587993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-144e6228-2640-4af5-8e26-5ecaa3505556 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.634981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e2faeacf-b53e-4305-a3ad-8ddf659ed7c0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.645320 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e2faeacf-b53e-4305-a3ad-8ddf659ed7c0 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 1.418926 Jul 20 04:19:00.675068 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1460/2872] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:00.680163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-68013e20-7f70-42c1-944e-fa297b980ca2 req-a006ba25-e403-4377-b3d2-441de0bcde4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358c5f50-cf9e-4577-a295-0aa87e318810", "name": "network-vif-deleted", "tag": "2cc5c8d5-88eb-4ddb-b127-216dd5aef81c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:00.707593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-68013e20-7f70-42c1-944e-fa297b980ca2 req-a006ba25-e403-4377-b3d2-441de0bcde4e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.708046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-68013e20-7f70-42c1-944e-fa297b980ca2 req-a006ba25-e403-4377-b3d2-441de0bcde4e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.750005 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-68013e20-7f70-42c1-944e-fa297b980ca2 req-a006ba25-e403-4377-b3d2-441de0bcde4e service nova] Creating event network-vif-deleted:2cc5c8d5-88eb-4ddb-b127-216dd5aef81c for instance 358c5f50-cf9e-4577-a295-0aa87e318810 on n-h1-760456-11 Jul 20 04:19:00.763362 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-68013e20-7f70-42c1-944e-fa297b980ca2 req-a006ba25-e403-4377-b3d2-441de0bcde4e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085868 Jul 20 04:19:00.770218 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1461/2873] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:00.902407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-313f9bf3-1463-41b4-a7ef-8c7c0309e509 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:00.903708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-313f9bf3-1463-41b4-a7ef-8c7c0309e509 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:00.921548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-313f9bf3-1463-41b4-a7ef-8c7c0309e509 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.931116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-313f9bf3-1463-41b4-a7ef-8c7c0309e509 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.932349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-313f9bf3-1463-41b4-a7ef-8c7c0309e509 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.936819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-313f9bf3-1463-41b4-a7ef-8c7c0309e509 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.154411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:01.194113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-313f9bf3-1463-41b4-a7ef-8c7c0309e509 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.201128 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-144e6228-2640-4af5-8e26-5ecaa3505556 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "POST /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631121 Jul 20 04:19:01.207485 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-313f9bf3-1463-41b4-a7ef-8c7c0309e509 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1269 microversion: 2.1 time: 0.312181 Jul 20 04:19:01.207971 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1462/2874] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:00 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1269 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:01.213377 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1413/2875] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:19:00 2022] POST /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments => generated 194 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:01.387911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-36f8c597-cc14-40d4-bf43-f1e21f530992 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.388554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-36f8c597-cc14-40d4-bf43-f1e21f530992 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:01.405663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36f8c597-cc14-40d4-bf43-f1e21f530992 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.406043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36f8c597-cc14-40d4-bf43-f1e21f530992 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.409053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36f8c597-cc14-40d4-bf43-f1e21f530992 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.411029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36f8c597-cc14-40d4-bf43-f1e21f530992 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.585764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.586508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:01.604050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.604475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.605281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.605731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.693882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.696754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.697565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lazy-loading 'fault' on Instance uuid 358c5f50-cf9e-4577-a295-0aa87e318810 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:01.785463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-36f8c597-cc14-40d4-bf43-f1e21f530992 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.796117 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-36f8c597-cc14-40d4-bf43-f1e21f530992 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1403 microversion: 2.1 time: 0.412749 Jul 20 04:19:01.798977 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1463/2876] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1403 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:01.810807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c2fb6c8-0c49-4043-8a6b-74267133567f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.821947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2c2fb6c8-0c49-4043-8a6b-74267133567f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:01.839194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.842154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c2fb6c8-0c49-4043-8a6b-74267133567f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.843352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c2fb6c8-0c49-4043-8a6b-74267133567f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.846234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c2fb6c8-0c49-4043-8a6b-74267133567f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.851542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c2fb6c8-0c49-4043-8a6b-74267133567f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.853471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.857386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.863276 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3dca1b6-6c9b-4940-b351-6709ff2cbdfc tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 200 len: 1376 microversion: 2.25 time: 0.281147 Jul 20 04:19:01.868630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1414/2877] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 1376 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:02.226913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1eb1ac16-cdcd-4928-8502-8a65a8b66465 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.230378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1eb1ac16-cdcd-4928-8502-8a65a8b66465 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:02.247453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eb1ac16-cdcd-4928-8502-8a65a8b66465 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.253167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eb1ac16-cdcd-4928-8502-8a65a8b66465 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.256237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eb1ac16-cdcd-4928-8502-8a65a8b66465 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.258134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eb1ac16-cdcd-4928-8502-8a65a8b66465 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.472289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c2fb6c8-0c49-4043-8a6b-74267133567f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:02.475167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1eb1ac16-cdcd-4928-8502-8a65a8b66465 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:02.489988 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1eb1ac16-cdcd-4928-8502-8a65a8b66465 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1275 microversion: 2.1 time: 0.265783 Jul 20 04:19:02.491230 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1415/2878] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:02 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1275 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:02.497325 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c2fb6c8-0c49-4043-8a6b-74267133567f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.690504 Jul 20 04:19:02.499766 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1464/2879] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:02.813108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-535fb229-3d7c-48a2-a21e-f7594d51e6de tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.813950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-535fb229-3d7c-48a2-a21e-f7594d51e6de tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:02.825997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-535fb229-3d7c-48a2-a21e-f7594d51e6de tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.834529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-535fb229-3d7c-48a2-a21e-f7594d51e6de tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.835579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-535fb229-3d7c-48a2-a21e-f7594d51e6de tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.836113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-535fb229-3d7c-48a2-a21e-f7594d51e6de tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.882006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-075150ee-399e-43e9-a4e8-3e5607e40dc2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.883308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-075150ee-399e-43e9-a4e8-3e5607e40dc2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 358c5f50-cf9e-4577-a295-0aa87e318810] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:02.901438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-075150ee-399e-43e9-a4e8-3e5607e40dc2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.902233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-075150ee-399e-43e9-a4e8-3e5607e40dc2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.903348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-075150ee-399e-43e9-a4e8-3e5607e40dc2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.907003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-075150ee-399e-43e9-a4e8-3e5607e40dc2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.940770 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-075150ee-399e-43e9-a4e8-3e5607e40dc2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] HTTP exception thrown: Instance 358c5f50-cf9e-4577-a295-0aa87e318810 could not be found. Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-075150ee-399e-43e9-a4e8-3e5607e40dc2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Request method failure captured: Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 HTTP/1.1 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14CEO3G3esOlkeb-7wv-eohmvY86Z1CTdoBef37xRuBAepEKTlbuNjikHie4fM80y6mcBbfFXx42XC8bpKFAPoy7dpu4FGRsTw10tE5ox79nq5ErLJrFKbIe9JRbyal09HM05UeqXSNNmrvq7VCvhp_-V-kJ5ERbMNGdaVMnU3sXwes Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d2323a93fbfb432f81cd11b542380af8 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d2323a93fbfb432f81cd11b542380af8 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-LiveAutoBlockMigrationV225Test-1081269634-project Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: df3e2faf94584fc99a59e3839e18f8b1 Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634-project Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 358c5f50-cf9e-4577-a295-0aa87e318810 could not be found. Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '358c5f50-cf9e-4577-a295-0aa87e318810'} Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 358c5f50-cf9e-4577-a295-0aa87e318810 could not be found. Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 358c5f50-cf9e-4577-a295-0aa87e318810 could not be found. Jul 20 04:19:02.948651 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:02.953324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:02.953324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:02.953324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:02.953324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:02.953324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:02.953324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:02.953324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:02.953324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 358c5f50-cf9e-4577-a295-0aa87e318810 could not be found. Jul 20 04:19:02.953324 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:02.956391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-075150ee-399e-43e9-a4e8-3e5607e40dc2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Returning 404 to user: Instance 358c5f50-cf9e-4577-a295-0aa87e318810 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:02.957637 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-075150ee-399e-43e9-a4e8-3e5607e40dc2 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810" status: 404 len: 111 microversion: 2.25 time: 0.080278 Jul 20 04:19:02.961044 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1465/2880] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:02 2022] GET /compute/v2.1/servers/358c5f50-cf9e-4577-a295-0aa87e318810 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:19:02.973191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-23145a52-31c2-42f7-b005-cfc8e9d41daf tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '.version_select at 0x7fb8412410d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.012331 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-23145a52-31c2-42f7-b005-cfc8e9d41daf tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993197706" status: 204 len: 0 microversion: 2.25 time: 0.047250 Jul 20 04:19:03.016179 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1466/2881] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:19:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993197706 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:19:03.287685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-535fb229-3d7c-48a2-a21e-f7594d51e6de tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.315329 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-535fb229-3d7c-48a2-a21e-f7594d51e6de tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1591 microversion: 2.1 time: 0.489209 Jul 20 04:19:03.317836 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1416/2882] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:02 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1591 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:03.335192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-47810ec6-63a4-43cb-9fad-f237dbdb4288 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.335709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-47810ec6-63a4-43cb-9fad-f237dbdb4288 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.349796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47810ec6-63a4-43cb-9fad-f237dbdb4288 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.351039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47810ec6-63a4-43cb-9fad-f237dbdb4288 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.352970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47810ec6-63a4-43cb-9fad-f237dbdb4288 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.353432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47810ec6-63a4-43cb-9fad-f237dbdb4288 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.515007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1528beb4-0749-4b9c-9218-d25e32a43529 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.516080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1528beb4-0749-4b9c-9218-d25e32a43529 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.528503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1528beb4-0749-4b9c-9218-d25e32a43529 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.531019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1528beb4-0749-4b9c-9218-d25e32a43529 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.534651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1528beb4-0749-4b9c-9218-d25e32a43529 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.536496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1528beb4-0749-4b9c-9218-d25e32a43529 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.704816 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-47810ec6-63a4-43cb-9fad-f237dbdb4288 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.375744 Jul 20 04:19:03.705453 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1467/2883] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49/os-interface => generated 285 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:03.714721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c2e49791-99f8-4f9b-b8e4-48c17cbff36e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.715590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c2e49791-99f8-4f9b-b8e4-48c17cbff36e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.724316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2e49791-99f8-4f9b-b8e4-48c17cbff36e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.729075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2e49791-99f8-4f9b-b8e4-48c17cbff36e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.730162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2e49791-99f8-4f9b-b8e4-48c17cbff36e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.730805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2e49791-99f8-4f9b-b8e4-48c17cbff36e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.816259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1528beb4-0749-4b9c-9218-d25e32a43529 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.827261 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1528beb4-0749-4b9c-9218-d25e32a43529 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1317 microversion: 2.1 time: 0.315996 Jul 20 04:19:03.828626 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1417/2884] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:04.638849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a04cd660-a59c-48cf-ac13-15ea2204b403 req-65e1d2d7-8e20-4799-a388-34b158787ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e32034-3c05-42c3-81e8-b65e3fa773e4", "tag": "6cec27c4-b109-44df-8ebf-907b4f02fcec"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:04.671617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a04cd660-a59c-48cf-ac13-15ea2204b403 req-65e1d2d7-8e20-4799-a388-34b158787ef0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.677541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a04cd660-a59c-48cf-ac13-15ea2204b403 req-65e1d2d7-8e20-4799-a388-34b158787ef0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.710632 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a04cd660-a59c-48cf-ac13-15ea2204b403 req-65e1d2d7-8e20-4799-a388-34b158787ef0 service nova] Creating event network-changed:6cec27c4-b109-44df-8ebf-907b4f02fcec for instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 on n-h2-760456-11 Jul 20 04:19:04.728205 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a04cd660-a59c-48cf-ac13-15ea2204b403 req-65e1d2d7-8e20-4799-a388-34b158787ef0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093875 Jul 20 04:19:04.729245 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1418/2885] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:04.847317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-13edf279-e90e-4798-80da-cb26b315e775 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.848943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-13edf279-e90e-4798-80da-cb26b315e775 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.864377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13edf279-e90e-4798-80da-cb26b315e775 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.865471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13edf279-e90e-4798-80da-cb26b315e775 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.867221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13edf279-e90e-4798-80da-cb26b315e775 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.867856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13edf279-e90e-4798-80da-cb26b315e775 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.099701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-13edf279-e90e-4798-80da-cb26b315e775 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.109375 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-13edf279-e90e-4798-80da-cb26b315e775 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1317 microversion: 2.1 time: 0.267932 Jul 20 04:19:05.121762 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1419/2886] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:04 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:05.188565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c2e49791-99f8-4f9b-b8e4-48c17cbff36e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.200520 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c2e49791-99f8-4f9b-b8e4-48c17cbff36e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 1.493565 Jul 20 04:19:05.212823 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1468/2887] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:06.128732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a065b3b7-612d-4f78-8a94-232f2583d13c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.129790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a065b3b7-612d-4f78-8a94-232f2583d13c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:06.146841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a065b3b7-612d-4f78-8a94-232f2583d13c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.147304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a065b3b7-612d-4f78-8a94-232f2583d13c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.148104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a065b3b7-612d-4f78-8a94-232f2583d13c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.148761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a065b3b7-612d-4f78-8a94-232f2583d13c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.222290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-faf85d58-90bb-4641-9b8e-e17a84084515 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.224510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-faf85d58-90bb-4641-9b8e-e17a84084515 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:06.242498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faf85d58-90bb-4641-9b8e-e17a84084515 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.242964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faf85d58-90bb-4641-9b8e-e17a84084515 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.243776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faf85d58-90bb-4641-9b8e-e17a84084515 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.244230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-faf85d58-90bb-4641-9b8e-e17a84084515 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.751056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-faf85d58-90bb-4641-9b8e-e17a84084515 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:06.776558 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-faf85d58-90bb-4641-9b8e-e17a84084515 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.560330 Jul 20 04:19:06.779632 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1469/2888] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:06 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:06.816455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-259f60c7-0cca-4009-8194-71907792ca0f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.818893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-259f60c7-0cca-4009-8194-71907792ca0f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:06.838139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-259f60c7-0cca-4009-8194-71907792ca0f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.840489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-259f60c7-0cca-4009-8194-71907792ca0f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.842055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-259f60c7-0cca-4009-8194-71907792ca0f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.842814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-259f60c7-0cca-4009-8194-71907792ca0f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.900370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:06.917752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-259f60c7-0cca-4009-8194-71907792ca0f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:06.992906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a065b3b7-612d-4f78-8a94-232f2583d13c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:07.002493 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a065b3b7-612d-4f78-8a94-232f2583d13c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1317 microversion: 2.1 time: 0.878829 Jul 20 04:19:07.007122 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1420/2889] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:06 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1317 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:07.172361 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-259f60c7-0cca-4009-8194-71907792ca0f tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 204 len: 0 microversion: 2.25 time: 0.369457 Jul 20 04:19:07.179267 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1470/2890] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:19:06 2022] DELETE /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:19:07.187238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45ba0d3e-27ec-4889-871d-987c828fc0d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:07.188031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-45ba0d3e-27ec-4889-871d-987c828fc0d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:07.206624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45ba0d3e-27ec-4889-871d-987c828fc0d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.207087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45ba0d3e-27ec-4889-871d-987c828fc0d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:07.207885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45ba0d3e-27ec-4889-871d-987c828fc0d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.208329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45ba0d3e-27ec-4889-871d-987c828fc0d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:07.341999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-55a1835e-ee5a-48f8-8537-8142fb0d9d8c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:07.343608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-55a1835e-ee5a-48f8-8537-8142fb0d9d8c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:07.360668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55a1835e-ee5a-48f8-8537-8142fb0d9d8c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.362572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55a1835e-ee5a-48f8-8537-8142fb0d9d8c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:07.365294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55a1835e-ee5a-48f8-8537-8142fb0d9d8c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.367274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55a1835e-ee5a-48f8-8537-8142fb0d9d8c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.106717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-55a1835e-ee5a-48f8-8537-8142fb0d9d8c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.115894 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-55a1835e-ee5a-48f8-8537-8142fb0d9d8c tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1591 microversion: 2.1 time: 0.780648 Jul 20 04:19:08.120064 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1471/2891] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:07 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1591 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:08.138838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-706429af-74dc-4ae4-b305-e858af2d7c7b req-6e9a2060-9d24-403b-bcc9-a0c458b106bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ef29d2-7202-47d0-9f12-3a9b7999aa49", "tag": "e88a60e1-f505-4b66-8189-731bf232b933"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:08.164290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-706429af-74dc-4ae4-b305-e858af2d7c7b req-6e9a2060-9d24-403b-bcc9-a0c458b106bb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.165904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-706429af-74dc-4ae4-b305-e858af2d7c7b req-6e9a2060-9d24-403b-bcc9-a0c458b106bb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.196528 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-706429af-74dc-4ae4-b305-e858af2d7c7b req-6e9a2060-9d24-403b-bcc9-a0c458b106bb service nova] Creating event network-changed:e88a60e1-f505-4b66-8189-731bf232b933 for instance 98ef29d2-7202-47d0-9f12-3a9b7999aa49 on n-h1-760456-11 Jul 20 04:19:08.219548 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-706429af-74dc-4ae4-b305-e858af2d7c7b req-6e9a2060-9d24-403b-bcc9-a0c458b106bb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096919 Jul 20 04:19:08.226201 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1472/2892] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:08.231770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c6fd90a-72e0-4172-aa1b-118ba145bb99 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:08.232498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2c6fd90a-72e0-4172-aa1b-118ba145bb99 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:08.264283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c6fd90a-72e0-4172-aa1b-118ba145bb99 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.264781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c6fd90a-72e0-4172-aa1b-118ba145bb99 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.265597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c6fd90a-72e0-4172-aa1b-118ba145bb99 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.273954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c6fd90a-72e0-4172-aa1b-118ba145bb99 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.427735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45ba0d3e-27ec-4889-871d-987c828fc0d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.442805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45ba0d3e-27ec-4889-871d-987c828fc0d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.447566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45ba0d3e-27ec-4889-871d-987c828fc0d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.456571 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-45ba0d3e-27ec-4889-871d-987c828fc0d0 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1549 microversion: 2.25 time: 1.272822 Jul 20 04:19:08.457403 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1421/2893] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:07 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1549 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:08.481547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73fde362-34d9-4112-809a-2f7b7ad81bb9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:08.482960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-73fde362-34d9-4112-809a-2f7b7ad81bb9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:08.499444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73fde362-34d9-4112-809a-2f7b7ad81bb9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.505728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73fde362-34d9-4112-809a-2f7b7ad81bb9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.511601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73fde362-34d9-4112-809a-2f7b7ad81bb9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.512303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73fde362-34d9-4112-809a-2f7b7ad81bb9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.988774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-73fde362-34d9-4112-809a-2f7b7ad81bb9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:09.000472 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-73fde362-34d9-4112-809a-2f7b7ad81bb9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1317 microversion: 2.1 time: 0.540785 Jul 20 04:19:09.003460 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1422/2894] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:08 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:09.484312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8448ca1e-ae93-4bfa-8942-70ee0d025a99 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.485657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8448ca1e-ae93-4bfa-8942-70ee0d025a99 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:09.498901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:09.510496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8448ca1e-ae93-4bfa-8942-70ee0d025a99 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.511034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8448ca1e-ae93-4bfa-8942-70ee0d025a99 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.511894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8448ca1e-ae93-4bfa-8942-70ee0d025a99 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.514855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8448ca1e-ae93-4bfa-8942-70ee0d025a99 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.686829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8448ca1e-ae93-4bfa-8942-70ee0d025a99 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:09.704365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8448ca1e-ae93-4bfa-8942-70ee0d025a99 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:09.705958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8448ca1e-ae93-4bfa-8942-70ee0d025a99 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:09.713168 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8448ca1e-ae93-4bfa-8942-70ee0d025a99 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 200 len: 1507 microversion: 2.25 time: 0.240610 Jul 20 04:19:09.714195 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1423/2895] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:09 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:09.944883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c6fd90a-72e0-4172-aa1b-118ba145bb99 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:09.953429 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c6fd90a-72e0-4172-aa1b-118ba145bb99 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 1.725876 Jul 20 04:19:09.974564 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1473/2896] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:08 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:10.020015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fa8703c-6999-4bcc-b5cd-8262a7fa1365 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.020662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1fa8703c-6999-4bcc-b5cd-8262a7fa1365 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.022632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:10.035545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fa8703c-6999-4bcc-b5cd-8262a7fa1365 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.036717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fa8703c-6999-4bcc-b5cd-8262a7fa1365 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.038285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fa8703c-6999-4bcc-b5cd-8262a7fa1365 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.039984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fa8703c-6999-4bcc-b5cd-8262a7fa1365 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.372808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1fa8703c-6999-4bcc-b5cd-8262a7fa1365 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:10.387097 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1fa8703c-6999-4bcc-b5cd-8262a7fa1365 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1317 microversion: 2.1 time: 0.371801 Jul 20 04:19:10.392673 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1424/2897] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:10.556933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-585fbb16-3b94-445f-b665-23d7158dc2a6 req-fc55b82d-8aa9-4f96-a168-a02b151b5535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfd0a05-0361-4623-b862-7e525c0eeb91", "name": "network-vif-deleted", "tag": "24377567-d41e-41ac-b4a3-0d0f3a117215"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:10.577404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-585fbb16-3b94-445f-b665-23d7158dc2a6 req-fc55b82d-8aa9-4f96-a168-a02b151b5535 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.577862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-585fbb16-3b94-445f-b665-23d7158dc2a6 req-fc55b82d-8aa9-4f96-a168-a02b151b5535 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.605087 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-585fbb16-3b94-445f-b665-23d7158dc2a6 req-fc55b82d-8aa9-4f96-a168-a02b151b5535 service nova] Creating event network-vif-deleted:24377567-d41e-41ac-b4a3-0d0f3a117215 for instance dbfd0a05-0361-4623-b862-7e525c0eeb91 on n-h1-760456-11 Jul 20 04:19:10.616742 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-585fbb16-3b94-445f-b665-23d7158dc2a6 req-fc55b82d-8aa9-4f96-a168-a02b151b5535 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062170 Jul 20 04:19:10.618631 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1474/2898] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:10.733838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d0502970-1115-473f-91af-ec30d7433342 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.735132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d0502970-1115-473f-91af-ec30d7433342 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: dbfd0a05-0361-4623-b862-7e525c0eeb91] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.753022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0502970-1115-473f-91af-ec30d7433342 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.753924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0502970-1115-473f-91af-ec30d7433342 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.756583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0502970-1115-473f-91af-ec30d7433342 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.758835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0502970-1115-473f-91af-ec30d7433342 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.805443 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-d0502970-1115-473f-91af-ec30d7433342 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] HTTP exception thrown: Instance dbfd0a05-0361-4623-b862-7e525c0eeb91 could not be found. Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d0502970-1115-473f-91af-ec30d7433342 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Request method failure captured: Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 HTTP/1.1 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14CEO3G3esOlkeb-7wv-eohmvY86Z1CTdoBef37xRuBAepEKTlbuNjikHie4fM80y6mcBbfFXx42XC8bpKFAPoy7dpu4FGRsTw10tE5ox79nq5ErLJrFKbIe9JRbyal09HM05UeqXSNNmrvq7VCvhp_-V-kJ5ERbMNGdaVMnU3sXwes Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d2323a93fbfb432f81cd11b542380af8 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d2323a93fbfb432f81cd11b542380af8 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-LiveAutoBlockMigrationV225Test-1081269634-project Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: df3e2faf94584fc99a59e3839e18f8b1 Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634-project Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance dbfd0a05-0361-4623-b862-7e525c0eeb91 could not be found. Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'dbfd0a05-0361-4623-b862-7e525c0eeb91'} Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbfd0a05-0361-4623-b862-7e525c0eeb91 could not be found. Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbfd0a05-0361-4623-b862-7e525c0eeb91 could not be found. Jul 20 04:19:10.810893 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.817273 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.817273 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.817273 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.817273 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.817273 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.817273 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:10.817273 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:10.817273 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbfd0a05-0361-4623-b862-7e525c0eeb91 could not be found. Jul 20 04:19:10.817273 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.821096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d0502970-1115-473f-91af-ec30d7433342 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Returning 404 to user: Instance dbfd0a05-0361-4623-b862-7e525c0eeb91 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:10.824157 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d0502970-1115-473f-91af-ec30d7433342 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91" status: 404 len: 111 microversion: 2.25 time: 0.094494 Jul 20 04:19:10.826924 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1425/2899] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/dbfd0a05-0361-4623-b862-7e525c0eeb91 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:19:10.838864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5450a0a-3408-48f6-8e00-222f7398257c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.839308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5450a0a-3408-48f6-8e00-222f7398257c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.844861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:10.852714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5450a0a-3408-48f6-8e00-222f7398257c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.853590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5450a0a-3408-48f6-8e00-222f7398257c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.854455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5450a0a-3408-48f6-8e00-222f7398257c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.854897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5450a0a-3408-48f6-8e00-222f7398257c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.896991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5450a0a-3408-48f6-8e00-222f7398257c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:10.972044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bde9fcff-24d5-4d97-bec2-2fbb3bb0d224 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.973070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bde9fcff-24d5-4d97-bec2-2fbb3bb0d224 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.991675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bde9fcff-24d5-4d97-bec2-2fbb3bb0d224 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.995031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bde9fcff-24d5-4d97-bec2-2fbb3bb0d224 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.997496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bde9fcff-24d5-4d97-bec2-2fbb3bb0d224 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.002128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bde9fcff-24d5-4d97-bec2-2fbb3bb0d224 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.070546 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5450a0a-3408-48f6-8e00-222f7398257c tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "DELETE /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 204 len: 0 microversion: 2.25 time: 0.237993 Jul 20 04:19:11.072078 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1475/2900] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:19:10 2022] DELETE /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:19:11.091961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1d04f456-b335-42c6-9c92-4763cb3c5b48 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.106312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1d04f456-b335-42c6-9c92-4763cb3c5b48 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.121300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d04f456-b335-42c6-9c92-4763cb3c5b48 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.122340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d04f456-b335-42c6-9c92-4763cb3c5b48 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.125552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d04f456-b335-42c6-9c92-4763cb3c5b48 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.126194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d04f456-b335-42c6-9c92-4763cb3c5b48 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.396283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bde9fcff-24d5-4d97-bec2-2fbb3bb0d224 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.405933 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bde9fcff-24d5-4d97-bec2-2fbb3bb0d224 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.438731 Jul 20 04:19:11.420801 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1426/2901] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:11.427879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f365060-beff-4170-bb52-2896a5da8436 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.435185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8f365060-beff-4170-bb52-2896a5da8436 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.445989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f365060-beff-4170-bb52-2896a5da8436 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.451539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f365060-beff-4170-bb52-2896a5da8436 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.452580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f365060-beff-4170-bb52-2896a5da8436 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.453239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f365060-beff-4170-bb52-2896a5da8436 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.684139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d04f456-b335-42c6-9c92-4763cb3c5b48 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.684463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8f365060-beff-4170-bb52-2896a5da8436 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.697946 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8f365060-beff-4170-bb52-2896a5da8436 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1317 microversion: 2.1 time: 0.275589 Jul 20 04:19:11.699285 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1427/2902] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:11 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:11.714936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d04f456-b335-42c6-9c92-4763cb3c5b48 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.727025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d04f456-b335-42c6-9c92-4763cb3c5b48 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.739421 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1d04f456-b335-42c6-9c92-4763cb3c5b48 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1563 microversion: 2.25 time: 0.659579 Jul 20 04:19:11.742745 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1476/2903] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:11 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1563 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:12.233151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-55bd9bac-d3d5-4e2d-be88-487ff2f731b7 req-21b40056-7f3a-4c7a-ae0c-8f7b9e69b1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e32034-3c05-42c3-81e8-b65e3fa773e4", "name": "network-vif-plugged", "status": "completed", "tag": "6cec27c4-b109-44df-8ebf-907b4f02fcec"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:12.253636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-55bd9bac-d3d5-4e2d-be88-487ff2f731b7 req-21b40056-7f3a-4c7a-ae0c-8f7b9e69b1ab service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.259766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-55bd9bac-d3d5-4e2d-be88-487ff2f731b7 req-21b40056-7f3a-4c7a-ae0c-8f7b9e69b1ab service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.299078 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-55bd9bac-d3d5-4e2d-be88-487ff2f731b7 req-21b40056-7f3a-4c7a-ae0c-8f7b9e69b1ab service nova] Creating event network-vif-plugged:6cec27c4-b109-44df-8ebf-907b4f02fcec for instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 on n-h2-760456-11 Jul 20 04:19:12.309756 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-55bd9bac-d3d5-4e2d-be88-487ff2f731b7 req-21b40056-7f3a-4c7a-ae0c-8f7b9e69b1ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079640 Jul 20 04:19:12.312231 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1428/2904] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:12.428113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a42c9d6-27f1-4b22-9d7c-f3733f913f3a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:12.428537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3a42c9d6-27f1-4b22-9d7c-f3733f913f3a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:12.442039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a42c9d6-27f1-4b22-9d7c-f3733f913f3a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.442595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a42c9d6-27f1-4b22-9d7c-f3733f913f3a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.446937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a42c9d6-27f1-4b22-9d7c-f3733f913f3a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.449829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a42c9d6-27f1-4b22-9d7c-f3733f913f3a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.718273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10f9652a-f8e6-4adf-a35d-586b45ba4092 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:12.719065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10f9652a-f8e6-4adf-a35d-586b45ba4092 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:12.733914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10f9652a-f8e6-4adf-a35d-586b45ba4092 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.734445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10f9652a-f8e6-4adf-a35d-586b45ba4092 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.735281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10f9652a-f8e6-4adf-a35d-586b45ba4092 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.735710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10f9652a-f8e6-4adf-a35d-586b45ba4092 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.941498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3a42c9d6-27f1-4b22-9d7c-f3733f913f3a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:12.952206 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3a42c9d6-27f1-4b22-9d7c-f3733f913f3a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.529014 Jul 20 04:19:12.963895 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1477/2905] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:12 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:12.979704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1d1940d-1a48-45d4-891b-bcde3f041e25 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:12.980778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d1d1940d-1a48-45d4-891b-bcde3f041e25 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:12.988523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1d1940d-1a48-45d4-891b-bcde3f041e25 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.989535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1d1940d-1a48-45d4-891b-bcde3f041e25 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.990699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1d1940d-1a48-45d4-891b-bcde3f041e25 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.991388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1d1940d-1a48-45d4-891b-bcde3f041e25 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:13.412196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1d1940d-1a48-45d4-891b-bcde3f041e25 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:13.419721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10f9652a-f8e6-4adf-a35d-586b45ba4092 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:13.429810 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10f9652a-f8e6-4adf-a35d-586b45ba4092 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1317 microversion: 2.1 time: 0.717926 Jul 20 04:19:13.433641 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1429/2906] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:12 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1317 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:13.434129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1d1940d-1a48-45d4-891b-bcde3f041e25 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:13.435857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1d1940d-1a48-45d4-891b-bcde3f041e25 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df3e2faf94584fc99a59e3839e18f8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2323a93fbfb432f81cd11b542380af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:13.437093 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1d1940d-1a48-45d4-891b-bcde3f041e25 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 200 len: 1563 microversion: 2.25 time: 0.461341 Jul 20 04:19:13.437652 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1478/2907] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:12 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 1563 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:13.447539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-92dc5acb-f2af-4520-9c48-1be5dd9b4d4f req-7cfa94dd-7d3b-4942-822d-bfb60237a535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cd136f-c79e-422a-b3ea-b8b6e73aa96d", "name": "network-vif-deleted", "tag": "c78a3349-2e55-45c6-9808-0b45347d0b3b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:13.474367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-92dc5acb-f2af-4520-9c48-1be5dd9b4d4f req-7cfa94dd-7d3b-4942-822d-bfb60237a535 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:13.475033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-92dc5acb-f2af-4520-9c48-1be5dd9b4d4f req-7cfa94dd-7d3b-4942-822d-bfb60237a535 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:13.499359 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-92dc5acb-f2af-4520-9c48-1be5dd9b4d4f req-7cfa94dd-7d3b-4942-822d-bfb60237a535 service nova] Creating event network-vif-deleted:c78a3349-2e55-45c6-9808-0b45347d0b3b for instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d on n-h1-760456-11 Jul 20 04:19:13.506617 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-92dc5acb-f2af-4520-9c48-1be5dd9b4d4f req-7cfa94dd-7d3b-4942-822d-bfb60237a535 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069417 Jul 20 04:19:13.507927 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1430/2908] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:13.971449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-55143d20-316a-4ade-a601-1a1a5bd658bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:13.972097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-55143d20-316a-4ade-a601-1a1a5bd658bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:13.989653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55143d20-316a-4ade-a601-1a1a5bd658bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:13.990119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55143d20-316a-4ade-a601-1a1a5bd658bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:13.990946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55143d20-316a-4ade-a601-1a1a5bd658bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:13.991396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55143d20-316a-4ade-a601-1a1a5bd658bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.459001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d8efebe1-7e61-426d-b160-9986cde89ba4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:14.473066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d8efebe1-7e61-426d-b160-9986cde89ba4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:14.500630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-55143d20-316a-4ade-a601-1a1a5bd658bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:14.514597 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-55143d20-316a-4ade-a601-1a1a5bd658bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.548256 Jul 20 04:19:14.516492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8efebe1-7e61-426d-b160-9986cde89ba4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.520533 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1479/2909] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:13 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:14.528186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cac12782-a0ce-491e-b552-b74956333050 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:14.535263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cac12782-a0ce-491e-b552-b74956333050 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] [instance: 00cd136f-c79e-422a-b3ea-b8b6e73aa96d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:14.547135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8efebe1-7e61-426d-b160-9986cde89ba4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.552091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8efebe1-7e61-426d-b160-9986cde89ba4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.552921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8efebe1-7e61-426d-b160-9986cde89ba4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.560367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cac12782-a0ce-491e-b552-b74956333050 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.561396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cac12782-a0ce-491e-b552-b74956333050 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.568913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cac12782-a0ce-491e-b552-b74956333050 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.570881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cac12782-a0ce-491e-b552-b74956333050 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.602345 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-cac12782-a0ce-491e-b552-b74956333050 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] HTTP exception thrown: Instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d could not be found. Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cac12782-a0ce-491e-b552-b74956333050 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Request method failure captured: Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d HTTP/1.1 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14CEO3G3esOlkeb-7wv-eohmvY86Z1CTdoBef37xRuBAepEKTlbuNjikHie4fM80y6mcBbfFXx42XC8bpKFAPoy7dpu4FGRsTw10tE5ox79nq5ErLJrFKbIe9JRbyal09HM05UeqXSNNmrvq7VCvhp_-V-kJ5ERbMNGdaVMnU3sXwes Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d2323a93fbfb432f81cd11b542380af8 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2323a93fbfb432f81cd11b542380af8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d2323a93fbfb432f81cd11b542380af8 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-LiveAutoBlockMigrationV225Test-1081269634-project Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: df3e2faf94584fc99a59e3839e18f8b1 Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1081269634-project Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d could not be found. Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '00cd136f-c79e-422a-b3ea-b8b6e73aa96d'} Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d could not be found. Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d could not be found. Jul 20 04:19:14.604833 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:14.609420 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:14.609420 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:14.609420 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:14.609420 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:14.609420 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:14.609420 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:14.609420 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:14.609420 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d could not be found. Jul 20 04:19:14.609420 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:14.611218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cac12782-a0ce-491e-b552-b74956333050 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] Returning 404 to user: Instance 00cd136f-c79e-422a-b3ea-b8b6e73aa96d could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:14.613691 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cac12782-a0ce-491e-b552-b74956333050 tempest-LiveAutoBlockMigrationV225Test-1081269634 tempest-LiveAutoBlockMigrationV225Test-1081269634-project] 10.222.0.59 "GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d" status: 404 len: 111 microversion: 2.25 time: 0.089502 Jul 20 04:19:14.614736 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1480/2910] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:14 2022] GET /compute/v2.1/servers/00cd136f-c79e-422a-b3ea-b8b6e73aa96d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:19:14.881014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d8efebe1-7e61-426d-b160-9986cde89ba4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:14.896387 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d8efebe1-7e61-426d-b160-9986cde89ba4 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1507 microversion: 2.1 time: 0.443379 Jul 20 04:19:14.898762 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1431/2911] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:14 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:14.917612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3a88e06-a918-45b2-8256-59abe05064b5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:14.920339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d3a88e06-a918-45b2-8256-59abe05064b5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:14.952510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3a88e06-a918-45b2-8256-59abe05064b5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.953669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3a88e06-a918-45b2-8256-59abe05064b5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.956280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3a88e06-a918-45b2-8256-59abe05064b5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.958397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3a88e06-a918-45b2-8256-59abe05064b5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.054468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:15.269770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baabdc8c-69c0-4d43-a45f-fd99b44e77a3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'create', calling method: .version_select at 0x7fb841114f70>, body: {"keypair": {"name": "tempest-keypair-1981349681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE1jf4ao5LSUWB6JiQg3++pjcfRkYjH8+tZuOGiNhrGEhmXW9EwOjSfZ/xI11YPvWn0wnSmDFYFXeVtr3IM0/kI0cV3+KeX8vrY+A+D9Lt02XdlAsV4OqObybACr9PsXQ=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:15.313295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-baabdc8c-69c0-4d43-a45f-fd99b44e77a3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Getting quotas for project 93f8bfd8e5a34423848573c7caab8d68. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:15.326346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-baabdc8c-69c0-4d43-a45f-fd99b44e77a3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Getting quotas for user 337b3a46906648cb82515704eadcdb38 and project 93f8bfd8e5a34423848573c7caab8d68. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:15.362989 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-baabdc8c-69c0-4d43-a45f-fd99b44e77a3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.550970 Jul 20 04:19:15.372862 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1481/2912] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:19:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:15.429794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d3a88e06-a918-45b2-8256-59abe05064b5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:15.440930 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d3a88e06-a918-45b2-8256-59abe05064b5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1507 microversion: 2.1 time: 0.530725 Jul 20 04:19:15.442821 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1432/2913] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:14 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1507 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:15.463000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dbff1bcc-5376-48a3-bb85-819ffe06eb41 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:15.464678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dbff1bcc-5376-48a3-bb85-819ffe06eb41 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.475616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dbff1bcc-5376-48a3-bb85-819ffe06eb41 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.476360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dbff1bcc-5376-48a3-bb85-819ffe06eb41 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.477456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dbff1bcc-5376-48a3-bb85-819ffe06eb41 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.478071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dbff1bcc-5376-48a3-bb85-819ffe06eb41 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.544515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-333ca22e-311e-4b30-a200-b7adfb82902e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.545355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-333ca22e-311e-4b30-a200-b7adfb82902e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.556350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-333ca22e-311e-4b30-a200-b7adfb82902e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.557086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-333ca22e-311e-4b30-a200-b7adfb82902e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.558459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-333ca22e-311e-4b30-a200-b7adfb82902e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.559142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-333ca22e-311e-4b30-a200-b7adfb82902e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.605153 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dbff1bcc-5376-48a3-bb85-819ffe06eb41 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "PUT /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1079 microversion: 2.1 time: 0.148057 Jul 20 04:19:15.617706 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1482/2914] 10.222.0.59 () {60 vars in 1255 bytes} [Wed Jul 20 04:19:15 2022] PUT /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1079 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:15.623044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-29b41ab4-d6d1-4529-877f-09468fbf1086 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.624072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-29b41ab4-d6d1-4529-877f-09468fbf1086 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.634568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29b41ab4-d6d1-4529-877f-09468fbf1086 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.635400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29b41ab4-d6d1-4529-877f-09468fbf1086 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.636970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29b41ab4-d6d1-4529-877f-09468fbf1086 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.637892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29b41ab4-d6d1-4529-877f-09468fbf1086 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.987071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-333ca22e-311e-4b30-a200-b7adfb82902e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:16.003568 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-333ca22e-311e-4b30-a200-b7adfb82902e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.463663 Jul 20 04:19:16.004939 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1433/2915] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:16.216953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-29b41ab4-d6d1-4529-877f-09468fbf1086 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:16.230199 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-29b41ab4-d6d1-4529-877f-09468fbf1086 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1505 microversion: 2.1 time: 0.611052 Jul 20 04:19:16.233115 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1483/2916] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:16.250183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d37c958e-701e-4873-bf6f-aa3f48b85ceb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:16.251089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d37c958e-701e-4873-bf6f-aa3f48b85ceb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:16.268880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d37c958e-701e-4873-bf6f-aa3f48b85ceb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.269361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d37c958e-701e-4873-bf6f-aa3f48b85ceb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.276625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d37c958e-701e-4873-bf6f-aa3f48b85ceb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.276625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d37c958e-701e-4873-bf6f-aa3f48b85ceb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.334153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c47ae97d-d78b-45bd-a69f-10e9c5b0eef3 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "add71f38-a7dc-4d6d-b767-a8dce7bbecce"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:16.335337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c47ae97d-d78b-45bd-a69f-10e9c5b0eef3 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:16.348436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c47ae97d-d78b-45bd-a69f-10e9c5b0eef3 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.349334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c47ae97d-d78b-45bd-a69f-10e9c5b0eef3 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.350353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c47ae97d-d78b-45bd-a69f-10e9c5b0eef3 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.350965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c47ae97d-d78b-45bd-a69f-10e9c5b0eef3 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.589535 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c47ae97d-d78b-45bd-a69f-10e9c5b0eef3 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] HTTP exception thrown: Volume add71f38-a7dc-4d6d-b767-a8dce7bbecce could not be found. Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c47ae97d-d78b-45bd-a69f-10e9c5b0eef3 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Request method failure captured: Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: request: PUT /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments/11034c61-98db-4729-993a-80763c55a1f4 HTTP/1.1 Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 74 Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14HtEcob53hs1sqkR1rJQaXZRnbnW7nkgNcZNqlCLN2I0wtEhWl6i50We7g0FTJ0uBLyzzqGyXjhvV7hTdnbvPCr18TMlCrvVGVq043E5Kw_J3wZ-D2nw8PTcDJ5TcOh-bbZ2vyiTC0ACJPLuGEUGZuUM-ToaHKTudgCEL3rjxa6_os Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e5cb77b798d54e288d2bb8218b9d7d44 Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesAdminNegativeTest-1442285252 Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e5cb77b798d54e288d2bb8218b9d7d44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5cb77b798d54e288d2bb8218b9d7d44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5cb77b798d54e288d2bb8218b9d7d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e5cb77b798d54e288d2bb8218b9d7d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesAdminNegativeTest-1442285252 Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e5cb77b798d54e288d2bb8218b9d7d44 Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1442285252 Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesAdminNegativeTest-1442285252-project-admin Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 754e124206e441c3badcacaf97d63336 Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesAdminNegativeTest-1442285252-project-admin Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: {"volumeAttachment": {"volumeId": "add71f38-a7dc-4d6d-b767-a8dce7bbecce"}} Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: exception: Volume add71f38-a7dc-4d6d-b767-a8dce7bbecce could not be found. Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'server_id': 'ea899275-fe75-439a-aec1-824f5cf75382', 'id': '11034c61-98db-4729-993a-80763c55a1f4', 'body': {'volumeAttachment': {'volumeId': 'add71f38-a7dc-4d6d-b767-a8dce7bbecce'}}} Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume add71f38-a7dc-4d6d-b767-a8dce7bbecce could not be found. (HTTP 404) (Request-ID: req-3dafb395-631b-4244-81b8-3188ec1648eb) Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:19:16.623227 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume add71f38-a7dc-4d6d-b767-a8dce7bbecce could not be found. Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume add71f38-a7dc-4d6d-b767-a8dce7bbecce could not be found. Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume add71f38-a7dc-4d6d-b767-a8dce7bbecce could not be found. Jul 20 04:19:16.627937 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:16.632443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c47ae97d-d78b-45bd-a69f-10e9c5b0eef3 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Returning 400 to user: Volume add71f38-a7dc-4d6d-b767-a8dce7bbecce could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:16.633578 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c47ae97d-d78b-45bd-a69f-10e9c5b0eef3 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] 10.222.0.59 "PUT /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments/11034c61-98db-4729-993a-80763c55a1f4" status: 400 len: 107 microversion: 2.1 time: 0.627251 Jul 20 04:19:16.634412 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1434/2917] 10.222.0.59 () {60 vars in 1432 bytes} [Wed Jul 20 04:19:16 2022] PUT /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments/11034c61-98db-4729-993a-80763c55a1f4 => generated 107 bytes in 629 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:19:16.741609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8620710f-cbc3-47a0-a734-18d2949a3e2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:16.742120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8620710f-cbc3-47a0-a734-18d2949a3e2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:16.758866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8620710f-cbc3-47a0-a734-18d2949a3e2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.760610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8620710f-cbc3-47a0-a734-18d2949a3e2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.763959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8620710f-cbc3-47a0-a734-18d2949a3e2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.764452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8620710f-cbc3-47a0-a734-18d2949a3e2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.902192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-8620710f-cbc3-47a0-a734-18d2949a3e2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lazy-loading 'services' on Instance uuid ea899275-fe75-439a-aec1-824f5cf75382 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:16.972304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d37c958e-701e-4873-bf6f-aa3f48b85ceb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:16.986865 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d37c958e-701e-4873-bf6f-aa3f48b85ceb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1505 microversion: 2.1 time: 0.740363 Jul 20 04:19:16.997886 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1484/2918] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:16 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1505 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:17.016571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:17.019862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:17.029940 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8620710f-cbc3-47a0-a734-18d2949a3e2b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments/11034c61-98db-4729-993a-80763c55a1f4" status: 202 len: 0 microversion: 2.1 time: 0.292326 Jul 20 04:19:17.031195 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1435/2919] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:19:16 2022] DELETE /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments/11034c61-98db-4729-993a-80763c55a1f4 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:17.036186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.036915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16a729a9-aa23-4a7c-ac43-8bf54eff32b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:17.037202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.037627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16a729a9-aa23-4a7c-ac43-8bf54eff32b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:17.039275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.040238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.058635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16a729a9-aa23-4a7c-ac43-8bf54eff32b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.059108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16a729a9-aa23-4a7c-ac43-8bf54eff32b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.060629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16a729a9-aa23-4a7c-ac43-8bf54eff32b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.061378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16a729a9-aa23-4a7c-ac43-8bf54eff32b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.211356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:17.212176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:17.212866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:17.213492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:17.214286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:17.226778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:17.328482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:17.344888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.349180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.350332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.351401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.456246 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ed95416a-b876-4f70-9cb0-a589940a03dd tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "POST /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4/action" status: 202 len: 1111 microversion: 2.1 time: 0.445466 Jul 20 04:19:17.458488 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1485/2920] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:19:17 2022] POST /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4/action => generated 1111 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 20 04:19:17.464753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cf3c15c7-97d3-484b-ac4d-9a9289c962c2 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:17.466344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cf3c15c7-97d3-484b-ac4d-9a9289c962c2 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:17.475013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf3c15c7-97d3-484b-ac4d-9a9289c962c2 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.476640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf3c15c7-97d3-484b-ac4d-9a9289c962c2 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.477847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf3c15c7-97d3-484b-ac4d-9a9289c962c2 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.478733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf3c15c7-97d3-484b-ac4d-9a9289c962c2 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.492579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-16a729a9-aa23-4a7c-ac43-8bf54eff32b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:17.507695 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16a729a9-aa23-4a7c-ac43-8bf54eff32b5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.475086 Jul 20 04:19:17.510861 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1436/2921] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:17 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:17.527322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e071d99e-f862-4cf3-8ad5-14ac0b7862db tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:17.529506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e071d99e-f862-4cf3-8ad5-14ac0b7862db tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:17.545117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e071d99e-f862-4cf3-8ad5-14ac0b7862db tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.546265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e071d99e-f862-4cf3-8ad5-14ac0b7862db tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.550724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e071d99e-f862-4cf3-8ad5-14ac0b7862db tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.551510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e071d99e-f862-4cf3-8ad5-14ac0b7862db tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.577986 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cf3c15c7-97d3-484b-ac4d-9a9289c962c2 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118008 Jul 20 04:19:17.583045 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1486/2922] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:19:17 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:17.710110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d614270e-b7df-438c-bf93-07124852b3f5 tempest-ComputeTenantNetworksTest-1456090470 tempest-ComputeTenantNetworksTest-1456090470-project] Calling method '.version_select at 0x7fb8411149d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:17.917501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e071d99e-f862-4cf3-8ad5-14ac0b7862db tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:17.926359 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e071d99e-f862-4cf3-8ad5-14ac0b7862db tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.412663 Jul 20 04:19:17.940379 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1437/2923] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:17 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:18.075305 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d614270e-b7df-438c-bf93-07124852b3f5 tempest-ComputeTenantNetworksTest-1456090470 tempest-ComputeTenantNetworksTest-1456090470-project] 10.222.0.59 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.448834 Jul 20 04:19:18.077170 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1487/2924] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:19:17 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:18.087314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ad8634ff-8a49-4d22-bd83-cd338c31a4ea tempest-ComputeTenantNetworksTest-1456090470 tempest-ComputeTenantNetworksTest-1456090470-project] Calling method '.version_select at 0x7fb841eee550>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:18.271665 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ad8634ff-8a49-4d22-bd83-cd338c31a4ea tempest-ComputeTenantNetworksTest-1456090470 tempest-ComputeTenantNetworksTest-1456090470-project] 10.222.0.59 "GET /compute/v2.1/os-tenant-networks/b42c9290-edd4-4d31-9a60-640837cfa22f" status: 200 len: 139 microversion: 2.1 time: 0.188158 Jul 20 04:19:18.272277 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1438/2925] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:19:18 2022] GET /compute/v2.1/os-tenant-networks/b42c9290-edd4-4d31-9a60-640837cfa22f => generated 139 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:18.527676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-03dacc30-507f-463a-9742-07da148d5ae2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:18.528319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-03dacc30-507f-463a-9742-07da148d5ae2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:18.539773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03dacc30-507f-463a-9742-07da148d5ae2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.540306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03dacc30-507f-463a-9742-07da148d5ae2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.541051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03dacc30-507f-463a-9742-07da148d5ae2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.541510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03dacc30-507f-463a-9742-07da148d5ae2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.593554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43ab7919-bbcf-4886-a9b9-039567bb43d9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:18.594191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43ab7919-bbcf-4886-a9b9-039567bb43d9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:18.620320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43ab7919-bbcf-4886-a9b9-039567bb43d9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.620783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43ab7919-bbcf-4886-a9b9-039567bb43d9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.629176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43ab7919-bbcf-4886-a9b9-039567bb43d9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.635850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43ab7919-bbcf-4886-a9b9-039567bb43d9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.698399 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43ab7919-bbcf-4886-a9b9-039567bb43d9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109171 Jul 20 04:19:18.700134 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1439/2926] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:19:18 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:18.950558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-57b0cd4b-7c96-41e7-85d2-af564f6ef62b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:18.953044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-57b0cd4b-7c96-41e7-85d2-af564f6ef62b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:18.961427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57b0cd4b-7c96-41e7-85d2-af564f6ef62b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.962276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57b0cd4b-7c96-41e7-85d2-af564f6ef62b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.963307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57b0cd4b-7c96-41e7-85d2-af564f6ef62b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.964232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57b0cd4b-7c96-41e7-85d2-af564f6ef62b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.211495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-03dacc30-507f-463a-9742-07da148d5ae2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:19.233998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-57b0cd4b-7c96-41e7-85d2-af564f6ef62b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:19.243820 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-03dacc30-507f-463a-9742-07da148d5ae2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1512 microversion: 2.1 time: 0.719330 Jul 20 04:19:19.244615 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1488/2927] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:18 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1512 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:19.245088 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-57b0cd4b-7c96-41e7-85d2-af564f6ef62b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.299606 Jul 20 04:19:19.245840 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1440/2928] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:18 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:19.711424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-64f8edc5-bb58-4bf5-b5bf-9907fb3a3a4a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:19.712746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-64f8edc5-bb58-4bf5-b5bf-9907fb3a3a4a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:19.724636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f8edc5-bb58-4bf5-b5bf-9907fb3a3a4a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.725503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f8edc5-bb58-4bf5-b5bf-9907fb3a3a4a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.726857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f8edc5-bb58-4bf5-b5bf-9907fb3a3a4a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.739098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f8edc5-bb58-4bf5-b5bf-9907fb3a3a4a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.789935 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-64f8edc5-bb58-4bf5-b5bf-9907fb3a3a4a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081608 Jul 20 04:19:19.793275 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1489/2929] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:19:19 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:20.264052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6942fed3-aef8-4545-86ba-42e0be267dcb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.265443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6942fed3-aef8-4545-86ba-42e0be267dcb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.269307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c3f00f2a-d18c-4c15-8e26-1bf3d84d7217 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.270696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c3f00f2a-d18c-4c15-8e26-1bf3d84d7217 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.278018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6942fed3-aef8-4545-86ba-42e0be267dcb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.278715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6942fed3-aef8-4545-86ba-42e0be267dcb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.281662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6942fed3-aef8-4545-86ba-42e0be267dcb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.282893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6942fed3-aef8-4545-86ba-42e0be267dcb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.283305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3f00f2a-d18c-4c15-8e26-1bf3d84d7217 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.284137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3f00f2a-d18c-4c15-8e26-1bf3d84d7217 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.287938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3f00f2a-d18c-4c15-8e26-1bf3d84d7217 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.290888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3f00f2a-d18c-4c15-8e26-1bf3d84d7217 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.551527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c3f00f2a-d18c-4c15-8e26-1bf3d84d7217 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:20.560281 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c3f00f2a-d18c-4c15-8e26-1bf3d84d7217 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1489 microversion: 2.1 time: 0.300921 Jul 20 04:19:20.562192 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1441/2930] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:20 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1489 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:20.578796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c00383f3-ade1-49a4-97f2-6072afd6f4c9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.588034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c00383f3-ade1-49a4-97f2-6072afd6f4c9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.594685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c00383f3-ade1-49a4-97f2-6072afd6f4c9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.595461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c00383f3-ade1-49a4-97f2-6072afd6f4c9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.596383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c00383f3-ade1-49a4-97f2-6072afd6f4c9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.597053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c00383f3-ade1-49a4-97f2-6072afd6f4c9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.630271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c00383f3-ade1-49a4-97f2-6072afd6f4c9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:20.696782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6942fed3-aef8-4545-86ba-42e0be267dcb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:20.708408 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6942fed3-aef8-4545-86ba-42e0be267dcb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.446471 Jul 20 04:19:20.709620 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1490/2931] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:20 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:20.769556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:20.776114 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c00383f3-ade1-49a4-97f2-6072afd6f4c9 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 204 len: 0 microversion: 2.1 time: 0.200217 Jul 20 04:19:20.777574 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1442/2932] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:20 2022] DELETE /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:20.786416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c46e8209-21fe-42c2-bb42-043e62a9b966 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.787259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c46e8209-21fe-42c2-bb42-043e62a9b966 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.802941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c46e8209-21fe-42c2-bb42-043e62a9b966 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.803698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c46e8209-21fe-42c2-bb42-043e62a9b966 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.804656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c46e8209-21fe-42c2-bb42-043e62a9b966 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.805277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c46e8209-21fe-42c2-bb42-043e62a9b966 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.806132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-493764ce-6603-479f-9658-fa69554add66 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.807557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-493764ce-6603-479f-9658-fa69554add66 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.821988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-493764ce-6603-479f-9658-fa69554add66 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.826995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-493764ce-6603-479f-9658-fa69554add66 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.830668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-493764ce-6603-479f-9658-fa69554add66 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.832137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-493764ce-6603-479f-9658-fa69554add66 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.901616 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-493764ce-6603-479f-9658-fa69554add66 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100518 Jul 20 04:19:20.908981 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1443/2933] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:19:20 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:21.493031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c46e8209-21fe-42c2-bb42-043e62a9b966 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:21.513280 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c46e8209-21fe-42c2-bb42-043e62a9b966 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1495 microversion: 2.1 time: 0.731626 Jul 20 04:19:21.524346 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1491/2934] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:20 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1495 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:21.690069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1078152718", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5ead2ac-90a5-4a98-88cc-7af516957d4b"}], "security_groups": [{"name": "tempest-securitygroup--1348464636"}], "key_name": "tempest-keypair-1981349681", "user_data": "}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:21.726786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-51e3a9e1-a38d-42bc-bedb-894fc92b8d89 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:21.727514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-51e3a9e1-a38d-42bc-bedb-894fc92b8d89 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:21.735531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51e3a9e1-a38d-42bc-bedb-894fc92b8d89 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.736186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51e3a9e1-a38d-42bc-bedb-894fc92b8d89 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.745651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51e3a9e1-a38d-42bc-bedb-894fc92b8d89 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.746160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51e3a9e1-a38d-42bc-bedb-894fc92b8d89 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.884308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] validate_networks() for [('c5ead2ac-90a5-4a98-88cc-7af516957d4b', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:22.458175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-51e3a9e1-a38d-42bc-bedb-894fc92b8d89 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:22.475579 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-51e3a9e1-a38d-42bc-bedb-894fc92b8d89 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.752508 Jul 20 04:19:22.476649 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1492/2935] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:21 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:22.489080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c9ddc6d-7d1e-4dd8-a845-88fc15ff76b0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:22.490036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0c9ddc6d-7d1e-4dd8-a845-88fc15ff76b0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:22.508696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c9ddc6d-7d1e-4dd8-a845-88fc15ff76b0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.509359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c9ddc6d-7d1e-4dd8-a845-88fc15ff76b0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.509934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c9ddc6d-7d1e-4dd8-a845-88fc15ff76b0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.510399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c9ddc6d-7d1e-4dd8-a845-88fc15ff76b0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.592543 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0c9ddc6d-7d1e-4dd8-a845-88fc15ff76b0 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114654 Jul 20 04:19:22.593450 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1493/2936] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:19:22 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:22.807796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c1defaec-f24f-4141-9070-3622a97c47b6 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Action: 'create', calling method: .version_select at 0x7fb841c8b430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-756150999", "metadata": {"Type": "work"}}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:22.832557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:22.833023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:22.833463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:22.833884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:22.834367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:22.849921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.850412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.852276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.853457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.893883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Getting quotas for project 93f8bfd8e5a34423848573c7caab8d68. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:22.900157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Getting quotas for user 337b3a46906648cb82515704eadcdb38 and project 93f8bfd8e5a34423848573c7caab8d68. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:22.915472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:22.918411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:22.983636 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5120ce75-c42a-47c1-bc3c-3af8e9464c5d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.300346 Jul 20 04:19:22.985130 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1444/2937] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:22.994288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-496224f8-8d6d-4df0-99aa-f618269ea1bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:22.995278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-496224f8-8d6d-4df0-99aa-f618269ea1bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:23.010956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-496224f8-8d6d-4df0-99aa-f618269ea1bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.011769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-496224f8-8d6d-4df0-99aa-f618269ea1bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.012893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-496224f8-8d6d-4df0-99aa-f618269ea1bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.013606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-496224f8-8d6d-4df0-99aa-f618269ea1bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.522909 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c1defaec-f24f-4141-9070-3622a97c47b6 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.928056 Jul 20 04:19:23.524267 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1494/2938] 10.222.0.59 () {60 vars in 1155 bytes} [Wed Jul 20 04:19:22 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 930 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 04:19:23.530056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-601be0b9-0059-4d0c-8965-d7c91018fe8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:23.531026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-601be0b9-0059-4d0c-8965-d7c91018fe8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:23.670928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-496224f8-8d6d-4df0-99aa-f618269ea1bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:23.685600 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-496224f8-8d6d-4df0-99aa-f618269ea1bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1495 microversion: 2.1 time: 0.697953 Jul 20 04:19:23.687398 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1445/2939] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:22 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1495 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:23.702709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-74e04052-6efe-49a8-9a55-be27d70faa8b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:23.703489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-74e04052-6efe-49a8-9a55-be27d70faa8b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:23.717890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74e04052-6efe-49a8-9a55-be27d70faa8b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.721523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74e04052-6efe-49a8-9a55-be27d70faa8b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.722521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74e04052-6efe-49a8-9a55-be27d70faa8b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.723100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74e04052-6efe-49a8-9a55-be27d70faa8b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:24.029358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-601be0b9-0059-4d0c-8965-d7c91018fe8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:24.037025 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-601be0b9-0059-4d0c-8965-d7c91018fe8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1238 microversion: 2.1 time: 0.511385 Jul 20 04:19:24.051785 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1495/2940] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:23 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1238 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:24.075805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0485d25c-d73c-4bc0-9966-7ab94e634417 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Calling method '.version_select at 0x7fb841c8b430>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:24.187910 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0485d25c-d73c-4bc0-9966-7ab94e634417 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707" status: 200 len: 352 microversion: 2.1 time: 0.132694 Jul 20 04:19:24.193104 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1496/2941] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:19:24 2022] GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707 => generated 352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:24.198518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-24899d6b-d5c5-406a-aeab-84b3b066ace9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:24.199947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-24899d6b-d5c5-406a-aeab-84b3b066ace9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:24.232001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24899d6b-d5c5-406a-aeab-84b3b066ace9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:24.239086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24899d6b-d5c5-406a-aeab-84b3b066ace9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:24.240214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24899d6b-d5c5-406a-aeab-84b3b066ace9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:24.240835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24899d6b-d5c5-406a-aeab-84b3b066ace9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:24.342001 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-24899d6b-d5c5-406a-aeab-84b3b066ace9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147643 Jul 20 04:19:24.342889 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1497/2942] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:19:24 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:24.439465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c4b939c5-a4ba-4b95-be30-0e6130354427 req-c82fcf89-75b0-49c5-b121-876d4510d206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b48b17a-920e-4020-ae3f-0027021d7253", "name": "network-vif-deleted", "tag": "6e448566-dce6-4bab-a936-60412c4e3d62"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:24.461608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c4b939c5-a4ba-4b95-be30-0e6130354427 req-c82fcf89-75b0-49c5-b121-876d4510d206 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:24.462082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c4b939c5-a4ba-4b95-be30-0e6130354427 req-c82fcf89-75b0-49c5-b121-876d4510d206 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:24.498543 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c4b939c5-a4ba-4b95-be30-0e6130354427 req-c82fcf89-75b0-49c5-b121-876d4510d206 service nova] Creating event network-vif-deleted:6e448566-dce6-4bab-a936-60412c4e3d62 for instance 2b48b17a-920e-4020-ae3f-0027021d7253 on n-h1-760456-11 Jul 20 04:19:24.513076 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c4b939c5-a4ba-4b95-be30-0e6130354427 req-c82fcf89-75b0-49c5-b121-876d4510d206 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071814 Jul 20 04:19:24.515254 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1498/2943] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:24.707841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:24.710772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:24.727350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:24.733171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:24.735758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:24.736401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:24.798540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-74e04052-6efe-49a8-9a55-be27d70faa8b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:24.813345 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-74e04052-6efe-49a8-9a55-be27d70faa8b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 1.124760 Jul 20 04:19:24.820937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:24.827240 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1446/2944] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:23 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:24.834383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:24.836591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lazy-loading 'fault' on Instance uuid 2b48b17a-920e-4020-ae3f-0027021d7253 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:24.934847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:24.957861 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cbb26ea5-23c0-4507-85e6-6a708e496970 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 200 len: 1305 microversion: 2.1 time: 0.255049 Jul 20 04:19:24.965538 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1499/2945] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:24 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 1305 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:25.055088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df13f877-c80a-4610-8f68-80a6b7916b9d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:25.055964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-df13f877-c80a-4610-8f68-80a6b7916b9d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:25.064729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df13f877-c80a-4610-8f68-80a6b7916b9d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.065444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df13f877-c80a-4610-8f68-80a6b7916b9d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.067219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df13f877-c80a-4610-8f68-80a6b7916b9d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.067968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df13f877-c80a-4610-8f68-80a6b7916b9d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.201168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c5077247-7b08-47b6-b85c-5b7dfec36a0d tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Calling method '.version_select at 0x7fb84112d0d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:25.224098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df13f877-c80a-4610-8f68-80a6b7916b9d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:25.243974 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-df13f877-c80a-4610-8f68-80a6b7916b9d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1296 microversion: 2.1 time: 0.189788 Jul 20 04:19:25.244651 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1447/2946] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:25 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1296 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:25.331533 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c5077247-7b08-47b6-b85c-5b7dfec36a0d tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707" status: 200 len: 352 microversion: 2.1 time: 0.134778 Jul 20 04:19:25.333989 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1500/2947] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:19:25 2022] GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707 => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:25.355187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0e1b278-d4ef-466f-afd1-99909e5d8f56 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:25.356558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0e1b278-d4ef-466f-afd1-99909e5d8f56 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:25.364891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0e1b278-d4ef-466f-afd1-99909e5d8f56 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.365349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0e1b278-d4ef-466f-afd1-99909e5d8f56 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.366166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0e1b278-d4ef-466f-afd1-99909e5d8f56 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.366641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0e1b278-d4ef-466f-afd1-99909e5d8f56 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.416813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:25.422746 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0e1b278-d4ef-466f-afd1-99909e5d8f56 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071964 Jul 20 04:19:25.424350 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1448/2948] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:19:25 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:19:25.633409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1408035168", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "635129a9-dca1-4aaf-b500-8ea126800731"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:25.699038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] validate_networks() for [('635129a9-dca1-4aaf-b500-8ea126800731', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:25.834862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f8995346-c108-4f99-ac75-d156360f483e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:25.837408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f8995346-c108-4f99-ac75-d156360f483e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:25.849202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8995346-c108-4f99-ac75-d156360f483e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.850697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8995346-c108-4f99-ac75-d156360f483e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.852019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8995346-c108-4f99-ac75-d156360f483e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.852731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8995346-c108-4f99-ac75-d156360f483e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.083776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f8995346-c108-4f99-ac75-d156360f483e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:26.093125 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f8995346-c108-4f99-ac75-d156360f483e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.264154 Jul 20 04:19:26.112501 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1449/2949] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:25 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:26.120285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ecd1c2c-f25e-4d32-9686-a69130180840 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.120850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ecd1c2c-f25e-4d32-9686-a69130180840 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:26.144488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ecd1c2c-f25e-4d32-9686-a69130180840 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.145077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ecd1c2c-f25e-4d32-9686-a69130180840 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.145892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ecd1c2c-f25e-4d32-9686-a69130180840 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.146443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ecd1c2c-f25e-4d32-9686-a69130180840 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.168156 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-1ecd1c2c-f25e-4d32-9686-a69130180840 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ecd1c2c-f25e-4d32-9686-a69130180840 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 HTTP/1.1 Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '2b48b17a-920e-4020-ae3f-0027021d7253'} Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:26.171126 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.176523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:26.176523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:26.176523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:26.176523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:26.176523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:26.176523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:26.176523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.178428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ecd1c2c-f25e-4d32-9686-a69130180840 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:26.179499 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ecd1c2c-f25e-4d32-9686-a69130180840 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 404 len: 111 microversion: 2.1 time: 0.065804 Jul 20 04:19:26.180547 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1450/2950] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:26 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:26.262977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c02fe6f-dfd0-456b-86b5-a466fcd821ed tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.264008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c02fe6f-dfd0-456b-86b5-a466fcd821ed tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:26.276535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c02fe6f-dfd0-456b-86b5-a466fcd821ed tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.279303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c02fe6f-dfd0-456b-86b5-a466fcd821ed tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.283557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c02fe6f-dfd0-456b-86b5-a466fcd821ed tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.284318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c02fe6f-dfd0-456b-86b5-a466fcd821ed tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.601233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c02fe6f-dfd0-456b-86b5-a466fcd821ed tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:26.612892 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c02fe6f-dfd0-456b-86b5-a466fcd821ed tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1364 microversion: 2.1 time: 0.354639 Jul 20 04:19:26.614340 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1451/2951] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:26 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1364 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:26.620241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-844445358", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "191d678e-1adc-40c3-b7b1-1a7cb20ca675"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:26.683521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] validate_networks() for [('191d678e-1adc-40c3-b7b1-1a7cb20ca675', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:27.189265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:27.190494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:27.191145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:27.191758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:27.193266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:27.205264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.205986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.207010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.207651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.244676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Getting quotas for project 0be768b73a844766a2407ac16a2b7304. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:27.252431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Getting quotas for user 0458026d4c4f43b1a770140d09b2e164 and project 0be768b73a844766a2407ac16a2b7304. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:27.269236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:27.271868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:27.326546 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4a1c1cbc-72bf-4ea0-aa61-d1661fbdcb5b tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.696323 Jul 20 04:19:27.327688 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1501/2952] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:27.333693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0bc6a4a-b165-40d6-abb4-35d61086f1eb tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Calling method '.version_select at 0x7fb8411329d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.398862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:27.399426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:27.399800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:27.400214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:27.400626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:27.406886 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d0bc6a4a-b165-40d6-abb4-35d61086f1eb tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707" status: 200 len: 353 microversion: 2.1 time: 0.077963 Jul 20 04:19:27.409495 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1502/2953] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:19:27 2022] GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707 => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:27.414380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a48418fa-3d92-414e-b2c9-47f03f9e3cf1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.415503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a48418fa-3d92-414e-b2c9-47f03f9e3cf1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:27.417634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.418611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.421837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.422305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.426349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a48418fa-3d92-414e-b2c9-47f03f9e3cf1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.426349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a48418fa-3d92-414e-b2c9-47f03f9e3cf1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.427041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a48418fa-3d92-414e-b2c9-47f03f9e3cf1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.427966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a48418fa-3d92-414e-b2c9-47f03f9e3cf1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.465805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:27.476008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Getting quotas for user 9f053f31c02c412394d48ce65350d153 and project ab3aecd6003c4614bf21b8134ceb98a1. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:27.491588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:27.493746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:27.546030 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b07f438f-c81a-40c4-8f47-e21cdc80b7a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930414 Jul 20 04:19:27.550292 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1452/2954] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:27.556955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0b9212e-0585-4c3a-a400-2c478ed574e5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.558086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0b9212e-0585-4c3a-a400-2c478ed574e5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:27.708017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c0b9212e-0585-4c3a-a400-2c478ed574e5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:27.720613 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0b9212e-0585-4c3a-a400-2c478ed574e5 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1218 microversion: 2.1 time: 0.171341 Jul 20 04:19:27.721238 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1453/2955] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:27 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:27.738881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eff0488f-a3b8-4fba-b671-481951bc74b4 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Calling method '.version_select at 0x7fb841e47700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.846270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a48418fa-3d92-414e-b2c9-47f03f9e3cf1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:27.854160 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eff0488f-a3b8-4fba-b671-481951bc74b4 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707" status: 200 len: 353 microversion: 2.1 time: 0.129470 Jul 20 04:19:27.855060 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1454/2956] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:19:27 2022] GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707 => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:27.857052 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a48418fa-3d92-414e-b2c9-47f03f9e3cf1 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.446132 Jul 20 04:19:27.859537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f1bbac6-9cd7-4003-8d9f-1af8eccb33ea tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.860836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f1bbac6-9cd7-4003-8d9f-1af8eccb33ea tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:27.869039 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1503/2957] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:27 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:27.874538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e5f8ca0e-7fec-4d92-9942-e9b32827a63a req-53b1fab0-bf2b-487a-b3ac-2d84e7da5458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4eb6ee-6232-43c2-a09b-55e0dda420d2", "tag": "8a7fbcc3-29b2-4ac1-a2b9-1a27d746c53c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:27.912680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e5f8ca0e-7fec-4d92-9942-e9b32827a63a req-53b1fab0-bf2b-487a-b3ac-2d84e7da5458 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:27.913143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e5f8ca0e-7fec-4d92-9942-e9b32827a63a req-53b1fab0-bf2b-487a-b3ac-2d84e7da5458 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.948409 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e5f8ca0e-7fec-4d92-9942-e9b32827a63a req-53b1fab0-bf2b-487a-b3ac-2d84e7da5458 service nova] Creating event network-changed:8a7fbcc3-29b2-4ac1-a2b9-1a27d746c53c for instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 on n-h2-760456-11 Jul 20 04:19:27.955963 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e5f8ca0e-7fec-4d92-9942-e9b32827a63a req-53b1fab0-bf2b-487a-b3ac-2d84e7da5458 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084846 Jul 20 04:19:27.957781 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1504/2958] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:27.992603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f1bbac6-9cd7-4003-8d9f-1af8eccb33ea tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:27.997611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8bb385dd-58f5-4fc3-a113-ea77743f577d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.998473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8bb385dd-58f5-4fc3-a113-ea77743f577d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:28.000424 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f1bbac6-9cd7-4003-8d9f-1af8eccb33ea tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1214 microversion: 2.1 time: 0.144298 Jul 20 04:19:28.001050 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1455/2959] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:27 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:28.015574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec1e46ee-5423-46af-ac3a-7a1368cb72c6 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Calling method '.version_select at 0x7fb841e47e50>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.024732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bb385dd-58f5-4fc3-a113-ea77743f577d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.031459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bb385dd-58f5-4fc3-a113-ea77743f577d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.033384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bb385dd-58f5-4fc3-a113-ea77743f577d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.033859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bb385dd-58f5-4fc3-a113-ea77743f577d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.182297 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec1e46ee-5423-46af-ac3a-7a1368cb72c6 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707" status: 202 len: 0 microversion: 2.1 time: 0.177186 Jul 20 04:19:28.183578 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1456/2960] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:19:28 2022] DELETE /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:28.194577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bfdcbd11-3051-40f3-b21e-dd319b7d9f3c tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Calling method '.version_select at 0x7fb841ebb670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.345181 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bfdcbd11-3051-40f3-b21e-dd319b7d9f3c tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707" status: 200 len: 352 microversion: 2.1 time: 0.156144 Jul 20 04:19:28.347425 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1457/2961] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:19:28 2022] GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707 => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:28.550774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8bb385dd-58f5-4fc3-a113-ea77743f577d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:28.559697 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8bb385dd-58f5-4fc3-a113-ea77743f577d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1364 microversion: 2.1 time: 0.583134 Jul 20 04:19:28.563066 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1505/2962] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:27 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1364 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:28.749990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ae29dbc-67a7-4712-8238-bbd9e2f62159 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.751498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ae29dbc-67a7-4712-8238-bbd9e2f62159 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:28.763470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ae29dbc-67a7-4712-8238-bbd9e2f62159 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.764627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ae29dbc-67a7-4712-8238-bbd9e2f62159 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.765845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ae29dbc-67a7-4712-8238-bbd9e2f62159 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.767107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ae29dbc-67a7-4712-8238-bbd9e2f62159 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.856882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1ae29dbc-67a7-4712-8238-bbd9e2f62159 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:28.866728 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ae29dbc-67a7-4712-8238-bbd9e2f62159 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1270 microversion: 2.1 time: 0.133434 Jul 20 04:19:28.867880 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1458/2963] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:28 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:28.878184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c2089557-c42b-4259-a36f-1f9838c71398 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.879481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c2089557-c42b-4259-a36f-1f9838c71398 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:28.886818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2089557-c42b-4259-a36f-1f9838c71398 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.887515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2089557-c42b-4259-a36f-1f9838c71398 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.888575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2089557-c42b-4259-a36f-1f9838c71398 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.889182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2089557-c42b-4259-a36f-1f9838c71398 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.021988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eae88241-7aef-48d6-9051-78b1b0a08a74 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:29.024610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eae88241-7aef-48d6-9051-78b1b0a08a74 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:29.033307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eae88241-7aef-48d6-9051-78b1b0a08a74 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.034489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eae88241-7aef-48d6-9051-78b1b0a08a74 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.036903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eae88241-7aef-48d6-9051-78b1b0a08a74 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.037607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eae88241-7aef-48d6-9051-78b1b0a08a74 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.113829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eae88241-7aef-48d6-9051-78b1b0a08a74 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:29.123493 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eae88241-7aef-48d6-9051-78b1b0a08a74 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1266 microversion: 2.1 time: 0.108912 Jul 20 04:19:29.124966 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1459/2964] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:29 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:29.305779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c2089557-c42b-4259-a36f-1f9838c71398 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:29.321258 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c2089557-c42b-4259-a36f-1f9838c71398 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.449437 Jul 20 04:19:29.322596 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1506/2965] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:28 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:29.359412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cd90ff1f-4406-4c26-b19b-560e5228cc20 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Calling method '.version_select at 0x7fb841eee790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:29.503140 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cd90ff1f-4406-4c26-b19b-560e5228cc20 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707" status: 200 len: 352 microversion: 2.1 time: 0.147360 Jul 20 04:19:29.504005 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1460/2966] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:19:29 2022] GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707 => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:29.582774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e73b2498-4b6c-41a1-aa48-b83111e5c1c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:29.584175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e73b2498-4b6c-41a1-aa48-b83111e5c1c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:29.599614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e73b2498-4b6c-41a1-aa48-b83111e5c1c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.600526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e73b2498-4b6c-41a1-aa48-b83111e5c1c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.604203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e73b2498-4b6c-41a1-aa48-b83111e5c1c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.604738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e73b2498-4b6c-41a1-aa48-b83111e5c1c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.885778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b74399bb-dbf9-462d-afd1-2a1419d0d5a3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:29.886460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b74399bb-dbf9-462d-afd1-2a1419d0d5a3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:29.903114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b74399bb-dbf9-462d-afd1-2a1419d0d5a3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.903489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b74399bb-dbf9-462d-afd1-2a1419d0d5a3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.904983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b74399bb-dbf9-462d-afd1-2a1419d0d5a3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.905939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b74399bb-dbf9-462d-afd1-2a1419d0d5a3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.056968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e73b2498-4b6c-41a1-aa48-b83111e5c1c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:30.067484 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e73b2498-4b6c-41a1-aa48-b83111e5c1c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1364 microversion: 2.1 time: 0.490596 Jul 20 04:19:30.069925 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1507/2967] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:29 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1364 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:30.094400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b74399bb-dbf9-462d-afd1-2a1419d0d5a3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:30.106960 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b74399bb-dbf9-462d-afd1-2a1419d0d5a3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1276 microversion: 2.1 time: 0.225806 Jul 20 04:19:30.117960 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1461/2968] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:29 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:30.143297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-971d1831-6a3e-44c6-95d4-d70aa6f2553d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.144183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-971d1831-6a3e-44c6-95d4-d70aa6f2553d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:30.153680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-971d1831-6a3e-44c6-95d4-d70aa6f2553d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.155394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-971d1831-6a3e-44c6-95d4-d70aa6f2553d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.162001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-971d1831-6a3e-44c6-95d4-d70aa6f2553d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.164611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-971d1831-6a3e-44c6-95d4-d70aa6f2553d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.212916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:30.314636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-971d1831-6a3e-44c6-95d4-d70aa6f2553d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:30.328756 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-971d1831-6a3e-44c6-95d4-d70aa6f2553d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1272 microversion: 2.1 time: 0.188941 Jul 20 04:19:30.359092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b52dc702-17d0-4f69-b206-d0ceaf85a991 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.359984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b52dc702-17d0-4f69-b206-d0ceaf85a991 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:30.367151 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1508/2969] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:30.378482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b52dc702-17d0-4f69-b206-d0ceaf85a991 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.380356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b52dc702-17d0-4f69-b206-d0ceaf85a991 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.383177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b52dc702-17d0-4f69-b206-d0ceaf85a991 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.385186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b52dc702-17d0-4f69-b206-d0ceaf85a991 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.534882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6ae6a36b-a2a1-4525-bd74-c8bedd1892ae tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Calling method '.version_select at 0x7fb841241670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.662485 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6ae6a36b-a2a1-4525-bd74-c8bedd1892ae tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707" status: 200 len: 352 microversion: 2.1 time: 0.141843 Jul 20 04:19:30.667932 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1509/2970] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707 => generated 352 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:30.899993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b52dc702-17d0-4f69-b206-d0ceaf85a991 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:30.910929 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b52dc702-17d0-4f69-b206-d0ceaf85a991 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.566735 Jul 20 04:19:30.920801 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1462/2971] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:31.087659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8b8d5160-1285-478d-bb6c-c81e524a76a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:31.088309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8b8d5160-1285-478d-bb6c-c81e524a76a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:31.143805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-68cf6e77-3de2-4d11-af55-13497f0683ed tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:31.144650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-68cf6e77-3de2-4d11-af55-13497f0683ed tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:31.153695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8d5160-1285-478d-bb6c-c81e524a76a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.154811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8d5160-1285-478d-bb6c-c81e524a76a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.156440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8d5160-1285-478d-bb6c-c81e524a76a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.184753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8d5160-1285-478d-bb6c-c81e524a76a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.197060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68cf6e77-3de2-4d11-af55-13497f0683ed tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.199238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68cf6e77-3de2-4d11-af55-13497f0683ed tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.209381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68cf6e77-3de2-4d11-af55-13497f0683ed tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.210791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68cf6e77-3de2-4d11-af55-13497f0683ed tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.718779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8b8d5160-1285-478d-bb6c-c81e524a76a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:31.733498 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8b8d5160-1285-478d-bb6c-c81e524a76a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1364 microversion: 2.1 time: 0.647946 Jul 20 04:19:31.738308 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1510/2972] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:31 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1364 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:31.747243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f6af261-840a-4b6e-89ca-3d79fb70a7a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:31.747881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8f6af261-840a-4b6e-89ca-3d79fb70a7a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:31.763254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f6af261-840a-4b6e-89ca-3d79fb70a7a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.763733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f6af261-840a-4b6e-89ca-3d79fb70a7a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.764548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f6af261-840a-4b6e-89ca-3d79fb70a7a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.768428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f6af261-840a-4b6e-89ca-3d79fb70a7a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.200146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-68cf6e77-3de2-4d11-af55-13497f0683ed tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:32.217899 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-68cf6e77-3de2-4d11-af55-13497f0683ed tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1318 microversion: 2.1 time: 1.093100 Jul 20 04:19:32.221491 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1463/2973] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:31 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1318 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:32.234594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ad0eebd-2ec7-45f2-be3e-ef9f0ad2baa3 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Calling method '.version_select at 0x7fb841d1a4c0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:32.289993 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8ad0eebd-2ec7-45f2-be3e-ef9f0ad2baa3 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] HTTP exception thrown: Volume 8231ecdb-d884-4a03-8939-77ca592de707 could not be found. Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ad0eebd-2ec7-45f2-be3e-ef9f0ad2baa3 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Request method failure captured: Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707 HTTP/1.1 Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14JK0U4sOXwLpTOAPG0JKbzXr8xVTDGXTnjyj3-KRr00dx_KyrmN-og3FU3M3z71dL6HZtpsktKDRhAU1MPS0U_tX84ulI_ojK3dd-AsYJs1zzRi7GVOT2qjFEGTFC7tTa5gdxh-WZztAJocwTFF795RGeSYAhxbLq7fsR2rDZmIJ0Y Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 7585b75a54a94c2b99403f041d2ee50e Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesGetTestJSON-360034633 Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7585b75a54a94c2b99403f041d2ee50e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7585b75a54a94c2b99403f041d2ee50e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7585b75a54a94c2b99403f041d2ee50e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7585b75a54a94c2b99403f041d2ee50e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesGetTestJSON-360034633 Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 7585b75a54a94c2b99403f041d2ee50e Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesGetTestJSON-360034633 Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesGetTestJSON-360034633-project Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: c2d09898e3c34544829a0da55bc7ef83 Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesGetTestJSON-360034633-project Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: exception: Volume 8231ecdb-d884-4a03-8939-77ca592de707 could not be found. Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8231ecdb-d884-4a03-8939-77ca592de707'} Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8231ecdb-d884-4a03-8939-77ca592de707 could not be found. (HTTP 404) (Request-ID: req-071ca5a8-84d0-4eb2-a05f-d08a8328fd8b) Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:19:32.292174 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8231ecdb-d884-4a03-8939-77ca592de707 could not be found. Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8231ecdb-d884-4a03-8939-77ca592de707 could not be found. Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8231ecdb-d884-4a03-8939-77ca592de707 could not be found. Jul 20 04:19:32.296962 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:32.300562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ad0eebd-2ec7-45f2-be3e-ef9f0ad2baa3 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] Returning 404 to user: Volume 8231ecdb-d884-4a03-8939-77ca592de707 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:32.302294 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8ad0eebd-2ec7-45f2-be3e-ef9f0ad2baa3 tempest-VolumesGetTestJSON-360034633 tempest-VolumesGetTestJSON-360034633-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707" status: 404 len: 109 microversion: 2.1 time: 0.078116 Jul 20 04:19:32.302294 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1464/2974] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:19:32 2022] GET /compute/v2.1/os-volumes/8231ecdb-d884-4a03-8939-77ca592de707 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:32.311180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2727897d-56b7-45a8-8d1d-5e45db6fe82b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:32.318918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2727897d-56b7-45a8-8d1d-5e45db6fe82b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:32.331922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2727897d-56b7-45a8-8d1d-5e45db6fe82b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.332527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2727897d-56b7-45a8-8d1d-5e45db6fe82b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.337011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2727897d-56b7-45a8-8d1d-5e45db6fe82b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.337711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2727897d-56b7-45a8-8d1d-5e45db6fe82b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.857939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2727897d-56b7-45a8-8d1d-5e45db6fe82b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:32.870669 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2727897d-56b7-45a8-8d1d-5e45db6fe82b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.566628 Jul 20 04:19:32.871256 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1465/2975] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:32 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:32.881895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a7ae391b-1b05-43be-9ca6-ad3636d949e4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:32.889733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7ae391b-1b05-43be-9ca6-ad3636d949e4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:32.907764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7ae391b-1b05-43be-9ca6-ad3636d949e4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.908758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7ae391b-1b05-43be-9ca6-ad3636d949e4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.909706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7ae391b-1b05-43be-9ca6-ad3636d949e4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.910415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7ae391b-1b05-43be-9ca6-ad3636d949e4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.958455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8f6af261-840a-4b6e-89ca-3d79fb70a7a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:32.967002 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8f6af261-840a-4b6e-89ca-3d79fb70a7a2 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1314 microversion: 2.1 time: 1.227482 Jul 20 04:19:32.977069 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1511/2976] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:31 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1314 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:33.244795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-976c72ed-a77d-4eb8-998a-e3592deafc91 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:33.245672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-976c72ed-a77d-4eb8-998a-e3592deafc91 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:33.249436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:33.270366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-976c72ed-a77d-4eb8-998a-e3592deafc91 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.271250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-976c72ed-a77d-4eb8-998a-e3592deafc91 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.273263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-976c72ed-a77d-4eb8-998a-e3592deafc91 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.274718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-976c72ed-a77d-4eb8-998a-e3592deafc91 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.433687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a7ae391b-1b05-43be-9ca6-ad3636d949e4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:33.445446 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a7ae391b-1b05-43be-9ca6-ad3636d949e4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1364 microversion: 2.1 time: 0.569977 Jul 20 04:19:33.446220 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1466/2977] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:32 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1364 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:33.652817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-23ba6456-0b54-4232-b9b4-8ad855163733 req-83f50861-6214-4f65-b1f7-0919ce1e7650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4eb6ee-6232-43c2-a09b-55e0dda420d2", "name": "network-vif-plugged", "status": "completed", "tag": "8a7fbcc3-29b2-4ac1-a2b9-1a27d746c53c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:33.673770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-23ba6456-0b54-4232-b9b4-8ad855163733 req-83f50861-6214-4f65-b1f7-0919ce1e7650 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.681452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-23ba6456-0b54-4232-b9b4-8ad855163733 req-83f50861-6214-4f65-b1f7-0919ce1e7650 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.685015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-976c72ed-a77d-4eb8-998a-e3592deafc91 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:33.696932 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-976c72ed-a77d-4eb8-998a-e3592deafc91 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1318 microversion: 2.1 time: 0.460047 Jul 20 04:19:33.704843 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1512/2978] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:33 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:33.720367 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-23ba6456-0b54-4232-b9b4-8ad855163733 req-83f50861-6214-4f65-b1f7-0919ce1e7650 service nova] Creating event network-vif-plugged:8a7fbcc3-29b2-4ac1-a2b9-1a27d746c53c for instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 on n-h2-760456-11 Jul 20 04:19:33.732869 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-23ba6456-0b54-4232-b9b4-8ad855163733 req-83f50861-6214-4f65-b1f7-0919ce1e7650 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083583 Jul 20 04:19:33.734804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5f274d41-a021-4a0b-a9cd-8c125dab0cfd req-b43a7dff-6058-4dda-809b-90b60f78bcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b905560-1341-498e-ae1c-81f4f2281180", "tag": "c0368a4e-17a8-43d7-a03e-21d099519bee"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:33.738497 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1467/2979] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:33.771047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5f274d41-a021-4a0b-a9cd-8c125dab0cfd req-b43a7dff-6058-4dda-809b-90b60f78bcda service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.771555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5f274d41-a021-4a0b-a9cd-8c125dab0cfd req-b43a7dff-6058-4dda-809b-90b60f78bcda service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.812531 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5f274d41-a021-4a0b-a9cd-8c125dab0cfd req-b43a7dff-6058-4dda-809b-90b60f78bcda service nova] Creating event network-changed:c0368a4e-17a8-43d7-a03e-21d099519bee for instance 6b905560-1341-498e-ae1c-81f4f2281180 on n-h1-760456-11 Jul 20 04:19:33.828616 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5f274d41-a021-4a0b-a9cd-8c125dab0cfd req-b43a7dff-6058-4dda-809b-90b60f78bcda service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097242 Jul 20 04:19:33.831412 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1513/2980] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:33.893890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4f62e1a2-8000-4372-af5b-0013d13750ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:33.894779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4f62e1a2-8000-4372-af5b-0013d13750ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:33.921478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f62e1a2-8000-4372-af5b-0013d13750ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.922104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f62e1a2-8000-4372-af5b-0013d13750ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.923401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f62e1a2-8000-4372-af5b-0013d13750ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.923960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f62e1a2-8000-4372-af5b-0013d13750ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.987080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-483c2970-4e4f-4550-88e8-098e8126684f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:33.992432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-483c2970-4e4f-4550-88e8-098e8126684f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:34.013503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-483c2970-4e4f-4550-88e8-098e8126684f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.022917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-483c2970-4e4f-4550-88e8-098e8126684f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.023966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-483c2970-4e4f-4550-88e8-098e8126684f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.025614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-483c2970-4e4f-4550-88e8-098e8126684f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.497932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f62e1a2-8000-4372-af5b-0013d13750ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:34.509953 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4f62e1a2-8000-4372-af5b-0013d13750ec tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.621180 Jul 20 04:19:34.511010 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1468/2981] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:33 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:34.521183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4eefd741-07af-420f-bef2-a046d88f675e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.523135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4eefd741-07af-420f-bef2-a046d88f675e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:34.530033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4eefd741-07af-420f-bef2-a046d88f675e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.532548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4eefd741-07af-420f-bef2-a046d88f675e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.536132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4eefd741-07af-420f-bef2-a046d88f675e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.550275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4eefd741-07af-420f-bef2-a046d88f675e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.769316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-483c2970-4e4f-4550-88e8-098e8126684f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:34.782913 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-483c2970-4e4f-4550-88e8-098e8126684f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1314 microversion: 2.1 time: 0.800101 Jul 20 04:19:34.784026 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1514/2982] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:33 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:34.797892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-df26f2a4-d11f-40b9-8f03-6975ebe1fa2d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.798840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-df26f2a4-d11f-40b9-8f03-6975ebe1fa2d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:34.812735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df26f2a4-d11f-40b9-8f03-6975ebe1fa2d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.818008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df26f2a4-d11f-40b9-8f03-6975ebe1fa2d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.819035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df26f2a4-d11f-40b9-8f03-6975ebe1fa2d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.820109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df26f2a4-d11f-40b9-8f03-6975ebe1fa2d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.985087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4eefd741-07af-420f-bef2-a046d88f675e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:34.993424 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4eefd741-07af-420f-bef2-a046d88f675e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1364 microversion: 2.1 time: 0.478902 Jul 20 04:19:35.005088 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1469/2983] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:34 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1364 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:35.483003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-df26f2a4-d11f-40b9-8f03-6975ebe1fa2d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:35.494539 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-df26f2a4-d11f-40b9-8f03-6975ebe1fa2d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1318 microversion: 2.1 time: 0.709367 Jul 20 04:19:35.499061 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1515/2984] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:34 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:35.532374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-977b2975-96f4-4bd9-abda-3bcdcd4a5eda tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:35.533884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-977b2975-96f4-4bd9-abda-3bcdcd4a5eda tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:35.551538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-977b2975-96f4-4bd9-abda-3bcdcd4a5eda tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.556089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-977b2975-96f4-4bd9-abda-3bcdcd4a5eda tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.557175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-977b2975-96f4-4bd9-abda-3bcdcd4a5eda tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.559232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-977b2975-96f4-4bd9-abda-3bcdcd4a5eda tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.800303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a7543f7-2cff-4119-a666-0f482de382ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:35.801068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3a7543f7-2cff-4119-a666-0f482de382ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:35.833314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a7543f7-2cff-4119-a666-0f482de382ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.833779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a7543f7-2cff-4119-a666-0f482de382ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.834615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a7543f7-2cff-4119-a666-0f482de382ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.835240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a7543f7-2cff-4119-a666-0f482de382ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.039650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-977b2975-96f4-4bd9-abda-3bcdcd4a5eda tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.048813 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-977b2975-96f4-4bd9-abda-3bcdcd4a5eda tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.520733 Jul 20 04:19:36.050014 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1470/2985] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:35 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:36.055274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-8e91530d-3c18-4951-b8b1-9cfe31e2130a req-17978d75-c3ed-426e-a935-0a0a369a0bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f11728-3c90-4e89-8da0-1f996da0af4d", "tag": "c6c43220-cd00-4896-9f39-b662de761c51"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:36.064013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8e91530d-3c18-4951-b8b1-9cfe31e2130a req-17978d75-c3ed-426e-a935-0a0a369a0bb0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.064013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8e91530d-3c18-4951-b8b1-9cfe31e2130a req-17978d75-c3ed-426e-a935-0a0a369a0bb0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.078182 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8e91530d-3c18-4951-b8b1-9cfe31e2130a req-17978d75-c3ed-426e-a935-0a0a369a0bb0 service nova] Creating event network-changed:c6c43220-cd00-4896-9f39-b662de761c51 for instance 09f11728-3c90-4e89-8da0-1f996da0af4d on n-h1-760456-11 Jul 20 04:19:36.085977 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-8e91530d-3c18-4951-b8b1-9cfe31e2130a req-17978d75-c3ed-426e-a935-0a0a369a0bb0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034466 Jul 20 04:19:36.087319 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1471/2986] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:36.097855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36ca8304-db2d-4fcd-b8f2-50fe28623e5a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.098900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-36ca8304-db2d-4fcd-b8f2-50fe28623e5a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.115368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36ca8304-db2d-4fcd-b8f2-50fe28623e5a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.115994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36ca8304-db2d-4fcd-b8f2-50fe28623e5a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.116887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36ca8304-db2d-4fcd-b8f2-50fe28623e5a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.117443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36ca8304-db2d-4fcd-b8f2-50fe28623e5a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.128821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3a7543f7-2cff-4119-a666-0f482de382ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.136958 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3a7543f7-2cff-4119-a666-0f482de382ad tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1314 microversion: 2.1 time: 0.341228 Jul 20 04:19:36.155256 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1516/2987] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:35 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:36.519095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9686cafc-b97e-42d2-8384-6e34c6d5f43e tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.520854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9686cafc-b97e-42d2-8384-6e34c6d5f43e tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.529201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9686cafc-b97e-42d2-8384-6e34c6d5f43e tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.529987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9686cafc-b97e-42d2-8384-6e34c6d5f43e tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.531169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9686cafc-b97e-42d2-8384-6e34c6d5f43e tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.531828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9686cafc-b97e-42d2-8384-6e34c6d5f43e tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.549918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-36ca8304-db2d-4fcd-b8f2-50fe28623e5a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.566100 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-36ca8304-db2d-4fcd-b8f2-50fe28623e5a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1550 microversion: 2.1 time: 0.477252 Jul 20 04:19:36.566761 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1472/2988] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1550 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:36.585482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-777228c1-6c65-4548-8f09-f3a3e027c2ac tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.586128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-777228c1-6c65-4548-8f09-f3a3e027c2ac tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.594029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-777228c1-6c65-4548-8f09-f3a3e027c2ac tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.600279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-777228c1-6c65-4548-8f09-f3a3e027c2ac tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.603330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-777228c1-6c65-4548-8f09-f3a3e027c2ac tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.603886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-777228c1-6c65-4548-8f09-f3a3e027c2ac tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.809664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9686cafc-b97e-42d2-8384-6e34c6d5f43e tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.821069 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9686cafc-b97e-42d2-8384-6e34c6d5f43e tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1318 microversion: 2.1 time: 0.307917 Jul 20 04:19:36.824103 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1517/2989] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:37.071652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cbd91b26-6bcb-46f7-bcee-abf1ec820f52 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.072666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cbd91b26-6bcb-46f7-bcee-abf1ec820f52 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:37.073524 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-777228c1-6c65-4548-8f09-f3a3e027c2ac tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.494574 Jul 20 04:19:37.074477 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1473/2990] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/os-interface => generated 285 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:37.100331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbd91b26-6bcb-46f7-bcee-abf1ec820f52 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.100798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbd91b26-6bcb-46f7-bcee-abf1ec820f52 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.112148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbd91b26-6bcb-46f7-bcee-abf1ec820f52 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.113865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbd91b26-6bcb-46f7-bcee-abf1ec820f52 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.155937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ab11996-b782-4d85-b805-90adb050cedf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.156648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8ab11996-b782-4d85-b805-90adb050cedf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:37.171810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ab11996-b782-4d85-b805-90adb050cedf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.174566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ab11996-b782-4d85-b805-90adb050cedf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.176827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ab11996-b782-4d85-b805-90adb050cedf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.177995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ab11996-b782-4d85-b805-90adb050cedf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.218640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:37.263862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:37.444108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:37.733079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cbd91b26-6bcb-46f7-bcee-abf1ec820f52 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:37.748144 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cbd91b26-6bcb-46f7-bcee-abf1ec820f52 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.684410 Jul 20 04:19:37.749021 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1518/2991] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:37 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:37.840005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-41942819-e2e1-4968-8558-aa9cdb2a6ff4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.841714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-41942819-e2e1-4968-8558-aa9cdb2a6ff4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:37.853181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41942819-e2e1-4968-8558-aa9cdb2a6ff4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.856928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41942819-e2e1-4968-8558-aa9cdb2a6ff4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.857980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41942819-e2e1-4968-8558-aa9cdb2a6ff4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.858620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41942819-e2e1-4968-8558-aa9cdb2a6ff4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.998785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=16 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:38.035056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8ab11996-b782-4d85-b805-90adb050cedf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:38.055553 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8ab11996-b782-4d85-b805-90adb050cedf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1314 microversion: 2.1 time: 0.904298 Jul 20 04:19:38.057187 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1474/2992] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:37 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:38.184021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-41942819-e2e1-4968-8558-aa9cdb2a6ff4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:38.198018 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-41942819-e2e1-4968-8558-aa9cdb2a6ff4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1318 microversion: 2.1 time: 0.361901 Jul 20 04:19:38.207840 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1519/2993] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:37 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:38.767456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e9fde8e-a1c3-4335-8b75-1f21726b6ba9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.768543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e9fde8e-a1c3-4335-8b75-1f21726b6ba9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:38.777371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9fde8e-a1c3-4335-8b75-1f21726b6ba9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.783330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9fde8e-a1c3-4335-8b75-1f21726b6ba9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.784456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9fde8e-a1c3-4335-8b75-1f21726b6ba9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.785135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9fde8e-a1c3-4335-8b75-1f21726b6ba9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.827853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:39.032212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e9fde8e-a1c3-4335-8b75-1f21726b6ba9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:39.073034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b72ed78-abce-403e-aa3b-ac6c0ac67a7a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:39.073584 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e9fde8e-a1c3-4335-8b75-1f21726b6ba9 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.302351 Jul 20 04:19:39.074623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3b72ed78-abce-403e-aa3b-ac6c0ac67a7a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:39.076897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1475/2994] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:38 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:39.092872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b72ed78-abce-403e-aa3b-ac6c0ac67a7a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.093420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b72ed78-abce-403e-aa3b-ac6c0ac67a7a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.094401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b72ed78-abce-403e-aa3b-ac6c0ac67a7a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.094862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b72ed78-abce-403e-aa3b-ac6c0ac67a7a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.220062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f36536c6-78c1-44c0-8a85-f3306b3833b4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:39.225893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f36536c6-78c1-44c0-8a85-f3306b3833b4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:39.241637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f36536c6-78c1-44c0-8a85-f3306b3833b4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.242893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f36536c6-78c1-44c0-8a85-f3306b3833b4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.244319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f36536c6-78c1-44c0-8a85-f3306b3833b4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.247073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f36536c6-78c1-44c0-8a85-f3306b3833b4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.724350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f36536c6-78c1-44c0-8a85-f3306b3833b4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:39.734991 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f36536c6-78c1-44c0-8a85-f3306b3833b4 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1318 microversion: 2.1 time: 0.518990 Jul 20 04:19:39.746288 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1476/2995] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:39 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:39.852543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-861112ed-2928-44f4-b141-d73faf8e5278 req-062ef3b9-95af-45fe-86fe-4a35c9c6a895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4eb6ee-6232-43c2-a09b-55e0dda420d2", "tag": "8a7fbcc3-29b2-4ac1-a2b9-1a27d746c53c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:39.873247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-861112ed-2928-44f4-b141-d73faf8e5278 req-062ef3b9-95af-45fe-86fe-4a35c9c6a895 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.874301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-861112ed-2928-44f4-b141-d73faf8e5278 req-062ef3b9-95af-45fe-86fe-4a35c9c6a895 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.918919 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-861112ed-2928-44f4-b141-d73faf8e5278 req-062ef3b9-95af-45fe-86fe-4a35c9c6a895 service nova] Creating event network-changed:8a7fbcc3-29b2-4ac1-a2b9-1a27d746c53c for instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 on n-h2-760456-11 Jul 20 04:19:39.939015 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-861112ed-2928-44f4-b141-d73faf8e5278 req-062ef3b9-95af-45fe-86fe-4a35c9c6a895 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091027 Jul 20 04:19:39.946928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3b72ed78-abce-403e-aa3b-ac6c0ac67a7a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:39.972918 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1477/2996] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:39.975127 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b72ed78-abce-403e-aa3b-ac6c0ac67a7a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1314 microversion: 2.1 time: 0.905987 Jul 20 04:19:39.980013 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1520/2997] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:39 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1314 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:40.093581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4eba5ede-cddf-4aa0-b6fa-4c6fb227672e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.095727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4eba5ede-cddf-4aa0-b6fa-4c6fb227672e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.115239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4eba5ede-cddf-4aa0-b6fa-4c6fb227672e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.115714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4eba5ede-cddf-4aa0-b6fa-4c6fb227672e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.116552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4eba5ede-cddf-4aa0-b6fa-4c6fb227672e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.117024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4eba5ede-cddf-4aa0-b6fa-4c6fb227672e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.755712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-15cc6ab3-0d74-441d-8989-9ec13d864a78 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.757114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-15cc6ab3-0d74-441d-8989-9ec13d864a78 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.780514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15cc6ab3-0d74-441d-8989-9ec13d864a78 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.790341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15cc6ab3-0d74-441d-8989-9ec13d864a78 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.791273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15cc6ab3-0d74-441d-8989-9ec13d864a78 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.791921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15cc6ab3-0d74-441d-8989-9ec13d864a78 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.887608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4eba5ede-cddf-4aa0-b6fa-4c6fb227672e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:40.905142 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4eba5ede-cddf-4aa0-b6fa-4c6fb227672e tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.811911 Jul 20 04:19:40.918874 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1478/2998] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:40.996971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4fd6d142-e8f3-4d92-ad7e-2a70619b74a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.997922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4fd6d142-e8f3-4d92-ad7e-2a70619b74a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:41.008458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:41.013264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fd6d142-e8f3-4d92-ad7e-2a70619b74a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.014438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fd6d142-e8f3-4d92-ad7e-2a70619b74a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.016685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fd6d142-e8f3-4d92-ad7e-2a70619b74a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.017692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fd6d142-e8f3-4d92-ad7e-2a70619b74a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.389573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-15cc6ab3-0d74-441d-8989-9ec13d864a78 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:41.398818 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-15cc6ab3-0d74-441d-8989-9ec13d864a78 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1318 microversion: 2.1 time: 0.648778 Jul 20 04:19:41.413423 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1521/2999] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1318 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:41.466055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4fd6d142-e8f3-4d92-ad7e-2a70619b74a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:41.486475 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4fd6d142-e8f3-4d92-ad7e-2a70619b74a1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1314 microversion: 2.1 time: 0.494111 Jul 20 04:19:41.487187 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1479/3000] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:41.926066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0dbb892-a2ed-43bb-b80e-c4a77102bd99 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:41.926737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e0dbb892-a2ed-43bb-b80e-c4a77102bd99 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:41.940817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0dbb892-a2ed-43bb-b80e-c4a77102bd99 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.941280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0dbb892-a2ed-43bb-b80e-c4a77102bd99 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.946414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0dbb892-a2ed-43bb-b80e-c4a77102bd99 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.946885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0dbb892-a2ed-43bb-b80e-c4a77102bd99 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.978592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5862e32c-8070-4a8d-8829-a4b3d2d437c0 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:41.982332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5862e32c-8070-4a8d-8829-a4b3d2d437c0 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:41.983156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5862e32c-8070-4a8d-8829-a4b3d2d437c0 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Searching by: {'deleted': False, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:42.002910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5862e32c-8070-4a8d-8829-a4b3d2d437c0 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.003376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5862e32c-8070-4a8d-8829-a4b3d2d437c0 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.010701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5862e32c-8070-4a8d-8829-a4b3d2d437c0 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.013195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5862e32c-8070-4a8d-8829-a4b3d2d437c0 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.084209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-5862e32c-8070-4a8d-8829-a4b3d2d437c0 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:42.126423 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5862e32c-8070-4a8d-8829-a4b3d2d437c0 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.151015 Jul 20 04:19:42.133670 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1480/3001] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:19:41 2022] GET /compute/v2.1/servers => generated 340 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:42.140919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.147009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:42.148051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Searching by: {'deleted': False, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:42.155783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.157409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.159045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.159824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.206590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:42.316314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:42.330944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.331975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.549708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e0dbb892-a2ed-43bb-b80e-c4a77102bd99 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:42.561733 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-905da099-ac31-46c9-8445-ebc6a7a5dad3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.424200 Jul 20 04:19:42.561733 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1481/3002] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:42.568947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b01d2cb1-7b8a-45de-873b-1dbda77b01cf req-1bc9465f-4a1b-4943-af54-ecf710cb22c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b905560-1341-498e-ae1c-81f4f2281180", "name": "network-vif-plugged", "status": "completed", "tag": "c0368a4e-17a8-43d7-a03e-21d099519bee"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:42.571688 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0dbb892-a2ed-43bb-b80e-c4a77102bd99 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.649886 Jul 20 04:19:42.572896 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1522/3003] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:41 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:42.583683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0d9f4ab6-bf97-47c9-98a8-1e8bb56d2cf8 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.586415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0d9f4ab6-bf97-47c9-98a8-1e8bb56d2cf8 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:42.589098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b01d2cb1-7b8a-45de-873b-1dbda77b01cf req-1bc9465f-4a1b-4943-af54-ecf710cb22c2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.589755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b01d2cb1-7b8a-45de-873b-1dbda77b01cf req-1bc9465f-4a1b-4943-af54-ecf710cb22c2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.610059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d9f4ab6-bf97-47c9-98a8-1e8bb56d2cf8 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.611054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d9f4ab6-bf97-47c9-98a8-1e8bb56d2cf8 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.611919 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b01d2cb1-7b8a-45de-873b-1dbda77b01cf req-1bc9465f-4a1b-4943-af54-ecf710cb22c2 service nova] Creating event network-vif-plugged:c0368a4e-17a8-43d7-a03e-21d099519bee for instance 6b905560-1341-498e-ae1c-81f4f2281180 on n-h1-760456-11 Jul 20 04:19:42.612932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d9f4ab6-bf97-47c9-98a8-1e8bb56d2cf8 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.614792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d9f4ab6-bf97-47c9-98a8-1e8bb56d2cf8 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.620808 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b01d2cb1-7b8a-45de-873b-1dbda77b01cf req-1bc9465f-4a1b-4943-af54-ecf710cb22c2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058448 Jul 20 04:19:42.621901 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1482/3004] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:42.631904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a7919cbb-2bc4-46ea-af11-c9dcf7230a7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.633375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7919cbb-2bc4-46ea-af11-c9dcf7230a7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:42.642970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7919cbb-2bc4-46ea-af11-c9dcf7230a7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.643681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7919cbb-2bc4-46ea-af11-c9dcf7230a7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.645225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7919cbb-2bc4-46ea-af11-c9dcf7230a7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.645912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7919cbb-2bc4-46ea-af11-c9dcf7230a7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.980850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a7919cbb-2bc4-46ea-af11-c9dcf7230a7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:42.993023 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a7919cbb-2bc4-46ea-af11-c9dcf7230a7d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1314 microversion: 2.1 time: 0.369200 Jul 20 04:19:43.001639 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1483/3005] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:43.007155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-21949bc9-4fdb-466a-a76e-e3bf843b87c6 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.017243 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-21949bc9-4fdb-466a-a76e-e3bf843b87c6 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013837 Jul 20 04:19:43.018093 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1484/3006] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:43.041080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0d9f4ab6-bf97-47c9-98a8-1e8bb56d2cf8 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:43.050278 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0d9f4ab6-bf97-47c9-98a8-1e8bb56d2cf8 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1318 microversion: 2.1 time: 0.474832 Jul 20 04:19:43.060892 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1523/3007] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:43.350365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ed3c6afb-e565-4dea-b43e-f7236c2887d5 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.350936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ed3c6afb-e565-4dea-b43e-f7236c2887d5 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:43.364423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed3c6afb-e565-4dea-b43e-f7236c2887d5 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.364895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed3c6afb-e565-4dea-b43e-f7236c2887d5 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.368065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed3c6afb-e565-4dea-b43e-f7236c2887d5 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.368529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed3c6afb-e565-4dea-b43e-f7236c2887d5 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.446300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ed3c6afb-e565-4dea-b43e-f7236c2887d5 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:43.594337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cb6a8c4e-011c-408c-9855-c5238f3a4f94 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.596399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cb6a8c4e-011c-408c-9855-c5238f3a4f94 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:43.602062 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ed3c6afb-e565-4dea-b43e-f7236c2887d5 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "DELETE /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 204 len: 0 microversion: 2.1 time: 0.256508 Jul 20 04:19:43.605963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb6a8c4e-011c-408c-9855-c5238f3a4f94 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.606442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb6a8c4e-011c-408c-9855-c5238f3a4f94 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.606912 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1485/3008] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:43 2022] DELETE /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:43.607909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb6a8c4e-011c-408c-9855-c5238f3a4f94 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.608518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb6a8c4e-011c-408c-9855-c5238f3a4f94 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.616537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2b80ca8b-aa78-43cb-8dbb-dec04db75563 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.617532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2b80ca8b-aa78-43cb-8dbb-dec04db75563 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:43.624758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b80ca8b-aa78-43cb-8dbb-dec04db75563 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.626060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b80ca8b-aa78-43cb-8dbb-dec04db75563 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.627270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b80ca8b-aa78-43cb-8dbb-dec04db75563 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.628198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b80ca8b-aa78-43cb-8dbb-dec04db75563 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.862429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cb6a8c4e-011c-408c-9855-c5238f3a4f94 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:43.872482 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cb6a8c4e-011c-408c-9855-c5238f3a4f94 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1516 microversion: 2.1 time: 0.285167 Jul 20 04:19:43.872634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2b80ca8b-aa78-43cb-8dbb-dec04db75563 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:43.873715 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1524/3009] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1516 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:43.881687 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2b80ca8b-aa78-43cb-8dbb-dec04db75563 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1716 microversion: 2.1 time: 0.269722 Jul 20 04:19:43.882301 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1486/3010] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1716 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:44.199257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-711140974", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "2194c820-ba28-4179-b77f-644e1fd28096"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:44.290785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] validate_networks() for [('2194c820-ba28-4179-b77f-644e1fd28096', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:44.480542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01a32b3c-a6ec-4ef1-a85f-cc9594014d22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:44.481034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-01a32b3c-a6ec-4ef1-a85f-cc9594014d22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:44.492278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01a32b3c-a6ec-4ef1-a85f-cc9594014d22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.493016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01a32b3c-a6ec-4ef1-a85f-cc9594014d22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.493974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01a32b3c-a6ec-4ef1-a85f-cc9594014d22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.494449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01a32b3c-a6ec-4ef1-a85f-cc9594014d22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.873477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-01a32b3c-a6ec-4ef1-a85f-cc9594014d22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:44.885639 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01a32b3c-a6ec-4ef1-a85f-cc9594014d22 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1314 microversion: 2.1 time: 0.876956 Jul 20 04:19:44.899861 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1487/3011] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:44 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:44.905534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-90e211dc-4ada-47ed-a24c-dcae46830c1a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:44.906168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-90e211dc-4ada-47ed-a24c-dcae46830c1a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:44.918779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90e211dc-4ada-47ed-a24c-dcae46830c1a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.919238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90e211dc-4ada-47ed-a24c-dcae46830c1a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.926376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90e211dc-4ada-47ed-a24c-dcae46830c1a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.931747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90e211dc-4ada-47ed-a24c-dcae46830c1a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.998344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:44.998784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:45.000081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:45.000660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:45.001173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:45.025034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.029774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.031585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.034545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.103236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Getting quotas for project ef8556bf8d2849c7a8aa422de636b9f8. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:45.122192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Getting quotas for user b13c7d9c51944674be96a7fa18b9af97 and project ef8556bf8d2849c7a8aa422de636b9f8. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:45.163671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:45.168290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-90e211dc-4ada-47ed-a24c-dcae46830c1a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:45.178848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:45.182571 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-90e211dc-4ada-47ed-a24c-dcae46830c1a tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1318 microversion: 2.1 time: 0.279301 Jul 20 04:19:45.196671 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1488/3012] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:44 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:45.233314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f7f42d24-7dc0-4548-9648-77acf1316e6d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:45.239421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f7f42d24-7dc0-4548-9648-77acf1316e6d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.257374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7f42d24-7dc0-4548-9648-77acf1316e6d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.260502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7f42d24-7dc0-4548-9648-77acf1316e6d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.262826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7f42d24-7dc0-4548-9648-77acf1316e6d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.264426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7f42d24-7dc0-4548-9648-77acf1316e6d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.336129 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-39195700-5a08-4c75-a120-9aea877b4b0d tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.377510 Jul 20 04:19:45.345659 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1525/3013] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:45.371073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5987e4f6-f0fb-457a-b6a0-51008d67ae34 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:45.376103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5987e4f6-f0fb-457a-b6a0-51008d67ae34 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.397243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5987e4f6-f0fb-457a-b6a0-51008d67ae34 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.398176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5987e4f6-f0fb-457a-b6a0-51008d67ae34 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.399725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5987e4f6-f0fb-457a-b6a0-51008d67ae34 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.401940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5987e4f6-f0fb-457a-b6a0-51008d67ae34 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.586656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f7f42d24-7dc0-4548-9648-77acf1316e6d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:45.601064 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f7f42d24-7dc0-4548-9648-77acf1316e6d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1522 microversion: 2.1 time: 0.401971 Jul 20 04:19:45.601596 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1489/3014] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:45 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:45.616005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-661eae02-4698-484d-bc84-5f5ab25968d7 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:45.617217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-661eae02-4698-484d-bc84-5f5ab25968d7 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.681614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-661eae02-4698-484d-bc84-5f5ab25968d7 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:45.689632 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-661eae02-4698-484d-bc84-5f5ab25968d7 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1216 microversion: 2.1 time: 0.087141 Jul 20 04:19:45.692294 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1490/3015] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:45 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1216 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:45.856783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5987e4f6-f0fb-457a-b6a0-51008d67ae34 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:45.866412 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5987e4f6-f0fb-457a-b6a0-51008d67ae34 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1716 microversion: 2.1 time: 0.518897 Jul 20 04:19:45.867027 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1526/3016] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:45 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1716 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:45.883215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-8ad6fb06-976f-4b8d-b720-5ebf48956306 req-02187c7b-7431-4021-81ae-bc78dc856c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f11728-3c90-4e89-8da0-1f996da0af4d", "name": "network-vif-plugged", "status": "completed", "tag": "c6c43220-cd00-4896-9f39-b662de761c51"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:45.900406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8ad6fb06-976f-4b8d-b720-5ebf48956306 req-02187c7b-7431-4021-81ae-bc78dc856c9e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.901622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8ad6fb06-976f-4b8d-b720-5ebf48956306 req-02187c7b-7431-4021-81ae-bc78dc856c9e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.904995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a8eb0c8a-b80b-434e-afbf-5cea626063f1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:45.905661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a8eb0c8a-b80b-434e-afbf-5cea626063f1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.918948 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8ad6fb06-976f-4b8d-b720-5ebf48956306 req-02187c7b-7431-4021-81ae-bc78dc856c9e service nova] Creating event network-vif-plugged:c6c43220-cd00-4896-9f39-b662de761c51 for instance 09f11728-3c90-4e89-8da0-1f996da0af4d on n-h1-760456-11 Jul 20 04:19:45.923216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8eb0c8a-b80b-434e-afbf-5cea626063f1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.923778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8eb0c8a-b80b-434e-afbf-5cea626063f1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.924646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8eb0c8a-b80b-434e-afbf-5cea626063f1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.925111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8eb0c8a-b80b-434e-afbf-5cea626063f1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.925974 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-8ad6fb06-976f-4b8d-b720-5ebf48956306 req-02187c7b-7431-4021-81ae-bc78dc856c9e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054316 Jul 20 04:19:45.927698 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1491/3017] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:45.964984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:46.207099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ac84771-fd2e-4964-a8ee-a6d118a3ac0f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.208778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ac84771-fd2e-4964-a8ee-a6d118a3ac0f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.225651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ac84771-fd2e-4964-a8ee-a6d118a3ac0f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.227403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ac84771-fd2e-4964-a8ee-a6d118a3ac0f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.230216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ac84771-fd2e-4964-a8ee-a6d118a3ac0f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.241491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ac84771-fd2e-4964-a8ee-a6d118a3ac0f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.419954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a8eb0c8a-b80b-434e-afbf-5cea626063f1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:46.433028 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a8eb0c8a-b80b-434e-afbf-5cea626063f1 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1314 microversion: 2.1 time: 0.531436 Jul 20 04:19:46.465874 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1527/3018] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:45 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:46.520454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5ac84771-fd2e-4964-a8ee-a6d118a3ac0f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:46.529173 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ac84771-fd2e-4964-a8ee-a6d118a3ac0f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1509 microversion: 2.1 time: 0.331778 Jul 20 04:19:46.534026 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1492/3019] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:46.623723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-515f511d-e7cb-4171-9a20-542a69563862 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.625060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-515f511d-e7cb-4171-9a20-542a69563862 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.634719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515f511d-e7cb-4171-9a20-542a69563862 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.635447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515f511d-e7cb-4171-9a20-542a69563862 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.636480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515f511d-e7cb-4171-9a20-542a69563862 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.637389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515f511d-e7cb-4171-9a20-542a69563862 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.711553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dcc9af27-5a4c-4f39-be26-2266a80940fa tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.712963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dcc9af27-5a4c-4f39-be26-2266a80940fa tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.723624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcc9af27-5a4c-4f39-be26-2266a80940fa tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.724891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcc9af27-5a4c-4f39-be26-2266a80940fa tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.726395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcc9af27-5a4c-4f39-be26-2266a80940fa tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.737551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcc9af27-5a4c-4f39-be26-2266a80940fa tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.798029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:46.902567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dcc9af27-5a4c-4f39-be26-2266a80940fa tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:46.947154 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dcc9af27-5a4c-4f39-be26-2266a80940fa tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1268 microversion: 2.1 time: 0.232692 Jul 20 04:19:46.954424 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1493/3020] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:46.969167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e1bc9e4-43c8-410f-b9e5-3cfdc9ff9902 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.973451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e1bc9e4-43c8-410f-b9e5-3cfdc9ff9902 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.993544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e1bc9e4-43c8-410f-b9e5-3cfdc9ff9902 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.993544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e1bc9e4-43c8-410f-b9e5-3cfdc9ff9902 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.993544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e1bc9e4-43c8-410f-b9e5-3cfdc9ff9902 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.993905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e1bc9e4-43c8-410f-b9e5-3cfdc9ff9902 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:47.008767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-515f511d-e7cb-4171-9a20-542a69563862 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:47.021767 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-515f511d-e7cb-4171-9a20-542a69563862 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1522 microversion: 2.1 time: 0.406444 Jul 20 04:19:47.028725 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1528/3021] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:47.242725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e1bc9e4-43c8-410f-b9e5-3cfdc9ff9902 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:47.253060 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e1bc9e4-43c8-410f-b9e5-3cfdc9ff9902 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1648 microversion: 2.1 time: 0.296927 Jul 20 04:19:47.260755 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1494/3022] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1648 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:47.456624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-51c9d339-b6b2-4e91-a590-7f063c73cb62 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:47.457423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-51c9d339-b6b2-4e91-a590-7f063c73cb62 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:47.473982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51c9d339-b6b2-4e91-a590-7f063c73cb62 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:47.478130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51c9d339-b6b2-4e91-a590-7f063c73cb62 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:47.479147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51c9d339-b6b2-4e91-a590-7f063c73cb62 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:47.479620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51c9d339-b6b2-4e91-a590-7f063c73cb62 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:47.972562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-99226f42-0beb-4e2a-b7ff-16918eaeb19b tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:47.973826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-99226f42-0beb-4e2a-b7ff-16918eaeb19b tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.009882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99226f42-0beb-4e2a-b7ff-16918eaeb19b tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.015141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99226f42-0beb-4e2a-b7ff-16918eaeb19b tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.019742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99226f42-0beb-4e2a-b7ff-16918eaeb19b tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.022504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99226f42-0beb-4e2a-b7ff-16918eaeb19b tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.055984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-51c9d339-b6b2-4e91-a590-7f063c73cb62 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:48.070673 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-51c9d339-b6b2-4e91-a590-7f063c73cb62 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1502 microversion: 2.1 time: 0.621752 Jul 20 04:19:48.073330 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1529/3023] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:47 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1502 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:48.096465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3ba1f031-da65-4c6a-863b-e01fe56f0642 req-090b57d0-5ded-4e6d-aeb4-c4f6490e897c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e32034-3c05-42c3-81e8-b65e3fa773e4", "name": "network-vif-unplugged", "status": "completed", "tag": "6cec27c4-b109-44df-8ebf-907b4f02fcec"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:48.159680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3ba1f031-da65-4c6a-863b-e01fe56f0642 req-090b57d0-5ded-4e6d-aeb4-c4f6490e897c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.161123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3ba1f031-da65-4c6a-863b-e01fe56f0642 req-090b57d0-5ded-4e6d-aeb4-c4f6490e897c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.189816 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3ba1f031-da65-4c6a-863b-e01fe56f0642 req-090b57d0-5ded-4e6d-aeb4-c4f6490e897c service nova] Creating event network-vif-unplugged:6cec27c4-b109-44df-8ebf-907b4f02fcec for instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 on n-h2-760456-11 Jul 20 04:19:48.211029 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3ba1f031-da65-4c6a-863b-e01fe56f0642 req-090b57d0-5ded-4e6d-aeb4-c4f6490e897c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135495 Jul 20 04:19:48.213431 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1530/3024] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:48.228614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9bb9b0cc-6703-4486-904c-d898e3e0cc59 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:48.229796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9bb9b0cc-6703-4486-904c-d898e3e0cc59 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.256590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bb9b0cc-6703-4486-904c-d898e3e0cc59 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.260272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bb9b0cc-6703-4486-904c-d898e3e0cc59 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.261457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bb9b0cc-6703-4486-904c-d898e3e0cc59 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.262051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bb9b0cc-6703-4486-904c-d898e3e0cc59 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.308514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-99226f42-0beb-4e2a-b7ff-16918eaeb19b tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:48.316933 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-99226f42-0beb-4e2a-b7ff-16918eaeb19b tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1274 microversion: 2.1 time: 0.352605 Jul 20 04:19:48.317528 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1495/3025] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:47 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1274 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:48.346596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-62900d5e-bf4a-4657-a13b-640b3d140248 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:48.347148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-62900d5e-bf4a-4657-a13b-640b3d140248 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.375702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62900d5e-bf4a-4657-a13b-640b3d140248 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.376327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62900d5e-bf4a-4657-a13b-640b3d140248 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.383209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62900d5e-bf4a-4657-a13b-640b3d140248 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.386462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62900d5e-bf4a-4657-a13b-640b3d140248 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.486401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-62900d5e-bf4a-4657-a13b-640b3d140248 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lazy-loading 'flavor' on Instance uuid 09f11728-3c90-4e89-8da0-1f996da0af4d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:48.610593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9bb9b0cc-6703-4486-904c-d898e3e0cc59 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:48.627002 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9bb9b0cc-6703-4486-904c-d898e3e0cc59 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1522 microversion: 2.1 time: 0.410006 Jul 20 04:19:48.628472 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1531/3026] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:48 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:48.634746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f82e4b3c-7908-47c1-845d-04590af79bc6 req-3c19b049-492c-4754-bfaa-fb587a3e4009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ef29d2-7202-47d0-9f12-3a9b7999aa49", "name": "network-vif-deleted", "tag": "e88a60e1-f505-4b66-8189-731bf232b933"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:48.661592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f82e4b3c-7908-47c1-845d-04590af79bc6 req-3c19b049-492c-4754-bfaa-fb587a3e4009 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.662682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f82e4b3c-7908-47c1-845d-04590af79bc6 req-3c19b049-492c-4754-bfaa-fb587a3e4009 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.679474 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f82e4b3c-7908-47c1-845d-04590af79bc6 req-3c19b049-492c-4754-bfaa-fb587a3e4009 service nova] Creating event network-vif-deleted:e88a60e1-f505-4b66-8189-731bf232b933 for instance 98ef29d2-7202-47d0-9f12-3a9b7999aa49 on n-h1-760456-11 Jul 20 04:19:48.685861 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f82e4b3c-7908-47c1-845d-04590af79bc6 req-3c19b049-492c-4754-bfaa-fb587a3e4009 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055603 Jul 20 04:19:48.698567 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1532/3027] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:48.700038 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-62900d5e-bf4a-4657-a13b-640b3d140248 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "POST /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d/action" status: 202 len: 0 microversion: 2.1 time: 0.368763 Jul 20 04:19:48.707862 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1496/3028] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:19:48 2022] POST /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:48.715693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:48.716623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.722051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-242005d4-951e-46bb-964f-fb7804b8ff8b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:48.723149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-242005d4-951e-46bb-964f-fb7804b8ff8b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.740789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-242005d4-951e-46bb-964f-fb7804b8ff8b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.741741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-242005d4-951e-46bb-964f-fb7804b8ff8b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.751135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-242005d4-951e-46bb-964f-fb7804b8ff8b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.751935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-242005d4-951e-46bb-964f-fb7804b8ff8b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.752054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.752769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.763947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.764512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.885254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.885716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.886188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lazy-loading 'fault' on Instance uuid 98ef29d2-7202-47d0-9f12-3a9b7999aa49 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:49.070292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6ea2f064248d992203faeb95b61af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ab79f10b6402cb29860dd32ec9b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:49.079746 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b63f9b2c-e177-4ff6-829f-a75e0244caa3 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 200 len: 1367 microversion: 2.1 time: 0.378682 Jul 20 04:19:49.080140 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1533/3029] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:48 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:49.337993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1adcd40f-a8ce-4b6e-8745-27159fc34e16 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:49.338835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1adcd40f-a8ce-4b6e-8745-27159fc34e16 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:49.352342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1adcd40f-a8ce-4b6e-8745-27159fc34e16 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.354653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1adcd40f-a8ce-4b6e-8745-27159fc34e16 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.355870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1adcd40f-a8ce-4b6e-8745-27159fc34e16 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.366183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1adcd40f-a8ce-4b6e-8745-27159fc34e16 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.696228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1adcd40f-a8ce-4b6e-8745-27159fc34e16 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:49.715945 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1adcd40f-a8ce-4b6e-8745-27159fc34e16 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1274 microversion: 2.1 time: 0.372554 Jul 20 04:19:49.718393 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1534/3030] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:49 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1274 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:49.758527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-60fe0c0e-6e6f-4f6d-8814-4c91f026c631 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:49.759450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-60fe0c0e-6e6f-4f6d-8814-4c91f026c631 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:49.782209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60fe0c0e-6e6f-4f6d-8814-4c91f026c631 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.782705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60fe0c0e-6e6f-4f6d-8814-4c91f026c631 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.783508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60fe0c0e-6e6f-4f6d-8814-4c91f026c631 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.783954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60fe0c0e-6e6f-4f6d-8814-4c91f026c631 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.985190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-242005d4-951e-46bb-964f-fb7804b8ff8b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:49.994998 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-242005d4-951e-46bb-964f-fb7804b8ff8b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1510 microversion: 2.1 time: 1.282573 Jul 20 04:19:49.999757 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1497/3031] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:48 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1510 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:50.116013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-60fe0c0e-6e6f-4f6d-8814-4c91f026c631 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.135214 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-60fe0c0e-6e6f-4f6d-8814-4c91f026c631 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1522 microversion: 2.1 time: 0.395151 Jul 20 04:19:50.135819 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1535/3032] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:49 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:50.157420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b4bffade-660f-4896-806c-882b29e48e53 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.159549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b4bffade-660f-4896-806c-882b29e48e53 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] [instance: 98ef29d2-7202-47d0-9f12-3a9b7999aa49] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.176493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4bffade-660f-4896-806c-882b29e48e53 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.179816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4bffade-660f-4896-806c-882b29e48e53 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.180728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4bffade-660f-4896-806c-882b29e48e53 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.181202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4bffade-660f-4896-806c-882b29e48e53 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.214184 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-b4bffade-660f-4896-806c-882b29e48e53 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] HTTP exception thrown: Instance 98ef29d2-7202-47d0-9f12-3a9b7999aa49 could not be found. Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b4bffade-660f-4896-806c-882b29e48e53 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Request method failure captured: Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 HTTP/1.1 Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14IhAFbGu0UtH_LmLRNnKwITfh_uBRB9ftxhfupRekDHDDhHqBtiQ2_KEE-Fj_CnaPgpQr0Dp-kHc_pjWuIWI8NGTistLc8HyemMtK7DOKfcPcjhFy2-XB_kqsHcE1T3BIvurEHHGLRBeUWweVDrmyeal7i4nbQdEwxLFH4AHNoxhvE Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: fa6ab79f10b6402cb29860dd32ec9b40 Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestManualDisk-1193689143 Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fa6ab79f10b6402cb29860dd32ec9b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fa6ab79f10b6402cb29860dd32ec9b40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fa6ab79f10b6402cb29860dd32ec9b40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fa6ab79f10b6402cb29860dd32ec9b40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestManualDisk-1193689143 Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: fa6ab79f10b6402cb29860dd32ec9b40 Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestManualDisk-1193689143 Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestManualDisk-1193689143-project Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: bfd6ea2f064248d992203faeb95b61af Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestManualDisk-1193689143-project Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 98ef29d2-7202-47d0-9f12-3a9b7999aa49 could not be found. Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '98ef29d2-7202-47d0-9f12-3a9b7999aa49'} Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ef29d2-7202-47d0-9f12-3a9b7999aa49 could not be found. Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ef29d2-7202-47d0-9f12-3a9b7999aa49 could not be found. Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:50.220382 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.225339 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:50.225339 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:50.225339 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:50.225339 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:50.225339 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:50.225339 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ef29d2-7202-47d0-9f12-3a9b7999aa49 could not be found. Jul 20 04:19:50.225339 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.225339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b4bffade-660f-4896-806c-882b29e48e53 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Returning 404 to user: Instance 98ef29d2-7202-47d0-9f12-3a9b7999aa49 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:50.225339 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b4bffade-660f-4896-806c-882b29e48e53 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49" status: 404 len: 111 microversion: 2.1 time: 0.073326 Jul 20 04:19:50.225339 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1536/3033] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/98ef29d2-7202-47d0-9f12-3a9b7999aa49 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:50.237496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc6b1ae6-0fed-456e-9aaf-914494d37733 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] Calling method '.version_select at 0x7fb8410f1040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.274071 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc6b1ae6-0fed-456e-9aaf-914494d37733 tempest-ServersTestManualDisk-1193689143 tempest-ServersTestManualDisk-1193689143-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921542331" status: 202 len: 0 microversion: 2.1 time: 0.042483 Jul 20 04:19:50.277912 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1537/3034] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 04:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921542331 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:50.397354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2077666507", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:50.435065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37f556ab-3f43-430d-9683-3d474954d142 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "539953f4-d8f5-44f1-856c-ae91cf40dcf2"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:50.436141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37f556ab-3f43-430d-9683-3d474954d142 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.455820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37f556ab-3f43-430d-9683-3d474954d142 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.456290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37f556ab-3f43-430d-9683-3d474954d142 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.457119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37f556ab-3f43-430d-9683-3d474954d142 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.457591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37f556ab-3f43-430d-9683-3d474954d142 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.528461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:50.549827 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-37f556ab-3f43-430d-9683-3d474954d142 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] HTTP exception thrown: Volume f6858af6-74f0-4f49-a9c5-3eb749a39d44 could not be found. Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37f556ab-3f43-430d-9683-3d474954d142 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Request method failure captured: Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180/os-volume_attachments/f6858af6-74f0-4f49-a9c5-3eb749a39d44 HTTP/1.1 Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 74 Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HtEcob53hs1sqkR1rJQaXZRnbnW7nkgNcZNqlCLN2I0wtEhWl6i50We7g0FTJ0uBLyzzqGyXjhvV7hTdnbvPCr18TMlCrvVGVq043E5Kw_J3wZ-D2nw8PTcDJ5TcOh-bbZ2vyiTC0ACJPLuGEUGZuUM-ToaHKTudgCEL3rjxa6_os Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e5cb77b798d54e288d2bb8218b9d7d44 Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-VolumesAdminNegativeTest-1442285252 Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e5cb77b798d54e288d2bb8218b9d7d44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5cb77b798d54e288d2bb8218b9d7d44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5cb77b798d54e288d2bb8218b9d7d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e5cb77b798d54e288d2bb8218b9d7d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-VolumesAdminNegativeTest-1442285252 Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e5cb77b798d54e288d2bb8218b9d7d44 Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1442285252 Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-VolumesAdminNegativeTest-1442285252-project-admin Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 754e124206e441c3badcacaf97d63336 Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-VolumesAdminNegativeTest-1442285252-project-admin Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: {"volumeAttachment": {"volumeId": "539953f4-d8f5-44f1-856c-ae91cf40dcf2"}} Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: exception: Volume f6858af6-74f0-4f49-a9c5-3eb749a39d44 could not be found. Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'server_id': '6b905560-1341-498e-ae1c-81f4f2281180', 'id': 'f6858af6-74f0-4f49-a9c5-3eb749a39d44', 'body': {'volumeAttachment': {'volumeId': '539953f4-d8f5-44f1-856c-ae91cf40dcf2'}}} Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6858af6-74f0-4f49-a9c5-3eb749a39d44 could not be found. (HTTP 404) (Request-ID: req-154b9b7f-994b-48b0-b126-a6b1eaea4e27) Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:19:50.556772 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6858af6-74f0-4f49-a9c5-3eb749a39d44 could not be found. Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6858af6-74f0-4f49-a9c5-3eb749a39d44 could not be found. Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6858af6-74f0-4f49-a9c5-3eb749a39d44 could not be found. Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37f556ab-3f43-430d-9683-3d474954d142 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] Returning 404 to user: Volume f6858af6-74f0-4f49-a9c5-3eb749a39d44 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:50.561793 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37f556ab-3f43-430d-9683-3d474954d142 tempest-VolumesAdminNegativeTest-1442285252 tempest-VolumesAdminNegativeTest-1442285252-project-admin] 10.222.0.59 "PUT /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180/os-volume_attachments/f6858af6-74f0-4f49-a9c5-3eb749a39d44" status: 404 len: 109 microversion: 2.1 time: 0.127871 Jul 20 04:19:50.570629 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1538/3035] 10.222.0.59 () {60 vars in 1432 bytes} [Wed Jul 20 04:19:50 2022] PUT /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180/os-volume_attachments/f6858af6-74f0-4f49-a9c5-3eb749a39d44 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:19:50.737996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-00436dc4-daf4-48ed-9061-1b8e538014c6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.739376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-00436dc4-daf4-48ed-9061-1b8e538014c6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.752791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00436dc4-daf4-48ed-9061-1b8e538014c6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.753260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00436dc4-daf4-48ed-9061-1b8e538014c6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.766611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00436dc4-daf4-48ed-9061-1b8e538014c6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.769013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00436dc4-daf4-48ed-9061-1b8e538014c6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.053646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-00436dc4-daf4-48ed-9061-1b8e538014c6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:51.063313 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-00436dc4-daf4-48ed-9061-1b8e538014c6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1316 microversion: 2.1 time: 0.331654 Jul 20 04:19:51.063908 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1539/3036] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:51.070145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e138067b-8dc3-4089-942a-b59c191a1c76 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.070974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e138067b-8dc3-4089-942a-b59c191a1c76 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.089952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e138067b-8dc3-4089-942a-b59c191a1c76 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.091367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e138067b-8dc3-4089-942a-b59c191a1c76 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.092736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e138067b-8dc3-4089-942a-b59c191a1c76 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.093588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e138067b-8dc3-4089-942a-b59c191a1c76 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.370078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e138067b-8dc3-4089-942a-b59c191a1c76 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:51.371778 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e138067b-8dc3-4089-942a-b59c191a1c76 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1493 microversion: 2.1 time: 0.306390 Jul 20 04:19:51.380759 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1540/3037] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:51 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1493 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:51.381280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b9826da-e395-4b4a-9b2f-2bc5d2052c50 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.385670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4b9826da-e395-4b4a-9b2f-2bc5d2052c50 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.399766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b9826da-e395-4b4a-9b2f-2bc5d2052c50 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.400528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b9826da-e395-4b4a-9b2f-2bc5d2052c50 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.406520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b9826da-e395-4b4a-9b2f-2bc5d2052c50 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.407331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b9826da-e395-4b4a-9b2f-2bc5d2052c50 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.423203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:51.424176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:51.424967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:51.425537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:51.426023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:51.439152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.439627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.440454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.441699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.481255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Getting quotas for project 5391d9bb22c94549b8c52f593c06c598. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:51.496156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Getting quotas for user 7349676e031f44de85e2352b69d39511 and project 5391d9bb22c94549b8c52f593c06c598. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:51.532546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:51.535008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:51.636438 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5e27b557-46a5-423a-88de-719d96df855a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634018 Jul 20 04:19:51.637555 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1498/3038] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:51.650494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0007fde7-d21c-46a8-b6a3-7359568bc614 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.651414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0007fde7-d21c-46a8-b6a3-7359568bc614 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.672949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0007fde7-d21c-46a8-b6a3-7359568bc614 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.674365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0007fde7-d21c-46a8-b6a3-7359568bc614 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.677445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0007fde7-d21c-46a8-b6a3-7359568bc614 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.678200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0007fde7-d21c-46a8-b6a3-7359568bc614 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.740604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0007fde7-d21c-46a8-b6a3-7359568bc614 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:51.971213 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0007fde7-d21c-46a8-b6a3-7359568bc614 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 204 len: 0 microversion: 2.1 time: 0.325202 Jul 20 04:19:51.976915 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1499/3039] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:51 2022] DELETE /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:51.985359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d1f08d56-bdcb-4347-a872-21796d789e9c tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.987248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d1f08d56-bdcb-4347-a872-21796d789e9c tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:52.143707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d1f08d56-bdcb-4347-a872-21796d789e9c tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.161928 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d1f08d56-bdcb-4347-a872-21796d789e9c tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1214 microversion: 2.1 time: 0.185283 Jul 20 04:19:52.162837 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1500/3040] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:51 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:52.177740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1f356896-f783-4bea-bdaf-432034dd087c req-01084952-85f1-42e6-a53b-00124919f9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e32034-3c05-42c3-81e8-b65e3fa773e4", "name": "network-vif-plugged", "status": "completed", "tag": "6cec27c4-b109-44df-8ebf-907b4f02fcec"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:52.202732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1f356896-f783-4bea-bdaf-432034dd087c req-01084952-85f1-42e6-a53b-00124919f9df service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.204673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1f356896-f783-4bea-bdaf-432034dd087c req-01084952-85f1-42e6-a53b-00124919f9df service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.225039 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1f356896-f783-4bea-bdaf-432034dd087c req-01084952-85f1-42e6-a53b-00124919f9df service nova] Creating event network-vif-plugged:6cec27c4-b109-44df-8ebf-907b4f02fcec for instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 on n-h2-760456-11 Jul 20 04:19:52.279176 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1f356896-f783-4bea-bdaf-432034dd087c req-01084952-85f1-42e6-a53b-00124919f9df service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113899 Jul 20 04:19:52.296349 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1501/3041] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:52.326598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b5b2ae3a-ada1-4239-8e12-9ed7ddb8a975 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:52.327643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b5b2ae3a-ada1-4239-8e12-9ed7ddb8a975 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:52.341912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5b2ae3a-ada1-4239-8e12-9ed7ddb8a975 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.342680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5b2ae3a-ada1-4239-8e12-9ed7ddb8a975 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.343857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5b2ae3a-ada1-4239-8e12-9ed7ddb8a975 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.344745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5b2ae3a-ada1-4239-8e12-9ed7ddb8a975 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.418366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4b9826da-e395-4b4a-9b2f-2bc5d2052c50 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.428643 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4b9826da-e395-4b4a-9b2f-2bc5d2052c50 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1522 microversion: 2.1 time: 1.055183 Jul 20 04:19:52.444676 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1541/3042] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:51 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1522 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:52.449860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-485ae101-c1ad-4205-8140-a59a0e0048a8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:52.450793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-485ae101-c1ad-4205-8140-a59a0e0048a8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:52.458050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-485ae101-c1ad-4205-8140-a59a0e0048a8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.458807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-485ae101-c1ad-4205-8140-a59a0e0048a8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.459772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-485ae101-c1ad-4205-8140-a59a0e0048a8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.460369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-485ae101-c1ad-4205-8140-a59a0e0048a8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.757125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b5b2ae3a-ada1-4239-8e12-9ed7ddb8a975 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.769390 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b5b2ae3a-ada1-4239-8e12-9ed7ddb8a975 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1499 microversion: 2.1 time: 0.468629 Jul 20 04:19:52.770642 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1502/3043] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:52 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1499 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:52.822998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-485ae101-c1ad-4205-8140-a59a0e0048a8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.834709 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-485ae101-c1ad-4205-8140-a59a0e0048a8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1316 microversion: 2.1 time: 0.388564 Jul 20 04:19:52.835315 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1542/3044] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:52 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:52.916781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-903df8f6-3fc7-414f-b03f-9427c91f8259 req-89f1ff94-fa1d-45fb-84bc-b616214b3499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ec1453-4d22-4482-9d68-3e3b1b4977c7", "tag": "e5d9553a-044e-4393-830b-554d71d4fd35"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:52.931267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-903df8f6-3fc7-414f-b03f-9427c91f8259 req-89f1ff94-fa1d-45fb-84bc-b616214b3499 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.931724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-903df8f6-3fc7-414f-b03f-9427c91f8259 req-89f1ff94-fa1d-45fb-84bc-b616214b3499 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.954689 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-903df8f6-3fc7-414f-b03f-9427c91f8259 req-89f1ff94-fa1d-45fb-84bc-b616214b3499 service nova] Creating event network-changed:e5d9553a-044e-4393-830b-554d71d4fd35 for instance b4ec1453-4d22-4482-9d68-3e3b1b4977c7 on n-h2-760456-11 Jul 20 04:19:52.962278 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-903df8f6-3fc7-414f-b03f-9427c91f8259 req-89f1ff94-fa1d-45fb-84bc-b616214b3499 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048666 Jul 20 04:19:52.972242 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1503/3045] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:53.181095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da02315a-980e-4132-b833-f866f0f8fce9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:53.181725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-da02315a-980e-4132-b833-f866f0f8fce9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:53.200906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da02315a-980e-4132-b833-f866f0f8fce9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.215222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da02315a-980e-4132-b833-f866f0f8fce9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.216200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da02315a-980e-4132-b833-f866f0f8fce9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.216646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da02315a-980e-4132-b833-f866f0f8fce9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.337689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-da02315a-980e-4132-b833-f866f0f8fce9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:53.346077 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-da02315a-980e-4132-b833-f866f0f8fce9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1210 microversion: 2.1 time: 0.170480 Jul 20 04:19:53.346710 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1543/3046] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:53 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:53.454011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d413d13-f77e-4f72-be78-fb109f3d7fe8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:53.455284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4d413d13-f77e-4f72-be78-fb109f3d7fe8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:53.474162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d413d13-f77e-4f72-be78-fb109f3d7fe8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.474652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d413d13-f77e-4f72-be78-fb109f3d7fe8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.475446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d413d13-f77e-4f72-be78-fb109f3d7fe8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.475891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d413d13-f77e-4f72-be78-fb109f3d7fe8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.788690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-00786769-dcbf-42ea-ae25-cbd14cd83bcb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:53.789378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-00786769-dcbf-42ea-ae25-cbd14cd83bcb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:53.801474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00786769-dcbf-42ea-ae25-cbd14cd83bcb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.802262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00786769-dcbf-42ea-ae25-cbd14cd83bcb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.805230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00786769-dcbf-42ea-ae25-cbd14cd83bcb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.808499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00786769-dcbf-42ea-ae25-cbd14cd83bcb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.946979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4d413d13-f77e-4f72-be78-fb109f3d7fe8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:53.963492 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4d413d13-f77e-4f72-be78-fb109f3d7fe8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1522 microversion: 2.1 time: 0.515097 Jul 20 04:19:53.967883 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1504/3047] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:53 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:53.986859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-81789cea-5d9e-4b82-b399-39944ea2eddf tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:53.987521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-81789cea-5d9e-4b82-b399-39944ea2eddf tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.005829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81789cea-5d9e-4b82-b399-39944ea2eddf tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.007370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81789cea-5d9e-4b82-b399-39944ea2eddf tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.008256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81789cea-5d9e-4b82-b399-39944ea2eddf tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.013004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81789cea-5d9e-4b82-b399-39944ea2eddf tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.340737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-81789cea-5d9e-4b82-b399-39944ea2eddf tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.349611 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-81789cea-5d9e-4b82-b399-39944ea2eddf tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1316 microversion: 2.1 time: 0.376833 Jul 20 04:19:54.350195 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1505/3048] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:53 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:54.375691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8452bcba-2542-4550-aed1-533b4b32a565 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.376101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8452bcba-2542-4550-aed1-533b4b32a565 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.408489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8452bcba-2542-4550-aed1-533b4b32a565 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.408957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8452bcba-2542-4550-aed1-533b4b32a565 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.409756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8452bcba-2542-4550-aed1-533b4b32a565 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.410202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8452bcba-2542-4550-aed1-533b4b32a565 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.478977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8452bcba-2542-4550-aed1-533b4b32a565 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:54.540844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-00786769-dcbf-42ea-ae25-cbd14cd83bcb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.556654 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-00786769-dcbf-42ea-ae25-cbd14cd83bcb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1499 microversion: 2.1 time: 0.773165 Jul 20 04:19:54.559782 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1544/3049] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:53 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1499 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:54.566846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0783caf8-9b9d-47be-a0ac-3dd41751c895 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.574506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0783caf8-9b9d-47be-a0ac-3dd41751c895 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.588854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0783caf8-9b9d-47be-a0ac-3dd41751c895 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.596561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0783caf8-9b9d-47be-a0ac-3dd41751c895 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.598038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0783caf8-9b9d-47be-a0ac-3dd41751c895 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.600518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0783caf8-9b9d-47be-a0ac-3dd41751c895 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.697533 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8452bcba-2542-4550-aed1-533b4b32a565 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 204 len: 0 microversion: 2.1 time: 0.345698 Jul 20 04:19:54.699457 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1506/3050] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:54 2022] DELETE /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:54.718534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-48e43f48-b5db-43bf-829a-cbf7d10f1088 req-c0d920fb-7aea-4c91-a0a4-674324051542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f11728-3c90-4e89-8da0-1f996da0af4d", "name": "network-vif-deleted", "tag": "c6c43220-cd00-4896-9f39-b662de761c51"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:54.737067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-48e43f48-b5db-43bf-829a-cbf7d10f1088 req-c0d920fb-7aea-4c91-a0a4-674324051542 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.738652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-48e43f48-b5db-43bf-829a-cbf7d10f1088 req-c0d920fb-7aea-4c91-a0a4-674324051542 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.762298 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-48e43f48-b5db-43bf-829a-cbf7d10f1088 req-c0d920fb-7aea-4c91-a0a4-674324051542 service nova] Creating event network-vif-deleted:c6c43220-cd00-4896-9f39-b662de761c51 for instance 09f11728-3c90-4e89-8da0-1f996da0af4d on n-h1-760456-11 Jul 20 04:19:54.773674 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-48e43f48-b5db-43bf-829a-cbf7d10f1088 req-c0d920fb-7aea-4c91-a0a4-674324051542 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070356 Jul 20 04:19:54.775435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0783caf8-9b9d-47be-a0ac-3dd41751c895 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.775706 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1507/3051] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:54.787690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-088cfb7a-b92e-4664-86e0-6ef525a9edee tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.788362 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0783caf8-9b9d-47be-a0ac-3dd41751c895 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1284 microversion: 2.1 time: 0.225935 Jul 20 04:19:54.788482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-088cfb7a-b92e-4664-86e0-6ef525a9edee tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.788965 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1545/3052] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:54 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:54.799128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-088cfb7a-b92e-4664-86e0-6ef525a9edee tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.799585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-088cfb7a-b92e-4664-86e0-6ef525a9edee tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.803044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-088cfb7a-b92e-4664-86e0-6ef525a9edee tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.803494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-088cfb7a-b92e-4664-86e0-6ef525a9edee tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.985839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-942255e1-d8d5-48f7-9cca-6bb13efd4a96 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.986769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-942255e1-d8d5-48f7-9cca-6bb13efd4a96 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.993673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942255e1-d8d5-48f7-9cca-6bb13efd4a96 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.994288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942255e1-d8d5-48f7-9cca-6bb13efd4a96 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.995216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942255e1-d8d5-48f7-9cca-6bb13efd4a96 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.996032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942255e1-d8d5-48f7-9cca-6bb13efd4a96 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.057549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:55.145235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:55.259052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-942255e1-d8d5-48f7-9cca-6bb13efd4a96 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.275413 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-942255e1-d8d5-48f7-9cca-6bb13efd4a96 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1507 microversion: 2.1 time: 0.294572 Jul 20 04:19:55.289002 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1546/3053] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:54 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.296213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-afbfeef7-56ad-4968-a0b1-0517dbb0cafa tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.298317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-afbfeef7-56ad-4968-a0b1-0517dbb0cafa tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.306560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-afbfeef7-56ad-4968-a0b1-0517dbb0cafa tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.307464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-afbfeef7-56ad-4968-a0b1-0517dbb0cafa tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.309080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-afbfeef7-56ad-4968-a0b1-0517dbb0cafa tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.309950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-afbfeef7-56ad-4968-a0b1-0517dbb0cafa tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.315883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:55.479196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-088cfb7a-b92e-4664-86e0-6ef525a9edee tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.482801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:55.492275 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-088cfb7a-b92e-4664-86e0-6ef525a9edee tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1515 microversion: 2.1 time: 0.715041 Jul 20 04:19:55.493416 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1508/3054] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:54 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1515 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.508876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c27c30b-79fc-425a-90a8-c66f643dd406 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.510544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c27c30b-79fc-425a-90a8-c66f643dd406 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.526809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-afbfeef7-56ad-4968-a0b1-0517dbb0cafa tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.527068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c27c30b-79fc-425a-90a8-c66f643dd406 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.527540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c27c30b-79fc-425a-90a8-c66f643dd406 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.528341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c27c30b-79fc-425a-90a8-c66f643dd406 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.534658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c27c30b-79fc-425a-90a8-c66f643dd406 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.538462 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-afbfeef7-56ad-4968-a0b1-0517dbb0cafa tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 200 len: 1507 microversion: 2.1 time: 0.245963 Jul 20 04:19:55.551017 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1547/3055] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.556392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f5a38c9e-8871-47e4-8937-26f058396557 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.557166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f5a38c9e-8871-47e4-8937-26f058396557 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.565383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5a38c9e-8871-47e4-8937-26f058396557 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.565981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5a38c9e-8871-47e4-8937-26f058396557 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.566938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5a38c9e-8871-47e4-8937-26f058396557 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.567480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5a38c9e-8871-47e4-8937-26f058396557 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.601048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f5a38c9e-8871-47e4-8937-26f058396557 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:55.724935 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f5a38c9e-8871-47e4-8937-26f058396557 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 204 len: 0 microversion: 2.1 time: 0.172047 Jul 20 04:19:55.728999 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1548/3056] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:55 2022] DELETE /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:55.732575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.733438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.743758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.744722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.746434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.747191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.789671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:55.795046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.795717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.796250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lazy-loading 'fault' on Instance uuid 09f11728-3c90-4e89-8da0-1f996da0af4d {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:55.863325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f053f31c02c412394d48ce65350d153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3aecd6003c4614bf21b8134ceb98a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.871515 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1bd7155d-5cab-444b-af66-53b88e64c8a8 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 200 len: 1304 microversion: 2.1 time: 0.143544 Jul 20 04:19:55.872659 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1549/3057] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.879967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ab05c24-ca69-400c-8a82-6ab2c4310ff9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.880794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2ab05c24-ca69-400c-8a82-6ab2c4310ff9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.895319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ab05c24-ca69-400c-8a82-6ab2c4310ff9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.895781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ab05c24-ca69-400c-8a82-6ab2c4310ff9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.896704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ab05c24-ca69-400c-8a82-6ab2c4310ff9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.899358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ab05c24-ca69-400c-8a82-6ab2c4310ff9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.968153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c27c30b-79fc-425a-90a8-c66f643dd406 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.976384 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c27c30b-79fc-425a-90a8-c66f643dd406 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1316 microversion: 2.1 time: 0.481668 Jul 20 04:19:55.987191 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1509/3058] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.987191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1212166955", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "e13e2da2-9e3c-4274-877d-f49bd33e9e48"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:55.987639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2ab05c24-ca69-400c-8a82-6ab2c4310ff9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.991713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:56.007366 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ab05c24-ca69-400c-8a82-6ab2c4310ff9 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1272 microversion: 2.1 time: 0.132949 Jul 20 04:19:56.017712 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1550/3059] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:56.065646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] validate_networks() for [('e13e2da2-9e3c-4274-877d-f49bd33e9e48', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:56.511067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e47295b-e124-4561-9f6c-c759157a4d4f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.511855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e47295b-e124-4561-9f6c-c759157a4d4f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:56.521657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e47295b-e124-4561-9f6c-c759157a4d4f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.522396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e47295b-e124-4561-9f6c-c759157a4d4f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.523253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e47295b-e124-4561-9f6c-c759157a4d4f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.523777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e47295b-e124-4561-9f6c-c759157a4d4f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.942715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e47295b-e124-4561-9f6c-c759157a4d4f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.955767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:56.956753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:56.957406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:56.958005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:56.958633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:56.971965 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e47295b-e124-4561-9f6c-c759157a4d4f tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1515 microversion: 2.1 time: 0.458320 Jul 20 04:19:56.973298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.973922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.974985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.975626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.976165 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1551/3060] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1515 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:56.995193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-35a0c50d-dad3-46f7-8155-ec8294cacbeb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.997944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-35a0c50d-dad3-46f7-8155-ec8294cacbeb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.012073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Getting quotas for project 65a9c17c56e94930a159f00d0c8e0e7f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:57.017277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-35a0c50d-dad3-46f7-8155-ec8294cacbeb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.021969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-35a0c50d-dad3-46f7-8155-ec8294cacbeb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.023134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-35a0c50d-dad3-46f7-8155-ec8294cacbeb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.023599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-35a0c50d-dad3-46f7-8155-ec8294cacbeb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.030141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Getting quotas for user 43de2b946fd7474dbc2a48e5fcaa518d and project 65a9c17c56e94930a159f00d0c8e0e7f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:57.061554 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-35a0c50d-dad3-46f7-8155-ec8294cacbeb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.061850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:57.064620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-35a0c50d-dad3-46f7-8155-ec8294cacbeb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d HTTP/1.1 Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '09f11728-3c90-4e89-8da0-1f996da0af4d'} Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:57.069079 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.074198 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:57.074198 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:57.074198 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:57.074198 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:57.074198 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:57.074198 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.074198 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.074198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-35a0c50d-dad3-46f7-8155-ec8294cacbeb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:57.074198 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-35a0c50d-dad3-46f7-8155-ec8294cacbeb tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 404 len: 111 microversion: 2.1 time: 0.093672 Jul 20 04:19:57.074198 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1552/3061] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:57.107332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e14454e-c5e3-4b41-8a51-fe3135dd3cce tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.110176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3e14454e-c5e3-4b41-8a51-fe3135dd3cce tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.125920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e14454e-c5e3-4b41-8a51-fe3135dd3cce tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.126653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e14454e-c5e3-4b41-8a51-fe3135dd3cce tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.130720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e14454e-c5e3-4b41-8a51-fe3135dd3cce tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.131515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e14454e-c5e3-4b41-8a51-fe3135dd3cce tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.181611 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-33a73530-c7c8-471b-b618-b76550135700 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200639 Jul 20 04:19:57.192485 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1510/3062] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:57.198928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-90746a43-6a99-4d25-bd0e-3e65c59bb823 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.199861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-90746a43-6a99-4d25-bd0e-3e65c59bb823 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.211978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90746a43-6a99-4d25-bd0e-3e65c59bb823 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.214211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90746a43-6a99-4d25-bd0e-3e65c59bb823 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.215286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90746a43-6a99-4d25-bd0e-3e65c59bb823 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.216114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90746a43-6a99-4d25-bd0e-3e65c59bb823 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.576670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-90746a43-6a99-4d25-bd0e-3e65c59bb823 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.589507 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-90746a43-6a99-4d25-bd0e-3e65c59bb823 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1272 microversion: 2.1 time: 0.395354 Jul 20 04:19:57.593187 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1511/3063] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1272 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:57.606795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-613c652e-7f07-4180-8268-b881f5b331dd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.615164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-613c652e-7f07-4180-8268-b881f5b331dd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.636095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-613c652e-7f07-4180-8268-b881f5b331dd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.636486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-613c652e-7f07-4180-8268-b881f5b331dd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.642203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-613c652e-7f07-4180-8268-b881f5b331dd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.642784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-613c652e-7f07-4180-8268-b881f5b331dd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.698242 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-613c652e-7f07-4180-8268-b881f5b331dd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-613c652e-7f07-4180-8268-b881f5b331dd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d HTTP/1.1 Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '09f11728-3c90-4e89-8da0-1f996da0af4d'} Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:57.701533 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.706057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.716262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3e14454e-c5e3-4b41-8a51-fe3135dd3cce tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.716646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-613c652e-7f07-4180-8268-b881f5b331dd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:57.717914 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-613c652e-7f07-4180-8268-b881f5b331dd tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 404 len: 111 microversion: 2.1 time: 0.120818 Jul 20 04:19:57.721826 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1512/3064] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:57 2022] DELETE /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:57.733103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-41e67294-2ac6-4341-aa5d-63bebea1aa84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.737165 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3e14454e-c5e3-4b41-8a51-fe3135dd3cce tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1316 microversion: 2.1 time: 0.643674 Jul 20 04:19:57.737793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-41e67294-2ac6-4341-aa5d-63bebea1aa84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.748916 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1553/3065] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1316 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:57.754073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-33692ffd-d8ad-49bf-8fc1-4f13f6409f81 req-3712c730-a2b3-4f6a-a8f0-c63d0b65a1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b905560-1341-498e-ae1c-81f4f2281180", "name": "network-vif-deleted", "tag": "c0368a4e-17a8-43d7-a03e-21d099519bee"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:57.776516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-33692ffd-d8ad-49bf-8fc1-4f13f6409f81 req-3712c730-a2b3-4f6a-a8f0-c63d0b65a1ea service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.778471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-33692ffd-d8ad-49bf-8fc1-4f13f6409f81 req-3712c730-a2b3-4f6a-a8f0-c63d0b65a1ea service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.817864 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-33692ffd-d8ad-49bf-8fc1-4f13f6409f81 req-3712c730-a2b3-4f6a-a8f0-c63d0b65a1ea service nova] Creating event network-vif-deleted:c0368a4e-17a8-43d7-a03e-21d099519bee for instance 6b905560-1341-498e-ae1c-81f4f2281180 on n-h1-760456-11 Jul 20 04:19:57.839628 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-33692ffd-d8ad-49bf-8fc1-4f13f6409f81 req-3712c730-a2b3-4f6a-a8f0-c63d0b65a1ea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094157 Jul 20 04:19:57.840859 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1554/3066] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:57.858649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6d56c39a-df16-493a-8c56-d3ca074be13e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.867416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6d56c39a-df16-493a-8c56-d3ca074be13e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 09f11728-3c90-4e89-8da0-1f996da0af4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.878837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d56c39a-df16-493a-8c56-d3ca074be13e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.880636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d56c39a-df16-493a-8c56-d3ca074be13e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.881913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d56c39a-df16-493a-8c56-d3ca074be13e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.884005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d56c39a-df16-493a-8c56-d3ca074be13e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.913093 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-6d56c39a-df16-493a-8c56-d3ca074be13e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6d56c39a-df16-493a-8c56-d3ca074be13e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d HTTP/1.1 Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '09f11728-3c90-4e89-8da0-1f996da0af4d'} Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:57.917667 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.922363 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:57.922363 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:57.922363 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:57.922363 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:57.922363 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:57.922363 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. Jul 20 04:19:57.922363 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:57.922363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6d56c39a-df16-493a-8c56-d3ca074be13e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 09f11728-3c90-4e89-8da0-1f996da0af4d could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:57.935807 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6d56c39a-df16-493a-8c56-d3ca074be13e tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d" status: 404 len: 111 microversion: 2.1 time: 0.076532 Jul 20 04:19:57.940338 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1555/3067] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/09f11728-3c90-4e89-8da0-1f996da0af4d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:57.961834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-263a0a85-1c1b-44f3-b16e-48b02d8202bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.965198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-263a0a85-1c1b-44f3-b16e-48b02d8202bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.987696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-263a0a85-1c1b-44f3-b16e-48b02d8202bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.989421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-263a0a85-1c1b-44f3-b16e-48b02d8202bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.990204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-41e67294-2ac6-4341-aa5d-63bebea1aa84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.992425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-263a0a85-1c1b-44f3-b16e-48b02d8202bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.992893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-263a0a85-1c1b-44f3-b16e-48b02d8202bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.999969 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-41e67294-2ac6-4341-aa5d-63bebea1aa84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1218 microversion: 2.1 time: 0.276612 Jul 20 04:19:58.000896 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1513/3068] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1218 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:58.019583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.020218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.027425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.028317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.029352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.030033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.037859 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-263a0a85-1c1b-44f3-b16e-48b02d8202bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-263a0a85-1c1b-44f3-b16e-48b02d8202bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 HTTP/1.1 Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '2b48b17a-920e-4020-ae3f-0027021d7253'} Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:58.048939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-263a0a85-1c1b-44f3-b16e-48b02d8202bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:58.054035 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-263a0a85-1c1b-44f3-b16e-48b02d8202bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 404 len: 111 microversion: 2.1 time: 0.106223 Jul 20 04:19:58.063942 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1556/3069] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:57 2022] DELETE /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:58.073390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.073851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.074344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lazy-loading 'fault' on Instance uuid 6b905560-1341-498e-ae1c-81f4f2281180 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:58.078463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-525952be-bf04-4df7-a476-e06215cb586b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.079820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-525952be-bf04-4df7-a476-e06215cb586b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 2b48b17a-920e-4020-ae3f-0027021d7253] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.102824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-525952be-bf04-4df7-a476-e06215cb586b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.103312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-525952be-bf04-4df7-a476-e06215cb586b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.106066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-525952be-bf04-4df7-a476-e06215cb586b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.107018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-525952be-bf04-4df7-a476-e06215cb586b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.145807 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-525952be-bf04-4df7-a476-e06215cb586b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-525952be-bf04-4df7-a476-e06215cb586b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 HTTP/1.1 Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '2b48b17a-920e-4020-ae3f-0027021d7253'} Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.152816 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.159434 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.159434 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.159434 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.159434 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:58.159434 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:58.159434 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. Jul 20 04:19:58.159434 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.159434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-525952be-bf04-4df7-a476-e06215cb586b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 2b48b17a-920e-4020-ae3f-0027021d7253 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:58.159434 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-525952be-bf04-4df7-a476-e06215cb586b tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253" status: 404 len: 111 microversion: 2.1 time: 0.092646 Jul 20 04:19:58.162567 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1557/3070] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/2b48b17a-920e-4020-ae3f-0027021d7253 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:58.174939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0b1939c-d9c8-42c8-beb0-50a24bc024bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.176687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0b1939c-d9c8-42c8-beb0-50a24bc024bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.188621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0b1939c-d9c8-42c8-beb0-50a24bc024bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.191506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0b1939c-d9c8-42c8-beb0-50a24bc024bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.192358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0b1939c-d9c8-42c8-beb0-50a24bc024bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.192814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0b1939c-d9c8-42c8-beb0-50a24bc024bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.197728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.207534 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-87bbf9d8-7ec4-43cc-a786-2238f34371f6 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 200 len: 1308 microversion: 2.1 time: 0.205784 Jul 20 04:19:58.213718 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1514/3071] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 1308 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:58.247989 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a0b1939c-d9c8-42c8-beb0-50a24bc024bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0b1939c-d9c8-42c8-beb0-50a24bc024bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 HTTP/1.1 Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '021c9592-bd4c-4506-8422-4ff0c8e2f141'} Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:58.251660 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:19:58.256518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.260205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0b1939c-d9c8-42c8-beb0-50a24bc024bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:58.263823 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0b1939c-d9c8-42c8-beb0-50a24bc024bf tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 404 len: 111 microversion: 2.1 time: 0.099655 Jul 20 04:19:58.266440 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1558/3072] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:58 2022] DELETE /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:58.275358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80bc7599-4bbf-4f7e-b1e4-7b3cee224d3f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.276073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-80bc7599-4bbf-4f7e-b1e4-7b3cee224d3f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 021c9592-bd4c-4506-8422-4ff0c8e2f141] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.290336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80bc7599-4bbf-4f7e-b1e4-7b3cee224d3f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.299438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80bc7599-4bbf-4f7e-b1e4-7b3cee224d3f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.300584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80bc7599-4bbf-4f7e-b1e4-7b3cee224d3f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.301129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80bc7599-4bbf-4f7e-b1e4-7b3cee224d3f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.362299 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-80bc7599-4bbf-4f7e-b1e4-7b3cee224d3f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80bc7599-4bbf-4f7e-b1e4-7b3cee224d3f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 HTTP/1.1 Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '021c9592-bd4c-4506-8422-4ff0c8e2f141'} Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.372990 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.383334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.383334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.383334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.383334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:58.383334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:58.383334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. Jul 20 04:19:58.383334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.383334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80bc7599-4bbf-4f7e-b1e4-7b3cee224d3f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 021c9592-bd4c-4506-8422-4ff0c8e2f141 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:58.383334 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-80bc7599-4bbf-4f7e-b1e4-7b3cee224d3f tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141" status: 404 len: 111 microversion: 2.1 time: 0.104201 Jul 20 04:19:58.383334 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1515/3073] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/021c9592-bd4c-4506-8422-4ff0c8e2f141 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:58.390746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f589020-b7e9-4d99-bb64-0265761e5891 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.392587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3f589020-b7e9-4d99-bb64-0265761e5891 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.406471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f589020-b7e9-4d99-bb64-0265761e5891 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.408928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f589020-b7e9-4d99-bb64-0265761e5891 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.416275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f589020-b7e9-4d99-bb64-0265761e5891 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.417578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f589020-b7e9-4d99-bb64-0265761e5891 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.463947 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3f589020-b7e9-4d99-bb64-0265761e5891 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f589020-b7e9-4d99-bb64-0265761e5891 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 HTTP/1.1 Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '04b03898-0556-4522-836d-fa47215c2cd3'} Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:58.471204 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:19:58.476598 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.488962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f589020-b7e9-4d99-bb64-0265761e5891 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:58.490451 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f589020-b7e9-4d99-bb64-0265761e5891 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 404 len: 111 microversion: 2.1 time: 0.104652 Jul 20 04:19:58.494775 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1559/3074] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:58 2022] DELETE /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:58.501573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf87900e-7bc7-4b70-8054-99566a3ad3a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.502705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cf87900e-7bc7-4b70-8054-99566a3ad3a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 04b03898-0556-4522-836d-fa47215c2cd3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.516038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf87900e-7bc7-4b70-8054-99566a3ad3a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.518463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf87900e-7bc7-4b70-8054-99566a3ad3a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.519518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf87900e-7bc7-4b70-8054-99566a3ad3a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.523065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf87900e-7bc7-4b70-8054-99566a3ad3a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.559293 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-cf87900e-7bc7-4b70-8054-99566a3ad3a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf87900e-7bc7-4b70-8054-99566a3ad3a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 HTTP/1.1 Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '04b03898-0556-4522-836d-fa47215c2cd3'} Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.563054 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.566956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.566956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.566956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.566956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:58.566956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:58.566956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. Jul 20 04:19:58.566956 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.571836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf87900e-7bc7-4b70-8054-99566a3ad3a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 04b03898-0556-4522-836d-fa47215c2cd3 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:58.573355 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf87900e-7bc7-4b70-8054-99566a3ad3a5 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3" status: 404 len: 111 microversion: 2.1 time: 0.077849 Jul 20 04:19:58.574335 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1516/3075] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/04b03898-0556-4522-836d-fa47215c2cd3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:58.589878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d198e13b-0e0f-4fe4-9034-b8ccc5f3d9a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.592260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d198e13b-0e0f-4fe4-9034-b8ccc5f3d9a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.636584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5d176954-463c-4c60-ba81-d32466677161 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.637236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5d176954-463c-4c60-ba81-d32466677161 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.642116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d198e13b-0e0f-4fe4-9034-b8ccc5f3d9a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.642629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d198e13b-0e0f-4fe4-9034-b8ccc5f3d9a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.649210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d198e13b-0e0f-4fe4-9034-b8ccc5f3d9a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.653985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d198e13b-0e0f-4fe4-9034-b8ccc5f3d9a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.667392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d176954-463c-4c60-ba81-d32466677161 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.684322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d176954-463c-4c60-ba81-d32466677161 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.685755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d176954-463c-4c60-ba81-d32466677161 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.686651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d176954-463c-4c60-ba81-d32466677161 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.711378 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d198e13b-0e0f-4fe4-9034-b8ccc5f3d9a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d198e13b-0e0f-4fe4-9034-b8ccc5f3d9a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e HTTP/1.1 Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'cfc9bd9c-e200-4378-ba53-b9ad6e75188e'} Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:58.716692 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.722169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d198e13b-0e0f-4fe4-9034-b8ccc5f3d9a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:58.722947 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d198e13b-0e0f-4fe4-9034-b8ccc5f3d9a7 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 404 len: 111 microversion: 2.1 time: 0.136389 Jul 20 04:19:58.725790 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1560/3076] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:58 2022] DELETE /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:58.742547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-915b1a1d-34e0-4b2f-832c-c026ebf010bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.743191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-915b1a1d-34e0-4b2f-832c-c026ebf010bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: cfc9bd9c-e200-4378-ba53-b9ad6e75188e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.766965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-915b1a1d-34e0-4b2f-832c-c026ebf010bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.767434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-915b1a1d-34e0-4b2f-832c-c026ebf010bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.775434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-915b1a1d-34e0-4b2f-832c-c026ebf010bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.775985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-915b1a1d-34e0-4b2f-832c-c026ebf010bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.812441 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-915b1a1d-34e0-4b2f-832c-c026ebf010bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-915b1a1d-34e0-4b2f-832c-c026ebf010bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e HTTP/1.1 Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'cfc9bd9c-e200-4378-ba53-b9ad6e75188e'} Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:58.815178 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.821070 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:58.821070 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:58.821070 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:58.821070 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:58.821070 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:58.821070 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. Jul 20 04:19:58.821070 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:58.831295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-915b1a1d-34e0-4b2f-832c-c026ebf010bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance cfc9bd9c-e200-4378-ba53-b9ad6e75188e could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:58.832361 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-915b1a1d-34e0-4b2f-832c-c026ebf010bc tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e" status: 404 len: 111 microversion: 2.1 time: 0.102874 Jul 20 04:19:58.833143 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1561/3077] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/cfc9bd9c-e200-4378-ba53-b9ad6e75188e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:58.841024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06850e36-a24a-4f4b-9b8e-32f50dc0ebe3 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.846672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-06850e36-a24a-4f4b-9b8e-32f50dc0ebe3 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.854000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06850e36-a24a-4f4b-9b8e-32f50dc0ebe3 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.854704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06850e36-a24a-4f4b-9b8e-32f50dc0ebe3 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.855979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06850e36-a24a-4f4b-9b8e-32f50dc0ebe3 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.856785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06850e36-a24a-4f4b-9b8e-32f50dc0ebe3 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.104926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-06850e36-a24a-4f4b-9b8e-32f50dc0ebe3 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.117166 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-06850e36-a24a-4f4b-9b8e-32f50dc0ebe3 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1316 microversion: 2.1 time: 0.282022 Jul 20 04:19:59.117787 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1562/3078] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:59.128732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d1b3de8-9483-4eab-ac2f-ae50ad858bdf tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:59.128732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5d1b3de8-9483-4eab-ac2f-ae50ad858bdf tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:59.146099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d1b3de8-9483-4eab-ac2f-ae50ad858bdf tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.147337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d1b3de8-9483-4eab-ac2f-ae50ad858bdf tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.148436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d1b3de8-9483-4eab-ac2f-ae50ad858bdf tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.149109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d1b3de8-9483-4eab-ac2f-ae50ad858bdf tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.341319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5d1b3de8-9483-4eab-ac2f-ae50ad858bdf tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.354371 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d1b3de8-9483-4eab-ac2f-ae50ad858bdf tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1270 microversion: 2.1 time: 0.234934 Jul 20 04:19:59.357459 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1563/3079] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:59 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1270 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:59.367535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e565cb68-3ceb-471f-8ddc-c4b3dc4cc385 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:59.370204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e565cb68-3ceb-471f-8ddc-c4b3dc4cc385 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: 6b905560-1341-498e-ae1c-81f4f2281180] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:59.400750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5d176954-463c-4c60-ba81-d32466677161 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.401755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e565cb68-3ceb-471f-8ddc-c4b3dc4cc385 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.403531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e565cb68-3ceb-471f-8ddc-c4b3dc4cc385 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.404545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e565cb68-3ceb-471f-8ddc-c4b3dc4cc385 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.406782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e565cb68-3ceb-471f-8ddc-c4b3dc4cc385 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.416866 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5d176954-463c-4c60-ba81-d32466677161 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1314 microversion: 2.1 time: 0.811463 Jul 20 04:19:59.425528 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1517/3080] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1314 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:59.442174 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e565cb68-3ceb-471f-8ddc-c4b3dc4cc385 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] HTTP exception thrown: Instance 6b905560-1341-498e-ae1c-81f4f2281180 could not be found. Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e565cb68-3ceb-471f-8ddc-c4b3dc4cc385 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Request method failure captured: Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 HTTP/1.1 Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HZwZXjQpDsCu6VruWdXV2KpzbefcfonjF_hXe95lcO3akOQ6P48aIL7kcPlToa8ATpxZ2o2MqKFweiVqwDVUJbDhC-aySmEDEdDp-C5cjXJ7ToJbshSL-jSJOcjSTZXnoWazPGv1-_ukggqKRtHJskeqZav8pyQZPw5BfWWtBMJuk Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 0be768b73a844766a2407ac16a2b7304 Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-VolumesAdminNegativeTest-2060435250 Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0be768b73a844766a2407ac16a2b7304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0be768b73a844766a2407ac16a2b7304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0be768b73a844766a2407ac16a2b7304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0be768b73a844766a2407ac16a2b7304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-VolumesAdminNegativeTest-2060435250 Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 0be768b73a844766a2407ac16a2b7304 Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2060435250 Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-VolumesAdminNegativeTest-2060435250-project Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 0458026d4c4f43b1a770140d09b2e164 Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-VolumesAdminNegativeTest-2060435250-project Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 6b905560-1341-498e-ae1c-81f4f2281180 could not be found. Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '6b905560-1341-498e-ae1c-81f4f2281180'} Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b905560-1341-498e-ae1c-81f4f2281180 could not be found. Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b905560-1341-498e-ae1c-81f4f2281180 could not be found. Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:59.444066 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:59.448766 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:59.448766 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:59.448766 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:59.448766 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:59.448766 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:59.448766 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b905560-1341-498e-ae1c-81f4f2281180 could not be found. Jul 20 04:19:59.448766 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:19:59.452869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e565cb68-3ceb-471f-8ddc-c4b3dc4cc385 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Returning 404 to user: Instance 6b905560-1341-498e-ae1c-81f4f2281180 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:59.456676 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e565cb68-3ceb-471f-8ddc-c4b3dc4cc385 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180" status: 404 len: 111 microversion: 2.1 time: 0.098020 Jul 20 04:19:59.458925 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1564/3081] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:59 2022] GET /compute/v2.1/servers/6b905560-1341-498e-ae1c-81f4f2281180 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:00.135778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3105c5b1-6d42-42ed-ab0c-c3bd58d42102 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.136413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3105c5b1-6d42-42ed-ab0c-c3bd58d42102 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.148948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3105c5b1-6d42-42ed-ab0c-c3bd58d42102 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.149411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3105c5b1-6d42-42ed-ab0c-c3bd58d42102 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.150220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3105c5b1-6d42-42ed-ab0c-c3bd58d42102 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.150710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3105c5b1-6d42-42ed-ab0c-c3bd58d42102 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.384584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f7fed63f-81fe-4081-a87a-cdbccd14c007 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.385912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f7fed63f-81fe-4081-a87a-cdbccd14c007 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.405579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7fed63f-81fe-4081-a87a-cdbccd14c007 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.406213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7fed63f-81fe-4081-a87a-cdbccd14c007 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.407239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7fed63f-81fe-4081-a87a-cdbccd14c007 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.408389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7fed63f-81fe-4081-a87a-cdbccd14c007 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.644369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f7fed63f-81fe-4081-a87a-cdbccd14c007 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:00.674756 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f7fed63f-81fe-4081-a87a-cdbccd14c007 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1276 microversion: 2.1 time: 0.278847 Jul 20 04:20:00.675930 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1565/3082] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1276 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:00.690502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-413e389b-44f2-48c6-88aa-15c2be5b3fad tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.695813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-413e389b-44f2-48c6-88aa-15c2be5b3fad tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.710046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-413e389b-44f2-48c6-88aa-15c2be5b3fad tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.710684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-413e389b-44f2-48c6-88aa-15c2be5b3fad tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.711690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-413e389b-44f2-48c6-88aa-15c2be5b3fad tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.712248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-413e389b-44f2-48c6-88aa-15c2be5b3fad tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.639168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-413e389b-44f2-48c6-88aa-15c2be5b3fad tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:01.657754 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-413e389b-44f2-48c6-88aa-15c2be5b3fad tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1314 microversion: 2.1 time: 0.967663 Jul 20 04:20:01.663359 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1566/3083] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:01.679979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5a19d21f-a9ac-4a3f-8ca3-976e06bdb509 req-54b6bb19-1d9e-45a1-8cf9-7fe477be06cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e32034-3c05-42c3-81e8-b65e3fa773e4", "name": "network-vif-deleted", "tag": "6cec27c4-b109-44df-8ebf-907b4f02fcec"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:01.719506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5a19d21f-a9ac-4a3f-8ca3-976e06bdb509 req-54b6bb19-1d9e-45a1-8cf9-7fe477be06cd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.720143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5a19d21f-a9ac-4a3f-8ca3-976e06bdb509 req-54b6bb19-1d9e-45a1-8cf9-7fe477be06cd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.758703 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5a19d21f-a9ac-4a3f-8ca3-976e06bdb509 req-54b6bb19-1d9e-45a1-8cf9-7fe477be06cd service nova] Creating event network-vif-deleted:6cec27c4-b109-44df-8ebf-907b4f02fcec for instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 on n-h2-760456-11 Jul 20 04:20:01.775695 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5a19d21f-a9ac-4a3f-8ca3-976e06bdb509 req-54b6bb19-1d9e-45a1-8cf9-7fe477be06cd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110128 Jul 20 04:20:01.776558 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1567/3084] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:01.797030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b112239a-f595-45fa-b1f1-264b4203eaa4 req-1fb2dea6-c73e-4ac2-b858-74e19776a3dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf2ba27-fa2a-4e8e-8345-e863474cec38", "tag": "3b4f3e21-554c-417e-83f1-0e4afef71ed1"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:01.820012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b112239a-f595-45fa-b1f1-264b4203eaa4 req-1fb2dea6-c73e-4ac2-b858-74e19776a3dc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.826111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b112239a-f595-45fa-b1f1-264b4203eaa4 req-1fb2dea6-c73e-4ac2-b858-74e19776a3dc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.849194 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b112239a-f595-45fa-b1f1-264b4203eaa4 req-1fb2dea6-c73e-4ac2-b858-74e19776a3dc service nova] Creating event network-changed:3b4f3e21-554c-417e-83f1-0e4afef71ed1 for instance 4cf2ba27-fa2a-4e8e-8345-e863474cec38 on n-h1-760456-11 Jul 20 04:20:01.861858 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b112239a-f595-45fa-b1f1-264b4203eaa4 req-1fb2dea6-c73e-4ac2-b858-74e19776a3dc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082804 Jul 20 04:20:01.865159 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1568/3085] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:01.875554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b4701bda-b1f0-4cad-9279-010f3ed12016 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:01.876311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b4701bda-b1f0-4cad-9279-010f3ed12016 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:01.902039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4701bda-b1f0-4cad-9279-010f3ed12016 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.902554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4701bda-b1f0-4cad-9279-010f3ed12016 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.903351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4701bda-b1f0-4cad-9279-010f3ed12016 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.903802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4701bda-b1f0-4cad-9279-010f3ed12016 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.959092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3105c5b1-6d42-42ed-ab0c-c3bd58d42102 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:01.976334 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3105c5b1-6d42-42ed-ab0c-c3bd58d42102 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1316 microversion: 2.1 time: 1.844333 Jul 20 04:20:01.988495 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1518/3086] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1316 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:02.444513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-584a159b-4cbc-48b5-9bbb-072eba5698a6 req-f8ea4624-32f4-4ab1-a856-ce6bbe70ae32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ec1453-4d22-4482-9d68-3e3b1b4977c7", "name": "network-vif-plugged", "status": "completed", "tag": "e5d9553a-044e-4393-830b-554d71d4fd35"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:02.463324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-584a159b-4cbc-48b5-9bbb-072eba5698a6 req-f8ea4624-32f4-4ab1-a856-ce6bbe70ae32 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.465004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-584a159b-4cbc-48b5-9bbb-072eba5698a6 req-f8ea4624-32f4-4ab1-a856-ce6bbe70ae32 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.509527 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-584a159b-4cbc-48b5-9bbb-072eba5698a6 req-f8ea4624-32f4-4ab1-a856-ce6bbe70ae32 service nova] Creating event network-vif-plugged:e5d9553a-044e-4393-830b-554d71d4fd35 for instance b4ec1453-4d22-4482-9d68-3e3b1b4977c7 on n-h2-760456-11 Jul 20 04:20:02.522448 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-584a159b-4cbc-48b5-9bbb-072eba5698a6 req-f8ea4624-32f4-4ab1-a856-ce6bbe70ae32 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083394 Jul 20 04:20:02.526898 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1519/3087] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:02.634867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b4701bda-b1f0-4cad-9279-010f3ed12016 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.644622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:02.650495 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b4701bda-b1f0-4cad-9279-010f3ed12016 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1276 microversion: 2.1 time: 0.782355 Jul 20 04:20:02.655151 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1569/3088] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:01 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1276 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:02.680892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a653be73-eb11-4877-9743-6f8a1c5df878 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.681807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a653be73-eb11-4877-9743-6f8a1c5df878 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.700305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a653be73-eb11-4877-9743-6f8a1c5df878 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.704602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a653be73-eb11-4877-9743-6f8a1c5df878 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.713351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a653be73-eb11-4877-9743-6f8a1c5df878 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.713984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a653be73-eb11-4877-9743-6f8a1c5df878 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.996827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e5718a4e-4aa3-4007-ac0a-c10a5a57d22e tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.997633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e5718a4e-4aa3-4007-ac0a-c10a5a57d22e tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.018166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5718a4e-4aa3-4007-ac0a-c10a5a57d22e tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.027601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5718a4e-4aa3-4007-ac0a-c10a5a57d22e tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.029446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5718a4e-4aa3-4007-ac0a-c10a5a57d22e tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.033530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5718a4e-4aa3-4007-ac0a-c10a5a57d22e tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.564228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e5718a4e-4aa3-4007-ac0a-c10a5a57d22e tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.581747 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e5718a4e-4aa3-4007-ac0a-c10a5a57d22e tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1316 microversion: 2.1 time: 0.583509 Jul 20 04:20:03.590314 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1570/3089] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:02 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:03.673844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1c0688df-8b98-4ea5-914b-f9f02d515559 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.675118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1c0688df-8b98-4ea5-914b-f9f02d515559 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.683001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c0688df-8b98-4ea5-914b-f9f02d515559 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.683840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c0688df-8b98-4ea5-914b-f9f02d515559 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.685232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c0688df-8b98-4ea5-914b-f9f02d515559 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.685885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c0688df-8b98-4ea5-914b-f9f02d515559 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.808627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a653be73-eb11-4877-9743-6f8a1c5df878 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.819216 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a653be73-eb11-4877-9743-6f8a1c5df878 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1314 microversion: 2.1 time: 1.142723 Jul 20 04:20:03.819936 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1520/3090] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:02 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1314 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:04.051787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1c0688df-8b98-4ea5-914b-f9f02d515559 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:04.071096 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1c0688df-8b98-4ea5-914b-f9f02d515559 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1318 microversion: 2.1 time: 0.395611 Jul 20 04:20:04.072806 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1571/3091] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:04.599902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-68fa652d-4883-45c4-b724-a99abc0e9ca8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.600520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-68fa652d-4883-45c4-b724-a99abc0e9ca8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:04.615660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68fa652d-4883-45c4-b724-a99abc0e9ca8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.616030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68fa652d-4883-45c4-b724-a99abc0e9ca8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.616794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68fa652d-4883-45c4-b724-a99abc0e9ca8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.617241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68fa652d-4883-45c4-b724-a99abc0e9ca8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.836289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0d6b6976-50ff-4453-98ee-94d567807a64 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.836819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0d6b6976-50ff-4453-98ee-94d567807a64 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:04.857734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d6b6976-50ff-4453-98ee-94d567807a64 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.858497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d6b6976-50ff-4453-98ee-94d567807a64 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.860228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d6b6976-50ff-4453-98ee-94d567807a64 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.860773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d6b6976-50ff-4453-98ee-94d567807a64 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.090499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-68fa652d-4883-45c4-b724-a99abc0e9ca8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.110049 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-68fa652d-4883-45c4-b724-a99abc0e9ca8 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1316 microversion: 2.1 time: 0.513921 Jul 20 04:20:05.115066 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1521/3092] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:05.130297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5fbd756b-0156-4788-acd9-01aa04af3d85 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.131875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5fbd756b-0156-4788-acd9-01aa04af3d85 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.153308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fbd756b-0156-4788-acd9-01aa04af3d85 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.153734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fbd756b-0156-4788-acd9-01aa04af3d85 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.157811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fbd756b-0156-4788-acd9-01aa04af3d85 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.158349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fbd756b-0156-4788-acd9-01aa04af3d85 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.447535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0d6b6976-50ff-4453-98ee-94d567807a64 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.468701 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0d6b6976-50ff-4453-98ee-94d567807a64 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1314 microversion: 2.1 time: 0.635719 Jul 20 04:20:05.473989 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1572/3093] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:05.526613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5fbd756b-0156-4788-acd9-01aa04af3d85 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.537383 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5fbd756b-0156-4788-acd9-01aa04af3d85 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1318 microversion: 2.1 time: 0.417845 Jul 20 04:20:05.538287 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1522/3094] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:05.723762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac5f540b-3e6e-4394-b577-5fd3eac83094 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.724432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac5f540b-3e6e-4394-b577-5fd3eac83094 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.741851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac5f540b-3e6e-4394-b577-5fd3eac83094 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.746723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac5f540b-3e6e-4394-b577-5fd3eac83094 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.754075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac5f540b-3e6e-4394-b577-5fd3eac83094 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.763259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac5f540b-3e6e-4394-b577-5fd3eac83094 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.806877 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-ac5f540b-3e6e-4394-b577-5fd3eac83094 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac5f540b-3e6e-4394-b577-5fd3eac83094 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 HTTP/1.1 Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'c2ca8a00-3d0f-485c-a7ce-9028d31e7035'} Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:05.814364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac5f540b-3e6e-4394-b577-5fd3eac83094 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:05.819327 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac5f540b-3e6e-4394-b577-5fd3eac83094 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 404 len: 111 microversion: 2.1 time: 0.095513 Jul 20 04:20:05.824931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d9be2bea-174a-47e1-8e70-14cad13582c6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.825487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d9be2bea-174a-47e1-8e70-14cad13582c6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: c2ca8a00-3d0f-485c-a7ce-9028d31e7035] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.826422 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1573/3095] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:05 2022] DELETE /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:05.841448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9be2bea-174a-47e1-8e70-14cad13582c6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.841802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9be2bea-174a-47e1-8e70-14cad13582c6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.843020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9be2bea-174a-47e1-8e70-14cad13582c6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.847408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9be2bea-174a-47e1-8e70-14cad13582c6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.882698 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-d9be2bea-174a-47e1-8e70-14cad13582c6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d9be2bea-174a-47e1-8e70-14cad13582c6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 HTTP/1.1 Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c2ca8a00-3d0f-485c-a7ce-9028d31e7035'} Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:05.884663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.893843 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:05.893843 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:05.893843 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:05.893843 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:05.893843 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:05.893843 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. Jul 20 04:20:05.893843 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.893843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d9be2bea-174a-47e1-8e70-14cad13582c6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance c2ca8a00-3d0f-485c-a7ce-9028d31e7035 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:05.893843 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d9be2bea-174a-47e1-8e70-14cad13582c6 tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035" status: 404 len: 111 microversion: 2.1 time: 0.065013 Jul 20 04:20:05.893843 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1523/3096] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/c2ca8a00-3d0f-485c-a7ce-9028d31e7035 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:05.901215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-65d2f1f2-bda2-4b25-89fc-2996f0a7611a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.901946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-65d2f1f2-bda2-4b25-89fc-2996f0a7611a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.916458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65d2f1f2-bda2-4b25-89fc-2996f0a7611a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.917238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65d2f1f2-bda2-4b25-89fc-2996f0a7611a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.918877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65d2f1f2-bda2-4b25-89fc-2996f0a7611a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.919347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65d2f1f2-bda2-4b25-89fc-2996f0a7611a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.957225 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-65d2f1f2-bda2-4b25-89fc-2996f0a7611a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-65d2f1f2-bda2-4b25-89fc-2996f0a7611a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 HTTP/1.1 Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '206ee904-1894-4f54-b06c-e8a01c6f08f3'} Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:05.963191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-65d2f1f2-bda2-4b25-89fc-2996f0a7611a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:05.970641 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-65d2f1f2-bda2-4b25-89fc-2996f0a7611a tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "DELETE /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 404 len: 111 microversion: 2.1 time: 0.076539 Jul 20 04:20:05.975402 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1574/3097] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:05 2022] DELETE /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:05.986297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0d86a59b-4a9a-4916-a9ff-c97fc5c6361d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.986964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0d86a59b-4a9a-4916-a9ff-c97fc5c6361d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] [instance: 206ee904-1894-4f54-b06c-e8a01c6f08f3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.004083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d86a59b-4a9a-4916-a9ff-c97fc5c6361d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.006678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d86a59b-4a9a-4916-a9ff-c97fc5c6361d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.008245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d86a59b-4a9a-4916-a9ff-c97fc5c6361d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.008989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d86a59b-4a9a-4916-a9ff-c97fc5c6361d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.028984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5358e3e5-af05-48c8-a52f-739fcd7abdaa req-d9d98a3c-a6d1-4b19-886f-835f8951b2cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c14806e2-040e-4e56-9e25-d417152338bf", "tag": "0e58105c-bf30-4985-8639-301f20e00ee0"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:06.056243 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-0d86a59b-4a9a-4916-a9ff-c97fc5c6361d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] HTTP exception thrown: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:20:06.056492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5358e3e5-af05-48c8-a52f-739fcd7abdaa req-d9d98a3c-a6d1-4b19-886f-835f8951b2cb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.058930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5358e3e5-af05-48c8-a52f-739fcd7abdaa req-d9d98a3c-a6d1-4b19-886f-835f8951b2cb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0d86a59b-4a9a-4916-a9ff-c97fc5c6361d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Request method failure captured: Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 HTTP/1.1 Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14ExZ4PduqHwNrg5bwvzIHVaaKs4bAKAA7I4YIxHJKe8fMxPNcHxf_KFkeU8lORFuNSpYULNKArK9JVE3poefQqIT6MzrQuVdan57WXwJWkQFcMkSy9qeljY52NwqCqvWZL-vt6IWSPHkouGWK3bl3LCbPk8szh4xuAA4ACv5hdyYRo Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ab3aecd6003c4614bf21b8134ceb98a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ab3aecd6003c4614bf21b8134ceb98a1 Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003356862 Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9f053f31c02c412394d48ce65350d153 Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-1003356862-project Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '206ee904-1894-4f54-b06c-e8a01c6f08f3'} Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:06.059192 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.063500 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:06.063500 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:06.063500 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:06.063500 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:06.063500 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:06.063500 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. Jul 20 04:20:06.063500 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:06.066362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0d86a59b-4a9a-4916-a9ff-c97fc5c6361d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] Returning 404 to user: Instance 206ee904-1894-4f54-b06c-e8a01c6f08f3 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:06.068162 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0d86a59b-4a9a-4916-a9ff-c97fc5c6361d tempest-DeleteServersTestJSON-1003356862 tempest-DeleteServersTestJSON-1003356862-project] 10.222.0.59 "GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3" status: 404 len: 111 microversion: 2.1 time: 0.089282 Jul 20 04:20:06.069375 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1524/3098] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/206ee904-1894-4f54-b06c-e8a01c6f08f3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:06.099260 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5358e3e5-af05-48c8-a52f-739fcd7abdaa req-d9d98a3c-a6d1-4b19-886f-835f8951b2cb service nova] Creating event network-changed:0e58105c-bf30-4985-8639-301f20e00ee0 for instance c14806e2-040e-4e56-9e25-d417152338bf on n-h1-760456-11 Jul 20 04:20:06.113942 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5358e3e5-af05-48c8-a52f-739fcd7abdaa req-d9d98a3c-a6d1-4b19-886f-835f8951b2cb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090680 Jul 20 04:20:06.116821 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1575/3099] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:06.134212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-322544fb-a3cd-48fc-8a1b-ed1a45674e19 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.134891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-322544fb-a3cd-48fc-8a1b-ed1a45674e19 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.143613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-322544fb-a3cd-48fc-8a1b-ed1a45674e19 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.144071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-322544fb-a3cd-48fc-8a1b-ed1a45674e19 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.144889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-322544fb-a3cd-48fc-8a1b-ed1a45674e19 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.145528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-322544fb-a3cd-48fc-8a1b-ed1a45674e19 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.492524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cf32bd84-7742-47ee-9f5a-d8cf170ea73e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.493659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cf32bd84-7742-47ee-9f5a-d8cf170ea73e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.525560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf32bd84-7742-47ee-9f5a-d8cf170ea73e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.527386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf32bd84-7742-47ee-9f5a-d8cf170ea73e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.530348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf32bd84-7742-47ee-9f5a-d8cf170ea73e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.533142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf32bd84-7742-47ee-9f5a-d8cf170ea73e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.632445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-322544fb-a3cd-48fc-8a1b-ed1a45674e19 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.644260 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-322544fb-a3cd-48fc-8a1b-ed1a45674e19 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1505 microversion: 2.1 time: 0.515121 Jul 20 04:20:06.646451 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1525/3100] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1505 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:06.662187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-637bb390-5e66-4e94-9362-29801c801154 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.663112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-637bb390-5e66-4e94-9362-29801c801154 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.673499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-637bb390-5e66-4e94-9362-29801c801154 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.681605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-637bb390-5e66-4e94-9362-29801c801154 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.682726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-637bb390-5e66-4e94-9362-29801c801154 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.686986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-637bb390-5e66-4e94-9362-29801c801154 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.987115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:06.992979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-637bb390-5e66-4e94-9362-29801c801154 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.007565 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-637bb390-5e66-4e94-9362-29801c801154 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1318 microversion: 2.1 time: 0.359835 Jul 20 04:20:07.012141 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1526/3101] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:07.023374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e7973cce-e98d-4f10-9f8a-4d4420417123 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.024199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e7973cce-e98d-4f10-9f8a-4d4420417123 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.052964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7973cce-e98d-4f10-9f8a-4d4420417123 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.053700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7973cce-e98d-4f10-9f8a-4d4420417123 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.054076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cf32bd84-7742-47ee-9f5a-d8cf170ea73e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.054792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7973cce-e98d-4f10-9f8a-4d4420417123 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.055280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7973cce-e98d-4f10-9f8a-4d4420417123 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.073401 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cf32bd84-7742-47ee-9f5a-d8cf170ea73e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1314 microversion: 2.1 time: 0.578950 Jul 20 04:20:07.075025 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1576/3102] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:07.194566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7973cce-e98d-4f10-9f8a-4d4420417123 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.199554 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e7973cce-e98d-4f10-9f8a-4d4420417123 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7/os-instance-actions/req-39195700-5a08-4c75-a120-9aea877b4b0d" status: 200 len: 313 microversion: 2.1 time: 0.186118 Jul 20 04:20:07.207964 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1527/3103] 10.222.0.59 () {58 vars in 1418 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7/os-instance-actions/req-39195700-5a08-4c75-a120-9aea877b4b0d => generated 313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:07.213990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea3d31aa-9a04-4e3e-8748-632fc095b5ae tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:07.215007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea3d31aa-9a04-4e3e-8748-632fc095b5ae tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.232109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea3d31aa-9a04-4e3e-8748-632fc095b5ae tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.232741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea3d31aa-9a04-4e3e-8748-632fc095b5ae tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.233600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea3d31aa-9a04-4e3e-8748-632fc095b5ae tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.234186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea3d31aa-9a04-4e3e-8748-632fc095b5ae tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.411995 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea3d31aa-9a04-4e3e-8748-632fc095b5ae tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "POST /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7/action" status: 202 len: 0 microversion: 2.1 time: 0.202343 Jul 20 04:20:07.413229 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1577/3104] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:07 2022] POST /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:07.428408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b0ee363-c73e-4371-b9a5-5e77c29541c2 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.429520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6b0ee363-c73e-4371-b9a5-5e77c29541c2 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.458560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b0ee363-c73e-4371-b9a5-5e77c29541c2 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.459162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b0ee363-c73e-4371-b9a5-5e77c29541c2 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.460611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b0ee363-c73e-4371-b9a5-5e77c29541c2 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.461061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b0ee363-c73e-4371-b9a5-5e77c29541c2 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.609327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-edd673ba-2c39-4a9a-9590-e14b4f647a1d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.610542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-edd673ba-2c39-4a9a-9590-e14b4f647a1d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.620401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-edd673ba-2c39-4a9a-9590-e14b4f647a1d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.621224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-edd673ba-2c39-4a9a-9590-e14b4f647a1d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.622693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-edd673ba-2c39-4a9a-9590-e14b4f647a1d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.623400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-edd673ba-2c39-4a9a-9590-e14b4f647a1d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.684438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-edd673ba-2c39-4a9a-9590-e14b4f647a1d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:07.876932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6b0ee363-c73e-4371-b9a5-5e77c29541c2 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.886669 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-edd673ba-2c39-4a9a-9590-e14b4f647a1d tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 204 len: 0 microversion: 2.1 time: 0.282718 Jul 20 04:20:07.887346 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1578/3105] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:07 2022] DELETE /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:07.900722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b20adbf-ffc0-4efe-b75c-abe634e9e4bd tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.902716 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b0ee363-c73e-4371-b9a5-5e77c29541c2 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1507 microversion: 2.1 time: 0.481755 Jul 20 04:20:07.903945 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1528/3106] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1507 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:07.904391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6b20adbf-ffc0-4efe-b75c-abe634e9e4bd tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.920163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b20adbf-ffc0-4efe-b75c-abe634e9e4bd tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.922561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b20adbf-ffc0-4efe-b75c-abe634e9e4bd tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.924035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b20adbf-ffc0-4efe-b75c-abe634e9e4bd tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.925379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b20adbf-ffc0-4efe-b75c-abe634e9e4bd tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.026403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=20 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:08.030455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-960ae666-26ea-42b6-ab33-027d4baba3fc tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.031694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-960ae666-26ea-42b6-ab33-027d4baba3fc tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:08.042215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-960ae666-26ea-42b6-ab33-027d4baba3fc tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.047498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-960ae666-26ea-42b6-ab33-027d4baba3fc tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.048439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-960ae666-26ea-42b6-ab33-027d4baba3fc tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.048966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-960ae666-26ea-42b6-ab33-027d4baba3fc tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.185721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6b20adbf-ffc0-4efe-b75c-abe634e9e4bd tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.199514 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6b20adbf-ffc0-4efe-b75c-abe634e9e4bd tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1683 microversion: 2.1 time: 0.306748 Jul 20 04:20:08.200314 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1579/3107] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1683 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:08.213690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4db4d0c6-18ae-4983-903e-d08ef7a55a4a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.214340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4db4d0c6-18ae-4983-903e-d08ef7a55a4a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:08.231907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4db4d0c6-18ae-4983-903e-d08ef7a55a4a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.232376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4db4d0c6-18ae-4983-903e-d08ef7a55a4a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.233212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4db4d0c6-18ae-4983-903e-d08ef7a55a4a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.233693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4db4d0c6-18ae-4983-903e-d08ef7a55a4a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.604012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4db4d0c6-18ae-4983-903e-d08ef7a55a4a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.615244 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4db4d0c6-18ae-4983-903e-d08ef7a55a4a tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1314 microversion: 2.1 time: 0.413712 Jul 20 04:20:08.615850 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1580/3108] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:08.820913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-960ae666-26ea-42b6-ab33-027d4baba3fc tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.833194 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-960ae666-26ea-42b6-ab33-027d4baba3fc tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1318 microversion: 2.1 time: 0.808135 Jul 20 04:20:08.833814 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1529/3109] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:08.921197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d8d9a403-b3d0-4193-8993-eb34163a7b1c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.922132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d8d9a403-b3d0-4193-8993-eb34163a7b1c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:08.936955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8d9a403-b3d0-4193-8993-eb34163a7b1c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.938093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8d9a403-b3d0-4193-8993-eb34163a7b1c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.939731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8d9a403-b3d0-4193-8993-eb34163a7b1c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.940195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8d9a403-b3d0-4193-8993-eb34163a7b1c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.217602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa48bea5-4a3a-4700-89fd-c6fe6041a1e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.218565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fa48bea5-4a3a-4700-89fd-c6fe6041a1e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.230429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa48bea5-4a3a-4700-89fd-c6fe6041a1e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.234585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa48bea5-4a3a-4700-89fd-c6fe6041a1e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.238492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa48bea5-4a3a-4700-89fd-c6fe6041a1e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.240946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa48bea5-4a3a-4700-89fd-c6fe6041a1e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.449936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8d9a403-b3d0-4193-8993-eb34163a7b1c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.463702 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d8d9a403-b3d0-4193-8993-eb34163a7b1c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1507 microversion: 2.1 time: 0.546333 Jul 20 04:20:09.467374 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1581/3110] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1507 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:09.558524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-39bdc820-9509-4b9c-b115-2374eae5ae82 req-2e0dfc6a-5cb5-4927-ab58-756d98a06ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf2ba27-fa2a-4e8e-8345-e863474cec38", "name": "network-vif-plugged", "status": "completed", "tag": "3b4f3e21-554c-417e-83f1-0e4afef71ed1"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:09.614055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-39bdc820-9509-4b9c-b115-2374eae5ae82 req-2e0dfc6a-5cb5-4927-ab58-756d98a06ebf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.614981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-39bdc820-9509-4b9c-b115-2374eae5ae82 req-2e0dfc6a-5cb5-4927-ab58-756d98a06ebf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.650716 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-39bdc820-9509-4b9c-b115-2374eae5ae82 req-2e0dfc6a-5cb5-4927-ab58-756d98a06ebf service nova] Creating event network-vif-plugged:3b4f3e21-554c-417e-83f1-0e4afef71ed1 for instance 4cf2ba27-fa2a-4e8e-8345-e863474cec38 on n-h1-760456-11 Jul 20 04:20:09.660073 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-39bdc820-9509-4b9c-b115-2374eae5ae82 req-2e0dfc6a-5cb5-4927-ab58-756d98a06ebf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119475 Jul 20 04:20:09.662581 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1582/3111] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:09.676214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ad44cade-b980-4cb0-9f0a-a715afa050df tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.677225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ad44cade-b980-4cb0-9f0a-a715afa050df tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.685892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad44cade-b980-4cb0-9f0a-a715afa050df tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.689932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad44cade-b980-4cb0-9f0a-a715afa050df tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.692132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad44cade-b980-4cb0-9f0a-a715afa050df tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.693354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad44cade-b980-4cb0-9f0a-a715afa050df tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.705024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fa48bea5-4a3a-4700-89fd-c6fe6041a1e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.710533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:09.723188 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa48bea5-4a3a-4700-89fd-c6fe6041a1e3 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1683 microversion: 2.1 time: 0.509928 Jul 20 04:20:09.738328 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1530/3112] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1683 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:09.852774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-21350922-7dbe-4af5-91b1-85f2a1c839a5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.854190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-21350922-7dbe-4af5-91b1-85f2a1c839a5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.872984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21350922-7dbe-4af5-91b1-85f2a1c839a5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.873673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21350922-7dbe-4af5-91b1-85f2a1c839a5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.875055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21350922-7dbe-4af5-91b1-85f2a1c839a5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.875710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21350922-7dbe-4af5-91b1-85f2a1c839a5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.313888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-21350922-7dbe-4af5-91b1-85f2a1c839a5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.324805 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-21350922-7dbe-4af5-91b1-85f2a1c839a5 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1318 microversion: 2.1 time: 0.474988 Jul 20 04:20:10.326815 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1531/3113] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:10.484205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6996aab3-276f-4ffa-aaa9-a5e9ec6e2577 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.485159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6996aab3-276f-4ffa-aaa9-a5e9ec6e2577 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.504703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6996aab3-276f-4ffa-aaa9-a5e9ec6e2577 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.505166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6996aab3-276f-4ffa-aaa9-a5e9ec6e2577 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.505970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6996aab3-276f-4ffa-aaa9-a5e9ec6e2577 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.506445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6996aab3-276f-4ffa-aaa9-a5e9ec6e2577 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.666889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ad44cade-b980-4cb0-9f0a-a715afa050df tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.682637 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ad44cade-b980-4cb0-9f0a-a715afa050df tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1314 microversion: 2.1 time: 1.018060 Jul 20 04:20:10.684234 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1583/3114] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1314 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:10.742480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-953d00ff-899c-4b8c-939d-d7b31c3134b9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.743108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-953d00ff-899c-4b8c-939d-d7b31c3134b9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.755831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-953d00ff-899c-4b8c-939d-d7b31c3134b9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.756291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-953d00ff-899c-4b8c-939d-d7b31c3134b9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.757097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-953d00ff-899c-4b8c-939d-d7b31c3134b9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.757539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-953d00ff-899c-4b8c-939d-d7b31c3134b9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.939925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6996aab3-276f-4ffa-aaa9-a5e9ec6e2577 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.958354 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6996aab3-276f-4ffa-aaa9-a5e9ec6e2577 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1505 microversion: 2.1 time: 0.478615 Jul 20 04:20:10.970333 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1532/3115] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:10.977652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-266839c3-a58d-4947-83c4-3da88b17fb09 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '.version_select at 0x7fb841b3fe50>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.978523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-266839c3-a58d-4947-83c4-3da88b17fb09 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.986116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-266839c3-a58d-4947-83c4-3da88b17fb09 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.986935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-266839c3-a58d-4947-83c4-3da88b17fb09 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.988125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-266839c3-a58d-4947-83c4-3da88b17fb09 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.988737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-266839c3-a58d-4947-83c4-3da88b17fb09 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.024867 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-266839c3-a58d-4947-83c4-3da88b17fb09 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.053017 Jul 20 04:20:11.025841 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1533/3116] 10.222.0.59 () {58 vars in 1295 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7/os-instance-actions => generated 611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:11.040216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a92b7148-2b2a-4611-abdd-3c75c8ad0443 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.040976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a92b7148-2b2a-4611-abdd-3c75c8ad0443 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.052022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a92b7148-2b2a-4611-abdd-3c75c8ad0443 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.052876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a92b7148-2b2a-4611-abdd-3c75c8ad0443 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.053905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a92b7148-2b2a-4611-abdd-3c75c8ad0443 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.054547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a92b7148-2b2a-4611-abdd-3c75c8ad0443 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.089711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a92b7148-2b2a-4611-abdd-3c75c8ad0443 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:11.234550 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a92b7148-2b2a-4611-abdd-3c75c8ad0443 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 204 len: 0 microversion: 2.1 time: 0.197651 Jul 20 04:20:11.235589 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1534/3117] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:11 2022] DELETE /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:11.268409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8173201a-b2a7-4d1e-9004-d6dc17e1b519 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.270342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8173201a-b2a7-4d1e-9004-d6dc17e1b519 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.280214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8173201a-b2a7-4d1e-9004-d6dc17e1b519 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.282048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8173201a-b2a7-4d1e-9004-d6dc17e1b519 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.283689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8173201a-b2a7-4d1e-9004-d6dc17e1b519 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.285824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8173201a-b2a7-4d1e-9004-d6dc17e1b519 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.573343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8173201a-b2a7-4d1e-9004-d6dc17e1b519 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.586715 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8173201a-b2a7-4d1e-9004-d6dc17e1b519 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1511 microversion: 2.1 time: 0.345747 Jul 20 04:20:11.588181 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1535/3118] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:11.594716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9bb6bb1d-28f3-4cbf-9b9a-545bcbd28372 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.595554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9bb6bb1d-28f3-4cbf-9b9a-545bcbd28372 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.604799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9bb6bb1d-28f3-4cbf-9b9a-545bcbd28372 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.605323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9bb6bb1d-28f3-4cbf-9b9a-545bcbd28372 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.606348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9bb6bb1d-28f3-4cbf-9b9a-545bcbd28372 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.606804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9bb6bb1d-28f3-4cbf-9b9a-545bcbd28372 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.791560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-953d00ff-899c-4b8c-939d-d7b31c3134b9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.799698 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-953d00ff-899c-4b8c-939d-d7b31c3134b9 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1683 microversion: 2.1 time: 1.061480 Jul 20 04:20:11.810294 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1584/3119] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1683 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:11.815953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-56ae4c2c-66a4-476c-95cc-33415c004673 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.816842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-56ae4c2c-66a4-476c-95cc-33415c004673 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.823101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56ae4c2c-66a4-476c-95cc-33415c004673 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.823568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56ae4c2c-66a4-476c-95cc-33415c004673 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.824553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56ae4c2c-66a4-476c-95cc-33415c004673 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.825004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56ae4c2c-66a4-476c-95cc-33415c004673 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.961151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9bb6bb1d-28f3-4cbf-9b9a-545bcbd28372 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.968968 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9bb6bb1d-28f3-4cbf-9b9a-545bcbd28372 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1318 microversion: 2.1 time: 0.379531 Jul 20 04:20:11.970153 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1536/3120] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:11.974989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-836cd676-da70-40ca-99a5-4b6c5d704500 req-3791144c-dee1-4f11-9524-9a8c2d3db548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14806e2-040e-4e56-9e25-d417152338bf", "name": "network-vif-plugged", "status": "completed", "tag": "0e58105c-bf30-4985-8639-301f20e00ee0"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:11.995657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-836cd676-da70-40ca-99a5-4b6c5d704500 req-3791144c-dee1-4f11-9524-9a8c2d3db548 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.996469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-836cd676-da70-40ca-99a5-4b6c5d704500 req-3791144c-dee1-4f11-9524-9a8c2d3db548 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.017939 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-836cd676-da70-40ca-99a5-4b6c5d704500 req-3791144c-dee1-4f11-9524-9a8c2d3db548 service nova] Creating event network-vif-plugged:0e58105c-bf30-4985-8639-301f20e00ee0 for instance c14806e2-040e-4e56-9e25-d417152338bf on n-h1-760456-11 Jul 20 04:20:12.024805 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-836cd676-da70-40ca-99a5-4b6c5d704500 req-3791144c-dee1-4f11-9524-9a8c2d3db548 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053139 Jul 20 04:20:12.029868 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1537/3121] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:12.443870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-56ae4c2c-66a4-476c-95cc-33415c004673 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:12.451607 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-56ae4c2c-66a4-476c-95cc-33415c004673 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1464 microversion: 2.1 time: 0.639915 Jul 20 04:20:12.453076 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1585/3122] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1464 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:12.605719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06afbca3-3208-4ef3-b084-aa16aea4e55c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:12.606375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-06afbca3-3208-4ef3-b084-aa16aea4e55c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:12.625304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06afbca3-3208-4ef3-b084-aa16aea4e55c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.626084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06afbca3-3208-4ef3-b084-aa16aea4e55c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.628729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06afbca3-3208-4ef3-b084-aa16aea4e55c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.629560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06afbca3-3208-4ef3-b084-aa16aea4e55c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.700644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:12.909370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2b2e3277-8ded-4510-897b-f05dd6d919b4 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] Calling method '.version_select at 0x7fb841c49b80>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:12.942916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b2e3277-8ded-4510-897b-f05dd6d919b4 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.945639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b2e3277-8ded-4510-897b-f05dd6d919b4 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.015857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b2e3277-8ded-4510-897b-f05dd6d919b4 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.017668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b2e3277-8ded-4510-897b-f05dd6d919b4 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.074659 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2b2e3277-8ded-4510-897b-f05dd6d919b4 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage/5391d9bb22c94549b8c52f593c06c598?start=2022-07-19T04%3A20%3A12.462293&end=2022-07-21T04%3A20%3A12.462293" status: 200 len: 695 microversion: 2.1 time: 0.608245 Jul 20 04:20:13.079740 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1538/3123] 10.222.0.59 () {58 vars in 1411 bytes} [Wed Jul 20 04:20:12 2022] GET /compute/v2.1/os-simple-tenant-usage/5391d9bb22c94549b8c52f593c06c598?start=2022-07-19T04%3A20%3A12.462293&end=2022-07-21T04%3A20%3A12.462293 => generated 695 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:13.087040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-99d2fb1c-a70c-437d-9a5e-4b814fd4a451 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.088125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-99d2fb1c-a70c-437d-9a5e-4b814fd4a451 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.101614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99d2fb1c-a70c-437d-9a5e-4b814fd4a451 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.114686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99d2fb1c-a70c-437d-9a5e-4b814fd4a451 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.116009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99d2fb1c-a70c-437d-9a5e-4b814fd4a451 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.117003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99d2fb1c-a70c-437d-9a5e-4b814fd4a451 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.163526 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-99d2fb1c-a70c-437d-9a5e-4b814fd4a451 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/ips" status: 200 len: 145 microversion: 2.1 time: 0.080897 Jul 20 04:20:13.164403 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1539/3124] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/ips => generated 145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:13.180778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4930d893-301b-48e0-a29a-55f844bf2adb tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.181529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4930d893-301b-48e0-a29a-55f844bf2adb tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.196366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4930d893-301b-48e0-a29a-55f844bf2adb tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.197186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4930d893-301b-48e0-a29a-55f844bf2adb tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.198650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4930d893-301b-48e0-a29a-55f844bf2adb tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.199329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4930d893-301b-48e0-a29a-55f844bf2adb tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.352126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4930d893-301b-48e0-a29a-55f844bf2adb tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.363796 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4930d893-301b-48e0-a29a-55f844bf2adb tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1615 microversion: 2.1 time: 0.197844 Jul 20 04:20:13.365196 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1540/3125] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1615 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:13.380127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35579485-882c-4d73-87c0-cd52957625d8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.381101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-35579485-882c-4d73-87c0-cd52957625d8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.397058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35579485-882c-4d73-87c0-cd52957625d8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.398501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35579485-882c-4d73-87c0-cd52957625d8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.399671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35579485-882c-4d73-87c0-cd52957625d8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.400355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35579485-882c-4d73-87c0-cd52957625d8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.514144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-06afbca3-3208-4ef3-b084-aa16aea4e55c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.528852 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-06afbca3-3208-4ef3-b084-aa16aea4e55c tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1511 microversion: 2.1 time: 0.928220 Jul 20 04:20:13.530162 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1586/3126] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:12 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1511 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:13.546670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-29a01a03-ac0e-47b8-86f3-89c2ffb8c544 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '.version_select at 0x7fb8410d29d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.557773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29a01a03-ac0e-47b8-86f3-89c2ffb8c544 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.559180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29a01a03-ac0e-47b8-86f3-89c2ffb8c544 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.625152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29a01a03-ac0e-47b8-86f3-89c2ffb8c544 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.626119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29a01a03-ac0e-47b8-86f3-89c2ffb8c544 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.681214 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-29a01a03-ac0e-47b8-86f3-89c2ffb8c544 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage/5391d9bb22c94549b8c52f593c06c598?start=2022-07-19T04%3A20%3A12.462293&end=2022-07-21T04%3A20%3A12.462293" status: 200 len: 695 microversion: 2.1 time: 0.148943 Jul 20 04:20:13.689022 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1587/3127] 10.222.0.59 () {58 vars in 1411 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/os-simple-tenant-usage/5391d9bb22c94549b8c52f593c06c598?start=2022-07-19T04%3A20%3A12.462293&end=2022-07-21T04%3A20%3A12.462293 => generated 695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:13.701636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9f4dc26-4c6a-41bb-bcb9-7763e94bdc29 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] Calling method '.version_select at 0x7fb84101b940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.733283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9f4dc26-4c6a-41bb-bcb9-7763e94bdc29 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.733845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9f4dc26-4c6a-41bb-bcb9-7763e94bdc29 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.778151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9f4dc26-4c6a-41bb-bcb9-7763e94bdc29 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.778549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9f4dc26-4c6a-41bb-bcb9-7763e94bdc29 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.973031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-35579485-882c-4d73-87c0-cd52957625d8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.983236 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-35579485-882c-4d73-87c0-cd52957625d8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1318 microversion: 2.1 time: 0.616686 Jul 20 04:20:13.986546 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1541/3128] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1318 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:14.049566 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9f4dc26-4c6a-41bb-bcb9-7763e94bdc29 tempest-TenantUsagesTestJSON-78863200 tempest-TenantUsagesTestJSON-78863200-project-admin] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A20%3A12.462293&end=2022-07-21T04%3A20%3A12.462293&detailed=1" status: 200 len: 39248 microversion: 2.1 time: 0.355934 Jul 20 04:20:14.063109 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1588/3129] 10.222.0.59 () {58 vars in 1334 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A20%3A12.462293&end=2022-07-21T04%3A20%3A12.462293&detailed=1 => generated 39248 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:20:14.107865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58303cef-fd54-4aff-8563-9e5b896c52b5 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.110471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-58303cef-fd54-4aff-8563-9e5b896c52b5 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.130388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58303cef-fd54-4aff-8563-9e5b896c52b5 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.141849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58303cef-fd54-4aff-8563-9e5b896c52b5 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.158996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58303cef-fd54-4aff-8563-9e5b896c52b5 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.159469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58303cef-fd54-4aff-8563-9e5b896c52b5 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.256876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1c1aa46d-3cfa-4623-a38a-d9d4801fcb96 req-3bbb6cfe-0258-4323-868e-d189187e9f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ec1453-4d22-4482-9d68-3e3b1b4977c7", "name": "network-vif-deleted", "tag": "e5d9553a-044e-4393-830b-554d71d4fd35"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:14.278408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-58303cef-fd54-4aff-8563-9e5b896c52b5 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:14.290210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1c1aa46d-3cfa-4623-a38a-d9d4801fcb96 req-3bbb6cfe-0258-4323-868e-d189187e9f72 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.290989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1c1aa46d-3cfa-4623-a38a-d9d4801fcb96 req-3bbb6cfe-0258-4323-868e-d189187e9f72 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.337105 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1c1aa46d-3cfa-4623-a38a-d9d4801fcb96 req-3bbb6cfe-0258-4323-868e-d189187e9f72 service nova] Creating event network-vif-deleted:e5d9553a-044e-4393-830b-554d71d4fd35 for instance b4ec1453-4d22-4482-9d68-3e3b1b4977c7 on n-h2-760456-11 Jul 20 04:20:14.381425 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1c1aa46d-3cfa-4623-a38a-d9d4801fcb96 req-3bbb6cfe-0258-4323-868e-d189187e9f72 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129724 Jul 20 04:20:14.390468 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1589/3130] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:14.415687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0055d27a-1a85-42fa-9164-e60095c50387 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.416913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0055d27a-1a85-42fa-9164-e60095c50387 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.475927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0055d27a-1a85-42fa-9164-e60095c50387 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.476619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0055d27a-1a85-42fa-9164-e60095c50387 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.484815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0055d27a-1a85-42fa-9164-e60095c50387 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.485347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0055d27a-1a85-42fa-9164-e60095c50387 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.655161 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-58303cef-fd54-4aff-8563-9e5b896c52b5 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 204 len: 0 microversion: 2.1 time: 0.563937 Jul 20 04:20:14.661731 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1542/3131] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:14 2022] DELETE /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:14.671706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.675791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.687154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.687875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.689013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.690473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.728230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.729048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.729708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lazy-loading 'fault' on Instance uuid b4ec1453-4d22-4482-9d68-3e3b1b4977c7 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:14.838483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0055d27a-1a85-42fa-9164-e60095c50387 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:14.858730 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0055d27a-1a85-42fa-9164-e60095c50387 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1615 microversion: 2.1 time: 0.464975 Jul 20 04:20:14.860179 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1590/3132] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1615 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:14.872738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-547c6e6c-069c-44aa-a729-a355d89cc75e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.875108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-547c6e6c-069c-44aa-a729-a355d89cc75e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.892263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-547c6e6c-069c-44aa-a729-a355d89cc75e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.894052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-547c6e6c-069c-44aa-a729-a355d89cc75e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.896238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-547c6e6c-069c-44aa-a729-a355d89cc75e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.898969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-547c6e6c-069c-44aa-a729-a355d89cc75e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.967431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b13c7d9c51944674be96a7fa18b9af97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8556bf8d2849c7a8aa422de636b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:14.997895 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d30e2ffe-4743-4ce4-9c8c-15bdb56fa8f6 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 200 len: 1306 microversion: 2.1 time: 0.333797 Jul 20 04:20:14.998891 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1543/3133] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 1306 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:15.031236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-11cdbf37-79ad-4ef0-8f9e-d899255c4674 req-77a02f36-f19c-4a69-abfb-d64dae463e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea899275-fe75-439a-aec1-824f5cf75382", "name": "network-vif-deleted", "tag": "eda254b3-c753-4cfe-bbf6-f11de433af64"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:15.058970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:15.061978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-11cdbf37-79ad-4ef0-8f9e-d899255c4674 req-77a02f36-f19c-4a69-abfb-d64dae463e7d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.067867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-11cdbf37-79ad-4ef0-8f9e-d899255c4674 req-77a02f36-f19c-4a69-abfb-d64dae463e7d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.100400 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-11cdbf37-79ad-4ef0-8f9e-d899255c4674 req-77a02f36-f19c-4a69-abfb-d64dae463e7d service nova] Creating event network-vif-deleted:eda254b3-c753-4cfe-bbf6-f11de433af64 for instance ea899275-fe75-439a-aec1-824f5cf75382 on n-h1-760456-11 Jul 20 04:20:15.110531 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-11cdbf37-79ad-4ef0-8f9e-d899255c4674 req-77a02f36-f19c-4a69-abfb-d64dae463e7d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098405 Jul 20 04:20:15.116500 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1544/3134] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:15.137282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-49a9c673-d77a-4efa-a41e-1dfa551dba7d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:15.138106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-49a9c673-d77a-4efa-a41e-1dfa551dba7d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:15.147379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49a9c673-d77a-4efa-a41e-1dfa551dba7d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.154082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49a9c673-d77a-4efa-a41e-1dfa551dba7d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.154990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49a9c673-d77a-4efa-a41e-1dfa551dba7d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.156070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49a9c673-d77a-4efa-a41e-1dfa551dba7d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.371451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-547c6e6c-069c-44aa-a729-a355d89cc75e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:15.384112 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-547c6e6c-069c-44aa-a729-a355d89cc75e tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1470 microversion: 2.1 time: 0.520091 Jul 20 04:20:15.385583 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1591/3135] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1470 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:15.442970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-49a9c673-d77a-4efa-a41e-1dfa551dba7d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:15.452274 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-49a9c673-d77a-4efa-a41e-1dfa551dba7d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1507 microversion: 2.1 time: 0.334170 Jul 20 04:20:15.456294 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1545/3136] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:15 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:15.474762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c0483c9f-5d1b-4d9a-83d7-b30c56bd947c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:15.476173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c0483c9f-5d1b-4d9a-83d7-b30c56bd947c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:15.485388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c0483c9f-5d1b-4d9a-83d7-b30c56bd947c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.486025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c0483c9f-5d1b-4d9a-83d7-b30c56bd947c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.488575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c0483c9f-5d1b-4d9a-83d7-b30c56bd947c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.489337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c0483c9f-5d1b-4d9a-83d7-b30c56bd947c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.879970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:15.881072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:15.881803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c0483c9f-5d1b-4d9a-83d7-b30c56bd947c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:15.898601 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c0483c9f-5d1b-4d9a-83d7-b30c56bd947c tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1507 microversion: 2.1 time: 0.430754 Jul 20 04:20:15.917487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.918045 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1592/3137] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:15 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:15.918669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.925660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.939482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.940891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-837bd1a9-0ff2-4002-8098-ffb29598cd27 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:15.942844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-837bd1a9-0ff2-4002-8098-ffb29598cd27 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:15.963823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-837bd1a9-0ff2-4002-8098-ffb29598cd27 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.974437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-837bd1a9-0ff2-4002-8098-ffb29598cd27 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.976013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-837bd1a9-0ff2-4002-8098-ffb29598cd27 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.977710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-837bd1a9-0ff2-4002-8098-ffb29598cd27 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.051411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:16.099196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.111740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.116899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lazy-loading 'fault' on Instance uuid ea899275-fe75-439a-aec1-824f5cf75382 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:16.175751 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-837bd1a9-0ff2-4002-8098-ffb29598cd27 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "PUT /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1079 microversion: 2.1 time: 0.255872 Jul 20 04:20:16.190210 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1593/3138] 10.222.0.59 () {60 vars in 1255 bytes} [Wed Jul 20 04:20:15 2022] PUT /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1079 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:16.200822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-735571f8-3391-475d-9e42-5eda60fd0b65 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:16.201447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-735571f8-3391-475d-9e42-5eda60fd0b65 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] [instance: b4ec1453-4d22-4482-9d68-3e3b1b4977c7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:16.220841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-735571f8-3391-475d-9e42-5eda60fd0b65 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.221387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-735571f8-3391-475d-9e42-5eda60fd0b65 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.222195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-735571f8-3391-475d-9e42-5eda60fd0b65 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.223058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-735571f8-3391-475d-9e42-5eda60fd0b65 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.245543 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-735571f8-3391-475d-9e42-5eda60fd0b65 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] HTTP exception thrown: Instance b4ec1453-4d22-4482-9d68-3e3b1b4977c7 could not be found. Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-735571f8-3391-475d-9e42-5eda60fd0b65 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Request method failure captured: Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 HTTP/1.1 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Jfb8XHmYBgZRhuLnC17YdtpEQgnxULZKgd6DQNdE71lWKOvXbfqR-2JtW-YXxyMiuWkY-z29jBIQv5r42XcNbLBt81nkxfWRBYwukc47J9T_46mcjxxUd6HUf9ptm3bGoIUOtNuBpWeCDZ9Qtztxf3XPQfuANWEkvGaaDVT5hv7e0 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ef8556bf8d2849c7a8aa422de636b9f8 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-InstanceActionsTestJSON-1541764769 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ef8556bf8d2849c7a8aa422de636b9f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef8556bf8d2849c7a8aa422de636b9f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef8556bf8d2849c7a8aa422de636b9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ef8556bf8d2849c7a8aa422de636b9f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-InstanceActionsTestJSON-1541764769 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ef8556bf8d2849c7a8aa422de636b9f8 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1541764769 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-InstanceActionsTestJSON-1541764769-project Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: b13c7d9c51944674be96a7fa18b9af97 Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-InstanceActionsTestJSON-1541764769-project Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance b4ec1453-4d22-4482-9d68-3e3b1b4977c7 could not be found. Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'b4ec1453-4d22-4482-9d68-3e3b1b4977c7'} Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ec1453-4d22-4482-9d68-3e3b1b4977c7 could not be found. Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ec1453-4d22-4482-9d68-3e3b1b4977c7 could not be found. Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:16.254931 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:16.259495 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:16.259495 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:16.259495 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:16.259495 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:16.259495 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:16.259495 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ec1453-4d22-4482-9d68-3e3b1b4977c7 could not be found. Jul 20 04:20:16.259495 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:16.262741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-735571f8-3391-475d-9e42-5eda60fd0b65 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] Returning 404 to user: Instance b4ec1453-4d22-4482-9d68-3e3b1b4977c7 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:16.267673 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-735571f8-3391-475d-9e42-5eda60fd0b65 tempest-InstanceActionsTestJSON-1541764769 tempest-InstanceActionsTestJSON-1541764769-project] 10.222.0.59 "GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7" status: 404 len: 111 microversion: 2.1 time: 0.073766 Jul 20 04:20:16.274671 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1594/3139] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:16 2022] GET /compute/v2.1/servers/b4ec1453-4d22-4482-9d68-3e3b1b4977c7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:16.280076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-07fc926a-8dd9-4973-a377-be09db97200a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:16.284800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-07fc926a-8dd9-4973-a377-be09db97200a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:16.301307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07fc926a-8dd9-4973-a377-be09db97200a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.302912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07fc926a-8dd9-4973-a377-be09db97200a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.305896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07fc926a-8dd9-4973-a377-be09db97200a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.308190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07fc926a-8dd9-4973-a377-be09db97200a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.497060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0458026d4c4f43b1a770140d09b2e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be768b73a844766a2407ac16a2b7304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:16.510719 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-84de0142-8b1f-49f1-8433-05d65fbfa5ab tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 200 len: 1331 microversion: 2.1 time: 0.636919 Jul 20 04:20:16.511593 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1546/3140] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:15 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 1331 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:16.521192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58e7702a-354d-4f84-982b-907349f73aa8 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:16.524284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-58e7702a-354d-4f84-982b-907349f73aa8 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:16.544769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58e7702a-354d-4f84-982b-907349f73aa8 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.551026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58e7702a-354d-4f84-982b-907349f73aa8 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.555972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58e7702a-354d-4f84-982b-907349f73aa8 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.556674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58e7702a-354d-4f84-982b-907349f73aa8 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.913022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-07fc926a-8dd9-4973-a377-be09db97200a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:16.933277 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-07fc926a-8dd9-4973-a377-be09db97200a tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1505 microversion: 2.1 time: 0.656330 Jul 20 04:20:16.934063 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1595/3141] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:16 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1505 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:16.951709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f21e14c5-e0ac-4cd2-a6c0-36fa4132eb7b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:16.953913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f21e14c5-e0ac-4cd2-a6c0-36fa4132eb7b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:16.956645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:16.971210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f21e14c5-e0ac-4cd2-a6c0-36fa4132eb7b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.974947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f21e14c5-e0ac-4cd2-a6c0-36fa4132eb7b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.981813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f21e14c5-e0ac-4cd2-a6c0-36fa4132eb7b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.982574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f21e14c5-e0ac-4cd2-a6c0-36fa4132eb7b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.472835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f21e14c5-e0ac-4cd2-a6c0-36fa4132eb7b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:17.482235 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f21e14c5-e0ac-4cd2-a6c0-36fa4132eb7b tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1505 microversion: 2.1 time: 0.534585 Jul 20 04:20:17.485615 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1596/3142] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:16 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:17.515971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8cddf3c9-8b43-4a68-a868-14af9f49a88d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b09960fc-2612-42f2-a44c-048d6ad11a55"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:17.517397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8cddf3c9-8b43-4a68-a868-14af9f49a88d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:17.538845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cddf3c9-8b43-4a68-a868-14af9f49a88d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.539313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cddf3c9-8b43-4a68-a868-14af9f49a88d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.540107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cddf3c9-8b43-4a68-a868-14af9f49a88d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.540554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8cddf3c9-8b43-4a68-a868-14af9f49a88d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.786873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-58e7702a-354d-4f84-982b-907349f73aa8 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349676e031f44de85e2352b69d39511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5391d9bb22c94549b8c52f593c06c598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:17.804997 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-58e7702a-354d-4f84-982b-907349f73aa8 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 200 len: 1470 microversion: 2.1 time: 1.290831 Jul 20 04:20:17.806785 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1547/3143] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:16 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 1470 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:17.822774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f49f3d53-c0cf-40cb-9256-9d2f3a60d2fb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:17.826954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f49f3d53-c0cf-40cb-9256-9d2f3a60d2fb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:17.838097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f49f3d53-c0cf-40cb-9256-9d2f3a60d2fb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.838788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f49f3d53-c0cf-40cb-9256-9d2f3a60d2fb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.846397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f49f3d53-c0cf-40cb-9256-9d2f3a60d2fb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.849619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f49f3d53-c0cf-40cb-9256-9d2f3a60d2fb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.148001 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f49f3d53-c0cf-40cb-9256-9d2f3a60d2fb tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "PUT /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1081 microversion: 2.1 time: 0.339791 Jul 20 04:20:18.148896 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1548/3144] 10.222.0.59 () {60 vars in 1255 bytes} [Wed Jul 20 04:20:17 2022] PUT /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1081 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:18.177196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b44620e-227c-475f-80a0-f80edc7d5fe7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:18.178090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8b44620e-227c-475f-80a0-f80edc7d5fe7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] [instance: ea899275-fe75-439a-aec1-824f5cf75382] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:18.192341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b44620e-227c-475f-80a0-f80edc7d5fe7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.196342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b44620e-227c-475f-80a0-f80edc7d5fe7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.198674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b44620e-227c-475f-80a0-f80edc7d5fe7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.200011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b44620e-227c-475f-80a0-f80edc7d5fe7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.240389 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8b44620e-227c-475f-80a0-f80edc7d5fe7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] HTTP exception thrown: Instance ea899275-fe75-439a-aec1-824f5cf75382 could not be found. Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b44620e-227c-475f-80a0-f80edc7d5fe7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Request method failure captured: Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 HTTP/1.1 Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14HZwZXjQpDsCu6VruWdXV2KpzbefcfonjF_hXe95lcO3akOQ6P48aIL7kcPlToa8ATpxZ2o2MqKFweiVqwDVUJbDhC-aySmEDEdDp-C5cjXJ7ToJbshSL-jSJOcjSTZXnoWazPGv1-_ukggqKRtHJskeqZav8pyQZPw5BfWWtBMJuk Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 0be768b73a844766a2407ac16a2b7304 Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesAdminNegativeTest-2060435250 Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0be768b73a844766a2407ac16a2b7304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0be768b73a844766a2407ac16a2b7304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0be768b73a844766a2407ac16a2b7304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0be768b73a844766a2407ac16a2b7304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesAdminNegativeTest-2060435250 Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 0be768b73a844766a2407ac16a2b7304 Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2060435250 Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesAdminNegativeTest-2060435250-project Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 0458026d4c4f43b1a770140d09b2e164 Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesAdminNegativeTest-2060435250-project Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance ea899275-fe75-439a-aec1-824f5cf75382 could not be found. Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'ea899275-fe75-439a-aec1-824f5cf75382'} Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea899275-fe75-439a-aec1-824f5cf75382 could not be found. Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea899275-fe75-439a-aec1-824f5cf75382 could not be found. Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:18.242201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:18.259832 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:18.259832 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:18.259832 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:18.259832 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:18.259832 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:18.259832 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea899275-fe75-439a-aec1-824f5cf75382 could not be found. Jul 20 04:20:18.259832 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:18.259832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b44620e-227c-475f-80a0-f80edc7d5fe7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Returning 404 to user: Instance ea899275-fe75-439a-aec1-824f5cf75382 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:18.259832 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8b44620e-227c-475f-80a0-f80edc7d5fe7 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382" status: 404 len: 111 microversion: 2.1 time: 0.097031 Jul 20 04:20:18.259832 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1549/3145] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:18 2022] GET /compute/v2.1/servers/ea899275-fe75-439a-aec1-824f5cf75382 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:18.266707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d0602364-7232-463f-b3fb-63b6667bac68 req-5dcb1cb2-8a38-4109-b0ee-ebc96b4d27a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf2ba27-fa2a-4e8e-8345-e863474cec38", "name": "network-vif-deleted", "tag": "3b4f3e21-554c-417e-83f1-0e4afef71ed1"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:18.291456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d0602364-7232-463f-b3fb-63b6667bac68 req-5dcb1cb2-8a38-4109-b0ee-ebc96b4d27a3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.293732 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8cddf3c9-8b43-4a68-a868-14af9f49a88d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.797351 Jul 20 04:20:18.300479 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1597/3146] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:20:17 2022] POST /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:18.301402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d0602364-7232-463f-b3fb-63b6667bac68 req-5dcb1cb2-8a38-4109-b0ee-ebc96b4d27a3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.327161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-459b420f-47c3-4bbc-8ff7-cb41d0623d17 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:18.328703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-459b420f-47c3-4bbc-8ff7-cb41d0623d17 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:18.362811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-459b420f-47c3-4bbc-8ff7-cb41d0623d17 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.363276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-459b420f-47c3-4bbc-8ff7-cb41d0623d17 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.369107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-459b420f-47c3-4bbc-8ff7-cb41d0623d17 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.369574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-459b420f-47c3-4bbc-8ff7-cb41d0623d17 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.375603 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d0602364-7232-463f-b3fb-63b6667bac68 req-5dcb1cb2-8a38-4109-b0ee-ebc96b4d27a3 service nova] Creating event network-vif-deleted:3b4f3e21-554c-417e-83f1-0e4afef71ed1 for instance 4cf2ba27-fa2a-4e8e-8345-e863474cec38 on n-h1-760456-11 Jul 20 04:20:18.400998 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d0602364-7232-463f-b3fb-63b6667bac68 req-5dcb1cb2-8a38-4109-b0ee-ebc96b4d27a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143790 Jul 20 04:20:18.402973 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1550/3147] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:18.413454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d8728af0-c537-4154-9983-9f70918a5ae2 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] Calling method '.version_select at 0x7fb841cb01f0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:18.469804 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d8728af0-c537-4154-9983-9f70918a5ae2 tempest-VolumesAdminNegativeTest-2060435250 tempest-VolumesAdminNegativeTest-2060435250-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-164623887" status: 202 len: 0 microversion: 2.1 time: 0.064464 Jul 20 04:20:18.471577 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1551/3148] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 04:20:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-164623887 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:18.782450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-459b420f-47c3-4bbc-8ff7-cb41d0623d17 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:18.796422 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-459b420f-47c3-4bbc-8ff7-cb41d0623d17 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1507 microversion: 2.1 time: 0.493967 Jul 20 04:20:18.809060 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1598/3149] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:18 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:18.815981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2386b29-1d34-42ef-a0e8-800ecacacda8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:18.816873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c2386b29-1d34-42ef-a0e8-800ecacacda8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:18.833973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baa32286-588b-40b2-863f-c8cda599c1b0 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:18.834868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-baa32286-588b-40b2-863f-c8cda599c1b0 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] [instance: 4cf2ba27-fa2a-4e8e-8345-e863474cec38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:18.836299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2386b29-1d34-42ef-a0e8-800ecacacda8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.840344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2386b29-1d34-42ef-a0e8-800ecacacda8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.841434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2386b29-1d34-42ef-a0e8-800ecacacda8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.841990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2386b29-1d34-42ef-a0e8-800ecacacda8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.844372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa32286-588b-40b2-863f-c8cda599c1b0 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.848657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa32286-588b-40b2-863f-c8cda599c1b0 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.849689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa32286-588b-40b2-863f-c8cda599c1b0 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.850330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-baa32286-588b-40b2-863f-c8cda599c1b0 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.881839 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-baa32286-588b-40b2-863f-c8cda599c1b0 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] HTTP exception thrown: Instance 4cf2ba27-fa2a-4e8e-8345-e863474cec38 could not be found. Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baa32286-588b-40b2-863f-c8cda599c1b0 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Request method failure captured: Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 HTTP/1.1 Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Jj9pCkqC-miHi7M6Q-pr56gb9DfAr5FIJNiYRKb6-upWTRFjlU60RNKUVTfJpVbNhKdI5iGeLY1CCXA-PyKefSf9gIs7GrdNEDGwuJv6LWlDReTywcqbX2sQ5GWU6GeUHdBynCQgD-bLMJMGeSjGZb7tjozM1jJGgSb21-sneDLMg Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 5391d9bb22c94549b8c52f593c06c598 Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TenantUsagesTestJSON-809375317 Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5391d9bb22c94549b8c52f593c06c598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5391d9bb22c94549b8c52f593c06c598"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5391d9bb22c94549b8c52f593c06c598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5391d9bb22c94549b8c52f593c06c598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TenantUsagesTestJSON-809375317 Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 5391d9bb22c94549b8c52f593c06c598 Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TenantUsagesTestJSON-809375317 Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TenantUsagesTestJSON-809375317-project Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 7349676e031f44de85e2352b69d39511 Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TenantUsagesTestJSON-809375317-project Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4cf2ba27-fa2a-4e8e-8345-e863474cec38 could not be found. Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4cf2ba27-fa2a-4e8e-8345-e863474cec38'} Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf2ba27-fa2a-4e8e-8345-e863474cec38 could not be found. Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf2ba27-fa2a-4e8e-8345-e863474cec38 could not be found. Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:18.888176 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:18.893191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:18.893191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:18.893191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:18.893191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:18.893191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:18.893191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf2ba27-fa2a-4e8e-8345-e863474cec38 could not be found. Jul 20 04:20:18.893191 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:18.894661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-baa32286-588b-40b2-863f-c8cda599c1b0 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] Returning 404 to user: Instance 4cf2ba27-fa2a-4e8e-8345-e863474cec38 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:18.895725 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-baa32286-588b-40b2-863f-c8cda599c1b0 tempest-TenantUsagesTestJSON-809375317 tempest-TenantUsagesTestJSON-809375317-project] 10.222.0.59 "GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38" status: 404 len: 111 microversion: 2.1 time: 0.065649 Jul 20 04:20:18.899253 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1599/3150] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:18 2022] GET /compute/v2.1/servers/4cf2ba27-fa2a-4e8e-8345-e863474cec38 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:19.514946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2386b29-1d34-42ef-a0e8-800ecacacda8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:19.534863 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c2386b29-1d34-42ef-a0e8-800ecacacda8 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1507 microversion: 2.1 time: 0.722446 Jul 20 04:20:19.535488 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1552/3151] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:18 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1507 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:19.555661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-19ef8bea-0a67-4dcc-bbdf-cb3ac8904a36 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:19.556204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-19ef8bea-0a67-4dcc-bbdf-cb3ac8904a36 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:19.565029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19ef8bea-0a67-4dcc-bbdf-cb3ac8904a36 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:19.565492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19ef8bea-0a67-4dcc-bbdf-cb3ac8904a36 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:19.572189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19ef8bea-0a67-4dcc-bbdf-cb3ac8904a36 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:19.572664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19ef8bea-0a67-4dcc-bbdf-cb3ac8904a36 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:19.675556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-19ef8bea-0a67-4dcc-bbdf-cb3ac8904a36 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:19.884335 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-19ef8bea-0a67-4dcc-bbdf-cb3ac8904a36 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 204 len: 0 microversion: 2.1 time: 0.331035 Jul 20 04:20:19.886592 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1600/3152] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:19 2022] DELETE /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:19.896843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-247245c3-86e8-4063-a4d5-26ce055bb19d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:19.897446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-247245c3-86e8-4063-a4d5-26ce055bb19d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:19.906397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247245c3-86e8-4063-a4d5-26ce055bb19d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:19.926895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247245c3-86e8-4063-a4d5-26ce055bb19d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:19.927807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247245c3-86e8-4063-a4d5-26ce055bb19d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:19.928273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247245c3-86e8-4063-a4d5-26ce055bb19d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.001517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-247245c3-86e8-4063-a4d5-26ce055bb19d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:20.125080 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.compute.api [None req-247245c3-86e8-4063-a4d5-26ce055bb19d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Instance is already in deleting state, ignoring this request Jul 20 04:20:20.143086 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-247245c3-86e8-4063-a4d5-26ce055bb19d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 204 len: 0 microversion: 2.1 time: 0.238672 Jul 20 04:20:20.144122 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1553/3153] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:19 2022] DELETE /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:20:20.157035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-adee025e-2b5f-47b9-af28-888607c240ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:20.158647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-adee025e-2b5f-47b9-af28-888607c240ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:20.165846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adee025e-2b5f-47b9-af28-888607c240ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.166665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adee025e-2b5f-47b9-af28-888607c240ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:20.167703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adee025e-2b5f-47b9-af28-888607c240ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:20.168379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adee025e-2b5f-47b9-af28-888607c240ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.157366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-adee025e-2b5f-47b9-af28-888607c240ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:21.166623 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-adee025e-2b5f-47b9-af28-888607c240ef tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1513 microversion: 2.1 time: 1.017226 Jul 20 04:20:21.171131 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1601/3154] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:20 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1513 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:22.193682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-db7cba67-1830-40ce-a875-47ba24244a1d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:22.197535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-db7cba67-1830-40ce-a875-47ba24244a1d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:22.215851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db7cba67-1830-40ce-a875-47ba24244a1d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.218830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db7cba67-1830-40ce-a875-47ba24244a1d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.220997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db7cba67-1830-40ce-a875-47ba24244a1d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.223754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db7cba67-1830-40ce-a875-47ba24244a1d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.599291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-db7cba67-1830-40ce-a875-47ba24244a1d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:22.610605 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-db7cba67-1830-40ce-a875-47ba24244a1d tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1513 microversion: 2.1 time: 0.424499 Jul 20 04:20:22.611933 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1554/3155] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:22 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1513 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:23.237354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1669172859", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "ef35a8f1-b429-411d-a46d-36137cbfbcbe"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:23.337021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] validate_networks() for [('ef35a8f1-b429-411d-a46d-36137cbfbcbe', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:23.630321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4768fc41-307d-48ec-853b-16d094aea603 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:23.631430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4768fc41-307d-48ec-853b-16d094aea603 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:23.636739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:23.702485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4768fc41-307d-48ec-853b-16d094aea603 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:23.713320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4768fc41-307d-48ec-853b-16d094aea603 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:23.714274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4768fc41-307d-48ec-853b-16d094aea603 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:23.714737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4768fc41-307d-48ec-853b-16d094aea603 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:23.779051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:24.516795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4768fc41-307d-48ec-853b-16d094aea603 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:24.526231 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4768fc41-307d-48ec-853b-16d094aea603 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1471 microversion: 2.1 time: 0.901829 Jul 20 04:20:24.539123 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1555/3156] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:23 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1471 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:25.235150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-9d296a87-9af5-40dd-b22a-70173844cc3c req-7d0d9a65-f918-4bb9-bd5c-c85576e4cebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c14806e2-040e-4e56-9e25-d417152338bf", "name": "network-vif-deleted", "tag": "0e58105c-bf30-4985-8639-301f20e00ee0"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:25.251822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9d296a87-9af5-40dd-b22a-70173844cc3c req-7d0d9a65-f918-4bb9-bd5c-c85576e4cebb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.275911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9d296a87-9af5-40dd-b22a-70173844cc3c req-7d0d9a65-f918-4bb9-bd5c-c85576e4cebb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.322064 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-9d296a87-9af5-40dd-b22a-70173844cc3c req-7d0d9a65-f918-4bb9-bd5c-c85576e4cebb service nova] Creating event network-vif-deleted:0e58105c-bf30-4985-8639-301f20e00ee0 for instance c14806e2-040e-4e56-9e25-d417152338bf on n-h1-760456-11 Jul 20 04:20:25.329487 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-9d296a87-9af5-40dd-b22a-70173844cc3c req-7d0d9a65-f918-4bb9-bd5c-c85576e4cebb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099539 Jul 20 04:20:25.334074 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1556/3157] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:25.485557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:25.486622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:25.487323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:25.488478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:25.489077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:25.511084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.511960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.513783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.515100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.542329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Getting quotas for project 57842d81149a414487d1918257a885d4. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:25.548055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.548773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:25.558606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Getting quotas for user 087fa50c9ef642489114276c50ece3f0 and project 57842d81149a414487d1918257a885d4. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:25.570071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.571691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.573737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.576347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.602773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:25.606414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:25.669789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.671094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.671997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lazy-loading 'fault' on Instance uuid c14806e2-040e-4e56-9e25-d417152338bf {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:25.739017 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d45002fb-83d1-4ac7-b33f-fde90ea48497 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.833140 Jul 20 04:20:25.744904 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1602/3158] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:20:25.756066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9af8b6c-005e-45ff-9992-9f07ef56104e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.757808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c9af8b6c-005e-45ff-9992-9f07ef56104e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:25.977356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c9af8b6c-005e-45ff-9992-9f07ef56104e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.985080 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c9af8b6c-005e-45ff-9992-9f07ef56104e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1217 microversion: 2.1 time: 0.238512 Jul 20 04:20:25.985659 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1603/3159] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:25 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1217 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:26.052569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43de2b946fd7474dbc2a48e5fcaa518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a9c17c56e94930a159f00d0c8e0e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:26.065004 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c7db930-2602-4f56-a80e-70f745b172ea tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 200 len: 1308 microversion: 2.1 time: 0.523482 Jul 20 04:20:26.067555 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1557/3160] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:25 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 1308 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:27.002960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b5962e9-bbe2-4bd1-8540-18601cd047ef tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.003580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6b5962e9-bbe2-4bd1-8540-18601cd047ef tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:27.019501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b5962e9-bbe2-4bd1-8540-18601cd047ef tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.019868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b5962e9-bbe2-4bd1-8540-18601cd047ef tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.021394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b5962e9-bbe2-4bd1-8540-18601cd047ef tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.022138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b5962e9-bbe2-4bd1-8540-18601cd047ef tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.081988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:27.084915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07d420fe-cbf2-493c-b271-e47ae7538eca tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.086116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-07d420fe-cbf2-493c-b271-e47ae7538eca tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: c14806e2-040e-4e56-9e25-d417152338bf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:27.112385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07d420fe-cbf2-493c-b271-e47ae7538eca tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.113968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07d420fe-cbf2-493c-b271-e47ae7538eca tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.115160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07d420fe-cbf2-493c-b271-e47ae7538eca tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.115850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07d420fe-cbf2-493c-b271-e47ae7538eca tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.143837 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-07d420fe-cbf2-493c-b271-e47ae7538eca tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] HTTP exception thrown: Instance c14806e2-040e-4e56-9e25-d417152338bf could not be found. Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07d420fe-cbf2-493c-b271-e47ae7538eca tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Request method failure captured: Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf HTTP/1.1 Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14HtSQT5wPrZ54jU89y35M3SaWJ12ev1S-fca2e2FgHLK6YMMnisaRhWVu66cTs64Yq14VlB3rjPOKFToQRJj2qhwWmClUmMWTSDJIsUxvIhI5v_YkAXwN9K62b23xpLUOiYIsuG5JW8YzT5XRHiqW6nzPZxagg8OHmlpeT4RI5PLt4 Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 65a9c17c56e94930a159f00d0c8e0e7f Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 65a9c17c56e94930a159f00d0c8e0e7f Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerDiskConfigTestJSON-1724860886-project Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 43de2b946fd7474dbc2a48e5fcaa518d Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerDiskConfigTestJSON-1724860886-project Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c14806e2-040e-4e56-9e25-d417152338bf could not be found. Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c14806e2-040e-4e56-9e25-d417152338bf'} Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c14806e2-040e-4e56-9e25-d417152338bf could not be found. Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c14806e2-040e-4e56-9e25-d417152338bf could not be found. Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.145985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.150014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.150014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.150014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.150014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:27.150014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:27.150014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c14806e2-040e-4e56-9e25-d417152338bf could not be found. Jul 20 04:20:27.150014 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.153125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07d420fe-cbf2-493c-b271-e47ae7538eca tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Returning 404 to user: Instance c14806e2-040e-4e56-9e25-d417152338bf could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:27.154273 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-07d420fe-cbf2-493c-b271-e47ae7538eca tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf" status: 404 len: 111 microversion: 2.1 time: 0.074180 Jul 20 04:20:27.156904 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1558/3161] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:27 2022] GET /compute/v2.1/servers/c14806e2-040e-4e56-9e25-d417152338bf => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:20:27.170598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bab38b62-e886-4f49-b657-0b204b107e84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.172109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bab38b62-e886-4f49-b657-0b204b107e84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:27.178880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab38b62-e886-4f49-b657-0b204b107e84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.179641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab38b62-e886-4f49-b657-0b204b107e84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.180707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab38b62-e886-4f49-b657-0b204b107e84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.181376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab38b62-e886-4f49-b657-0b204b107e84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.197707 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-bab38b62-e886-4f49-b657-0b204b107e84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] HTTP exception thrown: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bab38b62-e886-4f49-b657-0b204b107e84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Request method failure captured: Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 HTTP/1.1 Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14HtSQT5wPrZ54jU89y35M3SaWJ12ev1S-fca2e2FgHLK6YMMnisaRhWVu66cTs64Yq14VlB3rjPOKFToQRJj2qhwWmClUmMWTSDJIsUxvIhI5v_YkAXwN9K62b23xpLUOiYIsuG5JW8YzT5XRHiqW6nzPZxagg8OHmlpeT4RI5PLt4 Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 65a9c17c56e94930a159f00d0c8e0e7f Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 65a9c17c56e94930a159f00d0c8e0e7f Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerDiskConfigTestJSON-1724860886-project Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 43de2b946fd7474dbc2a48e5fcaa518d Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerDiskConfigTestJSON-1724860886-project Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'a5e32034-3c05-42c3-81e8-b65e3fa773e4'} Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:27.199679 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. Jul 20 04:20:27.205287 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.207739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bab38b62-e886-4f49-b657-0b204b107e84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Returning 404 to user: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:27.208856 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bab38b62-e886-4f49-b657-0b204b107e84 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 404 len: 111 microversion: 2.1 time: 0.047255 Jul 20 04:20:27.210116 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1559/3162] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:27 2022] DELETE /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:27.215518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6b5962e9-bbe2-4bd1-8540-18601cd047ef tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:27.230458 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6b5962e9-bbe2-4bd1-8540-18601cd047ef tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1213 microversion: 2.1 time: 0.230846 Jul 20 04:20:27.232567 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1604/3163] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:26 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1213 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:27.234222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f5365c6-e234-42dd-9abd-afa6f9a11bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.235215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8f5365c6-e234-42dd-9abd-afa6f9a11bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: a5e32034-3c05-42c3-81e8-b65e3fa773e4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:27.242433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f5365c6-e234-42dd-9abd-afa6f9a11bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.243453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f5365c6-e234-42dd-9abd-afa6f9a11bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.244619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f5365c6-e234-42dd-9abd-afa6f9a11bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.245564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f5365c6-e234-42dd-9abd-afa6f9a11bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.264059 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8f5365c6-e234-42dd-9abd-afa6f9a11bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] HTTP exception thrown: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f5365c6-e234-42dd-9abd-afa6f9a11bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Request method failure captured: Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 HTTP/1.1 Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14HtSQT5wPrZ54jU89y35M3SaWJ12ev1S-fca2e2FgHLK6YMMnisaRhWVu66cTs64Yq14VlB3rjPOKFToQRJj2qhwWmClUmMWTSDJIsUxvIhI5v_YkAXwN9K62b23xpLUOiYIsuG5JW8YzT5XRHiqW6nzPZxagg8OHmlpeT4RI5PLt4 Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 65a9c17c56e94930a159f00d0c8e0e7f Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 65a9c17c56e94930a159f00d0c8e0e7f Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerDiskConfigTestJSON-1724860886-project Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 43de2b946fd7474dbc2a48e5fcaa518d Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerDiskConfigTestJSON-1724860886-project Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'a5e32034-3c05-42c3-81e8-b65e3fa773e4'} Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.267591 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.271589 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.271589 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.271589 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.271589 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:27.271589 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:27.271589 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. Jul 20 04:20:27.271589 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.273604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f5365c6-e234-42dd-9abd-afa6f9a11bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Returning 404 to user: Instance a5e32034-3c05-42c3-81e8-b65e3fa773e4 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:27.274835 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8f5365c6-e234-42dd-9abd-afa6f9a11bac tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4" status: 404 len: 111 microversion: 2.1 time: 0.049479 Jul 20 04:20:27.275926 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1560/3164] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:27 2022] GET /compute/v2.1/servers/a5e32034-3c05-42c3-81e8-b65e3fa773e4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:27.284568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb96af08-2173-45eb-a592-c35841924097 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.285459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb96af08-2173-45eb-a592-c35841924097 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:27.292022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb96af08-2173-45eb-a592-c35841924097 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.293031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb96af08-2173-45eb-a592-c35841924097 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.294578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb96af08-2173-45eb-a592-c35841924097 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.295383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb96af08-2173-45eb-a592-c35841924097 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.347070 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-fb96af08-2173-45eb-a592-c35841924097 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] HTTP exception thrown: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb96af08-2173-45eb-a592-c35841924097 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Request method failure captured: Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 HTTP/1.1 Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14HtSQT5wPrZ54jU89y35M3SaWJ12ev1S-fca2e2FgHLK6YMMnisaRhWVu66cTs64Yq14VlB3rjPOKFToQRJj2qhwWmClUmMWTSDJIsUxvIhI5v_YkAXwN9K62b23xpLUOiYIsuG5JW8YzT5XRHiqW6nzPZxagg8OHmlpeT4RI5PLt4 Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 65a9c17c56e94930a159f00d0c8e0e7f Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 65a9c17c56e94930a159f00d0c8e0e7f Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerDiskConfigTestJSON-1724860886-project Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 43de2b946fd7474dbc2a48e5fcaa518d Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerDiskConfigTestJSON-1724860886-project Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '955c1609-40d3-47fd-9eac-8b879ecae2c8'} Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:27.351358 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. Jul 20 04:20:27.355251 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.357692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb96af08-2173-45eb-a592-c35841924097 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Returning 404 to user: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:27.361113 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb96af08-2173-45eb-a592-c35841924097 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "DELETE /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 404 len: 111 microversion: 2.1 time: 0.079401 Jul 20 04:20:27.363414 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1605/3165] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:27 2022] DELETE /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:27.372873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2dd6e218-cf15-4f6f-b6cb-d961f9838dd3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.375184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2dd6e218-cf15-4f6f-b6cb-d961f9838dd3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] [instance: 955c1609-40d3-47fd-9eac-8b879ecae2c8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:27.389091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd6e218-cf15-4f6f-b6cb-d961f9838dd3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.392219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd6e218-cf15-4f6f-b6cb-d961f9838dd3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.393289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd6e218-cf15-4f6f-b6cb-d961f9838dd3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.395497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd6e218-cf15-4f6f-b6cb-d961f9838dd3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.495918 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-2dd6e218-cf15-4f6f-b6cb-d961f9838dd3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] HTTP exception thrown: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2dd6e218-cf15-4f6f-b6cb-d961f9838dd3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Request method failure captured: Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 HTTP/1.1 Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14HtSQT5wPrZ54jU89y35M3SaWJ12ev1S-fca2e2FgHLK6YMMnisaRhWVu66cTs64Yq14VlB3rjPOKFToQRJj2qhwWmClUmMWTSDJIsUxvIhI5v_YkAXwN9K62b23xpLUOiYIsuG5JW8YzT5XRHiqW6nzPZxagg8OHmlpeT4RI5PLt4 Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 65a9c17c56e94930a159f00d0c8e0e7f Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_65a9c17c56e94930a159f00d0c8e0e7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 65a9c17c56e94930a159f00d0c8e0e7f Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1724860886 Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerDiskConfigTestJSON-1724860886-project Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 43de2b946fd7474dbc2a48e5fcaa518d Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerDiskConfigTestJSON-1724860886-project Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '955c1609-40d3-47fd-9eac-8b879ecae2c8'} Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:27.502915 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.509256 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:27.509256 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:27.509256 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:27.509256 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:27.509256 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:27.509256 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. Jul 20 04:20:27.509256 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:27.509256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2dd6e218-cf15-4f6f-b6cb-d961f9838dd3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] Returning 404 to user: Instance 955c1609-40d3-47fd-9eac-8b879ecae2c8 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:27.509256 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2dd6e218-cf15-4f6f-b6cb-d961f9838dd3 tempest-ServerDiskConfigTestJSON-1724860886 tempest-ServerDiskConfigTestJSON-1724860886-project] 10.222.0.59 "GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8" status: 404 len: 111 microversion: 2.1 time: 0.138157 Jul 20 04:20:27.509256 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1561/3166] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:27 2022] GET /compute/v2.1/servers/955c1609-40d3-47fd-9eac-8b879ecae2c8 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:28.256871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c824b2e9-f561-4a10-9a79-03e77fb472c6 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.257499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c824b2e9-f561-4a10-9a79-03e77fb472c6 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.283436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c824b2e9-f561-4a10-9a79-03e77fb472c6 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.284749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c824b2e9-f561-4a10-9a79-03e77fb472c6 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.285572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c824b2e9-f561-4a10-9a79-03e77fb472c6 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.286023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c824b2e9-f561-4a10-9a79-03e77fb472c6 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.485644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c824b2e9-f561-4a10-9a79-03e77fb472c6 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:28.498301 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c824b2e9-f561-4a10-9a79-03e77fb472c6 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1275 microversion: 2.1 time: 0.249798 Jul 20 04:20:28.502591 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1606/3167] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:28 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1275 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:29.523444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-de2f7296-d293-4ea6-99fb-2f390fe66f68 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:29.524027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-de2f7296-d293-4ea6-99fb-2f390fe66f68 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:29.542673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de2f7296-d293-4ea6-99fb-2f390fe66f68 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.543263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de2f7296-d293-4ea6-99fb-2f390fe66f68 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.546690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de2f7296-d293-4ea6-99fb-2f390fe66f68 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.547065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de2f7296-d293-4ea6-99fb-2f390fe66f68 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.974702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-de2f7296-d293-4ea6-99fb-2f390fe66f68 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:29.995776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-de2f7296-d293-4ea6-99fb-2f390fe66f68 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1275 microversion: 2.1 time: 0.481530 Jul 20 04:20:29.998096 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1562/3168] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:29 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1275 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:31.015947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5ba9db90-3711-44b7-afdb-77dd114f596e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:31.017369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5ba9db90-3711-44b7-afdb-77dd114f596e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:31.032861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ba9db90-3711-44b7-afdb-77dd114f596e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.034059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ba9db90-3711-44b7-afdb-77dd114f596e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.038339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ba9db90-3711-44b7-afdb-77dd114f596e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.039791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ba9db90-3711-44b7-afdb-77dd114f596e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.586324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5ba9db90-3711-44b7-afdb-77dd114f596e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:31.597812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5ba9db90-3711-44b7-afdb-77dd114f596e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1317 microversion: 2.1 time: 0.586205 Jul 20 04:20:31.598678 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1607/3169] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:31 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:32.621800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-026a3166-a813-44cb-ac7a-8e8beda4d24f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:32.623899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-026a3166-a813-44cb-ac7a-8e8beda4d24f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:32.695084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-026a3166-a813-44cb-ac7a-8e8beda4d24f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:32.701958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-026a3166-a813-44cb-ac7a-8e8beda4d24f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:32.707257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-026a3166-a813-44cb-ac7a-8e8beda4d24f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:32.707721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-026a3166-a813-44cb-ac7a-8e8beda4d24f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:33.192925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-27471988-2637-42a1-8b84-ccfe4766a798 req-c09b6287-204b-416f-9bd9-9dc9d98aa4fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a", "tag": "3640b21f-4237-4cf3-8d85-a3e8bf443916"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:33.214576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-27471988-2637-42a1-8b84-ccfe4766a798 req-c09b6287-204b-416f-9bd9-9dc9d98aa4fc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:33.220227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-27471988-2637-42a1-8b84-ccfe4766a798 req-c09b6287-204b-416f-9bd9-9dc9d98aa4fc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:33.256644 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-27471988-2637-42a1-8b84-ccfe4766a798 req-c09b6287-204b-416f-9bd9-9dc9d98aa4fc service nova] Creating event network-changed:3640b21f-4237-4cf3-8d85-a3e8bf443916 for instance 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a on n-h1-760456-11 Jul 20 04:20:33.263736 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-27471988-2637-42a1-8b84-ccfe4766a798 req-c09b6287-204b-416f-9bd9-9dc9d98aa4fc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074737 Jul 20 04:20:33.265324 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1608/3170] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:33.847844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-026a3166-a813-44cb-ac7a-8e8beda4d24f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:33.864246 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-026a3166-a813-44cb-ac7a-8e8beda4d24f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1317 microversion: 2.1 time: 1.252060 Jul 20 04:20:33.870633 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1563/3171] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:32 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1317 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:34.893896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6928580-17a3-48d7-b1e0-f4e9cb9eefac tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:34.895206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d6928580-17a3-48d7-b1e0-f4e9cb9eefac tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:34.907902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6928580-17a3-48d7-b1e0-f4e9cb9eefac tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:34.908366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6928580-17a3-48d7-b1e0-f4e9cb9eefac tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:34.909252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6928580-17a3-48d7-b1e0-f4e9cb9eefac tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:34.909598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6928580-17a3-48d7-b1e0-f4e9cb9eefac tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.261247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d6928580-17a3-48d7-b1e0-f4e9cb9eefac tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:35.270217 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d6928580-17a3-48d7-b1e0-f4e9cb9eefac tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1317 microversion: 2.1 time: 0.386416 Jul 20 04:20:35.275280 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1609/3172] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:34 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:36.295140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e3f7080-9cb4-4092-a0f6-535ed7fa76c3 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:36.299710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e3f7080-9cb4-4092-a0f6-535ed7fa76c3 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:36.327299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e3f7080-9cb4-4092-a0f6-535ed7fa76c3 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:36.335537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e3f7080-9cb4-4092-a0f6-535ed7fa76c3 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:36.338184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e3f7080-9cb4-4092-a0f6-535ed7fa76c3 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:36.341225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e3f7080-9cb4-4092-a0f6-535ed7fa76c3 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.037327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e3f7080-9cb4-4092-a0f6-535ed7fa76c3 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:37.053604 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e3f7080-9cb4-4092-a0f6-535ed7fa76c3 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1317 microversion: 2.1 time: 0.768934 Jul 20 04:20:37.054872 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1564/3173] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:36 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:37.590172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a8e74416-4a11-40f3-84ea-7ccce32584c5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:37.592606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:37.602470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:37.610115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8e74416-4a11-40f3-84ea-7ccce32584c5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.626679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8e74416-4a11-40f3-84ea-7ccce32584c5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.678586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a8e74416-4a11-40f3-84ea-7ccce32584c5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Going to try to stop instance {{(pid=119606) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:20:37.778244 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a8e74416-4a11-40f3-84ea-7ccce32584c5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/action" status: 202 len: 0 microversion: 2.1 time: 0.191979 Jul 20 04:20:37.779142 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1610/3174] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:37 2022] POST /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:37.791549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01227b69-830d-4cba-aa8b-27c1f778495e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:37.793364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-01227b69-830d-4cba-aa8b-27c1f778495e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:37.807897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01227b69-830d-4cba-aa8b-27c1f778495e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.809421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01227b69-830d-4cba-aa8b-27c1f778495e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.810722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01227b69-830d-4cba-aa8b-27c1f778495e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.811629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01227b69-830d-4cba-aa8b-27c1f778495e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.900249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a8e74416-4a11-40f3-84ea-7ccce32584c5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:37.901294 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a8e74416-4a11-40f3-84ea-7ccce32584c5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001548 Jul 20 04:20:37.901823 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1611/3175] 10.222.0.59 () {56 vars in 885 bytes} [Wed Jul 20 04:20:37 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 20 04:20:38.072204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-320cc65a-b131-4188-8ae2-7b38e603f2fa tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:38.073599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-320cc65a-b131-4188-8ae2-7b38e603f2fa tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:38.085054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-320cc65a-b131-4188-8ae2-7b38e603f2fa tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:38.087558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-320cc65a-b131-4188-8ae2-7b38e603f2fa tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:38.093658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-320cc65a-b131-4188-8ae2-7b38e603f2fa tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:38.094497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-320cc65a-b131-4188-8ae2-7b38e603f2fa tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:38.427155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-01227b69-830d-4cba-aa8b-27c1f778495e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:38.433756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:38.442711 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01227b69-830d-4cba-aa8b-27c1f778495e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.657380 Jul 20 04:20:38.454101 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1565/3176] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:37 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:39.204048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-320cc65a-b131-4188-8ae2-7b38e603f2fa tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:39.234544 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-320cc65a-b131-4188-8ae2-7b38e603f2fa tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1317 microversion: 2.1 time: 1.162806 Jul 20 04:20:39.235199 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1612/3177] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:38 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1317 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:39.460806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ec92bba-a80e-4663-97fd-e6e15249406e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:39.461779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ec92bba-a80e-4663-97fd-e6e15249406e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:39.481912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ec92bba-a80e-4663-97fd-e6e15249406e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.488263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ec92bba-a80e-4663-97fd-e6e15249406e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:39.489236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ec92bba-a80e-4663-97fd-e6e15249406e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.489761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ec92bba-a80e-4663-97fd-e6e15249406e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.251474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b021bbd-d1d0-4ab8-ae87-77184d21d748 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:40.252438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b021bbd-d1d0-4ab8-ae87-77184d21d748 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:40.273478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b021bbd-d1d0-4ab8-ae87-77184d21d748 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.279867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b021bbd-d1d0-4ab8-ae87-77184d21d748 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.280953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b021bbd-d1d0-4ab8-ae87-77184d21d748 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.281400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b021bbd-d1d0-4ab8-ae87-77184d21d748 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.345187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1ec92bba-a80e-4663-97fd-e6e15249406e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:40.359870 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ec92bba-a80e-4663-97fd-e6e15249406e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.902964 Jul 20 04:20:40.361047 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1566/3178] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:39 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:40.642353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b021bbd-d1d0-4ab8-ae87-77184d21d748 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:40.656339 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b021bbd-d1d0-4ab8-ae87-77184d21d748 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1317 microversion: 2.1 time: 0.405956 Jul 20 04:20:40.659292 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1613/3179] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:40 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:41.379952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3d4706c-3480-4894-aac4-9f6e6efe7fb7 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:41.380722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3d4706c-3480-4894-aac4-9f6e6efe7fb7 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:41.401115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3d4706c-3480-4894-aac4-9f6e6efe7fb7 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:41.407507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3d4706c-3480-4894-aac4-9f6e6efe7fb7 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:41.411384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3d4706c-3480-4894-aac4-9f6e6efe7fb7 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:41.412288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3d4706c-3480-4894-aac4-9f6e6efe7fb7 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:41.674989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6e6f3ec5-8c38-4345-8238-41bbb7c8741e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:41.675593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6e6f3ec5-8c38-4345-8238-41bbb7c8741e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:41.689055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e6f3ec5-8c38-4345-8238-41bbb7c8741e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:41.689834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e6f3ec5-8c38-4345-8238-41bbb7c8741e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:41.691313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e6f3ec5-8c38-4345-8238-41bbb7c8741e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:41.692047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e6f3ec5-8c38-4345-8238-41bbb7c8741e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:42.122416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6e6f3ec5-8c38-4345-8238-41bbb7c8741e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:42.137565 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6e6f3ec5-8c38-4345-8238-41bbb7c8741e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1317 microversion: 2.1 time: 0.467191 Jul 20 04:20:42.138159 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1614/3180] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:41 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:42.305119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c78db2e6-a6a4-4a42-8e5c-4edb5c6eca4e tempest-QuotasTestJSON-1038552334 tempest-QuotasTestJSON-1038552334-project] Calling method '.version_select at 0x7fb840f5e790>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:42.386817 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c78db2e6-a6a4-4a42-8e5c-4edb5c6eca4e tempest-QuotasTestJSON-1038552334 tempest-QuotasTestJSON-1038552334-project] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/d34db84067db4a94bda42d8849aca882/defaults" status: 200 len: 371 microversion: 2.1 time: 0.214115 Jul 20 04:20:42.387835 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1615/3181] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:20:42 2022] GET /compute/v2.1/os-quota-sets/d34db84067db4a94bda42d8849aca882/defaults => generated 371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:42.398617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8e77d53c-c67a-4d27-ad93-a8218cb01e9f tempest-QuotasTestJSON-1038552334 tempest-QuotasTestJSON-1038552334-project] Calling method '.version_select at 0x7fb840f6d9d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:42.421677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3d4706c-3480-4894-aac4-9f6e6efe7fb7 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:42.445151 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3d4706c-3480-4894-aac4-9f6e6efe7fb7 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 1.065164 Jul 20 04:20:42.445992 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1567/3182] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:41 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:42.530086 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8e77d53c-c67a-4d27-ad93-a8218cb01e9f tempest-QuotasTestJSON-1038552334 tempest-QuotasTestJSON-1038552334-project] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/d34db84067db4a94bda42d8849aca882" status: 200 len: 371 microversion: 2.1 time: 0.134878 Jul 20 04:20:42.543191 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1616/3183] 10.222.0.59 () {58 vars in 1241 bytes} [Wed Jul 20 04:20:42 2022] GET /compute/v2.1/os-quota-sets/d34db84067db4a94bda42d8849aca882 => generated 371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:42.550221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f23020f0-cefa-42ab-ad90-07a1534d2951 tempest-QuotasTestJSON-1038552334 tempest-QuotasTestJSON-1038552334-project] Calling method '.version_select at 0x7fb841d8e280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:42.693717 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f23020f0-cefa-42ab-ad90-07a1534d2951 tempest-QuotasTestJSON-1038552334 tempest-QuotasTestJSON-1038552334-project] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/d34db84067db4a94bda42d8849aca882/defaults" status: 200 len: 371 microversion: 2.1 time: 0.149315 Jul 20 04:20:42.694334 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1568/3184] 10.222.0.59 () {58 vars in 1268 bytes} [Wed Jul 20 04:20:42 2022] GET /compute/v2.1/os-quota-sets/d34db84067db4a94bda42d8849aca882/defaults => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:42.713792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-813908e4-e62f-407f-a349-6d3440859c38 tempest-QuotasTestJSON-1038552334 tempest-QuotasTestJSON-1038552334-project] Calling method '.version_select at 0x7fb840fff9d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:42.893976 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-813908e4-e62f-407f-a349-6d3440859c38 tempest-QuotasTestJSON-1038552334 tempest-QuotasTestJSON-1038552334-project] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/d34db84067db4a94bda42d8849aca882" status: 200 len: 371 microversion: 2.1 time: 0.190747 Jul 20 04:20:42.895247 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1617/3185] 10.222.0.59 () {58 vars in 1241 bytes} [Wed Jul 20 04:20:42 2022] GET /compute/v2.1/os-quota-sets/d34db84067db4a94bda42d8849aca882 => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:42.915118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ced74ce-fe0d-4e5b-a52c-795e05231522 tempest-QuotasTestJSON-1038552334 tempest-QuotasTestJSON-1038552334-project] Calling method '.version_select at 0x7fb8414dc280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:43.038621 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ced74ce-fe0d-4e5b-a52c-795e05231522 tempest-QuotasTestJSON-1038552334 tempest-QuotasTestJSON-1038552334-project] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/d34db84067db4a94bda42d8849aca882?user_id=33addb898c7d44bba25bd3cacf19967c" status: 200 len: 371 microversion: 2.1 time: 0.136535 Jul 20 04:20:43.040053 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1569/3186] 10.222.0.59 () {58 vars in 1322 bytes} [Wed Jul 20 04:20:42 2022] GET /compute/v2.1/os-quota-sets/d34db84067db4a94bda42d8849aca882?user_id=33addb898c7d44bba25bd3cacf19967c => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:43.155211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1408cc40-7778-4117-bcfc-1da967aae2ff tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:43.155976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1408cc40-7778-4117-bcfc-1da967aae2ff tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:43.164741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1408cc40-7778-4117-bcfc-1da967aae2ff tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.167513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1408cc40-7778-4117-bcfc-1da967aae2ff tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.170953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1408cc40-7778-4117-bcfc-1da967aae2ff tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.171511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1408cc40-7778-4117-bcfc-1da967aae2ff tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.285015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-9786afa8-1682-4f24-93c6-9d24fd00e606 req-636d372d-0d57-48f3-9180-6b3b6e8c544e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a", "name": "network-vif-plugged", "status": "completed", "tag": "3640b21f-4237-4cf3-8d85-a3e8bf443916"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:43.300439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9786afa8-1682-4f24-93c6-9d24fd00e606 req-636d372d-0d57-48f3-9180-6b3b6e8c544e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.300911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9786afa8-1682-4f24-93c6-9d24fd00e606 req-636d372d-0d57-48f3-9180-6b3b6e8c544e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.331515 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-9786afa8-1682-4f24-93c6-9d24fd00e606 req-636d372d-0d57-48f3-9180-6b3b6e8c544e service nova] Creating event network-vif-plugged:3640b21f-4237-4cf3-8d85-a3e8bf443916 for instance 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a on n-h1-760456-11 Jul 20 04:20:43.339074 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-9786afa8-1682-4f24-93c6-9d24fd00e606 req-636d372d-0d57-48f3-9180-6b3b6e8c544e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060265 Jul 20 04:20:43.342676 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1570/3187] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:43.465325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c8b4438-a7cb-45cb-b762-d83722417eee tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:43.466187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c8b4438-a7cb-45cb-b762-d83722417eee tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:43.486406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c8b4438-a7cb-45cb-b762-d83722417eee tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.486961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c8b4438-a7cb-45cb-b762-d83722417eee tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.492901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c8b4438-a7cb-45cb-b762-d83722417eee tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.493861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c8b4438-a7cb-45cb-b762-d83722417eee tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.546806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1408cc40-7778-4117-bcfc-1da967aae2ff tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:43.565284 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1408cc40-7778-4117-bcfc-1da967aae2ff tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1317 microversion: 2.1 time: 0.407910 Jul 20 04:20:43.568664 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1618/3188] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:43 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:44.164375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6c8b4438-a7cb-45cb-b762-d83722417eee tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:44.175243 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6c8b4438-a7cb-45cb-b762-d83722417eee tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.715885 Jul 20 04:20:44.186181 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1571/3189] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:43 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:44.589975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0860881b-f83e-4a37-893f-8025510c92ab tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:44.591332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0860881b-f83e-4a37-893f-8025510c92ab tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:44.647832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0860881b-f83e-4a37-893f-8025510c92ab tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:44.648540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0860881b-f83e-4a37-893f-8025510c92ab tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:44.651286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0860881b-f83e-4a37-893f-8025510c92ab tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:44.653627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0860881b-f83e-4a37-893f-8025510c92ab tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:45.206734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3539b904-c819-4140-bd39-6063edf37ae6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:45.208745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3539b904-c819-4140-bd39-6063edf37ae6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:45.230402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:45.235251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3539b904-c819-4140-bd39-6063edf37ae6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:45.237534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3539b904-c819-4140-bd39-6063edf37ae6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:45.241353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3539b904-c819-4140-bd39-6063edf37ae6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:45.242052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3539b904-c819-4140-bd39-6063edf37ae6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:45.879391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0860881b-f83e-4a37-893f-8025510c92ab tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:45.896853 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0860881b-f83e-4a37-893f-8025510c92ab tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1317 microversion: 2.1 time: 1.314149 Jul 20 04:20:45.901171 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1619/3190] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:44 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1317 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:46.466485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3539b904-c819-4140-bd39-6063edf37ae6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:46.485567 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3539b904-c819-4140-bd39-6063edf37ae6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 1.286199 Jul 20 04:20:46.486176 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1572/3191] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:45 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:46.917865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b5392b33-3e97-4f0e-b88e-5b7c64517d69 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:46.918515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b5392b33-3e97-4f0e-b88e-5b7c64517d69 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:46.927671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5392b33-3e97-4f0e-b88e-5b7c64517d69 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.932047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5392b33-3e97-4f0e-b88e-5b7c64517d69 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:46.941065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5392b33-3e97-4f0e-b88e-5b7c64517d69 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.941782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5392b33-3e97-4f0e-b88e-5b7c64517d69 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:47.275378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1590056947", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "7bbaa421-7466-416c-83a5-4f1686a26f31"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:47.311447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:47.439591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] validate_networks() for [('7bbaa421-7466-416c-83a5-4f1686a26f31', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:47.758683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b5392b33-3e97-4f0e-b88e-5b7c64517d69 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:47.769462 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b5392b33-3e97-4f0e-b88e-5b7c64517d69 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1506 microversion: 2.1 time: 0.855633 Jul 20 04:20:47.770060 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1573/3192] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:46 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1506 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:47.780217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d22acd7b-a6a3-4537-bdf3-d9bcaf5f3c1a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:47.780841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d22acd7b-a6a3-4537-bdf3-d9bcaf5f3c1a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:47.809029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22acd7b-a6a3-4537-bdf3-d9bcaf5f3c1a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:47.812376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22acd7b-a6a3-4537-bdf3-d9bcaf5f3c1a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:47.814459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22acd7b-a6a3-4537-bdf3-d9bcaf5f3c1a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:47.816317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d22acd7b-a6a3-4537-bdf3-d9bcaf5f3c1a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.657016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d22acd7b-a6a3-4537-bdf3-d9bcaf5f3c1a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:48.674081 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d22acd7b-a6a3-4537-bdf3-d9bcaf5f3c1a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.902828 Jul 20 04:20:48.674900 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1574/3193] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:47 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:48.688115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0119e27b-fabf-404b-832f-628f4104405f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:48.688624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0119e27b-fabf-404b-832f-628f4104405f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:48.697594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:48.698769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:48.699473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:48.699613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0119e27b-fabf-404b-832f-628f4104405f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.700027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0119e27b-fabf-404b-832f-628f4104405f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.700551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:48.700796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0119e27b-fabf-404b-832f-628f4104405f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.701767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0119e27b-fabf-404b-832f-628f4104405f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.702180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:48.717989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.718772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.720568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.721264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.752131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Getting quotas for project 3b4143a2971b4c41bfa5e239dd7e1708. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:48.759022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Getting quotas for user f4e63bfb5d954ec5b4cb7f4d89c0cfc0 and project 3b4143a2971b4c41bfa5e239dd7e1708. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:48.777986 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0119e27b-fabf-404b-832f-628f4104405f tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a/ips" status: 200 len: 109 microversion: 2.1 time: 0.101561 Jul 20 04:20:48.785854 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1575/3194] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a/ips => generated 109 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:48.815975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:48.831826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:48.894351 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-191933ed-ee00-4f8f-a936-2aa9066610d7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.042175 Jul 20 04:20:48.895776 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1620/3195] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:20:48.901632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e47ddb7-ea21-4370-b29f-b3b5d0b36ee2 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:48.902540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e47ddb7-ea21-4370-b29f-b3b5d0b36ee2 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:48.912671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e47ddb7-ea21-4370-b29f-b3b5d0b36ee2 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.913586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e47ddb7-ea21-4370-b29f-b3b5d0b36ee2 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.914828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e47ddb7-ea21-4370-b29f-b3b5d0b36ee2 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.917550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e47ddb7-ea21-4370-b29f-b3b5d0b36ee2 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.985820 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e47ddb7-ea21-4370-b29f-b3b5d0b36ee2 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a/ips" status: 200 len: 109 microversion: 2.1 time: 0.086506 Jul 20 04:20:48.987089 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1621/3196] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a/ips => generated 109 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:49.006537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a7838392-d1b6-4902-8a22-f2f53fda645a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.009160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a7838392-d1b6-4902-8a22-f2f53fda645a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.050520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-072e9df2-58bf-41fc-9e92-35a82d690e1e tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Action: 'create', calling method: .version_select at 0x7fb8414c2670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-748810692", "metadata": {"Type": "work"}}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-072e9df2-58bf-41fc-9e92-35a82d690e1e tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Request method failure captured: Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 121 Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Kg6osAK_bd0HdfwuaYfsuVdjpC9F-URWEPt0yY63pGRSCL05rM-pu8QsIBWX_m2W8kUG6TMJjA5fhJQVFrsJLJYyMPa_mwbkNKKKQZNje-BaAnrS7zFt4R0pyJhTwiPDF_mA6sTpSaFz9q3ZyBru5q4F7SjeFatsUDo3lGboaDI_8 Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 295a6324f8574022bc7c5eca192b8ab4 Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-748810692", "metadata": {"Type": "work"}}} Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-748810692', 'metadata': {'Type': 'work'}}}} Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:20:49.053916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-072e9df2-58bf-41fc-9e92-35a82d690e1e tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:49.059005 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-072e9df2-58bf-41fc-9e92-35a82d690e1e tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.274758 Jul 20 04:20:49.061346 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1576/3197] 10.222.0.59 () {60 vars in 1155 bytes} [Wed Jul 20 04:20:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:20:49.069498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-25172d7b-e4e3-4449-92fb-fab17efdb7f9 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.070027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-25172d7b-e4e3-4449-92fb-fab17efdb7f9 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.088419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25172d7b-e4e3-4449-92fb-fab17efdb7f9 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.088888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25172d7b-e4e3-4449-92fb-fab17efdb7f9 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.089689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25172d7b-e4e3-4449-92fb-fab17efdb7f9 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.090140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25172d7b-e4e3-4449-92fb-fab17efdb7f9 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.146783 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-25172d7b-e4e3-4449-92fb-fab17efdb7f9 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a/ips/tempest-ServerAddressesTestJSON-1291914563-network" status: 200 len: 94 microversion: 2.1 time: 0.084099 Jul 20 04:20:49.153059 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1577/3198] 10.222.0.59 () {58 vars in 1400 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a/ips/tempest-ServerAddressesTestJSON-1291914563-network => generated 94 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:20:49.160750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f92a4ad-6d23-4795-98b9-1b4310c859fe tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Action: 'create', calling method: .version_select at 0x7fb8414c2310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1148100049", "metadata": {"Type": "work"}}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f92a4ad-6d23-4795-98b9-1b4310c859fe tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Request method failure captured: Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 120 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Kg6osAK_bd0HdfwuaYfsuVdjpC9F-URWEPt0yY63pGRSCL05rM-pu8QsIBWX_m2W8kUG6TMJjA5fhJQVFrsJLJYyMPa_mwbkNKKKQZNje-BaAnrS7zFt4R0pyJhTwiPDF_mA6sTpSaFz9q3ZyBru5q4F7SjeFatsUDo3lGboaDI_8 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 295a6324f8574022bc7c5eca192b8ab4 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1148100049", "metadata": {"Type": "work"}}} Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1148100049', 'metadata': {'Type': 'work'}}}} Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi '0' Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:20:49.165259 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:20:49.171130 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.173509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f92a4ad-6d23-4795-98b9-1b4310c859fe tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:49.174584 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f92a4ad-6d23-4795-98b9-1b4310c859fe tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020210 Jul 20 04:20:49.175335 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1578/3199] 10.222.0.59 () {60 vars in 1155 bytes} [Wed Jul 20 04:20:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:20:49.187561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6029fb12-cbf0-47d2-b6d9-eb74ff72ae30 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.188369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6029fb12-cbf0-47d2-b6d9-eb74ff72ae30 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.196346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6029fb12-cbf0-47d2-b6d9-eb74ff72ae30 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.197001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6029fb12-cbf0-47d2-b6d9-eb74ff72ae30 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.197448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a7838392-d1b6-4902-8a22-f2f53fda645a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:49.199212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6029fb12-cbf0-47d2-b6d9-eb74ff72ae30 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.199854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6029fb12-cbf0-47d2-b6d9-eb74ff72ae30 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.207639 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a7838392-d1b6-4902-8a22-f2f53fda645a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1224 microversion: 2.1 time: 0.213266 Jul 20 04:20:49.208246 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1622/3200] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1224 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:49.227164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f87216c9-6af4-4e3f-9cd7-e9e4a89e359c tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Action: 'create', calling method: .version_select at 0x7fb841032e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-830697195", "metadata": {"Type": "work"}}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f87216c9-6af4-4e3f-9cd7-e9e4a89e359c tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Request method failure captured: Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 118 Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Kg6osAK_bd0HdfwuaYfsuVdjpC9F-URWEPt0yY63pGRSCL05rM-pu8QsIBWX_m2W8kUG6TMJjA5fhJQVFrsJLJYyMPa_mwbkNKKKQZNje-BaAnrS7zFt4R0pyJhTwiPDF_mA6sTpSaFz9q3ZyBru5q4F7SjeFatsUDo3lGboaDI_8 Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 295a6324f8574022bc7c5eca192b8ab4 Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-830697195", "metadata": {"Type": "work"}}} Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-830697195', 'metadata': {'Type': 'work'}}}} Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi '' Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:20:49.243908 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.248347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f87216c9-6af4-4e3f-9cd7-e9e4a89e359c tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:49.251662 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f87216c9-6af4-4e3f-9cd7-e9e4a89e359c tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035123 Jul 20 04:20:49.254625 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1623/3201] 10.222.0.59 () {60 vars in 1155 bytes} [Wed Jul 20 04:20:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:20:49.266890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6029fb12-cbf0-47d2-b6d9-eb74ff72ae30 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:49.272564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4e05f6c8-1459-4ef4-b01d-2ed2efe7541e tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Calling method '.version_select at 0x7fb840f58f70>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.380423 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-4e05f6c8-1459-4ef4-b01d-2ed2efe7541e tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] HTTP exception thrown: Volume tempest-invalid-1767646550 could not be found. Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4e05f6c8-1459-4ef4-b01d-2ed2efe7541e tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Request method failure captured: Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1767646550 HTTP/1.1 Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Kg6osAK_bd0HdfwuaYfsuVdjpC9F-URWEPt0yY63pGRSCL05rM-pu8QsIBWX_m2W8kUG6TMJjA5fhJQVFrsJLJYyMPa_mwbkNKKKQZNje-BaAnrS7zFt4R0pyJhTwiPDF_mA6sTpSaFz9q3ZyBru5q4F7SjeFatsUDo3lGboaDI_8 Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 295a6324f8574022bc7c5eca192b8ab4 Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: exception: Volume tempest-invalid-1767646550 could not be found. Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'tempest-invalid-1767646550'} Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1767646550 could not be found. (HTTP 404) (Request-ID: req-dc2874ef-d5d7-4097-b3af-23b2da180670) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:20:49.383257 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1767646550 could not be found. Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1767646550 could not be found. Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1767646550 could not be found. Jul 20 04:20:49.387661 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.396113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4e05f6c8-1459-4ef4-b01d-2ed2efe7541e tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Returning 404 to user: Volume tempest-invalid-1767646550 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:49.397410 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4e05f6c8-1459-4ef4-b01d-2ed2efe7541e tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1767646550" status: 404 len: 99 microversion: 2.1 time: 0.136120 Jul 20 04:20:49.403489 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1624/3202] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 04:20:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1767646550 => generated 99 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:20:49.414205 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5015faa6-d533-4e90-ae34-bb5fb81fbb58 tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007868 Jul 20 04:20:49.422688 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1625/3203] 10.222.0.59 () {58 vars in 1139 bytes} [Wed Jul 20 04:20:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:20:49.435131 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6ee5747c-f6eb-4fc2-afcf-029bce354581 tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007746 Jul 20 04:20:49.438057 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1626/3204] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:20:49.456642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-050c10d5-a8e5-47f4-b330-9cef984119ed tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Calling method '.version_select at 0x7fb841241670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.460757 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6029fb12-cbf0-47d2-b6d9-eb74ff72ae30 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 204 len: 0 microversion: 2.1 time: 0.278583 Jul 20 04:20:49.464198 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1579/3205] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:49 2022] DELETE /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:49.485326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6a8b3311-48c5-4b7d-8486-96c9ae8a1091 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.487794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6a8b3311-48c5-4b7d-8486-96c9ae8a1091 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.505069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a8b3311-48c5-4b7d-8486-96c9ae8a1091 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.506245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a8b3311-48c5-4b7d-8486-96c9ae8a1091 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.508385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a8b3311-48c5-4b7d-8486-96c9ae8a1091 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.511185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a8b3311-48c5-4b7d-8486-96c9ae8a1091 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.541569 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-050c10d5-a8e5-47f4-b330-9cef984119ed tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] HTTP exception thrown: Volume 26c8a437-1893-4b09-a186-bff513ac5890 could not be found. Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-050c10d5-a8e5-47f4-b330-9cef984119ed tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Request method failure captured: Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-volumes/26c8a437-1893-4b09-a186-bff513ac5890 HTTP/1.1 Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Kg6osAK_bd0HdfwuaYfsuVdjpC9F-URWEPt0yY63pGRSCL05rM-pu8QsIBWX_m2W8kUG6TMJjA5fhJQVFrsJLJYyMPa_mwbkNKKKQZNje-BaAnrS7zFt4R0pyJhTwiPDF_mA6sTpSaFz9q3ZyBru5q4F7SjeFatsUDo3lGboaDI_8 Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 295a6324f8574022bc7c5eca192b8ab4 Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: exception: Volume 26c8a437-1893-4b09-a186-bff513ac5890 could not be found. Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '26c8a437-1893-4b09-a186-bff513ac5890'} Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 26c8a437-1893-4b09-a186-bff513ac5890 could not be found. (HTTP 404) (Request-ID: req-5a7431f4-a373-4dfa-b415-b08c1ff2dfd2) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:20:49.545609 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 26c8a437-1893-4b09-a186-bff513ac5890 could not be found. Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 26c8a437-1893-4b09-a186-bff513ac5890 could not be found. Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 26c8a437-1893-4b09-a186-bff513ac5890 could not be found. Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-050c10d5-a8e5-47f4-b330-9cef984119ed tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Returning 404 to user: Volume 26c8a437-1893-4b09-a186-bff513ac5890 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-050c10d5-a8e5-47f4-b330-9cef984119ed tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/26c8a437-1893-4b09-a186-bff513ac5890" status: 404 len: 109 microversion: 2.1 time: 0.100625 Jul 20 04:20:49.549493 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1627/3206] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:20:49 2022] DELETE /compute/v2.1/os-volumes/26c8a437-1893-4b09-a186-bff513ac5890 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:49.561665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-76776104-4568-4fdb-b04f-9be866f813c0 tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Calling method '.version_select at 0x7fb8410521f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.642236 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-76776104-4568-4fdb-b04f-9be866f813c0 tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] HTTP exception thrown: Volume 8487827a-410b-4a7d-a0a5-27bc9f793556 could not be found. Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-76776104-4568-4fdb-b04f-9be866f813c0 tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Request method failure captured: Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-volumes/8487827a-410b-4a7d-a0a5-27bc9f793556 HTTP/1.1 Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Kg6osAK_bd0HdfwuaYfsuVdjpC9F-URWEPt0yY63pGRSCL05rM-pu8QsIBWX_m2W8kUG6TMJjA5fhJQVFrsJLJYyMPa_mwbkNKKKQZNje-BaAnrS7zFt4R0pyJhTwiPDF_mA6sTpSaFz9q3ZyBru5q4F7SjeFatsUDo3lGboaDI_8 Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bad26728d3094bcab23bedb1a82fecbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: bad26728d3094bcab23bedb1a82fecbd Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-VolumesNegativeTest-937371539 Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 295a6324f8574022bc7c5eca192b8ab4 Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-VolumesNegativeTest-937371539-project Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: exception: Volume 8487827a-410b-4a7d-a0a5-27bc9f793556 could not be found. Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '8487827a-410b-4a7d-a0a5-27bc9f793556'} Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8487827a-410b-4a7d-a0a5-27bc9f793556 could not be found. (HTTP 404) (Request-ID: req-92ff8a4b-38a8-4cad-9ed3-aa772d398390) Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:20:49.647172 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8487827a-410b-4a7d-a0a5-27bc9f793556 could not be found. Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8487827a-410b-4a7d-a0a5-27bc9f793556 could not be found. Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8487827a-410b-4a7d-a0a5-27bc9f793556 could not be found. Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-76776104-4568-4fdb-b04f-9be866f813c0 tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] Returning 404 to user: Volume 8487827a-410b-4a7d-a0a5-27bc9f793556 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:49.652641 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-76776104-4568-4fdb-b04f-9be866f813c0 tempest-VolumesNegativeTest-937371539 tempest-VolumesNegativeTest-937371539-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8487827a-410b-4a7d-a0a5-27bc9f793556" status: 404 len: 109 microversion: 2.1 time: 0.100031 Jul 20 04:20:49.660429 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1628/3207] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/os-volumes/8487827a-410b-4a7d-a0a5-27bc9f793556 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:49.692439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d7a804bf-79c2-438b-9b7c-77503235709e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.693169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d7a804bf-79c2-438b-9b7c-77503235709e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.720205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7a804bf-79c2-438b-9b7c-77503235709e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.720775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7a804bf-79c2-438b-9b7c-77503235709e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.721673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7a804bf-79c2-438b-9b7c-77503235709e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.726094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7a804bf-79c2-438b-9b7c-77503235709e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.176433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d7a804bf-79c2-438b-9b7c-77503235709e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.185360 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d7a804bf-79c2-438b-9b7c-77503235709e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.497100 Jul 20 04:20:50.189908 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1629/3208] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:50.226780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b1ee59d3-c1e9-4d2b-b3cb-df4b395c8db6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:50.228435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b1ee59d3-c1e9-4d2b-b3cb-df4b395c8db6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:50.257937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1ee59d3-c1e9-4d2b-b3cb-df4b395c8db6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:50.258341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1ee59d3-c1e9-4d2b-b3cb-df4b395c8db6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.261543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1ee59d3-c1e9-4d2b-b3cb-df4b395c8db6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:50.266242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1ee59d3-c1e9-4d2b-b3cb-df4b395c8db6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.422334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6a8b3311-48c5-4b7d-8486-96c9ae8a1091 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.436426 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6a8b3311-48c5-4b7d-8486-96c9ae8a1091 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1512 microversion: 2.1 time: 0.963679 Jul 20 04:20:50.437877 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1580/3209] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1512 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:50.511096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b1ee59d3-c1e9-4d2b-b3cb-df4b395c8db6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.524492 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b1ee59d3-c1e9-4d2b-b3cb-df4b395c8db6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1228 microversion: 2.1 time: 0.301369 Jul 20 04:20:50.527972 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1630/3210] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:50 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1228 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:51.206218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b842ed78-4d1c-4e21-8da5-ec63727cd739 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.206869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b842ed78-4d1c-4e21-8da5-ec63727cd739 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:51.224071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b842ed78-4d1c-4e21-8da5-ec63727cd739 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.227933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b842ed78-4d1c-4e21-8da5-ec63727cd739 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.228785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b842ed78-4d1c-4e21-8da5-ec63727cd739 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.238148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b842ed78-4d1c-4e21-8da5-ec63727cd739 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.456817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-98f939a9-91e4-4cea-9c38-29f9bc10993e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.459376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-98f939a9-91e4-4cea-9c38-29f9bc10993e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:51.479977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98f939a9-91e4-4cea-9c38-29f9bc10993e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.480438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98f939a9-91e4-4cea-9c38-29f9bc10993e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.481593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98f939a9-91e4-4cea-9c38-29f9bc10993e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.481870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98f939a9-91e4-4cea-9c38-29f9bc10993e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.821244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b842ed78-4d1c-4e21-8da5-ec63727cd739 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:51.841323 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b842ed78-4d1c-4e21-8da5-ec63727cd739 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.639281 Jul 20 04:20:51.842379 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1581/3211] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:51 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:51.865747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-06af1185-97e4-40a6-8bc9-9f35e2d7ee2a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.866447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-06af1185-97e4-40a6-8bc9-9f35e2d7ee2a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:51.906943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06af1185-97e4-40a6-8bc9-9f35e2d7ee2a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.907458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06af1185-97e4-40a6-8bc9-9f35e2d7ee2a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.908345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06af1185-97e4-40a6-8bc9-9f35e2d7ee2a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.908919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06af1185-97e4-40a6-8bc9-9f35e2d7ee2a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.168097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-06af1185-97e4-40a6-8bc9-9f35e2d7ee2a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:52.177383 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-06af1185-97e4-40a6-8bc9-9f35e2d7ee2a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1282 microversion: 2.1 time: 0.324075 Jul 20 04:20:52.182985 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1582/3212] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:51 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1282 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:52.861897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ae3910c3-0742-49bb-b1c4-999cb86598b8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:52.863253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ae3910c3-0742-49bb-b1c4-999cb86598b8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:52.882355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae3910c3-0742-49bb-b1c4-999cb86598b8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.883273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae3910c3-0742-49bb-b1c4-999cb86598b8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.885352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae3910c3-0742-49bb-b1c4-999cb86598b8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.890860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae3910c3-0742-49bb-b1c4-999cb86598b8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.020380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:53.323413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ae3910c3-0742-49bb-b1c4-999cb86598b8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:53.340823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ae3910c3-0742-49bb-b1c4-999cb86598b8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.482379 Jul 20 04:20:53.342163 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1583/3213] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:52 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:53.358732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75259e8b-f7a8-457f-949e-f2a0b0f9f7a3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:53.381185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-75259e8b-f7a8-457f-949e-f2a0b0f9f7a3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:53.403206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75259e8b-f7a8-457f-949e-f2a0b0f9f7a3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.409441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75259e8b-f7a8-457f-949e-f2a0b0f9f7a3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.412283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75259e8b-f7a8-457f-949e-f2a0b0f9f7a3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.412907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75259e8b-f7a8-457f-949e-f2a0b0f9f7a3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.596228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-98f939a9-91e4-4cea-9c38-29f9bc10993e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087fa50c9ef642489114276c50ece3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57842d81149a414487d1918257a885d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:53.605595 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-98f939a9-91e4-4cea-9c38-29f9bc10993e tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 200 len: 1512 microversion: 2.1 time: 2.155134 Jul 20 04:20:53.606173 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1631/3214] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:51 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 1512 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:53.761369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-75259e8b-f7a8-457f-949e-f2a0b0f9f7a3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:53.777546 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75259e8b-f7a8-457f-949e-f2a0b0f9f7a3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1324 microversion: 2.1 time: 0.433862 Jul 20 04:20:53.786614 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1584/3215] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:53 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:53.855248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-09d695f2-8237-4848-b028-68ad53bc8bbb req-48c8dbe3-dc91-40f7-b5bb-a4fc17c2b60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a", "name": "network-vif-deleted", "tag": "3640b21f-4237-4cf3-8d85-a3e8bf443916"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:53.868189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-09d695f2-8237-4848-b028-68ad53bc8bbb req-48c8dbe3-dc91-40f7-b5bb-a4fc17c2b60e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.868852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-09d695f2-8237-4848-b028-68ad53bc8bbb req-48c8dbe3-dc91-40f7-b5bb-a4fc17c2b60e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.937863 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-09d695f2-8237-4848-b028-68ad53bc8bbb req-48c8dbe3-dc91-40f7-b5bb-a4fc17c2b60e service nova] Creating event network-vif-deleted:3640b21f-4237-4cf3-8d85-a3e8bf443916 for instance 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a on n-h1-760456-11 Jul 20 04:20:53.983053 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-09d695f2-8237-4848-b028-68ad53bc8bbb req-48c8dbe3-dc91-40f7-b5bb-a4fc17c2b60e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130484 Jul 20 04:20:53.984362 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1632/3216] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:54.360207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36376aeb-2741-4b5e-80c8-7ed0d3527313 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:54.362085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-36376aeb-2741-4b5e-80c8-7ed0d3527313 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:54.383043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36376aeb-2741-4b5e-80c8-7ed0d3527313 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.384384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36376aeb-2741-4b5e-80c8-7ed0d3527313 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.389619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36376aeb-2741-4b5e-80c8-7ed0d3527313 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.396950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36376aeb-2741-4b5e-80c8-7ed0d3527313 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.623516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce3b6361-ef54-4cfb-91ea-99daa9cb1569 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:54.627552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce3b6361-ef54-4cfb-91ea-99daa9cb1569 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] [instance: 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:54.644872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce3b6361-ef54-4cfb-91ea-99daa9cb1569 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.646070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce3b6361-ef54-4cfb-91ea-99daa9cb1569 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.652330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce3b6361-ef54-4cfb-91ea-99daa9cb1569 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.653132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce3b6361-ef54-4cfb-91ea-99daa9cb1569 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.675034 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-ce3b6361-ef54-4cfb-91ea-99daa9cb1569 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] HTTP exception thrown: Instance 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a could not be found. Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce3b6361-ef54-4cfb-91ea-99daa9cb1569 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Request method failure captured: Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a HTTP/1.1 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14KGEKviikMyqpCeEcsDie0-WKdIVGu4Vl-XsVqwUvbLekF-GqQtYsCpPKDgoEa74omr5KDGToXvMQhM_Vl1zgw7SMm1ooscVtIYoiojSTixHfTeiAPrIuIT-6xti0ojTu6ufo0o5SsHnVdpi2Nxr-yyXElSyiSb1eaebhpC7jSArj8 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 57842d81149a414487d1918257a885d4 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerAddressesTestJSON-386001707 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/57842d81149a414487d1918257a885d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/57842d81149a414487d1918257a885d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/57842d81149a414487d1918257a885d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_57842d81149a414487d1918257a885d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerAddressesTestJSON-386001707 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 57842d81149a414487d1918257a885d4 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerAddressesTestJSON-386001707 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerAddressesTestJSON-386001707-project Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 087fa50c9ef642489114276c50ece3f0 Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerAddressesTestJSON-386001707-project Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a could not be found. Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a'} Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a could not be found. Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a could not be found. Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:54.676923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:54.680932 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:54.680932 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:54.680932 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:54.680932 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:54.680932 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:54.680932 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a could not be found. Jul 20 04:20:54.680932 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:20:54.680932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce3b6361-ef54-4cfb-91ea-99daa9cb1569 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] Returning 404 to user: Instance 5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:54.680932 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce3b6361-ef54-4cfb-91ea-99daa9cb1569 tempest-ServerAddressesTestJSON-386001707 tempest-ServerAddressesTestJSON-386001707-project] 10.222.0.59 "GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a" status: 404 len: 111 microversion: 2.1 time: 0.059817 Jul 20 04:20:54.680932 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1633/3217] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:54 2022] GET /compute/v2.1/servers/5de4aeac-5f80-4dc5-b0ea-387d4ae02f9a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:54.797035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-101a1aae-9baa-4f7b-8e90-bd5b5e70d165 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:54.797659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-101a1aae-9baa-4f7b-8e90-bd5b5e70d165 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:54.807375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-101a1aae-9baa-4f7b-8e90-bd5b5e70d165 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.811094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-101a1aae-9baa-4f7b-8e90-bd5b5e70d165 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.813686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-101a1aae-9baa-4f7b-8e90-bd5b5e70d165 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.817869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-101a1aae-9baa-4f7b-8e90-bd5b5e70d165 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.016769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-36376aeb-2741-4b5e-80c8-7ed0d3527313 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:55.032386 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-36376aeb-2741-4b5e-80c8-7ed0d3527313 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.677354 Jul 20 04:20:55.033600 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1585/3218] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:54 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:55.728209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-101a1aae-9baa-4f7b-8e90-bd5b5e70d165 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:55.743491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:55.756262 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-101a1aae-9baa-4f7b-8e90-bd5b5e70d165 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1324 microversion: 2.1 time: 0.962854 Jul 20 04:20:55.759307 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1634/3219] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:54 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1324 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:56.064682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f05df50-35b3-4429-8688-c0d4a9686614 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:56.066109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f05df50-35b3-4429-8688-c0d4a9686614 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:56.078496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f05df50-35b3-4429-8688-c0d4a9686614 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.079774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f05df50-35b3-4429-8688-c0d4a9686614 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.081555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f05df50-35b3-4429-8688-c0d4a9686614 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.082976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f05df50-35b3-4429-8688-c0d4a9686614 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.088485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:56.777579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ab2e0b9-c8aa-423c-993c-a57c3c49d87e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:56.778201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2ab2e0b9-c8aa-423c-993c-a57c3c49d87e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:56.796014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ab2e0b9-c8aa-423c-993c-a57c3c49d87e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.796736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ab2e0b9-c8aa-423c-993c-a57c3c49d87e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.797845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ab2e0b9-c8aa-423c-993c-a57c3c49d87e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.798489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ab2e0b9-c8aa-423c-993c-a57c3c49d87e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.135700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2ab2e0b9-c8aa-423c-993c-a57c3c49d87e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.150348 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ab2e0b9-c8aa-423c-993c-a57c3c49d87e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1324 microversion: 2.1 time: 0.376309 Jul 20 04:20:57.151898 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1635/3220] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:56 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:57.412019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f05df50-35b3-4429-8688-c0d4a9686614 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.441487 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f05df50-35b3-4429-8688-c0d4a9686614 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 1.386552 Jul 20 04:20:57.444365 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1586/3221] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:56 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:57.509749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e30a4eec-20de-4eb0-a9f8-0e269ae05b7e req-4f40d9c5-a4ed-4fd1-a7ec-3f6a1e6434b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40778e9-80ef-4eab-9be6-5278135b18b3", "tag": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:57.574669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e30a4eec-20de-4eb0-a9f8-0e269ae05b7e req-4f40d9c5-a4ed-4fd1-a7ec-3f6a1e6434b2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.577494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e30a4eec-20de-4eb0-a9f8-0e269ae05b7e req-4f40d9c5-a4ed-4fd1-a7ec-3f6a1e6434b2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.605431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e30a4eec-20de-4eb0-a9f8-0e269ae05b7e req-4f40d9c5-a4ed-4fd1-a7ec-3f6a1e6434b2 service nova] Creating event network-changed:a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf for instance f40778e9-80ef-4eab-9be6-5278135b18b3 on n-h2-760456-11 Jul 20 04:20:57.616002 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e30a4eec-20de-4eb0-a9f8-0e269ae05b7e req-4f40d9c5-a4ed-4fd1-a7ec-3f6a1e6434b2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110945 Jul 20 04:20:57.617074 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1636/3222] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:58.168136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-971029d2-0042-45f9-9957-d54d416ecfe2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.169031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-971029d2-0042-45f9-9957-d54d416ecfe2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:58.188343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-971029d2-0042-45f9-9957-d54d416ecfe2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.188814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-971029d2-0042-45f9-9957-d54d416ecfe2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.189618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-971029d2-0042-45f9-9957-d54d416ecfe2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.198843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-971029d2-0042-45f9-9957-d54d416ecfe2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.461508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-882ca7a5-3f7a-4356-bb57-ac9106f5a1d0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.463214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-882ca7a5-3f7a-4356-bb57-ac9106f5a1d0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:58.487045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-882ca7a5-3f7a-4356-bb57-ac9106f5a1d0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.490984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-882ca7a5-3f7a-4356-bb57-ac9106f5a1d0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.491835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-882ca7a5-3f7a-4356-bb57-ac9106f5a1d0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.492289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-882ca7a5-3f7a-4356-bb57-ac9106f5a1d0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.737005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:59.042337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-882ca7a5-3f7a-4356-bb57-ac9106f5a1d0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:59.063282 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-882ca7a5-3f7a-4356-bb57-ac9106f5a1d0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.605677 Jul 20 04:20:59.064716 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1637/3223] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:58 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:59.239702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-971029d2-0042-45f9-9957-d54d416ecfe2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:59.283008 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-971029d2-0042-45f9-9957-d54d416ecfe2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1324 microversion: 2.1 time: 1.119173 Jul 20 04:20:59.288822 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1587/3224] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:58 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1324 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:00.082728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a2876dc-cfaa-47cd-b894-0a441ca4272c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:00.083872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6a2876dc-cfaa-47cd-b894-0a441ca4272c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:00.117188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:00.127297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a2876dc-cfaa-47cd-b894-0a441ca4272c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.147983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a2876dc-cfaa-47cd-b894-0a441ca4272c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.151984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a2876dc-cfaa-47cd-b894-0a441ca4272c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.153162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a2876dc-cfaa-47cd-b894-0a441ca4272c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.671210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6a2876dc-cfaa-47cd-b894-0a441ca4272c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:00.688833 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6a2876dc-cfaa-47cd-b894-0a441ca4272c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.611929 Jul 20 04:21:00.709660 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1638/3225] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:00 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:00.738488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-98997d80-8ecb-4bc4-ba95-32a389b5fcc2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:00.740420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-98997d80-8ecb-4bc4-ba95-32a389b5fcc2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:00.781716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98997d80-8ecb-4bc4-ba95-32a389b5fcc2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.782503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98997d80-8ecb-4bc4-ba95-32a389b5fcc2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.785332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98997d80-8ecb-4bc4-ba95-32a389b5fcc2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.790829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98997d80-8ecb-4bc4-ba95-32a389b5fcc2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.821768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-280674219", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:00.924951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:01.636779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-98997d80-8ecb-4bc4-ba95-32a389b5fcc2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.651537 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-98997d80-8ecb-4bc4-ba95-32a389b5fcc2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1324 microversion: 2.1 time: 0.935676 Jul 20 04:21:01.652877 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1639/3226] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:00 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1324 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:01.728275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-41b969ff-30ff-4184-8b27-a6df82c49f89 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:01.729935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-41b969ff-30ff-4184-8b27-a6df82c49f89 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:01.745593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41b969ff-30ff-4184-8b27-a6df82c49f89 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.746103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41b969ff-30ff-4184-8b27-a6df82c49f89 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.749811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41b969ff-30ff-4184-8b27-a6df82c49f89 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.752771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41b969ff-30ff-4184-8b27-a6df82c49f89 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.456133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-41b969ff-30ff-4184-8b27-a6df82c49f89 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:02.467489 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-41b969ff-30ff-4184-8b27-a6df82c49f89 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1724 microversion: 2.1 time: 0.744256 Jul 20 04:21:02.474604 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1640/3227] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:01 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1724 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:02.670434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f6f6b962-df28-4531-903a-b0274a40287a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:02.671513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f6f6b962-df28-4531-903a-b0274a40287a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:02.686200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6f6b962-df28-4531-903a-b0274a40287a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.686708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6f6b962-df28-4531-903a-b0274a40287a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.687540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6f6b962-df28-4531-903a-b0274a40287a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.688144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6f6b962-df28-4531-903a-b0274a40287a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.109670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f6f6b962-df28-4531-903a-b0274a40287a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:03.150062 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f6f6b962-df28-4531-903a-b0274a40287a tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1324 microversion: 2.1 time: 0.481369 Jul 20 04:21:03.167951 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1641/3228] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:02 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:03.485993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97c724bc-8d5e-4e56-8eba-4002cc45e065 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:03.487233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97c724bc-8d5e-4e56-8eba-4002cc45e065 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:03.505929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97c724bc-8d5e-4e56-8eba-4002cc45e065 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.506468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97c724bc-8d5e-4e56-8eba-4002cc45e065 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.512560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97c724bc-8d5e-4e56-8eba-4002cc45e065 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.516627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97c724bc-8d5e-4e56-8eba-4002cc45e065 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.570919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:03.571496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:03.571810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:03.572228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:03.572690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:03.616618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.617091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.617969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.631916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.724399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Getting quotas for project b22ea719d3fb404391fa4406e4dcf1da. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:03.749220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Getting quotas for user 879e4546d27449039d4d8db2d3d933fb and project b22ea719d3fb404391fa4406e4dcf1da. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:03.794573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:03.800831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:03.946556 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2223c435-fba8-48ea-9220-673fa21a6687 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.823725 Jul 20 04:21:03.956113 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1588/3229] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:03.968362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a586f9fa-b567-4c5f-a2c1-e567d4ac5258 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:03.969247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a586f9fa-b567-4c5f-a2c1-e567d4ac5258 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:04.444646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a586f9fa-b567-4c5f-a2c1-e567d4ac5258 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:04.459357 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a586f9fa-b567-4c5f-a2c1-e567d4ac5258 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1216 microversion: 2.1 time: 0.496731 Jul 20 04:21:04.475581 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1589/3230] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:03 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1216 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:04.491286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d47eb02-c18f-48ac-91b8-05dd695eb51e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.492768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7d47eb02-c18f-48ac-91b8-05dd695eb51e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:04.537202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d47eb02-c18f-48ac-91b8-05dd695eb51e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.537789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d47eb02-c18f-48ac-91b8-05dd695eb51e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.538672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d47eb02-c18f-48ac-91b8-05dd695eb51e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.546037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d47eb02-c18f-48ac-91b8-05dd695eb51e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.762113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97c724bc-8d5e-4e56-8eba-4002cc45e065 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:04.788112 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97c724bc-8d5e-4e56-8eba-4002cc45e065 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1701 microversion: 2.1 time: 1.307347 Jul 20 04:21:04.795731 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1642/3231] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:03 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1701 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:04.806287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e838c80c-7681-4d2b-9343-0cced2edfca2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:04.849170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e838c80c-7681-4d2b-9343-0cced2edfca2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.852039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e838c80c-7681-4d2b-9343-0cced2edfca2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.920418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e838c80c-7681-4d2b-9343-0cced2edfca2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Going to try to start instance {{(pid=119606) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:21:05.078599 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e838c80c-7681-4d2b-9343-0cced2edfca2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/action" status: 202 len: 0 microversion: 2.1 time: 0.276075 Jul 20 04:21:05.085862 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1643/3232] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:04 2022] POST /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:21:05.107867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-999ffb01-7794-4123-988a-670be16d7c3d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:05.114934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-999ffb01-7794-4123-988a-670be16d7c3d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:05.133449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-999ffb01-7794-4123-988a-670be16d7c3d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.136576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-999ffb01-7794-4123-988a-670be16d7c3d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.144846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-999ffb01-7794-4123-988a-670be16d7c3d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.149006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-999ffb01-7794-4123-988a-670be16d7c3d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.765890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7d47eb02-c18f-48ac-91b8-05dd695eb51e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.789306 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7d47eb02-c18f-48ac-91b8-05dd695eb51e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1324 microversion: 2.1 time: 1.312593 Jul 20 04:21:05.793304 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1590/3233] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1324 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:05.825401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f13f4ccc-bd64-4546-92b6-59e76a1d0ad0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:05.826062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f13f4ccc-bd64-4546-92b6-59e76a1d0ad0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:05.841875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f13f4ccc-bd64-4546-92b6-59e76a1d0ad0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.849183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f13f4ccc-bd64-4546-92b6-59e76a1d0ad0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.853776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f13f4ccc-bd64-4546-92b6-59e76a1d0ad0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.855591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f13f4ccc-bd64-4546-92b6-59e76a1d0ad0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.266560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f13f4ccc-bd64-4546-92b6-59e76a1d0ad0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:06.281590 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f13f4ccc-bd64-4546-92b6-59e76a1d0ad0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1268 microversion: 2.1 time: 0.479326 Jul 20 04:21:06.297826 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1591/3234] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:05 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1268 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:06.808411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-09bcdf6c-4fde-44f0-a0b8-c6a0d66801fe tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:06.810240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-09bcdf6c-4fde-44f0-a0b8-c6a0d66801fe tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:06.824935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09bcdf6c-4fde-44f0-a0b8-c6a0d66801fe tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.830688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09bcdf6c-4fde-44f0-a0b8-c6a0d66801fe tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.831577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09bcdf6c-4fde-44f0-a0b8-c6a0d66801fe tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.832038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09bcdf6c-4fde-44f0-a0b8-c6a0d66801fe tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.362797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-999ffb01-7794-4123-988a-670be16d7c3d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:07.375217 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-999ffb01-7794-4123-988a-670be16d7c3d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1710 microversion: 2.1 time: 2.280995 Jul 20 04:21:07.380395 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1644/3235] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:05 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1710 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:07.385426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5696b091-f2f6-4b2d-b453-14e795e1d5d5 req-c29a3297-a87a-469d-9960-063fa37d40a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40778e9-80ef-4eab-9be6-5278135b18b3", "name": "network-vif-plugged", "status": "completed", "tag": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:07.411026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5696b091-f2f6-4b2d-b453-14e795e1d5d5 req-c29a3297-a87a-469d-9960-063fa37d40a7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.411897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5696b091-f2f6-4b2d-b453-14e795e1d5d5 req-c29a3297-a87a-469d-9960-063fa37d40a7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.443904 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5696b091-f2f6-4b2d-b453-14e795e1d5d5 req-c29a3297-a87a-469d-9960-063fa37d40a7 service nova] Creating event network-vif-plugged:a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf for instance f40778e9-80ef-4eab-9be6-5278135b18b3 on n-h2-760456-11 Jul 20 04:21:07.453621 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5696b091-f2f6-4b2d-b453-14e795e1d5d5 req-c29a3297-a87a-469d-9960-063fa37d40a7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069281 Jul 20 04:21:07.455261 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1645/3236] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:07.460724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9221bfc-b844-4e3f-9fb3-d97200c7f7b7 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:07.461733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e9221bfc-b844-4e3f-9fb3-d97200c7f7b7 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:07.509104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9221bfc-b844-4e3f-9fb3-d97200c7f7b7 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.511906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9221bfc-b844-4e3f-9fb3-d97200c7f7b7 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.514378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9221bfc-b844-4e3f-9fb3-d97200c7f7b7 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.519809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9221bfc-b844-4e3f-9fb3-d97200c7f7b7 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.689626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-09bcdf6c-4fde-44f0-a0b8-c6a0d66801fe tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:07.707462 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-09bcdf6c-4fde-44f0-a0b8-c6a0d66801fe tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1324 microversion: 2.1 time: 0.904302 Jul 20 04:21:07.718815 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1592/3237] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:06 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1324 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:07.868818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e9221bfc-b844-4e3f-9fb3-d97200c7f7b7 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:07.877651 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9221bfc-b844-4e3f-9fb3-d97200c7f7b7 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1274 microversion: 2.1 time: 0.420952 Jul 20 04:21:07.885015 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1646/3238] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:07 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1274 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:08.397743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-33e050d4-d6c1-4e5a-9ca5-cef486fa50c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:08.399090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-33e050d4-d6c1-4e5a-9ca5-cef486fa50c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:08.417117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33e050d4-d6c1-4e5a-9ca5-cef486fa50c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.424665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33e050d4-d6c1-4e5a-9ca5-cef486fa50c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.427241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33e050d4-d6c1-4e5a-9ca5-cef486fa50c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.433287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33e050d4-d6c1-4e5a-9ca5-cef486fa50c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.557946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-638959920", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "ac596d51-a056-4bdc-8014-1b8bd8550920"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:08.667713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] validate_networks() for [('ac596d51-a056-4bdc-8014-1b8bd8550920', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:09.220740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-33e050d4-d6c1-4e5a-9ca5-cef486fa50c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.234913 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-33e050d4-d6c1-4e5a-9ca5-cef486fa50c1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1710 microversion: 2.1 time: 0.841082 Jul 20 04:21:09.236880 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1647/3239] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:08 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1710 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:09.242681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6764b7e2-d2a4-48ff-96a5-51e99d254d17 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:09.243754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6764b7e2-d2a4-48ff-96a5-51e99d254d17 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:09.252235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6764b7e2-d2a4-48ff-96a5-51e99d254d17 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.253077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6764b7e2-d2a4-48ff-96a5-51e99d254d17 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.254341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6764b7e2-d2a4-48ff-96a5-51e99d254d17 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.255213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6764b7e2-d2a4-48ff-96a5-51e99d254d17 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.467417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6764b7e2-d2a4-48ff-96a5-51e99d254d17 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:10.476314 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6764b7e2-d2a4-48ff-96a5-51e99d254d17 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1324 microversion: 2.1 time: 1.237653 Jul 20 04:21:10.476916 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1648/3240] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:09 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1324 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:10.494009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-34a32f52-6f27-4213-ac2d-d9eab9518518 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:10.499603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-34a32f52-6f27-4213-ac2d-d9eab9518518 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:10.520304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34a32f52-6f27-4213-ac2d-d9eab9518518 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.520850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34a32f52-6f27-4213-ac2d-d9eab9518518 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.521695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34a32f52-6f27-4213-ac2d-d9eab9518518 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.522154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34a32f52-6f27-4213-ac2d-d9eab9518518 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.694714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:10.695768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:10.697663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:10.698344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:10.698971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:10.714989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.715442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.716274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.730853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.784217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Getting quotas for project e5d2969552fc4c28b85d296959e1679c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:10.792799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Getting quotas for user 66f319c26b6b42c6814d16aa295e277a and project e5d2969552fc4c28b85d296959e1679c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:10.819428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:10.823047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:10.938051 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3b2075df-17a6-457b-a6a0-902c9568c970 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.680404 Jul 20 04:21:10.943955 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1593/3241] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:10.961456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f192eed-6a82-4deb-8dcc-10c81100548a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:10.965429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f192eed-6a82-4deb-8dcc-10c81100548a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:10.975242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f192eed-6a82-4deb-8dcc-10c81100548a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.975981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f192eed-6a82-4deb-8dcc-10c81100548a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.977244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f192eed-6a82-4deb-8dcc-10c81100548a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.977859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f192eed-6a82-4deb-8dcc-10c81100548a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.573970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f192eed-6a82-4deb-8dcc-10c81100548a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.587664 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f192eed-6a82-4deb-8dcc-10c81100548a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1714 microversion: 2.1 time: 0.640770 Jul 20 04:21:11.591765 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1594/3242] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:10 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1714 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:11.607449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8aa629ec-a875-4040-baab-227870896843 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:11.608352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8aa629ec-a875-4040-baab-227870896843 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:11.654750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-34a32f52-6f27-4213-ac2d-d9eab9518518 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.665397 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-34a32f52-6f27-4213-ac2d-d9eab9518518 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1316 microversion: 2.1 time: 1.185038 Jul 20 04:21:11.670166 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1649/3243] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:10 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1316 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:11.676011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-454f5c6e-060a-4e08-85da-2a0dad705872 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:11.680439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-454f5c6e-060a-4e08-85da-2a0dad705872 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:11.687192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-454f5c6e-060a-4e08-85da-2a0dad705872 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.688024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-454f5c6e-060a-4e08-85da-2a0dad705872 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.689071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-454f5c6e-060a-4e08-85da-2a0dad705872 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.689880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-454f5c6e-060a-4e08-85da-2a0dad705872 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.119537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-454f5c6e-060a-4e08-85da-2a0dad705872 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.133659 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-454f5c6e-060a-4e08-85da-2a0dad705872 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1520 microversion: 2.1 time: 0.462068 Jul 20 04:21:12.134359 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1650/3244] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:11 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1520 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:12.158475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a68efbb-9087-4e07-b6d0-c200e814bfb1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Action: 'create', calling method: .version_select at 0x7fb8410f30d0>, body: {"pool": null} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:12.437069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8aa629ec-a875-4040-baab-227870896843 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.457653 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8aa629ec-a875-4040-baab-227870896843 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1224 microversion: 2.1 time: 0.862057 Jul 20 04:21:12.460643 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1595/3245] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:11 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1224 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:12.689462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fbc4ad4a-ecf7-467d-96e8-7c03252f5a30 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.690395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fbc4ad4a-ecf7-467d-96e8-7c03252f5a30 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:12.710192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fbc4ad4a-ecf7-467d-96e8-7c03252f5a30 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.710781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fbc4ad4a-ecf7-467d-96e8-7c03252f5a30 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.711940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fbc4ad4a-ecf7-467d-96e8-7c03252f5a30 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.715245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fbc4ad4a-ecf7-467d-96e8-7c03252f5a30 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.238044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fbc4ad4a-ecf7-467d-96e8-7c03252f5a30 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.257485 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fbc4ad4a-ecf7-467d-96e8-7c03252f5a30 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1316 microversion: 2.1 time: 0.573417 Jul 20 04:21:13.259621 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1596/3246] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:12 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1316 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:13.476021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2845ba4f-a286-4807-b41f-361a6b2543a5 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:13.476727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2845ba4f-a286-4807-b41f-361a6b2543a5 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:13.494658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2845ba4f-a286-4807-b41f-361a6b2543a5 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.496332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2845ba4f-a286-4807-b41f-361a6b2543a5 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.498694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2845ba4f-a286-4807-b41f-361a6b2543a5 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.515919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2845ba4f-a286-4807-b41f-361a6b2543a5 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.692873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2845ba4f-a286-4807-b41f-361a6b2543a5 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.707567 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2845ba4f-a286-4807-b41f-361a6b2543a5 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1282 microversion: 2.1 time: 0.233409 Jul 20 04:21:13.719579 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1597/3247] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:13 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1282 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:14.176212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-21f4d8a9-6870-485d-946e-d622dd9beacf req-d4a5959b-b9c9-4f1e-94da-a0a2f18b6c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5081b1-8b7a-400a-b16c-fb21ebed6c5b", "tag": "e3151488-9d50-447d-9855-2a8a94dea2fa"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:14.218640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-21f4d8a9-6870-485d-946e-d622dd9beacf req-d4a5959b-b9c9-4f1e-94da-a0a2f18b6c81 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.225257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-21f4d8a9-6870-485d-946e-d622dd9beacf req-d4a5959b-b9c9-4f1e-94da-a0a2f18b6c81 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.284909 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-21f4d8a9-6870-485d-946e-d622dd9beacf req-d4a5959b-b9c9-4f1e-94da-a0a2f18b6c81 service nova] Creating event network-changed:e3151488-9d50-447d-9855-2a8a94dea2fa for instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b on n-h1-760456-11 Jul 20 04:21:14.313837 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-21f4d8a9-6870-485d-946e-d622dd9beacf req-d4a5959b-b9c9-4f1e-94da-a0a2f18b6c81 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154825 Jul 20 04:21:14.315514 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1598/3248] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:14.321432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-847b33a5-60a7-4f10-9777-08874de85017 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.322736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-847b33a5-60a7-4f10-9777-08874de85017 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.334628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-847b33a5-60a7-4f10-9777-08874de85017 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.335610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-847b33a5-60a7-4f10-9777-08874de85017 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.338515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-847b33a5-60a7-4f10-9777-08874de85017 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.339698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-847b33a5-60a7-4f10-9777-08874de85017 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.721328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-847b33a5-60a7-4f10-9777-08874de85017 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.754799 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-847b33a5-60a7-4f10-9777-08874de85017 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1316 microversion: 2.1 time: 0.436849 Jul 20 04:21:14.773730 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1599/3249] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:14.781761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e214f21-71a9-4138-b804-2ebc29b957b0 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.803410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5e214f21-71a9-4138-b804-2ebc29b957b0 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.833223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e214f21-71a9-4138-b804-2ebc29b957b0 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.833708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e214f21-71a9-4138-b804-2ebc29b957b0 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.834602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e214f21-71a9-4138-b804-2ebc29b957b0 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.835264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e214f21-71a9-4138-b804-2ebc29b957b0 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.963249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5e214f21-71a9-4138-b804-2ebc29b957b0 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.978888 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5e214f21-71a9-4138-b804-2ebc29b957b0 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1282 microversion: 2.1 time: 0.203104 Jul 20 04:21:14.988650 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1600/3250] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:15.780815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-648d42d0-0043-43aa-9f5d-dc2debe9ac83 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:15.782064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-648d42d0-0043-43aa-9f5d-dc2debe9ac83 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:15.789190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:15.791184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-648d42d0-0043-43aa-9f5d-dc2debe9ac83 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.792154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-648d42d0-0043-43aa-9f5d-dc2debe9ac83 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.793081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-648d42d0-0043-43aa-9f5d-dc2debe9ac83 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.794052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-648d42d0-0043-43aa-9f5d-dc2debe9ac83 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.984681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-648d42d0-0043-43aa-9f5d-dc2debe9ac83 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:16.005904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-648d42d0-0043-43aa-9f5d-dc2debe9ac83 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1316 microversion: 2.1 time: 0.229841 Jul 20 04:21:16.008291 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1601/3251] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:15 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:16.019594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e507b2b7-8a07-4bbf-961f-b16ba42d7944 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:16.020150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e507b2b7-8a07-4bbf-961f-b16ba42d7944 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:16.058169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e507b2b7-8a07-4bbf-961f-b16ba42d7944 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.058676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e507b2b7-8a07-4bbf-961f-b16ba42d7944 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.059570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e507b2b7-8a07-4bbf-961f-b16ba42d7944 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.060022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e507b2b7-8a07-4bbf-961f-b16ba42d7944 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.302745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e507b2b7-8a07-4bbf-961f-b16ba42d7944 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:16.315719 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e507b2b7-8a07-4bbf-961f-b16ba42d7944 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1324 microversion: 2.1 time: 0.303015 Jul 20 04:21:16.316349 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1602/3252] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:16 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:16.417697 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4a68efbb-9087-4e07-b6d0-c200e814bfb1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.269968 Jul 20 04:21:16.418375 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1651/3253] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:21:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:21:16.721217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2121448897", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "7bbaa421-7466-416c-83a5-4f1686a26f31"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:16.826654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] validate_networks() for [('7bbaa421-7466-416c-83a5-4f1686a26f31', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:17.025669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a2efe1be-8f37-47b8-863b-b6357e34c1a9 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.026833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a2efe1be-8f37-47b8-863b-b6357e34c1a9 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:17.042216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2efe1be-8f37-47b8-863b-b6357e34c1a9 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.043080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2efe1be-8f37-47b8-863b-b6357e34c1a9 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.045010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2efe1be-8f37-47b8-863b-b6357e34c1a9 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.046956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2efe1be-8f37-47b8-863b-b6357e34c1a9 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.565529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a2efe1be-8f37-47b8-863b-b6357e34c1a9 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:17.580677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:17.588196 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a2efe1be-8f37-47b8-863b-b6357e34c1a9 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1316 microversion: 2.1 time: 0.566961 Jul 20 04:21:17.592984 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1652/3254] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:17.603579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9875f55-032c-4547-8fb0-f9b5a8e8734a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.604656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9875f55-032c-4547-8fb0-f9b5a8e8734a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:17.613614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:17.619061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9875f55-032c-4547-8fb0-f9b5a8e8734a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.619909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9875f55-032c-4547-8fb0-f9b5a8e8734a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.621508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9875f55-032c-4547-8fb0-f9b5a8e8734a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.622762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9875f55-032c-4547-8fb0-f9b5a8e8734a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.656887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:17.658457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:17.659210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:17.660039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:17.660729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:17.683812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.688290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.689525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.693788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.728174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Getting quotas for project 3b4143a2971b4c41bfa5e239dd7e1708. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:17.735206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Getting quotas for user f4e63bfb5d954ec5b4cb7f4d89c0cfc0 and project 3b4143a2971b4c41bfa5e239dd7e1708. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:17.752885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:17.756810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:17.865755 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ae9afbe4-3714-4032-82cf-f3c8619fceca tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.149280 Jul 20 04:21:17.872847 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1603/3255] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:17.879997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e61e7128-5fba-43c2-95c0-22fa5bbae0c6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.880626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e61e7128-5fba-43c2-95c0-22fa5bbae0c6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.061448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e61e7128-5fba-43c2-95c0-22fa5bbae0c6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.078820 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e61e7128-5fba-43c2-95c0-22fa5bbae0c6 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1224 microversion: 2.1 time: 0.201081 Jul 20 04:21:18.091942 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1604/3256] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1224 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:18.334147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ef9a9bb4-0e13-43e5-96fb-4551c169874d req-760e3b42-ae71-43c7-bfd6-d12ac979678b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380192af-f8f2-4c7a-8156-9cb3501062cc", "tag": "a7277005-50f5-4f40-9af7-290924601b3f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:18.346300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9875f55-032c-4547-8fb0-f9b5a8e8734a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.364175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ef9a9bb4-0e13-43e5-96fb-4551c169874d req-760e3b42-ae71-43c7-bfd6-d12ac979678b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.366703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ef9a9bb4-0e13-43e5-96fb-4551c169874d req-760e3b42-ae71-43c7-bfd6-d12ac979678b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.388288 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9875f55-032c-4547-8fb0-f9b5a8e8734a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1324 microversion: 2.1 time: 0.793241 Jul 20 04:21:18.389137 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1653/3257] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1324 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:18.415591 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ef9a9bb4-0e13-43e5-96fb-4551c169874d req-760e3b42-ae71-43c7-bfd6-d12ac979678b service nova] Creating event network-changed:a7277005-50f5-4f40-9af7-290924601b3f for instance 380192af-f8f2-4c7a-8156-9cb3501062cc on n-h1-760456-11 Jul 20 04:21:18.428226 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ef9a9bb4-0e13-43e5-96fb-4551c169874d req-760e3b42-ae71-43c7-bfd6-d12ac979678b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095614 Jul 20 04:21:18.428886 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1605/3258] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:21:18.609651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1c8fd8a8-baa6-4b91-81be-1209ee46bb78 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.610998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1c8fd8a8-baa6-4b91-81be-1209ee46bb78 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.633149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c8fd8a8-baa6-4b91-81be-1209ee46bb78 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.633805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c8fd8a8-baa6-4b91-81be-1209ee46bb78 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.634685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c8fd8a8-baa6-4b91-81be-1209ee46bb78 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.638657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c8fd8a8-baa6-4b91-81be-1209ee46bb78 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.070881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1c8fd8a8-baa6-4b91-81be-1209ee46bb78 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.092153 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1c8fd8a8-baa6-4b91-81be-1209ee46bb78 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1316 microversion: 2.1 time: 0.485646 Jul 20 04:21:19.098571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd1e724f-a100-4869-9c83-bd38b49db5fa tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.101061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd1e724f-a100-4869-9c83-bd38b49db5fa tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.118974 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1654/3259] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.136419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd1e724f-a100-4869-9c83-bd38b49db5fa tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.136817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd1e724f-a100-4869-9c83-bd38b49db5fa tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.138216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd1e724f-a100-4869-9c83-bd38b49db5fa tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.138847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd1e724f-a100-4869-9c83-bd38b49db5fa tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.408349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c8d8321-c3e1-4d66-af3e-b5fedf2b4a69 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.409102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3c8d8321-c3e1-4d66-af3e-b5fedf2b4a69 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.419943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd1e724f-a100-4869-9c83-bd38b49db5fa tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.440296 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd1e724f-a100-4869-9c83-bd38b49db5fa tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1220 microversion: 2.1 time: 0.344700 Jul 20 04:21:19.441677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c8d8321-c3e1-4d66-af3e-b5fedf2b4a69 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.443662 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1606/3260] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1220 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.445100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c8d8321-c3e1-4d66-af3e-b5fedf2b4a69 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.447329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c8d8321-c3e1-4d66-af3e-b5fedf2b4a69 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.449031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c8d8321-c3e1-4d66-af3e-b5fedf2b4a69 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.093411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3c8d8321-c3e1-4d66-af3e-b5fedf2b4a69 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:20.108150 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3c8d8321-c3e1-4d66-af3e-b5fedf2b4a69 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1324 microversion: 2.1 time: 0.700975 Jul 20 04:21:20.108967 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1655/3261] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1324 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:20.127206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26e5a7a6-ce8e-4e4d-86d1-c2585e2afe1a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:20.127842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-26e5a7a6-ce8e-4e4d-86d1-c2585e2afe1a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:20.144050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26e5a7a6-ce8e-4e4d-86d1-c2585e2afe1a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.144542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26e5a7a6-ce8e-4e4d-86d1-c2585e2afe1a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.145359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26e5a7a6-ce8e-4e4d-86d1-c2585e2afe1a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.149394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26e5a7a6-ce8e-4e4d-86d1-c2585e2afe1a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.460033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-87d89096-9a3e-4121-a88e-655487c523a7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:20.461830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-87d89096-9a3e-4121-a88e-655487c523a7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:20.473684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87d89096-9a3e-4121-a88e-655487c523a7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.474153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87d89096-9a3e-4121-a88e-655487c523a7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.477310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87d89096-9a3e-4121-a88e-655487c523a7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.479116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87d89096-9a3e-4121-a88e-655487c523a7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.597327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-26e5a7a6-ce8e-4e4d-86d1-c2585e2afe1a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:20.614193 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-26e5a7a6-ce8e-4e4d-86d1-c2585e2afe1a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1316 microversion: 2.1 time: 0.493075 Jul 20 04:21:20.618279 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1607/3262] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:20 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:20.628091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-87d89096-9a3e-4121-a88e-655487c523a7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:20.636010 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-87d89096-9a3e-4121-a88e-655487c523a7 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1282 microversion: 2.1 time: 0.180381 Jul 20 04:21:20.647360 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1656/3263] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:20 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:21.127380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fc40f9fb-2188-42e8-926d-99ad3be965a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.129897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fc40f9fb-2188-42e8-926d-99ad3be965a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:21.145105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc40f9fb-2188-42e8-926d-99ad3be965a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.145579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc40f9fb-2188-42e8-926d-99ad3be965a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.146392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc40f9fb-2188-42e8-926d-99ad3be965a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.146837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc40f9fb-2188-42e8-926d-99ad3be965a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.586065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fc40f9fb-2188-42e8-926d-99ad3be965a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.601882 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fc40f9fb-2188-42e8-926d-99ad3be965a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1324 microversion: 2.1 time: 0.478603 Jul 20 04:21:21.613721 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1608/3264] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:21 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1324 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:21.636758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e043fe4-9cd0-47da-8d47-3d4b5a2229ca tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.638241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e043fe4-9cd0-47da-8d47-3d4b5a2229ca tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:21.658507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5c93de0f-0a55-420d-8095-69b53a3c48bd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:21.659444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5c93de0f-0a55-420d-8095-69b53a3c48bd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:21.675819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e043fe4-9cd0-47da-8d47-3d4b5a2229ca tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.677908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e043fe4-9cd0-47da-8d47-3d4b5a2229ca tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.680384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e043fe4-9cd0-47da-8d47-3d4b5a2229ca tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.680854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c93de0f-0a55-420d-8095-69b53a3c48bd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.682551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e043fe4-9cd0-47da-8d47-3d4b5a2229ca tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.682806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c93de0f-0a55-420d-8095-69b53a3c48bd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.686866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c93de0f-0a55-420d-8095-69b53a3c48bd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:21.688176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c93de0f-0a55-420d-8095-69b53a3c48bd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.704943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:21.960852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5c93de0f-0a55-420d-8095-69b53a3c48bd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:21.974305 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5c93de0f-0a55-420d-8095-69b53a3c48bd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1282 microversion: 2.1 time: 0.319882 Jul 20 04:21:21.988885 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1609/3265] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:21 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1282 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:22.001060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-74adbc21-369d-4c7f-940f-6d25eed51e23 req-7211216f-d0fa-4528-aac8-91666137e038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5081b1-8b7a-400a-b16c-fb21ebed6c5b", "name": "network-vif-plugged", "status": "completed", "tag": "e3151488-9d50-447d-9855-2a8a94dea2fa"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:22.039309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-74adbc21-369d-4c7f-940f-6d25eed51e23 req-7211216f-d0fa-4528-aac8-91666137e038 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.039907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-74adbc21-369d-4c7f-940f-6d25eed51e23 req-7211216f-d0fa-4528-aac8-91666137e038 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.049106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e043fe4-9cd0-47da-8d47-3d4b5a2229ca tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:22.061890 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e043fe4-9cd0-47da-8d47-3d4b5a2229ca tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1316 microversion: 2.1 time: 0.429761 Jul 20 04:21:22.070813 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1657/3266] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:21 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:22.083149 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-74adbc21-369d-4c7f-940f-6d25eed51e23 req-7211216f-d0fa-4528-aac8-91666137e038 service nova] Creating event network-vif-plugged:e3151488-9d50-447d-9855-2a8a94dea2fa for instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b on n-h1-760456-11 Jul 20 04:21:22.096369 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-74adbc21-369d-4c7f-940f-6d25eed51e23 req-7211216f-d0fa-4528-aac8-91666137e038 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104842 Jul 20 04:21:22.099192 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1610/3267] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:22.621326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-194d2877-254d-4be5-ab42-77b8343949d2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:22.623855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-194d2877-254d-4be5-ab42-77b8343949d2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:22.646585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-194d2877-254d-4be5-ab42-77b8343949d2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.647154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-194d2877-254d-4be5-ab42-77b8343949d2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.647857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-194d2877-254d-4be5-ab42-77b8343949d2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.648312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-194d2877-254d-4be5-ab42-77b8343949d2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.997532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba937e30-6984-48ee-9b29-5aabe39ce0dd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:22.998471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ba937e30-6984-48ee-9b29-5aabe39ce0dd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.022861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba937e30-6984-48ee-9b29-5aabe39ce0dd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.023526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba937e30-6984-48ee-9b29-5aabe39ce0dd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.024656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba937e30-6984-48ee-9b29-5aabe39ce0dd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.025183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba937e30-6984-48ee-9b29-5aabe39ce0dd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.140341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ba937e30-6984-48ee-9b29-5aabe39ce0dd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.153713 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ba937e30-6984-48ee-9b29-5aabe39ce0dd tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1282 microversion: 2.1 time: 0.163319 Jul 20 04:21:23.171334 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1611/3268] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:22 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:23.172704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9837789d-e144-40eb-a00d-630c1db8fc3c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.173559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9837789d-e144-40eb-a00d-630c1db8fc3c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.185389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9837789d-e144-40eb-a00d-630c1db8fc3c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.186117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9837789d-e144-40eb-a00d-630c1db8fc3c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.187677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9837789d-e144-40eb-a00d-630c1db8fc3c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.188320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9837789d-e144-40eb-a00d-630c1db8fc3c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.568661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-194d2877-254d-4be5-ab42-77b8343949d2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.602584 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-194d2877-254d-4be5-ab42-77b8343949d2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1324 microversion: 2.1 time: 0.985263 Jul 20 04:21:23.603186 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1658/3269] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:22 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1324 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:23.868494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9837789d-e144-40eb-a00d-630c1db8fc3c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.883505 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9837789d-e144-40eb-a00d-630c1db8fc3c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1316 microversion: 2.1 time: 0.715790 Jul 20 04:21:23.884274 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1612/3270] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1316 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:24.141729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5f41adfb-ac00-41ac-ad51-117a96bada3b req-62d4ee37-ec8a-4052-bb31-aa0d77dcc0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380192af-f8f2-4c7a-8156-9cb3501062cc", "name": "network-vif-plugged", "status": "completed", "tag": "a7277005-50f5-4f40-9af7-290924601b3f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:24.172373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5f41adfb-ac00-41ac-ad51-117a96bada3b req-62d4ee37-ec8a-4052-bb31-aa0d77dcc0f0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.173776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-811747f9-73c0-4032-9bc5-923273a9c521 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.174604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-811747f9-73c0-4032-9bc5-923273a9c521 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:24.175514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5f41adfb-ac00-41ac-ad51-117a96bada3b req-62d4ee37-ec8a-4052-bb31-aa0d77dcc0f0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.187163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-811747f9-73c0-4032-9bc5-923273a9c521 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.188405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-811747f9-73c0-4032-9bc5-923273a9c521 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.189399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-811747f9-73c0-4032-9bc5-923273a9c521 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.194187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-811747f9-73c0-4032-9bc5-923273a9c521 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.212794 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5f41adfb-ac00-41ac-ad51-117a96bada3b req-62d4ee37-ec8a-4052-bb31-aa0d77dcc0f0 service nova] Creating event network-vif-plugged:a7277005-50f5-4f40-9af7-290924601b3f for instance 380192af-f8f2-4c7a-8156-9cb3501062cc on n-h1-760456-11 Jul 20 04:21:24.223256 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5f41adfb-ac00-41ac-ad51-117a96bada3b req-62d4ee37-ec8a-4052-bb31-aa0d77dcc0f0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092325 Jul 20 04:21:24.226661 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1659/3271] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:24.621416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be71f55a-e51a-4126-837e-601cb61b017a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.623057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-be71f55a-e51a-4126-837e-601cb61b017a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:24.625163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-811747f9-73c0-4032-9bc5-923273a9c521 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:24.633950 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-811747f9-73c0-4032-9bc5-923273a9c521 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1324 microversion: 2.1 time: 0.463948 Jul 20 04:21:24.636683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be71f55a-e51a-4126-837e-601cb61b017a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.637884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be71f55a-e51a-4126-837e-601cb61b017a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.641579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be71f55a-e51a-4126-837e-601cb61b017a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.642038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be71f55a-e51a-4126-837e-601cb61b017a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.647431 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1613/3272] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:24.901823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c39e0112-1e33-4e2a-af3b-fad5efae7bf4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.902639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c39e0112-1e33-4e2a-af3b-fad5efae7bf4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:24.924813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c39e0112-1e33-4e2a-af3b-fad5efae7bf4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.925445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c39e0112-1e33-4e2a-af3b-fad5efae7bf4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.926273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c39e0112-1e33-4e2a-af3b-fad5efae7bf4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.926928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c39e0112-1e33-4e2a-af3b-fad5efae7bf4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:25.214308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-be71f55a-e51a-4126-837e-601cb61b017a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:25.224584 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-be71f55a-e51a-4126-837e-601cb61b017a tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1324 microversion: 2.1 time: 0.606723 Jul 20 04:21:25.236884 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1660/3273] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:25.279401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-bf2283d6-0050-4e60-b87c-a1f454c06125 req-a9cbe200-7210-4e85-90ab-6e1ea36336e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1657dd8-66a9-456b-b106-9855a89dcc39", "tag": "0e5a62c4-f69c-443a-a839-48bbac5c77a9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:25.288287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c39e0112-1e33-4e2a-af3b-fad5efae7bf4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:25.297703 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c39e0112-1e33-4e2a-af3b-fad5efae7bf4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1466 microversion: 2.1 time: 0.399730 Jul 20 04:21:25.301922 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1614/3274] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1466 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:25.318817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9adcce42-be26-490a-96b6-a609190fd1ff tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1022344796", "metadata": {"image_type": "test"}}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:25.321293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bf2283d6-0050-4e60-b87c-a1f454c06125 req-a9cbe200-7210-4e85-90ab-6e1ea36336e0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:25.323665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9adcce42-be26-490a-96b6-a609190fd1ff tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:25.328864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bf2283d6-0050-4e60-b87c-a1f454c06125 req-a9cbe200-7210-4e85-90ab-6e1ea36336e0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:25.346158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9adcce42-be26-490a-96b6-a609190fd1ff tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:25.346627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9adcce42-be26-490a-96b6-a609190fd1ff tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:25.347428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9adcce42-be26-490a-96b6-a609190fd1ff tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:25.347872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9adcce42-be26-490a-96b6-a609190fd1ff tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:25.369909 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-bf2283d6-0050-4e60-b87c-a1f454c06125 req-a9cbe200-7210-4e85-90ab-6e1ea36336e0 service nova] Creating event network-changed:0e5a62c4-f69c-443a-a839-48bbac5c77a9 for instance a1657dd8-66a9-456b-b106-9855a89dcc39 on n-h2-760456-11 Jul 20 04:21:25.396450 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-bf2283d6-0050-4e60-b87c-a1f454c06125 req-a9cbe200-7210-4e85-90ab-6e1ea36336e0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121480 Jul 20 04:21:25.397128 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1661/3275] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:25.444215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-9adcce42-be26-490a-96b6-a609190fd1ff tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Getting quotas for project b22ea719d3fb404391fa4406e4dcf1da. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:25.461146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-9adcce42-be26-490a-96b6-a609190fd1ff tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Getting quotas for user 879e4546d27449039d4d8db2d3d933fb and project b22ea719d3fb404391fa4406e4dcf1da. Resources: dict_keys(['metadata_items']) {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:25.654670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4283a6b6-7cf9-446f-8bf8-72cf24d8b7ef tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:25.655397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4283a6b6-7cf9-446f-8bf8-72cf24d8b7ef tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:25.675306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4283a6b6-7cf9-446f-8bf8-72cf24d8b7ef tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:25.676010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4283a6b6-7cf9-446f-8bf8-72cf24d8b7ef tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:25.677010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4283a6b6-7cf9-446f-8bf8-72cf24d8b7ef tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:25.680026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4283a6b6-7cf9-446f-8bf8-72cf24d8b7ef tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.081893 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9adcce42-be26-490a-96b6-a609190fd1ff tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "POST /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b/action" status: 202 len: 0 microversion: 2.1 time: 0.764247 Jul 20 04:21:26.082611 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1615/3276] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:25 2022] POST /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b/action => generated 0 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:21:26.093516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7dce9a65-22c7-4005-8eda-f6348cc0dba1 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841df6e50>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:26.120010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4283a6b6-7cf9-446f-8bf8-72cf24d8b7ef tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:26.141988 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4283a6b6-7cf9-446f-8bf8-72cf24d8b7ef tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1324 microversion: 2.1 time: 0.491440 Jul 20 04:21:26.142706 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1662/3277] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:25 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1324 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:26.150534 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7dce9a65-22c7-4005-8eda-f6348cc0dba1 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.061887 Jul 20 04:21:26.154637 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1616/3278] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:26 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:26.241835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04716f4c-ab6a-4f07-92c0-e75c6ac24f89 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:26.242505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04716f4c-ab6a-4f07-92c0-e75c6ac24f89 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:26.257358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04716f4c-ab6a-4f07-92c0-e75c6ac24f89 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.257867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04716f4c-ab6a-4f07-92c0-e75c6ac24f89 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.263424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04716f4c-ab6a-4f07-92c0-e75c6ac24f89 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.263896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04716f4c-ab6a-4f07-92c0-e75c6ac24f89 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.639768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-04716f4c-ab6a-4f07-92c0-e75c6ac24f89 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:26.647722 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04716f4c-ab6a-4f07-92c0-e75c6ac24f89 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1520 microversion: 2.1 time: 0.409706 Jul 20 04:21:26.648306 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1663/3279] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:26 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:26.668042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b9c796d-2cb4-4fc2-a7af-2a69e945aa61 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:26.669883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8b9c796d-2cb4-4fc2-a7af-2a69e945aa61 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:26.685240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b9c796d-2cb4-4fc2-a7af-2a69e945aa61 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.686453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b9c796d-2cb4-4fc2-a7af-2a69e945aa61 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.690187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b9c796d-2cb4-4fc2-a7af-2a69e945aa61 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.690691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b9c796d-2cb4-4fc2-a7af-2a69e945aa61 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.773945 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8b9c796d-2cb4-4fc2-a7af-2a69e945aa61 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] HTTP exception thrown: Action 999 not found Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b9c796d-2cb4-4fc2-a7af-2a69e945aa61 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Request method failure captured: Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc/os-instance-actions/999 HTTP/1.1 Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14KzgnZAhyuxz_nSpvCCkhdX2HJozcc4DHHRk1VDuw0FN2a3Q_TL0Z8YoZLZj15EuONpL3N1EwrgrUIbsc3XKQHCx3c7r11K9RxFAZztaHEF-MS4yhmPAH-8KBM9vG506FBpgWmJYd5eAwoEb-cTTSl-5gzfhgYp8DVhDzoN61CIo2s Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e5d2969552fc4c28b85d296959e1679c Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-660787451 Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-2067065778", "name": "tempest-ServicesTestJSON-Service-992718057", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-660787451 Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e5d2969552fc4c28b85d296959e1679c Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-660787451 Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-InstanceActionsNegativeTestJSON-660787451-project Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 66f319c26b6b42c6814d16aa295e277a Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-660787451-project Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: exception: Action 999 not found Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'server_id': '380192af-f8f2-4c7a-8156-9cb3501062cc', 'id': '999'} Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 20 04:21:26.785637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:26.789474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b9c796d-2cb4-4fc2-a7af-2a69e945aa61 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Returning 404 to user: Action 999 not found {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:26.806044 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8b9c796d-2cb4-4fc2-a7af-2a69e945aa61 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.127048 Jul 20 04:21:26.807375 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1617/3280] 10.222.0.59 () {58 vars in 1307 bytes} [Wed Jul 20 04:21:26 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc/os-instance-actions/999 => generated 66 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:26.816783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6e7f1c09-993d-4f39-b28b-a24de3c1d890 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '.version_select at 0x7fb84105f040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:26.817360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6e7f1c09-993d-4f39-b28b-a24de3c1d890 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 3f4faf0a-cf2b-4254-8215-f434af6acfbd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:26.828187 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-6e7f1c09-993d-4f39-b28b-a24de3c1d890 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] HTTP exception thrown: Instance 3f4faf0a-cf2b-4254-8215-f434af6acfbd could not be found. Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6e7f1c09-993d-4f39-b28b-a24de3c1d890 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Request method failure captured: Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/3f4faf0a-cf2b-4254-8215-f434af6acfbd/os-instance-actions HTTP/1.1 Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14KzgnZAhyuxz_nSpvCCkhdX2HJozcc4DHHRk1VDuw0FN2a3Q_TL0Z8YoZLZj15EuONpL3N1EwrgrUIbsc3XKQHCx3c7r11K9RxFAZztaHEF-MS4yhmPAH-8KBM9vG506FBpgWmJYd5eAwoEb-cTTSl-5gzfhgYp8DVhDzoN61CIo2s Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e5d2969552fc4c28b85d296959e1679c Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-660787451 Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-2067065778", "name": "tempest-ServicesTestJSON-Service-992718057", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-660787451 Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e5d2969552fc4c28b85d296959e1679c Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-660787451 Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-InstanceActionsNegativeTestJSON-660787451-project Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 66f319c26b6b42c6814d16aa295e277a Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-660787451-project Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 3f4faf0a-cf2b-4254-8215-f434af6acfbd could not be found. Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'server_id': '3f4faf0a-cf2b-4254-8215-f434af6acfbd'} Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f4faf0a-cf2b-4254-8215-f434af6acfbd could not be found. Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 20 04:21:26.830167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f4faf0a-cf2b-4254-8215-f434af6acfbd could not be found. Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f4faf0a-cf2b-4254-8215-f434af6acfbd could not be found. Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6e7f1c09-993d-4f39-b28b-a24de3c1d890 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Returning 404 to user: Instance 3f4faf0a-cf2b-4254-8215-f434af6acfbd could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:26.835122 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6e7f1c09-993d-4f39-b28b-a24de3c1d890 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/3f4faf0a-cf2b-4254-8215-f434af6acfbd/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.018815 Jul 20 04:21:26.845879 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1664/3281] 10.222.0.59 () {58 vars in 1295 bytes} [Wed Jul 20 04:21:26 2022] GET /compute/v2.1/servers/3f4faf0a-cf2b-4254-8215-f434af6acfbd/os-instance-actions => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:26.850236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-418bf60b-df0d-4f66-a333-b59498d669a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:26.854612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-418bf60b-df0d-4f66-a333-b59498d669a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:26.869304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-418bf60b-df0d-4f66-a333-b59498d669a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.871638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-418bf60b-df0d-4f66-a333-b59498d669a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.872473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-418bf60b-df0d-4f66-a333-b59498d669a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.872929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-418bf60b-df0d-4f66-a333-b59498d669a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.943248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-418bf60b-df0d-4f66-a333-b59498d669a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:27.154524 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-418bf60b-df0d-4f66-a333-b59498d669a7 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "DELETE /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 204 len: 0 microversion: 2.1 time: 0.312808 Jul 20 04:21:27.157979 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1618/3282] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:26 2022] DELETE /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:27.166023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e73ac932-16e7-49ab-b1a4-0f4256607098 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.167013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e73ac932-16e7-49ab-b1a4-0f4256607098 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:27.172366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-95f2f2d3-3152-4b81-a544-6842e7a078bd tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.173140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-95f2f2d3-3152-4b81-a544-6842e7a078bd tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:27.183017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e73ac932-16e7-49ab-b1a4-0f4256607098 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.183812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e73ac932-16e7-49ab-b1a4-0f4256607098 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.185056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e73ac932-16e7-49ab-b1a4-0f4256607098 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.185835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e73ac932-16e7-49ab-b1a4-0f4256607098 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.194847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95f2f2d3-3152-4b81-a544-6842e7a078bd tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.195310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95f2f2d3-3152-4b81-a544-6842e7a078bd tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.196118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95f2f2d3-3152-4b81-a544-6842e7a078bd tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.196562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95f2f2d3-3152-4b81-a544-6842e7a078bd tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.519502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-95f2f2d3-3152-4b81-a544-6842e7a078bd tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:27.534275 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-95f2f2d3-3152-4b81-a544-6842e7a078bd tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1526 microversion: 2.1 time: 0.374775 Jul 20 04:21:27.535234 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1619/3283] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1526 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:27.549289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-279783b4-fa59-4d36-88ea-fa145582af6f tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841c62940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.630370 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-279783b4-fa59-4d36-88ea-fa145582af6f tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.084768 Jul 20 04:21:27.635004 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1620/3284] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:28.153865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e73ac932-16e7-49ab-b1a4-0f4256607098 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:28.166799 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e73ac932-16e7-49ab-b1a4-0f4256607098 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1324 microversion: 2.1 time: 1.007494 Jul 20 04:21:28.168755 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1665/3285] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1324 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:28.553504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7661a6a9-5b54-4235-b9ba-f27b43932d62 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:28.554421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7661a6a9-5b54-4235-b9ba-f27b43932d62 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:28.557804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:28.561095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=24 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:28.580745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7661a6a9-5b54-4235-b9ba-f27b43932d62 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.583188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7661a6a9-5b54-4235-b9ba-f27b43932d62 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.586466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7661a6a9-5b54-4235-b9ba-f27b43932d62 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.587197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7661a6a9-5b54-4235-b9ba-f27b43932d62 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.648634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be2c6f88-4581-4ca0-8dc7-0aaa7994fabc tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841052820>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:28.727755 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-be2c6f88-4581-4ca0-8dc7-0aaa7994fabc tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.080825 Jul 20 04:21:28.729038 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1666/3286] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:28 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:28.955959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7661a6a9-5b54-4235-b9ba-f27b43932d62 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:28.974150 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7661a6a9-5b54-4235-b9ba-f27b43932d62 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1526 microversion: 2.1 time: 0.425564 Jul 20 04:21:28.982571 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1621/3287] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:28 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1526 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:29.186119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2f008c00-21c3-4cb4-83a7-24691de5841f tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.187466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f008c00-21c3-4cb4-83a7-24691de5841f tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:29.206625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f008c00-21c3-4cb4-83a7-24691de5841f tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.214336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f008c00-21c3-4cb4-83a7-24691de5841f tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.217930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f008c00-21c3-4cb4-83a7-24691de5841f tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.219537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f008c00-21c3-4cb4-83a7-24691de5841f tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.741748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48228186-1fd3-40c4-b948-2fae8a13fe14 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841c62790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.791628 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48228186-1fd3-40c4-b948-2fae8a13fe14 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.054215 Jul 20 04:21:29.792213 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1622/3288] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:29 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:29.998978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c59be8e-57d1-4e1b-963f-57c8651fc215 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.999599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c59be8e-57d1-4e1b-963f-57c8651fc215 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:30.008073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c59be8e-57d1-4e1b-963f-57c8651fc215 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.008790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c59be8e-57d1-4e1b-963f-57c8651fc215 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.009824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c59be8e-57d1-4e1b-963f-57c8651fc215 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.010579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c59be8e-57d1-4e1b-963f-57c8651fc215 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.166073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2f008c00-21c3-4cb4-83a7-24691de5841f tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:30.178127 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2f008c00-21c3-4cb4-83a7-24691de5841f tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1324 microversion: 2.1 time: 0.996872 Jul 20 04:21:30.181197 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1667/3289] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:29 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1324 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:30.242231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6c59be8e-57d1-4e1b-963f-57c8651fc215 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:30.253262 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6c59be8e-57d1-4e1b-963f-57c8651fc215 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1526 microversion: 2.1 time: 0.258275 Jul 20 04:21:30.258182 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1623/3290] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:29 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1526 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:30.565585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-13c98957-57fa-4bab-95b7-e5d370c7d8c5 req-3d1cabe3-0384-4304-a568-67ba2593d58a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1657dd8-66a9-456b-b106-9855a89dcc39", "name": "network-vif-plugged", "status": "completed", "tag": "0e5a62c4-f69c-443a-a839-48bbac5c77a9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:30.591541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-13c98957-57fa-4bab-95b7-e5d370c7d8c5 req-3d1cabe3-0384-4304-a568-67ba2593d58a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.592249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-13c98957-57fa-4bab-95b7-e5d370c7d8c5 req-3d1cabe3-0384-4304-a568-67ba2593d58a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.626537 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-13c98957-57fa-4bab-95b7-e5d370c7d8c5 req-3d1cabe3-0384-4304-a568-67ba2593d58a service nova] Creating event network-vif-plugged:0e5a62c4-f69c-443a-a839-48bbac5c77a9 for instance a1657dd8-66a9-456b-b106-9855a89dcc39 on n-h2-760456-11 Jul 20 04:21:30.663464 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-13c98957-57fa-4bab-95b7-e5d370c7d8c5 req-3d1cabe3-0384-4304-a568-67ba2593d58a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102775 Jul 20 04:21:30.690998 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1668/3291] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:30.806679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca892d78-ca5c-434a-8bbc-b48fbf5f1846 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841beb430>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:30.856065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6e9abf0e-16a5-4652-8a2b-3792cf6970a2 req-b73337fe-ba2a-4dac-baa7-a27fd1ab2f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380192af-f8f2-4c7a-8156-9cb3501062cc", "name": "network-vif-deleted", "tag": "a7277005-50f5-4f40-9af7-290924601b3f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:30.899135 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ca892d78-ca5c-434a-8bbc-b48fbf5f1846 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.096834 Jul 20 04:21:30.902116 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1624/3292] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:30 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:30.907371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6e9abf0e-16a5-4652-8a2b-3792cf6970a2 req-b73337fe-ba2a-4dac-baa7-a27fd1ab2f1c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.908152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6e9abf0e-16a5-4652-8a2b-3792cf6970a2 req-b73337fe-ba2a-4dac-baa7-a27fd1ab2f1c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.947585 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6e9abf0e-16a5-4652-8a2b-3792cf6970a2 req-b73337fe-ba2a-4dac-baa7-a27fd1ab2f1c service nova] Creating event network-vif-deleted:a7277005-50f5-4f40-9af7-290924601b3f for instance 380192af-f8f2-4c7a-8156-9cb3501062cc on n-h1-760456-11 Jul 20 04:21:30.960607 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6e9abf0e-16a5-4652-8a2b-3792cf6970a2 req-b73337fe-ba2a-4dac-baa7-a27fd1ab2f1c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109655 Jul 20 04:21:30.967616 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1669/3293] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:21:31.199501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0bbbf007-75f2-49e6-9487-9d4388164321 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:31.200499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0bbbf007-75f2-49e6-9487-9d4388164321 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:31.212162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0bbbf007-75f2-49e6-9487-9d4388164321 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.213142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0bbbf007-75f2-49e6-9487-9d4388164321 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.217848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0bbbf007-75f2-49e6-9487-9d4388164321 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.218591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0bbbf007-75f2-49e6-9487-9d4388164321 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.276588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:31.277614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:31.299010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.303303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.309161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.312335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.434782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.437810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.438455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lazy-loading 'fault' on Instance uuid 380192af-f8f2-4c7a-8156-9cb3501062cc {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:31.611544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f319c26b6b42c6814d16aa295e277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d2969552fc4c28b85d296959e1679c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.615793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0bbbf007-75f2-49e6-9487-9d4388164321 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.625415 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-db67cd47-1677-40df-b0da-9597fefe1bc3 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 200 len: 1314 microversion: 2.1 time: 0.352869 Jul 20 04:21:31.626049 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1670/3294] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:31 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:31.646457 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0bbbf007-75f2-49e6-9487-9d4388164321 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1324 microversion: 2.1 time: 0.452074 Jul 20 04:21:31.648209 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1625/3295] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:31 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:31.916020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4f43bf2f-d4c5-4b2c-878e-0f90c8ab567c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841b6c820>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:32.000380 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4f43bf2f-d4c5-4b2c-878e-0f90c8ab567c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.088432 Jul 20 04:21:32.006393 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1626/3296] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:31 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:32.335643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-105495951", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "a9d8f45f-96de-4812-8c6a-ed3135031aa1"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:32.503038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] validate_networks() for [('a9d8f45f-96de-4812-8c6a-ed3135031aa1', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:32.643624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5fbca3ac-f6de-476f-92ca-a9fe08179dc2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:32.644638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5fbca3ac-f6de-476f-92ca-a9fe08179dc2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] [instance: 380192af-f8f2-4c7a-8156-9cb3501062cc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:32.670546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fbca3ac-f6de-476f-92ca-a9fe08179dc2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.671391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fbca3ac-f6de-476f-92ca-a9fe08179dc2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.672956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fbca3ac-f6de-476f-92ca-a9fe08179dc2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.682172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fbca3ac-f6de-476f-92ca-a9fe08179dc2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.745230 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-5fbca3ac-f6de-476f-92ca-a9fe08179dc2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] HTTP exception thrown: Instance 380192af-f8f2-4c7a-8156-9cb3501062cc could not be found. Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5fbca3ac-f6de-476f-92ca-a9fe08179dc2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Request method failure captured: Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc HTTP/1.1 Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14KzgnZAhyuxz_nSpvCCkhdX2HJozcc4DHHRk1VDuw0FN2a3Q_TL0Z8YoZLZj15EuONpL3N1EwrgrUIbsc3XKQHCx3c7r11K9RxFAZztaHEF-MS4yhmPAH-8KBM9vG506FBpgWmJYd5eAwoEb-cTTSl-5gzfhgYp8DVhDzoN61CIo2s Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e5d2969552fc4c28b85d296959e1679c Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-660787451 Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-2067065778", "name": "tempest-ServicesTestJSON-Service-992718057", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e5d2969552fc4c28b85d296959e1679c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-660787451 Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e5d2969552fc4c28b85d296959e1679c Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-660787451 Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-InstanceActionsNegativeTestJSON-660787451-project Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 66f319c26b6b42c6814d16aa295e277a Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-660787451-project Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 380192af-f8f2-4c7a-8156-9cb3501062cc could not be found. Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '380192af-f8f2-4c7a-8156-9cb3501062cc'} Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380192af-f8f2-4c7a-8156-9cb3501062cc could not be found. Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380192af-f8f2-4c7a-8156-9cb3501062cc could not be found. Jul 20 04:21:32.767585 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:32.774182 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:32.774182 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:32.774182 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:32.774182 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:32.774182 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:32.774182 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:32.774182 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:32.774182 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380192af-f8f2-4c7a-8156-9cb3501062cc could not be found. Jul 20 04:21:32.774182 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:32.781921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5fbca3ac-f6de-476f-92ca-a9fe08179dc2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] Returning 404 to user: Instance 380192af-f8f2-4c7a-8156-9cb3501062cc could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:32.789899 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5fbca3ac-f6de-476f-92ca-a9fe08179dc2 tempest-InstanceActionsNegativeTestJSON-660787451 tempest-InstanceActionsNegativeTestJSON-660787451-project] 10.222.0.59 "GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc" status: 404 len: 111 microversion: 2.1 time: 0.146945 Jul 20 04:21:32.791183 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1627/3297] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:32 2022] GET /compute/v2.1/servers/380192af-f8f2-4c7a-8156-9cb3501062cc => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:32.831097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c7a4ffb-1623-4f6e-98b9-61abbe67eab8 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:32.831754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8c7a4ffb-1623-4f6e-98b9-61abbe67eab8 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:32.861516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c7a4ffb-1623-4f6e-98b9-61abbe67eab8 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.861993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c7a4ffb-1623-4f6e-98b9-61abbe67eab8 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.862831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c7a4ffb-1623-4f6e-98b9-61abbe67eab8 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.863318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c7a4ffb-1623-4f6e-98b9-61abbe67eab8 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.956393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:33.736862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:33.737578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:33.738922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:33.739714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:33.740458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:33.752363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.753042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.754638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.755315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.778620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Getting quotas for project 5969026baa244a18be350ba03d29cfaf. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:33.785282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Getting quotas for user 8c53201bb24d40d7b988aaffd632d3bb and project 5969026baa244a18be350ba03d29cfaf. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:33.800496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:33.803980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:33.819226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8c7a4ffb-1623-4f6e-98b9-61abbe67eab8 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:33.832203 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c7a4ffb-1623-4f6e-98b9-61abbe67eab8 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 200 len: 1520 microversion: 2.1 time: 1.033058 Jul 20 04:21:33.832708 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1628/3298] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:32 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 1520 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:33.854047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3dc55630-1ac1-4ecc-9379-45170968a514 req-d4d9cacc-fe44-4d31-af1f-adaf9c7a2e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5081b1-8b7a-400a-b16c-fb21ebed6c5b", "name": "network-vif-plugged", "status": "completed", "tag": "e3151488-9d50-447d-9855-2a8a94dea2fa"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:33.880819 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bf0f2076-dc52-4d4d-933d-a78c18c1d6bc tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.241706 Jul 20 04:21:33.881083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3dc55630-1ac1-4ecc-9379-45170968a514 req-d4d9cacc-fe44-4d31-af1f-adaf9c7a2e38 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.881273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3dc55630-1ac1-4ecc-9379-45170968a514 req-d4d9cacc-fe44-4d31-af1f-adaf9c7a2e38 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.883624 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1671/3299] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:33.895761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4d87366a-06a0-45d9-a6e6-275f65e62f31 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840fb69d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:33.946717 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3dc55630-1ac1-4ecc-9379-45170968a514 req-d4d9cacc-fe44-4d31-af1f-adaf9c7a2e38 service nova] Creating event network-vif-plugged:e3151488-9d50-447d-9855-2a8a94dea2fa for instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b on n-h1-760456-11 Jul 20 04:21:33.971455 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3dc55630-1ac1-4ecc-9379-45170968a514 req-d4d9cacc-fe44-4d31-af1f-adaf9c7a2e38 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124802 Jul 20 04:21:33.977448 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1629/3300] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:33.984025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.113"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:33.988672 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4d87366a-06a0-45d9-a6e6-275f65e62f31 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.102992 Jul 20 04:21:33.990286 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1672/3301] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:33 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:33.996933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c83d17a3-5e3b-4c99-af28-54b3295dabf3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:33.997567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c83d17a3-5e3b-4c99-af28-54b3295dabf3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:34.009137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:34.030495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.031681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.033749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.034764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.169368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Acquired lock "refresh_cache-f40778e9-80ef-4eab-9be6-5278135b18b3" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:21:34.176226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c83d17a3-5e3b-4c99-af28-54b3295dabf3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:34.200239 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c83d17a3-5e3b-4c99-af28-54b3295dabf3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1224 microversion: 2.1 time: 0.208486 Jul 20 04:21:34.201979 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1673/3302] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:33 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1224 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:35.003404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08fbe9c8-dd19-4258-b225-e228bb3bd3f4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f73670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:35.144829 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08fbe9c8-dd19-4258-b225-e228bb3bd3f4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.146763 Jul 20 04:21:35.145423 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1674/3303] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:34 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:35.230733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-69eebd1b-f9b9-4c76-b1c8-f72ca57de856 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:35.231649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-69eebd1b-f9b9-4c76-b1c8-f72ca57de856 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:35.551736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-69eebd1b-f9b9-4c76-b1c8-f72ca57de856 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:35.560531 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-69eebd1b-f9b9-4c76-b1c8-f72ca57de856 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1224 microversion: 2.1 time: 0.346074 Jul 20 04:21:35.564939 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1675/3304] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:35 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1224 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:36.159489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04e0d5d5-d423-4663-8575-585794d85544 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f1b670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:36.280436 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04e0d5d5-d423-4663-8575-585794d85544 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.124938 Jul 20 04:21:36.287026 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1676/3305] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:36 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:36.581613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-68ccd099-afc9-4968-be0e-5048477a60a9 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:36.582454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-68ccd099-afc9-4968-be0e-5048477a60a9 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:36.603740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68ccd099-afc9-4968-be0e-5048477a60a9 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.604297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68ccd099-afc9-4968-be0e-5048477a60a9 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.605191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68ccd099-afc9-4968-be0e-5048477a60a9 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.611852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68ccd099-afc9-4968-be0e-5048477a60a9 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.908162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-68ccd099-afc9-4968-be0e-5048477a60a9 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:36.916317 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-68ccd099-afc9-4968-be0e-5048477a60a9 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1282 microversion: 2.1 time: 0.339438 Jul 20 04:21:36.928029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1677/3306] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:36 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1282 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:37.168135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Building network info cache for instance {{(pid=119605) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:21:37.181634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-115ad0b4-0653-4ba2-852d-a7bf8867fd80 req-3eb8f828-776f-4818-974d-a9ffb9e7f99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40778e9-80ef-4eab-9be6-5278135b18b3", "tag": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:37.214618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-115ad0b4-0653-4ba2-852d-a7bf8867fd80 req-3eb8f828-776f-4818-974d-a9ffb9e7f99d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.216411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-115ad0b4-0653-4ba2-852d-a7bf8867fd80 req-3eb8f828-776f-4818-974d-a9ffb9e7f99d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.255917 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-115ad0b4-0653-4ba2-852d-a7bf8867fd80 req-3eb8f828-776f-4818-974d-a9ffb9e7f99d service nova] Creating event network-changed:a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf for instance f40778e9-80ef-4eab-9be6-5278135b18b3 on n-h2-760456-11 Jul 20 04:21:37.268044 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-115ad0b4-0653-4ba2-852d-a7bf8867fd80 req-3eb8f828-776f-4818-974d-a9ffb9e7f99d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088953 Jul 20 04:21:37.271390 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1678/3307] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:37.317141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2a36be51-afdc-42bf-81da-542305045415 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8410015e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:37.414239 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2a36be51-afdc-42bf-81da-542305045415 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.108682 Jul 20 04:21:37.421566 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1679/3308] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:37 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:37.936977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-44fc3da7-4556-479a-9f74-84b36134e34e tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:37.938017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-44fc3da7-4556-479a-9f74-84b36134e34e tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:37.959145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44fc3da7-4556-479a-9f74-84b36134e34e tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.961720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44fc3da7-4556-479a-9f74-84b36134e34e tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.962900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44fc3da7-4556-479a-9f74-84b36134e34e tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.964999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44fc3da7-4556-479a-9f74-84b36134e34e tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.505394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-44fc3da7-4556-479a-9f74-84b36134e34e tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.523555 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-44fc3da7-4556-479a-9f74-84b36134e34e tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1282 microversion: 2.1 time: 0.590715 Jul 20 04:21:38.527328 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1680/3309] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:37 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1282 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:38.537865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-13f0443f-459d-4aa2-bbd0-f4c1d54c4964 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f424c0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:38.618794 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-13f0443f-459d-4aa2-bbd0-f4c1d54c4964 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.089486 Jul 20 04:21:38.619643 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1681/3310] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:38 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:38.674054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Updating instance_info_cache with network_info: [{"id": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf", "address": "fa:16:3e:5b:75:53", "network": {"id": "7bbaa421-7466-416c-83a5-4f1686a26f31", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977127072-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b4143a2971b4c41bfa5e239dd7e1708", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa63e1ea1-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119605) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:21:38.692633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Releasing lock "refresh_cache-f40778e9-80ef-4eab-9be6-5278135b18b3" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:21:38.699508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7570ffaa-63c9-4da5-aa1a-459ad9d24b80 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "POST /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3/action" status: 202 len: 0 microversion: 2.1 time: 4.719303 Jul 20 04:21:38.707272 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1630/3311] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:33 2022] POST /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3/action => generated 0 bytes in 4729 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:21:38.715275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.113"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:38.717204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:38.741599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:38.743936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.746582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:38.747269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.772883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:38.844537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Acquired lock "refresh_cache-a1657dd8-66a9-456b-b106-9855a89dcc39" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:21:39.545110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-33d0e789-0019-4171-aecc-7fba93ea0131 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.548139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-33d0e789-0019-4171-aecc-7fba93ea0131 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.565545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33d0e789-0019-4171-aecc-7fba93ea0131 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.570584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33d0e789-0019-4171-aecc-7fba93ea0131 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.572015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33d0e789-0019-4171-aecc-7fba93ea0131 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.573250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33d0e789-0019-4171-aecc-7fba93ea0131 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.354960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-33d0e789-0019-4171-aecc-7fba93ea0131 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:41.369009 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-33d0e789-0019-4171-aecc-7fba93ea0131 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1324 microversion: 2.1 time: 1.827032 Jul 20 04:21:41.372125 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1631/3312] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1324 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:41.382713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c657a579-16ff-44e2-9c03-c8e0a584b2fa tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841ebb3a0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.495268 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c657a579-16ff-44e2-9c03-c8e0a584b2fa tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.121760 Jul 20 04:21:41.496074 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1632/3313] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:41 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:42.388307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6ed4e16-5c77-4e80-8f60-56286facaf09 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:42.389089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e6ed4e16-5c77-4e80-8f60-56286facaf09 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:42.404617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6ed4e16-5c77-4e80-8f60-56286facaf09 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:42.406988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6ed4e16-5c77-4e80-8f60-56286facaf09 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:42.407951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6ed4e16-5c77-4e80-8f60-56286facaf09 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:42.413670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6ed4e16-5c77-4e80-8f60-56286facaf09 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.327929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6ed4e16-5c77-4e80-8f60-56286facaf09 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.343060 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6ed4e16-5c77-4e80-8f60-56286facaf09 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1324 microversion: 2.1 time: 0.959015 Jul 20 04:21:43.349164 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1633/3314] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:42 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1324 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:43.365505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-304a376b-b33b-4fc3-b411-57c06e5bb801 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8414dc0d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:43.509638 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-304a376b-b33b-4fc3-b411-57c06e5bb801 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.158867 Jul 20 04:21:43.511073 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1634/3315] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:43 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:43.767230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:44.369972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f4b3466-8074-4f4d-85a8-e7cbcbe71204 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:44.375051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f4b3466-8074-4f4d-85a8-e7cbcbe71204 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:44.414526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f4b3466-8074-4f4d-85a8-e7cbcbe71204 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:44.416298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f4b3466-8074-4f4d-85a8-e7cbcbe71204 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:44.417682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f4b3466-8074-4f4d-85a8-e7cbcbe71204 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:44.420505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f4b3466-8074-4f4d-85a8-e7cbcbe71204 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.534616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5f4b3466-8074-4f4d-85a8-e7cbcbe71204 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:45.554860 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f4b3466-8074-4f4d-85a8-e7cbcbe71204 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1324 microversion: 2.1 time: 1.181431 Jul 20 04:21:45.555562 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1635/3316] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:44 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1324 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:45.559736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=10 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:45.561094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ed5b1c0-6c45-40cf-abe3-97390465a961 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841ebbf70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:45.646956 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ed5b1c0-6c45-40cf-abe3-97390465a961 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.090240 Jul 20 04:21:45.655418 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1636/3317] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:45 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:45.662203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d96ec8bd-2928-479e-a960-e8d069aa75ea req-5f1bbecb-d522-4200-931b-684c9f7a2f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc307fe-a5b4-4927-8259-8a39f4c285a5", "tag": "91db1983-b6f1-4827-b8f0-2f9bb29f683f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:45.682502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d96ec8bd-2928-479e-a960-e8d069aa75ea req-5f1bbecb-d522-4200-931b-684c9f7a2f39 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.683148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d96ec8bd-2928-479e-a960-e8d069aa75ea req-5f1bbecb-d522-4200-931b-684c9f7a2f39 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.709559 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d96ec8bd-2928-479e-a960-e8d069aa75ea req-5f1bbecb-d522-4200-931b-684c9f7a2f39 service nova] Creating event network-changed:91db1983-b6f1-4827-b8f0-2f9bb29f683f for instance 9fc307fe-a5b4-4927-8259-8a39f4c285a5 on n-h1-760456-11 Jul 20 04:21:45.720681 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d96ec8bd-2928-479e-a960-e8d069aa75ea req-5f1bbecb-d522-4200-931b-684c9f7a2f39 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063519 Jul 20 04:21:45.724535 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1637/3318] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:45.756289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a404ee97-3f57-44aa-8644-87f99ad0681e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:45.757333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a404ee97-3f57-44aa-8644-87f99ad0681e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:45.768818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a404ee97-3f57-44aa-8644-87f99ad0681e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.769745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a404ee97-3f57-44aa-8644-87f99ad0681e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.771469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a404ee97-3f57-44aa-8644-87f99ad0681e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.772086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a404ee97-3f57-44aa-8644-87f99ad0681e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.994616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-a404ee97-3f57-44aa-8644-87f99ad0681e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lazy-loading 'services' on Instance uuid 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:46.226056 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a404ee97-3f57-44aa-8644-87f99ad0681e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/os-volume_attachments/b09960fc-2612-42f2-a44c-048d6ad11a55" status: 202 len: 0 microversion: 2.1 time: 0.499904 Jul 20 04:21:46.231254 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1638/3319] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:21:45 2022] DELETE /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/os-volume_attachments/b09960fc-2612-42f2-a44c-048d6ad11a55 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:46.578961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-579f464e-924b-4fff-8a27-94ab59379415 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:46.581350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-579f464e-924b-4fff-8a27-94ab59379415 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:46.586467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:46.601754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-579f464e-924b-4fff-8a27-94ab59379415 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.604507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-579f464e-924b-4fff-8a27-94ab59379415 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.606103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-579f464e-924b-4fff-8a27-94ab59379415 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.607387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-579f464e-924b-4fff-8a27-94ab59379415 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.991780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-579f464e-924b-4fff-8a27-94ab59379415 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:47.006569 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-579f464e-924b-4fff-8a27-94ab59379415 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1324 microversion: 2.1 time: 0.436442 Jul 20 04:21:47.009601 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1639/3320] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:46 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:47.015546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-967cb99e-3545-4b25-ae2b-5eea24c9a5a5 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841b6cf70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:47.115673 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-967cb99e-3545-4b25-ae2b-5eea24c9a5a5 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.104419 Jul 20 04:21:47.116593 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1640/3321] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:47 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:48.025903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-98e0f6ea-451d-4da4-a7b3-bc4f18ee0c1a tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.027312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-98e0f6ea-451d-4da4-a7b3-bc4f18ee0c1a tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:48.044333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98e0f6ea-451d-4da4-a7b3-bc4f18ee0c1a tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.048057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98e0f6ea-451d-4da4-a7b3-bc4f18ee0c1a tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.059913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98e0f6ea-451d-4da4-a7b3-bc4f18ee0c1a tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.060708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98e0f6ea-451d-4da4-a7b3-bc4f18ee0c1a tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.726446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:48.825379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:49.369240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-98e0f6ea-451d-4da4-a7b3-bc4f18ee0c1a tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:49.380105 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-98e0f6ea-451d-4da4-a7b3-bc4f18ee0c1a tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1324 microversion: 2.1 time: 1.359248 Jul 20 04:21:49.396439 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1641/3322] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1324 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:49.402399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-13f6213c-9aef-4010-b9ce-c316a978eda4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8413afca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.505661 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-13f6213c-9aef-4010-b9ce-c316a978eda4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.110913 Jul 20 04:21:49.507157 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1642/3323] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:50.405954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e5a63c5a-0526-46a3-83ef-314b648b0f67 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.407481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e5a63c5a-0526-46a3-83ef-314b648b0f67 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.434882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5a63c5a-0526-46a3-83ef-314b648b0f67 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.438109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5a63c5a-0526-46a3-83ef-314b648b0f67 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.439463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5a63c5a-0526-46a3-83ef-314b648b0f67 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.440144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5a63c5a-0526-46a3-83ef-314b648b0f67 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.904507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e5a63c5a-0526-46a3-83ef-314b648b0f67 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:51.923378 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e5a63c5a-0526-46a3-83ef-314b648b0f67 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1324 microversion: 2.1 time: 1.523096 Jul 20 04:21:51.926509 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1643/3324] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1324 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:51.931326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-afe03ce2-3bf7-42bd-b4ce-a37b0cd94203 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8414dcee0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:52.126622 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-afe03ce2-3bf7-42bd-b4ce-a37b0cd94203 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.198881 Jul 20 04:21:52.127758 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1644/3325] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:51 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:52.145495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ffbed8cf-16f5-4c39-9ae6-b03214ea1b6d req-de4f0d4a-6691-4650-b6ee-83a541f91955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40778e9-80ef-4eab-9be6-5278135b18b3", "tag": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:52.192984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ffbed8cf-16f5-4c39-9ae6-b03214ea1b6d req-de4f0d4a-6691-4650-b6ee-83a541f91955 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.193456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ffbed8cf-16f5-4c39-9ae6-b03214ea1b6d req-de4f0d4a-6691-4650-b6ee-83a541f91955 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.260039 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ffbed8cf-16f5-4c39-9ae6-b03214ea1b6d req-de4f0d4a-6691-4650-b6ee-83a541f91955 service nova] Creating event network-changed:a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf for instance f40778e9-80ef-4eab-9be6-5278135b18b3 on n-h2-760456-11 Jul 20 04:21:52.285051 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ffbed8cf-16f5-4c39-9ae6-b03214ea1b6d req-de4f0d4a-6691-4650-b6ee-83a541f91955 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147247 Jul 20 04:21:52.307861 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1645/3326] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:52.661120 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.network.neutron [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] re-assign floating IP 172.25.3.113 from instance f40778e9-80ef-4eab-9be6-5278135b18b3 Jul 20 04:21:52.807609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Building network info cache for instance {{(pid=119606) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:21:52.945019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d8bfd3ea-6b78-4cb0-ada0-7fb77f2e3c4f tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:52.945732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d8bfd3ea-6b78-4cb0-ada0-7fb77f2e3c4f tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:52.969460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8bfd3ea-6b78-4cb0-ada0-7fb77f2e3c4f tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.973590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8bfd3ea-6b78-4cb0-ada0-7fb77f2e3c4f tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.974552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8bfd3ea-6b78-4cb0-ada0-7fb77f2e3c4f tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:52.975146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8bfd3ea-6b78-4cb0-ada0-7fb77f2e3c4f tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.993414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d8bfd3ea-6b78-4cb0-ada0-7fb77f2e3c4f tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:54.003154 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d8bfd3ea-6b78-4cb0-ada0-7fb77f2e3c4f tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1324 microversion: 2.1 time: 1.066010 Jul 20 04:21:54.010959 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1646/3327] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:52 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1324 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:54.020894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5fb63873-113e-4d78-80ff-6cc7007ab858 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841c3d310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:55.362387 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5fb63873-113e-4d78-80ff-6cc7007ab858 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 1.349333 Jul 20 04:21:55.363101 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1647/3328] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:54 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:55.370143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-75f6c949-e726-4e79-8d28-c946b0f6a730 req-84dbf191-e0a9-428a-87ca-7a00b1f30948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc307fe-a5b4-4927-8259-8a39f4c285a5", "name": "network-vif-plugged", "status": "completed", "tag": "91db1983-b6f1-4827-b8f0-2f9bb29f683f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:55.419985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-75f6c949-e726-4e79-8d28-c946b0f6a730 req-84dbf191-e0a9-428a-87ca-7a00b1f30948 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.436090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-75f6c949-e726-4e79-8d28-c946b0f6a730 req-84dbf191-e0a9-428a-87ca-7a00b1f30948 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.469987 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-75f6c949-e726-4e79-8d28-c946b0f6a730 req-84dbf191-e0a9-428a-87ca-7a00b1f30948 service nova] Creating event network-vif-plugged:91db1983-b6f1-4827-b8f0-2f9bb29f683f for instance 9fc307fe-a5b4-4927-8259-8a39f4c285a5 on n-h1-760456-11 Jul 20 04:21:55.489887 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-75f6c949-e726-4e79-8d28-c946b0f6a730 req-84dbf191-e0a9-428a-87ca-7a00b1f30948 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125284 Jul 20 04:21:55.491791 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1648/3329] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:55.501247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Updating instance_info_cache with network_info: [{"id": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf", "address": "fa:16:3e:5b:75:53", "network": {"id": "7bbaa421-7466-416c-83a5-4f1686a26f31", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977127072-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b4143a2971b4c41bfa5e239dd7e1708", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa63e1ea1-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119606) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:21:55.524205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f1b4111b-b49a-4cc1-81e0-0d1fb71799e8 req-a268a7d0-e875-4ee3-8831-ea2d7ec064a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1657dd8-66a9-456b-b106-9855a89dcc39", "tag": "0e5a62c4-f69c-443a-a839-48bbac5c77a9"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:55.532022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Building network info cache for instance {{(pid=119606) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:21:55.552221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f1b4111b-b49a-4cc1-81e0-0d1fb71799e8 req-a268a7d0-e875-4ee3-8831-ea2d7ec064a3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.565541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f1b4111b-b49a-4cc1-81e0-0d1fb71799e8 req-a268a7d0-e875-4ee3-8831-ea2d7ec064a3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.623550 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f1b4111b-b49a-4cc1-81e0-0d1fb71799e8 req-a268a7d0-e875-4ee3-8831-ea2d7ec064a3 service nova] Creating event network-changed:0e5a62c4-f69c-443a-a839-48bbac5c77a9 for instance a1657dd8-66a9-456b-b106-9855a89dcc39 on n-h2-760456-11 Jul 20 04:21:55.669256 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f1b4111b-b49a-4cc1-81e0-0d1fb71799e8 req-a268a7d0-e875-4ee3-8831-ea2d7ec064a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167977 Jul 20 04:21:55.670346 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1649/3330] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:55.684201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bb259ad-22c9-4c59-bc14-dc218c90300c tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:55.704010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6bb259ad-22c9-4c59-bc14-dc218c90300c tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:55.731593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bb259ad-22c9-4c59-bc14-dc218c90300c tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.755995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bb259ad-22c9-4c59-bc14-dc218c90300c tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.762183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bb259ad-22c9-4c59-bc14-dc218c90300c tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.769875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bb259ad-22c9-4c59-bc14-dc218c90300c tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.320698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6bb259ad-22c9-4c59-bc14-dc218c90300c tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:57.343216 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6bb259ad-22c9-4c59-bc14-dc218c90300c tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1324 microversion: 2.1 time: 1.666531 Jul 20 04:21:57.355018 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1650/3331] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:55 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1324 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:57.367575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a665a5c0-0297-4f92-a188-a5e59a8ca1fb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Action: 'create', calling method: .version_select at 0x7fb8413af0d0>, body: {"keypair": {"name": "tempest-keypair-1771184430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJljCcNSejfCv61PJ1AaPiVnANd0eHlVa4WFtDxN2Ul6+RyRfTYbfXB/TbITcOn8A6dSTY2VGpc5AN/2gRGcEOiAJycls0GdSlq06htopjID0MpjwSuYUwOA2hckfpceYQ=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:57.451152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a665a5c0-0297-4f92-a188-a5e59a8ca1fb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Getting quotas for project 1b85c906b4a2497f88c62f8b2c021ae5. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:57.470470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a665a5c0-0297-4f92-a188-a5e59a8ca1fb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Getting quotas for user 0b4c2a58aa4047368a21fcc59bcdb42d and project 1b85c906b4a2497f88c62f8b2c021ae5. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:57.547582 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a665a5c0-0297-4f92-a188-a5e59a8ca1fb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.189412 Jul 20 04:21:57.548212 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1651/3332] 10.222.0.59 () {62 vars in 1199 bytes} [Wed Jul 20 04:21:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:21:57.566243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ee68432b-34bb-491b-b8c7-2c4fec98b941 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8414c2160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:57.682780 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ee68432b-34bb-491b-b8c7-2c4fec98b941 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.131390 Jul 20 04:21:57.684007 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1652/3333] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:57 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:57.738679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Updating instance_info_cache with network_info: [{"id": "0e5a62c4-f69c-443a-a839-48bbac5c77a9", "address": "fa:16:3e:99:f6:3f", "network": {"id": "7bbaa421-7466-416c-83a5-4f1686a26f31", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977127072-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b4143a2971b4c41bfa5e239dd7e1708", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0e5a62c4-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119606) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:21:57.767818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Releasing lock "refresh_cache-a1657dd8-66a9-456b-b106-9855a89dcc39" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:21:57.771600 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d184dc0b-3304-4358-b397-c971b4047b9c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "POST /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39/action" status: 202 len: 0 microversion: 2.1 time: 19.060671 Jul 20 04:21:57.779890 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1682/3334] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:38 2022] POST /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39/action => generated 0 bytes in 19072 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 20 04:21:57.784391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-44a54d18-7133-4fcc-b5ab-9d7aca2017f1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.113"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:58.360977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-82ff1210-2c74-4b67-8104-7b424b7630d6 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:58.361803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-82ff1210-2c74-4b67-8104-7b424b7630d6 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:58.380276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82ff1210-2c74-4b67-8104-7b424b7630d6 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.385143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82ff1210-2c74-4b67-8104-7b424b7630d6 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.386368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82ff1210-2c74-4b67-8104-7b424b7630d6 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.387187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82ff1210-2c74-4b67-8104-7b424b7630d6 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.743035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-44a54d18-7133-4fcc-b5ab-9d7aca2017f1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:58.778749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44a54d18-7133-4fcc-b5ab-9d7aca2017f1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.780378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44a54d18-7133-4fcc-b5ab-9d7aca2017f1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.782818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44a54d18-7133-4fcc-b5ab-9d7aca2017f1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.783812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44a54d18-7133-4fcc-b5ab-9d7aca2017f1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.381081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-82ff1210-2c74-4b67-8104-7b424b7630d6 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:59.397786 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-82ff1210-2c74-4b67-8104-7b424b7630d6 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1521 microversion: 2.1 time: 1.037928 Jul 20 04:21:59.399688 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1683/3335] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:58 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1521 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:59.415018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-75c252cf-75df-459f-a90f-b3640630fd2f tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f19b80>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:59.490824 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-44a54d18-7133-4fcc-b5ab-9d7aca2017f1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] HTTP exception thrown: Floating IP 172.25.3.113 is not associated with instance f40778e9-80ef-4eab-9be6-5278135b18b3. Jul 20 04:21:59.490950 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-75c252cf-75df-459f-a90f-b3640630fd2f tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.089154 Jul 20 04:21:59.491291 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1684/3336] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:21:59 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-44a54d18-7133-4fcc-b5ab-9d7aca2017f1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Request method failure captured: Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3/action HTTP/1.1 Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 49 Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14KeNvGHy6PNEnT75u5szPiYf2L5qcJnzuC4THldXexzH1iN1c4yfuBXofYFFKsOH4mcPZmXj5CMkqQJ5Avi8w6hWNoSV73szh1RLa5ZL7wYvPDhCFNXIpBQbZr3K6GhqXKIreAjFSGjQw5oyXBaR5E5ldWcXpJnRyf6LwdKgEmybWg Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 3b4143a2971b4c41bfa5e239dd7e1708 Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 3b4143a2971b4c41bfa5e239dd7e1708 Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-FloatingIPsAssociationTestJSON-1413959626-project Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f4e63bfb5d954ec5b4cb7f4d89c0cfc0 Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1413959626-project Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: {"removeFloatingIp": {"address": "172.25.3.113"}} Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: exception: Floating IP 172.25.3.113 is not associated with instance f40778e9-80ef-4eab-9be6-5278135b18b3. Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'f40778e9-80ef-4eab-9be6-5278135b18b3', 'body': {'removeFloatingIp': {'address': '172.25.3.113'}}} Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.113 is not associated with instance f40778e9-80ef-4eab-9be6-5278135b18b3. Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.113 is not associated with instance f40778e9-80ef-4eab-9be6-5278135b18b3. Jul 20 04:21:59.492925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:59.499373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-44a54d18-7133-4fcc-b5ab-9d7aca2017f1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Returning 409 to user: Floating IP 172.25.3.113 is not associated with instance f40778e9-80ef-4eab-9be6-5278135b18b3. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:59.500419 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-44a54d18-7133-4fcc-b5ab-9d7aca2017f1 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "POST /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3/action" status: 409 len: 146 microversion: 2.1 time: 1.722145 Jul 20 04:21:59.501184 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1653/3337] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:57 2022] POST /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3/action => generated 146 bytes in 1724 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:21:59.501562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c4874054-2b55-4c51-9f43-aaa4285fa30a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:59.509532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-94659c73-d15f-41a9-8623-d65fbe800f38 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:59.513215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-94659c73-d15f-41a9-8623-d65fbe800f38 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:59.523812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4874054-2b55-4c51-9f43-aaa4285fa30a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.524305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4874054-2b55-4c51-9f43-aaa4285fa30a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.524666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94659c73-d15f-41a9-8623-d65fbe800f38 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.525119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94659c73-d15f-41a9-8623-d65fbe800f38 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.525901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94659c73-d15f-41a9-8623-d65fbe800f38 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.526363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94659c73-d15f-41a9-8623-d65fbe800f38 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.564758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c4874054-2b55-4c51-9f43-aaa4285fa30a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Going to try to stop instance {{(pid=119606) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:21:59.604186 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-94659c73-d15f-41a9-8623-d65fbe800f38 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] HTTP exception thrown: Instance is not a member of specified network Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-94659c73-d15f-41a9-8623-d65fbe800f38 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Request method failure captured: Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5/ips/invalid HTTP/1.1 Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14LKJ-k2k1NNXWLVFRn6D52eJIHreoRfAywptHxs7YXQau4o-_gnLQNHc3X3GQotwJaKLqIU8sfjJD7QV0QjWsc4Cm4Tp2Hf-dB6NFskM9Y1jnEz-V-YAmpBqSCZjK8EDW6ZMviH70DyuS5MhNFzXLpQoZp0F5xQwBE_ndTzcugLZqA Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 5969026baa244a18be350ba03d29cfaf Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1190498701 Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5969026baa244a18be350ba03d29cfaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5969026baa244a18be350ba03d29cfaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5969026baa244a18be350ba03d29cfaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5969026baa244a18be350ba03d29cfaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1190498701 Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 5969026baa244a18be350ba03d29cfaf Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1190498701 Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerAddressesNegativeTestJSON-1190498701-project Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8c53201bb24d40d7b988aaffd632d3bb Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1190498701-project Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance is not a member of specified network Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'server_id': '9fc307fe-a5b4-4927-8259-8a39f4c285a5', 'id': 'invalid'} Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 20 04:21:59.615693 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:21:59.621531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-94659c73-d15f-41a9-8623-d65fbe800f38 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:59.623026 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c4874054-2b55-4c51-9f43-aaa4285fa30a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/action" status: 202 len: 0 microversion: 2.1 time: 0.130357 Jul 20 04:21:59.624399 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1685/3338] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:59 2022] POST /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:59.631567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.113"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:59.643101 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-94659c73-d15f-41a9-8623-d65fbe800f38 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.137954 Jul 20 04:21:59.644083 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1654/3339] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:59 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5/ips/invalid => generated 91 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:59.661471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26479224-2b8b-46ad-bfaf-b19ecb364fdb tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:59.665718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-26479224-2b8b-46ad-bfaf-b19ecb364fdb tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:59.700328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26479224-2b8b-46ad-bfaf-b19ecb364fdb tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.701238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26479224-2b8b-46ad-bfaf-b19ecb364fdb tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.704796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26479224-2b8b-46ad-bfaf-b19ecb364fdb tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.711725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26479224-2b8b-46ad-bfaf-b19ecb364fdb tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.907466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:59.915769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.916491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.918116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.924113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.131141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-26479224-2b8b-46ad-bfaf-b19ecb364fdb tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:00.150556 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-26479224-2b8b-46ad-bfaf-b19ecb364fdb tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1678 microversion: 2.1 time: 0.491435 Jul 20 04:22:00.162421 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1655/3340] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:59 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1678 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:00.173677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dcc1fb1f-2ef0-4e37-b35b-101418950aef tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:00.181515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dcc1fb1f-2ef0-4e37-b35b-101418950aef tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Failed to fetch instance by id 999 {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:22:00.185942 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-dcc1fb1f-2ef0-4e37-b35b-101418950aef tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] HTTP exception thrown: Instance 999 could not be found. Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dcc1fb1f-2ef0-4e37-b35b-101418950aef tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Request method failure captured: Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14LKJ-k2k1NNXWLVFRn6D52eJIHreoRfAywptHxs7YXQau4o-_gnLQNHc3X3GQotwJaKLqIU8sfjJD7QV0QjWsc4Cm4Tp2Hf-dB6NFskM9Y1jnEz-V-YAmpBqSCZjK8EDW6ZMviH70DyuS5MhNFzXLpQoZp0F5xQwBE_ndTzcugLZqA Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 5969026baa244a18be350ba03d29cfaf Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1190498701 Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5969026baa244a18be350ba03d29cfaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5969026baa244a18be350ba03d29cfaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5969026baa244a18be350ba03d29cfaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5969026baa244a18be350ba03d29cfaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1190498701 Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 5969026baa244a18be350ba03d29cfaf Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1190498701 Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerAddressesNegativeTestJSON-1190498701-project Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8c53201bb24d40d7b988aaffd632d3bb Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1190498701-project Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 999 could not be found. Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'server_id': '999'} Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 20 04:22:00.189581 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:00.200764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dcc1fb1f-2ef0-4e37-b35b-101418950aef tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:00.200764 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dcc1fb1f-2ef0-4e37-b35b-101418950aef tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.028810 Jul 20 04:22:00.200764 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1656/3341] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:22:00 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:22:00.208095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b7a192d-2ad7-4f10-bc3f-02cd847ed9a3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:00.208996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b7a192d-2ad7-4f10-bc3f-02cd847ed9a3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:00.222484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b7a192d-2ad7-4f10-bc3f-02cd847ed9a3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.223372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b7a192d-2ad7-4f10-bc3f-02cd847ed9a3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.224890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b7a192d-2ad7-4f10-bc3f-02cd847ed9a3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.225661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b7a192d-2ad7-4f10-bc3f-02cd847ed9a3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.297133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b7a192d-2ad7-4f10-bc3f-02cd847ed9a3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:00.306097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:00.471536 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b7a192d-2ad7-4f10-bc3f-02cd847ed9a3 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 204 len: 0 microversion: 2.1 time: 0.268513 Jul 20 04:22:00.476427 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1657/3342] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:00 2022] DELETE /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:00.488102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80b1bb26-5087-4b47-bafd-60a50db2b9b1 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:00.489453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-80b1bb26-5087-4b47-bafd-60a50db2b9b1 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:00.513785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80b1bb26-5087-4b47-bafd-60a50db2b9b1 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.514286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80b1bb26-5087-4b47-bafd-60a50db2b9b1 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.518621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80b1bb26-5087-4b47-bafd-60a50db2b9b1 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.519215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80b1bb26-5087-4b47-bafd-60a50db2b9b1 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.994606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Acquired lock "refresh_cache-a1657dd8-66a9-456b-b106-9855a89dcc39" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:22:01.085605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-80b1bb26-5087-4b47-bafd-60a50db2b9b1 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:01.116503 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-80b1bb26-5087-4b47-bafd-60a50db2b9b1 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1527 microversion: 2.1 time: 0.637950 Jul 20 04:22:01.119393 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1658/3343] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:00 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1527 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:01.158783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0370c0ee-7e93-4dbf-9798-62266a2724a6 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841488430>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.247029 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0370c0ee-7e93-4dbf-9798-62266a2724a6 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1424 microversion: 2.1 time: 0.125010 Jul 20 04:22:01.254565 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1659/3344] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1424 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:01.261850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d55e692f-4271-4bce-9d84-bf2caeecce31 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.268456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d55e692f-4271-4bce-9d84-bf2caeecce31 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.279451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d55e692f-4271-4bce-9d84-bf2caeecce31 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.281044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d55e692f-4271-4bce-9d84-bf2caeecce31 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.282210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d55e692f-4271-4bce-9d84-bf2caeecce31 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.282868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d55e692f-4271-4bce-9d84-bf2caeecce31 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.707162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d55e692f-4271-4bce-9d84-bf2caeecce31 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:01.715003 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d55e692f-4271-4bce-9d84-bf2caeecce31 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1678 microversion: 2.1 time: 0.458632 Jul 20 04:22:01.715590 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1660/3345] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1678 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:02.140435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89eb26d4-8d63-4170-9eb0-3286ed343c92 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:02.141052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-89eb26d4-8d63-4170-9eb0-3286ed343c92 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:02.150691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89eb26d4-8d63-4170-9eb0-3286ed343c92 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.160924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89eb26d4-8d63-4170-9eb0-3286ed343c92 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.161519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89eb26d4-8d63-4170-9eb0-3286ed343c92 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.161519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89eb26d4-8d63-4170-9eb0-3286ed343c92 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.953389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89eb26d4-8d63-4170-9eb0-3286ed343c92 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.969140 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89eb26d4-8d63-4170-9eb0-3286ed343c92 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1527 microversion: 2.1 time: 0.833552 Jul 20 04:22:02.970384 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1661/3346] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:02 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1527 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:02.998571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8fb2a6e1-c63e-4364-b9dc-6325651518dc tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8413af8b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.087995 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8fb2a6e1-c63e-4364-b9dc-6325651518dc tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1433 microversion: 2.1 time: 0.113878 Jul 20 04:22:03.095799 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1662/3347] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:02 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1433 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:03.117222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2277446e-59f5-4eac-8da4-ba507faa7c74 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.117849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2277446e-59f5-4eac-8da4-ba507faa7c74 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.134081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2277446e-59f5-4eac-8da4-ba507faa7c74 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.147002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2277446e-59f5-4eac-8da4-ba507faa7c74 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.147862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2277446e-59f5-4eac-8da4-ba507faa7c74 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.148308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2277446e-59f5-4eac-8da4-ba507faa7c74 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.739312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2277446e-59f5-4eac-8da4-ba507faa7c74 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.755006 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2277446e-59f5-4eac-8da4-ba507faa7c74 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1678 microversion: 2.1 time: 0.656910 Jul 20 04:22:03.760686 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1663/3348] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1678 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:03.770917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6755863-c822-4f97-8142-c50d1b9a1c90 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8413af8b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.866808 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6755863-c822-4f97-8142-c50d1b9a1c90 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 200 len: 1433 microversion: 2.1 time: 0.104131 Jul 20 04:22:03.869998 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1664/3349] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 1433 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:03.910064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6802329c-81ab-4df2-a51f-dac362315c60 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.912225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6802329c-81ab-4df2-a51f-dac362315c60 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.941063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6802329c-81ab-4df2-a51f-dac362315c60 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.941879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6802329c-81ab-4df2-a51f-dac362315c60 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.944372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6802329c-81ab-4df2-a51f-dac362315c60 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.945148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6802329c-81ab-4df2-a51f-dac362315c60 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.070241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Building network info cache for instance {{(pid=119606) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:22:05.035722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6802329c-81ab-4df2-a51f-dac362315c60 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:05.050785 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6802329c-81ab-4df2-a51f-dac362315c60 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1466 microversion: 2.1 time: 1.147080 Jul 20 04:22:05.051408 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1665/3350] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1466 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:05.082841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:05.083610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:05.103612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.104277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.106024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.106621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.201391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.201950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.202531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lazy-loading 'fault' on Instance uuid 9fc307fe-a5b4-4927-8259-8a39f4c285a5 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:05.344954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c53201bb24d40d7b988aaffd632d3bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5969026baa244a18be350ba03d29cfaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:05.362065 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-45374c95-a64d-45ef-8145-9da4ba3ba493 tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 200 len: 1314 microversion: 2.1 time: 0.287695 Jul 20 04:22:05.363001 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1666/3351] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:05 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:05.369275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-136ed8b5-9dad-4a1c-8c01-06e9693a4db1 req-1c86f413-b9ce-4e2b-a11d-1879d1950470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1657dd8-66a9-456b-b106-9855a89dcc39", "tag": "0e5a62c4-f69c-443a-a839-48bbac5c77a9"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:05.382240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-136ed8b5-9dad-4a1c-8c01-06e9693a4db1 req-1c86f413-b9ce-4e2b-a11d-1879d1950470 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.383070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-136ed8b5-9dad-4a1c-8c01-06e9693a4db1 req-1c86f413-b9ce-4e2b-a11d-1879d1950470 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.409271 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-136ed8b5-9dad-4a1c-8c01-06e9693a4db1 req-1c86f413-b9ce-4e2b-a11d-1879d1950470 service nova] Creating event network-changed:0e5a62c4-f69c-443a-a839-48bbac5c77a9 for instance a1657dd8-66a9-456b-b106-9855a89dcc39 on n-h2-760456-11 Jul 20 04:22:05.423876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-136ed8b5-9dad-4a1c-8c01-06e9693a4db1 req-1c86f413-b9ce-4e2b-a11d-1879d1950470 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055505 Jul 20 04:22:05.426911 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1667/3352] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:05.440051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-187074523", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "46906678-6b36-4498-ab77-df30aebe6e38"}, {"port": "f444e47b-8c44-41a2-8d8d-dc1251412040", "tag": "port-1"}, {"port": "a9b48c51-1561-4d97-9677-27009946bf45", "tag": "port-2"}, {"uuid": "6ee89142-632d-4197-97a9-bed4a7fb16c8", "tag": "net-1"}, {"uuid": "6ee89142-632d-4197-97a9-bed4a7fb16c8"}, {"uuid": "ff7cbb57-b206-4f4a-a129-3af50cd40c89", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ff7cbb57-b206-4f4a-a129-3af50cd40c89", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "17326161-ef8b-4d42-856c-ad4fade74fae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5b006925-282c-470f-a4fd-7156e76e9488", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a5211c46-790e-4be9-be51-6e73a832f8c4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--771036885"}], "key_name": "tempest-keypair-1771184430", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:05.736600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Updating instance_info_cache with network_info: [{"id": "0e5a62c4-f69c-443a-a839-48bbac5c77a9", "address": "fa:16:3e:99:f6:3f", "network": {"id": "7bbaa421-7466-416c-83a5-4f1686a26f31", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977127072-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b4143a2971b4c41bfa5e239dd7e1708", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0e5a62c4-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119606) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:22:05.754800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Releasing lock "refresh_cache-a1657dd8-66a9-456b-b106-9855a89dcc39" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:22:05.756116 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-784ddc0f-7df7-40e9-90b8-5af81f594a70 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "POST /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39/action" status: 202 len: 0 microversion: 2.1 time: 6.130354 Jul 20 04:22:05.756971 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1686/3353] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:59 2022] POST /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39/action => generated 0 bytes in 6132 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:22:05.775155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b8bc3d0b-ed05-4049-9458-7e42d68c49c2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:05.777176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b8bc3d0b-ed05-4049-9458-7e42d68c49c2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:05.803848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8bc3d0b-ed05-4049-9458-7e42d68c49c2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.804315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8bc3d0b-ed05-4049-9458-7e42d68c49c2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.805416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8bc3d0b-ed05-4049-9458-7e42d68c49c2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.806032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8bc3d0b-ed05-4049-9458-7e42d68c49c2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.809355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] validate_networks() for [('46906678-6b36-4498-ab77-df30aebe6e38', None, None, None, None, None), (None, None, 'f444e47b-8c44-41a2-8d8d-dc1251412040', None, None, None), (None, None, 'a9b48c51-1561-4d97-9677-27009946bf45', None, None, None), ('6ee89142-632d-4197-97a9-bed4a7fb16c8', None, None, None, None, None), ('6ee89142-632d-4197-97a9-bed4a7fb16c8', None, None, None, None, None), ('ff7cbb57-b206-4f4a-a129-3af50cd40c89', '10.2.2.100', None, None, None, None), ('ff7cbb57-b206-4f4a-a129-3af50cd40c89', '10.2.2.200', None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:06.394606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b8bc3d0b-ed05-4049-9458-7e42d68c49c2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:06.404462 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b8bc3d0b-ed05-4049-9458-7e42d68c49c2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1678 microversion: 2.1 time: 0.644510 Jul 20 04:22:06.407451 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1687/3354] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:05 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1678 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:06.415137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8154877f-be8a-4dad-ade1-3bc14d773707 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f5e8b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.493114 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8154877f-be8a-4dad-ade1-3bc14d773707 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e42aeec8-ce44-4145-9a4d-e614edbe956b" status: 200 len: 784 microversion: 2.1 time: 0.081604 Jul 20 04:22:06.495264 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1688/3355] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/images/e42aeec8-ce44-4145-9a4d-e614edbe956b => generated 784 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:06.500218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-23a77343-bee3-474b-b341-114bd7c6efae tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.500738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-23a77343-bee3-474b-b341-114bd7c6efae tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:06.516398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23a77343-bee3-474b-b341-114bd7c6efae tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.516854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23a77343-bee3-474b-b341-114bd7c6efae tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.521518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23a77343-bee3-474b-b341-114bd7c6efae tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.522779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23a77343-bee3-474b-b341-114bd7c6efae tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.575699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-23a77343-bee3-474b-b341-114bd7c6efae tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:06.712820 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-23a77343-bee3-474b-b341-114bd7c6efae tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 204 len: 0 microversion: 2.1 time: 0.216381 Jul 20 04:22:06.713440 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1689/3356] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:06 2022] DELETE /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:06.728179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9f8c53f2-69b1-4e66-a380-f55b5f9e0824 req-7da00de0-65c8-4c2f-9e2d-73180e7f4bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5081b1-8b7a-400a-b16c-fb21ebed6c5b", "name": "network-vif-unplugged", "status": "completed", "tag": "e3151488-9d50-447d-9855-2a8a94dea2fa"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:06.753704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9f8c53f2-69b1-4e66-a380-f55b5f9e0824 req-7da00de0-65c8-4c2f-9e2d-73180e7f4bd6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.755553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9f8c53f2-69b1-4e66-a380-f55b5f9e0824 req-7da00de0-65c8-4c2f-9e2d-73180e7f4bd6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.769190 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9f8c53f2-69b1-4e66-a380-f55b5f9e0824 req-7da00de0-65c8-4c2f-9e2d-73180e7f4bd6 service nova] Creating event network-vif-unplugged:e3151488-9d50-447d-9855-2a8a94dea2fa for instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b on n-h1-760456-11 Jul 20 04:22:06.774879 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9f8c53f2-69b1-4e66-a380-f55b5f9e0824 req-7da00de0-65c8-4c2f-9e2d-73180e7f4bd6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058711 Jul 20 04:22:06.776284 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1690/3357] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:06.782828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f12370a-c996-4a73-b29d-9faba57d61bb tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.783815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9f12370a-c996-4a73-b29d-9faba57d61bb tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] [instance: 9fc307fe-a5b4-4927-8259-8a39f4c285a5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:06.791707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f12370a-c996-4a73-b29d-9faba57d61bb tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.792612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f12370a-c996-4a73-b29d-9faba57d61bb tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.793620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f12370a-c996-4a73-b29d-9faba57d61bb tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.794237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f12370a-c996-4a73-b29d-9faba57d61bb tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.810289 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-9f12370a-c996-4a73-b29d-9faba57d61bb tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] HTTP exception thrown: Instance 9fc307fe-a5b4-4927-8259-8a39f4c285a5 could not be found. Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f12370a-c996-4a73-b29d-9faba57d61bb tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Request method failure captured: Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 HTTP/1.1 Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14LKJ-k2k1NNXWLVFRn6D52eJIHreoRfAywptHxs7YXQau4o-_gnLQNHc3X3GQotwJaKLqIU8sfjJD7QV0QjWsc4Cm4Tp2Hf-dB6NFskM9Y1jnEz-V-YAmpBqSCZjK8EDW6ZMviH70DyuS5MhNFzXLpQoZp0F5xQwBE_ndTzcugLZqA Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 5969026baa244a18be350ba03d29cfaf Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1190498701 Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5969026baa244a18be350ba03d29cfaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5969026baa244a18be350ba03d29cfaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5969026baa244a18be350ba03d29cfaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5969026baa244a18be350ba03d29cfaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1190498701 Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 5969026baa244a18be350ba03d29cfaf Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1190498701 Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerAddressesNegativeTestJSON-1190498701-project Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8c53201bb24d40d7b988aaffd632d3bb Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1190498701-project Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 9fc307fe-a5b4-4927-8259-8a39f4c285a5 could not be found. Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '9fc307fe-a5b4-4927-8259-8a39f4c285a5'} Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc307fe-a5b4-4927-8259-8a39f4c285a5 could not be found. Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc307fe-a5b4-4927-8259-8a39f4c285a5 could not be found. Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:06.811984 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:06.817006 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:06.817006 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:06.817006 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:06.817006 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:06.817006 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:06.817006 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:06.817006 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc307fe-a5b4-4927-8259-8a39f4c285a5 could not be found. Jul 20 04:22:06.817006 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:06.817006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f12370a-c996-4a73-b29d-9faba57d61bb tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] Returning 404 to user: Instance 9fc307fe-a5b4-4927-8259-8a39f4c285a5 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:06.817006 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f12370a-c996-4a73-b29d-9faba57d61bb tempest-ServerAddressesNegativeTestJSON-1190498701 tempest-ServerAddressesNegativeTestJSON-1190498701-project] 10.222.0.59 "GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5" status: 404 len: 111 microversion: 2.1 time: 0.035118 Jul 20 04:22:06.818963 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1691/3358] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/servers/9fc307fe-a5b4-4927-8259-8a39f4c285a5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:06.824260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a8b2d8f-fcf9-4efd-88fd-a6a257fe1987 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.833062 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a8b2d8f-fcf9-4efd-88fd-a6a257fe1987 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013925 Jul 20 04:22:06.833964 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1692/3359] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:06.838675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.113"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:06.840806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:06.847375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.848067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.849206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.849839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.877985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Acquired lock "refresh_cache-f40778e9-80ef-4eab-9be6-5278135b18b3" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:22:07.495104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:10.706634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Building network info cache for instance {{(pid=119606) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:22:12.600392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:12.601332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:12.601897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:12.602375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:12.602805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:12.615859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.616454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.617316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.617799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.643373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Getting quotas for project 1b85c906b4a2497f88c62f8b2c021ae5. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:12.650952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Getting quotas for user 0b4c2a58aa4047368a21fcc59bcdb42d and project 1b85c906b4a2497f88c62f8b2c021ae5. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:12.861175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Updating instance_info_cache with network_info: [{"id": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf", "address": "fa:16:3e:5b:75:53", "network": {"id": "7bbaa421-7466-416c-83a5-4f1686a26f31", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977127072-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b4143a2971b4c41bfa5e239dd7e1708", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa63e1ea1-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119606) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:22:12.887800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Releasing lock "refresh_cache-f40778e9-80ef-4eab-9be6-5278135b18b3" {{(pid=119606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:22:12.892485 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f84338b4-ce44-47e6-8465-dbfebe0da680 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "POST /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3/action" status: 202 len: 0 microversion: 2.1 time: 6.053617 Jul 20 04:22:12.897429 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1693/3360] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:06 2022] POST /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3/action => generated 0 bytes in 6063 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:22:12.921088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b8630933-5da0-4471-8f5e-b51474e37079 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f42e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:12.930719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:12.935017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='17326161-ef8b-4d42-856c-ad4fade74fae',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='5b006925-282c-470f-a4fd-7156e76e9488',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a5211c46-790e-4be9-be51-6e73a832f8c4',volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:13.542752 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2b64d320-0551-4931-b78c-f4d5f2aa3c1b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 8.104051 Jul 20 04:22:13.543704 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1668/3361] 10.222.0.59 () {62 vars in 1188 bytes} [Wed Jul 20 04:22:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 8116 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:22:13.552661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e87f3e34-b18a-49d0-a95d-d4fa27c343f8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:13.553415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e87f3e34-b18a-49d0-a95d-d4fa27c343f8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:13.564340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e87f3e34-b18a-49d0-a95d-d4fa27c343f8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.564976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e87f3e34-b18a-49d0-a95d-d4fa27c343f8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.565775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e87f3e34-b18a-49d0-a95d-d4fa27c343f8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.571178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e87f3e34-b18a-49d0-a95d-d4fa27c343f8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.301944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e87f3e34-b18a-49d0-a95d-d4fa27c343f8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.314892 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e87f3e34-b18a-49d0-a95d-d4fa27c343f8 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1655 microversion: 2.1 time: 0.770100 Jul 20 04:22:14.315504 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1669/3362] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:13 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1655 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:14.325477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-bf2b04e6-ca35-4c0c-b92f-e12a921d151d req-1b46115c-8a3a-4c8d-92c3-ad9e83117e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc307fe-a5b4-4927-8259-8a39f4c285a5", "name": "network-vif-deleted", "tag": "91db1983-b6f1-4827-b8f0-2f9bb29f683f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:14.354880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bf2b04e6-ca35-4c0c-b92f-e12a921d151d req-1b46115c-8a3a-4c8d-92c3-ad9e83117e1c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.355618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bf2b04e6-ca35-4c0c-b92f-e12a921d151d req-1b46115c-8a3a-4c8d-92c3-ad9e83117e1c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.390050 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-bf2b04e6-ca35-4c0c-b92f-e12a921d151d req-1b46115c-8a3a-4c8d-92c3-ad9e83117e1c service nova] Creating event network-vif-deleted:91db1983-b6f1-4827-b8f0-2f9bb29f683f for instance 9fc307fe-a5b4-4927-8259-8a39f4c285a5 on n-h1-760456-11 Jul 20 04:22:14.406030 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-bf2b04e6-ca35-4c0c-b92f-e12a921d151d req-1b46115c-8a3a-4c8d-92c3-ad9e83117e1c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087491 Jul 20 04:22:14.406987 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1670/3363] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:14.421884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e03b5a8e-e908-4734-a605-faaa33dcf3aa req-72914d4a-c19a-49b7-828f-a37e52f2829f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1657dd8-66a9-456b-b106-9855a89dcc39", "name": "network-vif-deleted", "tag": "0e5a62c4-f69c-443a-a839-48bbac5c77a9"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:14.457431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e03b5a8e-e908-4734-a605-faaa33dcf3aa req-72914d4a-c19a-49b7-828f-a37e52f2829f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.458011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e03b5a8e-e908-4734-a605-faaa33dcf3aa req-72914d4a-c19a-49b7-828f-a37e52f2829f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.514320 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e03b5a8e-e908-4734-a605-faaa33dcf3aa req-72914d4a-c19a-49b7-828f-a37e52f2829f service nova] Creating event network-vif-deleted:0e5a62c4-f69c-443a-a839-48bbac5c77a9 for instance a1657dd8-66a9-456b-b106-9855a89dcc39 on n-h2-760456-11 Jul 20 04:22:14.527727 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e03b5a8e-e908-4734-a605-faaa33dcf3aa req-72914d4a-c19a-49b7-828f-a37e52f2829f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117634 Jul 20 04:22:14.533111 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1671/3364] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:14.548398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1093cbab-1431-4d30-b21d-fe570f833486 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '.version_select at 0x7fb8413b35e0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:14.613743 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b8630933-5da0-4471-8f5e-b51474e37079 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "DELETE /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 204 len: 0 microversion: 2.1 time: 1.706328 Jul 20 04:22:14.614472 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1694/3365] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:12 2022] DELETE /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 0 bytes in 1716 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:14.624502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c8c0cd47-cf8a-42f8-b612-c4c4417a22a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:14.625424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c8c0cd47-cf8a-42f8-b612-c4c4417a22a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:14.742903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c8c0cd47-cf8a-42f8-b612-c4c4417a22a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.752228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c8c0cd47-cf8a-42f8-b612-c4c4417a22a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.757372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c8c0cd47-cf8a-42f8-b612-c4c4417a22a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.759374 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c8c0cd47-cf8a-42f8-b612-c4c4417a22a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1285 microversion: 2.32 time: 0.140509 Jul 20 04:22:14.772048 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1695/3366] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:14 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:14.778098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7668bdfe-9d8f-4b20-9a8e-0275f79d5908 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:14.795441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7668bdfe-9d8f-4b20-9a8e-0275f79d5908 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.795899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7668bdfe-9d8f-4b20-9a8e-0275f79d5908 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.843455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7668bdfe-9d8f-4b20-9a8e-0275f79d5908 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Going to try to start instance {{(pid=119606) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:22:14.946007 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7668bdfe-9d8f-4b20-9a8e-0275f79d5908 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/action" status: 202 len: 0 microversion: 2.1 time: 0.171588 Jul 20 04:22:14.952765 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1696/3367] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:14 2022] POST /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:14.960383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da2c08a4-f103-4db6-a995-791e0d899ce2 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f9ba60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:15.006385 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-da2c08a4-f103-4db6-a995-791e0d899ce2 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] HTTP exception thrown: Image not found. Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da2c08a4-f103-4db6-a995-791e0d899ce2 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Request method failure captured: Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc HTTP/1.1 Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14KrrMLkZY8jChwE3Do6iW5Twxd7E1rxPz2jgOlccYWfBF9AE9yfr742ed31EJqw5XOL8oj_QggR_KFs4TgVHdU1LPVQiiiS17_iTVKWUg5yNkQDzYRYO5tO8q4XTjYSJn7RN89WnJ62zlJ8gm6eKGivw3AA4cIeYwzGF3b3DCyvG9M Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: b22ea719d3fb404391fa4406e4dcf1da Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesOneServerTestJSON-1001535505 Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesOneServerTestJSON-1001535505 Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: b22ea719d3fb404391fa4406e4dcf1da Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1001535505 Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesOneServerTestJSON-1001535505-project Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 879e4546d27449039d4d8db2d3d933fb Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesOneServerTestJSON-1001535505-project Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: exception: Image not found. Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'e8e4da89-07d0-439f-bd49-a90950bf5adc'} Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e8e4da89-07d0-439f-bd49-a90950bf5adc Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:22:15.009892 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8e4da89-07d0-439f-bd49-a90950bf5adc could not be found. Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:22:15.020013 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:15.027154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da2c08a4-f103-4db6-a995-791e0d899ce2 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Returning 404 to user: Image not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:15.027154 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-da2c08a4-f103-4db6-a995-791e0d899ce2 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 404 len: 62 microversion: 2.1 time: 0.072174 Jul 20 04:22:15.032071 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1697/3368] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:14 2022] GET /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:22:15.499126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e1d3da14-7872-4d7e-86da-4d6d409e6816 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Action: 'create', calling method: .version_select at 0x7fb840ee7f70>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:15.555377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e1d3da14-7872-4d7e-86da-4d6d409e6816 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Getting quotas for project dc98b07b9c6845c0bfe444090db0fc5f. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:15.585515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e1d3da14-7872-4d7e-86da-4d6d409e6816 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Getting quotas for user 742e65dd1fd642e4baa1fb76f9081d1a and project dc98b07b9c6845c0bfe444090db0fc5f. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:15.778072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e1d3da14-7872-4d7e-86da-4d6d409e6816 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Getting quotas for project dc98b07b9c6845c0bfe444090db0fc5f. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:15.791064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e1d3da14-7872-4d7e-86da-4d6d409e6816 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Getting quotas for user 742e65dd1fd642e4baa1fb76f9081d1a and project dc98b07b9c6845c0bfe444090db0fc5f. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:15.822953 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e1d3da14-7872-4d7e-86da-4d6d409e6816 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.789175 Jul 20 04:22:15.824680 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1698/3369] 10.222.0.59 () {62 vars in 1213 bytes} [Wed Jul 20 04:22:15 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:22:15.833378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-749264bd-bacc-4685-90cb-0bc5901ba881 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:15.834898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-749264bd-bacc-4685-90cb-0bc5901ba881 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:15.845555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-749264bd-bacc-4685-90cb-0bc5901ba881 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.852627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-749264bd-bacc-4685-90cb-0bc5901ba881 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.853667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-749264bd-bacc-4685-90cb-0bc5901ba881 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.856199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-749264bd-bacc-4685-90cb-0bc5901ba881 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.886203 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1093cbab-1431-4d30-b21d-fe570f833486 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips/7c269c79-008a-4196-a604-095a894f7bf8" status: 200 len: 184 microversion: 2.1 time: 1.351038 Jul 20 04:22:15.899288 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1672/3370] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:22:14 2022] GET /compute/v2.1/os-floating-ips/7c269c79-008a-4196-a604-095a894f7bf8 => generated 184 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:15.930978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36381018-9a21-4c9e-85a6-36d1a9abae41 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1535376281"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:15.943792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-36381018-9a21-4c9e-85a6-36d1a9abae41 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:15.975448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36381018-9a21-4c9e-85a6-36d1a9abae41 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.978203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36381018-9a21-4c9e-85a6-36d1a9abae41 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.982625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36381018-9a21-4c9e-85a6-36d1a9abae41 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.984501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36381018-9a21-4c9e-85a6-36d1a9abae41 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.563692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-749264bd-bacc-4685-90cb-0bc5901ba881 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.576933 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-749264bd-bacc-4685-90cb-0bc5901ba881 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1664 microversion: 2.1 time: 0.750808 Jul 20 04:22:16.580752 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1699/3371] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:15 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1664 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:16.594115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08bd6023-4e2f-4044-8543-ebaad9f6ffe4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.594893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-08bd6023-4e2f-4044-8543-ebaad9f6ffe4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:16.604641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08bd6023-4e2f-4044-8543-ebaad9f6ffe4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.605531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08bd6023-4e2f-4044-8543-ebaad9f6ffe4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.606902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08bd6023-4e2f-4044-8543-ebaad9f6ffe4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.607565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08bd6023-4e2f-4044-8543-ebaad9f6ffe4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.661193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=83,nova_cell1:SAVEPOINT=4,nova_cell1:RELEASE=4,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:16.687762 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-36381018-9a21-4c9e-85a6-36d1a9abae41 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "POST /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b/action" status: 202 len: 0 microversion: 2.1 time: 0.781337 Jul 20 04:22:16.689114 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1673/3372] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:15 2022] POST /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:22:16.694803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-373d2ca3-4357-4673-8216-ab189b33c03a tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.699139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:16.714877 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-373d2ca3-4357-4673-8216-ab189b33c03a tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.024271 Jul 20 04:22:16.716075 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1674/3373] 10.222.0.59 () {60 vars in 1192 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:22:16.721380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.113"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:16.824922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-08bd6023-4e2f-4044-8543-ebaad9f6ffe4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.843630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-08bd6023-4e2f-4044-8543-ebaad9f6ffe4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.853681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-08bd6023-4e2f-4044-8543-ebaad9f6ffe4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.858948 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08bd6023-4e2f-4044-8543-ebaad9f6ffe4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1575 microversion: 2.32 time: 0.277016 Jul 20 04:22:16.882433 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1700/3374] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1575 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:16.888604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5f332214-9b40-48d9-a3c0-96bedc14ed5a req-50c4c991-af72-42bb-819a-04fad9440708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40778e9-80ef-4eab-9be6-5278135b18b3", "tag": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:16.909028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5f332214-9b40-48d9-a3c0-96bedc14ed5a req-50c4c991-af72-42bb-819a-04fad9440708 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.915308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5f332214-9b40-48d9-a3c0-96bedc14ed5a req-50c4c991-af72-42bb-819a-04fad9440708 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.944962 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5f332214-9b40-48d9-a3c0-96bedc14ed5a req-50c4c991-af72-42bb-819a-04fad9440708 service nova] Creating event network-changed:a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf for instance f40778e9-80ef-4eab-9be6-5278135b18b3 on n-h2-760456-11 Jul 20 04:22:16.958922 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5f332214-9b40-48d9-a3c0-96bedc14ed5a req-50c4c991-af72-42bb-819a-04fad9440708 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072734 Jul 20 04:22:16.961887 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1701/3375] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:16.970604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d88cdbaa-6f60-460e-9885-a64871c36a5d tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840e9ed30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.002771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:17.010313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.011943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.013478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.015665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.053906 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d88cdbaa-6f60-460e-9885-a64871c36a5d tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.090369 Jul 20 04:22:17.060975 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1702/3376] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:17.076324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-154376ab-a03f-44ef-a1c4-b3f62ce15c34 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.109910 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-154376ab-a03f-44ef-a1c4-b3f62ce15c34 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups/1039972d-da09-4268-a945-4feca3bc11a1" status: 200 len: 235 microversion: 2.64 time: 0.038099 Jul 20 04:22:17.110503 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1703/3377] 10.222.0.59 () {60 vars in 1303 bytes} [Wed Jul 20 04:22:17 2022] GET /compute/v2.1/os-server-groups/1039972d-da09-4268-a945-4feca3bc11a1 => generated 235 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:22:17.120491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cfc38963-0da8-4eb1-bf98-31f7ce2d4d45 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.225773 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cfc38963-0da8-4eb1-bf98-31f7ce2d4d45 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/1039972d-da09-4268-a945-4feca3bc11a1" status: 204 len: 0 microversion: 2.64 time: 0.109326 Jul 20 04:22:17.226933 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1704/3378] 10.222.0.59 () {60 vars in 1306 bytes} [Wed Jul 20 04:22:17 2022] DELETE /compute/v2.1/os-server-groups/1039972d-da09-4268-a945-4feca3bc11a1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:22:17.236055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9d7ef5c-5b48-408a-a932-fe480d2dca76 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.245346 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-c9d7ef5c-5b48-408a-a932-fe480d2dca76 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] HTTP exception thrown: Instance group 1039972d-da09-4268-a945-4feca3bc11a1 could not be found. Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9d7ef5c-5b48-408a-a932-fe480d2dca76 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Request method failure captured: Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-server-groups/1039972d-da09-4268-a945-4feca3bc11a1 HTTP/1.1 Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14L2O76ksIX9myP9ibYIMX4EuB9CPVvghvU-L2bYrgpvke2sxnLqFL1m1A47qdoUO1BJ3Q6zdZyiOZwc58u0HtGW0rszBuRp8CeTBU56oHCRk9PxqxZmDb3NKhtT32-My6K0q6Zma1WbWNEaFqBjz5My2cJIjiyGIE2zTROqigYhGaA Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.64 Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc98b07b9c6845c0bfe444090db0fc5f Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerGroup264TestJSON-265546655 Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc98b07b9c6845c0bfe444090db0fc5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc98b07b9c6845c0bfe444090db0fc5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc98b07b9c6845c0bfe444090db0fc5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc98b07b9c6845c0bfe444090db0fc5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerGroup264TestJSON-265546655 Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc98b07b9c6845c0bfe444090db0fc5f Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerGroup264TestJSON-265546655 Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerGroup264TestJSON-265546655-project Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 742e65dd1fd642e4baa1fb76f9081d1a Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerGroup264TestJSON-265546655-project Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance group 1039972d-da09-4268-a945-4feca3bc11a1 could not be found. Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '1039972d-da09-4268-a945-4feca3bc11a1'} Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1039972d-da09-4268-a945-4feca3bc11a1 could not be found. Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1039972d-da09-4268-a945-4feca3bc11a1 could not be found. Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:17.254897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:17.259364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:17.259364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:17.259364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:17.259364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:17.259364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1039972d-da09-4268-a945-4feca3bc11a1 could not be found. Jul 20 04:22:17.259364 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:17.261479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9d7ef5c-5b48-408a-a932-fe480d2dca76 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] Returning 404 to user: Instance group 1039972d-da09-4268-a945-4feca3bc11a1 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:17.262658 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c9d7ef5c-5b48-408a-a932-fe480d2dca76 tempest-ServerGroup264TestJSON-265546655 tempest-ServerGroup264TestJSON-265546655-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/1039972d-da09-4268-a945-4feca3bc11a1" status: 404 len: 117 microversion: 2.64 time: 0.030424 Jul 20 04:22:17.265818 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1705/3379] 10.222.0.59 () {60 vars in 1306 bytes} [Wed Jul 20 04:22:17 2022] DELETE /compute/v2.1/os-server-groups/1039972d-da09-4268-a945-4feca3bc11a1 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:22:17.565421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Acquired lock "refresh_cache-f40778e9-80ef-4eab-9be6-5278135b18b3" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:22:17.598361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e4d935d3-55a0-42ae-82fe-54fa653e9641 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.599467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e4d935d3-55a0-42ae-82fe-54fa653e9641 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:17.613626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4d935d3-55a0-42ae-82fe-54fa653e9641 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.616381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4d935d3-55a0-42ae-82fe-54fa653e9641 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.617556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4d935d3-55a0-42ae-82fe-54fa653e9641 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.619360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4d935d3-55a0-42ae-82fe-54fa653e9641 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.802010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e4d935d3-55a0-42ae-82fe-54fa653e9641 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:18.812595 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e4d935d3-55a0-42ae-82fe-54fa653e9641 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1668 microversion: 2.1 time: 1.218256 Jul 20 04:22:18.813795 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1706/3380] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:17 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1668 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:18.818814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8eef9b5c-7189-44aa-b092-8da57abc3b00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:18.827430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8eef9b5c-7189-44aa-b092-8da57abc3b00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:18.831872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:18.856058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eef9b5c-7189-44aa-b092-8da57abc3b00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.856810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eef9b5c-7189-44aa-b092-8da57abc3b00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.857963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eef9b5c-7189-44aa-b092-8da57abc3b00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.858607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eef9b5c-7189-44aa-b092-8da57abc3b00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.192645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8eef9b5c-7189-44aa-b092-8da57abc3b00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.211666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8eef9b5c-7189-44aa-b092-8da57abc3b00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.217847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8eef9b5c-7189-44aa-b092-8da57abc3b00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.220001 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8eef9b5c-7189-44aa-b092-8da57abc3b00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1593 microversion: 2.32 time: 0.404985 Jul 20 04:22:19.234235 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1707/3381] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:18 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1593 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:19.240796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1cf1ac53-8113-4454-847d-522b43a4eaae tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f5b820>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:19.363227 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1cf1ac53-8113-4454-847d-522b43a4eaae tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.124679 Jul 20 04:22:19.368944 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1708/3382] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:19 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:19.382786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Building network info cache for instance {{(pid=119605) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:22:19.415130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-0f11d5b6-e61a-4a5c-9fb3-72cff63edc8a req-e0ed8cb2-9dfa-4c5b-8e12-20a240721956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40778e9-80ef-4eab-9be6-5278135b18b3", "tag": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:19.443889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0f11d5b6-e61a-4a5c-9fb3-72cff63edc8a req-e0ed8cb2-9dfa-4c5b-8e12-20a240721956 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.444355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0f11d5b6-e61a-4a5c-9fb3-72cff63edc8a req-e0ed8cb2-9dfa-4c5b-8e12-20a240721956 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.468448 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-0f11d5b6-e61a-4a5c-9fb3-72cff63edc8a req-e0ed8cb2-9dfa-4c5b-8e12-20a240721956 service nova] Creating event network-changed:a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf for instance f40778e9-80ef-4eab-9be6-5278135b18b3 on n-h2-760456-11 Jul 20 04:22:19.479272 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-0f11d5b6-e61a-4a5c-9fb3-72cff63edc8a req-e0ed8cb2-9dfa-4c5b-8e12-20a240721956 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065391 Jul 20 04:22:19.485208 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1709/3383] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:20.242169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ff7adb3d-040f-40a6-989c-82651bc3bc49 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:20.243090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ff7adb3d-040f-40a6-989c-82651bc3bc49 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:20.268646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff7adb3d-040f-40a6-989c-82651bc3bc49 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.272240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff7adb3d-040f-40a6-989c-82651bc3bc49 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.273114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff7adb3d-040f-40a6-989c-82651bc3bc49 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.282042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff7adb3d-040f-40a6-989c-82651bc3bc49 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.778730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ff7adb3d-040f-40a6-989c-82651bc3bc49 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.795474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ff7adb3d-040f-40a6-989c-82651bc3bc49 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.797037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ff7adb3d-040f-40a6-989c-82651bc3bc49 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.804227 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ff7adb3d-040f-40a6-989c-82651bc3bc49 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1593 microversion: 2.32 time: 0.566260 Jul 20 04:22:20.818618 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1710/3384] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:20 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1593 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:20.834784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-eea3cb52-c2a3-4b63-9bcd-daed5f0addec tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f429d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:20.899710 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-eea3cb52-c2a3-4b63-9bcd-daed5f0addec tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.079679 Jul 20 04:22:20.906047 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1711/3385] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:20 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:21.377471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Updating instance_info_cache with network_info: [{"id": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf", "address": "fa:16:3e:5b:75:53", "network": {"id": "7bbaa421-7466-416c-83a5-4f1686a26f31", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977127072-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b4143a2971b4c41bfa5e239dd7e1708", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa63e1ea1-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119605) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:22:21.394359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Releasing lock "refresh_cache-f40778e9-80ef-4eab-9be6-5278135b18b3" {{(pid=119605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:22:21.396286 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-69c00d3f-1cb8-4f0b-b0c4-94a15dc26cd3 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "POST /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3/action" status: 202 len: 0 microversion: 2.1 time: 4.678990 Jul 20 04:22:21.404066 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1675/3386] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:16 2022] POST /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3/action => generated 0 bytes in 4687 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:22:21.408254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30665efe-22d3-4f26-9675-2ffc31e24e9e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.408760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-30665efe-22d3-4f26-9675-2ffc31e24e9e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.420376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30665efe-22d3-4f26-9675-2ffc31e24e9e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.420867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30665efe-22d3-4f26-9675-2ffc31e24e9e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.421717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30665efe-22d3-4f26-9675-2ffc31e24e9e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.422197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30665efe-22d3-4f26-9675-2ffc31e24e9e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.445579 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-30665efe-22d3-4f26-9675-2ffc31e24e9e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] HTTP exception thrown: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30665efe-22d3-4f26-9675-2ffc31e24e9e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Request method failure captured: Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 HTTP/1.1 Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14KeNvGHy6PNEnT75u5szPiYf2L5qcJnzuC4THldXexzH1iN1c4yfuBXofYFFKsOH4mcPZmXj5CMkqQJ5Avi8w6hWNoSV73szh1RLa5ZL7wYvPDhCFNXIpBQbZr3K6GhqXKIreAjFSGjQw5oyXBaR5E5ldWcXpJnRyf6LwdKgEmybWg Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 3b4143a2971b4c41bfa5e239dd7e1708 Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 3b4143a2971b4c41bfa5e239dd7e1708 Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FloatingIPsAssociationTestJSON-1413959626-project Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f4e63bfb5d954ec5b4cb7f4d89c0cfc0 Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1413959626-project Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'a1657dd8-66a9-456b-b106-9855a89dcc39'} Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:21.456679 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. Jul 20 04:22:21.462317 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.466941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30665efe-22d3-4f26-9675-2ffc31e24e9e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Returning 404 to user: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:21.468998 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-30665efe-22d3-4f26-9675-2ffc31e24e9e tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 404 len: 111 microversion: 2.1 time: 0.066063 Jul 20 04:22:21.472889 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1712/3387] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:21 2022] DELETE /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:22:21.481000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9bdc1dc-4a70-4703-a2c7-7f4c48292b24 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.481972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c9bdc1dc-4a70-4703-a2c7-7f4c48292b24 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: a1657dd8-66a9-456b-b106-9855a89dcc39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.493284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9bdc1dc-4a70-4703-a2c7-7f4c48292b24 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.493771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9bdc1dc-4a70-4703-a2c7-7f4c48292b24 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.494655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9bdc1dc-4a70-4703-a2c7-7f4c48292b24 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.499433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9bdc1dc-4a70-4703-a2c7-7f4c48292b24 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.538157 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c9bdc1dc-4a70-4703-a2c7-7f4c48292b24 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] HTTP exception thrown: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9bdc1dc-4a70-4703-a2c7-7f4c48292b24 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Request method failure captured: Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 HTTP/1.1 Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14KeNvGHy6PNEnT75u5szPiYf2L5qcJnzuC4THldXexzH1iN1c4yfuBXofYFFKsOH4mcPZmXj5CMkqQJ5Avi8w6hWNoSV73szh1RLa5ZL7wYvPDhCFNXIpBQbZr3K6GhqXKIreAjFSGjQw5oyXBaR5E5ldWcXpJnRyf6LwdKgEmybWg Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 3b4143a2971b4c41bfa5e239dd7e1708 Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 3b4143a2971b4c41bfa5e239dd7e1708 Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-FloatingIPsAssociationTestJSON-1413959626-project Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f4e63bfb5d954ec5b4cb7f4d89c0cfc0 Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1413959626-project Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'a1657dd8-66a9-456b-b106-9855a89dcc39'} Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.542930 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:21.547963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.547963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.547963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:21.547963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:21.547963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:21.547963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:21.547963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. Jul 20 04:22:21.547963 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.551145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9bdc1dc-4a70-4703-a2c7-7f4c48292b24 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Returning 404 to user: Instance a1657dd8-66a9-456b-b106-9855a89dcc39 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:21.556678 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c9bdc1dc-4a70-4703-a2c7-7f4c48292b24 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39" status: 404 len: 111 microversion: 2.1 time: 0.080863 Jul 20 04:22:21.560074 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1676/3388] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:21 2022] GET /compute/v2.1/servers/a1657dd8-66a9-456b-b106-9855a89dcc39 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:21.568673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bdc659b5-2763-4c30-af04-d38c43a5747c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '.version_select at 0x7fb840ee7ee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.824878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-25278a97-a443-4510-9c9c-90b10c029e00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.825843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-25278a97-a443-4510-9c9c-90b10c029e00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.844071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25278a97-a443-4510-9c9c-90b10c029e00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.847337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25278a97-a443-4510-9c9c-90b10c029e00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.849702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25278a97-a443-4510-9c9c-90b10c029e00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.852674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25278a97-a443-4510-9c9c-90b10c029e00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.041022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-25278a97-a443-4510-9c9c-90b10c029e00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.057914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-25278a97-a443-4510-9c9c-90b10c029e00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.063810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-25278a97-a443-4510-9c9c-90b10c029e00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.069255 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-25278a97-a443-4510-9c9c-90b10c029e00 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1593 microversion: 2.32 time: 0.247524 Jul 20 04:22:22.103763 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1677/3389] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:21 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1593 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:22.119025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-23ccc169-2552-4320-8c3b-4a7019324bc3 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8413b4dc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:22.213145 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-23ccc169-2552-4320-8c3b-4a7019324bc3 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.107223 Jul 20 04:22:22.214373 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1678/3390] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:22 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:22.238607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-61a7dab9-987d-4aaf-92f9-72b0dcbab1e3 req-421301f1-4dde-497e-8400-ab09d04a8e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5081b1-8b7a-400a-b16c-fb21ebed6c5b", "name": "network-vif-plugged", "status": "completed", "tag": "e3151488-9d50-447d-9855-2a8a94dea2fa"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:22.266399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-61a7dab9-987d-4aaf-92f9-72b0dcbab1e3 req-421301f1-4dde-497e-8400-ab09d04a8e0a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.267637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-61a7dab9-987d-4aaf-92f9-72b0dcbab1e3 req-421301f1-4dde-497e-8400-ab09d04a8e0a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.304193 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-61a7dab9-987d-4aaf-92f9-72b0dcbab1e3 req-421301f1-4dde-497e-8400-ab09d04a8e0a service nova] Creating event network-vif-plugged:e3151488-9d50-447d-9855-2a8a94dea2fa for instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b on n-h1-760456-11 Jul 20 04:22:22.320187 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-61a7dab9-987d-4aaf-92f9-72b0dcbab1e3 req-421301f1-4dde-497e-8400-ab09d04a8e0a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101852 Jul 20 04:22:22.326365 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1679/3391] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:23.110663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6d51194-f339-4e01-a718-3fcedd507071 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:23.112413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6d51194-f339-4e01-a718-3fcedd507071 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:23.130813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:23.136571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:23.149054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d51194-f339-4e01-a718-3fcedd507071 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.150302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d51194-f339-4e01-a718-3fcedd507071 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.154025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d51194-f339-4e01-a718-3fcedd507071 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.157472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d51194-f339-4e01-a718-3fcedd507071 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.174721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:24.423937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f6d51194-f339-4e01-a718-3fcedd507071 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.446578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f6d51194-f339-4e01-a718-3fcedd507071 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.451928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f6d51194-f339-4e01-a718-3fcedd507071 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.462844 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6d51194-f339-4e01-a718-3fcedd507071 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1660 microversion: 2.32 time: 1.352774 Jul 20 04:22:24.465910 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1680/3392] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:23 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1660 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:24.481032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2d97cd31-ea25-4bad-8db6-260869a00ad9 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8413465e0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.639310 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2d97cd31-ea25-4bad-8db6-260869a00ad9 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.170717 Jul 20 04:22:24.646547 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1681/3393] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:24 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:25.486381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1c62e23c-8eda-4f12-8ac8-b4b4ae1e46e4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:25.487976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1c62e23c-8eda-4f12-8ac8-b4b4ae1e46e4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:25.518010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c62e23c-8eda-4f12-8ac8-b4b4ae1e46e4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.520307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c62e23c-8eda-4f12-8ac8-b4b4ae1e46e4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.521393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c62e23c-8eda-4f12-8ac8-b4b4ae1e46e4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.523624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c62e23c-8eda-4f12-8ac8-b4b4ae1e46e4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.810839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=10 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:26.091504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1c62e23c-8eda-4f12-8ac8-b4b4ae1e46e4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.103937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1c62e23c-8eda-4f12-8ac8-b4b4ae1e46e4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.107440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1c62e23c-8eda-4f12-8ac8-b4b4ae1e46e4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.122779 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1c62e23c-8eda-4f12-8ac8-b4b4ae1e46e4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1660 microversion: 2.32 time: 0.641827 Jul 20 04:22:26.140060 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1682/3394] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:25 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1660 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:26.158002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8db98d52-95cc-4f7b-8010-3ffd4542c808 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841378dc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:26.249871 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8db98d52-95cc-4f7b-8010-3ffd4542c808 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.098643 Jul 20 04:22:26.250722 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1683/3395] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:26 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:26.609335 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bdc659b5-2763-4c30-af04-d38c43a5747c tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/7c269c79-008a-4196-a604-095a894f7bf8" status: 202 len: 0 microversion: 2.1 time: 5.044519 Jul 20 04:22:26.610101 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1713/3396] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:22:21 2022] DELETE /compute/v2.1/os-floating-ips/7c269c79-008a-4196-a604-095a894f7bf8 => generated 0 bytes in 5046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:26.618685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d954e42e-ab7b-460e-bd11-42720f47bbf2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:26.621707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d954e42e-ab7b-460e-bd11-42720f47bbf2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:26.632411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d954e42e-ab7b-460e-bd11-42720f47bbf2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.638226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d954e42e-ab7b-460e-bd11-42720f47bbf2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.639546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d954e42e-ab7b-460e-bd11-42720f47bbf2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.646096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d954e42e-ab7b-460e-bd11-42720f47bbf2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.748390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d954e42e-ab7b-460e-bd11-42720f47bbf2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:26.909298 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d954e42e-ab7b-460e-bd11-42720f47bbf2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 204 len: 0 microversion: 2.1 time: 0.292381 Jul 20 04:22:26.910962 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1684/3397] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:26 2022] DELETE /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:26.919795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f7c336cb-b08a-48fc-a30c-ae01bcba7be2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:26.920429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f7c336cb-b08a-48fc-a30c-ae01bcba7be2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:26.935459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7c336cb-b08a-48fc-a30c-ae01bcba7be2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.936151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7c336cb-b08a-48fc-a30c-ae01bcba7be2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.937126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7c336cb-b08a-48fc-a30c-ae01bcba7be2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.939991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7c336cb-b08a-48fc-a30c-ae01bcba7be2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.144742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b1ad7a03-471d-4e17-91c3-b16747087ef2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.145898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b1ad7a03-471d-4e17-91c3-b16747087ef2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:27.180034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1ad7a03-471d-4e17-91c3-b16747087ef2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.180034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1ad7a03-471d-4e17-91c3-b16747087ef2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.183306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1ad7a03-471d-4e17-91c3-b16747087ef2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.183908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1ad7a03-471d-4e17-91c3-b16747087ef2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.736329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b1ad7a03-471d-4e17-91c3-b16747087ef2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.753668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b1ad7a03-471d-4e17-91c3-b16747087ef2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.759746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b1ad7a03-471d-4e17-91c3-b16747087ef2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.770426 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b1ad7a03-471d-4e17-91c3-b16747087ef2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1660 microversion: 2.32 time: 0.630423 Jul 20 04:22:27.770724 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1685/3398] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1660 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:27.788356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-551452a0-1f05-4cc3-9ea2-f35afb80c966 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb8413ba790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.947220 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-551452a0-1f05-4cc3-9ea2-f35afb80c966 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/7d4e48c3-fdd4-47e4-94bc-83298ff1fc65" status: 200 len: 351 microversion: 2.1 time: 0.175137 Jul 20 04:22:27.949725 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1686/3399] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/os-volumes/7d4e48c3-fdd4-47e4-94bc-83298ff1fc65 => generated 351 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:27.954782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07951f0e-0b07-43f2-935c-2d933c607acb tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841378af0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:28.070744 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-07951f0e-0b07-43f2-935c-2d933c607acb tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.119530 Jul 20 04:22:28.074072 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1687/3400] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:28.476774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f7c336cb-b08a-48fc-a30c-ae01bcba7be2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.494050 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f7c336cb-b08a-48fc-a30c-ae01bcba7be2 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1526 microversion: 2.1 time: 1.579021 Jul 20 04:22:28.498016 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1714/3401] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:26 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1526 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:28.790138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ca3240c-d21b-4a5c-bfa9-abe99200a13e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:28.791120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ca3240c-d21b-4a5c-bfa9-abe99200a13e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:28.810476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ca3240c-d21b-4a5c-bfa9-abe99200a13e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.815494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ca3240c-d21b-4a5c-bfa9-abe99200a13e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.816644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ca3240c-d21b-4a5c-bfa9-abe99200a13e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.817271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ca3240c-d21b-4a5c-bfa9-abe99200a13e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.084642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-930d3282-1044-44dd-bc55-b3d180412ade tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840e5fd30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:29.178750 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-930d3282-1044-44dd-bc55-b3d180412ade tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.098174 Jul 20 04:22:29.180418 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1715/3402] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:29 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:29.514954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-927beb9e-e4f5-43c3-ba6f-0f166b6531a4 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:29.515945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-927beb9e-e4f5-43c3-ba6f-0f166b6531a4 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:29.527950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-927beb9e-e4f5-43c3-ba6f-0f166b6531a4 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.528605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-927beb9e-e4f5-43c3-ba6f-0f166b6531a4 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.532086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-927beb9e-e4f5-43c3-ba6f-0f166b6531a4 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.535145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-927beb9e-e4f5-43c3-ba6f-0f166b6531a4 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.260656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ca3240c-d21b-4a5c-bfa9-abe99200a13e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.280675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ca3240c-d21b-4a5c-bfa9-abe99200a13e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.283259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ca3240c-d21b-4a5c-bfa9-abe99200a13e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.284538 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ca3240c-d21b-4a5c-bfa9-abe99200a13e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1706 microversion: 2.32 time: 1.499333 Jul 20 04:22:30.301332 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1688/3403] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:28 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1706 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:30.320803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-76ea6867-29a5-433a-b208-0d4910077a99 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841378670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:30.423338 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-76ea6867-29a5-433a-b208-0d4910077a99 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.116833 Jul 20 04:22:30.430011 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1689/3404] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:30 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:30.512037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-927beb9e-e4f5-43c3-ba6f-0f166b6531a4 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.529940 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-927beb9e-e4f5-43c3-ba6f-0f166b6531a4 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1526 microversion: 2.1 time: 1.018734 Jul 20 04:22:30.533874 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1716/3405] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:29 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1526 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:30.930228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8aed209c-44dd-45e7-a77a-bbe952e2ee78 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb84136ef70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.039495 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8aed209c-44dd-45e7-a77a-bbe952e2ee78 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/bb7505f6-5526-42cd-a496-4d7a807746ee" status: 200 len: 350 microversion: 2.1 time: 0.113934 Jul 20 04:22:31.040672 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1690/3406] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:22:30 2022] GET /compute/v2.1/os-volumes/bb7505f6-5526-42cd-a496-4d7a807746ee => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:31.307405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-745d1fd3-3d7c-49be-90a0-e4814260688d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.308471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-745d1fd3-3d7c-49be-90a0-e4814260688d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.320956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-745d1fd3-3d7c-49be-90a0-e4814260688d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.328981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-745d1fd3-3d7c-49be-90a0-e4814260688d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.336273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-745d1fd3-3d7c-49be-90a0-e4814260688d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.337183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-745d1fd3-3d7c-49be-90a0-e4814260688d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.441215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c1cfd31d-de61-44b6-8ce9-a4fdccd62a1c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841c62e50>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.514747 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c1cfd31d-de61-44b6-8ce9-a4fdccd62a1c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.077631 Jul 20 04:22:31.516287 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1691/3407] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:31.551554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c47d4ec-8c05-4dea-a802-0a7ab539a068 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.552172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c47d4ec-8c05-4dea-a802-0a7ab539a068 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.561349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c47d4ec-8c05-4dea-a802-0a7ab539a068 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.561808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c47d4ec-8c05-4dea-a802-0a7ab539a068 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.574438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c47d4ec-8c05-4dea-a802-0a7ab539a068 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.575041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c47d4ec-8c05-4dea-a802-0a7ab539a068 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.908261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6c47d4ec-8c05-4dea-a802-0a7ab539a068 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e63bfb5d954ec5b4cb7f4d89c0cfc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4143a2971b4c41bfa5e239dd7e1708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.948873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6c47d4ec-8c05-4dea-a802-0a7ab539a068 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 200 len: 1484 microversion: 2.1 time: 0.400459 Jul 20 04:22:31.961548 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1692/3408] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 1484 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:31.973479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-745d1fd3-3d7c-49be-90a0-e4814260688d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.011586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-745d1fd3-3d7c-49be-90a0-e4814260688d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.013482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-745d1fd3-3d7c-49be-90a0-e4814260688d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.017287 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-745d1fd3-3d7c-49be-90a0-e4814260688d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1752 microversion: 2.32 time: 0.715884 Jul 20 04:22:32.029879 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1717/3409] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1752 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:32.114590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c048b5e5-59fc-4d74-912d-9242bc67e2b8 req-2c5a43ed-4730-42d1-92ef-466b45386114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40778e9-80ef-4eab-9be6-5278135b18b3", "name": "network-vif-deleted", "tag": "a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:32.139475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c048b5e5-59fc-4d74-912d-9242bc67e2b8 req-2c5a43ed-4730-42d1-92ef-466b45386114 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.149994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c048b5e5-59fc-4d74-912d-9242bc67e2b8 req-2c5a43ed-4730-42d1-92ef-466b45386114 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.199475 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c048b5e5-59fc-4d74-912d-9242bc67e2b8 req-2c5a43ed-4730-42d1-92ef-466b45386114 service nova] Creating event network-vif-deleted:a63e1ea1-8e83-45e2-91cd-6b6a9ff4ffcf for instance f40778e9-80ef-4eab-9be6-5278135b18b3 on n-h2-760456-11 Jul 20 04:22:32.224565 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c048b5e5-59fc-4d74-912d-9242bc67e2b8 req-2c5a43ed-4730-42d1-92ef-466b45386114 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117619 Jul 20 04:22:32.232890 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1693/3410] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:32.529664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5266cbac-45d3-426c-97ce-69759777e88d tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840e6cc10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.624002 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5266cbac-45d3-426c-97ce-69759777e88d tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.099612 Jul 20 04:22:32.634747 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1718/3411] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:32.994219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89bbaddc-c4da-4021-8863-f3c4b383bc91 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.995767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-89bbaddc-c4da-4021-8863-f3c4b383bc91 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] [instance: f40778e9-80ef-4eab-9be6-5278135b18b3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.021169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89bbaddc-c4da-4021-8863-f3c4b383bc91 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.022890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89bbaddc-c4da-4021-8863-f3c4b383bc91 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.025414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89bbaddc-c4da-4021-8863-f3c4b383bc91 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.028116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89bbaddc-c4da-4021-8863-f3c4b383bc91 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.037076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4f43858b-f619-47b0-bb53-b0ad7047c6b8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.038321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4f43858b-f619-47b0-bb53-b0ad7047c6b8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.054126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f43858b-f619-47b0-bb53-b0ad7047c6b8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.055135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f43858b-f619-47b0-bb53-b0ad7047c6b8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.059070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f43858b-f619-47b0-bb53-b0ad7047c6b8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.061797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f43858b-f619-47b0-bb53-b0ad7047c6b8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.095110 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-89bbaddc-c4da-4021-8863-f3c4b383bc91 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] HTTP exception thrown: Instance f40778e9-80ef-4eab-9be6-5278135b18b3 could not be found. Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89bbaddc-c4da-4021-8863-f3c4b383bc91 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Request method failure captured: Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 HTTP/1.1 Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14KeNvGHy6PNEnT75u5szPiYf2L5qcJnzuC4THldXexzH1iN1c4yfuBXofYFFKsOH4mcPZmXj5CMkqQJ5Avi8w6hWNoSV73szh1RLa5ZL7wYvPDhCFNXIpBQbZr3K6GhqXKIreAjFSGjQw5oyXBaR5E5ldWcXpJnRyf6LwdKgEmybWg Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 3b4143a2971b4c41bfa5e239dd7e1708 Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3b4143a2971b4c41bfa5e239dd7e1708"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 3b4143a2971b4c41bfa5e239dd7e1708 Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1413959626 Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-FloatingIPsAssociationTestJSON-1413959626-project Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f4e63bfb5d954ec5b4cb7f4d89c0cfc0 Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1413959626-project Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance f40778e9-80ef-4eab-9be6-5278135b18b3 could not be found. Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'f40778e9-80ef-4eab-9be6-5278135b18b3'} Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f40778e9-80ef-4eab-9be6-5278135b18b3 could not be found. Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f40778e9-80ef-4eab-9be6-5278135b18b3 could not be found. Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:33.102414 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:33.108034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:33.108034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:33.108034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:33.108034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:33.108034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:33.108034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:33.108034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f40778e9-80ef-4eab-9be6-5278135b18b3 could not be found. Jul 20 04:22:33.108034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:33.113460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89bbaddc-c4da-4021-8863-f3c4b383bc91 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] Returning 404 to user: Instance f40778e9-80ef-4eab-9be6-5278135b18b3 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:33.115508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89bbaddc-c4da-4021-8863-f3c4b383bc91 tempest-FloatingIPsAssociationTestJSON-1413959626 tempest-FloatingIPsAssociationTestJSON-1413959626-project] 10.222.0.59 "GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3" status: 404 len: 111 microversion: 2.1 time: 0.139194 Jul 20 04:22:33.119810 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1694/3412] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/servers/f40778e9-80ef-4eab-9be6-5278135b18b3 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:33.638565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6717a3e-ce41-4174-a5f1-935ac87e38fe tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841c623a0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.731917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4f43858b-f619-47b0-bb53-b0ad7047c6b8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.759862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4f43858b-f619-47b0-bb53-b0ad7047c6b8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.764454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4f43858b-f619-47b0-bb53-b0ad7047c6b8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.771113 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4f43858b-f619-47b0-bb53-b0ad7047c6b8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1798 microversion: 2.32 time: 0.737078 Jul 20 04:22:33.793865 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6717a3e-ce41-4174-a5f1-935ac87e38fe tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.159990 Jul 20 04:22:33.801511 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1719/3413] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1798 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:33.801777 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1695/3414] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:34.793874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3527f747-c34a-417c-9555-9fba38fa3c95 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:34.795661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3527f747-c34a-417c-9555-9fba38fa3c95 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:34.810838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-465b1edd-dfbf-40f0-a9f5-6034dfc585f8 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8428f5310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:34.827120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3527f747-c34a-417c-9555-9fba38fa3c95 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.842403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3527f747-c34a-417c-9555-9fba38fa3c95 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.843583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3527f747-c34a-417c-9555-9fba38fa3c95 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.853078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3527f747-c34a-417c-9555-9fba38fa3c95 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.908313 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-465b1edd-dfbf-40f0-a9f5-6034dfc585f8 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.094149 Jul 20 04:22:34.921357 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1696/3415] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:34 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:35.014775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9169269-8a68-4a65-8f8f-9a419812ac03 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb841329f70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.094818 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b9169269-8a68-4a65-8f8f-9a419812ac03 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/d5583045-60d3-4455-b2cf-6d60e908103d" status: 200 len: 351 microversion: 2.1 time: 0.079268 Jul 20 04:22:35.104974 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1697/3416] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/os-volumes/d5583045-60d3-4455-b2cf-6d60e908103d => generated 351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:35.110240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f68d5cae-6f26-4b22-b377-f7fc5dbc7895 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb841322670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.294610 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f68d5cae-6f26-4b22-b377-f7fc5dbc7895 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.188052 Jul 20 04:22:35.296026 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1698/3417] 10.222.0.59 () {58 vars in 1133 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:35.309127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-65414bc3-7653-4e69-9a40-470db2a9da52 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb841322af0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.474837 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-65414bc3-7653-4e69-9a40-470db2a9da52 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.169988 Jul 20 04:22:35.475938 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1699/3418] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:35.491321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d28d9148-0ee2-4b12-ba13-fadd76dc55d2 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb8424d5670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.630275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3527f747-c34a-417c-9555-9fba38fa3c95 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:35.641846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3527f747-c34a-417c-9555-9fba38fa3c95 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:35.653025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3527f747-c34a-417c-9555-9fba38fa3c95 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:35.654277 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3527f747-c34a-417c-9555-9fba38fa3c95 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1798 microversion: 2.32 time: 0.864604 Jul 20 04:22:35.680292 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d28d9148-0ee2-4b12-ba13-fadd76dc55d2 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.192628 Jul 20 04:22:35.683651 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1720/3419] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:34 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1798 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:35.693552 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1700/3420] 10.222.0.59 () {58 vars in 1133 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:35.698636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e5f4445e-43c9-47a6-bb5b-8acba8821005 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb840f73160>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.893358 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e5f4445e-43c9-47a6-bb5b-8acba8821005 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.199418 Jul 20 04:22:35.894230 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1721/3421] 10.222.0.59 () {58 vars in 1166 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:35.908600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b943c7ec-86d4-4a74-9a79-437e6a2e332c tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb841329820>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.924193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5dfa7d93-d36d-4517-b6e9-841c87c29153 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840e6c280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.055518 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5dfa7d93-d36d-4517-b6e9-841c87c29153 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.135073 Jul 20 04:22:36.056115 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1722/3422] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:36.192052 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b943c7ec-86d4-4a74-9a79-437e6a2e332c tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.287417 Jul 20 04:22:36.192976 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1701/3423] 10.222.0.59 () {58 vars in 1169 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:36.206185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-460d1721-2b42-4570-b659-882f76c5de10 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb840f739d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.471240 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-460d1721-2b42-4570-b659-882f76c5de10 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.268766 Jul 20 04:22:36.484006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-95888cbe-34db-45f1-be57-756a467747c8 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb8413b3d30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.488029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1723/3424] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:36.674272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d94bb147-435b-441a-86fb-ab756fa26aec tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.675201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d94bb147-435b-441a-86fb-ab756fa26aec tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:36.687484 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-95888cbe-34db-45f1-be57-756a467747c8 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.207512 Jul 20 04:22:36.689194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d94bb147-435b-441a-86fb-ab756fa26aec tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.691102 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1702/3425] 10.222.0.59 () {58 vars in 1187 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:36.692799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d94bb147-435b-441a-86fb-ab756fa26aec tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.693827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d94bb147-435b-441a-86fb-ab756fa26aec tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.695461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d94bb147-435b-441a-86fb-ab756fa26aec tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.706900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a778546a-f135-4ee2-bdf8-893e82cb8dc0 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] Calling method '.version_select at 0x7fb841322af0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.909947 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a778546a-f135-4ee2-bdf8-893e82cb8dc0 tempest-VolumesTestJSON-749509054 tempest-VolumesTestJSON-749509054-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.207963 Jul 20 04:22:36.910634 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1703/3426] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:37.070188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6515759b-b0d5-4e72-9c4e-2eb50efb4b86 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb84132f790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.208414 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6515759b-b0d5-4e72-9c4e-2eb50efb4b86 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.143093 Jul 20 04:22:37.209366 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1704/3427] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:37.574958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d94bb147-435b-441a-86fb-ab756fa26aec tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.590627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d94bb147-435b-441a-86fb-ab756fa26aec tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.592330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d94bb147-435b-441a-86fb-ab756fa26aec tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.593539 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d94bb147-435b-441a-86fb-ab756fa26aec tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1844 microversion: 2.32 time: 0.923408 Jul 20 04:22:37.599242 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1724/3428] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1844 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:38.222962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ba5f626-e5fb-4465-b204-dae5bf06ac21 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8424d50d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:38.368503 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ba5f626-e5fb-4465-b204-dae5bf06ac21 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.149682 Jul 20 04:22:38.371395 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1705/3429] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:38 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:38.617354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-371a05e3-3e41-435c-935f-073f30fa9648 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:38.617986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-371a05e3-3e41-435c-935f-073f30fa9648 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:38.640739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-371a05e3-3e41-435c-935f-073f30fa9648 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.642628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-371a05e3-3e41-435c-935f-073f30fa9648 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.647217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-371a05e3-3e41-435c-935f-073f30fa9648 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.651461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-371a05e3-3e41-435c-935f-073f30fa9648 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.383619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d4ac881-ee44-4aa5-af38-ba0663a6ce82 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8413b3f70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.491436 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d4ac881-ee44-4aa5-af38-ba0663a6ce82 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.111660 Jul 20 04:22:39.493500 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1706/3430] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:39 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:39.992406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-371a05e3-3e41-435c-935f-073f30fa9648 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:40.016933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-371a05e3-3e41-435c-935f-073f30fa9648 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:40.018969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-371a05e3-3e41-435c-935f-073f30fa9648 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:40.020667 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-371a05e3-3e41-435c-935f-073f30fa9648 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1844 microversion: 2.32 time: 1.407320 Jul 20 04:22:40.035456 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1725/3431] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:38 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1844 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:40.508733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f319b7ae-4347-4a7c-ad0c-7b31fd7e9bd4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841beb310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:40.642063 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f319b7ae-4347-4a7c-ad0c-7b31fd7e9bd4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.138195 Jul 20 04:22:40.642925 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1707/3432] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:40 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:41.062992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8911a4b2-a148-4260-878d-0c0a68730d85 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.064303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8911a4b2-a148-4260-878d-0c0a68730d85 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:41.088722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8911a4b2-a148-4260-878d-0c0a68730d85 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.095655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8911a4b2-a148-4260-878d-0c0a68730d85 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.101206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8911a4b2-a148-4260-878d-0c0a68730d85 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.105021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8911a4b2-a148-4260-878d-0c0a68730d85 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.658023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29532786-fecb-4e7e-875a-09f112353e1c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb84132e430>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.781493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8911a4b2-a148-4260-878d-0c0a68730d85 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:41.801512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8911a4b2-a148-4260-878d-0c0a68730d85 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:41.802915 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-29532786-fecb-4e7e-875a-09f112353e1c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.149500 Jul 20 04:22:41.809195 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1708/3433] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:41 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:41.820959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8911a4b2-a148-4260-878d-0c0a68730d85 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:41.825440 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8911a4b2-a148-4260-878d-0c0a68730d85 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1844 microversion: 2.32 time: 0.778740 Jul 20 04:22:41.834460 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1726/3434] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:41 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1844 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:41.841093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a4540c97-0597-4330-924a-128b0c70adf9 req-1987a50a-460d-4d5c-b537-b16eb4c47c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "tag": "86a07295-dd78-44c7-98ae-020642c58a78"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:41.872094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a4540c97-0597-4330-924a-128b0c70adf9 req-1987a50a-460d-4d5c-b537-b16eb4c47c65 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.872814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a4540c97-0597-4330-924a-128b0c70adf9 req-1987a50a-460d-4d5c-b537-b16eb4c47c65 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.914853 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a4540c97-0597-4330-924a-128b0c70adf9 req-1987a50a-460d-4d5c-b537-b16eb4c47c65 service nova] Creating event network-changed:86a07295-dd78-44c7-98ae-020642c58a78 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:22:41.931196 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a4540c97-0597-4330-924a-128b0c70adf9 req-1987a50a-460d-4d5c-b537-b16eb4c47c65 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120067 Jul 20 04:22:41.935645 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1709/3435] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:42.818760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c0c54dbf-8612-4ee8-9c14-ad058d6a94dd tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840e9e940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.846442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f481190-79bb-421a-929e-27835f741a2c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.847150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f481190-79bb-421a-929e-27835f741a2c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:42.883007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f481190-79bb-421a-929e-27835f741a2c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.883964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f481190-79bb-421a-929e-27835f741a2c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.887186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f481190-79bb-421a-929e-27835f741a2c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.889133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f481190-79bb-421a-929e-27835f741a2c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.940283 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c0c54dbf-8612-4ee8-9c14-ad058d6a94dd tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.127407 Jul 20 04:22:42.946854 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1727/3436] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:42 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:43.609486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f481190-79bb-421a-929e-27835f741a2c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.629066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f481190-79bb-421a-929e-27835f741a2c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.636702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f481190-79bb-421a-929e-27835f741a2c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.640195 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f481190-79bb-421a-929e-27835f741a2c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1844 microversion: 2.32 time: 0.797092 Jul 20 04:22:43.641717 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1710/3437] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:42 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1844 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:43.955542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cfa9d26f-7ab7-413c-9058-3b7be6c2b572 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840e753a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:44.036209 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cfa9d26f-7ab7-413c-9058-3b7be6c2b572 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.085188 Jul 20 04:22:44.043185 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1728/3438] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:43 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:44.661078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c93c589-892e-41d5-999c-55dd74bbe562 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:44.661933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8c93c589-892e-41d5-999c-55dd74bbe562 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:44.678619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c93c589-892e-41d5-999c-55dd74bbe562 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.679509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c93c589-892e-41d5-999c-55dd74bbe562 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.686784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c93c589-892e-41d5-999c-55dd74bbe562 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.688679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c93c589-892e-41d5-999c-55dd74bbe562 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.051679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db747cc1-6faf-4241-9740-d3b72199d62c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f73040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:45.144860 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-db747cc1-6faf-4241-9740-d3b72199d62c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.098068 Jul 20 04:22:45.145443 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1729/3439] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:45 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:45.740885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8c93c589-892e-41d5-999c-55dd74bbe562 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:45.761005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8c93c589-892e-41d5-999c-55dd74bbe562 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:45.766603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8c93c589-892e-41d5-999c-55dd74bbe562 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:45.769869 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c93c589-892e-41d5-999c-55dd74bbe562 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1865 microversion: 2.32 time: 1.113813 Jul 20 04:22:45.773024 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1711/3440] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:44 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1865 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:46.159891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5f802db5-5af8-414b-8f15-a2e0e70efa60 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f19a60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:46.273949 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5f802db5-5af8-414b-8f15-a2e0e70efa60 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.118715 Jul 20 04:22:46.275201 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1730/3441] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:46 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:46.769299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2e96d86f-aecf-40fa-8202-1bc370dc0f7c req-4e8c0dd3-4f77-40e0-9d7d-bc41ce6a0554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "tag": "f444e47b-8c44-41a2-8d8d-dc1251412040"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:46.785580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:46.796934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f1d49348-647a-48aa-a581-92caad23a22b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:46.797623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f1d49348-647a-48aa-a581-92caad23a22b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:46.827852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1d49348-647a-48aa-a581-92caad23a22b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.839381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1d49348-647a-48aa-a581-92caad23a22b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.840242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1d49348-647a-48aa-a581-92caad23a22b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.840689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1d49348-647a-48aa-a581-92caad23a22b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.844451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2e96d86f-aecf-40fa-8202-1bc370dc0f7c req-4e8c0dd3-4f77-40e0-9d7d-bc41ce6a0554 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.850800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2e96d86f-aecf-40fa-8202-1bc370dc0f7c req-4e8c0dd3-4f77-40e0-9d7d-bc41ce6a0554 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.895673 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2e96d86f-aecf-40fa-8202-1bc370dc0f7c req-4e8c0dd3-4f77-40e0-9d7d-bc41ce6a0554 service nova] Creating event network-changed:f444e47b-8c44-41a2-8d8d-dc1251412040 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:22:46.931018 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2e96d86f-aecf-40fa-8202-1bc370dc0f7c req-4e8c0dd3-4f77-40e0-9d7d-bc41ce6a0554 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161359 Jul 20 04:22:46.937638 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1712/3442] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:46.949451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=78 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:47.290055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b93f5574-18de-45ff-8cb1-10efcac94650 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8413b3ca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:47.391527 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b93f5574-18de-45ff-8cb1-10efcac94650 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.107085 Jul 20 04:22:47.392414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1713/3443] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:47 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:48.409941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3fbb3547-5978-40aa-a3e2-5a79b88bbfb4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8413ba160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:48.558677 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3fbb3547-5978-40aa-a3e2-5a79b88bbfb4 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.157214 Jul 20 04:22:48.561660 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1714/3444] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:48 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:49.575454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6fabc63c-7032-4ee8-b05e-8c0f1f42897c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841346a60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.655736 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6fabc63c-7032-4ee8-b05e-8c0f1f42897c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.085427 Jul 20 04:22:49.656859 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1715/3445] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:49 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:50.195128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f1d49348-647a-48aa-a581-92caad23a22b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:50.228224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f1d49348-647a-48aa-a581-92caad23a22b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:50.239947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f1d49348-647a-48aa-a581-92caad23a22b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:50.245863 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f1d49348-647a-48aa-a581-92caad23a22b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1865 microversion: 2.32 time: 3.457524 Jul 20 04:22:50.247023 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1731/3446] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:46 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1865 bytes in 3460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:50.451706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2edce748-f031-486a-82f4-dd10dbeadf43 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.452836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2edce748-f031-486a-82f4-dd10dbeadf43 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:50.477571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2edce748-f031-486a-82f4-dd10dbeadf43 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.478022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2edce748-f031-486a-82f4-dd10dbeadf43 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.479374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2edce748-f031-486a-82f4-dd10dbeadf43 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.479815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2edce748-f031-486a-82f4-dd10dbeadf43 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.598969 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2edce748-f031-486a-82f4-dd10dbeadf43 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148109 Jul 20 04:22:50.605333 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1716/3447] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:22:50 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:50.669204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86ae9206-ca3f-4e7e-8d2e-bd6b8fb8f3ce tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840f9b670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.798731 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-86ae9206-ca3f-4e7e-8d2e-bd6b8fb8f3ce tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.133286 Jul 20 04:22:50.799325 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1732/3448] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:50 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:50.900064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-14514b15-5368-4f18-a9d3-be7d2f0c1429 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.901260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-14514b15-5368-4f18-a9d3-be7d2f0c1429 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:50.915718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14514b15-5368-4f18-a9d3-be7d2f0c1429 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.919954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14514b15-5368-4f18-a9d3-be7d2f0c1429 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.926996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14514b15-5368-4f18-a9d3-be7d2f0c1429 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.927711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14514b15-5368-4f18-a9d3-be7d2f0c1429 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.100495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-14514b15-5368-4f18-a9d3-be7d2f0c1429 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:51.267194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e98c7ca-ddab-4d6f-93e0-f12e44400c7e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.268399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e98c7ca-ddab-4d6f-93e0-f12e44400c7e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:51.270641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=26 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:51.290454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e98c7ca-ddab-4d6f-93e0-f12e44400c7e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.314303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e98c7ca-ddab-4d6f-93e0-f12e44400c7e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.320653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e98c7ca-ddab-4d6f-93e0-f12e44400c7e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.324995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e98c7ca-ddab-4d6f-93e0-f12e44400c7e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.635705 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-14514b15-5368-4f18-a9d3-be7d2f0c1429 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 204 len: 0 microversion: 2.1 time: 0.736200 Jul 20 04:22:51.636363 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1717/3449] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:50 2022] DELETE /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:51.683102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e10de5fc-b87c-4eb6-89fe-d5743aca89f4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.687008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e10de5fc-b87c-4eb6-89fe-d5743aca89f4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:51.717202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e10de5fc-b87c-4eb6-89fe-d5743aca89f4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.718981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e10de5fc-b87c-4eb6-89fe-d5743aca89f4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.726604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e10de5fc-b87c-4eb6-89fe-d5743aca89f4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.727454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e10de5fc-b87c-4eb6-89fe-d5743aca89f4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.035372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e10de5fc-b87c-4eb6-89fe-d5743aca89f4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:52.052482 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e10de5fc-b87c-4eb6-89fe-d5743aca89f4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1674 microversion: 2.1 time: 0.406095 Jul 20 04:22:52.053293 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1718/3450] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:51 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1674 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:52.084361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-412d5615-457b-44ad-8850-03f3c20bffc7 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841334c10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.217783 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-412d5615-457b-44ad-8850-03f3c20bffc7 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.143376 Jul 20 04:22:52.229495 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1719/3451] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:53.043473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e98c7ca-ddab-4d6f-93e0-f12e44400c7e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.060213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e98c7ca-ddab-4d6f-93e0-f12e44400c7e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.068181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e98c7ca-ddab-4d6f-93e0-f12e44400c7e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.074334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3cc9b7dc-a69b-4deb-b293-b71da6a1105a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:53.075832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3cc9b7dc-a69b-4deb-b293-b71da6a1105a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:53.076966 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e98c7ca-ddab-4d6f-93e0-f12e44400c7e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1886 microversion: 2.32 time: 1.814996 Jul 20 04:22:53.090734 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1733/3452] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:51 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1886 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:53.091895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3cc9b7dc-a69b-4deb-b293-b71da6a1105a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.094833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3cc9b7dc-a69b-4deb-b293-b71da6a1105a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.113918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3cc9b7dc-a69b-4deb-b293-b71da6a1105a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.114721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3cc9b7dc-a69b-4deb-b293-b71da6a1105a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.231285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8e15735a-2b56-42a1-9c54-c01045c1ee22 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840e758b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:53.397828 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8e15735a-2b56-42a1-9c54-c01045c1ee22 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.170532 Jul 20 04:22:53.398769 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1734/3453] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:53 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:53.418765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3945c4f0-1301-42b6-accd-8696bab98717 req-183ca520-7b08-4fa3-a9f7-6c5dbf09030d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "tag": "a9b48c51-1561-4d97-9677-27009946bf45"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:53.446031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3945c4f0-1301-42b6-accd-8696bab98717 req-183ca520-7b08-4fa3-a9f7-6c5dbf09030d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.446516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3945c4f0-1301-42b6-accd-8696bab98717 req-183ca520-7b08-4fa3-a9f7-6c5dbf09030d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.497080 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3945c4f0-1301-42b6-accd-8696bab98717 req-183ca520-7b08-4fa3-a9f7-6c5dbf09030d service nova] Creating event network-changed:a9b48c51-1561-4d97-9677-27009946bf45 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:22:53.511992 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3945c4f0-1301-42b6-accd-8696bab98717 req-183ca520-7b08-4fa3-a9f7-6c5dbf09030d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109956 Jul 20 04:22:53.519685 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1735/3454] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:54.097249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-319389f3-6c72-4910-889d-0381b7f84cd1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:54.098727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-319389f3-6c72-4910-889d-0381b7f84cd1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:54.118356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-319389f3-6c72-4910-889d-0381b7f84cd1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.143455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-319389f3-6c72-4910-889d-0381b7f84cd1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.150066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-319389f3-6c72-4910-889d-0381b7f84cd1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.150861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-319389f3-6c72-4910-889d-0381b7f84cd1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.446369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-319389f3-6c72-4910-889d-0381b7f84cd1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.470597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-319389f3-6c72-4910-889d-0381b7f84cd1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.473206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-319389f3-6c72-4910-889d-0381b7f84cd1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.507050 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-319389f3-6c72-4910-889d-0381b7f84cd1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1886 microversion: 2.32 time: 0.412515 Jul 20 04:22:54.507050 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1736/3455] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:54 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1886 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:54.537027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cf5ecbe7-a62b-463b-8004-612f3b5a2926 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb840e75c10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:54.636020 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cf5ecbe7-a62b-463b-8004-612f3b5a2926 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1429 microversion: 2.1 time: 0.128726 Jul 20 04:22:54.637208 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1737/3456] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:54 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1429 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:54.808888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3cc9b7dc-a69b-4deb-b293-b71da6a1105a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.811470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:54.827607 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3cc9b7dc-a69b-4deb-b293-b71da6a1105a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1674 microversion: 2.1 time: 1.759387 Jul 20 04:22:54.835151 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1720/3457] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:53 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1674 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:55.533487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1670c88-c099-4fae-835e-3e00f63ff1fa tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.534796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d1670c88-c099-4fae-835e-3e00f63ff1fa tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:55.550501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1670c88-c099-4fae-835e-3e00f63ff1fa tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.557687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1670c88-c099-4fae-835e-3e00f63ff1fa tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.559305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1670c88-c099-4fae-835e-3e00f63ff1fa tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.559933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1670c88-c099-4fae-835e-3e00f63ff1fa tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.661569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-95eb6f65-5705-4c4e-9824-13634e399611 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841334f70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.773983 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-95eb6f65-5705-4c4e-9824-13634e399611 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1438 microversion: 2.1 time: 0.128330 Jul 20 04:22:55.775853 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1721/3458] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1438 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:55.787307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56139b7e-f77a-4650-b9f2-60353d8c0fce tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8413b41f0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.882889 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-56139b7e-f77a-4650-b9f2-60353d8c0fce tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 200 len: 1438 microversion: 2.1 time: 0.099359 Jul 20 04:22:55.885169 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1722/3459] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:55.896239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ba447f3-a84f-421f-bcaf-00bf2bdf459e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.897294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ba447f3-a84f-421f-bcaf-00bf2bdf459e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:55.905892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ba447f3-a84f-421f-bcaf-00bf2bdf459e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.906675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ba447f3-a84f-421f-bcaf-00bf2bdf459e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.907696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ba447f3-a84f-421f-bcaf-00bf2bdf459e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.908335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ba447f3-a84f-421f-bcaf-00bf2bdf459e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.586653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1670c88-c099-4fae-835e-3e00f63ff1fa tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.627155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1670c88-c099-4fae-835e-3e00f63ff1fa tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.631702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1670c88-c099-4fae-835e-3e00f63ff1fa tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.633651 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1670c88-c099-4fae-835e-3e00f63ff1fa tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1886 microversion: 2.32 time: 1.111984 Jul 20 04:22:56.637398 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1738/3460] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1886 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:56.647365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6f0fe9aa-e7ca-49a1-bce4-e6495417f5ea tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:56.648014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6f0fe9aa-e7ca-49a1-bce4-e6495417f5ea tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:56.656729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f0fe9aa-e7ca-49a1-bce4-e6495417f5ea tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.657190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f0fe9aa-e7ca-49a1-bce4-e6495417f5ea tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.657858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ba447f3-a84f-421f-bcaf-00bf2bdf459e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.658005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f0fe9aa-e7ca-49a1-bce4-e6495417f5ea tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.658451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f0fe9aa-e7ca-49a1-bce4-e6495417f5ea tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.674787 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ba447f3-a84f-421f-bcaf-00bf2bdf459e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1674 microversion: 2.1 time: 0.788474 Jul 20 04:22:56.675761 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1723/3461] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1674 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:57.055814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-65971cd6-48b6-453e-a387-f28bebddef91 req-2dc28685-39c6-4d21-9a9c-eba186bae990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4eb6ee-6232-43c2-a09b-55e0dda420d2", "name": "network-vif-unplugged", "status": "completed", "tag": "8a7fbcc3-29b2-4ac1-a2b9-1a27d746c53c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:57.068726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-65971cd6-48b6-453e-a387-f28bebddef91 req-2dc28685-39c6-4d21-9a9c-eba186bae990 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.069754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-65971cd6-48b6-453e-a387-f28bebddef91 req-2dc28685-39c6-4d21-9a9c-eba186bae990 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.102297 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-65971cd6-48b6-453e-a387-f28bebddef91 req-2dc28685-39c6-4d21-9a9c-eba186bae990 service nova] Creating event network-vif-unplugged:8a7fbcc3-29b2-4ac1-a2b9-1a27d746c53c for instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 on n-h2-760456-11 Jul 20 04:22:57.109347 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-65971cd6-48b6-453e-a387-f28bebddef91 req-2dc28685-39c6-4d21-9a9c-eba186bae990 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.258293 Jul 20 04:22:57.110725 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1724/3462] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:57.120406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-7e2f0467-d35d-45fd-91c3-6335a5104735 req-af3ff944-de02-4be7-bae5-69b3db421728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "tag": "34004e40-bf86-4b70-ba0c-469bb3766bbd"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:57.139536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7e2f0467-d35d-45fd-91c3-6335a5104735 req-af3ff944-de02-4be7-bae5-69b3db421728 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.140635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7e2f0467-d35d-45fd-91c3-6335a5104735 req-af3ff944-de02-4be7-bae5-69b3db421728 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.171676 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-7e2f0467-d35d-45fd-91c3-6335a5104735 req-af3ff944-de02-4be7-bae5-69b3db421728 service nova] Creating event network-changed:34004e40-bf86-4b70-ba0c-469bb3766bbd for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:22:57.180593 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-7e2f0467-d35d-45fd-91c3-6335a5104735 req-af3ff944-de02-4be7-bae5-69b3db421728 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067900 Jul 20 04:22:57.182075 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1725/3463] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:57.240266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6f0fe9aa-e7ca-49a1-bce4-e6495417f5ea tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:57.262322 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6f0fe9aa-e7ca-49a1-bce4-e6495417f5ea tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1466 microversion: 2.1 time: 0.620973 Jul 20 04:22:57.264763 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1739/3464] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:56 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1466 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:57.288769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-32031ab7-0012-4a23-8ab2-4a439df9e109 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb841beb310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:57.672002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bf65a0c7-a418-48cc-af43-24bdada5625f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:57.673458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bf65a0c7-a418-48cc-af43-24bdada5625f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:57.714457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf65a0c7-a418-48cc-af43-24bdada5625f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.715771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf65a0c7-a418-48cc-af43-24bdada5625f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.716608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf65a0c7-a418-48cc-af43-24bdada5625f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.720286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf65a0c7-a418-48cc-af43-24bdada5625f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.300375 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-32031ab7-0012-4a23-8ab2-4a439df9e109 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "DELETE /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4" status: 204 len: 0 microversion: 2.1 time: 1.017314 Jul 20 04:22:58.301321 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1726/3465] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:57 2022] DELETE /compute/v2.1/images/a92a0ab3-80cb-4472-9e68-8d5a5a9d0ab4 => generated 0 bytes in 1020 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:58.310394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-46e77dbf-29d2-46b5-9e44-c926de1db093 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:58.311305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-46e77dbf-29d2-46b5-9e44-c926de1db093 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:58.319931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46e77dbf-29d2-46b5-9e44-c926de1db093 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.321078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46e77dbf-29d2-46b5-9e44-c926de1db093 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.322285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46e77dbf-29d2-46b5-9e44-c926de1db093 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.322883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46e77dbf-29d2-46b5-9e44-c926de1db093 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.525722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-46e77dbf-29d2-46b5-9e44-c926de1db093 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:58.533675 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-46e77dbf-29d2-46b5-9e44-c926de1db093 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1606 microversion: 2.1 time: 0.230994 Jul 20 04:22:58.544851 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1727/3466] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:58 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1606 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:58.548824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bf65a0c7-a418-48cc-af43-24bdada5625f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:58.565670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bf65a0c7-a418-48cc-af43-24bdada5625f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:58.568751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bf65a0c7-a418-48cc-af43-24bdada5625f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:58.569294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8a290b7e-a63b-4f3b-88f5-e9e157f8bb64 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '.version_select at 0x7fb8413468b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:58.575346 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bf65a0c7-a418-48cc-af43-24bdada5625f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.919262 Jul 20 04:22:58.588922 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1740/3467] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:57 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:22:58.612468 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8a290b7e-a63b-4f3b-88f5-e9e157f8bb64 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] HTTP exception thrown: Image not found. Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8a290b7e-a63b-4f3b-88f5-e9e157f8bb64 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Request method failure captured: Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc HTTP/1.1 Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14KrrMLkZY8jChwE3Do6iW5Twxd7E1rxPz2jgOlccYWfBF9AE9yfr742ed31EJqw5XOL8oj_QggR_KFs4TgVHdU1LPVQiiiS17_iTVKWUg5yNkQDzYRYO5tO8q4XTjYSJn7RN89WnJ62zlJ8gm6eKGivw3AA4cIeYwzGF3b3DCyvG9M Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b22ea719d3fb404391fa4406e4dcf1da Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesOneServerTestJSON-1001535505 Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesOneServerTestJSON-1001535505 Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b22ea719d3fb404391fa4406e4dcf1da Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1001535505 Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesOneServerTestJSON-1001535505-project Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 879e4546d27449039d4d8db2d3d933fb Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesOneServerTestJSON-1001535505-project Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'e8e4da89-07d0-439f-bd49-a90950bf5adc'} Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e8e4da89-07d0-439f-bd49-a90950bf5adc to delete Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8e4da89-07d0-439f-bd49-a90950bf5adc could not be found. Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:58.614758 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:22:58.619900 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:22:58.623493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8a290b7e-a63b-4f3b-88f5-e9e157f8bb64 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:58.624746 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8a290b7e-a63b-4f3b-88f5-e9e157f8bb64 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "DELETE /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc" status: 404 len: 62 microversion: 2.1 time: 0.066347 Jul 20 04:22:58.625619 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1728/3468] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:58 2022] DELETE /compute/v2.1/images/e8e4da89-07d0-439f-bd49-a90950bf5adc => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:22:58.638554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea5f4f4b-7a55-4b9a-ae90-955e5cbf5706 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:58.639069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea5f4f4b-7a55-4b9a-ae90-955e5cbf5706 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:58.647901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea5f4f4b-7a55-4b9a-ae90-955e5cbf5706 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.648661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea5f4f4b-7a55-4b9a-ae90-955e5cbf5706 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.651052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea5f4f4b-7a55-4b9a-ae90-955e5cbf5706 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.651548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea5f4f4b-7a55-4b9a-ae90-955e5cbf5706 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.704244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea5f4f4b-7a55-4b9a-ae90-955e5cbf5706 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:58.890598 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea5f4f4b-7a55-4b9a-ae90-955e5cbf5706 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 204 len: 0 microversion: 2.1 time: 0.259784 Jul 20 04:22:58.891975 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1741/3469] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:58 2022] DELETE /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:58.919310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-14729f8b-316b-4989-af2e-22c7044524e0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:58.920419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-14729f8b-316b-4989-af2e-22c7044524e0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:58.934519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14729f8b-316b-4989-af2e-22c7044524e0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.937022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14729f8b-316b-4989-af2e-22c7044524e0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.938131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14729f8b-316b-4989-af2e-22c7044524e0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.939415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14729f8b-316b-4989-af2e-22c7044524e0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.537465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-14729f8b-316b-4989-af2e-22c7044524e0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:59.548612 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-14729f8b-316b-4989-af2e-22c7044524e0 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1472 microversion: 2.1 time: 0.652092 Jul 20 04:22:59.554500 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1729/3470] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:58 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1472 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:59.572338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f361d2f9-99a2-4cb5-9937-7a3011c2016f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:59.575104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f361d2f9-99a2-4cb5-9937-7a3011c2016f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:59.597764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f361d2f9-99a2-4cb5-9937-7a3011c2016f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.599764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f361d2f9-99a2-4cb5-9937-7a3011c2016f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.607601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f361d2f9-99a2-4cb5-9937-7a3011c2016f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.608921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f361d2f9-99a2-4cb5-9937-7a3011c2016f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.894929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a3142dc6-20f8-4185-9a96-7b01acded2df req-ef8d3611-dfde-4a8f-afa9-14131dc1f82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4eb6ee-6232-43c2-a09b-55e0dda420d2", "name": "network-vif-deleted", "tag": "8a7fbcc3-29b2-4ac1-a2b9-1a27d746c53c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:59.897902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f361d2f9-99a2-4cb5-9937-7a3011c2016f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:59.917127 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f361d2f9-99a2-4cb5-9937-7a3011c2016f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 200 len: 1323 microversion: 2.1 time: 0.361214 Jul 20 04:22:59.926704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a3142dc6-20f8-4185-9a96-7b01acded2df req-ef8d3611-dfde-4a8f-afa9-14131dc1f82a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.928668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a3142dc6-20f8-4185-9a96-7b01acded2df req-ef8d3611-dfde-4a8f-afa9-14131dc1f82a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.935952 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1730/3471] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:59 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:59.981826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0aabafa6-5346-4ca5-a2dd-d3fd84ac3d19 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:59.982975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0aabafa6-5346-4ca5-a2dd-d3fd84ac3d19 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:59.996419 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a3142dc6-20f8-4185-9a96-7b01acded2df req-ef8d3611-dfde-4a8f-afa9-14131dc1f82a service nova] Creating event network-vif-deleted:8a7fbcc3-29b2-4ac1-a2b9-1a27d746c53c for instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 on n-h2-760456-11 Jul 20 04:23:00.018211 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a3142dc6-20f8-4185-9a96-7b01acded2df req-ef8d3611-dfde-4a8f-afa9-14131dc1f82a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.576897 Jul 20 04:23:00.021130 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1742/3472] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:00.046341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-aaa30289-5605-44d9-965e-75ffc7992f22 req-01310768-93d1-403e-97ee-169dcbd69737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5081b1-8b7a-400a-b16c-fb21ebed6c5b", "name": "network-vif-unplugged", "status": "completed", "tag": "e3151488-9d50-447d-9855-2a8a94dea2fa"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:00.048669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0aabafa6-5346-4ca5-a2dd-d3fd84ac3d19 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.049192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0aabafa6-5346-4ca5-a2dd-d3fd84ac3d19 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.050682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0aabafa6-5346-4ca5-a2dd-d3fd84ac3d19 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.051488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0aabafa6-5346-4ca5-a2dd-d3fd84ac3d19 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.080466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-aaa30289-5605-44d9-965e-75ffc7992f22 req-01310768-93d1-403e-97ee-169dcbd69737 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.082157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-aaa30289-5605-44d9-965e-75ffc7992f22 req-01310768-93d1-403e-97ee-169dcbd69737 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.161346 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-aaa30289-5605-44d9-965e-75ffc7992f22 req-01310768-93d1-403e-97ee-169dcbd69737 service nova] Creating event network-vif-unplugged:e3151488-9d50-447d-9855-2a8a94dea2fa for instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b on n-h1-760456-11 Jul 20 04:23:00.177863 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-aaa30289-5605-44d9-965e-75ffc7992f22 req-01310768-93d1-403e-97ee-169dcbd69737 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137638 Jul 20 04:23:00.180621 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1743/3473] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:00.565434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c41f7b6-4e70-4b39-9524-806e055e469a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:00.566434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3c41f7b6-4e70-4b39-9524-806e055e469a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:00.578068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c41f7b6-4e70-4b39-9524-806e055e469a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.578718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c41f7b6-4e70-4b39-9524-806e055e469a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.579620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c41f7b6-4e70-4b39-9524-806e055e469a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.590717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c41f7b6-4e70-4b39-9524-806e055e469a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.873663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0aabafa6-5346-4ca5-a2dd-d3fd84ac3d19 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:00.887413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0aabafa6-5346-4ca5-a2dd-d3fd84ac3d19 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:00.907912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0aabafa6-5346-4ca5-a2dd-d3fd84ac3d19 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:00.908251 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0aabafa6-5346-4ca5-a2dd-d3fd84ac3d19 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.970158 Jul 20 04:23:00.922747 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1731/3474] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:59 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:00.939999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a4a3a37f-77b3-4cce-b2dd-201c8cc5a280 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:00.941479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a4a3a37f-77b3-4cce-b2dd-201c8cc5a280 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:00.952771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4a3a37f-77b3-4cce-b2dd-201c8cc5a280 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.953312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4a3a37f-77b3-4cce-b2dd-201c8cc5a280 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.954375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4a3a37f-77b3-4cce-b2dd-201c8cc5a280 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:00.955424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4a3a37f-77b3-4cce-b2dd-201c8cc5a280 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:00.983864 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a4a3a37f-77b3-4cce-b2dd-201c8cc5a280 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] HTTP exception thrown: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a4a3a37f-77b3-4cce-b2dd-201c8cc5a280 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Request method failure captured: Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 HTTP/1.1 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14JCLPvINkU04kxoUxRW7wflXcVg8w0OdwOx6_eiLhJ--5w66kQ1BjwphaYOeNc4GtXTVkBcAOlU-RAChYLWEtRuFzGdlax5UqQKMNwmHV1DUFdjLjLC1KV7YgyzHSu4zEjnvY_9sUsWgs-gO2xF4h8DzchN0Q1OynJteACD9LyGQb4 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 337b3a46906648cb82515704eadcdb38 Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '9c4eb6ee-6232-43c2-a09b-55e0dda420d2'} Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:00.985870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:00.993407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:00.993407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:00.993407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:00.993407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:00.993407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:00.993407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:23:00.993407 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:01.006527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a4a3a37f-77b3-4cce-b2dd-201c8cc5a280 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Returning 404 to user: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:01.008261 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a4a3a37f-77b3-4cce-b2dd-201c8cc5a280 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 404 len: 111 microversion: 2.1 time: 0.072539 Jul 20 04:23:01.014239 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1732/3475] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:00 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:01.028078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ae82946f-c90d-470c-a5a3-f0ac5f1eb54a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '.version_select at 0x7fb841b6c310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:01.071831 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ae82946f-c90d-470c-a5a3-f0ac5f1eb54a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981349681" status: 202 len: 0 microversion: 2.1 time: 0.053069 Jul 20 04:23:01.073828 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1733/3476] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:23:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981349681 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:23:01.946096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b13e614-ef16-48da-a314-3f65818fec64 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:01.947482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b13e614-ef16-48da-a314-3f65818fec64 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:01.960061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b13e614-ef16-48da-a314-3f65818fec64 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.965667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b13e614-ef16-48da-a314-3f65818fec64 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.966641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b13e614-ef16-48da-a314-3f65818fec64 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.967294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b13e614-ef16-48da-a314-3f65818fec64 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.735341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3c41f7b6-4e70-4b39-9524-806e055e469a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:02.747249 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3c41f7b6-4e70-4b39-9524-806e055e469a tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1472 microversion: 2.1 time: 2.185959 Jul 20 04:23:02.747922 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1744/3477] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:00 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1472 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:03.000052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0b13e614-ef16-48da-a314-3f65818fec64 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.024299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0b13e614-ef16-48da-a314-3f65818fec64 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.025913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0b13e614-ef16-48da-a314-3f65818fec64 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.027386 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b13e614-ef16-48da-a314-3f65818fec64 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 1.088002 Jul 20 04:23:03.038175 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1734/3478] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:01 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:03.445655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-87ec2bd7-68cb-4c3d-8c2c-1dea3dd95e93 req-0179ebcb-b185-4a5a-991f-fdf6e37dc7cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "tag": "b90b46cd-4019-4d40-b56c-2fad4191a7fb"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:03.472855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-87ec2bd7-68cb-4c3d-8c2c-1dea3dd95e93 req-0179ebcb-b185-4a5a-991f-fdf6e37dc7cd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.475981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-87ec2bd7-68cb-4c3d-8c2c-1dea3dd95e93 req-0179ebcb-b185-4a5a-991f-fdf6e37dc7cd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.511251 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-87ec2bd7-68cb-4c3d-8c2c-1dea3dd95e93 req-0179ebcb-b185-4a5a-991f-fdf6e37dc7cd service nova] Creating event network-changed:b90b46cd-4019-4d40-b56c-2fad4191a7fb for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:23:03.519400 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-87ec2bd7-68cb-4c3d-8c2c-1dea3dd95e93 req-0179ebcb-b185-4a5a-991f-fdf6e37dc7cd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078847 Jul 20 04:23:03.526060 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1745/3479] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:03.765038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8592ca19-0683-4ddc-926a-371954f1d476 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:03.765641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8592ca19-0683-4ddc-926a-371954f1d476 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:03.781920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8592ca19-0683-4ddc-926a-371954f1d476 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.783701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8592ca19-0683-4ddc-926a-371954f1d476 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.786847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8592ca19-0683-4ddc-926a-371954f1d476 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.787876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8592ca19-0683-4ddc-926a-371954f1d476 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.046818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-400b4e77-fd36-41f4-b2c1-c42ef9f01a30 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:04.047536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-400b4e77-fd36-41f4-b2c1-c42ef9f01a30 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:04.074483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-400b4e77-fd36-41f4-b2c1-c42ef9f01a30 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.074951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-400b4e77-fd36-41f4-b2c1-c42ef9f01a30 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:04.075751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-400b4e77-fd36-41f4-b2c1-c42ef9f01a30 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:04.076197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-400b4e77-fd36-41f4-b2c1-c42ef9f01a30 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:05.143525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8592ca19-0683-4ddc-926a-371954f1d476 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.157104 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8592ca19-0683-4ddc-926a-371954f1d476 tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1472 microversion: 2.1 time: 1.395926 Jul 20 04:23:05.166456 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1735/3480] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:03 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1472 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:05.219221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-400b4e77-fd36-41f4-b2c1-c42ef9f01a30 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.234626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-400b4e77-fd36-41f4-b2c1-c42ef9f01a30 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.242216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-400b4e77-fd36-41f4-b2c1-c42ef9f01a30 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:05.243391 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-400b4e77-fd36-41f4-b2c1-c42ef9f01a30 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 1.200822 Jul 20 04:23:05.259929 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1746/3481] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:04 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:05.330360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-890dc6e0-39a8-46ce-9817-ace0e81272c0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'create', calling method: .version_select at 0x7fb841c628b0>, body: {"keypair": {"name": "tempest-keypair-1537175707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+7Moeofkwy8AmmD0HHccZaCEAtmHo9nU6shBLnqtVkD8BJJ/jeCzRqKYpBSlfrGTX636QNElvUYm3H66Sgjf9kuqAyjgrNfFDW3YbZC3P7lZOrm8l3NO3cIqy4SXXGaw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:05.351341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-890dc6e0-39a8-46ce-9817-ace0e81272c0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Getting quotas for project 93f8bfd8e5a34423848573c7caab8d68. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:05.364067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-890dc6e0-39a8-46ce-9817-ace0e81272c0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Getting quotas for user 337b3a46906648cb82515704eadcdb38 and project 93f8bfd8e5a34423848573c7caab8d68. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:05.405278 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-890dc6e0-39a8-46ce-9817-ace0e81272c0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090282 Jul 20 04:23:05.406894 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1736/3482] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:23:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:06.077192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-90b71308-c36e-455e-a388-114423e2a210 req-c9b408e0-00fd-4566-a5af-85c34d08dee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5081b1-8b7a-400a-b16c-fb21ebed6c5b", "name": "network-vif-deleted", "tag": "e3151488-9d50-447d-9855-2a8a94dea2fa"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:06.092781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-90b71308-c36e-455e-a388-114423e2a210 req-c9b408e0-00fd-4566-a5af-85c34d08dee4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.098899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-90b71308-c36e-455e-a388-114423e2a210 req-c9b408e0-00fd-4566-a5af-85c34d08dee4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.133403 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-90b71308-c36e-455e-a388-114423e2a210 req-c9b408e0-00fd-4566-a5af-85c34d08dee4 service nova] Creating event network-vif-deleted:e3151488-9d50-447d-9855-2a8a94dea2fa for instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b on n-h1-760456-11 Jul 20 04:23:06.149174 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-90b71308-c36e-455e-a388-114423e2a210 req-c9b408e0-00fd-4566-a5af-85c34d08dee4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075819 Jul 20 04:23:06.151642 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1747/3483] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:06.178212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.179318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.222033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.228951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.231357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.231824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.287609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-90949b99-22bc-45db-b999-adb28cd413d2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.290799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-90949b99-22bc-45db-b999-adb28cd413d2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.314599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90949b99-22bc-45db-b999-adb28cd413d2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.316882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90949b99-22bc-45db-b999-adb28cd413d2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.317945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90949b99-22bc-45db-b999-adb28cd413d2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.320876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90949b99-22bc-45db-b999-adb28cd413d2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.386688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.390638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.392010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lazy-loading 'fault' on Instance uuid 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:06.715711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879e4546d27449039d4d8db2d3d933fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22ea719d3fb404391fa4406e4dcf1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:06.728784 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c44a77be-921c-4468-974b-e129a8ffbd2e tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 200 len: 1306 microversion: 2.1 time: 0.553623 Jul 20 04:23:06.742785 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1737/3484] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 1306 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:07.237060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90949b99-22bc-45db-b999-adb28cd413d2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.263221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90949b99-22bc-45db-b999-adb28cd413d2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.268651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90949b99-22bc-45db-b999-adb28cd413d2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.270414 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-90949b99-22bc-45db-b999-adb28cd413d2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.997459 Jul 20 04:23:07.282677 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1748/3485] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:07.751422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8c5d441-e6b5-4e54-a0e2-daca0d44e56c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:07.752851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c8c5d441-e6b5-4e54-a0e2-daca0d44e56c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] [instance: 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:07.771936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8c5d441-e6b5-4e54-a0e2-daca0d44e56c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.772382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8c5d441-e6b5-4e54-a0e2-daca0d44e56c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.778156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8c5d441-e6b5-4e54-a0e2-daca0d44e56c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.778886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8c5d441-e6b5-4e54-a0e2-daca0d44e56c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.827045 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c8c5d441-e6b5-4e54-a0e2-daca0d44e56c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] HTTP exception thrown: Instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b could not be found. Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8c5d441-e6b5-4e54-a0e2-daca0d44e56c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Request method failure captured: Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b HTTP/1.1 Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14KrrMLkZY8jChwE3Do6iW5Twxd7E1rxPz2jgOlccYWfBF9AE9yfr742ed31EJqw5XOL8oj_QggR_KFs4TgVHdU1LPVQiiiS17_iTVKWUg5yNkQDzYRYO5tO8q4XTjYSJn7RN89WnJ62zlJ8gm6eKGivw3AA4cIeYwzGF3b3DCyvG9M Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b22ea719d3fb404391fa4406e4dcf1da Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesOneServerTestJSON-1001535505 Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b22ea719d3fb404391fa4406e4dcf1da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesOneServerTestJSON-1001535505 Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b22ea719d3fb404391fa4406e4dcf1da Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1001535505 Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesOneServerTestJSON-1001535505-project Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 879e4546d27449039d4d8db2d3d933fb Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesOneServerTestJSON-1001535505-project Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b could not be found. Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '5c5081b1-8b7a-400a-b16c-fb21ebed6c5b'} Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b could not be found. Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b could not be found. Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:07.839479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:07.845621 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:07.845621 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:07.845621 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:07.845621 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:07.845621 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:07.845621 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b could not be found. Jul 20 04:23:07.845621 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:07.845621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8c5d441-e6b5-4e54-a0e2-daca0d44e56c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] Returning 404 to user: Instance 5c5081b1-8b7a-400a-b16c-fb21ebed6c5b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:07.845621 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c8c5d441-e6b5-4e54-a0e2-daca0d44e56c tempest-ImagesOneServerTestJSON-1001535505 tempest-ImagesOneServerTestJSON-1001535505-project] 10.222.0.59 "GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b" status: 404 len: 111 microversion: 2.1 time: 0.094484 Jul 20 04:23:07.845621 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1738/3486] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:07 2022] GET /compute/v2.1/servers/5c5081b1-8b7a-400a-b16c-fb21ebed6c5b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:08.294726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3de15873-0e99-4f3b-acd1-7b29dc2648e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:08.295672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3de15873-0e99-4f3b-acd1-7b29dc2648e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:08.308002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3de15873-0e99-4f3b-acd1-7b29dc2648e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.318363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3de15873-0e99-4f3b-acd1-7b29dc2648e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.319779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3de15873-0e99-4f3b-acd1-7b29dc2648e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.320301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3de15873-0e99-4f3b-acd1-7b29dc2648e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.632044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5122feb7-c7a8-45b6-847c-d802fac5d332 req-8fac638a-023e-4dd9-bfe3-3c03350e2b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "tag": "9ef1b0a9-a805-494d-9371-757d4ab1d057"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:08.659307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5122feb7-c7a8-45b6-847c-d802fac5d332 req-8fac638a-023e-4dd9-bfe3-3c03350e2b02 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.667646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5122feb7-c7a8-45b6-847c-d802fac5d332 req-8fac638a-023e-4dd9-bfe3-3c03350e2b02 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.702727 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5122feb7-c7a8-45b6-847c-d802fac5d332 req-8fac638a-023e-4dd9-bfe3-3c03350e2b02 service nova] Creating event network-changed:9ef1b0a9-a805-494d-9371-757d4ab1d057 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:23:08.716184 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5122feb7-c7a8-45b6-847c-d802fac5d332 req-8fac638a-023e-4dd9-bfe3-3c03350e2b02 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.432412 Jul 20 04:23:08.718555 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1749/3487] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:09.706950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3de15873-0e99-4f3b-acd1-7b29dc2648e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.730498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3de15873-0e99-4f3b-acd1-7b29dc2648e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.737928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3de15873-0e99-4f3b-acd1-7b29dc2648e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.743424 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3de15873-0e99-4f3b-acd1-7b29dc2648e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 1.451666 Jul 20 04:23:09.746196 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1739/3488] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:08 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:10.042966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-396463522", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "6cbb404b-c4c8-4257-b36b-8b119628a5dc"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:10.156953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] validate_networks() for [('6cbb404b-c4c8-4257-b36b-8b119628a5dc', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:10.764802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-68a43c35-f16d-4699-a113-8b8f9fa2cf8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:10.765282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-68a43c35-f16d-4699-a113-8b8f9fa2cf8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.778535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68a43c35-f16d-4699-a113-8b8f9fa2cf8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.779068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68a43c35-f16d-4699-a113-8b8f9fa2cf8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.780019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68a43c35-f16d-4699-a113-8b8f9fa2cf8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.780475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68a43c35-f16d-4699-a113-8b8f9fa2cf8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.750612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-68a43c35-f16d-4699-a113-8b8f9fa2cf8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:11.767422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-68a43c35-f16d-4699-a113-8b8f9fa2cf8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:11.771182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-68a43c35-f16d-4699-a113-8b8f9fa2cf8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:11.773626 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-68a43c35-f16d-4699-a113-8b8f9fa2cf8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 1.013482 Jul 20 04:23:11.776810 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1740/3489] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:10 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:11.784666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-53bbad0e-7331-48ab-9393-6274c864f6f5 req-8895eac0-adb9-49dc-bcf8-06bc9f82b0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "tag": "cf931418-c175-456d-a8cf-dcc9a12f42e8"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:11.802172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-53bbad0e-7331-48ab-9393-6274c864f6f5 req-8895eac0-adb9-49dc-bcf8-06bc9f82b0ca service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.803197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-53bbad0e-7331-48ab-9393-6274c864f6f5 req-8895eac0-adb9-49dc-bcf8-06bc9f82b0ca service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.851926 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-53bbad0e-7331-48ab-9393-6274c864f6f5 req-8895eac0-adb9-49dc-bcf8-06bc9f82b0ca service nova] Creating event network-changed:cf931418-c175-456d-a8cf-dcc9a12f42e8 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:23:11.866830 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-53bbad0e-7331-48ab-9393-6274c864f6f5 req-8895eac0-adb9-49dc-bcf8-06bc9f82b0ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085923 Jul 20 04:23:11.870787 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1741/3490] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:12.119014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:12.119693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:12.121169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:12.133622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:12.134339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:12.158045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.158532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.170577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.175147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.225863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Getting quotas for project d982f2be50cd4c23b245c855019c7f01. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:12.244117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Getting quotas for user 6ab1957012704763aab3292f0b64933a and project d982f2be50cd4c23b245c855019c7f01. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:12.264795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:12.267566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:12.387366 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08b86cf4-bee3-4409-a95b-e0320864d3f5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.476138 Jul 20 04:23:12.388290 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1750/3491] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:12.398850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34667dde-e58d-44b6-a7ae-447001f61287 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:12.400370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-34667dde-e58d-44b6-a7ae-447001f61287 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:12.690289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-34667dde-e58d-44b6-a7ae-447001f61287 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:12.704543 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-34667dde-e58d-44b6-a7ae-447001f61287 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1215 microversion: 2.1 time: 0.309820 Jul 20 04:23:12.705925 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1742/3492] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:12 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1215 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:12.803088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c0770f8-b073-47c0-81aa-88503047cede tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:12.803968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2c0770f8-b073-47c0-81aa-88503047cede tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:12.812478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c0770f8-b073-47c0-81aa-88503047cede tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.812955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c0770f8-b073-47c0-81aa-88503047cede tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.813754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c0770f8-b073-47c0-81aa-88503047cede tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.814208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c0770f8-b073-47c0-81aa-88503047cede tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.439276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-989b5b3e-dfaa-4de5-86e4-5fdb7bd68a64 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] Calling method '.version_select at 0x7fb841378f70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:14.587338 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-989b5b3e-dfaa-4de5-86e4-5fdb7bd68a64 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.142641 Jul 20 04:23:14.589172 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1743/3493] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:23:13 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:23:14.604623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ef1687f-c1ec-4560-83d7-4293abcad3dd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:14.606113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8ef1687f-c1ec-4560-83d7-4293abcad3dd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:14.616707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ef1687f-c1ec-4560-83d7-4293abcad3dd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.617658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ef1687f-c1ec-4560-83d7-4293abcad3dd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.631296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ef1687f-c1ec-4560-83d7-4293abcad3dd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.631977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ef1687f-c1ec-4560-83d7-4293abcad3dd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.750276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8ef1687f-c1ec-4560-83d7-4293abcad3dd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.754698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c0770f8-b073-47c0-81aa-88503047cede tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.762689 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8ef1687f-c1ec-4560-83d7-4293abcad3dd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1267 microversion: 2.1 time: 0.172019 Jul 20 04:23:14.763280 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1744/3494] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:14 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:14.771384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c0770f8-b073-47c0-81aa-88503047cede tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.777860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c0770f8-b073-47c0-81aa-88503047cede tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.778416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1499385816", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5ead2ac-90a5-4a98-88cc-7af516957d4b"}], "security_groups": [{"name": "tempest-securitygroup--167069962"}], "key_name": "tempest-keypair-1537175707", "user_data": "}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:14.784369 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c0770f8-b073-47c0-81aa-88503047cede tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 1.985187 Jul 20 04:23:14.790000 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1751/3495] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:12 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:14.797747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-61cb0cc7-e469-488d-abd8-030f444b15b1 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] Action: 'create', calling method: .version_select at 0x7fb840e039d0>, body: {"pool": "non_exist_pool"} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:15.144462 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-61cb0cc7-e469-488d-abd8-030f444b15b1 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] HTTP exception thrown: Floating IP pool not found. Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-61cb0cc7-e469-488d-abd8-030f444b15b1 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] Request method failure captured: Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 26 Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14MxXRpvSCEBzcLCcq0GfkkngQfpiiVU5oKo9_chsXfcvb3lDJsrw9Td2tAqlICUSDAxszkBTjg30iT7C7O_ea028FriJBwNSykdbAmXplsqZSkBdIYKc1AT64BEKVzlICOkteesEPcl334SSbEXtqpxbz2469E1VrQgtuoaWEuBXwU Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 097391cafc5f4f66b53d38b2aa88042c Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-781272720 Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/097391cafc5f4f66b53d38b2aa88042c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/097391cafc5f4f66b53d38b2aa88042c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/097391cafc5f4f66b53d38b2aa88042c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_097391cafc5f4f66b53d38b2aa88042c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-781272720 Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 097391cafc5f4f66b53d38b2aa88042c Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-781272720 Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FloatingIPsNegativeTestJSON-781272720-project Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 45a923fb445e4e468ba067b7e74d10d5 Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-781272720-project Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: {"pool": "non_exist_pool"} Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: exception: Floating IP pool not found. Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:15.149966 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:15.155104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 20 04:23:15.155104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.157260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-61cb0cc7-e469-488d-abd8-030f444b15b1 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] Returning 404 to user: Floating IP pool not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:15.158361 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-61cb0cc7-e469-488d-abd8-030f444b15b1 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.366525 Jul 20 04:23:15.159904 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1752/3496] 10.222.0.59 () {60 vars in 1169 bytes} [Wed Jul 20 04:23:14 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:23:15.178391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-52d4a23d-c390-4c81-b770-d9e0dc1816b9 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] Calling method '.version_select at 0x7fb840f5be50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:15.315085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] validate_networks() for [('c5ead2ac-90a5-4a98-88cc-7af516957d4b', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:15.454805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG neutronclient.v2_0.client [None req-52d4a23d-c390-4c81-b770-d9e0dc1816b9 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 20f2f4d1-6ba9-4d7e-a209-f85d9f36c518 could not be found", "detail": ""}} {{(pid=119606) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:23:15.455800 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-52d4a23d-c390-4c81-b770-d9e0dc1816b9 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] HTTP exception thrown: Floating IP not found for ID 20f2f4d1-6ba9-4d7e-a209-f85d9f36c518 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-52d4a23d-c390-4c81-b770-d9e0dc1816b9 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] Request method failure captured: Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-floating-ips/20f2f4d1-6ba9-4d7e-a209-f85d9f36c518 HTTP/1.1 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14MxXRpvSCEBzcLCcq0GfkkngQfpiiVU5oKo9_chsXfcvb3lDJsrw9Td2tAqlICUSDAxszkBTjg30iT7C7O_ea028FriJBwNSykdbAmXplsqZSkBdIYKc1AT64BEKVzlICOkteesEPcl334SSbEXtqpxbz2469E1VrQgtuoaWEuBXwU Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 097391cafc5f4f66b53d38b2aa88042c Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-781272720 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/097391cafc5f4f66b53d38b2aa88042c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/097391cafc5f4f66b53d38b2aa88042c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/097391cafc5f4f66b53d38b2aa88042c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_097391cafc5f4f66b53d38b2aa88042c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-781272720 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 097391cafc5f4f66b53d38b2aa88042c Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-781272720 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-FloatingIPsNegativeTestJSON-781272720-project Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 45a923fb445e4e468ba067b7e74d10d5 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-781272720-project Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: exception: Floating IP not found for ID 20f2f4d1-6ba9-4d7e-a209-f85d9f36c518 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '20f2f4d1-6ba9-4d7e-a209-f85d9f36c518'} Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 20f2f4d1-6ba9-4d7e-a209-f85d9f36c518 could not be found Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27e2b1cd-80c0-42fa-b336-ed5f3f432cad'] Jul 20 04:23:15.458524 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 20f2f4d1-6ba9-4d7e-a209-f85d9f36c518. Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 20f2f4d1-6ba9-4d7e-a209-f85d9f36c518 Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 20f2f4d1-6ba9-4d7e-a209-f85d9f36c518 Jul 20 04:23:15.463923 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:15.470913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-52d4a23d-c390-4c81-b770-d9e0dc1816b9 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] Returning 404 to user: Floating IP not found for ID 20f2f4d1-6ba9-4d7e-a209-f85d9f36c518 {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:15.472935 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-52d4a23d-c390-4c81-b770-d9e0dc1816b9 tempest-FloatingIPsNegativeTestJSON-781272720 tempest-FloatingIPsNegativeTestJSON-781272720-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/20f2f4d1-6ba9-4d7e-a209-f85d9f36c518" status: 404 len: 111 microversion: 2.1 time: 0.299012 Jul 20 04:23:15.473918 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1753/3497] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:23:15 2022] DELETE /compute/v2.1/os-floating-ips/20f2f4d1-6ba9-4d7e-a209-f85d9f36c518 => generated 111 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:23:15.780430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97821ee1-eb8d-4894-b231-5f9d0e9108d4 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:15.781899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97821ee1-eb8d-4894-b231-5f9d0e9108d4 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:15.795054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97821ee1-eb8d-4894-b231-5f9d0e9108d4 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.795852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97821ee1-eb8d-4894-b231-5f9d0e9108d4 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:15.796886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97821ee1-eb8d-4894-b231-5f9d0e9108d4 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.797570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97821ee1-eb8d-4894-b231-5f9d0e9108d4 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.314946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97821ee1-eb8d-4894-b231-5f9d0e9108d4 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.325793 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97821ee1-eb8d-4894-b231-5f9d0e9108d4 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1273 microversion: 2.1 time: 0.548916 Jul 20 04:23:16.353740 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1754/3498] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:15 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1273 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:16.362394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6195dd6b-8896-427f-8d85-26d7b518c9d0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.362693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6195dd6b-8896-427f-8d85-26d7b518c9d0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.373555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6195dd6b-8896-427f-8d85-26d7b518c9d0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.374017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6195dd6b-8896-427f-8d85-26d7b518c9d0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.390393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6195dd6b-8896-427f-8d85-26d7b518c9d0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.391077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6195dd6b-8896-427f-8d85-26d7b518c9d0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.844728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6195dd6b-8896-427f-8d85-26d7b518c9d0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.852019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:17.861796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6195dd6b-8896-427f-8d85-26d7b518c9d0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.863421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6195dd6b-8896-427f-8d85-26d7b518c9d0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.864650 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6195dd6b-8896-427f-8d85-26d7b518c9d0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 1.509785 Jul 20 04:23:17.884871 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1755/3499] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:17.895646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b2ce63c-dab1-48a3-aea5-6602bcf33e4e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.896335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b2ce63c-dab1-48a3-aea5-6602bcf33e4e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.907174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b2ce63c-dab1-48a3-aea5-6602bcf33e4e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.907633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b2ce63c-dab1-48a3-aea5-6602bcf33e4e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.908424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b2ce63c-dab1-48a3-aea5-6602bcf33e4e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.908876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b2ce63c-dab1-48a3-aea5-6602bcf33e4e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.074074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b2ce63c-dab1-48a3-aea5-6602bcf33e4e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:18.084207 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b2ce63c-dab1-48a3-aea5-6602bcf33e4e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1273 microversion: 2.1 time: 0.197977 Jul 20 04:23:18.085200 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1756/3500] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:18.276978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:18.277463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:18.278331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:18.279106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:18.280005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:18.285945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:18.311216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.314408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.318456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.319243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.349576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Getting quotas for project 93f8bfd8e5a34423848573c7caab8d68. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:18.363088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Getting quotas for user 337b3a46906648cb82515704eadcdb38 and project 93f8bfd8e5a34423848573c7caab8d68. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:18.384131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:18.388018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:18.480201 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e092a8df-7430-4a8c-99a5-1d0dccfd03a9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.709793 Jul 20 04:23:18.488344 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1745/3501] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 3718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:18.495447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bda76b67-1b37-4a89-a8df-2b34c6359a99 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:18.496296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bda76b67-1b37-4a89-a8df-2b34c6359a99 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:18.849451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bda76b67-1b37-4a89-a8df-2b34c6359a99 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:18.867449 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bda76b67-1b37-4a89-a8df-2b34c6359a99 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1238 microversion: 2.1 time: 0.376833 Jul 20 04:23:18.881048 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1757/3502] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:18 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1238 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:18.891529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-65347bc3-b8bc-4aae-b3ca-103fb09296f4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:18.891735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-65347bc3-b8bc-4aae-b3ca-103fb09296f4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:18.914301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65347bc3-b8bc-4aae-b3ca-103fb09296f4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.915498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65347bc3-b8bc-4aae-b3ca-103fb09296f4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.918101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65347bc3-b8bc-4aae-b3ca-103fb09296f4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.919203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65347bc3-b8bc-4aae-b3ca-103fb09296f4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.101817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a7e6306-2751-47d7-8896-373d6c7d8fef tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.102945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3a7e6306-2751-47d7-8896-373d6c7d8fef tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:19.136157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a7e6306-2751-47d7-8896-373d6c7d8fef tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.140468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a7e6306-2751-47d7-8896-373d6c7d8fef tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.141723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a7e6306-2751-47d7-8896-373d6c7d8fef tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.141855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a7e6306-2751-47d7-8896-373d6c7d8fef tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.289594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3a7e6306-2751-47d7-8896-373d6c7d8fef tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.334707 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3a7e6306-2751-47d7-8896-373d6c7d8fef tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1273 microversion: 2.1 time: 0.205121 Jul 20 04:23:19.337384 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1758/3503] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:19.892259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d0ea0fb-f423-4872-8462-74e96653b096 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.894071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d0ea0fb-f423-4872-8462-74e96653b096 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:19.926055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d0ea0fb-f423-4872-8462-74e96653b096 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.928775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d0ea0fb-f423-4872-8462-74e96653b096 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.931520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d0ea0fb-f423-4872-8462-74e96653b096 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.932434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d0ea0fb-f423-4872-8462-74e96653b096 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.060063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d0ea0fb-f423-4872-8462-74e96653b096 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.083242 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d0ea0fb-f423-4872-8462-74e96653b096 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1290 microversion: 2.1 time: 0.196694 Jul 20 04:23:20.083850 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1759/3504] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1290 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:20.157253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-65347bc3-b8bc-4aae-b3ca-103fb09296f4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.172048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-65347bc3-b8bc-4aae-b3ca-103fb09296f4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.178137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-65347bc3-b8bc-4aae-b3ca-103fb09296f4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.180601 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-65347bc3-b8bc-4aae-b3ca-103fb09296f4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 1.296230 Jul 20 04:23:20.193749 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1746/3505] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:18 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:20.361785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5631713d-a80b-4961-bf76-bc1ae72b033a tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.364671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5631713d-a80b-4961-bf76-bc1ae72b033a tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.388510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5631713d-a80b-4961-bf76-bc1ae72b033a tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.389319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5631713d-a80b-4961-bf76-bc1ae72b033a tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.390406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5631713d-a80b-4961-bf76-bc1ae72b033a tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.391721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5631713d-a80b-4961-bf76-bc1ae72b033a tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.101357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b44172f-615b-444b-81ca-09ba47f6ada6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:21.102377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b44172f-615b-444b-81ca-09ba47f6ada6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:21.114818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b44172f-615b-444b-81ca-09ba47f6ada6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.119492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b44172f-615b-444b-81ca-09ba47f6ada6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.120749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b44172f-615b-444b-81ca-09ba47f6ada6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.121430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b44172f-615b-444b-81ca-09ba47f6ada6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.177644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5631713d-a80b-4961-bf76-bc1ae72b033a tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.186192 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5631713d-a80b-4961-bf76-bc1ae72b033a tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1315 microversion: 2.1 time: 0.836857 Jul 20 04:23:21.190573 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1760/3506] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:21.203754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5fe210e6-1f7d-4a06-b5e5-a9f346cf9044 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:21.204827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5fe210e6-1f7d-4a06-b5e5-a9f346cf9044 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:21.218373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fe210e6-1f7d-4a06-b5e5-a9f346cf9044 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.219242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fe210e6-1f7d-4a06-b5e5-a9f346cf9044 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.220217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fe210e6-1f7d-4a06-b5e5-a9f346cf9044 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.223194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fe210e6-1f7d-4a06-b5e5-a9f346cf9044 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.373441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7b44172f-615b-444b-81ca-09ba47f6ada6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.391988 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b44172f-615b-444b-81ca-09ba47f6ada6 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1296 microversion: 2.1 time: 0.289857 Jul 20 04:23:21.393817 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1747/3507] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:21 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1296 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:21.672735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5fe210e6-1f7d-4a06-b5e5-a9f346cf9044 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.690905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5fe210e6-1f7d-4a06-b5e5-a9f346cf9044 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.696205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5fe210e6-1f7d-4a06-b5e5-a9f346cf9044 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.706500 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5fe210e6-1f7d-4a06-b5e5-a9f346cf9044 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.506340 Jul 20 04:23:21.721559 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1761/3508] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:21 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:22.205285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10833a2a-a7ad-43e1-bccb-bf6a33b530d3 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:22.205901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10833a2a-a7ad-43e1-bccb-bf6a33b530d3 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:22.215561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10833a2a-a7ad-43e1-bccb-bf6a33b530d3 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.216029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10833a2a-a7ad-43e1-bccb-bf6a33b530d3 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.216838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10833a2a-a7ad-43e1-bccb-bf6a33b530d3 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.217286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10833a2a-a7ad-43e1-bccb-bf6a33b530d3 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.408948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26cc3542-9167-4f5e-9723-d3698de6032e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:22.409644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26cc3542-9167-4f5e-9723-d3698de6032e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:22.415285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:22.417291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:22.419089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26cc3542-9167-4f5e-9723-d3698de6032e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.419822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26cc3542-9167-4f5e-9723-d3698de6032e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.420989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26cc3542-9167-4f5e-9723-d3698de6032e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.423463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26cc3542-9167-4f5e-9723-d3698de6032e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.610970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-26cc3542-9167-4f5e-9723-d3698de6032e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:22.627583 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26cc3542-9167-4f5e-9723-d3698de6032e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1296 microversion: 2.1 time: 0.222157 Jul 20 04:23:22.628711 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1762/3509] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:22 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1296 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:22.731052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-00c9b853-7d10-4aa9-95d5-59b29fdea0e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:22.732758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-00c9b853-7d10-4aa9-95d5-59b29fdea0e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:22.745304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00c9b853-7d10-4aa9-95d5-59b29fdea0e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.746509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00c9b853-7d10-4aa9-95d5-59b29fdea0e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.748301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00c9b853-7d10-4aa9-95d5-59b29fdea0e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:22.749363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00c9b853-7d10-4aa9-95d5-59b29fdea0e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:22.903759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10833a2a-a7ad-43e1-bccb-bf6a33b530d3 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:22.932123 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10833a2a-a7ad-43e1-bccb-bf6a33b530d3 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1315 microversion: 2.1 time: 0.721555 Jul 20 04:23:22.947353 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1748/3510] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:22 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:23.185654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-00c9b853-7d10-4aa9-95d5-59b29fdea0e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:23.212194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-00c9b853-7d10-4aa9-95d5-59b29fdea0e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:23.217003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-00c9b853-7d10-4aa9-95d5-59b29fdea0e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:23.219748 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-00c9b853-7d10-4aa9-95d5-59b29fdea0e3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.496587 Jul 20 04:23:23.237961 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1763/3511] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:22 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:23.644989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ec8584c-d7d3-4c7e-ab9e-5233527aa51f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:23.645608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ec8584c-d7d3-4c7e-ab9e-5233527aa51f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:23.662129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ec8584c-d7d3-4c7e-ab9e-5233527aa51f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.662612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ec8584c-d7d3-4c7e-ab9e-5233527aa51f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.663661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ec8584c-d7d3-4c7e-ab9e-5233527aa51f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.664103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ec8584c-d7d3-4c7e-ab9e-5233527aa51f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.700548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:23.968531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f3b9511c-5c35-4629-bcd2-fc7582e861d9 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:23.969158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f3b9511c-5c35-4629-bcd2-fc7582e861d9 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:23.981682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f3b9511c-5c35-4629-bcd2-fc7582e861d9 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.982153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f3b9511c-5c35-4629-bcd2-fc7582e861d9 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.987310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f3b9511c-5c35-4629-bcd2-fc7582e861d9 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.987794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f3b9511c-5c35-4629-bcd2-fc7582e861d9 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.017320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ec8584c-d7d3-4c7e-ab9e-5233527aa51f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:24.028164 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ec8584c-d7d3-4c7e-ab9e-5233527aa51f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1296 microversion: 2.1 time: 0.386885 Jul 20 04:23:24.029055 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1749/3512] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:23 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1296 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:24.253049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b2e09c9-c56b-4574-8b12-9df396e8674c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:24.253959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9b2e09c9-c56b-4574-8b12-9df396e8674c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:24.265607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b2e09c9-c56b-4574-8b12-9df396e8674c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.266401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b2e09c9-c56b-4574-8b12-9df396e8674c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.267565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b2e09c9-c56b-4574-8b12-9df396e8674c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.271751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b2e09c9-c56b-4574-8b12-9df396e8674c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.448560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f3b9511c-5c35-4629-bcd2-fc7582e861d9 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:24.456647 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f3b9511c-5c35-4629-bcd2-fc7582e861d9 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1315 microversion: 2.1 time: 0.492480 Jul 20 04:23:24.458931 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1764/3513] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:23 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:25.062304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b2028a1-9b45-40d5-968f-bfb04023e61d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.063085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3b2028a1-9b45-40d5-968f-bfb04023e61d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:25.085107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b2028a1-9b45-40d5-968f-bfb04023e61d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.085946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b2028a1-9b45-40d5-968f-bfb04023e61d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.087228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b2028a1-9b45-40d5-968f-bfb04023e61d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.088045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b2028a1-9b45-40d5-968f-bfb04023e61d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.153648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b2e09c9-c56b-4574-8b12-9df396e8674c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.189278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b2e09c9-c56b-4574-8b12-9df396e8674c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.193762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b2e09c9-c56b-4574-8b12-9df396e8674c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.200070 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9b2e09c9-c56b-4574-8b12-9df396e8674c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.953743 Jul 20 04:23:25.201327 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1750/3514] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:24 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:25.484226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca52e3a7-f416-4a1b-805a-7f908810a228 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.485155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ca52e3a7-f416-4a1b-805a-7f908810a228 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:25.527329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca52e3a7-f416-4a1b-805a-7f908810a228 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.537257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca52e3a7-f416-4a1b-805a-7f908810a228 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.538420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca52e3a7-f416-4a1b-805a-7f908810a228 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.541418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca52e3a7-f416-4a1b-805a-7f908810a228 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.655088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3b2028a1-9b45-40d5-968f-bfb04023e61d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.670994 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b2028a1-9b45-40d5-968f-bfb04023e61d tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1363 microversion: 2.1 time: 0.625074 Jul 20 04:23:25.671955 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1765/3515] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1363 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:26.219744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d9fabbfa-a69f-4ba8-8d0e-540ddbf9721d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:26.220467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d9fabbfa-a69f-4ba8-8d0e-540ddbf9721d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:26.235412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9fabbfa-a69f-4ba8-8d0e-540ddbf9721d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.239426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9fabbfa-a69f-4ba8-8d0e-540ddbf9721d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.240265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9fabbfa-a69f-4ba8-8d0e-540ddbf9721d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.240723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9fabbfa-a69f-4ba8-8d0e-540ddbf9721d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.474968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ca52e3a7-f416-4a1b-805a-7f908810a228 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:26.488292 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ca52e3a7-f416-4a1b-805a-7f908810a228 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1315 microversion: 2.1 time: 1.014328 Jul 20 04:23:26.503728 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1751/3516] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1315 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:26.679163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5600ec45-d2a6-4b57-8c0b-a2297cc32ab8 req-e1142836-6c6c-4da4-a61f-6394624f04af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed365e6-a501-4ce3-afa5-88bd37017e39", "tag": "a9cb387f-ead4-4aeb-9327-7426b60dad7c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:26.699800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5600ec45-d2a6-4b57-8c0b-a2297cc32ab8 req-e1142836-6c6c-4da4-a61f-6394624f04af service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.700252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5600ec45-d2a6-4b57-8c0b-a2297cc32ab8 req-e1142836-6c6c-4da4-a61f-6394624f04af service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.735076 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5600ec45-d2a6-4b57-8c0b-a2297cc32ab8 req-e1142836-6c6c-4da4-a61f-6394624f04af service nova] Creating event network-changed:a9cb387f-ead4-4aeb-9327-7426b60dad7c for instance 3ed365e6-a501-4ce3-afa5-88bd37017e39 on n-h2-760456-11 Jul 20 04:23:26.747067 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5600ec45-d2a6-4b57-8c0b-a2297cc32ab8 req-e1142836-6c6c-4da4-a61f-6394624f04af service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082966 Jul 20 04:23:26.751512 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1752/3517] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:26.767950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d195ba97-aba1-4c7d-9445-a5d87ed7dbb4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:26.768681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d195ba97-aba1-4c7d-9445-a5d87ed7dbb4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:26.791597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d195ba97-aba1-4c7d-9445-a5d87ed7dbb4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.792156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d195ba97-aba1-4c7d-9445-a5d87ed7dbb4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.795862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d195ba97-aba1-4c7d-9445-a5d87ed7dbb4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.796321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d195ba97-aba1-4c7d-9445-a5d87ed7dbb4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.072423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d9fabbfa-a69f-4ba8-8d0e-540ddbf9721d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.116993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d9fabbfa-a69f-4ba8-8d0e-540ddbf9721d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.123158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d9fabbfa-a69f-4ba8-8d0e-540ddbf9721d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.132414 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d9fabbfa-a69f-4ba8-8d0e-540ddbf9721d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.912390 Jul 20 04:23:27.137079 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1766/3518] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:26 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:27.515934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2f78169a-3c48-4df1-9d35-3d0a088ea0c5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:27.517943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f78169a-3c48-4df1-9d35-3d0a088ea0c5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:27.536596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f78169a-3c48-4df1-9d35-3d0a088ea0c5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.538787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f78169a-3c48-4df1-9d35-3d0a088ea0c5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.542081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f78169a-3c48-4df1-9d35-3d0a088ea0c5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.543253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f78169a-3c48-4df1-9d35-3d0a088ea0c5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.616178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d195ba97-aba1-4c7d-9445-a5d87ed7dbb4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.625564 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d195ba97-aba1-4c7d-9445-a5d87ed7dbb4 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1363 microversion: 2.1 time: 0.870178 Jul 20 04:23:27.635252 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1753/3519] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:26 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1363 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:28.169237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2f78169a-3c48-4df1-9d35-3d0a088ea0c5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:28.176013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6a0e3112-c7b2-468a-afcd-7ef63c32964c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:28.178869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6a0e3112-c7b2-468a-afcd-7ef63c32964c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:28.202128 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2f78169a-3c48-4df1-9d35-3d0a088ea0c5 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1315 microversion: 2.1 time: 0.698120 Jul 20 04:23:28.210566 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1767/3520] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:27 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:28.213665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a0e3112-c7b2-468a-afcd-7ef63c32964c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.214139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a0e3112-c7b2-468a-afcd-7ef63c32964c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.217705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a0e3112-c7b2-468a-afcd-7ef63c32964c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.219534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a0e3112-c7b2-468a-afcd-7ef63c32964c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.335807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:28.377740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=12 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:28.654993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f11b6f29-f86f-4474-8119-6677829c4647 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:28.655633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f11b6f29-f86f-4474-8119-6677829c4647 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:28.676858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f11b6f29-f86f-4474-8119-6677829c4647 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.680210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f11b6f29-f86f-4474-8119-6677829c4647 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.683706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f11b6f29-f86f-4474-8119-6677829c4647 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.685801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f11b6f29-f86f-4474-8119-6677829c4647 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.865989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:29.114451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6a0e3112-c7b2-468a-afcd-7ef63c32964c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.185112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6a0e3112-c7b2-468a-afcd-7ef63c32964c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.187021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6a0e3112-c7b2-468a-afcd-7ef63c32964c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.188921 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6a0e3112-c7b2-468a-afcd-7ef63c32964c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 1.035882 Jul 20 04:23:29.191660 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1754/3521] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:28 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:29.234409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9f6a3fee-7aac-4f0c-aa4d-84cfe490502d tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:29.235507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9f6a3fee-7aac-4f0c-aa4d-84cfe490502d tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:29.265363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f6a3fee-7aac-4f0c-aa4d-84cfe490502d tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.266088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f6a3fee-7aac-4f0c-aa4d-84cfe490502d tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.268424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f6a3fee-7aac-4f0c-aa4d-84cfe490502d tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.269986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f6a3fee-7aac-4f0c-aa4d-84cfe490502d tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.766001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9f6a3fee-7aac-4f0c-aa4d-84cfe490502d tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.781048 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9f6a3fee-7aac-4f0c-aa4d-84cfe490502d tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1315 microversion: 2.1 time: 0.554606 Jul 20 04:23:29.781817 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1755/3522] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:29 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:29.793592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f4cc1d68-2a61-48a7-9204-1815795f4a3a req-da329466-a97c-4ef2-9ae2-4e206c64f8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b8484b-3078-4fc9-923d-e72a9aa94a9b", "tag": "67af8e46-651c-4cb7-8e70-c3a2946e9294"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:29.833280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f4cc1d68-2a61-48a7-9204-1815795f4a3a req-da329466-a97c-4ef2-9ae2-4e206c64f8d3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.835115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f4cc1d68-2a61-48a7-9204-1815795f4a3a req-da329466-a97c-4ef2-9ae2-4e206c64f8d3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.886003 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f4cc1d68-2a61-48a7-9204-1815795f4a3a req-da329466-a97c-4ef2-9ae2-4e206c64f8d3 service nova] Creating event network-changed:67af8e46-651c-4cb7-8e70-c3a2946e9294 for instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b on n-h2-760456-11 Jul 20 04:23:29.897412 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f4cc1d68-2a61-48a7-9204-1815795f4a3a req-da329466-a97c-4ef2-9ae2-4e206c64f8d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110962 Jul 20 04:23:29.900850 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1756/3523] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:29.905385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f11b6f29-f86f-4474-8119-6677829c4647 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.916330 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f11b6f29-f86f-4474-8119-6677829c4647 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1363 microversion: 2.1 time: 1.268398 Jul 20 04:23:29.929927 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1768/3524] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:28 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1363 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:30.218045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1593aff7-8ecd-4c7b-8c3a-2d341a9748eb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:30.219098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1593aff7-8ecd-4c7b-8c3a-2d341a9748eb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:30.247263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1593aff7-8ecd-4c7b-8c3a-2d341a9748eb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.247725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1593aff7-8ecd-4c7b-8c3a-2d341a9748eb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:30.248525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1593aff7-8ecd-4c7b-8c3a-2d341a9748eb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.249059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1593aff7-8ecd-4c7b-8c3a-2d341a9748eb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:30.801625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-33bcd707-ed85-4b52-afe9-c2900549b449 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:30.802304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-33bcd707-ed85-4b52-afe9-c2900549b449 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:30.817261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33bcd707-ed85-4b52-afe9-c2900549b449 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.818906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33bcd707-ed85-4b52-afe9-c2900549b449 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:30.820395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33bcd707-ed85-4b52-afe9-c2900549b449 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:30.821793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33bcd707-ed85-4b52-afe9-c2900549b449 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:31.619993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1593aff7-8ecd-4c7b-8c3a-2d341a9748eb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:31.631433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1593aff7-8ecd-4c7b-8c3a-2d341a9748eb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:31.640692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1593aff7-8ecd-4c7b-8c3a-2d341a9748eb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:31.644735 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1593aff7-8ecd-4c7b-8c3a-2d341a9748eb tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 1.436404 Jul 20 04:23:31.662930 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1757/3525] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:30 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:31.679694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0147c8f-8b69-4a77-9846-abdad280ccd9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:31.684232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0147c8f-8b69-4a77-9846-abdad280ccd9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:31.700285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0147c8f-8b69-4a77-9846-abdad280ccd9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:31.701024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0147c8f-8b69-4a77-9846-abdad280ccd9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:31.701988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0147c8f-8b69-4a77-9846-abdad280ccd9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:31.702783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0147c8f-8b69-4a77-9846-abdad280ccd9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:32.116342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-33bcd707-ed85-4b52-afe9-c2900549b449 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:32.136643 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-33bcd707-ed85-4b52-afe9-c2900549b449 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1315 microversion: 2.1 time: 1.342280 Jul 20 04:23:32.137925 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1769/3526] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:30 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1315 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:32.444759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c0147c8f-8b69-4a77-9846-abdad280ccd9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:32.458894 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0147c8f-8b69-4a77-9846-abdad280ccd9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1363 microversion: 2.1 time: 0.787064 Jul 20 04:23:32.463702 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1758/3527] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:31 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1363 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:32.671349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-24282bea-d02c-4754-b209-9b6f6a41bfc2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:32.672093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-24282bea-d02c-4754-b209-9b6f6a41bfc2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:32.682072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24282bea-d02c-4754-b209-9b6f6a41bfc2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:32.682753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24282bea-d02c-4754-b209-9b6f6a41bfc2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:32.683938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24282bea-d02c-4754-b209-9b6f6a41bfc2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:32.684625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24282bea-d02c-4754-b209-9b6f6a41bfc2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.190700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-24282bea-d02c-4754-b209-9b6f6a41bfc2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:33.207884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-24282bea-d02c-4754-b209-9b6f6a41bfc2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:33.215123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-24282bea-d02c-4754-b209-9b6f6a41bfc2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:33.217080 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-24282bea-d02c-4754-b209-9b6f6a41bfc2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.551788 Jul 20 04:23:33.217897 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1770/3528] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:32 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:33.228666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a839754c-3795-44a1-b624-7f6b69ad3717 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:33.235371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a839754c-3795-44a1-b624-7f6b69ad3717 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:33.253133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a839754c-3795-44a1-b624-7f6b69ad3717 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.253715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a839754c-3795-44a1-b624-7f6b69ad3717 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.256004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a839754c-3795-44a1-b624-7f6b69ad3717 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.257664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a839754c-3795-44a1-b624-7f6b69ad3717 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.360985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-313528577", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "a6502162-a528-4ba5-89a1-8e5c89b95706"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:33.477987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] validate_networks() for [('a6502162-a528-4ba5-89a1-8e5c89b95706', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:33.586463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a839754c-3795-44a1-b624-7f6b69ad3717 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:33.607499 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a839754c-3795-44a1-b624-7f6b69ad3717 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1315 microversion: 2.1 time: 0.380658 Jul 20 04:23:33.609528 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1771/3529] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:33 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:33.621225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-64cc01d2-33cf-4d48-b754-5894fcd20790 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:33.622218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-64cc01d2-33cf-4d48-b754-5894fcd20790 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:33.630893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64cc01d2-33cf-4d48-b754-5894fcd20790 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.631979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64cc01d2-33cf-4d48-b754-5894fcd20790 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.633388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64cc01d2-33cf-4d48-b754-5894fcd20790 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.634523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64cc01d2-33cf-4d48-b754-5894fcd20790 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.877286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-64cc01d2-33cf-4d48-b754-5894fcd20790 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:33.889306 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-64cc01d2-33cf-4d48-b754-5894fcd20790 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1363 microversion: 2.1 time: 0.278409 Jul 20 04:23:33.890189 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1772/3530] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:33 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:33.907312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-974f9e60-bb2d-46ea-a5e0-b6da50be69e1 req-0ed48aa9-b4f6-4dc9-871e-d4d882313e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed365e6-a501-4ce3-afa5-88bd37017e39", "name": "network-vif-plugged", "status": "completed", "tag": "a9cb387f-ead4-4aeb-9327-7426b60dad7c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:33.919917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-974f9e60-bb2d-46ea-a5e0-b6da50be69e1 req-0ed48aa9-b4f6-4dc9-871e-d4d882313e15 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:33.920783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-974f9e60-bb2d-46ea-a5e0-b6da50be69e1 req-0ed48aa9-b4f6-4dc9-871e-d4d882313e15 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:33.943113 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-974f9e60-bb2d-46ea-a5e0-b6da50be69e1 req-0ed48aa9-b4f6-4dc9-871e-d4d882313e15 service nova] Creating event network-vif-plugged:a9cb387f-ead4-4aeb-9327-7426b60dad7c for instance 3ed365e6-a501-4ce3-afa5-88bd37017e39 on n-h2-760456-11 Jul 20 04:23:33.952205 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-974f9e60-bb2d-46ea-a5e0-b6da50be69e1 req-0ed48aa9-b4f6-4dc9-871e-d4d882313e15 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060010 Jul 20 04:23:33.953154 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1773/3531] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:34.239009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b0e244db-f2c5-4ca8-a3b4-29556f7a4d10 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.239729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b0e244db-f2c5-4ca8-a3b4-29556f7a4d10 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:34.264586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0e244db-f2c5-4ca8-a3b4-29556f7a4d10 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.267301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0e244db-f2c5-4ca8-a3b4-29556f7a4d10 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.275839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0e244db-f2c5-4ca8-a3b4-29556f7a4d10 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.277743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0e244db-f2c5-4ca8-a3b4-29556f7a4d10 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.294683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:34.694165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0e244db-f2c5-4ca8-a3b4-29556f7a4d10 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.724209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0e244db-f2c5-4ca8-a3b4-29556f7a4d10 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.726655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0e244db-f2c5-4ca8-a3b4-29556f7a4d10 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.730764 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b0e244db-f2c5-4ca8-a3b4-29556f7a4d10 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.497076 Jul 20 04:23:34.733454 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1774/3532] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:34 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:34.739947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-302fc4d4-2c04-4f4c-80de-6dd4ee701930 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.740768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-302fc4d4-2c04-4f4c-80de-6dd4ee701930 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:34.748645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-302fc4d4-2c04-4f4c-80de-6dd4ee701930 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.749811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-302fc4d4-2c04-4f4c-80de-6dd4ee701930 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.750925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-302fc4d4-2c04-4f4c-80de-6dd4ee701930 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.752680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-302fc4d4-2c04-4f4c-80de-6dd4ee701930 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.175296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-302fc4d4-2c04-4f4c-80de-6dd4ee701930 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:35.187430 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-302fc4d4-2c04-4f4c-80de-6dd4ee701930 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1315 microversion: 2.1 time: 0.452520 Jul 20 04:23:35.188035 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1775/3533] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:34 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:35.218954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-60263c22-4a0e-41b4-8d62-e6f0fd9a27b0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:35.228989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-60263c22-4a0e-41b4-8d62-e6f0fd9a27b0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:35.253142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60263c22-4a0e-41b4-8d62-e6f0fd9a27b0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.253761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60263c22-4a0e-41b4-8d62-e6f0fd9a27b0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.259175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60263c22-4a0e-41b4-8d62-e6f0fd9a27b0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.259791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60263c22-4a0e-41b4-8d62-e6f0fd9a27b0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.511257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-60263c22-4a0e-41b4-8d62-e6f0fd9a27b0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:35.529289 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-60263c22-4a0e-41b4-8d62-e6f0fd9a27b0 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1363 microversion: 2.1 time: 0.321176 Jul 20 04:23:35.530201 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1776/3534] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:35 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:35.760084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fad05058-a014-4d4c-a54b-945f2fc886f8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:35.766972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fad05058-a014-4d4c-a54b-945f2fc886f8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:35.789261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fad05058-a014-4d4c-a54b-945f2fc886f8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.791973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fad05058-a014-4d4c-a54b-945f2fc886f8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.792800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fad05058-a014-4d4c-a54b-945f2fc886f8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.793809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fad05058-a014-4d4c-a54b-945f2fc886f8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.405519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fad05058-a014-4d4c-a54b-945f2fc886f8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.425955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fad05058-a014-4d4c-a54b-945f2fc886f8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.439306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fad05058-a014-4d4c-a54b-945f2fc886f8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.441191 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fad05058-a014-4d4c-a54b-945f2fc886f8 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.690340 Jul 20 04:23:36.456711 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1777/3535] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:35 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:36.464083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-60372c18-7f1a-4922-abce-792a08c25d5b tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:36.465113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-60372c18-7f1a-4922-abce-792a08c25d5b tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:36.475317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60372c18-7f1a-4922-abce-792a08c25d5b tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.476152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60372c18-7f1a-4922-abce-792a08c25d5b tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.478549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60372c18-7f1a-4922-abce-792a08c25d5b tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.479269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-60372c18-7f1a-4922-abce-792a08c25d5b tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.742338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-60372c18-7f1a-4922-abce-792a08c25d5b tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.753729 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-60372c18-7f1a-4922-abce-792a08c25d5b tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1503 microversion: 2.1 time: 0.293999 Jul 20 04:23:36.766416 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1778/3536] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:36.786207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-77fb5be2-72a1-496f-8b3a-1f064d822ee3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:36.788648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-77fb5be2-72a1-496f-8b3a-1f064d822ee3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:36.802977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77fb5be2-72a1-496f-8b3a-1f064d822ee3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.804070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77fb5be2-72a1-496f-8b3a-1f064d822ee3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.806575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77fb5be2-72a1-496f-8b3a-1f064d822ee3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.807868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77fb5be2-72a1-496f-8b3a-1f064d822ee3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.040858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:37.042091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:37.042990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:37.044316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:37.060514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:37.103248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.104571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.106009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.106742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.113745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-77fb5be2-72a1-496f-8b3a-1f064d822ee3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:37.134773 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-77fb5be2-72a1-496f-8b3a-1f064d822ee3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1363 microversion: 2.1 time: 0.367111 Jul 20 04:23:37.135410 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1779/3537] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:37.141590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be893ff7-816f-4f02-8b10-3d34d634955e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.142034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-be893ff7-816f-4f02-8b10-3d34d634955e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.144063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Getting quotas for project 6e0df1f7215e4150975085ea1c52bf23. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:37.166534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be893ff7-816f-4f02-8b10-3d34d634955e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.167625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be893ff7-816f-4f02-8b10-3d34d634955e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.169297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Getting quotas for user 2093470c6f894ad9a5b0fb5fc1fe87f4 and project 6e0df1f7215e4150975085ea1c52bf23. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:37.171750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be893ff7-816f-4f02-8b10-3d34d634955e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.173946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be893ff7-816f-4f02-8b10-3d34d634955e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.217198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:37.232608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:37.362325 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9d552626-b709-4f96-b5ab-adbad327373a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.312235 Jul 20 04:23:37.366231 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1759/3538] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:37.367067 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-be893ff7-816f-4f02-8b10-3d34d634955e tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.229357 Jul 20 04:23:37.369279 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1780/3539] 10.222.0.59 () {58 vars in 1295 bytes} [Wed Jul 20 04:23:37 2022] DELETE /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39/os-server-password => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:37.385237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1dcd9212-e837-49f2-b3cf-9f47cd113f31 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.388463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1dcd9212-e837-49f2-b3cf-9f47cd113f31 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.392016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26a071bd-d258-48ad-a4fd-bbb542a9e33c tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.395110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-26a071bd-d258-48ad-a4fd-bbb542a9e33c tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.439041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26a071bd-d258-48ad-a4fd-bbb542a9e33c tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.439887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26a071bd-d258-48ad-a4fd-bbb542a9e33c tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.440890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26a071bd-d258-48ad-a4fd-bbb542a9e33c tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.443466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26a071bd-d258-48ad-a4fd-bbb542a9e33c tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.505956 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-26a071bd-d258-48ad-a4fd-bbb542a9e33c tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.131451 Jul 20 04:23:37.514811 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1760/3540] 10.222.0.59 () {58 vars in 1292 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39/os-server-password => generated 16 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:23:37.523133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-369eb8c2-fe40-4820-88b6-3705dccb0baf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.523747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-369eb8c2-fe40-4820-88b6-3705dccb0baf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.531064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-369eb8c2-fe40-4820-88b6-3705dccb0baf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.531773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-369eb8c2-fe40-4820-88b6-3705dccb0baf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.532768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-369eb8c2-fe40-4820-88b6-3705dccb0baf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.535071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-369eb8c2-fe40-4820-88b6-3705dccb0baf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.536595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1dcd9212-e837-49f2-b3cf-9f47cd113f31 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:37.544983 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1dcd9212-e837-49f2-b3cf-9f47cd113f31 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1224 microversion: 2.1 time: 0.166620 Jul 20 04:23:37.549554 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1781/3541] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1224 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:37.568111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e6e7fd58-fd86-4da5-84e6-4d59b56d8859 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.568638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e6e7fd58-fd86-4da5-84e6-4d59b56d8859 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.592301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6e7fd58-fd86-4da5-84e6-4d59b56d8859 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.592937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6e7fd58-fd86-4da5-84e6-4d59b56d8859 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.593961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6e7fd58-fd86-4da5-84e6-4d59b56d8859 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.594519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6e7fd58-fd86-4da5-84e6-4d59b56d8859 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.718747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e6e7fd58-fd86-4da5-84e6-4d59b56d8859 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:38.096805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-369eb8c2-fe40-4820-88b6-3705dccb0baf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.097619 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e6e7fd58-fd86-4da5-84e6-4d59b56d8859 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 204 len: 0 microversion: 2.1 time: 0.544002 Jul 20 04:23:38.101482 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1782/3542] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:37 2022] DELETE /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:38.114175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-369eb8c2-fe40-4820-88b6-3705dccb0baf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.120224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-369eb8c2-fe40-4820-88b6-3705dccb0baf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.125141 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-369eb8c2-fe40-4820-88b6-3705dccb0baf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.608883 Jul 20 04:23:38.130441 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1761/3543] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:38.142741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-662accc1-f5c8-4bbb-9aa8-7a780ff16e49 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:38.143523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-662accc1-f5c8-4bbb-9aa8-7a780ff16e49 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:38.155905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-662accc1-f5c8-4bbb-9aa8-7a780ff16e49 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.156379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-662accc1-f5c8-4bbb-9aa8-7a780ff16e49 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.157181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-662accc1-f5c8-4bbb-9aa8-7a780ff16e49 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.157667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-662accc1-f5c8-4bbb-9aa8-7a780ff16e49 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.161905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-275e7956-ac34-47f9-9f23-c01975a3b1a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:38.163060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-275e7956-ac34-47f9-9f23-c01975a3b1a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:38.182022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-275e7956-ac34-47f9-9f23-c01975a3b1a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.187851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-275e7956-ac34-47f9-9f23-c01975a3b1a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.191983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-275e7956-ac34-47f9-9f23-c01975a3b1a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.193309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-275e7956-ac34-47f9-9f23-c01975a3b1a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.653647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-275e7956-ac34-47f9-9f23-c01975a3b1a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.677923 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-275e7956-ac34-47f9-9f23-c01975a3b1a2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1363 microversion: 2.1 time: 0.524220 Jul 20 04:23:38.689926 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1762/3544] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:38 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1363 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:38.702895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-489c9838-b91c-4290-bcfb-90a82d6f5f6c req-633a5f8d-b106-472b-a5d4-cb2997499f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b8484b-3078-4fc9-923d-e72a9aa94a9b", "name": "network-vif-plugged", "status": "completed", "tag": "67af8e46-651c-4cb7-8e70-c3a2946e9294"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:38.722839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-489c9838-b91c-4290-bcfb-90a82d6f5f6c req-633a5f8d-b106-472b-a5d4-cb2997499f53 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.724116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-489c9838-b91c-4290-bcfb-90a82d6f5f6c req-633a5f8d-b106-472b-a5d4-cb2997499f53 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.754404 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-489c9838-b91c-4290-bcfb-90a82d6f5f6c req-633a5f8d-b106-472b-a5d4-cb2997499f53 service nova] Creating event network-vif-plugged:67af8e46-651c-4cb7-8e70-c3a2946e9294 for instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b on n-h2-760456-11 Jul 20 04:23:38.765870 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-489c9838-b91c-4290-bcfb-90a82d6f5f6c req-633a5f8d-b106-472b-a5d4-cb2997499f53 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073314 Jul 20 04:23:38.767332 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1763/3545] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:38.791786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e23e411f-2387-4e40-b000-d6ad57674e7e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:38.793024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-662accc1-f5c8-4bbb-9aa8-7a780ff16e49 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.797698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e23e411f-2387-4e40-b000-d6ad57674e7e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:38.806369 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-662accc1-f5c8-4bbb-9aa8-7a780ff16e49 tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1509 microversion: 2.1 time: 0.687151 Jul 20 04:23:38.814570 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1783/3546] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:38 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1509 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:38.837312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e23e411f-2387-4e40-b000-d6ad57674e7e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.851720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e23e411f-2387-4e40-b000-d6ad57674e7e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.854555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e23e411f-2387-4e40-b000-d6ad57674e7e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.857768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e23e411f-2387-4e40-b000-d6ad57674e7e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.029922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e23e411f-2387-4e40-b000-d6ad57674e7e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.052924 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e23e411f-2387-4e40-b000-d6ad57674e7e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1220 microversion: 2.1 time: 0.284042 Jul 20 04:23:39.066004 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1764/3547] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:38 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1220 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:39.152878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c5f151d5-224c-47b5-bc3c-8dd813a2cd8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.153555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c5f151d5-224c-47b5-bc3c-8dd813a2cd8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:39.173822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5f151d5-224c-47b5-bc3c-8dd813a2cd8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.179819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5f151d5-224c-47b5-bc3c-8dd813a2cd8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.182766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5f151d5-224c-47b5-bc3c-8dd813a2cd8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.183231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5f151d5-224c-47b5-bc3c-8dd813a2cd8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.205468 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d2d52a85-f06e-4572-9cce-9a5996f98e83 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] 10.222.0.59 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.389201 Jul 20 04:23:39.205994 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1784/3548] 10.222.0.59 () {58 vars in 1127 bytes} [Wed Jul 20 04:23:38 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:23:39.224874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ffd2262c-d8cd-488b-b88e-e9c6af2a12f9 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Calling method '.version_select at 0x7fb840f580d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.275113 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-ffd2262c-d8cd-488b-b88e-e9c6af2a12f9 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] HTTP exception thrown: Image not found. Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ffd2262c-d8cd-488b-b88e-e9c6af2a12f9 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Request method failure captured: Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NKa4oQNe_9cs8i1kB--Tj41CP_aZwgg7EhxJxqtVE1hseLGf0dutsARrlMDpRYCz-zc3PsEDJsQPA7yNuMU-JsZklLFt2A3o_KHULHWLvoabxLjXeC4aQbEoO_a5vb-pp6oE4jEcJZZUuwH_p3fQLTAFxbF7yx_R1pjfI4nsTbcNk Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4d5d26a47b494f249df74762bc37b2c5 Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4d5d26a47b494f249df74762bc37b2c5 Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesDeleteNegativeTestJSON-888852385-project Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 1573cb0411954c20bee3e7f4f20d487d Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-888852385-project Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: exception: Image not found. Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '-1'} Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.277205 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ffd2262c-d8cd-488b-b88e-e9c6af2a12f9 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Returning 404 to user: Image not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ffd2262c-d8cd-488b-b88e-e9c6af2a12f9 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] 10.222.0.59 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.067031 Jul 20 04:23:39.285565 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1785/3549] 10.222.0.59 () {58 vars in 1133 bytes} [Wed Jul 20 04:23:39 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:23:39.294834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ee443b4b-9c5e-48b0-901a-e08b4b7c01b6 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Calling method '.version_select at 0x7fb840f1bd30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.331882 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-ee443b4b-9c5e-48b0-901a-e08b4b7c01b6 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] HTTP exception thrown: Image not found. Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ee443b4b-9c5e-48b0-901a-e08b4b7c01b6 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Request method failure captured: Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/images/deaf5d96-d3ac-4c68-89da-56c9dc41665j HTTP/1.1 Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NKa4oQNe_9cs8i1kB--Tj41CP_aZwgg7EhxJxqtVE1hseLGf0dutsARrlMDpRYCz-zc3PsEDJsQPA7yNuMU-JsZklLFt2A3o_KHULHWLvoabxLjXeC4aQbEoO_a5vb-pp6oE4jEcJZZUuwH_p3fQLTAFxbF7yx_R1pjfI4nsTbcNk Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4d5d26a47b494f249df74762bc37b2c5 Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4d5d26a47b494f249df74762bc37b2c5 Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesDeleteNegativeTestJSON-888852385-project Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 1573cb0411954c20bee3e7f4f20d487d Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-888852385-project Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: exception: Image not found. Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'deaf5d96-d3ac-4c68-89da-56c9dc41665j'} Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image deaf5d96-d3ac-4c68-89da-56c9dc41665j to delete Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image deaf5d96-d3ac-4c68-89da-56c9dc41665j could not be found. Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.333686 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.338862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ee443b4b-9c5e-48b0-901a-e08b4b7c01b6 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Returning 404 to user: Image not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:39.343452 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ee443b4b-9c5e-48b0-901a-e08b4b7c01b6 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] 10.222.0.59 "DELETE /compute/v2.1/images/deaf5d96-d3ac-4c68-89da-56c9dc41665j" status: 404 len: 62 microversion: 2.1 time: 0.055945 Jul 20 04:23:39.344366 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1786/3550] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:39 2022] DELETE /compute/v2.1/images/deaf5d96-d3ac-4c68-89da-56c9dc41665j => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:23:39.356620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-332ea060-0e18-4c2e-867f-8f6e6f365123 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Calling method '.version_select at 0x7fb840f16b80>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.388307 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-332ea060-0e18-4c2e-867f-8f6e6f365123 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] HTTP exception thrown: Image not found. Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-332ea060-0e18-4c2e-867f-8f6e6f365123 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Request method failure captured: Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/images/34658ac8-d5c4-4914-8d2c-dfc6198ca9f81 HTTP/1.1 Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NKa4oQNe_9cs8i1kB--Tj41CP_aZwgg7EhxJxqtVE1hseLGf0dutsARrlMDpRYCz-zc3PsEDJsQPA7yNuMU-JsZklLFt2A3o_KHULHWLvoabxLjXeC4aQbEoO_a5vb-pp6oE4jEcJZZUuwH_p3fQLTAFxbF7yx_R1pjfI4nsTbcNk Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4d5d26a47b494f249df74762bc37b2c5 Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4d5d26a47b494f249df74762bc37b2c5 Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesDeleteNegativeTestJSON-888852385-project Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 1573cb0411954c20bee3e7f4f20d487d Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-888852385-project Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: exception: Image not found. Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '34658ac8-d5c4-4914-8d2c-dfc6198ca9f81'} Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 34658ac8-d5c4-4914-8d2c-dfc6198ca9f81 to delete Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 34658ac8-d5c4-4914-8d2c-dfc6198ca9f81 could not be found. Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.390428 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:23:39.395017 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.398683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-332ea060-0e18-4c2e-867f-8f6e6f365123 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Returning 404 to user: Image not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:39.399971 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-332ea060-0e18-4c2e-867f-8f6e6f365123 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] 10.222.0.59 "DELETE /compute/v2.1/images/34658ac8-d5c4-4914-8d2c-dfc6198ca9f81" status: 404 len: 62 microversion: 2.1 time: 0.048628 Jul 20 04:23:39.400779 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1787/3551] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:39 2022] DELETE /compute/v2.1/images/34658ac8-d5c4-4914-8d2c-dfc6198ca9f81 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:23:39.413825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-602d61cf-18f4-472b-968c-7bbc4699dd7d tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Calling method '.version_select at 0x7fb840f58310>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.459448 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-602d61cf-18f4-472b-968c-7bbc4699dd7d tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] HTTP exception thrown: Image not found. Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-602d61cf-18f4-472b-968c-7bbc4699dd7d tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Request method failure captured: Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/images/tempest-invalid-52674546 HTTP/1.1 Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NKa4oQNe_9cs8i1kB--Tj41CP_aZwgg7EhxJxqtVE1hseLGf0dutsARrlMDpRYCz-zc3PsEDJsQPA7yNuMU-JsZklLFt2A3o_KHULHWLvoabxLjXeC4aQbEoO_a5vb-pp6oE4jEcJZZUuwH_p3fQLTAFxbF7yx_R1pjfI4nsTbcNk Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4d5d26a47b494f249df74762bc37b2c5 Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4d5d26a47b494f249df74762bc37b2c5 Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesDeleteNegativeTestJSON-888852385-project Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 1573cb0411954c20bee3e7f4f20d487d Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-888852385-project Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: exception: Image not found. Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'tempest-invalid-52674546'} Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-52674546 to delete Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-52674546 could not be found. Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.461620 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.467456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-602d61cf-18f4-472b-968c-7bbc4699dd7d tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Returning 404 to user: Image not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:39.471598 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-602d61cf-18f4-472b-968c-7bbc4699dd7d tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] 10.222.0.59 "DELETE /compute/v2.1/images/tempest-invalid-52674546" status: 404 len: 62 microversion: 2.1 time: 0.063357 Jul 20 04:23:39.480071 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1788/3552] 10.222.0.59 () {58 vars in 1199 bytes} [Wed Jul 20 04:23:39 2022] DELETE /compute/v2.1/images/tempest-invalid-52674546 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:23:39.484682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e73ad6f6-b7f1-4d84-b461-5760e1919ff8 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Calling method '.version_select at 0x7fb840f1b940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.537579 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e73ad6f6-b7f1-4d84-b461-5760e1919ff8 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] HTTP exception thrown: Image not found. Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e73ad6f6-b7f1-4d84-b461-5760e1919ff8 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Request method failure captured: Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/images/3ae70eb3-5a56-4efc-a373-5e8cbaadab32 HTTP/1.1 Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NKa4oQNe_9cs8i1kB--Tj41CP_aZwgg7EhxJxqtVE1hseLGf0dutsARrlMDpRYCz-zc3PsEDJsQPA7yNuMU-JsZklLFt2A3o_KHULHWLvoabxLjXeC4aQbEoO_a5vb-pp6oE4jEcJZZUuwH_p3fQLTAFxbF7yx_R1pjfI4nsTbcNk Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4d5d26a47b494f249df74762bc37b2c5 Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d5d26a47b494f249df74762bc37b2c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4d5d26a47b494f249df74762bc37b2c5 Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-888852385 Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesDeleteNegativeTestJSON-888852385-project Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 1573cb0411954c20bee3e7f4f20d487d Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-888852385-project Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: exception: Image not found. Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '3ae70eb3-5a56-4efc-a373-5e8cbaadab32'} Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3ae70eb3-5a56-4efc-a373-5e8cbaadab32 to delete Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3ae70eb3-5a56-4efc-a373-5e8cbaadab32 could not be found. Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.540338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e73ad6f6-b7f1-4d84-b461-5760e1919ff8 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] Returning 404 to user: Image not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e73ad6f6-b7f1-4d84-b461-5760e1919ff8 tempest-ImagesDeleteNegativeTestJSON-888852385 tempest-ImagesDeleteNegativeTestJSON-888852385-project] 10.222.0.59 "DELETE /compute/v2.1/images/3ae70eb3-5a56-4efc-a373-5e8cbaadab32" status: 404 len: 62 microversion: 2.1 time: 0.064428 Jul 20 04:23:39.551442 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1789/3553] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:39 2022] DELETE /compute/v2.1/images/3ae70eb3-5a56-4efc-a373-5e8cbaadab32 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:23:39.698232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-af58abcc-f3ce-4a28-ad0f-7a79809ff90f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.698925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-af58abcc-f3ce-4a28-ad0f-7a79809ff90f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:39.719232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af58abcc-f3ce-4a28-ad0f-7a79809ff90f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.720848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af58abcc-f3ce-4a28-ad0f-7a79809ff90f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.721862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af58abcc-f3ce-4a28-ad0f-7a79809ff90f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.723314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af58abcc-f3ce-4a28-ad0f-7a79809ff90f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.929685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c5f151d5-224c-47b5-bc3c-8dd813a2cd8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.969971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c5f151d5-224c-47b5-bc3c-8dd813a2cd8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.979331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c5f151d5-224c-47b5-bc3c-8dd813a2cd8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.986436 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c5f151d5-224c-47b5-bc3c-8dd813a2cd8a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.835441 Jul 20 04:23:40.005256 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1765/3554] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:39 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:40.026666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-83760082-1bee-467e-9ac9-f634d9639cca tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:40.027444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-83760082-1bee-467e-9ac9-f634d9639cca tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:40.047222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83760082-1bee-467e-9ac9-f634d9639cca tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.055995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83760082-1bee-467e-9ac9-f634d9639cca tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.056970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83760082-1bee-467e-9ac9-f634d9639cca tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.057423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83760082-1bee-467e-9ac9-f634d9639cca tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.386877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-83760082-1bee-467e-9ac9-f634d9639cca tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:40.401278 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-83760082-1bee-467e-9ac9-f634d9639cca tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1509 microversion: 2.1 time: 0.393762 Jul 20 04:23:40.402698 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1766/3555] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:40 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:40.412182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa1bb1dc-b99e-42a6-b381-344037935526 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:40.417462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fa1bb1dc-b99e-42a6-b381-344037935526 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:40.436578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa1bb1dc-b99e-42a6-b381-344037935526 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.437665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa1bb1dc-b99e-42a6-b381-344037935526 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.438809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa1bb1dc-b99e-42a6-b381-344037935526 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.439630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa1bb1dc-b99e-42a6-b381-344037935526 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.617130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fa1bb1dc-b99e-42a6-b381-344037935526 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:40.634153 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa1bb1dc-b99e-42a6-b381-344037935526 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1282 microversion: 2.1 time: 0.228912 Jul 20 04:23:40.640110 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1767/3556] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:40 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:40.973486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-af58abcc-f3ce-4a28-ad0f-7a79809ff90f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:40.986675 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-af58abcc-f3ce-4a28-ad0f-7a79809ff90f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1363 microversion: 2.1 time: 1.293472 Jul 20 04:23:41.000470 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1790/3557] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:39 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1363 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:41.011059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d537778c-a79f-4d0a-b8c4-af590229be53 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.011970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d537778c-a79f-4d0a-b8c4-af590229be53 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.031889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d537778c-a79f-4d0a-b8c4-af590229be53 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.032637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d537778c-a79f-4d0a-b8c4-af590229be53 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.033645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d537778c-a79f-4d0a-b8c4-af590229be53 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.038062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d537778c-a79f-4d0a-b8c4-af590229be53 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.422949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-43dabd63-30ac-456f-8eb9-093c69fbb90f tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.423509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-43dabd63-30ac-456f-8eb9-093c69fbb90f tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.444989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43dabd63-30ac-456f-8eb9-093c69fbb90f tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.446356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43dabd63-30ac-456f-8eb9-093c69fbb90f tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.457530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43dabd63-30ac-456f-8eb9-093c69fbb90f tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.464572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43dabd63-30ac-456f-8eb9-093c69fbb90f tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.767054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d537778c-a79f-4d0a-b8c4-af590229be53 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.782372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:41.789341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-43dabd63-30ac-456f-8eb9-093c69fbb90f tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab1957012704763aab3292f0b64933a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd982f2be50cd4c23b245c855019c7f01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.807686 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-43dabd63-30ac-456f-8eb9-093c69fbb90f tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 200 len: 1467 microversion: 2.1 time: 0.390401 Jul 20 04:23:41.809393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d537778c-a79f-4d0a-b8c4-af590229be53 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.810224 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1791/3558] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:41 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 1467 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:41.813874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d537778c-a79f-4d0a-b8c4-af590229be53 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.820377 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d537778c-a79f-4d0a-b8c4-af590229be53 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.815014 Jul 20 04:23:41.823962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8578367c-c166-4a6c-83d2-dfd0a9bdffaa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.824814 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1768/3559] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:41 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:41.833274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5edf9717-68ed-4c76-b871-874783344387 req-a2b11d8b-903f-42ea-91df-2b7ff4feeb74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed365e6-a501-4ce3-afa5-88bd37017e39", "name": "network-vif-deleted", "tag": "a9cb387f-ead4-4aeb-9327-7426b60dad7c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:41.834438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8578367c-c166-4a6c-83d2-dfd0a9bdffaa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.857694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8578367c-c166-4a6c-83d2-dfd0a9bdffaa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.858151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8578367c-c166-4a6c-83d2-dfd0a9bdffaa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.874323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8578367c-c166-4a6c-83d2-dfd0a9bdffaa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.875941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8578367c-c166-4a6c-83d2-dfd0a9bdffaa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.878913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5edf9717-68ed-4c76-b871-874783344387 req-a2b11d8b-903f-42ea-91df-2b7ff4feeb74 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.879995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5edf9717-68ed-4c76-b871-874783344387 req-a2b11d8b-903f-42ea-91df-2b7ff4feeb74 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.917862 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5edf9717-68ed-4c76-b871-874783344387 req-a2b11d8b-903f-42ea-91df-2b7ff4feeb74 service nova] Creating event network-vif-deleted:a9cb387f-ead4-4aeb-9327-7426b60dad7c for instance 3ed365e6-a501-4ce3-afa5-88bd37017e39 on n-h2-760456-11 Jul 20 04:23:41.925751 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5edf9717-68ed-4c76-b871-874783344387 req-a2b11d8b-903f-42ea-91df-2b7ff4feeb74 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096279 Jul 20 04:23:41.926737 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1769/3560] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:42.006685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3fbf893-4845-4910-bf17-1966beb13e4b tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.007406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f3fbf893-4845-4910-bf17-1966beb13e4b tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.019945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3fbf893-4845-4910-bf17-1966beb13e4b tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.020416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3fbf893-4845-4910-bf17-1966beb13e4b tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.025556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3fbf893-4845-4910-bf17-1966beb13e4b tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.026069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3fbf893-4845-4910-bf17-1966beb13e4b tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.296244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8578367c-c166-4a6c-83d2-dfd0a9bdffaa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:42.305553 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8578367c-c166-4a6c-83d2-dfd0a9bdffaa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1282 microversion: 2.1 time: 0.493367 Jul 20 04:23:42.306166 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1792/3561] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:41 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1282 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:42.436453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f3fbf893-4845-4910-bf17-1966beb13e4b tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:42.471383 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f3fbf893-4845-4910-bf17-1966beb13e4b tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1549 microversion: 2.1 time: 0.467036 Jul 20 04:23:42.493694 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1770/3562] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1549 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:42.498742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c431ce6-9e18-48fa-8b58-256c282aedf5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.499585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0c431ce6-9e18-48fa-8b58-256c282aedf5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.513770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c431ce6-9e18-48fa-8b58-256c282aedf5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.514150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c431ce6-9e18-48fa-8b58-256c282aedf5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.514994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c431ce6-9e18-48fa-8b58-256c282aedf5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.519222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c431ce6-9e18-48fa-8b58-256c282aedf5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.808137 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0c431ce6-9e18-48fa-8b58-256c282aedf5 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.318811 Jul 20 04:23:42.809366 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1793/3563] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-interface => generated 285 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:42.835364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f9a64d78-6b1f-4415-9ce1-26d73664eabd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.850632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a6fb39c-131c-41d8-b8bb-2bba6069b3db tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.851538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5a6fb39c-131c-41d8-b8bb-2bba6069b3db tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.853699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f9a64d78-6b1f-4415-9ce1-26d73664eabd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] [instance: 3ed365e6-a501-4ce3-afa5-88bd37017e39] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.871826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9a64d78-6b1f-4415-9ce1-26d73664eabd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.873767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a6fb39c-131c-41d8-b8bb-2bba6069b3db tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.885496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a6fb39c-131c-41d8-b8bb-2bba6069b3db tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.886734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a6fb39c-131c-41d8-b8bb-2bba6069b3db tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.890503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a6fb39c-131c-41d8-b8bb-2bba6069b3db tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.891393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9a64d78-6b1f-4415-9ce1-26d73664eabd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.895935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9a64d78-6b1f-4415-9ce1-26d73664eabd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.896634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9a64d78-6b1f-4415-9ce1-26d73664eabd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.973665 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-f9a64d78-6b1f-4415-9ce1-26d73664eabd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] HTTP exception thrown: Instance 3ed365e6-a501-4ce3-afa5-88bd37017e39 could not be found. Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f9a64d78-6b1f-4415-9ce1-26d73664eabd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Request method failure captured: Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 HTTP/1.1 Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Mt3jbxDvRgtP9UU7s4TaeMlijDK1MipDkaEhoblX4CeMo0oq33VW0gy6XstY_aTYbSr_8gVciv9mBL2H_Eqcjz0eRgR99zZ2xgiqIQrZe7As4JdTYq_FfWc_fRlQafxp_1qQODaVT5i44mCzl7K9MFyWpgaRBZB7UOVMX2KoFUcX4 Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d982f2be50cd4c23b245c855019c7f01 Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerPasswordTestJSON-1652925667 Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d982f2be50cd4c23b245c855019c7f01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d982f2be50cd4c23b245c855019c7f01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d982f2be50cd4c23b245c855019c7f01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d982f2be50cd4c23b245c855019c7f01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerPasswordTestJSON-1652925667 Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d982f2be50cd4c23b245c855019c7f01 Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1652925667 Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerPasswordTestJSON-1652925667-project Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 6ab1957012704763aab3292f0b64933a Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerPasswordTestJSON-1652925667-project Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 3ed365e6-a501-4ce3-afa5-88bd37017e39 could not be found. Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '3ed365e6-a501-4ce3-afa5-88bd37017e39'} Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed365e6-a501-4ce3-afa5-88bd37017e39 could not be found. Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed365e6-a501-4ce3-afa5-88bd37017e39 could not be found. Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:42.986189 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:42.993229 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:42.993229 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:42.993229 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:42.993229 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:42.993229 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:42.993229 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed365e6-a501-4ce3-afa5-88bd37017e39 could not be found. Jul 20 04:23:42.993229 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:23:42.998628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f9a64d78-6b1f-4415-9ce1-26d73664eabd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] Returning 404 to user: Instance 3ed365e6-a501-4ce3-afa5-88bd37017e39 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:43.001332 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f9a64d78-6b1f-4415-9ce1-26d73664eabd tempest-ServerPasswordTestJSON-1652925667 tempest-ServerPasswordTestJSON-1652925667-project] 10.222.0.59 "GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39" status: 404 len: 111 microversion: 2.1 time: 0.174891 Jul 20 04:23:43.009744 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1771/3564] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/3ed365e6-a501-4ce3-afa5-88bd37017e39 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:43.325141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4307ba47-bfbc-4f15-bcf4-9808ede53197 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:43.327024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4307ba47-bfbc-4f15-bcf4-9808ede53197 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:43.341072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4307ba47-bfbc-4f15-bcf4-9808ede53197 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.342328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4307ba47-bfbc-4f15-bcf4-9808ede53197 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.343378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4307ba47-bfbc-4f15-bcf4-9808ede53197 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.344512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4307ba47-bfbc-4f15-bcf4-9808ede53197 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.131886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4307ba47-bfbc-4f15-bcf4-9808ede53197 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:44.150698 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4307ba47-bfbc-4f15-bcf4-9808ede53197 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1324 microversion: 2.1 time: 0.823166 Jul 20 04:23:44.151783 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1772/3565] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:43 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1324 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:44.156987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c4d1741c-414b-4c1c-883e-d2fb147f58fc req-d23c8df7-6d80-4bae-8836-1223a75a2cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-plugged", "status": "completed", "tag": "86a07295-dd78-44c7-98ae-020642c58a78"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:44.184883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c4d1741c-414b-4c1c-883e-d2fb147f58fc req-d23c8df7-6d80-4bae-8836-1223a75a2cf1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:44.185334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c4d1741c-414b-4c1c-883e-d2fb147f58fc req-d23c8df7-6d80-4bae-8836-1223a75a2cf1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.214022 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c4d1741c-414b-4c1c-883e-d2fb147f58fc req-d23c8df7-6d80-4bae-8836-1223a75a2cf1 service nova] Creating event network-vif-plugged:86a07295-dd78-44c7-98ae-020642c58a78 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:23:44.231025 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c4d1741c-414b-4c1c-883e-d2fb147f58fc req-d23c8df7-6d80-4bae-8836-1223a75a2cf1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077611 Jul 20 04:23:44.231644 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1773/3566] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:44.467921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a6fb39c-131c-41d8-b8bb-2bba6069b3db tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:44.489115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a6fb39c-131c-41d8-b8bb-2bba6069b3db tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:44.490911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a6fb39c-131c-41d8-b8bb-2bba6069b3db tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:44.493792 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5a6fb39c-131c-41d8-b8bb-2bba6069b3db tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 1.652004 Jul 20 04:23:44.505815 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1794/3567] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:45.171356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d4b6c206-173d-4e8b-a159-a7bb7d8b38d8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:45.172076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d4b6c206-173d-4e8b-a159-a7bb7d8b38d8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:45.197041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4b6c206-173d-4e8b-a159-a7bb7d8b38d8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.198556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4b6c206-173d-4e8b-a159-a7bb7d8b38d8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.199397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4b6c206-173d-4e8b-a159-a7bb7d8b38d8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.199849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4b6c206-173d-4e8b-a159-a7bb7d8b38d8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.523640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7818ca37-1e1b-411e-a9ed-1c389c4ae381 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:45.524884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7818ca37-1e1b-411e-a9ed-1c389c4ae381 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:45.542403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7818ca37-1e1b-411e-a9ed-1c389c4ae381 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.543148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7818ca37-1e1b-411e-a9ed-1c389c4ae381 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.544124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7818ca37-1e1b-411e-a9ed-1c389c4ae381 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.544760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7818ca37-1e1b-411e-a9ed-1c389c4ae381 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.548328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:45.645868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d4b6c206-173d-4e8b-a159-a7bb7d8b38d8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:45.654455 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d4b6c206-173d-4e8b-a159-a7bb7d8b38d8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1324 microversion: 2.1 time: 0.490429 Jul 20 04:23:45.658606 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1774/3568] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:45 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:45.669162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d25eb992-21a7-4244-962e-e161027ab60b req-84719110-e900-4d77-a4d3-ddf6dfb53b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b8484b-3078-4fc9-923d-e72a9aa94a9b", "tag": "67af8e46-651c-4cb7-8e70-c3a2946e9294"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:45.694193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d25eb992-21a7-4244-962e-e161027ab60b req-84719110-e900-4d77-a4d3-ddf6dfb53b8c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.701398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d25eb992-21a7-4244-962e-e161027ab60b req-84719110-e900-4d77-a4d3-ddf6dfb53b8c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.722512 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d25eb992-21a7-4244-962e-e161027ab60b req-84719110-e900-4d77-a4d3-ddf6dfb53b8c service nova] Creating event network-changed:67af8e46-651c-4cb7-8e70-c3a2946e9294 for instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b on n-h2-760456-11 Jul 20 04:23:45.739658 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d25eb992-21a7-4244-962e-e161027ab60b req-84719110-e900-4d77-a4d3-ddf6dfb53b8c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079495 Jul 20 04:23:45.740634 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1775/3569] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:46.026505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b82dd98-564b-44ca-9b7d-76ecc0ee778f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412881f0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:46.133093 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b82dd98-564b-44ca-9b7d-76ecc0ee778f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ab60d333-313b-4f53-8722-f542537aad7a" status: 200 len: 661 microversion: 2.1 time: 0.110602 Jul 20 04:23:46.134140 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1776/3570] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:46 2022] GET /compute/v2.1/images/ab60d333-313b-4f53-8722-f542537aad7a => generated 661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:46.145804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-103f7e2d-5bd8-470b-b66e-f1e2a82a5d9d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412ec790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:46.225060 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-103f7e2d-5bd8-470b-b66e-f1e2a82a5d9d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ab60d333-313b-4f53-8722-f542537aad7a" status: 200 len: 661 microversion: 2.1 time: 0.083041 Jul 20 04:23:46.226293 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1777/3571] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:46 2022] GET /compute/v2.1/images/ab60d333-313b-4f53-8722-f542537aad7a => generated 661 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:46.387721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7818ca37-1e1b-411e-a9ed-1c389c4ae381 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:46.414567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7818ca37-1e1b-411e-a9ed-1c389c4ae381 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:46.422028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7818ca37-1e1b-411e-a9ed-1c389c4ae381 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:46.423620 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7818ca37-1e1b-411e-a9ed-1c389c4ae381 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.903976 Jul 20 04:23:46.424749 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1795/3572] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:45 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:46.531321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-da72c49d-5d8b-4ecb-a56a-a6df29a63b05 req-facaeb58-2a89-4d7f-ae82-0cf13bb7c95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-plugged", "status": "completed", "tag": "f444e47b-8c44-41a2-8d8d-dc1251412040"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:46.550897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-da72c49d-5d8b-4ecb-a56a-a6df29a63b05 req-facaeb58-2a89-4d7f-ae82-0cf13bb7c95e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:46.552993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-da72c49d-5d8b-4ecb-a56a-a6df29a63b05 req-facaeb58-2a89-4d7f-ae82-0cf13bb7c95e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:46.600981 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-da72c49d-5d8b-4ecb-a56a-a6df29a63b05 req-facaeb58-2a89-4d7f-ae82-0cf13bb7c95e service nova] Creating event network-vif-plugged:f444e47b-8c44-41a2-8d8d-dc1251412040 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:23:46.609289 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-da72c49d-5d8b-4ecb-a56a-a6df29a63b05 req-facaeb58-2a89-4d7f-ae82-0cf13bb7c95e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082701 Jul 20 04:23:46.614068 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1778/3573] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:46.672484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-77866e85-39f6-461f-8b0c-87c6ee63f441 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:46.673106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-77866e85-39f6-461f-8b0c-87c6ee63f441 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:46.683343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77866e85-39f6-461f-8b0c-87c6ee63f441 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:46.686832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77866e85-39f6-461f-8b0c-87c6ee63f441 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:46.687920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77866e85-39f6-461f-8b0c-87c6ee63f441 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:46.690968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77866e85-39f6-461f-8b0c-87c6ee63f441 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.352258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-57c57bec-0cea-448d-a370-fcc29345d1d8 req-b9fd9fd9-f441-4b2f-82be-58929aa7cddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75de7cb5-82d8-4004-817f-cbd784128119", "tag": "99cefe41-e92f-41c7-b30b-e9d26a95d053"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:47.372564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:47.373963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:47.379110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-57c57bec-0cea-448d-a370-fcc29345d1d8 req-b9fd9fd9-f441-4b2f-82be-58929aa7cddf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.384967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-57c57bec-0cea-448d-a370-fcc29345d1d8 req-b9fd9fd9-f441-4b2f-82be-58929aa7cddf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.420687 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-57c57bec-0cea-448d-a370-fcc29345d1d8 req-b9fd9fd9-f441-4b2f-82be-58929aa7cddf service nova] Creating event network-changed:99cefe41-e92f-41c7-b30b-e9d26a95d053 for instance 75de7cb5-82d8-4004-817f-cbd784128119 on n-h1-760456-11 Jul 20 04:23:47.435010 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-57c57bec-0cea-448d-a370-fcc29345d1d8 req-b9fd9fd9-f441-4b2f-82be-58929aa7cddf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086382 Jul 20 04:23:47.437467 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1779/3574] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:47.456328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b6a4888-ed06-4bb0-a45d-08d1c7beca69 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:47.457083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6b6a4888-ed06-4bb0-a45d-08d1c7beca69 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:47.484213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b6a4888-ed06-4bb0-a45d-08d1c7beca69 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.484680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b6a4888-ed06-4bb0-a45d-08d1c7beca69 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.485539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b6a4888-ed06-4bb0-a45d-08d1c7beca69 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.485924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b6a4888-ed06-4bb0-a45d-08d1c7beca69 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.544573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:47.970303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-77866e85-39f6-461f-8b0c-87c6ee63f441 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:47.987668 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-77866e85-39f6-461f-8b0c-87c6ee63f441 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1324 microversion: 2.1 time: 1.319489 Jul 20 04:23:47.988600 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1796/3575] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:46 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1324 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:48.013675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-895529b1-a8ad-42a7-be76-631603763bd8 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841001040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:48.099653 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-895529b1-a8ad-42a7-be76-631603763bd8 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/873d6383-cfb7-4bf2-ad7d-a7cba62146d6" status: 200 len: 661 microversion: 2.1 time: 0.075255 Jul 20 04:23:48.113198 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1797/3576] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:48 2022] GET /compute/v2.1/images/873d6383-cfb7-4bf2-ad7d-a7cba62146d6 => generated 661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:23:48.134859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fd71a8d4-6f98-4be7-8ed3-982ee6715453 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840e1aca0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:48.190043 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fd71a8d4-6f98-4be7-8ed3-982ee6715453 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/873d6383-cfb7-4bf2-ad7d-a7cba62146d6" status: 200 len: 661 microversion: 2.1 time: 0.061815 Jul 20 04:23:48.190976 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1798/3577] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:48 2022] GET /compute/v2.1/images/873d6383-cfb7-4bf2-ad7d-a7cba62146d6 => generated 661 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:48.342731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6b6a4888-ed06-4bb0-a45d-08d1c7beca69 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:48.354539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6b6a4888-ed06-4bb0-a45d-08d1c7beca69 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:48.365895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6b6a4888-ed06-4bb0-a45d-08d1c7beca69 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:48.367393 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b6a4888-ed06-4bb0-a45d-08d1c7beca69 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.927967 Jul 20 04:23:48.379860 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1780/3578] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:47 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:48.647840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1da8f004-cef4-4fa7-826c-14b5c2fdbf2c req-76fe1610-e836-4ec6-936d-12c3beca2d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-plugged", "status": "completed", "tag": "9ef1b0a9-a805-494d-9371-757d4ab1d057"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:48.670604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1da8f004-cef4-4fa7-826c-14b5c2fdbf2c req-76fe1610-e836-4ec6-936d-12c3beca2d2c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.671248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1da8f004-cef4-4fa7-826c-14b5c2fdbf2c req-76fe1610-e836-4ec6-936d-12c3beca2d2c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.683766 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1da8f004-cef4-4fa7-826c-14b5c2fdbf2c req-76fe1610-e836-4ec6-936d-12c3beca2d2c service nova] Creating event network-vif-plugged:9ef1b0a9-a805-494d-9371-757d4ab1d057 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:23:48.691774 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1da8f004-cef4-4fa7-826c-14b5c2fdbf2c req-76fe1610-e836-4ec6-936d-12c3beca2d2c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050125 Jul 20 04:23:48.693036 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1799/3579] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:49.006037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7bb53155-b2e3-4cc9-9b09-194ab3cb58f8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.006622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7bb53155-b2e3-4cc9-9b09-194ab3cb58f8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:49.017078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:49.018866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bb53155-b2e3-4cc9-9b09-194ab3cb58f8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.019566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bb53155-b2e3-4cc9-9b09-194ab3cb58f8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.020612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bb53155-b2e3-4cc9-9b09-194ab3cb58f8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.021389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bb53155-b2e3-4cc9-9b09-194ab3cb58f8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.332551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7bb53155-b2e3-4cc9-9b09-194ab3cb58f8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.347712 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7bb53155-b2e3-4cc9-9b09-194ab3cb58f8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1324 microversion: 2.1 time: 0.346389 Jul 20 04:23:49.349522 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1781/3580] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:49.391016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8ff349dd-a2b0-4a47-be91-3be898ccaaca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.394277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8ff349dd-a2b0-4a47-be91-3be898ccaaca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:49.413047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ff349dd-a2b0-4a47-be91-3be898ccaaca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.415505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ff349dd-a2b0-4a47-be91-3be898ccaaca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.416576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ff349dd-a2b0-4a47-be91-3be898ccaaca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.417395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ff349dd-a2b0-4a47-be91-3be898ccaaca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.744653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84f4dd22-95d5-4b87-a6c2-b6c6e19df4a7 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412c8c10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.814577 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-84f4dd22-95d5-4b87-a6c2-b6c6e19df4a7 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/254a1984-054d-47e4-8830-c015c04103ce" status: 200 len: 662 microversion: 2.1 time: 0.078069 Jul 20 04:23:49.815219 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1782/3581] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/images/254a1984-054d-47e4-8830-c015c04103ce => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:49.828228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d72a1402-14f7-4c68-81ab-e20028481cb9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8413ba160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.832177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8ff349dd-a2b0-4a47-be91-3be898ccaaca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.844539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8ff349dd-a2b0-4a47-be91-3be898ccaaca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.851733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8ff349dd-a2b0-4a47-be91-3be898ccaaca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.863112 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8ff349dd-a2b0-4a47-be91-3be898ccaaca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.469649 Jul 20 04:23:49.863801 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1800/3582] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:49.910890 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d72a1402-14f7-4c68-81ab-e20028481cb9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/254a1984-054d-47e4-8830-c015c04103ce" status: 200 len: 662 microversion: 2.1 time: 0.086349 Jul 20 04:23:49.912200 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1783/3583] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/images/254a1984-054d-47e4-8830-c015c04103ce => generated 662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:49.986191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1355588747", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:50.080839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:50.370035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e89e720-089a-4e33-aea2-4eb3e02f0066 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:50.370649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e89e720-089a-4e33-aea2-4eb3e02f0066 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:50.401972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e89e720-089a-4e33-aea2-4eb3e02f0066 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.402511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e89e720-089a-4e33-aea2-4eb3e02f0066 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.403305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e89e720-089a-4e33-aea2-4eb3e02f0066 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.403751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e89e720-089a-4e33-aea2-4eb3e02f0066 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.223362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e89e720-089a-4e33-aea2-4eb3e02f0066 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:51.236078 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e89e720-089a-4e33-aea2-4eb3e02f0066 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1324 microversion: 2.1 time: 0.871641 Jul 20 04:23:51.238883 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1784/3584] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:50 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1324 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:51.249458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1f413372-fe6e-4ff6-bf97-8629af036394 req-88e099f7-7e26-4654-93dd-26fcd6c894ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-plugged", "status": "completed", "tag": "34004e40-bf86-4b70-ba0c-469bb3766bbd"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:51.270687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1f413372-fe6e-4ff6-bf97-8629af036394 req-88e099f7-7e26-4654-93dd-26fcd6c894ca service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.272657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1f413372-fe6e-4ff6-bf97-8629af036394 req-88e099f7-7e26-4654-93dd-26fcd6c894ca service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.273735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:51.274391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:51.275103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:51.275697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:51.276304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:51.301477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.302236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.303913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.304584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.337111 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1f413372-fe6e-4ff6-bf97-8629af036394 req-88e099f7-7e26-4654-93dd-26fcd6c894ca service nova] Creating event network-vif-plugged:34004e40-bf86-4b70-ba0c-469bb3766bbd for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:23:51.349069 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1f413372-fe6e-4ff6-bf97-8629af036394 req-88e099f7-7e26-4654-93dd-26fcd6c894ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108647 Jul 20 04:23:51.356757 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1785/3585] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:51.369764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c4bf7aeb-72de-4ac6-a30d-e32be5cb76a0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:51.370891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c4bf7aeb-72de-4ac6-a30d-e32be5cb76a0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:51.386151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4bf7aeb-72de-4ac6-a30d-e32be5cb76a0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.390567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4bf7aeb-72de-4ac6-a30d-e32be5cb76a0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.393698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4bf7aeb-72de-4ac6-a30d-e32be5cb76a0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.395319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4bf7aeb-72de-4ac6-a30d-e32be5cb76a0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.396167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Getting quotas for project 6fdcdb574d07479a9c086c640629e906. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:51.411800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Getting quotas for user 2a214df8538845fe94a6487911f0d538 and project 6fdcdb574d07479a9c086c640629e906. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:51.453558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:51.461659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:51.528106 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04db2900-f48b-40a5-b814-0138ce2693f5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547395 Jul 20 04:23:51.540844 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1801/3586] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:51.646074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1706991199", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:51.739022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:52.301171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c4bf7aeb-72de-4ac6-a30d-e32be5cb76a0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.339430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c4bf7aeb-72de-4ac6-a30d-e32be5cb76a0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.341576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c4bf7aeb-72de-4ac6-a30d-e32be5cb76a0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.347263 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c4bf7aeb-72de-4ac6-a30d-e32be5cb76a0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.988382 Jul 20 04:23:52.349064 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1786/3587] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:51 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:52.358163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3854ddb-1b35-43ce-8ece-46d71cb8b6ba tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:52.363171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f3854ddb-1b35-43ce-8ece-46d71cb8b6ba tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:52.385958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3854ddb-1b35-43ce-8ece-46d71cb8b6ba tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.390967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3854ddb-1b35-43ce-8ece-46d71cb8b6ba tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.395331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3854ddb-1b35-43ce-8ece-46d71cb8b6ba tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.396160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3854ddb-1b35-43ce-8ece-46d71cb8b6ba tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.650784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:52.651265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:52.651871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:52.652501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:52.653043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:52.658081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:52.679124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.680475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.684153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.684803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.723032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Getting quotas for project 6fdcdb574d07479a9c086c640629e906. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:52.731817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Getting quotas for user 2a214df8538845fe94a6487911f0d538 and project 6fdcdb574d07479a9c086c640629e906. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:52.764239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:52.771105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:52.874188 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ffaeaf6b-d6d3-45b1-9c04-b9e601627a20 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230653 Jul 20 04:23:52.875371 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1802/3588] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:52.885832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-73602307-2598-4340-9324-e0ce40057e4c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:52.886508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-73602307-2598-4340-9324-e0ce40057e4c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:52.975874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-73602307-2598-4340-9324-e0ce40057e4c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.984997 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-73602307-2598-4340-9324-e0ce40057e4c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1218 microversion: 2.1 time: 0.103836 Jul 20 04:23:52.986099 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1803/3589] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:52 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:53.369250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3fbfdfab-a624-4569-9043-7c60ed658145 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:53.369979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3fbfdfab-a624-4569-9043-7c60ed658145 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:53.382331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fbfdfab-a624-4569-9043-7c60ed658145 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.383078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fbfdfab-a624-4569-9043-7c60ed658145 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.384653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fbfdfab-a624-4569-9043-7c60ed658145 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.386033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fbfdfab-a624-4569-9043-7c60ed658145 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.476288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f3854ddb-1b35-43ce-8ece-46d71cb8b6ba tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:53.489739 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f3854ddb-1b35-43ce-8ece-46d71cb8b6ba tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1324 microversion: 2.1 time: 1.139221 Jul 20 04:23:53.493107 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1787/3590] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:52 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1324 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:53.502512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-6f5b71ad-226c-48ec-9ff5-d438fe460fb1 req-5d1aee17-6100-49d0-88f9-4a23cb393376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-plugged", "status": "completed", "tag": "a9b48c51-1561-4d97-9677-27009946bf45"}, {"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-plugged", "status": "completed", "tag": "b90b46cd-4019-4d40-b56c-2fad4191a7fb"}, {"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-plugged", "status": "completed", "tag": "cf931418-c175-456d-a8cf-dcc9a12f42e8"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:53.521545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6f5b71ad-226c-48ec-9ff5-d438fe460fb1 req-5d1aee17-6100-49d0-88f9-4a23cb393376 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.523469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6f5b71ad-226c-48ec-9ff5-d438fe460fb1 req-5d1aee17-6100-49d0-88f9-4a23cb393376 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.559278 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6f5b71ad-226c-48ec-9ff5-d438fe460fb1 req-5d1aee17-6100-49d0-88f9-4a23cb393376 service nova] Creating event network-vif-plugged:a9b48c51-1561-4d97-9677-27009946bf45 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:23:53.559840 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6f5b71ad-226c-48ec-9ff5-d438fe460fb1 req-5d1aee17-6100-49d0-88f9-4a23cb393376 service nova] Creating event network-vif-plugged:b90b46cd-4019-4d40-b56c-2fad4191a7fb for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:23:53.560361 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6f5b71ad-226c-48ec-9ff5-d438fe460fb1 req-5d1aee17-6100-49d0-88f9-4a23cb393376 service nova] Creating event network-vif-plugged:cf931418-c175-456d-a8cf-dcc9a12f42e8 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:23:53.567884 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-6f5b71ad-226c-48ec-9ff5-d438fe460fb1 req-5d1aee17-6100-49d0-88f9-4a23cb393376 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.073294 Jul 20 04:23:53.573564 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1788/3591] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:54.003315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-977ae971-7095-4a53-8f98-ebf30bf86d44 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:54.004295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-977ae971-7095-4a53-8f98-ebf30bf86d44 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:54.015517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-977ae971-7095-4a53-8f98-ebf30bf86d44 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.020282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-977ae971-7095-4a53-8f98-ebf30bf86d44 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.021433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-977ae971-7095-4a53-8f98-ebf30bf86d44 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.022075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-977ae971-7095-4a53-8f98-ebf30bf86d44 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.052995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3fbfdfab-a624-4569-9043-7c60ed658145 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.066146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3fbfdfab-a624-4569-9043-7c60ed658145 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.068171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3fbfdfab-a624-4569-9043-7c60ed658145 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.074074 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3fbfdfab-a624-4569-9043-7c60ed658145 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.710789 Jul 20 04:23:54.085507 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1804/3592] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:53 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:23:54.206673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-977ae971-7095-4a53-8f98-ebf30bf86d44 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.227605 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-977ae971-7095-4a53-8f98-ebf30bf86d44 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1214 microversion: 2.1 time: 0.227608 Jul 20 04:23:54.228222 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1789/3593] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:53 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:54.512397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f75e2f87-243a-438e-adc8-e47c3dcc91a7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:54.513251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f75e2f87-243a-438e-adc8-e47c3dcc91a7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:54.529939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f75e2f87-243a-438e-adc8-e47c3dcc91a7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.531454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f75e2f87-243a-438e-adc8-e47c3dcc91a7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.536938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f75e2f87-243a-438e-adc8-e47c3dcc91a7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.538654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f75e2f87-243a-438e-adc8-e47c3dcc91a7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.845076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f75e2f87-243a-438e-adc8-e47c3dcc91a7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.861491 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f75e2f87-243a-438e-adc8-e47c3dcc91a7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1324 microversion: 2.1 time: 0.356559 Jul 20 04:23:54.874873 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1805/3594] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:54 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1324 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:55.097110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bc447df5-289d-46ae-985f-bf1ec8dedd66 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:55.101080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bc447df5-289d-46ae-985f-bf1ec8dedd66 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:55.112515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc447df5-289d-46ae-985f-bf1ec8dedd66 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.114810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc447df5-289d-46ae-985f-bf1ec8dedd66 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.117023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc447df5-289d-46ae-985f-bf1ec8dedd66 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.119131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc447df5-289d-46ae-985f-bf1ec8dedd66 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.249274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b3258784-c532-4ccc-aad8-0ef0cd0c0f13 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:55.255707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b3258784-c532-4ccc-aad8-0ef0cd0c0f13 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:55.294924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3258784-c532-4ccc-aad8-0ef0cd0c0f13 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.295784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3258784-c532-4ccc-aad8-0ef0cd0c0f13 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.296878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3258784-c532-4ccc-aad8-0ef0cd0c0f13 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.297678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3258784-c532-4ccc-aad8-0ef0cd0c0f13 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.472646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b3258784-c532-4ccc-aad8-0ef0cd0c0f13 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:55.480900 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b3258784-c532-4ccc-aad8-0ef0cd0c0f13 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1276 microversion: 2.1 time: 0.240016 Jul 20 04:23:55.482146 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1806/3595] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:55 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:55.663936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc447df5-289d-46ae-985f-bf1ec8dedd66 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:55.674930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc447df5-289d-46ae-985f-bf1ec8dedd66 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:55.681119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc447df5-289d-46ae-985f-bf1ec8dedd66 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:55.682753 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bc447df5-289d-46ae-985f-bf1ec8dedd66 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1874 microversion: 2.32 time: 0.592916 Jul 20 04:23:55.696087 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1790/3596] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:55 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1874 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:55.799058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a3457fa5-582a-45b0-b28a-55899181a9e3 req-33e862c4-8e26-478b-98b5-41567ddbc545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75de7cb5-82d8-4004-817f-cbd784128119", "name": "network-vif-plugged", "status": "completed", "tag": "99cefe41-e92f-41c7-b30b-e9d26a95d053"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:55.830886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a3457fa5-582a-45b0-b28a-55899181a9e3 req-33e862c4-8e26-478b-98b5-41567ddbc545 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.831352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a3457fa5-582a-45b0-b28a-55899181a9e3 req-33e862c4-8e26-478b-98b5-41567ddbc545 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.855199 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a3457fa5-582a-45b0-b28a-55899181a9e3 req-33e862c4-8e26-478b-98b5-41567ddbc545 service nova] Creating event network-vif-plugged:99cefe41-e92f-41c7-b30b-e9d26a95d053 for instance 75de7cb5-82d8-4004-817f-cbd784128119 on n-h1-760456-11 Jul 20 04:23:55.875057 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a3457fa5-582a-45b0-b28a-55899181a9e3 req-33e862c4-8e26-478b-98b5-41567ddbc545 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071716 Jul 20 04:23:55.881249 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1807/3597] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:55.882937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-656e0360-ce9e-4ffa-b5f1-bb88efc9141a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:55.883646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-656e0360-ce9e-4ffa-b5f1-bb88efc9141a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:55.902411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-656e0360-ce9e-4ffa-b5f1-bb88efc9141a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.902884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-656e0360-ce9e-4ffa-b5f1-bb88efc9141a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.903828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-656e0360-ce9e-4ffa-b5f1-bb88efc9141a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.908491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-656e0360-ce9e-4ffa-b5f1-bb88efc9141a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:56.465963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-656e0360-ce9e-4ffa-b5f1-bb88efc9141a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:56.483100 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-656e0360-ce9e-4ffa-b5f1-bb88efc9141a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1324 microversion: 2.1 time: 0.604198 Jul 20 04:23:56.494881 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1791/3598] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:55 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1324 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:56.504267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6911b23e-7dff-4c27-b7f8-9207101fe4f1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:56.505285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6911b23e-7dff-4c27-b7f8-9207101fe4f1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:56.521285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6911b23e-7dff-4c27-b7f8-9207101fe4f1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:56.522773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6911b23e-7dff-4c27-b7f8-9207101fe4f1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:56.524690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6911b23e-7dff-4c27-b7f8-9207101fe4f1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:56.525142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6911b23e-7dff-4c27-b7f8-9207101fe4f1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:56.620082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6911b23e-7dff-4c27-b7f8-9207101fe4f1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:56.632859 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6911b23e-7dff-4c27-b7f8-9207101fe4f1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1276 microversion: 2.1 time: 0.137270 Jul 20 04:23:56.636828 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1808/3599] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:56 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:56.702677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-59f033cb-fdfa-4bb3-abf5-cc736e1e3219 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:56.703583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-59f033cb-fdfa-4bb3-abf5-cc736e1e3219 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:56.710394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59f033cb-fdfa-4bb3-abf5-cc736e1e3219 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:56.711229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59f033cb-fdfa-4bb3-abf5-cc736e1e3219 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:56.712199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59f033cb-fdfa-4bb3-abf5-cc736e1e3219 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:56.712805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59f033cb-fdfa-4bb3-abf5-cc736e1e3219 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.273280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-59f033cb-fdfa-4bb3-abf5-cc736e1e3219 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:57.284020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-59f033cb-fdfa-4bb3-abf5-cc736e1e3219 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:57.285531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-59f033cb-fdfa-4bb3-abf5-cc736e1e3219 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:57.298193 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-59f033cb-fdfa-4bb3-abf5-cc736e1e3219 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2825 microversion: 2.32 time: 0.599492 Jul 20 04:23:57.298846 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1792/3600] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:56 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2825 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:57.322083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2be0d63e-6930-4fef-a648-ddfdd609fdf5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:57.322839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2be0d63e-6930-4fef-a648-ddfdd609fdf5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:57.341313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2be0d63e-6930-4fef-a648-ddfdd609fdf5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.343048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2be0d63e-6930-4fef-a648-ddfdd609fdf5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.346396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2be0d63e-6930-4fef-a648-ddfdd609fdf5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.347052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2be0d63e-6930-4fef-a648-ddfdd609fdf5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.502836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cd02c17d-ae28-49e8-b290-59d2a6452cc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:57.504195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cd02c17d-ae28-49e8-b290-59d2a6452cc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:57.511228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd02c17d-ae28-49e8-b290-59d2a6452cc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.511680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd02c17d-ae28-49e8-b290-59d2a6452cc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.517733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd02c17d-ae28-49e8-b290-59d2a6452cc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.518309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd02c17d-ae28-49e8-b290-59d2a6452cc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.664491 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2be0d63e-6930-4fef-a648-ddfdd609fdf5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.347707 Jul 20 04:23:57.669305 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1809/3601] 10.222.0.59 () {60 vars in 1315 bytes} [Wed Jul 20 04:23:57 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e/os-interface => generated 1831 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:57.681086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5fcf1f48-e52e-407e-953f-bb4526dd468a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:57.683066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5fcf1f48-e52e-407e-953f-bb4526dd468a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:57.708339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fcf1f48-e52e-407e-953f-bb4526dd468a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.710495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fcf1f48-e52e-407e-953f-bb4526dd468a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:57.711862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fcf1f48-e52e-407e-953f-bb4526dd468a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:57.714057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fcf1f48-e52e-407e-953f-bb4526dd468a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:58.227389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5fcf1f48-e52e-407e-953f-bb4526dd468a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:58.238767 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5fcf1f48-e52e-407e-953f-bb4526dd468a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1318 microversion: 2.1 time: 0.566339 Jul 20 04:23:58.248705 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1810/3602] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:57 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:58.532330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cd02c17d-ae28-49e8-b290-59d2a6452cc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:58.544396 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cd02c17d-ae28-49e8-b290-59d2a6452cc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1521 microversion: 2.1 time: 1.047168 Jul 20 04:23:58.559045 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1793/3603] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:57 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1521 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:58.563994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5ffde244-e0af-4d50-89a9-d9f7915fdeef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:58.564622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5ffde244-e0af-4d50-89a9-d9f7915fdeef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:58.574505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ffde244-e0af-4d50-89a9-d9f7915fdeef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:58.575200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ffde244-e0af-4d50-89a9-d9f7915fdeef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:58.576234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ffde244-e0af-4d50-89a9-d9f7915fdeef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:58.577143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ffde244-e0af-4d50-89a9-d9f7915fdeef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:58.786314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4281d5fa-ba68-4fd1-abfa-ef384e3ae1f0 req-c8d321fb-a98c-44f0-9a03-1d9f5d82153a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c46211-eaee-4f38-a690-65d710b5529f", "tag": "15789429-5cd8-4e37-95ed-801038c4a3ef"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:58.810476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4281d5fa-ba68-4fd1-abfa-ef384e3ae1f0 req-c8d321fb-a98c-44f0-9a03-1d9f5d82153a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:58.811073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4281d5fa-ba68-4fd1-abfa-ef384e3ae1f0 req-c8d321fb-a98c-44f0-9a03-1d9f5d82153a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:58.828255 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4281d5fa-ba68-4fd1-abfa-ef384e3ae1f0 req-c8d321fb-a98c-44f0-9a03-1d9f5d82153a service nova] Creating event network-changed:15789429-5cd8-4e37-95ed-801038c4a3ef for instance b9c46211-eaee-4f38-a690-65d710b5529f on n-h2-760456-11 Jul 20 04:23:58.837509 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4281d5fa-ba68-4fd1-abfa-ef384e3ae1f0 req-c8d321fb-a98c-44f0-9a03-1d9f5d82153a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056059 Jul 20 04:23:58.838814 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1794/3604] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:59.257973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-baf9d793-bd38-48af-8abc-31fac098c197 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:59.258892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-baf9d793-bd38-48af-8abc-31fac098c197 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:59.274155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-baf9d793-bd38-48af-8abc-31fac098c197 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.274994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-baf9d793-bd38-48af-8abc-31fac098c197 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.276197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-baf9d793-bd38-48af-8abc-31fac098c197 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.276811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-baf9d793-bd38-48af-8abc-31fac098c197 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.312266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:59.622640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5ffde244-e0af-4d50-89a9-d9f7915fdeef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:59.633789 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5ffde244-e0af-4d50-89a9-d9f7915fdeef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1521 microversion: 2.1 time: 1.074429 Jul 20 04:23:59.635462 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1811/3605] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:58 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1521 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:59.666638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2384229-f692-46fc-86a8-1d1eca6e10cd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1144685651", "metadata": {"": ""}}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2384229-f692-46fc-86a8-1d1eca6e10cd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action HTTP/1.1 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 107 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1144685651", "metadata": {"": ""}}} Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '75de7cb5-82d8-4004-817f-cbd784128119', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1144685651', 'metadata': {'': ''}}}} Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'': ''} Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:59.670746 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:23:59.677175 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:23:59.679628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2384229-f692-46fc-86a8-1d1eca6e10cd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:59.680893 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f2384229-f692-46fc-86a8-1d1eca6e10cd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action" status: 400 len: 170 microversion: 2.1 time: 0.029873 Jul 20 04:23:59.685334 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1812/3606] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Jul 20 04:23:59 2022] POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action => generated 170 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:23:59.690571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d5c5cce4-aa85-4409-a872-f5fc5d57311a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:59.691445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d5c5cce4-aa85-4409-a872-f5fc5d57311a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:59.716545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5c5cce4-aa85-4409-a872-f5fc5d57311a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.717323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5c5cce4-aa85-4409-a872-f5fc5d57311a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.718343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5c5cce4-aa85-4409-a872-f5fc5d57311a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.718973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5c5cce4-aa85-4409-a872-f5fc5d57311a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.725524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-baf9d793-bd38-48af-8abc-31fac098c197 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:59.739233 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-baf9d793-bd38-48af-8abc-31fac098c197 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1318 microversion: 2.1 time: 0.486292 Jul 20 04:23:59.754542 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1795/3607] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:59 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:00.192289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d5c5cce4-aa85-4409-a872-f5fc5d57311a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:00.201565 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d5c5cce4-aa85-4409-a872-f5fc5d57311a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1521 microversion: 2.1 time: 0.514659 Jul 20 04:24:00.202470 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1813/3608] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:59 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:00.220112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5fb09805-16a5-4d5b-b17f-c4a5ca0d8592 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:00.221090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5fb09805-16a5-4d5b-b17f-c4a5ca0d8592 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:00.228813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fb09805-16a5-4d5b-b17f-c4a5ca0d8592 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.229536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fb09805-16a5-4d5b-b17f-c4a5ca0d8592 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.231190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fb09805-16a5-4d5b-b17f-c4a5ca0d8592 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.231830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5fb09805-16a5-4d5b-b17f-c4a5ca0d8592 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.430031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5fb09805-16a5-4d5b-b17f-c4a5ca0d8592 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:00.438522 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5fb09805-16a5-4d5b-b17f-c4a5ca0d8592 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1521 microversion: 2.1 time: 0.222531 Jul 20 04:24:00.440024 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1796/3609] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:00 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:00.461842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49c3d66c-6648-435e-9354-2bae8a477ee4 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2078740857", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49c3d66c-6648-435e-9354-2bae8a477ee4 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action HTTP/1.1 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 619 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2078740857", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '75de7cb5-82d8-4004-817f-cbd784128119', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2078740857', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:24:00.464937 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:24:00.468521 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:00.473708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49c3d66c-6648-435e-9354-2bae8a477ee4 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:00.474812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-49c3d66c-6648-435e-9354-2bae8a477ee4 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action" status: 400 len: 938 microversion: 2.1 time: 0.022575 Jul 20 04:24:00.485051 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1814/3610] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Jul 20 04:24:00 2022] POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action => generated 938 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:00.486324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ef6770eb-d589-43d1-a2dc-ad104dd5a69f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:00.487291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ef6770eb-d589-43d1-a2dc-ad104dd5a69f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:00.494135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef6770eb-d589-43d1-a2dc-ad104dd5a69f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.494888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef6770eb-d589-43d1-a2dc-ad104dd5a69f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.495959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef6770eb-d589-43d1-a2dc-ad104dd5a69f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.496574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef6770eb-d589-43d1-a2dc-ad104dd5a69f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.758729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-545e04f9-5aaf-4b46-ba30-3b6057554997 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:00.759364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-545e04f9-5aaf-4b46-ba30-3b6057554997 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:00.783713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-545e04f9-5aaf-4b46-ba30-3b6057554997 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.784532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-545e04f9-5aaf-4b46-ba30-3b6057554997 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.785847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-545e04f9-5aaf-4b46-ba30-3b6057554997 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.786536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-545e04f9-5aaf-4b46-ba30-3b6057554997 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.076759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ef6770eb-d589-43d1-a2dc-ad104dd5a69f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:01.094769 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ef6770eb-d589-43d1-a2dc-ad104dd5a69f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1521 microversion: 2.1 time: 0.610803 Jul 20 04:24:01.095630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1797/3611] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:00 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:01.108535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3028192e-dac0-4438-b12c-e538ed7719ad req-cade5033-ae67-4879-954f-a57dd921633b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21563660-c2fb-4770-a9d1-83dd296394cd", "tag": "c8d3c0c2-42fb-4da8-9aa0-8fa9605c9fc0"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:01.134525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3028192e-dac0-4438-b12c-e538ed7719ad req-cade5033-ae67-4879-954f-a57dd921633b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:01.135897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3028192e-dac0-4438-b12c-e538ed7719ad req-cade5033-ae67-4879-954f-a57dd921633b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.166809 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3028192e-dac0-4438-b12c-e538ed7719ad req-cade5033-ae67-4879-954f-a57dd921633b service nova] Creating event network-changed:c8d3c0c2-42fb-4da8-9aa0-8fa9605c9fc0 for instance 21563660-c2fb-4770-a9d1-83dd296394cd on n-h2-760456-11 Jul 20 04:24:01.179854 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3028192e-dac0-4438-b12c-e538ed7719ad req-cade5033-ae67-4879-954f-a57dd921633b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080452 Jul 20 04:24:01.183046 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1798/3612] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:01.193974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3e51d3ea-5472-4960-a8b7-078a470e2603 req-1b70851c-0153-4706-87fa-a5763e7a2199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "tag": "86a07295-dd78-44c7-98ae-020642c58a78"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:01.220005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3e51d3ea-5472-4960-a8b7-078a470e2603 req-1b70851c-0153-4706-87fa-a5763e7a2199 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:01.220456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3e51d3ea-5472-4960-a8b7-078a470e2603 req-1b70851c-0153-4706-87fa-a5763e7a2199 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.244410 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3e51d3ea-5472-4960-a8b7-078a470e2603 req-1b70851c-0153-4706-87fa-a5763e7a2199 service nova] Creating event network-changed:86a07295-dd78-44c7-98ae-020642c58a78 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:24:01.265799 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3e51d3ea-5472-4960-a8b7-078a470e2603 req-1b70851c-0153-4706-87fa-a5763e7a2199 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081422 Jul 20 04:24:01.267725 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1799/3613] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:01.281257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa04a43b-9627-48b3-b1c1-eb9fa0aab363 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:01.283755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fa04a43b-9627-48b3-b1c1-eb9fa0aab363 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:01.304460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa04a43b-9627-48b3-b1c1-eb9fa0aab363 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:01.308142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa04a43b-9627-48b3-b1c1-eb9fa0aab363 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.309308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa04a43b-9627-48b3-b1c1-eb9fa0aab363 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:01.311392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa04a43b-9627-48b3-b1c1-eb9fa0aab363 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.611967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-545e04f9-5aaf-4b46-ba30-3b6057554997 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:01.625199 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-545e04f9-5aaf-4b46-ba30-3b6057554997 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1318 microversion: 2.1 time: 0.870441 Jul 20 04:24:01.635626 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1815/3614] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:00 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1318 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:02.143039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fa04a43b-9627-48b3-b1c1-eb9fa0aab363 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:02.161573 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa04a43b-9627-48b3-b1c1-eb9fa0aab363 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1521 microversion: 2.1 time: 0.890460 Jul 20 04:24:02.162639 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1800/3615] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:01 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1521 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:02.181361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b7bd5d65-8e47-4ff9-b5db-a5db34cc0101 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b7bd5d65-8e47-4ff9-b5db-a5db34cc0101 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action HTTP/1.1 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 285 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '75de7cb5-82d8-4004-817f-cbd784128119', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:02.186385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:24:02.191218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:02.215962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b7bd5d65-8e47-4ff9-b5db-a5db34cc0101 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:02.255578 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b7bd5d65-8e47-4ff9-b5db-a5db34cc0101 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action" status: 400 len: 619 microversion: 2.1 time: 0.080010 Jul 20 04:24:02.276939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c1ea5ed-c476-47e5-9758-8568947603ea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:02.278651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c1ea5ed-c476-47e5-9758-8568947603ea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:02.283267 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1816/3616] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Jul 20 04:24:02 2022] POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action => generated 619 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:02.305077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c1ea5ed-c476-47e5-9758-8568947603ea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.305848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c1ea5ed-c476-47e5-9758-8568947603ea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.307828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c1ea5ed-c476-47e5-9758-8568947603ea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.311430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c1ea5ed-c476-47e5-9758-8568947603ea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.643244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d2c0f6a-6c91-4e4c-ae93-0484839056c2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:02.643885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5d2c0f6a-6c91-4e4c-ae93-0484839056c2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:02.656898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d2c0f6a-6c91-4e4c-ae93-0484839056c2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.657688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d2c0f6a-6c91-4e4c-ae93-0484839056c2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.658751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d2c0f6a-6c91-4e4c-ae93-0484839056c2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:02.659389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d2c0f6a-6c91-4e4c-ae93-0484839056c2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:02.712952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:02.984674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=14 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:02.994875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6c1ea5ed-c476-47e5-9758-8568947603ea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:03.022501 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6c1ea5ed-c476-47e5-9758-8568947603ea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1521 microversion: 2.1 time: 0.757018 Jul 20 04:24:03.024688 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1801/3617] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:02 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1521 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:03.041333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-92412474-7775-4154-839d-ae192cb53c28 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:03.042286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-92412474-7775-4154-839d-ae192cb53c28 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:03.051325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92412474-7775-4154-839d-ae192cb53c28 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.052135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92412474-7775-4154-839d-ae192cb53c28 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.063222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92412474-7775-4154-839d-ae192cb53c28 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.063987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92412474-7775-4154-839d-ae192cb53c28 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.823113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5d2c0f6a-6c91-4e4c-ae93-0484839056c2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:03.836071 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d2c0f6a-6c91-4e4c-ae93-0484839056c2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1318 microversion: 2.1 time: 1.195959 Jul 20 04:24:03.838333 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1817/3618] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:02 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1318 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:03.848828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5f52cb3f-9bef-455c-a7c3-aeffa45f8022 req-58bbe724-3b72-488a-bb07-17ef203d3ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c46211-eaee-4f38-a690-65d710b5529f", "name": "network-vif-plugged", "status": "completed", "tag": "15789429-5cd8-4e37-95ed-801038c4a3ef"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:03.858655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5f52cb3f-9bef-455c-a7c3-aeffa45f8022 req-58bbe724-3b72-488a-bb07-17ef203d3ffa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:03.859481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5f52cb3f-9bef-455c-a7c3-aeffa45f8022 req-58bbe724-3b72-488a-bb07-17ef203d3ffa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:03.875244 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5f52cb3f-9bef-455c-a7c3-aeffa45f8022 req-58bbe724-3b72-488a-bb07-17ef203d3ffa service nova] Creating event network-vif-plugged:15789429-5cd8-4e37-95ed-801038c4a3ef for instance b9c46211-eaee-4f38-a690-65d710b5529f on n-h2-760456-11 Jul 20 04:24:03.888568 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5f52cb3f-9bef-455c-a7c3-aeffa45f8022 req-58bbe724-3b72-488a-bb07-17ef203d3ffa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047505 Jul 20 04:24:03.890264 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1818/3619] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:04.373105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-92412474-7775-4154-839d-ae192cb53c28 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:04.385161 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-92412474-7775-4154-839d-ae192cb53c28 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1521 microversion: 2.1 time: 1.347849 Jul 20 04:24:04.389570 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1802/3620] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:03 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1521 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:04.405989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0d1d83c5-e1af-48bf-91cc-0760257ca6e3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-317432761"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:04.407160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0d1d83c5-e1af-48bf-91cc-0760257ca6e3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:04.423022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d1d83c5-e1af-48bf-91cc-0760257ca6e3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.425778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d1d83c5-e1af-48bf-91cc-0760257ca6e3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.429125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d1d83c5-e1af-48bf-91cc-0760257ca6e3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.434420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d1d83c5-e1af-48bf-91cc-0760257ca6e3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.828070 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0d1d83c5-e1af-48bf-91cc-0760257ca6e3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action" status: 202 len: 0 microversion: 2.1 time: 0.426397 Jul 20 04:24:04.833885 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1819/3621] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:04 2022] POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:24:04.843653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-427c1d44-ebb2-4a22-8f69-4a8e80ea6b32 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1803647978"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:04.846221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-427c1d44-ebb2-4a22-8f69-4a8e80ea6b32 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:04.856173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6642e81a-b266-4d45-b95f-fb724eb53131 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:04.856934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6642e81a-b266-4d45-b95f-fb724eb53131 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:04.885147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-427c1d44-ebb2-4a22-8f69-4a8e80ea6b32 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.887413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-427c1d44-ebb2-4a22-8f69-4a8e80ea6b32 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.887635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6642e81a-b266-4d45-b95f-fb724eb53131 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.888097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6642e81a-b266-4d45-b95f-fb724eb53131 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.897075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6642e81a-b266-4d45-b95f-fb724eb53131 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.897750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-427c1d44-ebb2-4a22-8f69-4a8e80ea6b32 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:04.898712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6642e81a-b266-4d45-b95f-fb724eb53131 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:04.900091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-427c1d44-ebb2-4a22-8f69-4a8e80ea6b32 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:05.025879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:05.046690 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-427c1d44-ebb2-4a22-8f69-4a8e80ea6b32 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Cannot 'createImage' instance 75de7cb5-82d8-4004-817f-cbd784128119 while it is in task_state image_snapshot_pending Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-427c1d44-ebb2-4a22-8f69-4a8e80ea6b32 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action HTTP/1.1 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 85 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1803647978"}} Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: exception: Cannot 'createImage' instance 75de7cb5-82d8-4004-817f-cbd784128119 while it is in task_state image_snapshot_pending Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '75de7cb5-82d8-4004-817f-cbd784128119', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1803647978'}}} Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 75de7cb5-82d8-4004-817f-cbd784128119 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:24:05.048520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 75de7cb5-82d8-4004-817f-cbd784128119 while it is in task_state image_snapshot_pending Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 75de7cb5-82d8-4004-817f-cbd784128119 while it is in task_state image_snapshot_pending Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-427c1d44-ebb2-4a22-8f69-4a8e80ea6b32 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 409 to user: Cannot 'createImage' instance 75de7cb5-82d8-4004-817f-cbd784128119 while it is in task_state image_snapshot_pending {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-427c1d44-ebb2-4a22-8f69-4a8e80ea6b32 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action" status: 409 len: 167 microversion: 2.1 time: 0.215384 Jul 20 04:24:05.053400 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1803/3622] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:04 2022] POST /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119/action => generated 167 bytes in 217 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:24:05.060523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2c67f70-b707-4331-8966-23ed89ced89e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '.version_select at 0x7fb8412ea430>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:05.298223 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e2c67f70-b707-4331-8966-23ed89ced89e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "DELETE /compute/v2.1/images/89bc1563-cc57-4dce-bb60-938fff2e529e" status: 204 len: 0 microversion: 2.1 time: 0.241699 Jul 20 04:24:05.299716 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1804/3623] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:05 2022] DELETE /compute/v2.1/images/89bc1563-cc57-4dce-bb60-938fff2e529e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:05.308142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ce2d384-d9c6-4b00-b5d2-4dfe9cf0d436 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:05.309201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4ce2d384-d9c6-4b00-b5d2-4dfe9cf0d436 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:05.323650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ce2d384-d9c6-4b00-b5d2-4dfe9cf0d436 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:05.330612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ce2d384-d9c6-4b00-b5d2-4dfe9cf0d436 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:05.331791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ce2d384-d9c6-4b00-b5d2-4dfe9cf0d436 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:05.332502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ce2d384-d9c6-4b00-b5d2-4dfe9cf0d436 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:05.511513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6642e81a-b266-4d45-b95f-fb724eb53131 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:05.519337 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6642e81a-b266-4d45-b95f-fb724eb53131 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1318 microversion: 2.1 time: 0.669003 Jul 20 04:24:05.530882 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1820/3624] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:04 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:05.873052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4ce2d384-d9c6-4b00-b5d2-4dfe9cf0d436 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:05.911797 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ce2d384-d9c6-4b00-b5d2-4dfe9cf0d436 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1533 microversion: 2.1 time: 0.606781 Jul 20 04:24:05.915626 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1805/3625] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:05 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1533 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:06.538154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0959ea3-d35c-419e-a182-c46d25f8394f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:06.540642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0959ea3-d35c-419e-a182-c46d25f8394f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:06.559305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0959ea3-d35c-419e-a182-c46d25f8394f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:06.560051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0959ea3-d35c-419e-a182-c46d25f8394f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:06.561047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0959ea3-d35c-419e-a182-c46d25f8394f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:06.561655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0959ea3-d35c-419e-a182-c46d25f8394f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:06.938619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b06e4246-44cc-4cfd-8727-5d51433e2eb7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:06.940843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b06e4246-44cc-4cfd-8727-5d51433e2eb7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:06.957777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b06e4246-44cc-4cfd-8727-5d51433e2eb7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:06.965446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b06e4246-44cc-4cfd-8727-5d51433e2eb7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:06.970781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b06e4246-44cc-4cfd-8727-5d51433e2eb7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:06.973059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b06e4246-44cc-4cfd-8727-5d51433e2eb7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.223196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a0959ea3-d35c-419e-a182-c46d25f8394f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.236392 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0959ea3-d35c-419e-a182-c46d25f8394f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1318 microversion: 2.1 time: 0.699960 Jul 20 04:24:07.237110 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1821/3626] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:06 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:07.291285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b06e4246-44cc-4cfd-8727-5d51433e2eb7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.299512 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b06e4246-44cc-4cfd-8727-5d51433e2eb7 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1539 microversion: 2.1 time: 0.365358 Jul 20 04:24:07.312951 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1806/3627] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:06 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1539 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:07.565618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-cd408fad-683d-425e-97ad-0d7b411ad915 req-1d3533bd-a8b2-4777-9e20-2bc714075431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21563660-c2fb-4770-a9d1-83dd296394cd", "name": "network-vif-plugged", "status": "completed", "tag": "c8d3c0c2-42fb-4da8-9aa0-8fa9605c9fc0"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:07.583543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cd408fad-683d-425e-97ad-0d7b411ad915 req-1d3533bd-a8b2-4777-9e20-2bc714075431 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.585024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cd408fad-683d-425e-97ad-0d7b411ad915 req-1d3533bd-a8b2-4777-9e20-2bc714075431 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.599788 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-cd408fad-683d-425e-97ad-0d7b411ad915 req-1d3533bd-a8b2-4777-9e20-2bc714075431 service nova] Creating event network-vif-plugged:c8d3c0c2-42fb-4da8-9aa0-8fa9605c9fc0 for instance 21563660-c2fb-4770-a9d1-83dd296394cd on n-h2-760456-11 Jul 20 04:24:07.607928 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-cd408fad-683d-425e-97ad-0d7b411ad915 req-1d3533bd-a8b2-4777-9e20-2bc714075431 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046044 Jul 20 04:24:07.613353 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1822/3628] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:08.255838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b166edf0-0f65-4e57-904f-203df67e5a0e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.256468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b166edf0-0f65-4e57-904f-203df67e5a0e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:08.266988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b166edf0-0f65-4e57-904f-203df67e5a0e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.277077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b166edf0-0f65-4e57-904f-203df67e5a0e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.278235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b166edf0-0f65-4e57-904f-203df67e5a0e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.278894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b166edf0-0f65-4e57-904f-203df67e5a0e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.321893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fa32075b-2100-4413-8982-4f9cb236f822 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.322882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fa32075b-2100-4413-8982-4f9cb236f822 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:08.337693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa32075b-2100-4413-8982-4f9cb236f822 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.340643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa32075b-2100-4413-8982-4f9cb236f822 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.345444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa32075b-2100-4413-8982-4f9cb236f822 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.347455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa32075b-2100-4413-8982-4f9cb236f822 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.833842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fa32075b-2100-4413-8982-4f9cb236f822 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:08.849882 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fa32075b-2100-4413-8982-4f9cb236f822 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1534 microversion: 2.1 time: 0.533950 Jul 20 04:24:08.864466 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1823/3629] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1534 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:09.072679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b166edf0-0f65-4e57-904f-203df67e5a0e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:09.081727 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b166edf0-0f65-4e57-904f-203df67e5a0e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1318 microversion: 2.1 time: 0.829997 Jul 20 04:24:09.087629 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1807/3630] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:09.658644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c28c0a54-c331-4bd0-a487-613e3739f715 req-29d26049-9348-4377-8db4-8d469ec8c393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75de7cb5-82d8-4004-817f-cbd784128119", "name": "network-vif-plugged", "status": "completed", "tag": "99cefe41-e92f-41c7-b30b-e9d26a95d053"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:09.679734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c28c0a54-c331-4bd0-a487-613e3739f715 req-29d26049-9348-4377-8db4-8d469ec8c393 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.680065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c28c0a54-c331-4bd0-a487-613e3739f715 req-29d26049-9348-4377-8db4-8d469ec8c393 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.692448 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c28c0a54-c331-4bd0-a487-613e3739f715 req-29d26049-9348-4377-8db4-8d469ec8c393 service nova] Creating event network-vif-plugged:99cefe41-e92f-41c7-b30b-e9d26a95d053 for instance 75de7cb5-82d8-4004-817f-cbd784128119 on n-h1-760456-11 Jul 20 04:24:09.697904 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c28c0a54-c331-4bd0-a487-613e3739f715 req-29d26049-9348-4377-8db4-8d469ec8c393 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044119 Jul 20 04:24:09.699246 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1824/3631] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:09.886182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4b8ad37d-c3e7-4f71-8aee-da97eed0c4ee tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:09.887021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4b8ad37d-c3e7-4f71-8aee-da97eed0c4ee tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:09.900886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b8ad37d-c3e7-4f71-8aee-da97eed0c4ee tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.903007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b8ad37d-c3e7-4f71-8aee-da97eed0c4ee tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.904134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b8ad37d-c3e7-4f71-8aee-da97eed0c4ee tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.906552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b8ad37d-c3e7-4f71-8aee-da97eed0c4ee tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.118866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dfb066c3-6e49-4c6c-bb36-8c9a54b2004d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:10.135344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dfb066c3-6e49-4c6c-bb36-8c9a54b2004d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:10.145562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfb066c3-6e49-4c6c-bb36-8c9a54b2004d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:10.146351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfb066c3-6e49-4c6c-bb36-8c9a54b2004d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.147361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfb066c3-6e49-4c6c-bb36-8c9a54b2004d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:10.148496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfb066c3-6e49-4c6c-bb36-8c9a54b2004d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.356935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4b8ad37d-c3e7-4f71-8aee-da97eed0c4ee tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:10.365905 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4b8ad37d-c3e7-4f71-8aee-da97eed0c4ee tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1521 microversion: 2.1 time: 0.488565 Jul 20 04:24:10.366552 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1808/3632] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:09 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:10.384476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b631316e-2a3b-4e40-8651-41591a6e9dc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:10.384919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b631316e-2a3b-4e40-8651-41591a6e9dc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:10.412923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b631316e-2a3b-4e40-8651-41591a6e9dc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:10.414960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b631316e-2a3b-4e40-8651-41591a6e9dc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.416128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b631316e-2a3b-4e40-8651-41591a6e9dc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:10.416802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b631316e-2a3b-4e40-8651-41591a6e9dc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.451762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b631316e-2a3b-4e40-8651-41591a6e9dc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:10.563467 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b631316e-2a3b-4e40-8651-41591a6e9dc3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "DELETE /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 204 len: 0 microversion: 2.1 time: 0.184108 Jul 20 04:24:10.564130 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1809/3633] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:10 2022] DELETE /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:24:10.574693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2f32405e-e0e8-437c-9c1f-0442927804b5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:10.577638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2f32405e-e0e8-437c-9c1f-0442927804b5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:10.591928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f32405e-e0e8-437c-9c1f-0442927804b5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:10.592454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f32405e-e0e8-437c-9c1f-0442927804b5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.593250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f32405e-e0e8-437c-9c1f-0442927804b5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:10.593793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f32405e-e0e8-437c-9c1f-0442927804b5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.760318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dfb066c3-6e49-4c6c-bb36-8c9a54b2004d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:10.772121 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dfb066c3-6e49-4c6c-bb36-8c9a54b2004d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1468 microversion: 2.1 time: 0.670737 Jul 20 04:24:10.775255 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1825/3634] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:10 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1468 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:10.800152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-206db03b-0264-459c-8970-b0ae1757ac82 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:10.800890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-206db03b-0264-459c-8970-b0ae1757ac82 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:10.811302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-206db03b-0264-459c-8970-b0ae1757ac82 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:10.811986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-206db03b-0264-459c-8970-b0ae1757ac82 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.812946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-206db03b-0264-459c-8970-b0ae1757ac82 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:10.813547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-206db03b-0264-459c-8970-b0ae1757ac82 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:10.961565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2f32405e-e0e8-437c-9c1f-0442927804b5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:10.973909 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2f32405e-e0e8-437c-9c1f-0442927804b5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1527 microversion: 2.1 time: 0.405050 Jul 20 04:24:10.974610 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1810/3635] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:10 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1527 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:11.191771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-206db03b-0264-459c-8970-b0ae1757ac82 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:11.211035 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-206db03b-0264-459c-8970-b0ae1757ac82 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f" status: 200 len: 1468 microversion: 2.1 time: 0.422954 Jul 20 04:24:11.212332 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1826/3636] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:10 2022] GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f => generated 1468 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:11.238658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-612da11c-d9bb-4a7e-90d7-f4e08a715b7c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2005717673"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:11.239740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-612da11c-d9bb-4a7e-90d7-f4e08a715b7c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:11.250563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-612da11c-d9bb-4a7e-90d7-f4e08a715b7c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.254990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-612da11c-d9bb-4a7e-90d7-f4e08a715b7c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.256089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-612da11c-d9bb-4a7e-90d7-f4e08a715b7c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.256713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-612da11c-d9bb-4a7e-90d7-f4e08a715b7c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.928808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:11.977468 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-612da11c-d9bb-4a7e-90d7-f4e08a715b7c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "POST /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f/action" status: 202 len: 0 microversion: 2.1 time: 0.742549 Jul 20 04:24:11.994781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e6eb8c7f-1324-4ca0-a117-a52d566b5403 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:11.995709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e6eb8c7f-1324-4ca0-a117-a52d566b5403 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:12.019138 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1811/3637] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:11 2022] POST /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 20 04:24:12.030107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6eb8c7f-1324-4ca0-a117-a52d566b5403 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.034729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6eb8c7f-1324-4ca0-a117-a52d566b5403 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.036129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6eb8c7f-1324-4ca0-a117-a52d566b5403 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.037402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-76cec95c-7675-4fc8-bc88-56f8992aec47 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bc700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:12.038090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6eb8c7f-1324-4ca0-a117-a52d566b5403 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.169151 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-76cec95c-7675-4fc8-bc88-56f8992aec47 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.148612 Jul 20 04:24:12.169970 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1812/3638] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:12 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:12.442030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-063138b3-71c2-4bc1-b4cf-81c7873af266 req-18fb620e-9c60-47b6-b119-988aed69bedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75de7cb5-82d8-4004-817f-cbd784128119", "name": "network-vif-unplugged", "status": "completed", "tag": "99cefe41-e92f-41c7-b30b-e9d26a95d053"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:12.468145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-063138b3-71c2-4bc1-b4cf-81c7873af266 req-18fb620e-9c60-47b6-b119-988aed69bedf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.468622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-063138b3-71c2-4bc1-b4cf-81c7873af266 req-18fb620e-9c60-47b6-b119-988aed69bedf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.535601 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-063138b3-71c2-4bc1-b4cf-81c7873af266 req-18fb620e-9c60-47b6-b119-988aed69bedf service nova] Creating event network-vif-unplugged:99cefe41-e92f-41c7-b30b-e9d26a95d053 for instance 75de7cb5-82d8-4004-817f-cbd784128119 on n-h1-760456-11 Jul 20 04:24:12.553232 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-063138b3-71c2-4bc1-b4cf-81c7873af266 req-18fb620e-9c60-47b6-b119-988aed69bedf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113418 Jul 20 04:24:12.558956 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1813/3639] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:12.715534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e6eb8c7f-1324-4ca0-a117-a52d566b5403 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:12.731704 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e6eb8c7f-1324-4ca0-a117-a52d566b5403 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1527 microversion: 2.1 time: 0.744138 Jul 20 04:24:12.732630 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1827/3640] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:11 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1527 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:13.184564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3a1cd260-56fa-4bdf-879e-d43c6e23ef91 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bc670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:13.299508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3a1cd260-56fa-4bdf-879e-d43c6e23ef91 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.118532 Jul 20 04:24:13.309727 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1814/3641] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:13 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:13.750280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2b3e3ce5-d9ea-41e7-98d7-5f325c984146 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:13.752485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2b3e3ce5-d9ea-41e7-98d7-5f325c984146 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:13.776949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b3e3ce5-d9ea-41e7-98d7-5f325c984146 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.779316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b3e3ce5-d9ea-41e7-98d7-5f325c984146 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.781309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b3e3ce5-d9ea-41e7-98d7-5f325c984146 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.782235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b3e3ce5-d9ea-41e7-98d7-5f325c984146 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.316853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3ca0f3fe-65a2-47ee-94c1-f88c94e6f932 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841248040>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:14.449326 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3ca0f3fe-65a2-47ee-94c1-f88c94e6f932 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.137576 Jul 20 04:24:14.451354 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1815/3642] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:14 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:14.518318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2b3e3ce5-d9ea-41e7-98d7-5f325c984146 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:14.530517 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2b3e3ce5-d9ea-41e7-98d7-5f325c984146 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1527 microversion: 2.1 time: 0.784847 Jul 20 04:24:14.534101 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1828/3643] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:13 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1527 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:14.960997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-45172c1c-380f-4773-ad60-de33521bd47b req-0c9a4b62-ee97-4872-a95c-a19ee61b05c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75de7cb5-82d8-4004-817f-cbd784128119", "name": "network-vif-deleted", "tag": "99cefe41-e92f-41c7-b30b-e9d26a95d053"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:14.984617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-45172c1c-380f-4773-ad60-de33521bd47b req-0c9a4b62-ee97-4872-a95c-a19ee61b05c1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:14.985145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-45172c1c-380f-4773-ad60-de33521bd47b req-0c9a4b62-ee97-4872-a95c-a19ee61b05c1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.021455 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-45172c1c-380f-4773-ad60-de33521bd47b req-0c9a4b62-ee97-4872-a95c-a19ee61b05c1 service nova] Creating event network-vif-deleted:99cefe41-e92f-41c7-b30b-e9d26a95d053 for instance 75de7cb5-82d8-4004-817f-cbd784128119 on n-h1-760456-11 Jul 20 04:24:15.042412 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-45172c1c-380f-4773-ad60-de33521bd47b req-0c9a4b62-ee97-4872-a95c-a19ee61b05c1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085397 Jul 20 04:24:15.043408 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1816/3644] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:15.466870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3613dfbb-040d-4a34-9492-566de5cdbabe tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84105f820>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:15.551786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:15.552389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:15.566375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.566841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.567632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.568074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.681152 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3613dfbb-040d-4a34-9492-566de5cdbabe tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.217358 Jul 20 04:24:15.690551 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1829/3645] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:15 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:15.692796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:15.693345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:15.693710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lazy-loading 'fault' on Instance uuid 75de7cb5-82d8-4004-817f-cbd784128119 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:15.820017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:15.833300 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f61969af-78fc-4395-a721-175b1ec4eacb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 200 len: 1314 microversion: 2.1 time: 0.282484 Jul 20 04:24:15.837890 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1817/3646] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:15 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:16.699935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ef43370-c3ca-4462-822d-2bdca62e8bfb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841052670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:16.800132 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ef43370-c3ca-4462-822d-2bdca62e8bfb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.107639 Jul 20 04:24:16.807254 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1830/3647] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:16 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:16.855963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-acdd6f1d-44a5-4a36-a661-871b08bb055b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:16.857557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-acdd6f1d-44a5-4a36-a661-871b08bb055b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:16.879323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acdd6f1d-44a5-4a36-a661-871b08bb055b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:16.881549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acdd6f1d-44a5-4a36-a661-871b08bb055b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:16.883881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acdd6f1d-44a5-4a36-a661-871b08bb055b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:16.884604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acdd6f1d-44a5-4a36-a661-871b08bb055b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:16.930006 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-acdd6f1d-44a5-4a36-a661-871b08bb055b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-acdd6f1d-44a5-4a36-a661-871b08bb055b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 HTTP/1.1 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '75de7cb5-82d8-4004-817f-cbd784128119'} Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:16.933034 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:16.939622 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:16.939622 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:16.939622 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:16.939622 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:16.939622 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:16.939622 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:16.939622 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:24:16.939622 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:16.943533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-acdd6f1d-44a5-4a36-a661-871b08bb055b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 404 to user: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:16.944788 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-acdd6f1d-44a5-4a36-a661-871b08bb055b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 404 len: 111 microversion: 2.1 time: 0.095723 Jul 20 04:24:16.948155 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1818/3648] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:16 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:16.961524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4eed995d-b897-458a-bc61-6d837f9bb71b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Action: 'create', calling method: .version_select at 0x7fb8410d43a0>, body: {"keypair": {"name": "tempest-keypair-1544982760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCONGYQMfXrVHDOKOZeVAB4Lx0vrP7nIDC8+WFi8PGAIQGoX6shtnveCTw2oGWE2uqvMewiBDKryY9JKPbGEEaax9ouXkuCBhLNdu6g/fa/OZKYDChi6IylC4dNfuGWatA=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:17.004765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4eed995d-b897-458a-bc61-6d837f9bb71b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Getting quotas for project 6e0df1f7215e4150975085ea1c52bf23. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:17.017624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4eed995d-b897-458a-bc61-6d837f9bb71b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Getting quotas for user 2093470c6f894ad9a5b0fb5fc1fe87f4 and project 6e0df1f7215e4150975085ea1c52bf23. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:17.088046 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4eed995d-b897-458a-bc61-6d837f9bb71b tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130322 Jul 20 04:24:17.090011 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1831/3649] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:24:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:17.813567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3ec0d434-8456-42c0-b04f-4888fb5be8e1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84112d040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:17.829945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-833713224", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "72f4a0c7-3717-4016-91f5-8fc30f90f268"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:17.947706 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3ec0d434-8456-42c0-b04f-4888fb5be8e1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.137543 Jul 20 04:24:17.951183 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1832/3650] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:17 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:17.964639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] validate_networks() for [('72f4a0c7-3717-4016-91f5-8fc30f90f268', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:18.965749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-57cc0508-3d8f-41aa-b11c-2cc46b82b312 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8410f10d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:19.070770 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-57cc0508-3d8f-41aa-b11c-2cc46b82b312 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.111482 Jul 20 04:24:19.076381 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1833/3651] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:18 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:19.581330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:19.581864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:19.582644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:19.583348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:19.584031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:19.590200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:19.607823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.608806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.609917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.611534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.685049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Getting quotas for project e210967a095943d9b7c5fab0ae2d9f31. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:19.705454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Getting quotas for user cad43f1f50e3413c9630929e534d5493 and project e210967a095943d9b7c5fab0ae2d9f31. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:19.750036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:19.766209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:19.942287 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e785b1ba-1827-451f-9eb2-9ce0375aa1f8 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.381479 Jul 20 04:24:19.943571 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1819/3652] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:19.955503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-96d30769-f5c4-4001-9142-4269ebc9d32b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:19.956131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-96d30769-f5c4-4001-9142-4269ebc9d32b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:20.084498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3a160203-34aa-4fcd-b34f-56750e3f2db8 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bca60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:20.106729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-96d30769-f5c4-4001-9142-4269ebc9d32b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:20.127378 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-96d30769-f5c4-4001-9142-4269ebc9d32b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1213 microversion: 2.1 time: 0.175820 Jul 20 04:24:20.138787 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1834/3653] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:19 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1213 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:20.182130 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3a160203-34aa-4fcd-b34f-56750e3f2db8 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.101556 Jul 20 04:24:20.182756 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1820/3654] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:20 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:20.353208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-cc39f18c-87c5-4210-9a8e-42d924f2e9a9 req-50cfea3d-95ac-4174-a51a-7f68e8b7412f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c46211-eaee-4f38-a690-65d710b5529f", "name": "network-vif-plugged", "status": "completed", "tag": "15789429-5cd8-4e37-95ed-801038c4a3ef"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:20.373714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cc39f18c-87c5-4210-9a8e-42d924f2e9a9 req-50cfea3d-95ac-4174-a51a-7f68e8b7412f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:20.374389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cc39f18c-87c5-4210-9a8e-42d924f2e9a9 req-50cfea3d-95ac-4174-a51a-7f68e8b7412f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:20.404066 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-cc39f18c-87c5-4210-9a8e-42d924f2e9a9 req-50cfea3d-95ac-4174-a51a-7f68e8b7412f service nova] Creating event network-vif-plugged:15789429-5cd8-4e37-95ed-801038c4a3ef for instance b9c46211-eaee-4f38-a690-65d710b5529f on n-h2-760456-11 Jul 20 04:24:20.421477 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-cc39f18c-87c5-4210-9a8e-42d924f2e9a9 req-50cfea3d-95ac-4174-a51a-7f68e8b7412f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070799 Jul 20 04:24:20.423984 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1835/3655] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:21.147083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59088b37-b2f6-4cea-ab59-b7456298f56a tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:21.148544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-59088b37-b2f6-4cea-ab59-b7456298f56a tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:21.294969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fcae7a4-667f-4a56-9120-23a5eeb3a85a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:21.295450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1fcae7a4-667f-4a56-9120-23a5eeb3a85a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:21.312749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fcae7a4-667f-4a56-9120-23a5eeb3a85a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:21.318715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fcae7a4-667f-4a56-9120-23a5eeb3a85a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:21.321206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fcae7a4-667f-4a56-9120-23a5eeb3a85a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:21.323022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fcae7a4-667f-4a56-9120-23a5eeb3a85a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:21.408603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-59088b37-b2f6-4cea-ab59-b7456298f56a tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:21.425694 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-59088b37-b2f6-4cea-ab59-b7456298f56a tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1213 microversion: 2.1 time: 0.283971 Jul 20 04:24:21.434547 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1836/3656] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:21 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1213 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:21.462454 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1fcae7a4-667f-4a56-9120-23a5eeb3a85a tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/ips" status: 200 len: 145 microversion: 2.1 time: 0.715154 Jul 20 04:24:21.463192 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1821/3657] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:24:20 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/ips => generated 145 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:21.471526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0237ccab-2a0d-41be-9995-f5aa74973aa9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84112dee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:21.676313 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0237ccab-2a0d-41be-9995-f5aa74973aa9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.240618 Jul 20 04:24:21.676918 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1837/3658] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:21 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.443315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-70177704-9655-4f7c-ab94-e434cee67ca7 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.444069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-70177704-9655-4f7c-ab94-e434cee67ca7 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:22.454282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70177704-9655-4f7c-ab94-e434cee67ca7 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.454685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70177704-9655-4f7c-ab94-e434cee67ca7 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.455473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70177704-9655-4f7c-ab94-e434cee67ca7 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.475072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70177704-9655-4f7c-ab94-e434cee67ca7 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.690184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-41e31144-301c-44a0-8d76-8eccb45f6bd0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840f1bee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.703016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-70177704-9655-4f7c-ab94-e434cee67ca7 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:22.712835 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-70177704-9655-4f7c-ab94-e434cee67ca7 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1283 microversion: 2.1 time: 0.271677 Jul 20 04:24:22.716534 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1822/3659] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1283 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.796400 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-41e31144-301c-44a0-8d76-8eccb45f6bd0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.109924 Jul 20 04:24:22.796988 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1838/3660] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.896908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2007869871", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:23.033615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] validate_networks() for [('a6502162-a528-4ba5-89a1-8e5c89b95706', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:23.735879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26ecf7fa-ae23-4667-82a3-86b9dbb84ba1 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.737124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26ecf7fa-ae23-4667-82a3-86b9dbb84ba1 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:23.739388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:23.766149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26ecf7fa-ae23-4667-82a3-86b9dbb84ba1 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.769285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26ecf7fa-ae23-4667-82a3-86b9dbb84ba1 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.770380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26ecf7fa-ae23-4667-82a3-86b9dbb84ba1 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.773639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26ecf7fa-ae23-4667-82a3-86b9dbb84ba1 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:24.511246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-26ecf7fa-ae23-4667-82a3-86b9dbb84ba1 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:24.525640 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26ecf7fa-ae23-4667-82a3-86b9dbb84ba1 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1271 microversion: 2.1 time: 0.794831 Jul 20 04:24:24.529772 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1839/3661] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:23 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1271 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:24.543993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-adfacf72-84df-4a22-a7fd-0f76d9e24cd5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840f16e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:24.830412 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-adfacf72-84df-4a22-a7fd-0f76d9e24cd5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.298370 Jul 20 04:24:24.836651 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1840/3662] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:24 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:24.864096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-eb70b765-7421-41b7-acba-c1cf7b75eb8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2bc2b85-d5ac-4363-b688-29879cb3b86e"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:24.871604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-eb70b765-7421-41b7-acba-c1cf7b75eb8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:24.889997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb70b765-7421-41b7-acba-c1cf7b75eb8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:24.891616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb70b765-7421-41b7-acba-c1cf7b75eb8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:24.893184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb70b765-7421-41b7-acba-c1cf7b75eb8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:24.896370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb70b765-7421-41b7-acba-c1cf7b75eb8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.536299 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-eb70b765-7421-41b7-acba-c1cf7b75eb8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.678035 Jul 20 04:24:25.537680 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1841/3663] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:24:24 2022] POST /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:25.561421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9aca4ed-e8dd-4d27-a3bc-2674bb1b575b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:25.564113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9aca4ed-e8dd-4d27-a3bc-2674bb1b575b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:25.577994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9aca4ed-e8dd-4d27-a3bc-2674bb1b575b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.580163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9aca4ed-e8dd-4d27-a3bc-2674bb1b575b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.581688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9aca4ed-e8dd-4d27-a3bc-2674bb1b575b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.582323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9aca4ed-e8dd-4d27-a3bc-2674bb1b575b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.966289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:25.966822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:25.968080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:25.969548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:25.970228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:25.999683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.000574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.001769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.002990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.047385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Getting quotas for project 6e0df1f7215e4150975085ea1c52bf23. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:26.059621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Getting quotas for user 2093470c6f894ad9a5b0fb5fc1fe87f4 and project 6e0df1f7215e4150975085ea1c52bf23. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:26.113843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:26.117288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:26.257619 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0c09609-203a-4b3a-8bd8-55f46ee0a945 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.374975 Jul 20 04:24:26.258785 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1823/3664] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 3379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:24:26.274969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f161a24f-1b23-466f-88aa-7b2ba83e3312 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412609d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.442714 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f161a24f-1b23-466f-88aa-7b2ba83e3312 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.180574 Jul 20 04:24:26.443455 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1824/3665] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:26 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:26.473452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6af12514-b6ab-45d2-ae23-d0b2ddcce996 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.481388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6af12514-b6ab-45d2-ae23-d0b2ddcce996 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:26.653237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9aca4ed-e8dd-4d27-a3bc-2674bb1b575b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:26.669295 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9aca4ed-e8dd-4d27-a3bc-2674bb1b575b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1313 microversion: 2.1 time: 1.119081 Jul 20 04:24:26.683189 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1842/3666] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:25 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1313 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:26.851567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6af12514-b6ab-45d2-ae23-d0b2ddcce996 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:26.873338 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6af12514-b6ab-45d2-ae23-d0b2ddcce996 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1225 microversion: 2.1 time: 0.423531 Jul 20 04:24:26.885479 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1825/3667] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:26 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1225 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:27.463366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b541c59c-5e45-42fa-97db-f644729912ca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84111f430>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.548495 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b541c59c-5e45-42fa-97db-f644729912ca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.094334 Jul 20 04:24:27.553023 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1843/3668] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:27.695166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-005f4ffc-3eb2-4b58-90dc-dd0afe0d2556 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.695850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-005f4ffc-3eb2-4b58-90dc-dd0afe0d2556 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:27.712055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-005f4ffc-3eb2-4b58-90dc-dd0afe0d2556 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.712827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-005f4ffc-3eb2-4b58-90dc-dd0afe0d2556 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.714038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-005f4ffc-3eb2-4b58-90dc-dd0afe0d2556 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.714735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-005f4ffc-3eb2-4b58-90dc-dd0afe0d2556 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.893111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0a91684a-e74b-47b8-b259-3805b53674d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.894525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0a91684a-e74b-47b8-b259-3805b53674d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:27.923312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a91684a-e74b-47b8-b259-3805b53674d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.924081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a91684a-e74b-47b8-b259-3805b53674d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.925077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a91684a-e74b-47b8-b259-3805b53674d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.925703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a91684a-e74b-47b8-b259-3805b53674d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.073398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0a91684a-e74b-47b8-b259-3805b53674d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:28.095058 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0a91684a-e74b-47b8-b259-3805b53674d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1277 microversion: 2.1 time: 0.205782 Jul 20 04:24:28.097366 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1844/3669] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:28.151745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a48cb22b-b19f-44d8-a071-dd62b530ad9f req-c0bde48e-98ed-41cd-a322-30bafc2d561d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a1fc3d-c12a-410a-b478-f0c2be382b66", "tag": "ed136390-e0a0-4082-a31c-27d18f8345e1"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:28.198850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a48cb22b-b19f-44d8-a071-dd62b530ad9f req-c0bde48e-98ed-41cd-a322-30bafc2d561d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.206991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a48cb22b-b19f-44d8-a071-dd62b530ad9f req-c0bde48e-98ed-41cd-a322-30bafc2d561d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.251145 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a48cb22b-b19f-44d8-a071-dd62b530ad9f req-c0bde48e-98ed-41cd-a322-30bafc2d561d service nova] Creating event network-changed:ed136390-e0a0-4082-a31c-27d18f8345e1 for instance 71a1fc3d-c12a-410a-b478-f0c2be382b66 on n-h1-760456-11 Jul 20 04:24:28.285970 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a48cb22b-b19f-44d8-a071-dd62b530ad9f req-c0bde48e-98ed-41cd-a322-30bafc2d561d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139502 Jul 20 04:24:28.295768 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1845/3670] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:28.567140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4d66151e-5ab0-4f6b-9705-b07bf044acd7 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840fffdc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.644727 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4d66151e-5ab0-4f6b-9705-b07bf044acd7 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.082159 Jul 20 04:24:28.645481 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1846/3671] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:28 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:28.773229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-005f4ffc-3eb2-4b58-90dc-dd0afe0d2556 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:28.787325 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-005f4ffc-3eb2-4b58-90dc-dd0afe0d2556 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1313 microversion: 2.1 time: 1.103001 Jul 20 04:24:28.788587 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1826/3672] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1313 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.119359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0b8f31d8-2f05-426a-a1ad-d353673901d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.120797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0b8f31d8-2f05-426a-a1ad-d353673901d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.137673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b8f31d8-2f05-426a-a1ad-d353673901d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.141285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b8f31d8-2f05-426a-a1ad-d353673901d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.143490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b8f31d8-2f05-426a-a1ad-d353673901d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.145079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b8f31d8-2f05-426a-a1ad-d353673901d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.402797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0b8f31d8-2f05-426a-a1ad-d353673901d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:29.415337 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0b8f31d8-2f05-426a-a1ad-d353673901d5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1283 microversion: 2.1 time: 0.300997 Jul 20 04:24:29.416224 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1847/3673] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1283 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.659724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5ab03e0a-83ae-4936-a84a-9d0dad36cb16 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840fffa60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.784333 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5ab03e0a-83ae-4936-a84a-9d0dad36cb16 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.129036 Jul 20 04:24:29.785485 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1848/3674] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.811491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2f52c11e-e36d-4c2d-bc3e-dc530c27836f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.812313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f52c11e-e36d-4c2d-bc3e-dc530c27836f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.834080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1638071874", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "919a5903-6527-411f-87fa-bfe6d184541e"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:29.839247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f52c11e-e36d-4c2d-bc3e-dc530c27836f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.846799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f52c11e-e36d-4c2d-bc3e-dc530c27836f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.849028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f52c11e-e36d-4c2d-bc3e-dc530c27836f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.851449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f52c11e-e36d-4c2d-bc3e-dc530c27836f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.984815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] validate_networks() for [('919a5903-6527-411f-87fa-bfe6d184541e', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:30.737119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2f52c11e-e36d-4c2d-bc3e-dc530c27836f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.748384 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2f52c11e-e36d-4c2d-bc3e-dc530c27836f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1313 microversion: 2.1 time: 0.944666 Jul 20 04:24:30.759168 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1849/3675] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1313 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:30.771924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d13498d-076e-4901-ac0e-7a25ee5945e1 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.790931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7d13498d-076e-4901-ac0e-7a25ee5945e1 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:30.810615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d13498d-076e-4901-ac0e-7a25ee5945e1 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.811539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d13498d-076e-4901-ac0e-7a25ee5945e1 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.819030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d13498d-076e-4901-ac0e-7a25ee5945e1 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.821554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d13498d-076e-4901-ac0e-7a25ee5945e1 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.295083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7d13498d-076e-4901-ac0e-7a25ee5945e1 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:31.311527 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d13498d-076e-4901-ac0e-7a25ee5945e1 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1325 microversion: 2.1 time: 0.545711 Jul 20 04:24:31.313661 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1850/3676] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:30 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1325 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:31.346995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0f1221c2-326e-486b-98c0-9551efb3bb2d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8410523a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.415372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:31.472001 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0f1221c2-326e-486b-98c0-9551efb3bb2d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.154491 Jul 20 04:24:31.472515 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1851/3677] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:31.769871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5096f59c-7e48-447d-9c05-6d13967415a4 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.770595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5096f59c-7e48-447d-9c05-6d13967415a4 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.780490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5096f59c-7e48-447d-9c05-6d13967415a4 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.780962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5096f59c-7e48-447d-9c05-6d13967415a4 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.781767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5096f59c-7e48-447d-9c05-6d13967415a4 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.782222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5096f59c-7e48-447d-9c05-6d13967415a4 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.835983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:31.865468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:31.867011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:31.867725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:31.868390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:31.869193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:31.894937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.899982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.901389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.902167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.970436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Getting quotas for project 907cfda59e2841da99f8c2c74c2a2ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:31.990049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Getting quotas for user 0443fe5ef60743b2b039f600e6cd3c61 and project 907cfda59e2841da99f8c2c74c2a2ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:32.087833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:32.103532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:32.342432 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-881babb6-7e62-46e1-bf28-b2617b898956 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.803427 Jul 20 04:24:32.344622 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1827/3678] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:32.375441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6415e22d-3650-49fa-a3a2-4bf0a49dc210 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:32.376638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6415e22d-3650-49fa-a3a2-4bf0a49dc210 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:32.401837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6415e22d-3650-49fa-a3a2-4bf0a49dc210 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.428215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6415e22d-3650-49fa-a3a2-4bf0a49dc210 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.438342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6415e22d-3650-49fa-a3a2-4bf0a49dc210 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.454689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6415e22d-3650-49fa-a3a2-4bf0a49dc210 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.629705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5096f59c-7e48-447d-9c05-6d13967415a4 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:32.642706 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5096f59c-7e48-447d-9c05-6d13967415a4 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1313 microversion: 2.1 time: 0.877525 Jul 20 04:24:32.657618 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1852/3679] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1313 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:32.663397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-229430bb-04ef-48f5-950a-9baebc539077 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:32.682728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-229430bb-04ef-48f5-950a-9baebc539077 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:33.048240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6415e22d-3650-49fa-a3a2-4bf0a49dc210 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:33.059228 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6415e22d-3650-49fa-a3a2-4bf0a49dc210 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1325 microversion: 2.1 time: 0.710603 Jul 20 04:24:33.065655 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1828/3680] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:32 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1325 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:33.094443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-229430bb-04ef-48f5-950a-9baebc539077 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:33.108012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-de89fb16-7f60-4b30-9005-4f39ad0656e8 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412ead30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:33.146751 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-229430bb-04ef-48f5-950a-9baebc539077 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1228 microversion: 2.1 time: 0.483557 Jul 20 04:24:33.149149 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1853/3681] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:32 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1228 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:33.239427 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-de89fb16-7f60-4b30-9005-4f39ad0656e8 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.126112 Jul 20 04:24:33.241775 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1829/3682] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:33 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:33.675305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4f4aa408-3e49-4cf4-a781-fd2d2b903c6e tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:33.676046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4f4aa408-3e49-4cf4-a781-fd2d2b903c6e tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:33.704805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f4aa408-3e49-4cf4-a781-fd2d2b903c6e tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:33.713794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f4aa408-3e49-4cf4-a781-fd2d2b903c6e tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:33.728745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f4aa408-3e49-4cf4-a781-fd2d2b903c6e tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:33.732164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f4aa408-3e49-4cf4-a781-fd2d2b903c6e tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.086720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ecba86e-8e4e-4166-8109-d0080ef59bfd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:34.088113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4ecba86e-8e4e-4166-8109-d0080ef59bfd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:34.156649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ecba86e-8e4e-4166-8109-d0080ef59bfd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.160451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ecba86e-8e4e-4166-8109-d0080ef59bfd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.166651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ecba86e-8e4e-4166-8109-d0080ef59bfd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.167188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ecba86e-8e4e-4166-8109-d0080ef59bfd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.677403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4f4aa408-3e49-4cf4-a781-fd2d2b903c6e tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:34.687163 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4f4aa408-3e49-4cf4-a781-fd2d2b903c6e tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1313 microversion: 2.1 time: 1.016586 Jul 20 04:24:34.692127 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1854/3683] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:33 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1313 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:34.709347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62a4b8c7-4258-4a9a-903b-ea6c4c89bb66 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:34.712391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-62a4b8c7-4258-4a9a-903b-ea6c4c89bb66 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:34.735642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62a4b8c7-4258-4a9a-903b-ea6c4c89bb66 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.736458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62a4b8c7-4258-4a9a-903b-ea6c4c89bb66 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.738935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62a4b8c7-4258-4a9a-903b-ea6c4c89bb66 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.739628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62a4b8c7-4258-4a9a-903b-ea6c4c89bb66 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:35.145153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-62a4b8c7-4258-4a9a-903b-ea6c4c89bb66 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:35.171931 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62a4b8c7-4258-4a9a-903b-ea6c4c89bb66 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1280 microversion: 2.1 time: 0.474193 Jul 20 04:24:35.180045 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1855/3684] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:34 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1280 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:35.227844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2504a3b3-8cd4-47f0-9a1c-f35a84e57a98 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840e1a8b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:35.811331 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2504a3b3-8cd4-47f0-9a1c-f35a84e57a98 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.627500 Jul 20 04:24:35.815709 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1856/3685] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:35 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:35.825794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-23964bc2-4d17-4480-b6fc-f1529b073a76 req-767be728-6529-4dc5-aa2c-1ac43bca18b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d8f875-4cc0-4603-abbc-d795d2c2ef0f", "tag": "8c804f89-0ed7-4455-801c-64507e891221"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:35.864481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-23964bc2-4d17-4480-b6fc-f1529b073a76 req-767be728-6529-4dc5-aa2c-1ac43bca18b4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:35.864923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-23964bc2-4d17-4480-b6fc-f1529b073a76 req-767be728-6529-4dc5-aa2c-1ac43bca18b4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:35.903467 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-23964bc2-4d17-4480-b6fc-f1529b073a76 req-767be728-6529-4dc5-aa2c-1ac43bca18b4 service nova] Creating event network-changed:8c804f89-0ed7-4455-801c-64507e891221 for instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f on n-h1-760456-11 Jul 20 04:24:35.916131 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-23964bc2-4d17-4480-b6fc-f1529b073a76 req-767be728-6529-4dc5-aa2c-1ac43bca18b4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097620 Jul 20 04:24:35.916889 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1857/3686] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:35.936722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-552ab418-7180-4460-8cea-f26223eb9b3c tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:35.943737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-552ab418-7180-4460-8cea-f26223eb9b3c tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:35.961201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-552ab418-7180-4460-8cea-f26223eb9b3c tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:35.966403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-552ab418-7180-4460-8cea-f26223eb9b3c tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:35.967614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-552ab418-7180-4460-8cea-f26223eb9b3c tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:35.968312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-552ab418-7180-4460-8cea-f26223eb9b3c tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.071561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4ecba86e-8e4e-4166-8109-d0080ef59bfd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:36.109778 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ecba86e-8e4e-4166-8109-d0080ef59bfd tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1325 microversion: 2.1 time: 2.003085 Jul 20 04:24:36.121593 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1830/3687] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:34 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1325 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:36.196614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f9ca621-b87d-476f-81fc-ae5b34188b4a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:36.197327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f9ca621-b87d-476f-81fc-ae5b34188b4a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:36.214408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f9ca621-b87d-476f-81fc-ae5b34188b4a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.221719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f9ca621-b87d-476f-81fc-ae5b34188b4a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.227401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f9ca621-b87d-476f-81fc-ae5b34188b4a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.229773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f9ca621-b87d-476f-81fc-ae5b34188b4a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.301058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-552ab418-7180-4460-8cea-f26223eb9b3c tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:36.340084 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-552ab418-7180-4460-8cea-f26223eb9b3c tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1313 microversion: 2.1 time: 0.412713 Jul 20 04:24:36.340797 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1858/3688] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:35 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:36.538998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f9ca621-b87d-476f-81fc-ae5b34188b4a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:36.547798 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f9ca621-b87d-476f-81fc-ae5b34188b4a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1286 microversion: 2.1 time: 0.359050 Jul 20 04:24:36.549823 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1831/3689] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:36 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1286 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:36.672304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-d5e562d4-3b9f-489f-a4ea-bdd3a19e0bd3 req-65c1f24d-77ab-4ba7-849d-418f61e32baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a1fc3d-c12a-410a-b478-f0c2be382b66", "name": "network-vif-plugged", "status": "completed", "tag": "ed136390-e0a0-4082-a31c-27d18f8345e1"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:36.695843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d5e562d4-3b9f-489f-a4ea-bdd3a19e0bd3 req-65c1f24d-77ab-4ba7-849d-418f61e32baf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.701553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d5e562d4-3b9f-489f-a4ea-bdd3a19e0bd3 req-65c1f24d-77ab-4ba7-849d-418f61e32baf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.728747 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-d5e562d4-3b9f-489f-a4ea-bdd3a19e0bd3 req-65c1f24d-77ab-4ba7-849d-418f61e32baf service nova] Creating event network-vif-plugged:ed136390-e0a0-4082-a31c-27d18f8345e1 for instance 71a1fc3d-c12a-410a-b478-f0c2be382b66 on n-h1-760456-11 Jul 20 04:24:36.741768 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-d5e562d4-3b9f-489f-a4ea-bdd3a19e0bd3 req-65c1f24d-77ab-4ba7-849d-418f61e32baf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072822 Jul 20 04:24:36.747720 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1859/3690] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:36.830957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c1e3052-ec9c-4253-bd45-1b4456a6a4fd tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412ea280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:36.993493 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c1e3052-ec9c-4253-bd45-1b4456a6a4fd tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.167865 Jul 20 04:24:37.008019 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1832/3691] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:36 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:37.138523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-51a76c00-5b54-4ab7-a4b6-543452c0b480 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:37.140158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-51a76c00-5b54-4ab7-a4b6-543452c0b480 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:37.168959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51a76c00-5b54-4ab7-a4b6-543452c0b480 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.169988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51a76c00-5b54-4ab7-a4b6-543452c0b480 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.171495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51a76c00-5b54-4ab7-a4b6-543452c0b480 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.172591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51a76c00-5b54-4ab7-a4b6-543452c0b480 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.361147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8fb96b5-f7d3-4369-9b2e-5dcd740d6b6f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:37.361988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c8fb96b5-f7d3-4369-9b2e-5dcd740d6b6f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:37.381659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8fb96b5-f7d3-4369-9b2e-5dcd740d6b6f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.386208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8fb96b5-f7d3-4369-9b2e-5dcd740d6b6f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.388879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8fb96b5-f7d3-4369-9b2e-5dcd740d6b6f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.395081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8fb96b5-f7d3-4369-9b2e-5dcd740d6b6f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.814468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-51a76c00-5b54-4ab7-a4b6-543452c0b480 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:37.824038 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-51a76c00-5b54-4ab7-a4b6-543452c0b480 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1325 microversion: 2.1 time: 0.700639 Jul 20 04:24:37.824697 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1860/3692] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:37 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1325 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:37.852681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea80d011-01bd-4990-892e-d01353bf83d0 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:37.856094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea80d011-01bd-4990-892e-d01353bf83d0 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:37.882931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea80d011-01bd-4990-892e-d01353bf83d0 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.883802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea80d011-01bd-4990-892e-d01353bf83d0 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.884716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea80d011-01bd-4990-892e-d01353bf83d0 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.885235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea80d011-01bd-4990-892e-d01353bf83d0 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.981651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ea80d011-01bd-4990-892e-d01353bf83d0 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:37.995413 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea80d011-01bd-4990-892e-d01353bf83d0 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1286 microversion: 2.1 time: 0.169534 Jul 20 04:24:37.997073 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1861/3693] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:37 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:38.019720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f799d94f-f656-44b4-b598-73ab7a5852e6 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8410d4550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.342373 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f799d94f-f656-44b4-b598-73ab7a5852e6 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.326669 Jul 20 04:24:38.343114 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1862/3694] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:38 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:38.551750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c8fb96b5-f7d3-4369-9b2e-5dcd740d6b6f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:38.560339 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c8fb96b5-f7d3-4369-9b2e-5dcd740d6b6f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1313 microversion: 2.1 time: 1.206223 Jul 20 04:24:38.560953 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1833/3695] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:37 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1313 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:38.843511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-16ed7834-e71d-4cf9-a256-5bb34b7ff8c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.844532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-16ed7834-e71d-4cf9-a256-5bb34b7ff8c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.871005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16ed7834-e71d-4cf9-a256-5bb34b7ff8c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.878961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16ed7834-e71d-4cf9-a256-5bb34b7ff8c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.880132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16ed7834-e71d-4cf9-a256-5bb34b7ff8c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.884403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16ed7834-e71d-4cf9-a256-5bb34b7ff8c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.014957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f7dbcb9e-20db-4784-8099-36ae38c52b8f tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:39.015886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f7dbcb9e-20db-4784-8099-36ae38c52b8f tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:39.034163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7dbcb9e-20db-4784-8099-36ae38c52b8f tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.034552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7dbcb9e-20db-4784-8099-36ae38c52b8f tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.035419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7dbcb9e-20db-4784-8099-36ae38c52b8f tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.035860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7dbcb9e-20db-4784-8099-36ae38c52b8f tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.585246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f7dbcb9e-20db-4784-8099-36ae38c52b8f tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:39.598435 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f7dbcb9e-20db-4784-8099-36ae38c52b8f tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1328 microversion: 2.1 time: 0.582860 Jul 20 04:24:39.599098 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1834/3696] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:39 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1328 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:39.620565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a77d47ee-3e3d-4451-8e59-e295871173d8 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412ded30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:40.082459 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a77d47ee-3e3d-4451-8e59-e295871173d8 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.482217 Jul 20 04:24:40.083776 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1835/3697] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:39 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:40.089320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-87b4a17c-07a7-4f9b-8a10-1ebcadb95cc3 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:40.090313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-87b4a17c-07a7-4f9b-8a10-1ebcadb95cc3 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:40.114530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87b4a17c-07a7-4f9b-8a10-1ebcadb95cc3 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.116864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87b4a17c-07a7-4f9b-8a10-1ebcadb95cc3 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.124171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87b4a17c-07a7-4f9b-8a10-1ebcadb95cc3 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.124979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87b4a17c-07a7-4f9b-8a10-1ebcadb95cc3 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.138788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-16ed7834-e71d-4cf9-a256-5bb34b7ff8c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:40.154997 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-16ed7834-e71d-4cf9-a256-5bb34b7ff8c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1325 microversion: 2.1 time: 1.316483 Jul 20 04:24:40.156143 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1863/3698] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:38 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1325 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:40.615890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6bdecba6-c04f-4f4d-b21b-80b378054f42 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:40.616788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6bdecba6-c04f-4f4d-b21b-80b378054f42 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:40.625436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bdecba6-c04f-4f4d-b21b-80b378054f42 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.635715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bdecba6-c04f-4f4d-b21b-80b378054f42 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.640582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bdecba6-c04f-4f4d-b21b-80b378054f42 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.643910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bdecba6-c04f-4f4d-b21b-80b378054f42 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.753543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-87b4a17c-07a7-4f9b-8a10-1ebcadb95cc3 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:40.766618 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-87b4a17c-07a7-4f9b-8a10-1ebcadb95cc3 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1496 microversion: 2.1 time: 0.681422 Jul 20 04:24:40.783284 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1836/3699] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:40 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1496 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:40.894935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-40a0d56b-6a59-4ea3-86a0-3ec08b167306 req-88ee6d3c-ee46-4098-9388-b1c4e608530a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc896523-9272-4327-a80d-b9c91ba15866", "tag": "5906bc06-8f17-4252-996e-da32b94ded1d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:40.924408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-40a0d56b-6a59-4ea3-86a0-3ec08b167306 req-88ee6d3c-ee46-4098-9388-b1c4e608530a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.937365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-40a0d56b-6a59-4ea3-86a0-3ec08b167306 req-88ee6d3c-ee46-4098-9388-b1c4e608530a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.978420 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-40a0d56b-6a59-4ea3-86a0-3ec08b167306 req-88ee6d3c-ee46-4098-9388-b1c4e608530a service nova] Creating event network-changed:5906bc06-8f17-4252-996e-da32b94ded1d for instance cc896523-9272-4327-a80d-b9c91ba15866 on n-h2-760456-11 Jul 20 04:24:40.991231 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-40a0d56b-6a59-4ea3-86a0-3ec08b167306 req-88ee6d3c-ee46-4098-9388-b1c4e608530a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110339 Jul 20 04:24:40.993982 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1837/3700] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:41.009863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2bbd6190-ec1e-4236-a4d6-6f319158ee85 req-9b1d6896-f811-4400-96ce-4ad84b21fa82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d8f875-4cc0-4603-abbc-d795d2c2ef0f", "name": "network-vif-plugged", "status": "completed", "tag": "8c804f89-0ed7-4455-801c-64507e891221"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:41.035180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2bbd6190-ec1e-4236-a4d6-6f319158ee85 req-9b1d6896-f811-4400-96ce-4ad84b21fa82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.039632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2bbd6190-ec1e-4236-a4d6-6f319158ee85 req-9b1d6896-f811-4400-96ce-4ad84b21fa82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.074133 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2bbd6190-ec1e-4236-a4d6-6f319158ee85 req-9b1d6896-f811-4400-96ce-4ad84b21fa82 service nova] Creating event network-vif-plugged:8c804f89-0ed7-4455-801c-64507e891221 for instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f on n-h1-760456-11 Jul 20 04:24:41.088581 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2bbd6190-ec1e-4236-a4d6-6f319158ee85 req-9b1d6896-f811-4400-96ce-4ad84b21fa82 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092962 Jul 20 04:24:41.095448 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1838/3701] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:41.137342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84ac58c3-2706-44f9-819b-e9d32a8696e2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412ec820>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:41.227580 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-84ac58c3-2706-44f9-819b-e9d32a8696e2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.129732 Jul 20 04:24:41.234631 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1839/3702] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:41 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:41.244209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7e9c3192-da37-46cf-ba99-f81fd7d46dd3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:41.245321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7e9c3192-da37-46cf-ba99-f81fd7d46dd3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:41.255483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9c3192-da37-46cf-ba99-f81fd7d46dd3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.255951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9c3192-da37-46cf-ba99-f81fd7d46dd3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.257670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9c3192-da37-46cf-ba99-f81fd7d46dd3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.258229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9c3192-da37-46cf-ba99-f81fd7d46dd3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.664745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6bdecba6-c04f-4f4d-b21b-80b378054f42 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.680187 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6bdecba6-c04f-4f4d-b21b-80b378054f42 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1328 microversion: 2.1 time: 1.067968 Jul 20 04:24:41.689468 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1864/3703] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:40 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1328 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:41.804422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7e9c3192-da37-46cf-ba99-f81fd7d46dd3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.820984 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7e9c3192-da37-46cf-ba99-f81fd7d46dd3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1325 microversion: 2.1 time: 0.588484 Jul 20 04:24:41.822732 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1840/3704] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:41 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1325 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:42.246136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94815086-a111-4d53-a51f-892eab94961e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84112d1f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.324455 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94815086-a111-4d53-a51f-892eab94961e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.083539 Jul 20 04:24:42.328466 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1865/3705] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:42 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:42.694909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:42.696376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=20 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:42.721959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a11a00e6-2df6-498c-ac0e-327e5642b6ae tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.724695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a11a00e6-2df6-498c-ac0e-327e5642b6ae tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:42.732493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a11a00e6-2df6-498c-ac0e-327e5642b6ae tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.732985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a11a00e6-2df6-498c-ac0e-327e5642b6ae tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.733979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a11a00e6-2df6-498c-ac0e-327e5642b6ae tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.734642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a11a00e6-2df6-498c-ac0e-327e5642b6ae tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.761414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:42.842321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-056c8fba-6264-424b-8f10-9f1cb77b347a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.844216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-056c8fba-6264-424b-8f10-9f1cb77b347a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:42.858626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-056c8fba-6264-424b-8f10-9f1cb77b347a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.859571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-056c8fba-6264-424b-8f10-9f1cb77b347a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.860747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-056c8fba-6264-424b-8f10-9f1cb77b347a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.861449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-056c8fba-6264-424b-8f10-9f1cb77b347a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.973963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a11a00e6-2df6-498c-ac0e-327e5642b6ae tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.986819 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a11a00e6-2df6-498c-ac0e-327e5642b6ae tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1328 microversion: 2.1 time: 0.291916 Jul 20 04:24:42.995447 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1841/3706] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:42 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1328 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:43.105214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:43.242388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-056c8fba-6264-424b-8f10-9f1cb77b347a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:43.264763 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-056c8fba-6264-424b-8f10-9f1cb77b347a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1325 microversion: 2.1 time: 0.424321 Jul 20 04:24:43.269662 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1866/3707] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:42 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1325 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:43.346068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7006e1ec-2934-4c90-be5d-0393c1ccab7c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bc8b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:43.447971 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7006e1ec-2934-4c90-be5d-0393c1ccab7c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1453 microversion: 2.1 time: 0.105684 Jul 20 04:24:43.448578 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1842/3708] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:43 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:44.012373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0492f20d-6394-41a6-880f-e67c7a3dbb0a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.013825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0492f20d-6394-41a6-880f-e67c7a3dbb0a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.028884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0492f20d-6394-41a6-880f-e67c7a3dbb0a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.031503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0492f20d-6394-41a6-880f-e67c7a3dbb0a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.035294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0492f20d-6394-41a6-880f-e67c7a3dbb0a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.036252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0492f20d-6394-41a6-880f-e67c7a3dbb0a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.289533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f7d2686-9600-4a0c-9b50-1c8583ab225a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.290088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1f7d2686-9600-4a0c-9b50-1c8583ab225a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.293932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0492f20d-6394-41a6-880f-e67c7a3dbb0a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:44.300828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f7d2686-9600-4a0c-9b50-1c8583ab225a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.302639 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0492f20d-6394-41a6-880f-e67c7a3dbb0a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1328 microversion: 2.1 time: 0.294136 Jul 20 04:24:44.305250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f7d2686-9600-4a0c-9b50-1c8583ab225a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.306283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f7d2686-9600-4a0c-9b50-1c8583ab225a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.306594 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1867/3709] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1328 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:44.310510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f7d2686-9600-4a0c-9b50-1c8583ab225a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.461776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08505daa-d8d6-4352-9b40-d52c989fe206 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840f6d1f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.518541 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08505daa-d8d6-4352-9b40-d52c989fe206 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1462 microversion: 2.1 time: 0.061332 Jul 20 04:24:44.526870 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1868/3710] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1462 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:44.534007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2eaefd5c-b18d-46b8-9185-768b49bf0e3d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84111f4c0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.599664 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2eaefd5c-b18d-46b8-9185-768b49bf0e3d tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 200 len: 1462 microversion: 2.1 time: 0.071354 Jul 20 04:24:44.600787 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1869/3711] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 1462 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:44.624785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b2bcc644-79e6-4572-9128-c5e36bdb8379 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.625490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b2bcc644-79e6-4572-9128-c5e36bdb8379 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.641254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2bcc644-79e6-4572-9128-c5e36bdb8379 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.641713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2bcc644-79e6-4572-9128-c5e36bdb8379 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.647453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2bcc644-79e6-4572-9128-c5e36bdb8379 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.647929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2bcc644-79e6-4572-9128-c5e36bdb8379 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.649111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f7d2686-9600-4a0c-9b50-1c8583ab225a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:44.661590 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1f7d2686-9600-4a0c-9b50-1c8583ab225a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1522 microversion: 2.1 time: 0.379787 Jul 20 04:24:44.664324 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1843/3712] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:44.690661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e01cf466-a35f-4575-ac23-6ad7b10d2f60 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.691388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e01cf466-a35f-4575-ac23-6ad7b10d2f60 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.712411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e01cf466-a35f-4575-ac23-6ad7b10d2f60 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.717419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e01cf466-a35f-4575-ac23-6ad7b10d2f60 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.718737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e01cf466-a35f-4575-ac23-6ad7b10d2f60 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.719336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e01cf466-a35f-4575-ac23-6ad7b10d2f60 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.886628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b2bcc644-79e6-4572-9128-c5e36bdb8379 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:44.901136 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b2bcc644-79e6-4572-9128-c5e36bdb8379 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f" status: 200 len: 1468 microversion: 2.1 time: 0.289982 Jul 20 04:24:44.904476 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1870/3713] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f => generated 1468 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:44.919889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e01cf466-a35f-4575-ac23-6ad7b10d2f60 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:44.922110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f96c9b8-45b5-4465-9724-0823707a01a9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-18666938"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:44.923696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8f96c9b8-45b5-4465-9724-0823707a01a9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.929510 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e01cf466-a35f-4575-ac23-6ad7b10d2f60 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1522 microversion: 2.1 time: 0.242847 Jul 20 04:24:44.930103 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1844/3714] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:44.947932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f96c9b8-45b5-4465-9724-0823707a01a9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.950602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f96c9b8-45b5-4465-9724-0823707a01a9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.953102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f96c9b8-45b5-4465-9724-0823707a01a9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.953904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f96c9b8-45b5-4465-9724-0823707a01a9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.954478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-18062158-d5dc-435e-b9ab-86e72eae1ac2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1581561013"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:44.959373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-18062158-d5dc-435e-b9ab-86e72eae1ac2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.975674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18062158-d5dc-435e-b9ab-86e72eae1ac2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.976884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18062158-d5dc-435e-b9ab-86e72eae1ac2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.980580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18062158-d5dc-435e-b9ab-86e72eae1ac2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.981203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18062158-d5dc-435e-b9ab-86e72eae1ac2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.424204 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-18062158-d5dc-435e-b9ab-86e72eae1ac2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "POST /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f/action" status: 202 len: 0 microversion: 2.1 time: 0.478483 Jul 20 04:24:45.426215 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1845/3715] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:44 2022] POST /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:24:45.437130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd069ad0-da94-4ff5-9e03-c98dd6c75c1e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.438775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd069ad0-da94-4ff5-9e03-c98dd6c75c1e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:45.447547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd069ad0-da94-4ff5-9e03-c98dd6c75c1e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.448311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd069ad0-da94-4ff5-9e03-c98dd6c75c1e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.449230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd069ad0-da94-4ff5-9e03-c98dd6c75c1e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.449909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd069ad0-da94-4ff5-9e03-c98dd6c75c1e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.486874 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd069ad0-da94-4ff5-9e03-c98dd6c75c1e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057172 Jul 20 04:24:45.492977 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1846/3716] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:24:45 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:45.493794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4e5d224e-7391-452c-8d00-e78b5355aa0d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.494649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4e5d224e-7391-452c-8d00-e78b5355aa0d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:45.501820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e5d224e-7391-452c-8d00-e78b5355aa0d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.503576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e5d224e-7391-452c-8d00-e78b5355aa0d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.504673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e5d224e-7391-452c-8d00-e78b5355aa0d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.505930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e5d224e-7391-452c-8d00-e78b5355aa0d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.569791 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8f96c9b8-45b5-4465-9724-0823707a01a9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "POST /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd/action" status: 202 len: 0 microversion: 2.1 time: 0.653530 Jul 20 04:24:45.575244 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1871/3717] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:44 2022] POST /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:24:45.580897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-357e6dfd-d46e-4942-8bc1-ed7ff98b8fd2 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.586786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-357e6dfd-d46e-4942-8bc1-ed7ff98b8fd2 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:45.596004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-357e6dfd-d46e-4942-8bc1-ed7ff98b8fd2 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.596478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-357e6dfd-d46e-4942-8bc1-ed7ff98b8fd2 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.597284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-357e6dfd-d46e-4942-8bc1-ed7ff98b8fd2 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.597742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-357e6dfd-d46e-4942-8bc1-ed7ff98b8fd2 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.811575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4e5d224e-7391-452c-8d00-e78b5355aa0d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:45.827106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4e5d224e-7391-452c-8d00-e78b5355aa0d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:45.830152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4e5d224e-7391-452c-8d00-e78b5355aa0d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:45.832995 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4e5d224e-7391-452c-8d00-e78b5355aa0d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2944 microversion: 2.32 time: 0.343911 Jul 20 04:24:45.839105 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1847/3718] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:45 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2944 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:45.852424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bc6852eb-539e-4bf3-97ca-b32753c3f31f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.853134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bc6852eb-539e-4bf3-97ca-b32753c3f31f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:45.863771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc6852eb-539e-4bf3-97ca-b32753c3f31f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.864241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc6852eb-539e-4bf3-97ca-b32753c3f31f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.866098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc6852eb-539e-4bf3-97ca-b32753c3f31f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.866583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc6852eb-539e-4bf3-97ca-b32753c3f31f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.868661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-357e6dfd-d46e-4942-8bc1-ed7ff98b8fd2 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:45.879755 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-357e6dfd-d46e-4942-8bc1-ed7ff98b8fd2 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1328 microversion: 2.1 time: 0.303110 Jul 20 04:24:45.882625 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1872/3719] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:45 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1328 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:45.892801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62a06eba-7ab0-44f4-a5c8-8f50806e12cc tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '.version_select at 0x7fb840f9b0d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.903780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bc6852eb-539e-4bf3-97ca-b32753c3f31f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:46.026134 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bc6852eb-539e-4bf3-97ca-b32753c3f31f tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "DELETE /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 204 len: 0 microversion: 2.1 time: 0.183146 Jul 20 04:24:46.028680 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1848/3720] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:45 2022] DELETE /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:46.035956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0996b807-bfd9-45f9-8382-a2e1908241d9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.036687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0996b807-bfd9-45f9-8382-a2e1908241d9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.046589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0996b807-bfd9-45f9-8382-a2e1908241d9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.047256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0996b807-bfd9-45f9-8382-a2e1908241d9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.048224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0996b807-bfd9-45f9-8382-a2e1908241d9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.050022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0996b807-bfd9-45f9-8382-a2e1908241d9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.121130 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0996b807-bfd9-45f9-8382-a2e1908241d9 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments/c2bc2b85-d5ac-4363-b688-29879cb3b86e" status: 200 len: 194 microversion: 2.1 time: 0.090957 Jul 20 04:24:46.130463 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1849/3721] 10.222.0.59 () {58 vars in 1412 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments/c2bc2b85-d5ac-4363-b688-29879cb3b86e => generated 194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:46.145776 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62a06eba-7ab0-44f4-a5c8-8f50806e12cc tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "DELETE /compute/v2.1/images/366c956e-7960-49ed-8a33-f997dfaaffd1" status: 204 len: 0 microversion: 2.1 time: 0.261642 Jul 20 04:24:46.147532 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1873/3722] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:45 2022] DELETE /compute/v2.1/images/366c956e-7960-49ed-8a33-f997dfaaffd1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:46.153264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-98140dc0-e150-4e46-bf47-bbf82d76ce86 req-91c4dc45-9d60-4089-9694-8f0d9440772f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc896523-9272-4327-a80d-b9c91ba15866", "name": "network-vif-plugged", "status": "completed", "tag": "5906bc06-8f17-4252-996e-da32b94ded1d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:46.158551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2b9abe4e-f033-4684-ba29-e4cfe238b76c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841261a60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.172264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-98140dc0-e150-4e46-bf47-bbf82d76ce86 req-91c4dc45-9d60-4089-9694-8f0d9440772f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.175488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-98140dc0-e150-4e46-bf47-bbf82d76ce86 req-91c4dc45-9d60-4089-9694-8f0d9440772f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.198712 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-98140dc0-e150-4e46-bf47-bbf82d76ce86 req-91c4dc45-9d60-4089-9694-8f0d9440772f service nova] Creating event network-vif-plugged:5906bc06-8f17-4252-996e-da32b94ded1d for instance cc896523-9272-4327-a80d-b9c91ba15866 on n-h2-760456-11 Jul 20 04:24:46.214896 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-98140dc0-e150-4e46-bf47-bbf82d76ce86 req-91c4dc45-9d60-4089-9694-8f0d9440772f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065576 Jul 20 04:24:46.216710 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1874/3723] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:46.227871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-63c36c6a-5ac1-4782-bf73-37b294be1c3d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.228461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63c36c6a-5ac1-4782-bf73-37b294be1c3d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.253140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63c36c6a-5ac1-4782-bf73-37b294be1c3d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.254002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63c36c6a-5ac1-4782-bf73-37b294be1c3d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.254139 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2b9abe4e-f033-4684-ba29-e4cfe238b76c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.121521 Jul 20 04:24:46.255114 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1850/3724] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:46.255226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63c36c6a-5ac1-4782-bf73-37b294be1c3d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.255886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63c36c6a-5ac1-4782-bf73-37b294be1c3d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.266095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f0b80a9-9d0b-44af-9a02-ebd5a5b0261b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.266912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f0b80a9-9d0b-44af-9a02-ebd5a5b0261b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.278059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f0b80a9-9d0b-44af-9a02-ebd5a5b0261b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.283620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f0b80a9-9d0b-44af-9a02-ebd5a5b0261b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.284533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f0b80a9-9d0b-44af-9a02-ebd5a5b0261b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.284989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f0b80a9-9d0b-44af-9a02-ebd5a5b0261b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.487368 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-63c36c6a-5ac1-4782-bf73-37b294be1c3d tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.268202 Jul 20 04:24:46.487981 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1875/3725] 10.222.0.59 () {60 vars in 1315 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e/os-interface => generated 1831 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:46.497405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62621eaa-ed2e-4a51-8503-8ba92e739ee9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '.version_select at 0x7fb8410e54c0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.538123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f0b80a9-9d0b-44af-9a02-ebd5a5b0261b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:46.542789 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-62621eaa-ed2e-4a51-8503-8ba92e739ee9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Image not found. Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62621eaa-ed2e-4a51-8503-8ba92e739ee9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/images/366c956e-7960-49ed-8a33-f997dfaaffd1 HTTP/1.1 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: exception: Image not found. Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '366c956e-7960-49ed-8a33-f997dfaaffd1'} Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 366c956e-7960-49ed-8a33-f997dfaaffd1 Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:24:46.545828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 366c956e-7960-49ed-8a33-f997dfaaffd1 could not be found. Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:24:46.548910 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.551018 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f0b80a9-9d0b-44af-9a02-ebd5a5b0261b tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1502 microversion: 2.1 time: 0.290893 Jul 20 04:24:46.551018 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1851/3726] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1502 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:46.553823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62621eaa-ed2e-4a51-8503-8ba92e739ee9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 404 to user: Image not found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:46.555155 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62621eaa-ed2e-4a51-8503-8ba92e739ee9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/images/366c956e-7960-49ed-8a33-f997dfaaffd1" status: 404 len: 62 microversion: 2.1 time: 0.063218 Jul 20 04:24:46.556545 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1876/3727] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/images/366c956e-7960-49ed-8a33-f997dfaaffd1 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:24:46.564989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-da879f6a-902c-4e7d-b33c-9a529224757d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.565550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-da879f6a-902c-4e7d-b33c-9a529224757d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.573843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da879f6a-902c-4e7d-b33c-9a529224757d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.574546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da879f6a-902c-4e7d-b33c-9a529224757d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.575637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da879f6a-902c-4e7d-b33c-9a529224757d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.576243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da879f6a-902c-4e7d-b33c-9a529224757d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.749887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-da879f6a-902c-4e7d-b33c-9a529224757d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:46.760220 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-da879f6a-902c-4e7d-b33c-9a529224757d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1534 microversion: 2.1 time: 0.199311 Jul 20 04:24:46.769532 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1852/3728] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1534 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:46.897591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8bd369e9-dce1-496a-869b-7e272f90f199 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.898355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8bd369e9-dce1-496a-869b-7e272f90f199 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.918830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bd369e9-dce1-496a-869b-7e272f90f199 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.921108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bd369e9-dce1-496a-869b-7e272f90f199 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.922132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bd369e9-dce1-496a-869b-7e272f90f199 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.923416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8bd369e9-dce1-496a-869b-7e272f90f199 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.137642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8bd369e9-dce1-496a-869b-7e272f90f199 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:47.140363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:47.147797 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8bd369e9-dce1-496a-869b-7e272f90f199 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1328 microversion: 2.1 time: 0.254611 Jul 20 04:24:47.148618 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1877/3729] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1328 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:47.271028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ce8d3137-7fad-4886-9886-0cb7da6cc823 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bca60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:47.350545 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ce8d3137-7fad-4886-9886-0cb7da6cc823 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.084944 Jul 20 04:24:47.360129 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1853/3730] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:47 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:47.566047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f72b068f-033b-47ce-8dec-0d06f3739575 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:47.566727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f72b068f-033b-47ce-8dec-0d06f3739575 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:47.592513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f72b068f-033b-47ce-8dec-0d06f3739575 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.594088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f72b068f-033b-47ce-8dec-0d06f3739575 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.597353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f72b068f-033b-47ce-8dec-0d06f3739575 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.598758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f72b068f-033b-47ce-8dec-0d06f3739575 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.778494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2cf9d077-5955-4b85-89ef-be05da7f91ef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:47.779264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2cf9d077-5955-4b85-89ef-be05da7f91ef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:47.782199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:47.809625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2cf9d077-5955-4b85-89ef-be05da7f91ef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.812788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2cf9d077-5955-4b85-89ef-be05da7f91ef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.814205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2cf9d077-5955-4b85-89ef-be05da7f91ef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.816471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2cf9d077-5955-4b85-89ef-be05da7f91ef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.969495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f72b068f-033b-47ce-8dec-0d06f3739575 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad43f1f50e3413c9630929e534d5493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e210967a095943d9b7c5fab0ae2d9f31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:47.984840 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f72b068f-033b-47ce-8dec-0d06f3739575 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 200 len: 1502 microversion: 2.1 time: 0.423500 Jul 20 04:24:47.996759 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1878/3731] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:47 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 1502 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:48.165831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cce4c75d-4750-4691-8317-935066e29beb tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:48.168460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cce4c75d-4750-4691-8317-935066e29beb tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:48.177091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cce4c75d-4750-4691-8317-935066e29beb tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.179494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cce4c75d-4750-4691-8317-935066e29beb tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.181642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cce4c75d-4750-4691-8317-935066e29beb tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.182403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cce4c75d-4750-4691-8317-935066e29beb tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.400167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cce4c75d-4750-4691-8317-935066e29beb tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:48.416712 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cce4c75d-4750-4691-8317-935066e29beb tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1529 microversion: 2.1 time: 0.254955 Jul 20 04:24:48.417624 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1879/3732] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:48 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1529 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:48.422763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c71e0b72-c1f4-4a2d-87d6-7072ca530cb6 req-5883dde5-5e65-4714-9a30-17c0c36bed11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c46211-eaee-4f38-a690-65d710b5529f", "name": "network-vif-unplugged", "status": "completed", "tag": "15789429-5cd8-4e37-95ed-801038c4a3ef"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:48.433403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c71e0b72-c1f4-4a2d-87d6-7072ca530cb6 req-5883dde5-5e65-4714-9a30-17c0c36bed11 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.434068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c71e0b72-c1f4-4a2d-87d6-7072ca530cb6 req-5883dde5-5e65-4714-9a30-17c0c36bed11 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.448398 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c71e0b72-c1f4-4a2d-87d6-7072ca530cb6 req-5883dde5-5e65-4714-9a30-17c0c36bed11 service nova] Creating event network-vif-unplugged:15789429-5cd8-4e37-95ed-801038c4a3ef for instance b9c46211-eaee-4f38-a690-65d710b5529f on n-h2-760456-11 Jul 20 04:24:48.455592 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c71e0b72-c1f4-4a2d-87d6-7072ca530cb6 req-5883dde5-5e65-4714-9a30-17c0c36bed11 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036319 Jul 20 04:24:48.456590 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1880/3733] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:48.462698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a85e824c-2622-4d28-8390-f9d052d4697b req-7cae9ddc-a14a-4698-ade0-adb86636dcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a1fc3d-c12a-410a-b478-f0c2be382b66", "name": "network-vif-deleted", "tag": "ed136390-e0a0-4082-a31c-27d18f8345e1"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:48.471301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a85e824c-2622-4d28-8390-f9d052d4697b req-7cae9ddc-a14a-4698-ade0-adb86636dcb6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.471764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a85e824c-2622-4d28-8390-f9d052d4697b req-7cae9ddc-a14a-4698-ade0-adb86636dcb6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.484628 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a85e824c-2622-4d28-8390-f9d052d4697b req-7cae9ddc-a14a-4698-ade0-adb86636dcb6 service nova] Creating event network-vif-deleted:ed136390-e0a0-4082-a31c-27d18f8345e1 for instance 71a1fc3d-c12a-410a-b478-f0c2be382b66 on n-h1-760456-11 Jul 20 04:24:48.489675 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a85e824c-2622-4d28-8390-f9d052d4697b req-7cae9ddc-a14a-4698-ade0-adb86636dcb6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031619 Jul 20 04:24:48.491225 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1881/3734] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:48.499428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0fca407d-7b0b-4a13-a86c-ab62abd86666 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8411090d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:48.558151 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0fca407d-7b0b-4a13-a86c-ab62abd86666 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.062733 Jul 20 04:24:48.558887 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1882/3735] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:48 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:48.563935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fa8a2c4a-ecac-4f44-8671-dd65bc3bf46c tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:48.564806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fa8a2c4a-ecac-4f44-8671-dd65bc3bf46c tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:48.571980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa8a2c4a-ecac-4f44-8671-dd65bc3bf46c tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.572579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa8a2c4a-ecac-4f44-8671-dd65bc3bf46c tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.573511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa8a2c4a-ecac-4f44-8671-dd65bc3bf46c tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.574036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa8a2c4a-ecac-4f44-8671-dd65bc3bf46c tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.649835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2cf9d077-5955-4b85-89ef-be05da7f91ef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:48.661058 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2cf9d077-5955-4b85-89ef-be05da7f91ef tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1540 microversion: 2.1 time: 0.884830 Jul 20 04:24:48.661674 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1854/3736] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:47 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1540 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:48.741375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fa8a2c4a-ecac-4f44-8671-dd65bc3bf46c tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:48.751770 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fa8a2c4a-ecac-4f44-8671-dd65bc3bf46c tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1529 microversion: 2.1 time: 0.191726 Jul 20 04:24:48.752605 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1883/3737] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:48 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1529 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:48.913199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f1d3931-0fb4-4c35-8716-5b493333fcfa tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b028798b-b954-4583-afe2-8078ffeef907"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:48.916359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9f1d3931-0fb4-4c35-8716-5b493333fcfa tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:48.936666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f1d3931-0fb4-4c35-8716-5b493333fcfa tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.939454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f1d3931-0fb4-4c35-8716-5b493333fcfa tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.943481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f1d3931-0fb4-4c35-8716-5b493333fcfa tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.946779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f1d3931-0fb4-4c35-8716-5b493333fcfa tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.106336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e697207-57bb-46b4-b6af-d9c7451ed683 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:49.106840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e697207-57bb-46b4-b6af-d9c7451ed683 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:49.113599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e697207-57bb-46b4-b6af-d9c7451ed683 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.114142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e697207-57bb-46b4-b6af-d9c7451ed683 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.116186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e697207-57bb-46b4-b6af-d9c7451ed683 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.116802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e697207-57bb-46b4-b6af-d9c7451ed683 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.134501 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-9e697207-57bb-46b4-b6af-d9c7451ed683 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] HTTP exception thrown: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e697207-57bb-46b4-b6af-d9c7451ed683 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Request method failure captured: Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 HTTP/1.1 Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14N9Af7JTdNm952l_geFm7Q0rbgVjzyVfkv632PkzcQgU6nYZIiTRPhbCjQKKHIEMu9G9RvF2oA_GYmZtwwIgoe0yN4VMqzIjaJyY6eGce3kFbEbjsztH9AmaLvljRbW9UPrAYbaVWJgdMcTW_9pDWCKQcrjE7EJCFBXFfh1E3WGezg Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 7d5bf986204d452dbb29a2b082997b22 Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1288967368 Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7d5bf986204d452dbb29a2b082997b22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7d5bf986204d452dbb29a2b082997b22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7d5bf986204d452dbb29a2b082997b22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7d5bf986204d452dbb29a2b082997b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1288967368 Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 7d5bf986204d452dbb29a2b082997b22 Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1288967368 Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1288967368-project Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: c107c991e0464478a8b66d4a190c12e5 Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1288967368-project Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'cc896523-9272-4327-a80d-b9c91ba15866'} Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:49.136541 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:49.140319 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.142078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e697207-57bb-46b4-b6af-d9c7451ed683 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Returning 404 to user: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:49.143180 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e697207-57bb-46b4-b6af-d9c7451ed683 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 404 len: 111 microversion: 2.1 time: 0.376842 Jul 20 04:24:49.144409 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1855/3738] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:48 2022] DELETE /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 111 bytes in 379 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:49.149551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4a7e9d70-b879-4e62-89d2-b21d2bd32078 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:49.150284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4a7e9d70-b879-4e62-89d2-b21d2bd32078 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] [instance: 71a1fc3d-c12a-410a-b478-f0c2be382b66] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:49.157850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a7e9d70-b879-4e62-89d2-b21d2bd32078 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.158459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a7e9d70-b879-4e62-89d2-b21d2bd32078 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.159494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a7e9d70-b879-4e62-89d2-b21d2bd32078 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.160062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a7e9d70-b879-4e62-89d2-b21d2bd32078 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.195625 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-4a7e9d70-b879-4e62-89d2-b21d2bd32078 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] HTTP exception thrown: Instance 71a1fc3d-c12a-410a-b478-f0c2be382b66 could not be found. Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4a7e9d70-b879-4e62-89d2-b21d2bd32078 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Request method failure captured: Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 HTTP/1.1 Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14NrTlKH_rgeGs7YQHH58cR3X4lElx1rBQfGSGlNS8gi3as55W8gvnYsdUewRny-U27tejbgf6G9bUVmBgJ3ReGQgI_bLgbvKzN1tlTccxKbMcQWMc4VOSxpV8sWI_kH_q-PqapjjO-2qqGv6EoL_6CcJj9D4K2Lbe6J3yOMaQZ1IOA Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e210967a095943d9b7c5fab0ae2d9f31 Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesActionsTest-1593050785 Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e210967a095943d9b7c5fab0ae2d9f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e210967a095943d9b7c5fab0ae2d9f31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e210967a095943d9b7c5fab0ae2d9f31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e210967a095943d9b7c5fab0ae2d9f31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesActionsTest-1593050785 Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e210967a095943d9b7c5fab0ae2d9f31 Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesActionsTest-1593050785 Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesActionsTest-1593050785-project Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: cad43f1f50e3413c9630929e534d5493 Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesActionsTest-1593050785-project Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 71a1fc3d-c12a-410a-b478-f0c2be382b66 could not be found. Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '71a1fc3d-c12a-410a-b478-f0c2be382b66'} Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a1fc3d-c12a-410a-b478-f0c2be382b66 could not be found. Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a1fc3d-c12a-410a-b478-f0c2be382b66 could not be found. Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:49.197968 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.202524 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:49.202524 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:49.202524 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:49.202524 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:49.202524 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:49.202524 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a1fc3d-c12a-410a-b478-f0c2be382b66 could not be found. Jul 20 04:24:49.202524 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.205034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4a7e9d70-b879-4e62-89d2-b21d2bd32078 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] Returning 404 to user: Instance 71a1fc3d-c12a-410a-b478-f0c2be382b66 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:49.206577 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4a7e9d70-b879-4e62-89d2-b21d2bd32078 tempest-VolumesActionsTest-1593050785 tempest-VolumesActionsTest-1593050785-project] 10.222.0.59 "GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66" status: 404 len: 111 microversion: 2.1 time: 0.060788 Jul 20 04:24:49.207506 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1856/3739] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:49 2022] GET /compute/v2.1/servers/71a1fc3d-c12a-410a-b478-f0c2be382b66 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:49.223621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-15aa293a-caa6-4646-aa00-569a62b13732 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:49.225879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-15aa293a-caa6-4646-aa00-569a62b13732 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:49.236272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15aa293a-caa6-4646-aa00-569a62b13732 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.236830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15aa293a-caa6-4646-aa00-569a62b13732 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.239345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15aa293a-caa6-4646-aa00-569a62b13732 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.240054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15aa293a-caa6-4646-aa00-569a62b13732 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.429144 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f1d3931-0fb4-4c35-8716-5b493333fcfa tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "POST /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.520071 Jul 20 04:24:49.459572 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1884/3740] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:24:48 2022] POST /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:24:49.574351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-361c939a-ff6c-4263-ab24-0c868da86a3f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841109310>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:49.647800 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-361c939a-ff6c-4263-ab24-0c868da86a3f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.078444 Jul 20 04:24:49.649253 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1885/3741] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:49 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:49.681017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c93c8e51-fa6f-40cb-897b-7d54097e2cd9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:49.681912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c93c8e51-fa6f-40cb-897b-7d54097e2cd9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:49.694858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c93c8e51-fa6f-40cb-897b-7d54097e2cd9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.695152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c93c8e51-fa6f-40cb-897b-7d54097e2cd9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.699677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c93c8e51-fa6f-40cb-897b-7d54097e2cd9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.700249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c93c8e51-fa6f-40cb-897b-7d54097e2cd9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.730701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-15aa293a-caa6-4646-aa00-569a62b13732 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:49.743407 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-15aa293a-caa6-4646-aa00-569a62b13732 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1529 microversion: 2.1 time: 0.534399 Jul 20 04:24:49.744540 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1857/3742] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:49 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1529 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:49.762594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-08e1976a-e57d-4057-97e0-f865e9665794 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Action: 'update', calling method: >, body: {"server": {"name": "cc896523-9272-4327-a80d-b9c91ba15866_new"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:49.763767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-08e1976a-e57d-4057-97e0-f865e9665794 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:49.778737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08e1976a-e57d-4057-97e0-f865e9665794 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.779421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08e1976a-e57d-4057-97e0-f865e9665794 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.781551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08e1976a-e57d-4057-97e0-f865e9665794 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.782388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08e1976a-e57d-4057-97e0-f865e9665794 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.817919 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-08e1976a-e57d-4057-97e0-f865e9665794 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] HTTP exception thrown: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-08e1976a-e57d-4057-97e0-f865e9665794 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Request method failure captured: Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: request: PUT /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 HTTP/1.1 Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 64 Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14N9Af7JTdNm952l_geFm7Q0rbgVjzyVfkv632PkzcQgU6nYZIiTRPhbCjQKKHIEMu9G9RvF2oA_GYmZtwwIgoe0yN4VMqzIjaJyY6eGce3kFbEbjsztH9AmaLvljRbW9UPrAYbaVWJgdMcTW_9pDWCKQcrjE7EJCFBXFfh1E3WGezg Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 7d5bf986204d452dbb29a2b082997b22 Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1288967368 Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7d5bf986204d452dbb29a2b082997b22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7d5bf986204d452dbb29a2b082997b22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7d5bf986204d452dbb29a2b082997b22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7d5bf986204d452dbb29a2b082997b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1288967368 Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 7d5bf986204d452dbb29a2b082997b22 Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1288967368 Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1288967368-project Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: c107c991e0464478a8b66d4a190c12e5 Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1288967368-project Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "cc896523-9272-4327-a80d-b9c91ba15866_new"}} Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'cc896523-9272-4327-a80d-b9c91ba15866', 'body': {'server': {'name': 'cc896523-9272-4327-a80d-b9c91ba15866_new'}}} Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:24:49.823802 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:49.827369 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:49.829011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-08e1976a-e57d-4057-97e0-f865e9665794 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] Returning 404 to user: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:49.830062 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-08e1976a-e57d-4057-97e0-f865e9665794 tempest-ServersNegativeTestMultiTenantJSON-1288967368 tempest-ServersNegativeTestMultiTenantJSON-1288967368-project] 10.222.0.59 "PUT /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 404 len: 111 microversion: 2.1 time: 0.071471 Jul 20 04:24:49.831232 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1858/3743] 10.222.0.59 () {60 vars in 1255 bytes} [Wed Jul 20 04:24:49 2022] PUT /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:49.843911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2659cc54-777b-420e-9391-bd22df0a4224 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:49.846709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2659cc54-777b-420e-9391-bd22df0a4224 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:49.866816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2659cc54-777b-420e-9391-bd22df0a4224 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.867843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2659cc54-777b-420e-9391-bd22df0a4224 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.869126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2659cc54-777b-420e-9391-bd22df0a4224 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.869748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2659cc54-777b-420e-9391-bd22df0a4224 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.924128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2659cc54-777b-420e-9391-bd22df0a4224 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:49.931987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:50.103743 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2659cc54-777b-420e-9391-bd22df0a4224 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 204 len: 0 microversion: 2.1 time: 0.266546 Jul 20 04:24:50.105115 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1859/3744] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:49 2022] DELETE /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:50.113815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ef90e5e-8093-4f7b-bbe8-3fe4f92ad8f9 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:50.114535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ef90e5e-8093-4f7b-bbe8-3fe4f92ad8f9 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:50.134675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ef90e5e-8093-4f7b-bbe8-3fe4f92ad8f9 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.135054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ef90e5e-8093-4f7b-bbe8-3fe4f92ad8f9 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.135864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ef90e5e-8093-4f7b-bbe8-3fe4f92ad8f9 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.137853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ef90e5e-8093-4f7b-bbe8-3fe4f92ad8f9 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.262950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c93c8e51-fa6f-40cb-897b-7d54097e2cd9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:50.273413 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c93c8e51-fa6f-40cb-897b-7d54097e2cd9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1522 microversion: 2.1 time: 0.596874 Jul 20 04:24:50.279290 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1886/3745] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:49 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1522 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:50.298209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-15f134d3-2b3f-4b93-b676-fb916510f92a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:50.299025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-15f134d3-2b3f-4b93-b676-fb916510f92a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:50.318001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f134d3-2b3f-4b93-b676-fb916510f92a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.319745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f134d3-2b3f-4b93-b676-fb916510f92a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.322666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f134d3-2b3f-4b93-b676-fb916510f92a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.324760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f134d3-2b3f-4b93-b676-fb916510f92a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.424486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-15f134d3-2b3f-4b93-b676-fb916510f92a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:50.465519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ef90e5e-8093-4f7b-bbe8-3fe4f92ad8f9 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:50.478822 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ef90e5e-8093-4f7b-bbe8-3fe4f92ad8f9 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1535 microversion: 2.1 time: 0.367167 Jul 20 04:24:50.488990 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1860/3746] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:50 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1535 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:50.550587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c67f16de-cd00-4973-bbb6-a20a90d50049 req-c6bf8e99-7ecd-4684-9c9e-3a03fa3a41bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21563660-c2fb-4770-a9d1-83dd296394cd", "name": "network-vif-plugged", "status": "completed", "tag": "c8d3c0c2-42fb-4da8-9aa0-8fa9605c9fc0"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:50.576890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c67f16de-cd00-4973-bbb6-a20a90d50049 req-c6bf8e99-7ecd-4684-9c9e-3a03fa3a41bd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.580393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c67f16de-cd00-4973-bbb6-a20a90d50049 req-c6bf8e99-7ecd-4684-9c9e-3a03fa3a41bd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.662728 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c67f16de-cd00-4973-bbb6-a20a90d50049 req-c6bf8e99-7ecd-4684-9c9e-3a03fa3a41bd service nova] Creating event network-vif-plugged:c8d3c0c2-42fb-4da8-9aa0-8fa9605c9fc0 for instance 21563660-c2fb-4770-a9d1-83dd296394cd on n-h2-760456-11 Jul 20 04:24:50.682088 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-15f134d3-2b3f-4b93-b676-fb916510f92a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "DELETE /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 204 len: 0 microversion: 2.1 time: 0.389770 Jul 20 04:24:50.684029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1887/3747] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:50 2022] DELETE /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:50.686342 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c67f16de-cd00-4973-bbb6-a20a90d50049 req-c6bf8e99-7ecd-4684-9c9e-3a03fa3a41bd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139858 Jul 20 04:24:50.690361 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1861/3748] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:24:50.698926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c56ac91d-03d3-46c7-b821-1ddeb5598afd tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840f9b670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:50.706324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2705baeb-9824-411a-9a00-c211a6bcf113 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:50.707079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2705baeb-9824-411a-9a00-c211a6bcf113 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:50.739152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2705baeb-9824-411a-9a00-c211a6bcf113 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.739678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2705baeb-9824-411a-9a00-c211a6bcf113 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.740484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2705baeb-9824-411a-9a00-c211a6bcf113 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.740922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2705baeb-9824-411a-9a00-c211a6bcf113 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.805534 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c56ac91d-03d3-46c7-b821-1ddeb5598afd tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.119940 Jul 20 04:24:50.806995 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1888/3749] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:50 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:51.321622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2705baeb-9824-411a-9a00-c211a6bcf113 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:51.344264 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2705baeb-9824-411a-9a00-c211a6bcf113 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1528 microversion: 2.1 time: 0.643590 Jul 20 04:24:51.345330 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1862/3750] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:50 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1528 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:51.498097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-920eafd0-f198-4411-96d8-eb6f7151ca7a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:51.499190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-920eafd0-f198-4411-96d8-eb6f7151ca7a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:51.554540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-920eafd0-f198-4411-96d8-eb6f7151ca7a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.555249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-920eafd0-f198-4411-96d8-eb6f7151ca7a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.556236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-920eafd0-f198-4411-96d8-eb6f7151ca7a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.559069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-920eafd0-f198-4411-96d8-eb6f7151ca7a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.831411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b2325452-b5fc-4c21-a661-918515cebf5f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841b6c160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:51.932876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b2325452-b5fc-4c21-a661-918515cebf5f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.114376 Jul 20 04:24:51.933523 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1863/3751] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:51 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:52.371461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ccd393da-d276-498a-a049-e4f158352ae3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:52.372435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ccd393da-d276-498a-a049-e4f158352ae3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:52.401795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccd393da-d276-498a-a049-e4f158352ae3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.406217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccd393da-d276-498a-a049-e4f158352ae3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.411146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccd393da-d276-498a-a049-e4f158352ae3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.414302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccd393da-d276-498a-a049-e4f158352ae3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.103914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ccd393da-d276-498a-a049-e4f158352ae3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:53.120703 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ccd393da-d276-498a-a049-e4f158352ae3 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1528 microversion: 2.1 time: 0.757260 Jul 20 04:24:53.129447 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1864/3752] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:52 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1528 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:53.147406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2546c563-ae45-4062-a110-a22831c43039 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8413343a0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:53.294774 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2546c563-ae45-4062-a110-a22831c43039 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.162184 Jul 20 04:24:53.295792 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1865/3753] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:53 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:53.307296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1a41fd9d-aa8b-4b61-917a-553e65fd4095 req-0f8f2cdb-ef42-4149-976c-c93fc710a392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc896523-9272-4327-a80d-b9c91ba15866", "name": "network-vif-deleted", "tag": "5906bc06-8f17-4252-996e-da32b94ded1d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:53.317235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1a41fd9d-aa8b-4b61-917a-553e65fd4095 req-0f8f2cdb-ef42-4149-976c-c93fc710a392 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:53.318034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1a41fd9d-aa8b-4b61-917a-553e65fd4095 req-0f8f2cdb-ef42-4149-976c-c93fc710a392 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:53.331842 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1a41fd9d-aa8b-4b61-917a-553e65fd4095 req-0f8f2cdb-ef42-4149-976c-c93fc710a392 service nova] Creating event network-vif-deleted:5906bc06-8f17-4252-996e-da32b94ded1d for instance cc896523-9272-4327-a80d-b9c91ba15866 on n-h2-760456-11 Jul 20 04:24:53.340052 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1a41fd9d-aa8b-4b61-917a-553e65fd4095 req-0f8f2cdb-ef42-4149-976c-c93fc710a392 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037180 Jul 20 04:24:53.341853 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1866/3754] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:53.792778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-920eafd0-f198-4411-96d8-eb6f7151ca7a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0443fe5ef60743b2b039f600e6cd3c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907cfda59e2841da99f8c2c74c2a2ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:53.811813 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-920eafd0-f198-4411-96d8-eb6f7151ca7a tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 200 len: 1535 microversion: 2.1 time: 2.318673 Jul 20 04:24:53.837237 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1889/3755] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:51 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 1535 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:54.145953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10f56c52-a8a8-4d7f-829f-848cbe79b86c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:54.152056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10f56c52-a8a8-4d7f-829f-848cbe79b86c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:54.184716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10f56c52-a8a8-4d7f-829f-848cbe79b86c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.189014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10f56c52-a8a8-4d7f-829f-848cbe79b86c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.196845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10f56c52-a8a8-4d7f-829f-848cbe79b86c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.197921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10f56c52-a8a8-4d7f-829f-848cbe79b86c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.319594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd52a701-08bb-4625-a919-1fabc7dea3a2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84111fe50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:54.657561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10f56c52-a8a8-4d7f-829f-848cbe79b86c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:54.671546 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10f56c52-a8a8-4d7f-829f-848cbe79b86c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1528 microversion: 2.1 time: 0.530257 Jul 20 04:24:54.674103 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1867/3756] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:54 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1528 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:54.680352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-80755a2c-4366-4071-9676-a3b3ff143a2f req-78a9da1d-e1e2-46cb-b1d1-28f2efc115f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d8f875-4cc0-4603-abbc-d795d2c2ef0f", "name": "network-vif-deleted", "tag": "8c804f89-0ed7-4455-801c-64507e891221"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:54.717936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-80755a2c-4366-4071-9676-a3b3ff143a2f req-78a9da1d-e1e2-46cb-b1d1-28f2efc115f3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.718652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-80755a2c-4366-4071-9676-a3b3ff143a2f req-78a9da1d-e1e2-46cb-b1d1-28f2efc115f3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.762239 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-80755a2c-4366-4071-9676-a3b3ff143a2f req-78a9da1d-e1e2-46cb-b1d1-28f2efc115f3 service nova] Creating event network-vif-deleted:8c804f89-0ed7-4455-801c-64507e891221 for instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f on n-h1-760456-11 Jul 20 04:24:54.770168 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-80755a2c-4366-4071-9676-a3b3ff143a2f req-78a9da1d-e1e2-46cb-b1d1-28f2efc115f3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094453 Jul 20 04:24:54.771117 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1868/3757] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:54.832668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc518426-9116-4035-957e-142cde6a2652 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:54.833611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cc518426-9116-4035-957e-142cde6a2652 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] [instance: cc896523-9272-4327-a80d-b9c91ba15866] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:54.849385 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd52a701-08bb-4625-a919-1fabc7dea3a2 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.542528 Jul 20 04:24:54.855818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc518426-9116-4035-957e-142cde6a2652 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.857706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc518426-9116-4035-957e-142cde6a2652 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.858728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc518426-9116-4035-957e-142cde6a2652 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.860509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc518426-9116-4035-957e-142cde6a2652 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.862614 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1890/3758] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:54 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:54.944858 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-cc518426-9116-4035-957e-142cde6a2652 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] HTTP exception thrown: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc518426-9116-4035-957e-142cde6a2652 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Request method failure captured: Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 HTTP/1.1 Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14NrssFIiysYlMfwkP0_W0l01ATLsfVYRAHN_lrd102Q1_YPTV7k-CfWKIlocg9SrCz0cA7-6yTLNm_Y5rqiG7AoqArLR7uA1PSO5PMOTR04wfK6DrukdpkeUFcLWcQ6nV77zLBzdIFws-WFgoT_DEHS0bHIgYQGMmeaxPkCzYtSRyM Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 907cfda59e2841da99f8c2c74c2a2ed2 Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-834934170 Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/907cfda59e2841da99f8c2c74c2a2ed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/907cfda59e2841da99f8c2c74c2a2ed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/907cfda59e2841da99f8c2c74c2a2ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_907cfda59e2841da99f8c2c74c2a2ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-834934170 Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 907cfda59e2841da99f8c2c74c2a2ed2 Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-834934170 Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestMultiTenantJSON-834934170-project Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 0443fe5ef60743b2b039f600e6cd3c61 Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-834934170-project Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'cc896523-9272-4327-a80d-b9c91ba15866'} Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:54.948980 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:54.953870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:54.953870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:54.953870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:54.953870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:54.953870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:54.953870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:54.953870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. Jul 20 04:24:54.953870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:24:54.955529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc518426-9116-4035-957e-142cde6a2652 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] Returning 404 to user: Instance cc896523-9272-4327-a80d-b9c91ba15866 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:54.958017 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cc518426-9116-4035-957e-142cde6a2652 tempest-ServersNegativeTestMultiTenantJSON-834934170 tempest-ServersNegativeTestMultiTenantJSON-834934170-project] 10.222.0.59 "GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866" status: 404 len: 111 microversion: 2.1 time: 0.129614 Jul 20 04:24:54.961085 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1869/3759] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:54 2022] GET /compute/v2.1/servers/cc896523-9272-4327-a80d-b9c91ba15866 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:24:55.698167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:55.698947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:55.702722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:55.727969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:55.733469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:55.735099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:55.735938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:55.860768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:55.864564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:55.866106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-21a66148-d9d6-419f-b856-72daa67a44d1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841270790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:55.867146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lazy-loading 'fault' on Instance uuid 02d8f875-4cc0-4603-abbc-d795d2c2ef0f {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:56.001895 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-21a66148-d9d6-419f-b856-72daa67a44d1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.138633 Jul 20 04:24:56.003102 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1870/3760] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:55 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:56.029768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:56.043834 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c9cf805a-aa66-43b8-af5d-72be2405dda2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 200 len: 1315 microversion: 2.1 time: 0.346897 Jul 20 04:24:56.048152 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1891/3761] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:55 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:57.016678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c18049c2-dfff-4a93-87ee-bd6cbf7c30fa tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bc3a0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:57.066970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db3aaca1-deaf-44a4-bf1f-cacc5bec6a8d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:57.067692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-db3aaca1-deaf-44a4-bf1f-cacc5bec6a8d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:57.107730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db3aaca1-deaf-44a4-bf1f-cacc5bec6a8d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:57.108291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db3aaca1-deaf-44a4-bf1f-cacc5bec6a8d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:57.112969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db3aaca1-deaf-44a4-bf1f-cacc5bec6a8d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:57.119232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db3aaca1-deaf-44a4-bf1f-cacc5bec6a8d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:57.167529 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c18049c2-dfff-4a93-87ee-bd6cbf7c30fa tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.155432 Jul 20 04:24:57.173474 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1871/3762] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:57 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:57.200493 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-db3aaca1-deaf-44a4-bf1f-cacc5bec6a8d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db3aaca1-deaf-44a4-bf1f-cacc5bec6a8d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f HTTP/1.1 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '02d8f875-4cc0-4603-abbc-d795d2c2ef0f'} Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:57.202883 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:57.206173 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:57.206173 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:57.206173 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:57.206173 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:57.206173 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:57.206173 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:57.206173 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:24:57.206173 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:24:57.212221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db3aaca1-deaf-44a4-bf1f-cacc5bec6a8d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 404 to user: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:57.217371 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-db3aaca1-deaf-44a4-bf1f-cacc5bec6a8d tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 404 len: 111 microversion: 2.1 time: 0.154800 Jul 20 04:24:57.221229 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1892/3763] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:57 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:57.449105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1145979458", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:57.827765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] validate_networks() for [('a6502162-a528-4ba5-89a1-8e5c89b95706', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:58.182224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cad9d968-f4f6-4a80-928a-5f3c9c96b188 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84105f820>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:58.268179 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cad9d968-f4f6-4a80-928a-5f3c9c96b188 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.090762 Jul 20 04:24:58.274278 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1893/3764] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:58 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:59.283261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f4493db7-bed7-40ef-beb5-90961311e407 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb842230ca0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:59.380121 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f4493db7-bed7-40ef-beb5-90961311e407 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.102368 Jul 20 04:24:59.386988 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1894/3765] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:59 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:24:59.706269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:59.707355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:59.707977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:59.708527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:59.709676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:59.736901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:59.740664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:59.745572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:59.747388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:59.796395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Getting quotas for project 6e0df1f7215e4150975085ea1c52bf23. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:59.812543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Getting quotas for user 2093470c6f894ad9a5b0fb5fc1fe87f4 and project 6e0df1f7215e4150975085ea1c52bf23. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:59.856536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:59.878757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:00.077243 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bbb1a5fe-6b31-4f33-815d-cf383fafecdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.629536 Jul 20 04:25:00.080002 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1872/3766] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:25:00.092651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b6ef6d1-bdf6-41c8-8504-47fcb52f7da5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:00.093637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b6ef6d1-bdf6-41c8-8504-47fcb52f7da5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:00.397456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d6c632ea-bb26-4271-8438-e676f7fa6550 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841242310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:00.494173 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d6c632ea-bb26-4271-8438-e676f7fa6550 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.103108 Jul 20 04:25:00.494916 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1873/3767] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:00 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:00.655689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b6ef6d1-bdf6-41c8-8504-47fcb52f7da5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:00.669331 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b6ef6d1-bdf6-41c8-8504-47fcb52f7da5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1225 microversion: 2.1 time: 0.581321 Jul 20 04:25:00.673248 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1895/3768] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:00 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1225 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:01.512929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26ce0437-df97-43b7-b997-54ddd7b00c3b tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841258d30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:01.660435 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-26ce0437-df97-43b7-b997-54ddd7b00c3b tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.152714 Jul 20 04:25:01.663150 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1874/3769] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:01 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:01.691796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d034b3bc-55c5-42aa-b13a-1765a20e4e23 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:01.692301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d034b3bc-55c5-42aa-b13a-1765a20e4e23 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:01.715246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d034b3bc-55c5-42aa-b13a-1765a20e4e23 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.718093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d034b3bc-55c5-42aa-b13a-1765a20e4e23 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.725791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d034b3bc-55c5-42aa-b13a-1765a20e4e23 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.726693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d034b3bc-55c5-42aa-b13a-1765a20e4e23 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.986305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d034b3bc-55c5-42aa-b13a-1765a20e4e23 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:01.996847 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d034b3bc-55c5-42aa-b13a-1765a20e4e23 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1221 microversion: 2.1 time: 0.309529 Jul 20 04:25:02.014231 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1896/3770] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:01 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1221 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:02.676118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1a15d211-f7a2-428c-a3fa-e215c3eb5f40 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412423a0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:02.792347 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1a15d211-f7a2-428c-a3fa-e215c3eb5f40 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.120404 Jul 20 04:25:02.793607 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1875/3771] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:02 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:03.031797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-03809c85-07a9-4d6d-bba5-d73d7f2a65b0 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:03.035176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-03809c85-07a9-4d6d-bba5-d73d7f2a65b0 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:03.059610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03809c85-07a9-4d6d-bba5-d73d7f2a65b0 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.066610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03809c85-07a9-4d6d-bba5-d73d7f2a65b0 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.067678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03809c85-07a9-4d6d-bba5-d73d7f2a65b0 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.068214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03809c85-07a9-4d6d-bba5-d73d7f2a65b0 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.564553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-03809c85-07a9-4d6d-bba5-d73d7f2a65b0 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:03.585410 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-03809c85-07a9-4d6d-bba5-d73d7f2a65b0 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1283 microversion: 2.1 time: 0.568415 Jul 20 04:25:03.586015 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1897/3772] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:03 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1283 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:03.809992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d9ff62e-08af-440c-9e10-670881ca4f15 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841219ca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:03.941902 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7d9ff62e-08af-440c-9e10-670881ca4f15 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.137183 Jul 20 04:25:03.959771 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1876/3773] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:03 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:04.603870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-75eccbed-b8bb-4a78-868c-da7c5ec03ede tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:04.604566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-75eccbed-b8bb-4a78-868c-da7c5ec03ede tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:04.615340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75eccbed-b8bb-4a78-868c-da7c5ec03ede tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.617081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75eccbed-b8bb-4a78-868c-da7c5ec03ede tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.618706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75eccbed-b8bb-4a78-868c-da7c5ec03ede tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.619337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75eccbed-b8bb-4a78-868c-da7c5ec03ede tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.888206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-75eccbed-b8bb-4a78-868c-da7c5ec03ede tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:04.915168 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-75eccbed-b8bb-4a78-868c-da7c5ec03ede tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1283 microversion: 2.1 time: 0.310735 Jul 20 04:25:04.916627 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1898/3774] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:04 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1283 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:04.975472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ef47891-c1fe-4888-b4f1-e0400d4556de tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841261af0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:05.110152 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ef47891-c1fe-4888-b4f1-e0400d4556de tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.141162 Jul 20 04:25:05.111910 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1877/3775] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:04 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:05.933679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-248b4068-834c-46c0-a43d-f9d5c143feea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:05.935167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-248b4068-834c-46c0-a43d-f9d5c143feea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:05.961985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-248b4068-834c-46c0-a43d-f9d5c143feea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:05.962800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-248b4068-834c-46c0-a43d-f9d5c143feea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:05.964091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-248b4068-834c-46c0-a43d-f9d5c143feea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:05.965027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-248b4068-834c-46c0-a43d-f9d5c143feea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.126313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a60e990d-5c45-4a5a-9440-8a484ebe0d44 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8411ffaf0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:06.281219 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a60e990d-5c45-4a5a-9440-8a484ebe0d44 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.160177 Jul 20 04:25:06.282718 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1878/3776] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:06 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:06.760286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-248b4068-834c-46c0-a43d-f9d5c143feea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:06.786687 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-248b4068-834c-46c0-a43d-f9d5c143feea tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1325 microversion: 2.1 time: 0.843086 Jul 20 04:25:06.788882 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1899/3777] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:05 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1325 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:07.294994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6945b1b3-d867-4793-a37a-77ffb18e63aa tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841242790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:07.470462 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6945b1b3-d867-4793-a37a-77ffb18e63aa tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.165555 Jul 20 04:25:07.474885 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1879/3778] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:07 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:07.806704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4ee975b1-39e7-49ef-9f98-170ee138b1c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:07.807999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4ee975b1-39e7-49ef-9f98-170ee138b1c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:07.861547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ee975b1-39e7-49ef-9f98-170ee138b1c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.877705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ee975b1-39e7-49ef-9f98-170ee138b1c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.891352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ee975b1-39e7-49ef-9f98-170ee138b1c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:07.891924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ee975b1-39e7-49ef-9f98-170ee138b1c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.912342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:08.485761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2c9eee30-65ed-4111-8559-6c546e2c49ee tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84120a940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:08.582143 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2c9eee30-65ed-4111-8559-6c546e2c49ee tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.101779 Jul 20 04:25:08.583149 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1880/3779] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:08 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:09.179629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5590498d-bfd3-406e-8166-7d39563354a6 req-f46b247f-056c-4124-9440-71c43f977e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0054196-263d-4a09-9301-f72f9652aec3", "tag": "bf20c2be-df87-4549-8664-fe43bc7a9163"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:09.221038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5590498d-bfd3-406e-8166-7d39563354a6 req-f46b247f-056c-4124-9440-71c43f977e92 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.221533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5590498d-bfd3-406e-8166-7d39563354a6 req-f46b247f-056c-4124-9440-71c43f977e92 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.295271 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5590498d-bfd3-406e-8166-7d39563354a6 req-f46b247f-056c-4124-9440-71c43f977e92 service nova] Creating event network-changed:bf20c2be-df87-4549-8664-fe43bc7a9163 for instance e0054196-263d-4a09-9301-f72f9652aec3 on n-h1-760456-11 Jul 20 04:25:09.318878 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5590498d-bfd3-406e-8166-7d39563354a6 req-f46b247f-056c-4124-9440-71c43f977e92 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143657 Jul 20 04:25:09.324966 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1881/3780] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:09.590905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-53e8130d-b349-4ca9-9460-cce326136375 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:09.591974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-53e8130d-b349-4ca9-9460-cce326136375 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:09.635873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53e8130d-b349-4ca9-9460-cce326136375 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.647502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53e8130d-b349-4ca9-9460-cce326136375 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.653832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53e8130d-b349-4ca9-9460-cce326136375 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.654364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53e8130d-b349-4ca9-9460-cce326136375 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.763170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4ee975b1-39e7-49ef-9f98-170ee138b1c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:09.779971 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4ee975b1-39e7-49ef-9f98-170ee138b1c9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1325 microversion: 2.1 time: 1.978243 Jul 20 04:25:09.780594 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1900/3781] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:07 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1325 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:09.799266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:09.813887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fe331bd9-48b4-4d37-b172-144489c67271 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840f1b820>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:09.842615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:09.869140 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-53e8130d-b349-4ca9-9460-cce326136375 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.284492 Jul 20 04:25:09.875679 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1882/3782] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:25:09 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments => generated 371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:09.951680 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fe331bd9-48b4-4d37-b172-144489c67271 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.169891 Jul 20 04:25:09.952575 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1901/3783] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:09 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:10.024654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b2a88c11-717d-4a5f-af3a-ba0345dee3ca tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:10.025079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b2a88c11-717d-4a5f-af3a-ba0345dee3ca tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:10.041718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2a88c11-717d-4a5f-af3a-ba0345dee3ca tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.047242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2a88c11-717d-4a5f-af3a-ba0345dee3ca tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.049785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2a88c11-717d-4a5f-af3a-ba0345dee3ca tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.054872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2a88c11-717d-4a5f-af3a-ba0345dee3ca tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.206713 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b2a88c11-717d-4a5f-af3a-ba0345dee3ca tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments/c2bc2b85-d5ac-4363-b688-29879cb3b86e" status: 200 len: 194 microversion: 2.1 time: 0.187261 Jul 20 04:25:10.210365 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1883/3784] 10.222.0.59 () {58 vars in 1412 bytes} [Wed Jul 20 04:25:10 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments/c2bc2b85-d5ac-4363-b688-29879cb3b86e => generated 194 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:10.220435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ca073b5-7dc6-4735-a48a-f9473fd27a42 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:10.221192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ca073b5-7dc6-4735-a48a-f9473fd27a42 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:10.248573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ca073b5-7dc6-4735-a48a-f9473fd27a42 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.256935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ca073b5-7dc6-4735-a48a-f9473fd27a42 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.258083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ca073b5-7dc6-4735-a48a-f9473fd27a42 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.262148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ca073b5-7dc6-4735-a48a-f9473fd27a42 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.667557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:10.683625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-9ca073b5-7dc6-4735-a48a-f9473fd27a42 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lazy-loading 'services' on Instance uuid c0b8484b-3078-4fc9-923d-e72a9aa94a9b {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:25:10.798393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dd43146f-0173-4d8b-93b4-86407e2e5afa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:10.799030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dd43146f-0173-4d8b-93b4-86407e2e5afa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:10.812949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd43146f-0173-4d8b-93b4-86407e2e5afa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.829168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd43146f-0173-4d8b-93b4-86407e2e5afa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.830198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd43146f-0173-4d8b-93b4-86407e2e5afa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:10.834604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd43146f-0173-4d8b-93b4-86407e2e5afa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:10.956479 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ca073b5-7dc6-4735-a48a-f9473fd27a42 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments/c2bc2b85-d5ac-4363-b688-29879cb3b86e" status: 202 len: 0 microversion: 2.1 time: 0.740190 Jul 20 04:25:10.966738 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1902/3785] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:25:10 2022] DELETE /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments/c2bc2b85-d5ac-4363-b688-29879cb3b86e => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:25:10.997374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c2375aa9-b3c4-4e9e-97d8-134061d27eca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841a96e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:11.165933 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c2375aa9-b3c4-4e9e-97d8-134061d27eca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.197166 Jul 20 04:25:11.166594 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1903/3786] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:10 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:11.506973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dd43146f-0173-4d8b-93b4-86407e2e5afa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:11.517929 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dd43146f-0173-4d8b-93b4-86407e2e5afa tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1325 microversion: 2.1 time: 0.724631 Jul 20 04:25:11.523990 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1884/3787] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:10 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1325 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:12.197990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f62dc0d1-c6a2-4911-82cd-afd1e0caa778 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841a96a60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:12.327262 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f62dc0d1-c6a2-4911-82cd-afd1e0caa778 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.134005 Jul 20 04:25:12.327766 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1904/3788] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:12 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:12.544810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f2752cf-3b55-456d-911a-2cfff809d68e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:12.546022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f2752cf-3b55-456d-911a-2cfff809d68e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:12.558382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f2752cf-3b55-456d-911a-2cfff809d68e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.559879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f2752cf-3b55-456d-911a-2cfff809d68e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.563497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f2752cf-3b55-456d-911a-2cfff809d68e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:12.564126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f2752cf-3b55-456d-911a-2cfff809d68e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:13.341730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb2cba1e-e0bb-441e-abeb-3dde66e6c7f6 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841aa0e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:13.460947 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb2cba1e-e0bb-441e-abeb-3dde66e6c7f6 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.123721 Jul 20 04:25:13.464574 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1905/3789] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:13 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:13.655588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f2752cf-3b55-456d-911a-2cfff809d68e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:13.668575 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f2752cf-3b55-456d-911a-2cfff809d68e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1325 microversion: 2.1 time: 1.127137 Jul 20 04:25:13.675519 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1885/3790] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:12 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1325 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:14.478219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ec998ff8-8f32-4ba2-978d-7660b366e946 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8410c40d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:14.561223 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ec998ff8-8f32-4ba2-978d-7660b366e946 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.087787 Jul 20 04:25:14.562145 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1906/3791] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:14 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:14.694275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1c4a8b8e-2247-455b-ad45-c4f7387c80b2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:14.696533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1c4a8b8e-2247-455b-ad45-c4f7387c80b2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:14.728781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c4a8b8e-2247-455b-ad45-c4f7387c80b2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.729413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c4a8b8e-2247-455b-ad45-c4f7387c80b2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.730279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c4a8b8e-2247-455b-ad45-c4f7387c80b2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.737135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c4a8b8e-2247-455b-ad45-c4f7387c80b2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:15.576613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c55c1483-de48-440c-a562-b3b177b7ce47 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841b715e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:15.695431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c55c1483-de48-440c-a562-b3b177b7ce47 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.123806 Jul 20 04:25:15.696281 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1907/3792] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:15 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:15.910686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1c4a8b8e-2247-455b-ad45-c4f7387c80b2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:15.921981 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1c4a8b8e-2247-455b-ad45-c4f7387c80b2 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1325 microversion: 2.1 time: 1.233791 Jul 20 04:25:15.929704 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1886/3793] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:14 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1325 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:16.711541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-032fd632-8b2c-4786-a0eb-bbcb906da419 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8410f1c10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:16.900677 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-032fd632-8b2c-4786-a0eb-bbcb906da419 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.196455 Jul 20 04:25:16.906077 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1908/3794] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:16 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:16.947120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-afb0f9a7-115e-4a83-ace6-a3df4961955c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:16.949335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-afb0f9a7-115e-4a83-ace6-a3df4961955c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:16.983632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afb0f9a7-115e-4a83-ace6-a3df4961955c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.987128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afb0f9a7-115e-4a83-ace6-a3df4961955c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:16.991048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afb0f9a7-115e-4a83-ace6-a3df4961955c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.991593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afb0f9a7-115e-4a83-ace6-a3df4961955c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:17.917904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-99a1547f-f8f2-4be0-80d5-41516b2e7ff0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841b71160>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:18.030527 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-99a1547f-f8f2-4be0-80d5-41516b2e7ff0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.119140 Jul 20 04:25:18.032310 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1909/3795] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:17 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:19.054680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4e3151ed-0f53-4b83-b989-e39902c4d43b tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841a71280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:19.190369 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4e3151ed-0f53-4b83-b989-e39902c4d43b tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.143187 Jul 20 04:25:19.191594 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1910/3796] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:19 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:19.592373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-afb0f9a7-115e-4a83-ace6-a3df4961955c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:19.609453 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-afb0f9a7-115e-4a83-ace6-a3df4961955c tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1325 microversion: 2.1 time: 2.668900 Jul 20 04:25:19.614144 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1887/3797] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:16 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1325 bytes in 2676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:19.794584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-028b1aa2-1005-4cce-af5e-08d1515014ff req-7827ed79-ea0d-42c5-ac0e-4c646101971d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0054196-263d-4a09-9301-f72f9652aec3", "name": "network-vif-plugged", "status": "completed", "tag": "bf20c2be-df87-4549-8664-fe43bc7a9163"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:19.807501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-028b1aa2-1005-4cce-af5e-08d1515014ff req-7827ed79-ea0d-42c5-ac0e-4c646101971d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:19.807871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-028b1aa2-1005-4cce-af5e-08d1515014ff req-7827ed79-ea0d-42c5-ac0e-4c646101971d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:19.887154 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-028b1aa2-1005-4cce-af5e-08d1515014ff req-7827ed79-ea0d-42c5-ac0e-4c646101971d service nova] Creating event network-vif-plugged:bf20c2be-df87-4549-8664-fe43bc7a9163 for instance e0054196-263d-4a09-9301-f72f9652aec3 on n-h1-760456-11 Jul 20 04:25:19.899805 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-028b1aa2-1005-4cce-af5e-08d1515014ff req-7827ed79-ea0d-42c5-ac0e-4c646101971d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109124 Jul 20 04:25:19.900469 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1911/3798] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:20.208570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-810f8a50-b59a-4f8e-97ab-fd2035f1e09a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841251f70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:20.321367 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-810f8a50-b59a-4f8e-97ab-fd2035f1e09a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.121311 Jul 20 04:25:20.336215 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1888/3799] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:20 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:20.507470 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:25:20.508514 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 04:25:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:25:20.633012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-64f6b958-85d3-462f-8642-257bf217ed19 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:20.633741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-64f6b958-85d3-462f-8642-257bf217ed19 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:20.650088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f6b958-85d3-462f-8642-257bf217ed19 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:20.659847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f6b958-85d3-462f-8642-257bf217ed19 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:20.663471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f6b958-85d3-462f-8642-257bf217ed19 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:20.677676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f6b958-85d3-462f-8642-257bf217ed19 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.336283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-990b295f-0c56-4c15-9bbd-bc2bb9ad7a50 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841bebdc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:21.439721 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-990b295f-0c56-4c15-9bbd-bc2bb9ad7a50 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.109360 Jul 20 04:25:21.442919 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1889/3800] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:21 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:22.229418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-64f6b958-85d3-462f-8642-257bf217ed19 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:22.239300 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-64f6b958-85d3-462f-8642-257bf217ed19 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1325 microversion: 2.1 time: 1.611919 Jul 20 04:25:22.244822 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1912/3801] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:20 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1325 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:22.456581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7aea6993-0ed7-410e-92fc-6e5ffebb918f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841200f70>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:22.570811 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7aea6993-0ed7-410e-92fc-6e5ffebb918f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.118585 Jul 20 04:25:22.579429 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1890/3802] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:22 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:23.261287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30b019c2-340b-4e05-b62a-2d151872f00a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:23.261908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-30b019c2-340b-4e05-b62a-2d151872f00a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:23.278195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30b019c2-340b-4e05-b62a-2d151872f00a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.287989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30b019c2-340b-4e05-b62a-2d151872f00a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.289176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30b019c2-340b-4e05-b62a-2d151872f00a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:23.290370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30b019c2-340b-4e05-b62a-2d151872f00a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:23.587307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0199c535-8907-4857-af76-ee2a96e1dd21 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841274e50>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:23.612545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-30b019c2-340b-4e05-b62a-2d151872f00a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:23.625024 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-30b019c2-340b-4e05-b62a-2d151872f00a tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1325 microversion: 2.1 time: 0.367593 Jul 20 04:25:23.628299 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1913/3803] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:23 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1325 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:23.691285 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0199c535-8907-4857-af76-ee2a96e1dd21 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.107748 Jul 20 04:25:23.692140 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1891/3804] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:23 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:24.044846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-14848543-b9d4-40c7-830e-f0c2952c36b2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:24.045359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-14848543-b9d4-40c7-830e-f0c2952c36b2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:24.058646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14848543-b9d4-40c7-830e-f0c2952c36b2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.059181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14848543-b9d4-40c7-830e-f0c2952c36b2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.060016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14848543-b9d4-40c7-830e-f0c2952c36b2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.060471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14848543-b9d4-40c7-830e-f0c2952c36b2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.190120 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-14848543-b9d4-40c7-830e-f0c2952c36b2 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments/b028798b-b954-4583-afe2-8078ffeef907" status: 200 len: 194 microversion: 2.1 time: 0.149213 Jul 20 04:25:24.190789 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1914/3805] 10.222.0.59 () {58 vars in 1412 bytes} [Wed Jul 20 04:25:24 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments/b028798b-b954-4583-afe2-8078ffeef907 => generated 194 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:24.201535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aedfb570-75fc-4805-9c53-7d6508291766 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:24.202440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aedfb570-75fc-4805-9c53-7d6508291766 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:24.204370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:24.221790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aedfb570-75fc-4805-9c53-7d6508291766 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.231644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aedfb570-75fc-4805-9c53-7d6508291766 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.232848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aedfb570-75fc-4805-9c53-7d6508291766 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.233444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aedfb570-75fc-4805-9c53-7d6508291766 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.326726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:24.486515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-aedfb570-75fc-4805-9c53-7d6508291766 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lazy-loading 'services' on Instance uuid c0b8484b-3078-4fc9-923d-e72a9aa94a9b {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:25:24.646022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dedc228a-c878-4323-a0fb-4fe8bf55de17 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:24.647521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dedc228a-c878-4323-a0fb-4fe8bf55de17 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:24.647973 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aedfb570-75fc-4805-9c53-7d6508291766 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments/b028798b-b954-4583-afe2-8078ffeef907" status: 202 len: 0 microversion: 2.1 time: 0.450282 Jul 20 04:25:24.648904 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1892/3806] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:25:24 2022] DELETE /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments/b028798b-b954-4583-afe2-8078ffeef907 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:25:24.680136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dedc228a-c878-4323-a0fb-4fe8bf55de17 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.684732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dedc228a-c878-4323-a0fb-4fe8bf55de17 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.687054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dedc228a-c878-4323-a0fb-4fe8bf55de17 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:24.689849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dedc228a-c878-4323-a0fb-4fe8bf55de17 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:24.710414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8cfe930c-27e2-4c2a-8dad-a53b951a1f0c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841261550>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:24.871467 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8cfe930c-27e2-4c2a-8dad-a53b951a1f0c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1451 microversion: 2.1 time: 0.169432 Jul 20 04:25:24.872222 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1893/3807] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:24 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:25.242054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dedc228a-c878-4323-a0fb-4fe8bf55de17 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:25.250647 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dedc228a-c878-4323-a0fb-4fe8bf55de17 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1522 microversion: 2.1 time: 0.609404 Jul 20 04:25:25.252327 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1915/3808] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:24 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:25.276928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9a0c7c72-b69a-4ff0-a2ec-e31314c0fbdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:25.276928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9a0c7c72-b69a-4ff0-a2ec-e31314c0fbdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:25.283152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a0c7c72-b69a-4ff0-a2ec-e31314c0fbdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:25.284067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a0c7c72-b69a-4ff0-a2ec-e31314c0fbdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:25.287149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a0c7c72-b69a-4ff0-a2ec-e31314c0fbdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:25.288136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a0c7c72-b69a-4ff0-a2ec-e31314c0fbdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:25.357062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9a0c7c72-b69a-4ff0-a2ec-e31314c0fbdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:25:25.550964 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9a0c7c72-b69a-4ff0-a2ec-e31314c0fbdf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 204 len: 0 microversion: 2.1 time: 0.281165 Jul 20 04:25:25.552638 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1894/3809] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:25 2022] DELETE /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:25.563049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cece9487-7c39-4afc-9a5d-b616a8aa1a42 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:25.563732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cece9487-7c39-4afc-9a5d-b616a8aa1a42 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:25.578279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cece9487-7c39-4afc-9a5d-b616a8aa1a42 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:25.578658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cece9487-7c39-4afc-9a5d-b616a8aa1a42 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:25.582784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cece9487-7c39-4afc-9a5d-b616a8aa1a42 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:25.583927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cece9487-7c39-4afc-9a5d-b616a8aa1a42 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:25.883525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cece9487-7c39-4afc-9a5d-b616a8aa1a42 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:25.890218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d44ef7ab-0d4c-43d6-926a-5d07ff606479 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84120ad30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:25.906748 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cece9487-7c39-4afc-9a5d-b616a8aa1a42 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1528 microversion: 2.1 time: 0.348990 Jul 20 04:25:25.909331 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1916/3810] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:25 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1528 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:25.974553 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d44ef7ab-0d4c-43d6-926a-5d07ff606479 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1460 microversion: 2.1 time: 0.086138 Jul 20 04:25:25.976543 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1895/3811] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:25 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1460 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:25:25.992011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-eabcb522-8622-4312-bc30-23dcbfe47d23 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840e1a4c0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:26.071918 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-eabcb522-8622-4312-bc30-23dcbfe47d23 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 200 len: 1460 microversion: 2.1 time: 0.086403 Jul 20 04:25:26.079558 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1917/3812] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:25 2022] GET /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 1460 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:26.091777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c31bdeb9-2aa9-4f2c-be8c-c0f75dcbb6ca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:26.092732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c31bdeb9-2aa9-4f2c-be8c-c0f75dcbb6ca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:26.101514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c31bdeb9-2aa9-4f2c-be8c-c0f75dcbb6ca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.103462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c31bdeb9-2aa9-4f2c-be8c-c0f75dcbb6ca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.104695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c31bdeb9-2aa9-4f2c-be8c-c0f75dcbb6ca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.108215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c31bdeb9-2aa9-4f2c-be8c-c0f75dcbb6ca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.480126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c31bdeb9-2aa9-4f2c-be8c-c0f75dcbb6ca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:26.490609 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c31bdeb9-2aa9-4f2c-be8c-c0f75dcbb6ca tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1468 microversion: 2.1 time: 0.402869 Jul 20 04:25:26.504021 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1896/3813] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:26 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1468 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:26.508680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7a9c504f-99d9-4ee3-a705-29546e00c774 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-762728904"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:26.509804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7a9c504f-99d9-4ee3-a705-29546e00c774 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:26.512352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=34 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:26.529743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a9c504f-99d9-4ee3-a705-29546e00c774 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.534330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a9c504f-99d9-4ee3-a705-29546e00c774 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.537097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a9c504f-99d9-4ee3-a705-29546e00c774 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.537561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a9c504f-99d9-4ee3-a705-29546e00c774 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.926217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-23e37a5e-63af-4ecf-865d-1ecdecdcfb6e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:26.927652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-23e37a5e-63af-4ecf-865d-1ecdecdcfb6e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:26.941249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23e37a5e-63af-4ecf-865d-1ecdecdcfb6e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.941784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23e37a5e-63af-4ecf-865d-1ecdecdcfb6e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:26.943229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23e37a5e-63af-4ecf-865d-1ecdecdcfb6e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:26.944226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23e37a5e-63af-4ecf-865d-1ecdecdcfb6e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:27.199663 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7a9c504f-99d9-4ee3-a705-29546e00c774 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "POST /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f/action" status: 202 len: 0 microversion: 2.1 time: 0.695199 Jul 20 04:25:27.200360 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1918/3814] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:26 2022] POST /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 20 04:25:27.221062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-642cdd72-48ce-47b1-ba79-8d8e22af91c1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb842230ca0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:27.315394 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-642cdd72-48ce-47b1-ba79-8d8e22af91c1 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.107530 Jul 20 04:25:27.316316 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1919/3815] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:27 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:28.300904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-23e37a5e-63af-4ecf-865d-1ecdecdcfb6e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:28.310200 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-23e37a5e-63af-4ecf-865d-1ecdecdcfb6e tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1528 microversion: 2.1 time: 1.389149 Jul 20 04:25:28.310815 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1897/3816] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:26 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1528 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:28.329966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6e21519c-4191-4d52-b4c2-3143425d0acb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841b71f70>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:28.431914 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6e21519c-4191-4d52-b4c2-3143425d0acb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.106908 Jul 20 04:25:28.436105 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1920/3817] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:28 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:28.604565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-25d7ed22-7a33-46d2-976a-ccc03e7c3f7c req-1332e2ea-0e78-4761-aef7-cfca370c7bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0054196-263d-4a09-9301-f72f9652aec3", "name": "network-vif-deleted", "tag": "bf20c2be-df87-4549-8664-fe43bc7a9163"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:28.631211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-25d7ed22-7a33-46d2-976a-ccc03e7c3f7c req-1332e2ea-0e78-4761-aef7-cfca370c7bef service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:28.631698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-25d7ed22-7a33-46d2-976a-ccc03e7c3f7c req-1332e2ea-0e78-4761-aef7-cfca370c7bef service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:28.680775 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-25d7ed22-7a33-46d2-976a-ccc03e7c3f7c req-1332e2ea-0e78-4761-aef7-cfca370c7bef service nova] Creating event network-vif-deleted:bf20c2be-df87-4549-8664-fe43bc7a9163 for instance e0054196-263d-4a09-9301-f72f9652aec3 on n-h1-760456-11 Jul 20 04:25:28.702541 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-25d7ed22-7a33-46d2-976a-ccc03e7c3f7c req-1332e2ea-0e78-4761-aef7-cfca370c7bef service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102293 Jul 20 04:25:28.710147 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1898/3818] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:29.328648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:29.330210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:29.387234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.390756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.394770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.400879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.452164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0018e692-2f9a-4716-b39e-a6c70f83c365 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84120ae50>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:29.564175 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0018e692-2f9a-4716-b39e-a6c70f83c365 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.118829 Jul 20 04:25:29.565738 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1899/3819] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:29 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:29.577091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.577793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.578451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lazy-loading 'fault' on Instance uuid e0054196-263d-4a09-9301-f72f9652aec3 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:25:29.842606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ea9c3f53-78c8-4ed8-9fa6-91e81afc247e req-f523ced1-339a-43a1-a629-defb6fafaf85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21563660-c2fb-4770-a9d1-83dd296394cd", "name": "network-vif-unplugged", "status": "completed", "tag": "c8d3c0c2-42fb-4da8-9aa0-8fa9605c9fc0"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:29.867261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ea9c3f53-78c8-4ed8-9fa6-91e81afc247e req-f523ced1-339a-43a1-a629-defb6fafaf85 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:29.867722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ea9c3f53-78c8-4ed8-9fa6-91e81afc247e req-f523ced1-339a-43a1-a629-defb6fafaf85 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:29.903234 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ea9c3f53-78c8-4ed8-9fa6-91e81afc247e req-f523ced1-339a-43a1-a629-defb6fafaf85 service nova] Creating event network-vif-unplugged:c8d3c0c2-42fb-4da8-9aa0-8fa9605c9fc0 for instance 21563660-c2fb-4770-a9d1-83dd296394cd on n-h2-760456-11 Jul 20 04:25:29.922440 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ea9c3f53-78c8-4ed8-9fa6-91e81afc247e req-f523ced1-339a-43a1-a629-defb6fafaf85 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072793 Jul 20 04:25:29.931086 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1900/3820] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:30.088230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2093470c6f894ad9a5b0fb5fc1fe87f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e0df1f7215e4150975085ea1c52bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:30.098020 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fbf6a830-c413-4142-b51e-0346947cd333 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 200 len: 1315 microversion: 2.1 time: 0.773518 Jul 20 04:25:30.100331 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1921/3821] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:29 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:30.579668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4617bf38-420b-499a-8286-b6550461ad4e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bcaf0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:30.707617 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4617bf38-420b-499a-8286-b6550461ad4e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.132740 Jul 20 04:25:30.714354 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1901/3822] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:30 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:31.117939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e50839f-f4b2-4a93-8ca5-c86cb2509aeb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:31.119296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3e50839f-f4b2-4a93-8ca5-c86cb2509aeb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: e0054196-263d-4a09-9301-f72f9652aec3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:31.133195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e50839f-f4b2-4a93-8ca5-c86cb2509aeb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.133655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e50839f-f4b2-4a93-8ca5-c86cb2509aeb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.135134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e50839f-f4b2-4a93-8ca5-c86cb2509aeb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.137061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3e50839f-f4b2-4a93-8ca5-c86cb2509aeb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.165950 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3e50839f-f4b2-4a93-8ca5-c86cb2509aeb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Instance e0054196-263d-4a09-9301-f72f9652aec3 could not be found. Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e50839f-f4b2-4a93-8ca5-c86cb2509aeb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 HTTP/1.1 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance e0054196-263d-4a09-9301-f72f9652aec3 could not be found. Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'e0054196-263d-4a09-9301-f72f9652aec3'} Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0054196-263d-4a09-9301-f72f9652aec3 could not be found. Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0054196-263d-4a09-9301-f72f9652aec3 could not be found. Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.168375 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:31.172133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.172133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.172133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:31.172133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:31.172133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:31.172133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:31.172133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0054196-263d-4a09-9301-f72f9652aec3 could not be found. Jul 20 04:25:31.172133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.176015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e50839f-f4b2-4a93-8ca5-c86cb2509aeb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 404 to user: Instance e0054196-263d-4a09-9301-f72f9652aec3 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:31.179166 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3e50839f-f4b2-4a93-8ca5-c86cb2509aeb tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3" status: 404 len: 111 microversion: 2.1 time: 0.066219 Jul 20 04:25:31.180251 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1922/3823] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:31 2022] GET /compute/v2.1/servers/e0054196-263d-4a09-9301-f72f9652aec3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:31.189756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-816fca64-15bd-456e-ad4b-6572bee28e1f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '.version_select at 0x7fb841270c10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:31.230012 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-816fca64-15bd-456e-ad4b-6572bee28e1f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Image not found. Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-816fca64-15bd-456e-ad4b-6572bee28e1f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/images/366c956e-7960-49ed-8a33-f997dfaaffd1 HTTP/1.1 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '366c956e-7960-49ed-8a33-f997dfaaffd1'} Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 366c956e-7960-49ed-8a33-f997dfaaffd1 to delete Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 366c956e-7960-49ed-8a33-f997dfaaffd1 could not be found. Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:31.232110 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-816fca64-15bd-456e-ad4b-6572bee28e1f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:31.235617 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-816fca64-15bd-456e-ad4b-6572bee28e1f tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "DELETE /compute/v2.1/images/366c956e-7960-49ed-8a33-f997dfaaffd1" status: 404 len: 62 microversion: 2.1 time: 0.049757 Jul 20 04:25:31.237083 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1902/3824] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:31 2022] DELETE /compute/v2.1/images/366c956e-7960-49ed-8a33-f997dfaaffd1 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:25:31.244971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e4a61f0-f9a2-4579-8687-87a7f60175b9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:31.245782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e4a61f0-f9a2-4579-8687-87a7f60175b9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:31.257810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e4a61f0-f9a2-4579-8687-87a7f60175b9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.259903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e4a61f0-f9a2-4579-8687-87a7f60175b9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.262111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e4a61f0-f9a2-4579-8687-87a7f60175b9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.264251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e4a61f0-f9a2-4579-8687-87a7f60175b9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.303326 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-2e4a61f0-f9a2-4579-8687-87a7f60175b9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e4a61f0-f9a2-4579-8687-87a7f60175b9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f HTTP/1.1 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '02d8f875-4cc0-4603-abbc-d795d2c2ef0f'} Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:31.308573 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.311878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e4a61f0-f9a2-4579-8687-87a7f60175b9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 404 to user: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:31.314288 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e4a61f0-f9a2-4579-8687-87a7f60175b9 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "DELETE /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 404 len: 111 microversion: 2.1 time: 0.073530 Jul 20 04:25:31.315757 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1923/3825] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:31 2022] DELETE /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:31.327744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-18493e25-61aa-496c-bf04-69a5c540f1c5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:31.330224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-18493e25-61aa-496c-bf04-69a5c540f1c5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 02d8f875-4cc0-4603-abbc-d795d2c2ef0f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:31.358381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18493e25-61aa-496c-bf04-69a5c540f1c5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.359272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18493e25-61aa-496c-bf04-69a5c540f1c5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.361180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18493e25-61aa-496c-bf04-69a5c540f1c5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:31.361804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18493e25-61aa-496c-bf04-69a5c540f1c5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:31.391980 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-18493e25-61aa-496c-bf04-69a5c540f1c5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-18493e25-61aa-496c-bf04-69a5c540f1c5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f HTTP/1.1 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '02d8f875-4cc0-4603-abbc-d795d2c2ef0f'} Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.394096 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:31.397943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.397943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:31.397943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:31.397943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:31.397943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:31.397943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:31.397943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. Jul 20 04:25:31.397943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:31.404033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-18493e25-61aa-496c-bf04-69a5c540f1c5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 404 to user: Instance 02d8f875-4cc0-4603-abbc-d795d2c2ef0f could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:31.406413 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-18493e25-61aa-496c-bf04-69a5c540f1c5 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f" status: 404 len: 111 microversion: 2.1 time: 0.085901 Jul 20 04:25:31.408697 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1903/3826] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:31 2022] GET /compute/v2.1/servers/02d8f875-4cc0-4603-abbc-d795d2c2ef0f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:31.419535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9a10df8-c016-4051-abb2-28f8c0f80336 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '.version_select at 0x7fb841109dc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:31.448715 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c9a10df8-c016-4051-abb2-28f8c0f80336 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544982760" status: 202 len: 0 microversion: 2.1 time: 0.032503 Jul 20 04:25:31.450781 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1924/3827] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:25:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544982760 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:25:31.727653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b2cea90-f72a-47ad-a466-a6240b33f4ce tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412704c0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:31.856986 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b2cea90-f72a-47ad-a466-a6240b33f4ce tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.133334 Jul 20 04:25:31.859692 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1904/3828] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:31 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:32.874658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3aaf9072-91e4-4c89-8d90-4ec355fa3f68 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8410f35e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:32.971069 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3aaf9072-91e4-4c89-8d90-4ec355fa3f68 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.102367 Jul 20 04:25:32.980811 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1925/3829] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:32 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:33.294621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2cb9026f-9f75-4f46-aa78-6fa4df87e0a6 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '.version_select at 0x7fb8412bca60>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:33.344166 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-2cb9026f-9f75-4f46-aa78-6fa4df87e0a6 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Image not found. Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2cb9026f-9f75-4f46-aa78-6fa4df87e0a6 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/images/89bc1563-cc57-4dce-bb60-938fff2e529e HTTP/1.1 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: exception: Image not found. Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '89bc1563-cc57-4dce-bb60-938fff2e529e'} Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 89bc1563-cc57-4dce-bb60-938fff2e529e to delete Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 89bc1563-cc57-4dce-bb60-938fff2e529e could not be found. Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:33.345934 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:25:33.350796 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.353068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2cb9026f-9f75-4f46-aa78-6fa4df87e0a6 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 404 to user: Image not found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:33.354889 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2cb9026f-9f75-4f46-aa78-6fa4df87e0a6 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "DELETE /compute/v2.1/images/89bc1563-cc57-4dce-bb60-938fff2e529e" status: 404 len: 62 microversion: 2.1 time: 0.065464 Jul 20 04:25:33.357176 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1905/3830] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:33 2022] DELETE /compute/v2.1/images/89bc1563-cc57-4dce-bb60-938fff2e529e => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:25:33.366420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9fe98f3-22db-4817-bfd3-1044ad7aadbf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:33.367162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9fe98f3-22db-4817-bfd3-1044ad7aadbf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:33.386578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9fe98f3-22db-4817-bfd3-1044ad7aadbf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:33.393287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9fe98f3-22db-4817-bfd3-1044ad7aadbf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:33.396995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9fe98f3-22db-4817-bfd3-1044ad7aadbf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:33.402527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9fe98f3-22db-4817-bfd3-1044ad7aadbf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:33.469427 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-b9fe98f3-22db-4817-bfd3-1044ad7aadbf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9fe98f3-22db-4817-bfd3-1044ad7aadbf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 HTTP/1.1 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '75de7cb5-82d8-4004-817f-cbd784128119'} Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:33.471131 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.476072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9fe98f3-22db-4817-bfd3-1044ad7aadbf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 404 to user: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:33.484254 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9fe98f3-22db-4817-bfd3-1044ad7aadbf tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "DELETE /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 404 len: 111 microversion: 2.1 time: 0.113235 Jul 20 04:25:33.488095 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1926/3831] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:33 2022] DELETE /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:33.496830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9d8d449-2d0e-42fd-92d3-8ae4ff4e31c8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:33.497692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c9d8d449-2d0e-42fd-92d3-8ae4ff4e31c8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] [instance: 75de7cb5-82d8-4004-817f-cbd784128119] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:33.522023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9d8d449-2d0e-42fd-92d3-8ae4ff4e31c8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:33.522567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9d8d449-2d0e-42fd-92d3-8ae4ff4e31c8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:33.523405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9d8d449-2d0e-42fd-92d3-8ae4ff4e31c8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:33.523844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9d8d449-2d0e-42fd-92d3-8ae4ff4e31c8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:33.565441 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c9d8d449-2d0e-42fd-92d3-8ae4ff4e31c8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] HTTP exception thrown: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9d8d449-2d0e-42fd-92d3-8ae4ff4e31c8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Request method failure captured: Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 HTTP/1.1 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14NEW82VqxF7QoEYuMdeT01_qi6GfGf-sNQKnwWPzw0H8_XrCoaWj4yKu5nNTasSXV8GSmv7zZp0TQwO6-E3uM90BB0C_jQK5ORNbt68VjnhD53p4xnQJT1J1-s2Qf0kRONWnBLCjxNbVS8h4kbGV9QAXz1CJXCWLKYyHCB4MOBHP-8 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6e0df1f7215e4150975085ea1c52bf23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 6e0df1f7215e4150975085ea1c52bf23 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-258260907 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2093470c6f894ad9a5b0fb5fc1fe87f4 Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-258260907-project Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '75de7cb5-82d8-4004-817f-cbd784128119'} Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.568723 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:33.572767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.572767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:33.572767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:33.572767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:33.572767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:33.572767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:33.572767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. Jul 20 04:25:33.572767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:33.574899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9d8d449-2d0e-42fd-92d3-8ae4ff4e31c8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] Returning 404 to user: Instance 75de7cb5-82d8-4004-817f-cbd784128119 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:33.576449 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c9d8d449-2d0e-42fd-92d3-8ae4ff4e31c8 tempest-ImagesOneServerNegativeTestJSON-258260907 tempest-ImagesOneServerNegativeTestJSON-258260907-project] 10.222.0.59 "GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119" status: 404 len: 111 microversion: 2.1 time: 0.083892 Jul 20 04:25:33.577793 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1906/3832] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:33 2022] GET /compute/v2.1/servers/75de7cb5-82d8-4004-817f-cbd784128119 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:33.984776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2b36583-df41-42d1-a91b-3daa7a5ed0f0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841111dc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:34.075814 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f2b36583-df41-42d1-a91b-3daa7a5ed0f0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.094669 Jul 20 04:25:34.076700 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1927/3833] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:33 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:35.094679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-42c92c74-7502-4d57-95be-0153d12474e9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841205280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:35.195643 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-42c92c74-7502-4d57-95be-0153d12474e9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.108957 Jul 20 04:25:35.197401 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1907/3834] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:35 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:36.021236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2da24176-76c1-47f4-bd5e-6d95093d7555 req-4e956228-20f5-41db-9b36-d4476d31f5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c46211-eaee-4f38-a690-65d710b5529f", "name": "network-vif-plugged", "status": "completed", "tag": "15789429-5cd8-4e37-95ed-801038c4a3ef"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:36.053684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2da24176-76c1-47f4-bd5e-6d95093d7555 req-4e956228-20f5-41db-9b36-d4476d31f5ea service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.055493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2da24176-76c1-47f4-bd5e-6d95093d7555 req-4e956228-20f5-41db-9b36-d4476d31f5ea service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.096981 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2da24176-76c1-47f4-bd5e-6d95093d7555 req-4e956228-20f5-41db-9b36-d4476d31f5ea service nova] Creating event network-vif-plugged:15789429-5cd8-4e37-95ed-801038c4a3ef for instance b9c46211-eaee-4f38-a690-65d710b5529f on n-h2-760456-11 Jul 20 04:25:36.118535 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2da24176-76c1-47f4-bd5e-6d95093d7555 req-4e956228-20f5-41db-9b36-d4476d31f5ea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111661 Jul 20 04:25:36.119778 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1928/3835] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:36.211290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73dedf7e-3df5-425a-887e-da43b05ae4a4 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bc040>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:36.310562 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-73dedf7e-3df5-425a-887e-da43b05ae4a4 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.105376 Jul 20 04:25:36.313854 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1908/3836] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:36 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:36.515906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-27a7aeed-75a2-4548-b06c-25a8f50e1b49 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:36.518234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-27a7aeed-75a2-4548-b06c-25a8f50e1b49 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:36.547099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27a7aeed-75a2-4548-b06c-25a8f50e1b49 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.548771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27a7aeed-75a2-4548-b06c-25a8f50e1b49 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.549647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27a7aeed-75a2-4548-b06c-25a8f50e1b49 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.550108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27a7aeed-75a2-4548-b06c-25a8f50e1b49 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.714479 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-27a7aeed-75a2-4548-b06c-25a8f50e1b49 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.204326 Jul 20 04:25:36.717944 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1929/3837] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:25:36 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments => generated 25 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:25:37.164028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f6c594a6-9c67-40c5-b71f-49148cd04000 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:37.164991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f6c594a6-9c67-40c5-b71f-49148cd04000 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:37.204386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6c594a6-9c67-40c5-b71f-49148cd04000 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.211013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6c594a6-9c67-40c5-b71f-49148cd04000 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.212110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6c594a6-9c67-40c5-b71f-49148cd04000 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.219010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6c594a6-9c67-40c5-b71f-49148cd04000 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.363507 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f6c594a6-9c67-40c5-b71f-49148cd04000 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.204261 Jul 20 04:25:37.368048 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1930/3838] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:25:37 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b/os-volume_attachments => generated 25 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:25:37.409779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50004dbe-1139-4ef1-b480-fa1b25268743 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841a71040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:37.564561 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-50004dbe-1139-4ef1-b480-fa1b25268743 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.176218 Jul 20 04:25:37.565760 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1931/3839] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:37 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:37.579391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cff82585-9510-489b-bc18-b9922688f50f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:37.580453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cff82585-9510-489b-bc18-b9922688f50f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:37.596146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cff82585-9510-489b-bc18-b9922688f50f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.598380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cff82585-9510-489b-bc18-b9922688f50f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.601236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cff82585-9510-489b-bc18-b9922688f50f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.602520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cff82585-9510-489b-bc18-b9922688f50f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.717355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-23fa81cb-9385-4ba4-9a5b-ab5e9a1f8a04 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664-project-admin] Calling method '.version_select at 0x7fb841288b80>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:37.718455 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:25:37.718455 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:25:37.720032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23fa81cb-9385-4ba4-9a5b-ab5e9a1f8a04 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.720595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23fa81cb-9385-4ba4-9a5b-ab5e9a1f8a04 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.725843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cff82585-9510-489b-bc18-b9922688f50f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:25:37.807868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23fa81cb-9385-4ba4-9a5b-ab5e9a1f8a04 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.810852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23fa81cb-9385-4ba4-9a5b-ab5e9a1f8a04 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.852017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:37.863612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23fa81cb-9385-4ba4-9a5b-ab5e9a1f8a04 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.865377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23fa81cb-9385-4ba4-9a5b-ab5e9a1f8a04 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.886526 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-23fa81cb-9385-4ba4-9a5b-ab5e9a1f8a04 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1196630664-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.050723 Jul 20 04:25:37.893687 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1909/3840] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:25:36 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:37.985319 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cff82585-9510-489b-bc18-b9922688f50f tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 204 len: 0 microversion: 2.1 time: 0.417579 Jul 20 04:25:37.994839 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1932/3841] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:37 2022] DELETE /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:37.996908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-41ba6697-97c2-441f-b4d5-221b58d3b15c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:37.998122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-41ba6697-97c2-441f-b4d5-221b58d3b15c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:38.010408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ba6697-97c2-441f-b4d5-221b58d3b15c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.011127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ba6697-97c2-441f-b4d5-221b58d3b15c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.015267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ba6697-97c2-441f-b4d5-221b58d3b15c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.015920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ba6697-97c2-441f-b4d5-221b58d3b15c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.579619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4c4aaa87-5713-4184-aa4b-25e31a9a27b0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841109280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:38.646865 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4c4aaa87-5713-4184-aa4b-25e31a9a27b0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.071407 Jul 20 04:25:38.649460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-41ba6697-97c2-441f-b4d5-221b58d3b15c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:38.658422 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-41ba6697-97c2-441f-b4d5-221b58d3b15c tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1673 microversion: 2.1 time: 0.667406 Jul 20 04:25:38.658860 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1933/3842] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:38 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:38.667068 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1910/3843] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:37 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1673 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:39.664932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1d2a830-3791-4873-a16c-2e472dbed3b9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8410c4e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:39.682199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45dff3b4-bec7-4f78-9cbc-b459d406a470 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:39.683457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-45dff3b4-bec7-4f78-9cbc-b459d406a470 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:39.694904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45dff3b4-bec7-4f78-9cbc-b459d406a470 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.704014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45dff3b4-bec7-4f78-9cbc-b459d406a470 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.708688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45dff3b4-bec7-4f78-9cbc-b459d406a470 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.713485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45dff3b4-bec7-4f78-9cbc-b459d406a470 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.753038 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1d2a830-3791-4873-a16c-2e472dbed3b9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.096822 Jul 20 04:25:39.756209 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1934/3844] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:39 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:40.774188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f94ad494-92de-4c71-b973-9698d613cb28 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840f6d4c0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:40.861501 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f94ad494-92de-4c71-b973-9698d613cb28 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.096206 Jul 20 04:25:40.868047 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1935/3845] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:40 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:41.488330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45dff3b4-bec7-4f78-9cbc-b459d406a470 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:41.506234 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-45dff3b4-bec7-4f78-9cbc-b459d406a470 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1673 microversion: 2.1 time: 1.828039 Jul 20 04:25:41.519970 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1911/3846] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:39 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1673 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:41.877250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ed160d6c-b204-46ec-9cba-b92d79c797fa tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841a71af0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:42.006076 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ed160d6c-b204-46ec-9cba-b92d79c797fa tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.127105 Jul 20 04:25:42.016002 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1936/3847] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:41 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:42.529786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-88bfd240-7120-4a02-aeff-f9f2292ad6e1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:42.531649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-88bfd240-7120-4a02-aeff-f9f2292ad6e1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:42.564156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88bfd240-7120-4a02-aeff-f9f2292ad6e1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.564502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88bfd240-7120-4a02-aeff-f9f2292ad6e1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.570000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88bfd240-7120-4a02-aeff-f9f2292ad6e1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.576301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88bfd240-7120-4a02-aeff-f9f2292ad6e1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.747837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-241fa196-8193-4a30-8f62-4068cf5eebd7 req-f3ddf67f-3101-4b15-922b-699c88ab8697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b8484b-3078-4fc9-923d-e72a9aa94a9b", "name": "network-vif-deleted", "tag": "67af8e46-651c-4cb7-8e70-c3a2946e9294"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:42.796210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-241fa196-8193-4a30-8f62-4068cf5eebd7 req-f3ddf67f-3101-4b15-922b-699c88ab8697 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.797306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-241fa196-8193-4a30-8f62-4068cf5eebd7 req-f3ddf67f-3101-4b15-922b-699c88ab8697 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.846852 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-241fa196-8193-4a30-8f62-4068cf5eebd7 req-f3ddf67f-3101-4b15-922b-699c88ab8697 service nova] Creating event network-vif-deleted:67af8e46-651c-4cb7-8e70-c3a2946e9294 for instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b on n-h2-760456-11 Jul 20 04:25:42.872913 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-241fa196-8193-4a30-8f62-4068cf5eebd7 req-f3ddf67f-3101-4b15-922b-699c88ab8697 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132471 Jul 20 04:25:42.878703 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1937/3848] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:42.975876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-88bfd240-7120-4a02-aeff-f9f2292ad6e1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b3a46906648cb82515704eadcdb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f8bfd8e5a34423848573c7caab8d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:42.997770 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-88bfd240-7120-4a02-aeff-f9f2292ad6e1 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 200 len: 1606 microversion: 2.1 time: 0.476249 Jul 20 04:25:43.006539 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1912/3849] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:42 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 1606 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:43.021248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a4b7b39-3060-46eb-9b21-bbff973404cb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841a71550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:43.140070 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3a4b7b39-3060-46eb-9b21-bbff973404cb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.123419 Jul 20 04:25:43.162701 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1938/3850] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:43 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:44.022655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-445f8e02-539d-4978-8ff4-ed71fceb43ad tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:44.022655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-445f8e02-539d-4978-8ff4-ed71fceb43ad tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:44.041931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-445f8e02-539d-4978-8ff4-ed71fceb43ad tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:44.042481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-445f8e02-539d-4978-8ff4-ed71fceb43ad tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:44.049291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-445f8e02-539d-4978-8ff4-ed71fceb43ad tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:44.050558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-445f8e02-539d-4978-8ff4-ed71fceb43ad tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:44.101358 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-445f8e02-539d-4978-8ff4-ed71fceb43ad tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] HTTP exception thrown: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-445f8e02-539d-4978-8ff4-ed71fceb43ad tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Request method failure captured: Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b HTTP/1.1 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14JCLPvINkU04kxoUxRW7wflXcVg8w0OdwOx6_eiLhJ--5w66kQ1BjwphaYOeNc4GtXTVkBcAOlU-RAChYLWEtRuFzGdlax5UqQKMNwmHV1DUFdjLjLC1KV7YgyzHSu4zEjnvY_9sUsWgs-gO2xF4h8DzchN0Q1OynJteACD9LyGQb4 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 337b3a46906648cb82515704eadcdb38 Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c0b8484b-3078-4fc9-923d-e72a9aa94a9b'} Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:44.115636 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.120294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:44.120294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:44.120294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:44.120294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:44.120294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:44.120294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:25:44.120294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.130170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-445f8e02-539d-4978-8ff4-ed71fceb43ad tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Returning 404 to user: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:44.131406 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-445f8e02-539d-4978-8ff4-ed71fceb43ad tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 404 len: 111 microversion: 2.1 time: 0.115661 Jul 20 04:25:44.132920 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1913/3851] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:44 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:44.142630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-34ea5e3a-4549-45ff-b131-16732c7f5da3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '.version_select at 0x7fb841b71940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:44.167655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0dff4a2c-a1f4-4a90-8a56-abf6d4851b30 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412705e0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:44.195486 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-34ea5e3a-4549-45ff-b131-16732c7f5da3 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1537175707" status: 202 len: 0 microversion: 2.1 time: 0.058275 Jul 20 04:25:44.200445 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1939/3852] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:25:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1537175707 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:25:44.236252 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0dff4a2c-a1f4-4a90-8a56-abf6d4851b30 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.081235 Jul 20 04:25:44.237597 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1914/3853] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:44 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:45.256472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ffd25e6a-7983-4da8-bc89-e2815f4fbf91 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840f6d0d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:45.361190 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ffd25e6a-7983-4da8-bc89-e2815f4fbf91 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.111088 Jul 20 04:25:45.362344 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1940/3854] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:45 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:46.376090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ad89bd76-92fb-4f95-ac0c-ee8fa680f988 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84122eca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:46.480765 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ad89bd76-92fb-4f95-ac0c-ee8fa680f988 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.109658 Jul 20 04:25:46.481605 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1915/3855] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:46 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:47.508439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5bd8e14a-8054-419a-8d9b-e50aead1c36f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841a963a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:47.616245 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5bd8e14a-8054-419a-8d9b-e50aead1c36f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.118836 Jul 20 04:25:47.616848 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1941/3856] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:47 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:48.643688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a41697f-f19f-4deb-ac5d-66ff50ebf003 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841251d30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:48.761108 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a41697f-f19f-4deb-ac5d-66ff50ebf003 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.134342 Jul 20 04:25:48.762343 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1916/3857] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:48 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:49.775738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-843cb30f-078d-4c5b-b90c-370118af5b28 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb840f6dca0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:49.876127 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-843cb30f-078d-4c5b-b90c-370118af5b28 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.104854 Jul 20 04:25:49.876779 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1942/3858] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:49 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:50.891097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d3237f1-73b6-49eb-877b-5f246d446d30 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841233790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:50.984957 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8d3237f1-73b6-49eb-877b-5f246d446d30 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.099247 Jul 20 04:25:50.985543 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1917/3859] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:50 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:51.999500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d9ede21-a69a-413d-99b0-4fff437ea354 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841201820>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.068277 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9d9ede21-a69a-413d-99b0-4fff437ea354 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.073092 Jul 20 04:25:52.074675 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1918/3860] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:51 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:52.345672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d131a8b0-6fc6-4d3f-a6e5-4dba1f407f22 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Action: 'create', calling method: .version_select at 0x7fb841b23160>, body: {"keypair": {"name": "tempest-keypair-1391323152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnhIWRbMH1j3GGO5lJeLe6+S/Uc3RUzLgCLvc0Sd6V9ivbzdtYAL3MosFSF+ANhcQziGTq1ul8+xBpGB5niM9ChgnB6VCBUoXPB9rUQR+SA3GVNa4IsJnrgc01eNJmnlQ=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:52.420444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d131a8b0-6fc6-4d3f-a6e5-4dba1f407f22 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:52.428766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d131a8b0-6fc6-4d3f-a6e5-4dba1f407f22 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for user 7ea2f5a220114c7a94b72189780a972f and project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:52.474030 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d131a8b0-6fc6-4d3f-a6e5-4dba1f407f22 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.835517 Jul 20 04:25:52.475660 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1943/3861] 10.222.0.59 () {62 vars in 1198 bytes} [Wed Jul 20 04:25:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 838 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:25:52.487150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e103a44b-2204-424f-bbc2-49939d535c32 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb841233700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.501050 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e103a44b-2204-424f-bbc2-49939d535c32 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs/tempest-keypair-1391323152" status: 200 len: 513 microversion: 2.2 time: 0.019552 Jul 20 04:25:52.502689 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1919/3862] 10.222.0.59 () {60 vars in 1257 bytes} [Wed Jul 20 04:25:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1391323152 => generated 513 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:52.513012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-84e71b15-e220-4caf-ab75-8423e6b0f296 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb841b239d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.554042 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-84e71b15-e220-4caf-ab75-8423e6b0f296 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391323152" status: 204 len: 0 microversion: 2.2 time: 0.045024 Jul 20 04:25:52.557403 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1944/3863] 10.222.0.59 () {60 vars in 1260 bytes} [Wed Jul 20 04:25:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391323152 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:52.577330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-426f8336-c7cd-4f28-9731-38d3aecc557c tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Action: 'create', calling method: .version_select at 0x7fb8411c3700>, body: {"keypair": {"name": "tempest-keypair-574158477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4ci1g0t9EB3PSoNYKBP+5jRu3afxzCimGFCNAui7u+5tigh91IOGWJoRyb1+rW0SJdyCO2/FtbVBfTRmF8SGCQR77JwMkz6AC99C0s5qzBmMutz4aW/JI4dungnYehJg=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:52.681351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-426f8336-c7cd-4f28-9731-38d3aecc557c tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:52.702810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-426f8336-c7cd-4f28-9731-38d3aecc557c tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for user 7ea2f5a220114c7a94b72189780a972f and project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:52.763709 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-426f8336-c7cd-4f28-9731-38d3aecc557c tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.196587 Jul 20 04:25:52.766289 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1920/3864] 10.222.0.59 () {62 vars in 1198 bytes} [Wed Jul 20 04:25:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 202 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:25:52.775248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b32ef3df-a936-41ed-bdd2-fe6510cffbec tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb841b71b80>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.814311 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b32ef3df-a936-41ed-bdd2-fe6510cffbec tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-574158477" status: 204 len: 0 microversion: 2.2 time: 0.043208 Jul 20 04:25:52.815915 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1945/3865] 10.222.0.59 () {60 vars in 1257 bytes} [Wed Jul 20 04:25:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-574158477 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:52.826084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-304791b9-4d2d-42e9-bac2-8554798bf998 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Action: 'create', calling method: .version_select at 0x7fb8411c3670>, body: {"keypair": {"name": "tempest-keypair-1621019037", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:52.855836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-304791b9-4d2d-42e9-bac2-8554798bf998 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:52.887378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-304791b9-4d2d-42e9-bac2-8554798bf998 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for user 7ea2f5a220114c7a94b72189780a972f and project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:52.977987 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-304791b9-4d2d-42e9-bac2-8554798bf998 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.156185 Jul 20 04:25:52.984354 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1921/3866] 10.222.0.59 () {62 vars in 1198 bytes} [Wed Jul 20 04:25:52 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:25:52.993840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-363cbedf-a288-4c97-9130-a703918af317 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb841a71940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.998163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=6,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:53.063615 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-363cbedf-a288-4c97-9130-a703918af317 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621019037" status: 204 len: 0 microversion: 2.2 time: 0.074148 Jul 20 04:25:53.066958 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1946/3867] 10.222.0.59 () {60 vars in 1260 bytes} [Wed Jul 20 04:25:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621019037 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:53.088388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9f09a200-fe51-40b5-b55d-0c968407f2f0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84121cca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.094110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6fcdafc-424e-4f3c-9aa7-c08f4526c141 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Action: 'create', calling method: .version_select at 0x7fb841b71790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-643740216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvx1n9xpdZ+ZzkJEUknp8Jf3D4nZB9ix4a84/61GeJSkPCxdkaiyRNo9/HzSLNH1rprNtVzEnPLZhfn/Rnju4s9dTulrpcS3+P1bRVEvGRMlEK6BDeR6Z31suCAOmd9pA=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:53.211598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-a6fcdafc-424e-4f3c-9aa7-c08f4526c141 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:53.217836 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9f09a200-fe51-40b5-b55d-0c968407f2f0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.140208 Jul 20 04:25:53.220067 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1922/3868] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:53 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:53.236739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-a6fcdafc-424e-4f3c-9aa7-c08f4526c141 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for user 7ea2f5a220114c7a94b72189780a972f and project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:53.287924 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6fcdafc-424e-4f3c-9aa7-c08f4526c141 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.202715 Jul 20 04:25:53.288436 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1947/3869] 10.222.0.59 () {62 vars in 1198 bytes} [Wed Jul 20 04:25:53 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 205 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:25:53.303686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3e0d0e9-25a5-4570-96c7-e42e13580cd8 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Action: 'create', calling method: .version_select at 0x7fb84121c1f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2117175116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeA2CU80qoGK5byMMYUMcCPL2gklR+BsE3m77svx5xvr2w68SPm33T3yk56cjT5CeIzKBKakkVpk8AnjIRInKIUjPHwrXHoq8DCwh7OdQ2RunNYLk0RL8bcRmAtbrOIAw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:53.358855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d3e0d0e9-25a5-4570-96c7-e42e13580cd8 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:53.385583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d3e0d0e9-25a5-4570-96c7-e42e13580cd8 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for user 7ea2f5a220114c7a94b72189780a972f and project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:53.433632 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d3e0d0e9-25a5-4570-96c7-e42e13580cd8 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.135700 Jul 20 04:25:53.436553 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1923/3870] 10.222.0.59 () {62 vars in 1198 bytes} [Wed Jul 20 04:25:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:25:53.448742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-af913b65-cd28-4bb2-8e08-c0a733f7b372 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Action: 'create', calling method: .version_select at 0x7fb841b52940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1605331440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsYpcnI6wEcyFyHIiFoiW6C2CVFu0PvAEqQ0ERtYKKkMG9lKok1J/F/tCpv1Hymx/Dzm0svIlObE9YLk+tQkXgAfmjWG+/qLfYYewDqbEurumoeABSBfoaNYJNlcdfCsA=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:53.496858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-af913b65-cd28-4bb2-8e08-c0a733f7b372 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:53.513113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-af913b65-cd28-4bb2-8e08-c0a733f7b372 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for user 7ea2f5a220114c7a94b72189780a972f and project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:53.581272 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-af913b65-cd28-4bb2-8e08-c0a733f7b372 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.136622 Jul 20 04:25:53.583427 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1948/3871] 10.222.0.59 () {62 vars in 1198 bytes} [Wed Jul 20 04:25:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:25:53.594352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01704b7a-40e9-4dcd-af63-7c1b936b2c4b tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb84121cd30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.598610 n-d-760456-11 devstack@n-api.service[119605]: WARNING oslo_db.sqlalchemy.utils [None req-01704b7a-40e9-4dcd-af63-7c1b936b2c4b tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:25:53.612030 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01704b7a-40e9-4dcd-af63-7c1b936b2c4b tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.022087 Jul 20 04:25:53.614697 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1924/3872] 10.222.0.59 () {60 vars in 1176 bytes} [Wed Jul 20 04:25:53 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:53.623487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f252aa01-6929-4db8-9c54-6ebef832c120 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb841b52d30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.653657 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f252aa01-6929-4db8-9c54-6ebef832c120 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1605331440" status: 204 len: 0 microversion: 2.2 time: 0.034177 Jul 20 04:25:53.657778 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1949/3873] 10.222.0.59 () {60 vars in 1320 bytes} [Wed Jul 20 04:25:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1605331440 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:53.666570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-67a97b28-c503-45b0-83ad-15196d548057 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb84122eca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.700176 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-67a97b28-c503-45b0-83ad-15196d548057 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2117175116" status: 204 len: 0 microversion: 2.2 time: 0.036849 Jul 20 04:25:53.703876 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1925/3874] 10.222.0.59 () {60 vars in 1320 bytes} [Wed Jul 20 04:25:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2117175116 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:53.713903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fd3afd34-952f-4e51-a059-aeb8d5e1242a tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb841b71ee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.744306 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fd3afd34-952f-4e51-a059-aeb8d5e1242a tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-643740216" status: 204 len: 0 microversion: 2.2 time: 0.034696 Jul 20 04:25:53.747726 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1950/3875] 10.222.0.59 () {60 vars in 1317 bytes} [Wed Jul 20 04:25:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-643740216 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:53.761129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2488f1b4-1865-45fe-8ac2-063af68f50c9 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Action: 'create', calling method: .version_select at 0x7fb8411c30d0>, body: {"keypair": {"name": "tempest-keypair-1784713378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIq+aEoXo0Z+Fv96phtwxtyV9+ynXhzK5Czu+aTogFUrrcU3QnUEbhkyWQlCGnxGAip4CpfYfpdQGTseVUuHp+QpTK0AgjfBwN9hdbxGfcw9BbDFeJtHzEtphayJmfqhOw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:53.793672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-2488f1b4-1865-45fe-8ac2-063af68f50c9 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:53.805061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-2488f1b4-1865-45fe-8ac2-063af68f50c9 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for user 7ea2f5a220114c7a94b72189780a972f and project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:53.868680 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2488f1b4-1865-45fe-8ac2-063af68f50c9 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.112962 Jul 20 04:25:53.869290 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1926/3876] 10.222.0.59 () {62 vars in 1198 bytes} [Wed Jul 20 04:25:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:25:53.883073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-891d9c14-8c18-405a-8f9d-db7952bf10eb tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb841d058b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.903279 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-891d9c14-8c18-405a-8f9d-db7952bf10eb tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs/tempest-keypair-1784713378" status: 200 len: 513 microversion: 2.2 time: 0.026921 Jul 20 04:25:53.904891 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1951/3877] 10.222.0.59 () {60 vars in 1257 bytes} [Wed Jul 20 04:25:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1784713378 => generated 513 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:25:53.916847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eaad53f7-9f57-49f7-8295-e8c19b310106 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb8411c38b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.919713 n-d-760456-11 devstack@n-api.service[119605]: WARNING oslo_db.sqlalchemy.utils [None req-eaad53f7-9f57-49f7-8295-e8c19b310106 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:25:53.936230 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eaad53f7-9f57-49f7-8295-e8c19b310106 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.023925 Jul 20 04:25:53.938274 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1927/3878] 10.222.0.59 () {60 vars in 1176 bytes} [Wed Jul 20 04:25:53 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:53.948924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cc1887e3-c061-473f-bd53-e419f8bbd23f tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb841cf15e0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.981636 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cc1887e3-c061-473f-bd53-e419f8bbd23f tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784713378" status: 204 len: 0 microversion: 2.2 time: 0.036547 Jul 20 04:25:53.988322 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1952/3879] 10.222.0.59 () {60 vars in 1260 bytes} [Wed Jul 20 04:25:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784713378 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:53.994670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4dc92679-96ae-4c2e-bddd-b911bd37df28 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Action: 'create', calling method: .version_select at 0x7fb841346790>, body: {"keypair": {"name": "tempest-keypair-1317632532", "type": "x509"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:54.028303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4dc92679-96ae-4c2e-bddd-b911bd37df28 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:54.045644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4dc92679-96ae-4c2e-bddd-b911bd37df28 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for user 7ea2f5a220114c7a94b72189780a972f and project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:54.066563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:54.105145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.processutils [None req-4dc92679-96ae-4c2e-bddd-b911bd37df28 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpl3fq28mj/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpl3fq28mj/temp.key -subj /CN=7ea2f5a220114c7a94b72189780a972f -extensions v3_req_client {{(pid=119605) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 20 04:25:54.159043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:54.235338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e3f3c2db-bafb-4494-8497-9fb8065d9aa9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841ca1670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:54.317810 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e3f3c2db-bafb-4494-8497-9fb8065d9aa9 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.088689 Jul 20 04:25:54.327831 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1953/3880] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:54 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:54.428708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.processutils [None req-4dc92679-96ae-4c2e-bddd-b911bd37df28 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpl3fq28mj/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpl3fq28mj/temp.key -subj /CN=7ea2f5a220114c7a94b72189780a972f -extensions v3_req_client" returned: 0 in 0.322s {{(pid=119605) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 20 04:25:54.431146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.processutils [None req-4dc92679-96ae-4c2e-bddd-b911bd37df28 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpl3fq28mj/temp.key -password pass: {{(pid=119605) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 20 04:25:54.510402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.processutils [None req-4dc92679-96ae-4c2e-bddd-b911bd37df28 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpl3fq28mj/temp.key -password pass:" returned: 0 in 0.079s {{(pid=119605) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 20 04:25:54.617850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4dc92679-96ae-4c2e-bddd-b911bd37df28 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:54.641309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4dc92679-96ae-4c2e-bddd-b911bd37df28 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Getting quotas for user 7ea2f5a220114c7a94b72189780a972f and project 5fdeb005562b487e8cea5ca9da88beef. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:54.686048 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4dc92679-96ae-4c2e-bddd-b911bd37df28 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.695335 Jul 20 04:25:54.687782 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1928/3881] 10.222.0.59 () {62 vars in 1197 bytes} [Wed Jul 20 04:25:53 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 698 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:54.698304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a2ce231-885e-49a9-9b3e-5a750eec0f5b tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb841c4e280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:54.720230 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a2ce231-885e-49a9-9b3e-5a750eec0f5b tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs/tempest-keypair-1317632532" status: 200 len: 1534 microversion: 2.2 time: 0.026270 Jul 20 04:25:54.721288 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1954/3882] 10.222.0.59 () {60 vars in 1257 bytes} [Wed Jul 20 04:25:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1317632532 => generated 1534 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:54.733612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-96b6f923-ed30-4145-8d07-ae26a63ddd72 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb84121cca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:54.741306 n-d-760456-11 devstack@n-api.service[119605]: WARNING oslo_db.sqlalchemy.utils [None req-96b6f923-ed30-4145-8d07-ae26a63ddd72 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:25:54.760140 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-96b6f923-ed30-4145-8d07-ae26a63ddd72 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.031382 Jul 20 04:25:54.762097 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1929/3883] 10.222.0.59 () {60 vars in 1176 bytes} [Wed Jul 20 04:25:54 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:54.773388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-df624919-e8bb-4681-bd1b-b4aea4782755 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] Calling method '.version_select at 0x7fb841b23670>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:54.797418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=8,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:54.828314 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-df624919-e8bb-4681-bd1b-b4aea4782755 tempest-KeyPairsV22TestJSON-13651129 tempest-KeyPairsV22TestJSON-13651129-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317632532" status: 204 len: 0 microversion: 2.2 time: 0.060173 Jul 20 04:25:54.834031 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1955/3884] 10.222.0.59 () {60 vars in 1260 bytes} [Wed Jul 20 04:25:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317632532 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:55.330955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1cc563e9-854d-4368-932a-7e83d3608a82 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8411c3940>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:55.424678 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1cc563e9-854d-4368-932a-7e83d3608a82 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.097677 Jul 20 04:25:55.425280 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1930/3885] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:55 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:56.440317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7a10dbd7-ae3d-4493-9e71-00f028be8aae tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841a961f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:56.572458 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7a10dbd7-ae3d-4493-9e71-00f028be8aae tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.133645 Jul 20 04:25:56.572458 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1956/3886] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:56 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:57.585159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8be06480-ce3c-4aac-8747-59c2637ea29f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84121cdc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:57.745558 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8be06480-ce3c-4aac-8747-59c2637ea29f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.166566 Jul 20 04:25:57.751499 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1931/3887] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:57 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:58.760719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3e482b1f-0628-43d7-97fd-0da8174aa574 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841c4e700>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:58.931183 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3e482b1f-0628-43d7-97fd-0da8174aa574 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.173953 Jul 20 04:25:58.931783 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1957/3888] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:58 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:59.948094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-330f494a-1c6b-4b72-8355-c318d04e3cff tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bcaf0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:00.062107 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-330f494a-1c6b-4b72-8355-c318d04e3cff tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1452 microversion: 2.1 time: 0.121593 Jul 20 04:26:00.064169 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1932/3889] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:59 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:01.077270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d5879598-8e90-45d9-a01d-14af490eaeb7 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841b23820>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:01.178806 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d5879598-8e90-45d9-a01d-14af490eaeb7 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1461 microversion: 2.1 time: 0.106249 Jul 20 04:26:01.182321 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1958/3890] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1461 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:01.194157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1a0d3ccf-3cdc-422a-96bc-8b7f9483f12e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8411c3280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:01.327364 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1a0d3ccf-3cdc-422a-96bc-8b7f9483f12e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 200 len: 1461 microversion: 2.1 time: 0.138410 Jul 20 04:26:01.327971 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1933/3891] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 1461 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:01.351843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-839fefb0-54a0-4ea8-bcb8-40ab923bfeeb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:01.353145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-839fefb0-54a0-4ea8-bcb8-40ab923bfeeb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:01.362875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-839fefb0-54a0-4ea8-bcb8-40ab923bfeeb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.366190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-839fefb0-54a0-4ea8-bcb8-40ab923bfeeb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.368118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-839fefb0-54a0-4ea8-bcb8-40ab923bfeeb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.368799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-839fefb0-54a0-4ea8-bcb8-40ab923bfeeb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.992039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-839fefb0-54a0-4ea8-bcb8-40ab923bfeeb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:02.002944 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-839fefb0-54a0-4ea8-bcb8-40ab923bfeeb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f" status: 200 len: 1468 microversion: 2.1 time: 0.655673 Jul 20 04:26:02.011601 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1959/3892] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f => generated 1468 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:02.028607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-338d6b8c-4564-48f3-9bfc-8a67c3d30e51 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bc0d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:02.371129 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-338d6b8c-4564-48f3-9bfc-8a67c3d30e51 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images?changes-since=2022-07-20T04%3A23%3A48Z" status: 200 len: 2373 microversion: 2.1 time: 0.347260 Jul 20 04:26:02.372839 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1934/3893] 10.222.0.59 () {58 vars in 1198 bytes} [Wed Jul 20 04:26:02 2022] GET /compute/v2.1/images?changes-since=2022-07-20T04%3A23%3A48Z => generated 2373 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:02.387396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4671be7e-3f8c-4e27-8732-61eafc9880c5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841b23af0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:02.397568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-54d96020-35ce-47d6-9b19-30bfb23a0970 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:02.398689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-54d96020-35ce-47d6-9b19-30bfb23a0970 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:02.427969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54d96020-35ce-47d6-9b19-30bfb23a0970 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.429227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54d96020-35ce-47d6-9b19-30bfb23a0970 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.432931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54d96020-35ce-47d6-9b19-30bfb23a0970 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.434751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54d96020-35ce-47d6-9b19-30bfb23a0970 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.478584 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-54d96020-35ce-47d6-9b19-30bfb23a0970 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] HTTP exception thrown: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-54d96020-35ce-47d6-9b19-30bfb23a0970 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Request method failure captured: Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b HTTP/1.1 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14JCLPvINkU04kxoUxRW7wflXcVg8w0OdwOx6_eiLhJ--5w66kQ1BjwphaYOeNc4GtXTVkBcAOlU-RAChYLWEtRuFzGdlax5UqQKMNwmHV1DUFdjLjLC1KV7YgyzHSu4zEjnvY_9sUsWgs-gO2xF4h8DzchN0Q1OynJteACD9LyGQb4 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 337b3a46906648cb82515704eadcdb38 Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c0b8484b-3078-4fc9-923d-e72a9aa94a9b'} Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:02.486722 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:26:02.491826 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.491826 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:02.491826 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.491826 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:02.491826 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:02.491826 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:02.491826 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:02.491826 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:02.491826 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:26:02.491826 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.494080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-54d96020-35ce-47d6-9b19-30bfb23a0970 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Returning 404 to user: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:02.497183 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-54d96020-35ce-47d6-9b19-30bfb23a0970 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 404 len: 111 microversion: 2.1 time: 0.102755 Jul 20 04:26:02.499157 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1935/3894] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:02 2022] DELETE /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:26:02.509668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bf608f5f-9f0f-4e7b-bd55-a13312d5e36e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:02.514357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bf608f5f-9f0f-4e7b-bd55-a13312d5e36e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: c0b8484b-3078-4fc9-923d-e72a9aa94a9b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:02.539316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf608f5f-9f0f-4e7b-bd55-a13312d5e36e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.541617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf608f5f-9f0f-4e7b-bd55-a13312d5e36e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.543568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf608f5f-9f0f-4e7b-bd55-a13312d5e36e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.545577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf608f5f-9f0f-4e7b-bd55-a13312d5e36e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.587855 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4671be7e-3f8c-4e27-8732-61eafc9880c5 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-680055419" status: 200 len: 484 microversion: 2.1 time: 0.205129 Jul 20 04:26:02.589060 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1960/3895] 10.222.0.59 () {58 vars in 1228 bytes} [Wed Jul 20 04:26:02 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-680055419 => generated 484 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:02.601634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b5f7268f-6d81-4b11-b02f-4d35e4cd71a3 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841cf1280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:02.610787 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-bf608f5f-9f0f-4e7b-bd55-a13312d5e36e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] HTTP exception thrown: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bf608f5f-9f0f-4e7b-bd55-a13312d5e36e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Request method failure captured: Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b HTTP/1.1 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14JCLPvINkU04kxoUxRW7wflXcVg8w0OdwOx6_eiLhJ--5w66kQ1BjwphaYOeNc4GtXTVkBcAOlU-RAChYLWEtRuFzGdlax5UqQKMNwmHV1DUFdjLjLC1KV7YgyzHSu4zEjnvY_9sUsWgs-gO2xF4h8DzchN0Q1OynJteACD9LyGQb4 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 337b3a46906648cb82515704eadcdb38 Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c0b8484b-3078-4fc9-923d-e72a9aa94a9b'} Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:02.618201 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.621683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:02.621683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:02.621683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:02.621683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:02.621683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:02.621683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. Jul 20 04:26:02.621683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.621683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bf608f5f-9f0f-4e7b-bd55-a13312d5e36e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Returning 404 to user: Instance c0b8484b-3078-4fc9-923d-e72a9aa94a9b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:02.621683 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bf608f5f-9f0f-4e7b-bd55-a13312d5e36e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b" status: 404 len: 111 microversion: 2.1 time: 0.117739 Jul 20 04:26:02.625602 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1936/3896] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:02 2022] GET /compute/v2.1/servers/c0b8484b-3078-4fc9-923d-e72a9aa94a9b => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:02.930977 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b5f7268f-6d81-4b11-b02f-4d35e4cd71a3 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images?server=b9c46211-eaee-4f38-a690-65d710b5529f" status: 200 len: 957 microversion: 2.1 time: 0.334140 Jul 20 04:26:02.932622 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1961/3897] 10.222.0.59 () {58 vars in 1208 bytes} [Wed Jul 20 04:26:02 2022] GET /compute/v2.1/images?server=b9c46211-eaee-4f38-a690-65d710b5529f => generated 957 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:02.946927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1c846240-0967-4d2f-9ad8-3e25f1268b3b tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8413ba310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:03.073124 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1c846240-0967-4d2f-9ad8-3e25f1268b3b tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fv2.1%2Fservers%2F21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 483 microversion: 2.1 time: 0.133098 Jul 20 04:26:03.078753 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1937/3898] 10.222.0.59 () {58 vars in 1316 bytes} [Wed Jul 20 04:26:02 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fv2.1%2Fservers%2F21563660-c2fb-4770-a9d1-83dd296394cd => generated 483 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:03.086204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aaffa016-ffb8-47a3-a714-e57f5cea3eba tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841c4e0d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:03.239523 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aaffa016-ffb8-47a3-a714-e57f5cea3eba tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fservers%2F21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 483 microversion: 2.1 time: 0.158225 Jul 20 04:26:03.246323 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1962/3899] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Jul 20 04:26:03 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fservers%2F21563660-c2fb-4770-a9d1-83dd296394cd => generated 483 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:03.258644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9102e7f8-c557-4b2d-9669-778f0e123e0a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bc430>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:03.560421 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9102e7f8-c557-4b2d-9669-778f0e123e0a tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.305598 Jul 20 04:26:03.563373 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1938/3900] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:26:03 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:03.574374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:03.579928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0b0f1d5-3c1c-4008-8fd5-c93e7c400c12 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841b71e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:03.734156 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0b0f1d5-3c1c-4008-8fd5-c93e7c400c12 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.156246 Jul 20 04:26:03.742476 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1963/3901] 10.222.0.59 () {58 vars in 1148 bytes} [Wed Jul 20 04:26:03 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:03.748623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d5d6d70-4faf-485a-9c27-2c9296e9ec6e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84121c670>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:03.835677 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4d5d6d70-4faf-485a-9c27-2c9296e9ec6e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.092139 Jul 20 04:26:03.840016 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1939/3902] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:26:03 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:03.853905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d383e3e7-a396-4de0-b548-4046bc5e6177 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8410f19d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:04.165656 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d383e3e7-a396-4de0-b548-4046bc5e6177 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/detail?changes-since=2022-07-20T04%3A23%3A44Z" status: 200 len: 6325 microversion: 2.1 time: 0.318743 Jul 20 04:26:04.166321 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1964/3903] 10.222.0.59 () {58 vars in 1219 bytes} [Wed Jul 20 04:26:03 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-20T04%3A23%3A44Z => generated 6325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:04.182357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c1ee4ba-ea91-4141-b06d-bed578e435af tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84121caf0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:04.381725 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c1ee4ba-ea91-4141-b06d-bed578e435af tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-680055419" status: 200 len: 664 microversion: 2.1 time: 0.202719 Jul 20 04:26:04.383831 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1940/3904] 10.222.0.59 () {58 vars in 1249 bytes} [Wed Jul 20 04:26:04 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-680055419 => generated 664 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:04.397718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4e4a740d-0e9f-41ec-9f1e-b71905e5efc3 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841b23af0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:04.499102 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4e4a740d-0e9f-41ec-9f1e-b71905e5efc3 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fv2.1%2Fservers%2F21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1463 microversion: 2.1 time: 0.106183 Jul 20 04:26:04.500111 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1965/3905] 10.222.0.59 () {58 vars in 1337 bytes} [Wed Jul 20 04:26:04 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fv2.1%2Fservers%2F21563660-c2fb-4770-a9d1-83dd296394cd => generated 1463 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:04.532168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-94537890-9f87-4452-85d5-24b959bef01b tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841233ee0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:04.646761 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-94537890-9f87-4452-85d5-24b959bef01b tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fservers%2F21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1463 microversion: 2.1 time: 0.136191 Jul 20 04:26:04.653434 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1941/3906] 10.222.0.59 () {58 vars in 1323 bytes} [Wed Jul 20 04:26:04 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fservers%2F21563660-c2fb-4770-a9d1-83dd296394cd => generated 1463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:04.672789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-27ab6b8d-a4d4-4195-8c26-234db98f2ad8 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841cf1d30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:04.832418 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-27ab6b8d-a4d4-4195-8c26-234db98f2ad8 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.164444 Jul 20 04:26:04.835225 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1966/3907] 10.222.0.59 () {58 vars in 1169 bytes} [Wed Jul 20 04:26:04 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:04.860660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a2198b96-dfe9-4b7b-ba18-b9ffe4dbc944 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8412bc9d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:04.886735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=24 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:05.026763 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a2198b96-dfe9-4b7b-ba18-b9ffe4dbc944 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.175663 Jul 20 04:26:05.027766 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1942/3908] 10.222.0.59 () {58 vars in 1169 bytes} [Wed Jul 20 04:26:04 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:05.042787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c14e0c3-e216-43c8-8dc9-ddbd013823ab tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb841a96940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:05.101792 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3c14e0c3-e216-43c8-8dc9-ddbd013823ab tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/e42aeec8-ce44-4145-9a4d-e614edbe956b" status: 200 len: 784 microversion: 2.1 time: 0.063102 Jul 20 04:26:05.102459 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1967/3909] 10.222.0.59 () {58 vars in 1232 bytes} [Wed Jul 20 04:26:05 2022] GET /compute/v2.1/images/e42aeec8-ce44-4145-9a4d-e614edbe956b => generated 784 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:05.119592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b9375c3-ff12-49fb-b1e1-784bd737ac7b tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84121c8b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:05.233860 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b9375c3-ff12-49fb-b1e1-784bd737ac7b tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.119294 Jul 20 04:26:05.240172 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1943/3910] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 04:26:05 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:05.255492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8cc1dcee-1c15-4f35-bfa1-8f56a73fb2f0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb8410f13a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:05.702869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4bf6cb4e-6240-477f-a77c-f0885e6dea79 req-0c384dee-11ee-4522-8f14-3b7d6f9a662e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c46211-eaee-4f38-a690-65d710b5529f", "name": "network-vif-unplugged", "status": "completed", "tag": "15789429-5cd8-4e37-95ed-801038c4a3ef"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:05.729840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4bf6cb4e-6240-477f-a77c-f0885e6dea79 req-0c384dee-11ee-4522-8f14-3b7d6f9a662e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.730694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4bf6cb4e-6240-477f-a77c-f0885e6dea79 req-0c384dee-11ee-4522-8f14-3b7d6f9a662e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.759327 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4bf6cb4e-6240-477f-a77c-f0885e6dea79 req-0c384dee-11ee-4522-8f14-3b7d6f9a662e service nova] Creating event network-vif-unplugged:15789429-5cd8-4e37-95ed-801038c4a3ef for instance b9c46211-eaee-4f38-a690-65d710b5529f on n-h2-760456-11 Jul 20 04:26:05.781951 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4bf6cb4e-6240-477f-a77c-f0885e6dea79 req-0c384dee-11ee-4522-8f14-3b7d6f9a662e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084193 Jul 20 04:26:05.785899 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1944/3911] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:06.209434 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8cc1dcee-1c15-4f35-bfa1-8f56a73fb2f0 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "DELETE /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0" status: 204 len: 0 microversion: 2.1 time: 0.958791 Jul 20 04:26:06.210023 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1968/3912] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:05 2022] DELETE /compute/v2.1/images/ebd69307-daba-4285-8866-6084cb8574a0 => generated 0 bytes in 960 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:06.219274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b2b3236-7aad-4527-9b89-004f9a529b43 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84121cca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:07.794468 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b2b3236-7aad-4527-9b89-004f9a529b43 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "DELETE /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2" status: 204 len: 0 microversion: 2.1 time: 1.579891 Jul 20 04:26:07.795133 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1945/3913] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:06 2022] DELETE /compute/v2.1/images/9d56342a-c4b6-4666-b088-0fb7d7d259e2 => generated 0 bytes in 1582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:07.805194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c03f53a9-aa16-4038-9154-738dfd160a4c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb842230ca0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:09.446066 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c03f53a9-aa16-4038-9154-738dfd160a4c tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "DELETE /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc" status: 204 len: 0 microversion: 2.1 time: 1.646608 Jul 20 04:26:09.446815 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1969/3914] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:07 2022] DELETE /compute/v2.1/images/1590724c-d653-44ed-a08c-1f7b59607fbc => generated 0 bytes in 1648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:09.458528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0740042e-2d6d-4b0d-8f83-f40a7ae9bf35 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:09.459342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0740042e-2d6d-4b0d-8f83-f40a7ae9bf35 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:09.481284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0740042e-2d6d-4b0d-8f83-f40a7ae9bf35 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.481880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0740042e-2d6d-4b0d-8f83-f40a7ae9bf35 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.482974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0740042e-2d6d-4b0d-8f83-f40a7ae9bf35 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.483828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0740042e-2d6d-4b0d-8f83-f40a7ae9bf35 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.558765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0740042e-2d6d-4b0d-8f83-f40a7ae9bf35 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:26:09.884405 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0740042e-2d6d-4b0d-8f83-f40a7ae9bf35 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "DELETE /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 204 len: 0 microversion: 2.1 time: 0.432589 Jul 20 04:26:09.885763 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1946/3915] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:09 2022] DELETE /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:09.895127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37994ee0-0ad3-4781-b601-6bf3c0371340 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:09.895765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37994ee0-0ad3-4781-b601-6bf3c0371340 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:09.909330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37994ee0-0ad3-4781-b601-6bf3c0371340 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.916816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37994ee0-0ad3-4781-b601-6bf3c0371340 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.919414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37994ee0-0ad3-4781-b601-6bf3c0371340 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.926847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37994ee0-0ad3-4781-b601-6bf3c0371340 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.939110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dcd7007b-32af-4a18-914f-a749ae45de8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:11.939690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dcd7007b-32af-4a18-914f-a749ae45de8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:11.967406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcd7007b-32af-4a18-914f-a749ae45de8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.968350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcd7007b-32af-4a18-914f-a749ae45de8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.973545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcd7007b-32af-4a18-914f-a749ae45de8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.974268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcd7007b-32af-4a18-914f-a749ae45de8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.027418 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-dcd7007b-32af-4a18-914f-a749ae45de8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] HTTP exception thrown: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dcd7007b-32af-4a18-914f-a749ae45de8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Request method failure captured: Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 HTTP/1.1 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14JCLPvINkU04kxoUxRW7wflXcVg8w0OdwOx6_eiLhJ--5w66kQ1BjwphaYOeNc4GtXTVkBcAOlU-RAChYLWEtRuFzGdlax5UqQKMNwmHV1DUFdjLjLC1KV7YgyzHSu4zEjnvY_9sUsWgs-gO2xF4h8DzchN0Q1OynJteACD9LyGQb4 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 337b3a46906648cb82515704eadcdb38 Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '9c4eb6ee-6232-43c2-a09b-55e0dda420d2'} Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:12.036815 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:26:12.040316 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:12.040316 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:12.040316 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:12.040316 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:12.040316 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:12.040316 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:12.040316 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:12.040316 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:12.040316 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:26:12.040316 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:12.044690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dcd7007b-32af-4a18-914f-a749ae45de8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Returning 404 to user: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:12.046330 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dcd7007b-32af-4a18-914f-a749ae45de8e tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 404 len: 111 microversion: 2.1 time: 0.112113 Jul 20 04:26:12.051871 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1947/3916] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:11 2022] DELETE /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:26:12.062137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-76c6d556-9479-4115-baaa-9f66e76b5b81 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:12.065657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-76c6d556-9479-4115-baaa-9f66e76b5b81 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] [instance: 9c4eb6ee-6232-43c2-a09b-55e0dda420d2] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:12.079879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76c6d556-9479-4115-baaa-9f66e76b5b81 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:12.083767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76c6d556-9479-4115-baaa-9f66e76b5b81 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.084746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76c6d556-9479-4115-baaa-9f66e76b5b81 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:12.087346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76c6d556-9479-4115-baaa-9f66e76b5b81 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.133044 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-76c6d556-9479-4115-baaa-9f66e76b5b81 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] HTTP exception thrown: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-76c6d556-9479-4115-baaa-9f66e76b5b81 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Request method failure captured: Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 HTTP/1.1 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14JCLPvINkU04kxoUxRW7wflXcVg8w0OdwOx6_eiLhJ--5w66kQ1BjwphaYOeNc4GtXTVkBcAOlU-RAChYLWEtRuFzGdlax5UqQKMNwmHV1DUFdjLjLC1KV7YgyzHSu4zEjnvY_9sUsWgs-gO2xF4h8DzchN0Q1OynJteACD9LyGQb4 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_93f8bfd8e5a34423848573c7caab8d68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 93f8bfd8e5a34423848573c7caab8d68 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-82480754 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 337b3a46906648cb82515704eadcdb38 Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeTestJSON-82480754-project Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '9c4eb6ee-6232-43c2-a09b-55e0dda420d2'} Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:12.137161 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:12.141285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:12.141285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:12.141285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:12.141285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:12.141285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:12.141285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. Jul 20 04:26:12.141285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:12.141285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-76c6d556-9479-4115-baaa-9f66e76b5b81 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] Returning 404 to user: Instance 9c4eb6ee-6232-43c2-a09b-55e0dda420d2 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:12.147789 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-76c6d556-9479-4115-baaa-9f66e76b5b81 tempest-AttachVolumeTestJSON-82480754 tempest-AttachVolumeTestJSON-82480754-project] 10.222.0.59 "GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2" status: 404 len: 111 microversion: 2.1 time: 0.081748 Jul 20 04:26:12.153837 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1948/3917] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:12 2022] GET /compute/v2.1/servers/9c4eb6ee-6232-43c2-a09b-55e0dda420d2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:12.255798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-37994ee0-0ad3-4781-b601-6bf3c0371340 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:12.279912 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37994ee0-0ad3-4781-b601-6bf3c0371340 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1474 microversion: 2.1 time: 2.384858 Jul 20 04:26:12.283586 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1970/3918] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:09 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1474 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:13.302796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58402eba-0014-43b6-aae8-7c5d90a20e85 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:13.304843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-58402eba-0014-43b6-aae8-7c5d90a20e85 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:13.322006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58402eba-0014-43b6-aae8-7c5d90a20e85 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.329796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58402eba-0014-43b6-aae8-7c5d90a20e85 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:13.335812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58402eba-0014-43b6-aae8-7c5d90a20e85 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.339921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58402eba-0014-43b6-aae8-7c5d90a20e85 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:13.596814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-58402eba-0014-43b6-aae8-7c5d90a20e85 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:13.615766 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-58402eba-0014-43b6-aae8-7c5d90a20e85 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 200 len: 1432 microversion: 2.1 time: 0.318875 Jul 20 04:26:13.617735 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1949/3919] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:13 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 1432 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:13.950106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6a6bd990-81ca-4906-a81e-6ac91deb8367 req-5941edf5-b501-466f-9a98-d5caa93cb82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21563660-c2fb-4770-a9d1-83dd296394cd", "name": "network-vif-deleted", "tag": "c8d3c0c2-42fb-4da8-9aa0-8fa9605c9fc0"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:13.980555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6a6bd990-81ca-4906-a81e-6ac91deb8367 req-5941edf5-b501-466f-9a98-d5caa93cb82f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:13.982515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6a6bd990-81ca-4906-a81e-6ac91deb8367 req-5941edf5-b501-466f-9a98-d5caa93cb82f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.026022 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6a6bd990-81ca-4906-a81e-6ac91deb8367 req-5941edf5-b501-466f-9a98-d5caa93cb82f service nova] Creating event network-vif-deleted:c8d3c0c2-42fb-4da8-9aa0-8fa9605c9fc0 for instance 21563660-c2fb-4770-a9d1-83dd296394cd on n-h2-760456-11 Jul 20 04:26:14.052048 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6a6bd990-81ca-4906-a81e-6ac91deb8367 req-5941edf5-b501-466f-9a98-d5caa93cb82f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104917 Jul 20 04:26:14.059488 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1971/3920] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:14.635484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dfb00b0e-a831-4465-a9b4-919a69cd810e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:14.636120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dfb00b0e-a831-4465-a9b4-919a69cd810e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: 21563660-c2fb-4770-a9d1-83dd296394cd] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:14.645152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfb00b0e-a831-4465-a9b4-919a69cd810e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.645720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfb00b0e-a831-4465-a9b4-919a69cd810e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.647188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfb00b0e-a831-4465-a9b4-919a69cd810e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.648281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfb00b0e-a831-4465-a9b4-919a69cd810e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.688089 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-dfb00b0e-a831-4465-a9b4-919a69cd810e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] HTTP exception thrown: Instance 21563660-c2fb-4770-a9d1-83dd296394cd could not be found. Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dfb00b0e-a831-4465-a9b4-919a69cd810e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Request method failure captured: Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd HTTP/1.1 Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14NPjAw7sazhAl32SlQDaixf1TcK5oxJbLD5zYJjpP1I5gCm4pGoxwsOqg1SQX11hsaXV6n3J3hHhMV5wC_FA8-xHFiSnMOjgHx2A54PpBE8_yzDdy0VYmuYw5Xt92oJUjTGap3es7sQowKJcJ2ecuGhsvLnHJZ64KX_sOm_ShX2JVE Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 6fdcdb574d07479a9c086c640629e906 Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ListImageFiltersTestJSON-979542845 Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6fdcdb574d07479a9c086c640629e906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6fdcdb574d07479a9c086c640629e906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6fdcdb574d07479a9c086c640629e906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6fdcdb574d07479a9c086c640629e906"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ListImageFiltersTestJSON-979542845 Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 6fdcdb574d07479a9c086c640629e906 Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-979542845 Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ListImageFiltersTestJSON-979542845-project Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2a214df8538845fe94a6487911f0d538 Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ListImageFiltersTestJSON-979542845-project Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 21563660-c2fb-4770-a9d1-83dd296394cd could not be found. Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '21563660-c2fb-4770-a9d1-83dd296394cd'} Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21563660-c2fb-4770-a9d1-83dd296394cd could not be found. Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21563660-c2fb-4770-a9d1-83dd296394cd could not be found. Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:14.690120 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:14.694789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:14.694789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:14.694789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:14.694789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:14.694789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:14.694789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21563660-c2fb-4770-a9d1-83dd296394cd could not be found. Jul 20 04:26:14.694789 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:14.694789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dfb00b0e-a831-4465-a9b4-919a69cd810e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Returning 404 to user: Instance 21563660-c2fb-4770-a9d1-83dd296394cd could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:14.694789 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dfb00b0e-a831-4465-a9b4-919a69cd810e tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd" status: 404 len: 111 microversion: 2.1 time: 0.060890 Jul 20 04:26:14.696130 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1950/3921] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:14 2022] GET /compute/v2.1/servers/21563660-c2fb-4770-a9d1-83dd296394cd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:14.703553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3911b9ec-cfd6-428f-b2c0-294dc4e006bb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:14.704176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3911b9ec-cfd6-428f-b2c0-294dc4e006bb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:14.718557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3911b9ec-cfd6-428f-b2c0-294dc4e006bb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.721363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3911b9ec-cfd6-428f-b2c0-294dc4e006bb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.723347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3911b9ec-cfd6-428f-b2c0-294dc4e006bb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.723951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3911b9ec-cfd6-428f-b2c0-294dc4e006bb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.808878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3911b9ec-cfd6-428f-b2c0-294dc4e006bb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:26:15.008984 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3911b9ec-cfd6-428f-b2c0-294dc4e006bb tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f" status: 204 len: 0 microversion: 2.1 time: 0.310112 Jul 20 04:26:15.010988 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1972/3922] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:14 2022] DELETE /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:15.019519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-85963322-0c8b-49ac-bdbd-9e9fa7a59831 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:15.020158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-85963322-0c8b-49ac-bdbd-9e9fa7a59831 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:15.041010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85963322-0c8b-49ac-bdbd-9e9fa7a59831 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.041756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85963322-0c8b-49ac-bdbd-9e9fa7a59831 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.050846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85963322-0c8b-49ac-bdbd-9e9fa7a59831 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.051528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85963322-0c8b-49ac-bdbd-9e9fa7a59831 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.140469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-85963322-0c8b-49ac-bdbd-9e9fa7a59831 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:16.176249 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-85963322-0c8b-49ac-bdbd-9e9fa7a59831 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f" status: 200 len: 1474 microversion: 2.1 time: 1.155169 Jul 20 04:26:16.178557 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1951/3923] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:15 2022] GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f => generated 1474 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:17.201555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9caa3ce3-7396-4f0f-baf4-fe0601cf3497 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:17.203886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9caa3ce3-7396-4f0f-baf4-fe0601cf3497 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:17.219703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9caa3ce3-7396-4f0f-baf4-fe0601cf3497 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.220304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9caa3ce3-7396-4f0f-baf4-fe0601cf3497 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.222473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9caa3ce3-7396-4f0f-baf4-fe0601cf3497 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.223361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9caa3ce3-7396-4f0f-baf4-fe0601cf3497 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.135892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9caa3ce3-7396-4f0f-baf4-fe0601cf3497 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a214df8538845fe94a6487911f0d538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdcdb574d07479a9c086c640629e906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:18.145450 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9caa3ce3-7396-4f0f-baf4-fe0601cf3497 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f" status: 200 len: 1474 microversion: 2.1 time: 0.952578 Jul 20 04:26:18.151169 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1973/3924] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:17 2022] GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f => generated 1474 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:18.320643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-6783c209-3020-46c0-a713-03bac3bfe122 req-523312f7-086b-4b1a-b649-03dc9a171fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c46211-eaee-4f38-a690-65d710b5529f", "name": "network-vif-deleted", "tag": "15789429-5cd8-4e37-95ed-801038c4a3ef"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:18.339317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6783c209-3020-46c0-a713-03bac3bfe122 req-523312f7-086b-4b1a-b649-03dc9a171fd2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.340166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6783c209-3020-46c0-a713-03bac3bfe122 req-523312f7-086b-4b1a-b649-03dc9a171fd2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.390466 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6783c209-3020-46c0-a713-03bac3bfe122 req-523312f7-086b-4b1a-b649-03dc9a171fd2 service nova] Creating event network-vif-deleted:15789429-5cd8-4e37-95ed-801038c4a3ef for instance b9c46211-eaee-4f38-a690-65d710b5529f on n-h2-760456-11 Jul 20 04:26:18.408606 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-6783c209-3020-46c0-a713-03bac3bfe122 req-523312f7-086b-4b1a-b649-03dc9a171fd2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089329 Jul 20 04:26:18.413968 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1952/3925] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:19.172615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f820b41e-42f4-4c1a-a86b-98229a00a45f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:19.173626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f820b41e-42f4-4c1a-a86b-98229a00a45f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] [instance: b9c46211-eaee-4f38-a690-65d710b5529f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:19.186965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f820b41e-42f4-4c1a-a86b-98229a00a45f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:19.189240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f820b41e-42f4-4c1a-a86b-98229a00a45f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:19.191165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f820b41e-42f4-4c1a-a86b-98229a00a45f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:19.192534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f820b41e-42f4-4c1a-a86b-98229a00a45f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:19.230796 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-f820b41e-42f4-4c1a-a86b-98229a00a45f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] HTTP exception thrown: Instance b9c46211-eaee-4f38-a690-65d710b5529f could not be found. Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f820b41e-42f4-4c1a-a86b-98229a00a45f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Request method failure captured: Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f HTTP/1.1 Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14NPjAw7sazhAl32SlQDaixf1TcK5oxJbLD5zYJjpP1I5gCm4pGoxwsOqg1SQX11hsaXV6n3J3hHhMV5wC_FA8-xHFiSnMOjgHx2A54PpBE8_yzDdy0VYmuYw5Xt92oJUjTGap3es7sQowKJcJ2ecuGhsvLnHJZ64KX_sOm_ShX2JVE Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 6fdcdb574d07479a9c086c640629e906 Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ListImageFiltersTestJSON-979542845 Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6fdcdb574d07479a9c086c640629e906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6fdcdb574d07479a9c086c640629e906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6fdcdb574d07479a9c086c640629e906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6fdcdb574d07479a9c086c640629e906"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ListImageFiltersTestJSON-979542845 Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 6fdcdb574d07479a9c086c640629e906 Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-979542845 Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ListImageFiltersTestJSON-979542845-project Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2a214df8538845fe94a6487911f0d538 Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ListImageFiltersTestJSON-979542845-project Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance b9c46211-eaee-4f38-a690-65d710b5529f could not be found. Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'b9c46211-eaee-4f38-a690-65d710b5529f'} Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c46211-eaee-4f38-a690-65d710b5529f could not be found. Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c46211-eaee-4f38-a690-65d710b5529f could not be found. Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:19.234557 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:19.239134 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:19.239134 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:19.239134 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:19.239134 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:19.239134 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:19.239134 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c46211-eaee-4f38-a690-65d710b5529f could not be found. Jul 20 04:26:19.239134 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:26:19.240668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f820b41e-42f4-4c1a-a86b-98229a00a45f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Returning 404 to user: Instance b9c46211-eaee-4f38-a690-65d710b5529f could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:19.245589 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f820b41e-42f4-4c1a-a86b-98229a00a45f tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f" status: 404 len: 111 microversion: 2.1 time: 0.079501 Jul 20 04:26:19.248308 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1953/3926] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:19 2022] GET /compute/v2.1/servers/b9c46211-eaee-4f38-a690-65d710b5529f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:19.255826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75088c51-6f86-4402-bb9a-5d21e9c49160 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84120a040>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:19.319211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-68cc5669-a509-489f-ad3c-ade2c025ffb8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Action: 'create', calling method: .version_select at 0x7fb840fff4c0>, body: {"keypair": {"name": "tempest-keypair-725374488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsOpEhmsBdqzyVEZUX6/ChXP1ue9FNRMQXnR9mOfSKXRxggsroAq5II/WBPvNYazLGmKgJom4a0bAUOtVEgHkqaZpSIQKuHtdMnbYkPF3hxUWNNqv3uhhtrsg8IrT8n4w=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:19.356896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-68cc5669-a509-489f-ad3c-ade2c025ffb8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Getting quotas for project b1cc955243624af284b786e810c70833. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:19.372730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-68cc5669-a509-489f-ad3c-ade2c025ffb8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Getting quotas for user 2db0e73fdd5142acaad64b423e592249 and project b1cc955243624af284b786e810c70833. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:19.447800 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-68cc5669-a509-489f-ad3c-ade2c025ffb8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.435248 Jul 20 04:26:19.450374 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1974/3927] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:26:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:20.084494 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75088c51-6f86-4402-bb9a-5d21e9c49160 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "DELETE /compute/v2.1/images/254a1984-054d-47e4-8830-c015c04103ce" status: 204 len: 0 microversion: 2.1 time: 0.832147 Jul 20 04:26:20.086630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1954/3928] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:19 2022] DELETE /compute/v2.1/images/254a1984-054d-47e4-8830-c015c04103ce => generated 0 bytes in 835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:20.098428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3a3ec71-238e-434a-a8b4-140f82e521d7 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84111f1f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:20.700964 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d3a3ec71-238e-434a-a8b4-140f82e521d7 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "DELETE /compute/v2.1/images/873d6383-cfb7-4bf2-ad7d-a7cba62146d6" status: 204 len: 0 microversion: 2.1 time: 0.609394 Jul 20 04:26:20.703399 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1975/3929] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:20 2022] DELETE /compute/v2.1/images/873d6383-cfb7-4bf2-ad7d-a7cba62146d6 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:20.717647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f8c2d45e-8a27-43b7-82b7-9ec764132439 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] Calling method '.version_select at 0x7fb84122e790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:21.304088 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f8c2d45e-8a27-43b7-82b7-9ec764132439 tempest-ListImageFiltersTestJSON-979542845 tempest-ListImageFiltersTestJSON-979542845-project] 10.222.0.59 "DELETE /compute/v2.1/images/ab60d333-313b-4f53-8722-f542537aad7a" status: 204 len: 0 microversion: 2.1 time: 0.594444 Jul 20 04:26:21.304704 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1955/3930] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:20 2022] DELETE /compute/v2.1/images/ab60d333-313b-4f53-8722-f542537aad7a => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:28.023963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "bfc2cd69-6ec6-4d93-b098-b5790734dedd"}], "security_groups": [{"name": "tempest-securitygroup--1281872497"}], "key_name": "tempest-keypair-725374488", "user_data": "}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:28.035606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:28.144251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:28.312111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] validate_networks() for [('bfc2cd69-6ec6-4d93-b098-b5790734dedd', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:26:29.396134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:29.664225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:29.664975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:29.665869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:29.666722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:29.667296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:29.693905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.694819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.695931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.697487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.741121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Getting quotas for project b1cc955243624af284b786e810c70833. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:29.761040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Getting quotas for user 2db0e73fdd5142acaad64b423e592249 and project b1cc955243624af284b786e810c70833. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:29.784653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:26:29.787567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:26:29.878643 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4f8fc476-7b7e-4ce9-8a9d-aea7e834343e tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.859481 Jul 20 04:26:29.883625 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1976/3931] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:26:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:26:29.907276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e4633b11-6dbd-43f5-ab47-fa514be08af6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:29.908412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e4633b11-6dbd-43f5-ab47-fa514be08af6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:29.918577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:29.920275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:30.219301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e4633b11-6dbd-43f5-ab47-fa514be08af6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:30.249150 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e4633b11-6dbd-43f5-ab47-fa514be08af6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1225 microversion: 2.1 time: 0.358297 Jul 20 04:26:30.256662 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1956/3932] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:29 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1225 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:31.278105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dcdd9cfe-32ff-4b35-ac50-778f8350f4de tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:31.279344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dcdd9cfe-32ff-4b35-ac50-778f8350f4de tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:31.294681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcdd9cfe-32ff-4b35-ac50-778f8350f4de tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:31.295379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcdd9cfe-32ff-4b35-ac50-778f8350f4de tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:31.313130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcdd9cfe-32ff-4b35-ac50-778f8350f4de tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:31.315659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcdd9cfe-32ff-4b35-ac50-778f8350f4de tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:31.475868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dcdd9cfe-32ff-4b35-ac50-778f8350f4de tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:31.504504 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dcdd9cfe-32ff-4b35-ac50-778f8350f4de tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1277 microversion: 2.1 time: 0.231920 Jul 20 04:26:31.505642 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1977/3933] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:31 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:32.528279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d74548a-3575-4953-af0d-c8ef838647b7 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:32.528911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d74548a-3575-4953-af0d-c8ef838647b7 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:32.550532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d74548a-3575-4953-af0d-c8ef838647b7 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:32.551032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d74548a-3575-4953-af0d-c8ef838647b7 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:32.553709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d74548a-3575-4953-af0d-c8ef838647b7 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:32.554465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d74548a-3575-4953-af0d-c8ef838647b7 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:32.995615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d74548a-3575-4953-af0d-c8ef838647b7 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:33.032941 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d74548a-3575-4953-af0d-c8ef838647b7 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1283 microversion: 2.1 time: 0.515089 Jul 20 04:26:33.037690 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1957/3934] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:32 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1283 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:34.055407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c2364aff-09e3-4eb5-af6a-81a72e86b6b2 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:34.056135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c2364aff-09e3-4eb5-af6a-81a72e86b6b2 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:34.080366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2364aff-09e3-4eb5-af6a-81a72e86b6b2 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:34.081888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2364aff-09e3-4eb5-af6a-81a72e86b6b2 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:34.083207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2364aff-09e3-4eb5-af6a-81a72e86b6b2 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:34.088349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c2364aff-09e3-4eb5-af6a-81a72e86b6b2 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:34.545656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c2364aff-09e3-4eb5-af6a-81a72e86b6b2 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:34.554996 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c2364aff-09e3-4eb5-af6a-81a72e86b6b2 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1283 microversion: 2.1 time: 0.505518 Jul 20 04:26:34.571986 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1978/3935] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:34 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1283 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:35.579646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7352e1af-32bd-4f53-b004-bc7658243fbe tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:35.581558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7352e1af-32bd-4f53-b004-bc7658243fbe tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:35.599234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7352e1af-32bd-4f53-b004-bc7658243fbe tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:35.602952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7352e1af-32bd-4f53-b004-bc7658243fbe tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:35.604654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7352e1af-32bd-4f53-b004-bc7658243fbe tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:35.605552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7352e1af-32bd-4f53-b004-bc7658243fbe tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:36.141275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7352e1af-32bd-4f53-b004-bc7658243fbe tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:36.165188 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7352e1af-32bd-4f53-b004-bc7658243fbe tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1351 microversion: 2.1 time: 0.591019 Jul 20 04:26:36.165803 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1958/3936] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:35 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1351 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:37.190987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a22dda0-5a6f-4a48-8dd0-5a4a221a29a8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:37.194412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1a22dda0-5a6f-4a48-8dd0-5a4a221a29a8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:37.217529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a22dda0-5a6f-4a48-8dd0-5a4a221a29a8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:37.220524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a22dda0-5a6f-4a48-8dd0-5a4a221a29a8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:37.222047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a22dda0-5a6f-4a48-8dd0-5a4a221a29a8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:37.231164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a22dda0-5a6f-4a48-8dd0-5a4a221a29a8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:37.779439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a22dda0-5a6f-4a48-8dd0-5a4a221a29a8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:37.803798 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a22dda0-5a6f-4a48-8dd0-5a4a221a29a8 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1351 microversion: 2.1 time: 0.624513 Jul 20 04:26:37.820620 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1979/3937] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:37 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1351 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:38.846712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-027795f4-bb57-4b1f-b42e-355e1bc09ee6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:38.847505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-027795f4-bb57-4b1f-b42e-355e1bc09ee6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:38.871940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-027795f4-bb57-4b1f-b42e-355e1bc09ee6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:38.872400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-027795f4-bb57-4b1f-b42e-355e1bc09ee6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:38.876000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-027795f4-bb57-4b1f-b42e-355e1bc09ee6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:38.876462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-027795f4-bb57-4b1f-b42e-355e1bc09ee6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:38.993926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e79ddea9-f139-4014-beee-97c27c4e1296 req-0269a7b0-dcf7-452f-9f16-291c0a63dac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a40b6d7-f555-47c1-ada4-403fd310538c", "tag": "da1344eb-40ae-4d16-8070-db65871b1e43"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:39.025261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e79ddea9-f139-4014-beee-97c27c4e1296 req-0269a7b0-dcf7-452f-9f16-291c0a63dac9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:39.029975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e79ddea9-f139-4014-beee-97c27c4e1296 req-0269a7b0-dcf7-452f-9f16-291c0a63dac9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:39.054778 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e79ddea9-f139-4014-beee-97c27c4e1296 req-0269a7b0-dcf7-452f-9f16-291c0a63dac9 service nova] Creating event network-changed:da1344eb-40ae-4d16-8070-db65871b1e43 for instance 4a40b6d7-f555-47c1-ada4-403fd310538c on n-h2-760456-11 Jul 20 04:26:39.061293 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e79ddea9-f139-4014-beee-97c27c4e1296 req-0269a7b0-dcf7-452f-9f16-291c0a63dac9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088387 Jul 20 04:26:39.062520 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1980/3938] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:40.243242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:40.301547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-027795f4-bb57-4b1f-b42e-355e1bc09ee6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:40.328742 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-027795f4-bb57-4b1f-b42e-355e1bc09ee6 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1351 microversion: 2.1 time: 1.487228 Jul 20 04:26:40.353938 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1959/3939] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:38 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1351 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:41.351702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:41.352576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:41.359172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bd3ce100-a8b5-426b-bfb4-f487a9b37230 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:41.362207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bd3ce100-a8b5-426b-bfb4-f487a9b37230 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:41.388160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd3ce100-a8b5-426b-bfb4-f487a9b37230 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:41.397888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd3ce100-a8b5-426b-bfb4-f487a9b37230 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:41.399059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd3ce100-a8b5-426b-bfb4-f487a9b37230 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:41.399532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd3ce100-a8b5-426b-bfb4-f487a9b37230 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:41.990756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bd3ce100-a8b5-426b-bfb4-f487a9b37230 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:42.003684 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bd3ce100-a8b5-426b-bfb4-f487a9b37230 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1351 microversion: 2.1 time: 0.652200 Jul 20 04:26:42.004859 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1981/3940] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:41 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1351 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:43.021413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e3c4e55-8432-438e-9bf2-963ededa7602 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:43.022636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6e3c4e55-8432-438e-9bf2-963ededa7602 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:43.038271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e3c4e55-8432-438e-9bf2-963ededa7602 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.038890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e3c4e55-8432-438e-9bf2-963ededa7602 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:43.039856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e3c4e55-8432-438e-9bf2-963ededa7602 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.040462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e3c4e55-8432-438e-9bf2-963ededa7602 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.476900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-197295438", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "e35ebae1-44ac-4186-b5e1-eef824ca2d78"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:44.616691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] validate_networks() for [('e35ebae1-44ac-4186-b5e1-eef824ca2d78', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:26:44.662919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6e3c4e55-8432-438e-9bf2-963ededa7602 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:44.677714 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6e3c4e55-8432-438e-9bf2-963ededa7602 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1351 microversion: 2.1 time: 1.660377 Jul 20 04:26:44.692959 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1960/3941] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:43 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1351 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:45.699252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e98a749-3b6f-4757-8d41-4e5d66d613a5 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:45.699929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5e98a749-3b6f-4757-8d41-4e5d66d613a5 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:45.721168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e98a749-3b6f-4757-8d41-4e5d66d613a5 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:45.721675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e98a749-3b6f-4757-8d41-4e5d66d613a5 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:45.737094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e98a749-3b6f-4757-8d41-4e5d66d613a5 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:45.742548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e98a749-3b6f-4757-8d41-4e5d66d613a5 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:46.012468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:46.013159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:46.013410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:46.013830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:46.014504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:46.050388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:46.050960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:46.051804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:46.052259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:46.152721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Getting quotas for project f4be66f05acc44aba09f0fb11ddfa74f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:46.169660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Getting quotas for user 21a5e03823b142198363b07a08d4f4d1 and project f4be66f05acc44aba09f0fb11ddfa74f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:46.207733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:26:46.216176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:26:46.382274 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9736a003-44b5-44ab-853f-9f11b10355f6 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.172606 Jul 20 04:26:46.389653 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1982/3942] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:26:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2183 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:26:46.401807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-58cc8c26-7611-4801-8d2a-5e1a2bdc619b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:46.404654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-58cc8c26-7611-4801-8d2a-5e1a2bdc619b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:46.651595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-58cc8c26-7611-4801-8d2a-5e1a2bdc619b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:46.670489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-58cc8c26-7611-4801-8d2a-5e1a2bdc619b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:46.678714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-58cc8c26-7611-4801-8d2a-5e1a2bdc619b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:46.685623 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-58cc8c26-7611-4801-8d2a-5e1a2bdc619b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1258 microversion: 2.21 time: 0.293011 Jul 20 04:26:46.686216 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1983/3943] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:46 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1258 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:47.113243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5e98a749-3b6f-4757-8d41-4e5d66d613a5 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:47.144412 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5e98a749-3b6f-4757-8d41-4e5d66d613a5 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1351 microversion: 2.1 time: 1.439364 Jul 20 04:26:47.145315 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1961/3944] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:45 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1351 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:47.706089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae52505c-1591-4d9a-bd94-492933e5d187 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:47.706856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ae52505c-1591-4d9a-bd94-492933e5d187 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:47.724150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae52505c-1591-4d9a-bd94-492933e5d187 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:47.731209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae52505c-1591-4d9a-bd94-492933e5d187 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:47.734609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae52505c-1591-4d9a-bd94-492933e5d187 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:47.738697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae52505c-1591-4d9a-bd94-492933e5d187 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.029738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae52505c-1591-4d9a-bd94-492933e5d187 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:48.083100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae52505c-1591-4d9a-bd94-492933e5d187 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:48.096854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae52505c-1591-4d9a-bd94-492933e5d187 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:48.102402 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae52505c-1591-4d9a-bd94-492933e5d187 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1262 microversion: 2.21 time: 0.399759 Jul 20 04:26:48.105161 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1984/3945] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:47 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1262 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:48.164521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b20ed519-5fca-4532-8d6f-2fa77c66f55d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:48.165159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b20ed519-5fca-4532-8d6f-2fa77c66f55d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:48.175392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b20ed519-5fca-4532-8d6f-2fa77c66f55d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.175860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b20ed519-5fca-4532-8d6f-2fa77c66f55d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.176692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b20ed519-5fca-4532-8d6f-2fa77c66f55d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.177130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b20ed519-5fca-4532-8d6f-2fa77c66f55d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.770208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b20ed519-5fca-4532-8d6f-2fa77c66f55d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:48.792623 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b20ed519-5fca-4532-8d6f-2fa77c66f55d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1351 microversion: 2.1 time: 0.632082 Jul 20 04:26:48.814819 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1962/3946] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:48 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1351 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:49.123457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c5eddf78-a0f8-459c-b3e0-81485d40c9fc tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:49.124153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c5eddf78-a0f8-459c-b3e0-81485d40c9fc tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:49.148492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5eddf78-a0f8-459c-b3e0-81485d40c9fc tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.149765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5eddf78-a0f8-459c-b3e0-81485d40c9fc tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.152258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5eddf78-a0f8-459c-b3e0-81485d40c9fc tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.152892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5eddf78-a0f8-459c-b3e0-81485d40c9fc tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.450996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5eddf78-a0f8-459c-b3e0-81485d40c9fc tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:49.465154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5eddf78-a0f8-459c-b3e0-81485d40c9fc tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:49.471936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c5eddf78-a0f8-459c-b3e0-81485d40c9fc tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:49.476231 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c5eddf78-a0f8-459c-b3e0-81485d40c9fc tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1316 microversion: 2.21 time: 0.355963 Jul 20 04:26:49.477523 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1985/3947] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:49 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:49.825122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-402b8b66-7dbf-4f17-8472-3dcc4c2e724b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:49.826010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-402b8b66-7dbf-4f17-8472-3dcc4c2e724b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:49.852206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-402b8b66-7dbf-4f17-8472-3dcc4c2e724b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.854140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-402b8b66-7dbf-4f17-8472-3dcc4c2e724b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.855999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-402b8b66-7dbf-4f17-8472-3dcc4c2e724b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.857183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-402b8b66-7dbf-4f17-8472-3dcc4c2e724b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:50.225158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-402b8b66-7dbf-4f17-8472-3dcc4c2e724b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:50.243248 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-402b8b66-7dbf-4f17-8472-3dcc4c2e724b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1351 microversion: 2.1 time: 0.424531 Jul 20 04:26:50.246881 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1963/3948] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:49 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1351 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:50.496529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e244d50e-cced-44cd-8b28-7510646b27ee tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:50.497291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e244d50e-cced-44cd-8b28-7510646b27ee tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:50.514445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e244d50e-cced-44cd-8b28-7510646b27ee tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:50.514921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e244d50e-cced-44cd-8b28-7510646b27ee tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:50.516164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e244d50e-cced-44cd-8b28-7510646b27ee tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:50.516628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e244d50e-cced-44cd-8b28-7510646b27ee tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:50.747800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e244d50e-cced-44cd-8b28-7510646b27ee tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:50.757256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e244d50e-cced-44cd-8b28-7510646b27ee tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:50.758834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e244d50e-cced-44cd-8b28-7510646b27ee tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:50.760146 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e244d50e-cced-44cd-8b28-7510646b27ee tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1316 microversion: 2.21 time: 0.268265 Jul 20 04:26:50.785438 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1986/3949] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:50 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:50.787619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-7310c4e1-c5b6-484f-af1e-5aa0ae6b5c60 req-08b51aa5-51fe-4abf-9b13-35f50be1c5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a40b6d7-f555-47c1-ada4-403fd310538c", "name": "network-vif-plugged", "status": "completed", "tag": "da1344eb-40ae-4d16-8070-db65871b1e43"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:50.809173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7310c4e1-c5b6-484f-af1e-5aa0ae6b5c60 req-08b51aa5-51fe-4abf-9b13-35f50be1c5fe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:50.809634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7310c4e1-c5b6-484f-af1e-5aa0ae6b5c60 req-08b51aa5-51fe-4abf-9b13-35f50be1c5fe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:50.832973 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-7310c4e1-c5b6-484f-af1e-5aa0ae6b5c60 req-08b51aa5-51fe-4abf-9b13-35f50be1c5fe service nova] Creating event network-vif-plugged:da1344eb-40ae-4d16-8070-db65871b1e43 for instance 4a40b6d7-f555-47c1-ada4-403fd310538c on n-h2-760456-11 Jul 20 04:26:50.843891 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-7310c4e1-c5b6-484f-af1e-5aa0ae6b5c60 req-08b51aa5-51fe-4abf-9b13-35f50be1c5fe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062468 Jul 20 04:26:50.848511 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1964/3950] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:26:51.269787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-10a1ed66-81d9-4363-bb08-6c1d76dfb69a tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:51.270518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-10a1ed66-81d9-4363-bb08-6c1d76dfb69a tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:51.278232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10a1ed66-81d9-4363-bb08-6c1d76dfb69a tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:51.278928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10a1ed66-81d9-4363-bb08-6c1d76dfb69a tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.280183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10a1ed66-81d9-4363-bb08-6c1d76dfb69a tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:51.280790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10a1ed66-81d9-4363-bb08-6c1d76dfb69a tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.782285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-49702313-718b-4f5e-b92c-450b14829ac4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:51.783079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-49702313-718b-4f5e-b92c-450b14829ac4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:51.804720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49702313-718b-4f5e-b92c-450b14829ac4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:51.807407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49702313-718b-4f5e-b92c-450b14829ac4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.809392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49702313-718b-4f5e-b92c-450b14829ac4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:51.810145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49702313-718b-4f5e-b92c-450b14829ac4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.927941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-10a1ed66-81d9-4363-bb08-6c1d76dfb69a tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:51.997303 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-10a1ed66-81d9-4363-bb08-6c1d76dfb69a tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1351 microversion: 2.1 time: 0.736674 Jul 20 04:26:52.004915 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1987/3951] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:51 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1351 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:52.341571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-49702313-718b-4f5e-b92c-450b14829ac4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:52.359100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-49702313-718b-4f5e-b92c-450b14829ac4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:52.370952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-49702313-718b-4f5e-b92c-450b14829ac4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:52.373759 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-49702313-718b-4f5e-b92c-450b14829ac4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 0.595999 Jul 20 04:26:52.379069 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1965/3952] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:51 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:26:53.022029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-11e9f462-3a5f-4b0d-8094-135231cb4083 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:53.037031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-11e9f462-3a5f-4b0d-8094-135231cb4083 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:53.061250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11e9f462-3a5f-4b0d-8094-135231cb4083 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.062145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11e9f462-3a5f-4b0d-8094-135231cb4083 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.063315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11e9f462-3a5f-4b0d-8094-135231cb4083 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.063993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11e9f462-3a5f-4b0d-8094-135231cb4083 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.393072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-99990384-4d34-45c1-baa3-2bdaf5c73fa7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:53.394641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-99990384-4d34-45c1-baa3-2bdaf5c73fa7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:53.404875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99990384-4d34-45c1-baa3-2bdaf5c73fa7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.420435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99990384-4d34-45c1-baa3-2bdaf5c73fa7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.427345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99990384-4d34-45c1-baa3-2bdaf5c73fa7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.428300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99990384-4d34-45c1-baa3-2bdaf5c73fa7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.977511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-99990384-4d34-45c1-baa3-2bdaf5c73fa7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:53.991607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-99990384-4d34-45c1-baa3-2bdaf5c73fa7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:53.993553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-99990384-4d34-45c1-baa3-2bdaf5c73fa7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:53.994263 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-99990384-4d34-45c1-baa3-2bdaf5c73fa7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 0.605125 Jul 20 04:26:53.995177 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1966/3953] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:53 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:26:54.318558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-11e9f462-3a5f-4b0d-8094-135231cb4083 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:54.338671 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-11e9f462-3a5f-4b0d-8094-135231cb4083 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1541 microversion: 2.1 time: 1.318745 Jul 20 04:26:54.340788 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1988/3954] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:53 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1541 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:54.358625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-19f439d6-05fd-418e-90a3-bf6f2fd2883d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:54.359193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-19f439d6-05fd-418e-90a3-bf6f2fd2883d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:54.367828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19f439d6-05fd-418e-90a3-bf6f2fd2883d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.368492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19f439d6-05fd-418e-90a3-bf6f2fd2883d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:54.373563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19f439d6-05fd-418e-90a3-bf6f2fd2883d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.374380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19f439d6-05fd-418e-90a3-bf6f2fd2883d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:54.552763 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-19f439d6-05fd-418e-90a3-bf6f2fd2883d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198250 Jul 20 04:26:54.560650 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1967/3955] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:26:54 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:55.013862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-47fc5329-80bc-4123-b67e-b81719e19e73 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:55.014771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-47fc5329-80bc-4123-b67e-b81719e19e73 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:55.032142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47fc5329-80bc-4123-b67e-b81719e19e73 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.041617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47fc5329-80bc-4123-b67e-b81719e19e73 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.044929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47fc5329-80bc-4123-b67e-b81719e19e73 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.045665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47fc5329-80bc-4123-b67e-b81719e19e73 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.239690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c752c46c-9d11-49d3-a872-29c5f66dcdd7 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:55.240196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c752c46c-9d11-49d3-a872-29c5f66dcdd7 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:55.250701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c752c46c-9d11-49d3-a872-29c5f66dcdd7 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.251160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c752c46c-9d11-49d3-a872-29c5f66dcdd7 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.253269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c752c46c-9d11-49d3-a872-29c5f66dcdd7 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.255317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c752c46c-9d11-49d3-a872-29c5f66dcdd7 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.301847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c752c46c-9d11-49d3-a872-29c5f66dcdd7 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:26:55.460422 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c752c46c-9d11-49d3-a872-29c5f66dcdd7 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 204 len: 0 microversion: 2.32 time: 0.773233 Jul 20 04:26:55.463119 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1989/3956] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:26:54 2022] DELETE /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 0 bytes in 777 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:26:55.473690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce2b913d-2781-46ed-9b73-05776c96321e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:55.476782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce2b913d-2781-46ed-9b73-05776c96321e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:55.493416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce2b913d-2781-46ed-9b73-05776c96321e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.494425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce2b913d-2781-46ed-9b73-05776c96321e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.495468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce2b913d-2781-46ed-9b73-05776c96321e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.497477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce2b913d-2781-46ed-9b73-05776c96321e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.919538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-47fc5329-80bc-4123-b67e-b81719e19e73 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:55.929507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-47fc5329-80bc-4123-b67e-b81719e19e73 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:55.947372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-47fc5329-80bc-4123-b67e-b81719e19e73 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:55.949048 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-47fc5329-80bc-4123-b67e-b81719e19e73 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 0.939662 Jul 20 04:26:55.952002 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1968/3957] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:55 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:26:56.069695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-67ff0267-aaf5-4031-a6ea-3a71cc40ed86 req-19cc2f75-7223-4706-a3d3-aa8b18543e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b62df52a-640b-4a48-ba7d-c07b79861b5a", "tag": "bacd40a9-c5fe-4ee6-8ccb-b94fcf5db671"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:56.093412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:56.097405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-67ff0267-aaf5-4031-a6ea-3a71cc40ed86 req-19cc2f75-7223-4706-a3d3-aa8b18543e8d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.098660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-67ff0267-aaf5-4031-a6ea-3a71cc40ed86 req-19cc2f75-7223-4706-a3d3-aa8b18543e8d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:56.136506 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-67ff0267-aaf5-4031-a6ea-3a71cc40ed86 req-19cc2f75-7223-4706-a3d3-aa8b18543e8d service nova] Creating event network-changed:bacd40a9-c5fe-4ee6-8ccb-b94fcf5db671 for instance b62df52a-640b-4a48-ba7d-c07b79861b5a on n-h1-760456-11 Jul 20 04:26:56.148757 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-67ff0267-aaf5-4031-a6ea-3a71cc40ed86 req-19cc2f75-7223-4706-a3d3-aa8b18543e8d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083687 Jul 20 04:26:56.153379 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1969/3958] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:26:56.253383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce2b913d-2781-46ed-9b73-05776c96321e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:56.265996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce2b913d-2781-46ed-9b73-05776c96321e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:56.271115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce2b913d-2781-46ed-9b73-05776c96321e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:56.276449 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce2b913d-2781-46ed-9b73-05776c96321e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2950 microversion: 2.32 time: 0.806230 Jul 20 04:26:56.278220 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1990/3959] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:55 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2950 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:26:56.970138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dfe5d376-7e91-40ae-8efd-2664f89cae9d tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:56.971315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dfe5d376-7e91-40ae-8efd-2664f89cae9d tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:56.983383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfe5d376-7e91-40ae-8efd-2664f89cae9d tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.983838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfe5d376-7e91-40ae-8efd-2664f89cae9d tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:56.990391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfe5d376-7e91-40ae-8efd-2664f89cae9d tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.991029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfe5d376-7e91-40ae-8efd-2664f89cae9d tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:57.301596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-89694008-ea86-45bd-98f9-91ae75e63bb0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:57.302962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-89694008-ea86-45bd-98f9-91ae75e63bb0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:57.305522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:57.315249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89694008-ea86-45bd-98f9-91ae75e63bb0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:57.316037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89694008-ea86-45bd-98f9-91ae75e63bb0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:57.317387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89694008-ea86-45bd-98f9-91ae75e63bb0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:57.318030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89694008-ea86-45bd-98f9-91ae75e63bb0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:57.371383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dfe5d376-7e91-40ae-8efd-2664f89cae9d tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:57.399335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dfe5d376-7e91-40ae-8efd-2664f89cae9d tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:57.404555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dfe5d376-7e91-40ae-8efd-2664f89cae9d tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:57.407920 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dfe5d376-7e91-40ae-8efd-2664f89cae9d tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 0.442262 Jul 20 04:26:57.412572 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1970/3960] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:56 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:57.998833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-89694008-ea86-45bd-98f9-91ae75e63bb0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:58.016330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-89694008-ea86-45bd-98f9-91ae75e63bb0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:58.034786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-89694008-ea86-45bd-98f9-91ae75e63bb0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:58.036167 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-89694008-ea86-45bd-98f9-91ae75e63bb0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2950 microversion: 2.32 time: 0.739090 Jul 20 04:26:58.041569 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1991/3961] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:57 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2950 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:26:58.089226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5d513cd5-46ab-47c4-bfc5-3aad35a8a607 req-58186438-c643-46de-a892-3eed70ced13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a40b6d7-f555-47c1-ada4-403fd310538c", "tag": "da1344eb-40ae-4d16-8070-db65871b1e43"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:58.107167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5d513cd5-46ab-47c4-bfc5-3aad35a8a607 req-58186438-c643-46de-a892-3eed70ced13c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:58.107614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5d513cd5-46ab-47c4-bfc5-3aad35a8a607 req-58186438-c643-46de-a892-3eed70ced13c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:58.150045 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5d513cd5-46ab-47c4-bfc5-3aad35a8a607 req-58186438-c643-46de-a892-3eed70ced13c service nova] Creating event network-changed:da1344eb-40ae-4d16-8070-db65871b1e43 for instance 4a40b6d7-f555-47c1-ada4-403fd310538c on n-h2-760456-11 Jul 20 04:26:58.162751 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5d513cd5-46ab-47c4-bfc5-3aad35a8a607 req-58186438-c643-46de-a892-3eed70ced13c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078987 Jul 20 04:26:58.163849 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1971/3962] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:58.431974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aad755b3-70bc-4dda-adde-8dcc5277b125 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:58.433241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aad755b3-70bc-4dda-adde-8dcc5277b125 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:58.443061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:58.474206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aad755b3-70bc-4dda-adde-8dcc5277b125 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:58.476820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aad755b3-70bc-4dda-adde-8dcc5277b125 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:58.479389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aad755b3-70bc-4dda-adde-8dcc5277b125 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:58.480194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aad755b3-70bc-4dda-adde-8dcc5277b125 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:58.506844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:59.065614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0aa8ae1a-d8d2-4dac-9ea1-ce7243a1c11e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:59.066451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0aa8ae1a-d8d2-4dac-9ea1-ce7243a1c11e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:59.084621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0aa8ae1a-d8d2-4dac-9ea1-ce7243a1c11e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.085166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0aa8ae1a-d8d2-4dac-9ea1-ce7243a1c11e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.087903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0aa8ae1a-d8d2-4dac-9ea1-ce7243a1c11e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.089927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0aa8ae1a-d8d2-4dac-9ea1-ce7243a1c11e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.426413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aad755b3-70bc-4dda-adde-8dcc5277b125 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.438650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aad755b3-70bc-4dda-adde-8dcc5277b125 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.442151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aad755b3-70bc-4dda-adde-8dcc5277b125 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.446604 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aad755b3-70bc-4dda-adde-8dcc5277b125 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 1.019507 Jul 20 04:26:59.454530 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1992/3963] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:58 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:59.573844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0aa8ae1a-d8d2-4dac-9ea1-ce7243a1c11e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.593927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0aa8ae1a-d8d2-4dac-9ea1-ce7243a1c11e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.596905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0aa8ae1a-d8d2-4dac-9ea1-ce7243a1c11e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.599117 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0aa8ae1a-d8d2-4dac-9ea1-ce7243a1c11e tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2950 microversion: 2.32 time: 0.539843 Jul 20 04:26:59.616391 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1972/3964] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:59 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2950 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:00.464998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7721a41a-1195-4a32-9f1a-31d14399d178 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:00.466210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7721a41a-1195-4a32-9f1a-31d14399d178 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:00.484580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7721a41a-1195-4a32-9f1a-31d14399d178 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.489030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7721a41a-1195-4a32-9f1a-31d14399d178 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.492302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7721a41a-1195-4a32-9f1a-31d14399d178 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.493000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7721a41a-1195-4a32-9f1a-31d14399d178 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.553225 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:27:00.553782 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 04:27:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:27:00.623497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-54b2c07f-086f-450c-982f-2096de0549a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:00.624290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-54b2c07f-086f-450c-982f-2096de0549a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:00.635954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=37 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:00.647352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54b2c07f-086f-450c-982f-2096de0549a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.647795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54b2c07f-086f-450c-982f-2096de0549a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.651009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54b2c07f-086f-450c-982f-2096de0549a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.652840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54b2c07f-086f-450c-982f-2096de0549a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.677168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=83 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:01.285176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-54b2c07f-086f-450c-982f-2096de0549a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.305270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-54b2c07f-086f-450c-982f-2096de0549a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.312221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-54b2c07f-086f-450c-982f-2096de0549a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.316386 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-54b2c07f-086f-450c-982f-2096de0549a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2950 microversion: 2.32 time: 0.698913 Jul 20 04:27:01.319233 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1973/3965] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:00 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2950 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:01.630791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7721a41a-1195-4a32-9f1a-31d14399d178 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.639202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7721a41a-1195-4a32-9f1a-31d14399d178 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.640949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7721a41a-1195-4a32-9f1a-31d14399d178 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.642119 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7721a41a-1195-4a32-9f1a-31d14399d178 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 1.181046 Jul 20 04:27:01.652992 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1993/3966] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:00 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:02.344348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4bcd60b4-bc3e-48bf-9c44-46faa659b250 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:02.345075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4bcd60b4-bc3e-48bf-9c44-46faa659b250 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:02.365040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bcd60b4-bc3e-48bf-9c44-46faa659b250 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.365508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bcd60b4-bc3e-48bf-9c44-46faa659b250 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.369473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bcd60b4-bc3e-48bf-9c44-46faa659b250 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.372645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4bcd60b4-bc3e-48bf-9c44-46faa659b250 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.492799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-09e9806d-0a07-43b7-8dba-3b8bb789d2e7 req-2ecab1b6-4dfa-43b1-8e61-c6ce4818701d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-unplugged", "status": "completed", "tag": "34004e40-bf86-4b70-ba0c-469bb3766bbd"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:02.513084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-09e9806d-0a07-43b7-8dba-3b8bb789d2e7 req-2ecab1b6-4dfa-43b1-8e61-c6ce4818701d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.516121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-09e9806d-0a07-43b7-8dba-3b8bb789d2e7 req-2ecab1b6-4dfa-43b1-8e61-c6ce4818701d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.550094 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-09e9806d-0a07-43b7-8dba-3b8bb789d2e7 req-2ecab1b6-4dfa-43b1-8e61-c6ce4818701d service nova] Creating event network-vif-unplugged:34004e40-bf86-4b70-ba0c-469bb3766bbd for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:27:02.568407 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-09e9806d-0a07-43b7-8dba-3b8bb789d2e7 req-2ecab1b6-4dfa-43b1-8e61-c6ce4818701d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080688 Jul 20 04:27:02.573740 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1994/3967] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:02.662408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cf583dc3-dbfe-4683-ac70-2e8aa8c6fab2 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:02.663261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cf583dc3-dbfe-4683-ac70-2e8aa8c6fab2 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:02.693269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf583dc3-dbfe-4683-ac70-2e8aa8c6fab2 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.694854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf583dc3-dbfe-4683-ac70-2e8aa8c6fab2 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.697168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf583dc3-dbfe-4683-ac70-2e8aa8c6fab2 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.698862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf583dc3-dbfe-4683-ac70-2e8aa8c6fab2 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:03.566391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4bcd60b4-bc3e-48bf-9c44-46faa659b250 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:03.577451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4bcd60b4-bc3e-48bf-9c44-46faa659b250 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:03.586353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4bcd60b4-bc3e-48bf-9c44-46faa659b250 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:03.587957 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4bcd60b4-bc3e-48bf-9c44-46faa659b250 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2929 microversion: 2.32 time: 1.255336 Jul 20 04:27:03.620993 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1974/3968] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:02 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2929 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:03.722219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cf583dc3-dbfe-4683-ac70-2e8aa8c6fab2 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:03.733023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cf583dc3-dbfe-4683-ac70-2e8aa8c6fab2 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:03.734616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cf583dc3-dbfe-4683-ac70-2e8aa8c6fab2 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:03.737395 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cf583dc3-dbfe-4683-ac70-2e8aa8c6fab2 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 1.080577 Jul 20 04:27:03.741683 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1995/3969] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:02 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:04.625216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ad50d910-36d5-462a-9114-a1def1d899f1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:04.627149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ad50d910-36d5-462a-9114-a1def1d899f1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:04.649180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad50d910-36d5-462a-9114-a1def1d899f1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.655497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad50d910-36d5-462a-9114-a1def1d899f1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.674198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad50d910-36d5-462a-9114-a1def1d899f1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.674766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad50d910-36d5-462a-9114-a1def1d899f1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.766212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1ec522de-40aa-4eb9-8e48-7f9bde10167b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:04.769371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1ec522de-40aa-4eb9-8e48-7f9bde10167b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:04.785803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ec522de-40aa-4eb9-8e48-7f9bde10167b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.786798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ec522de-40aa-4eb9-8e48-7f9bde10167b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.787858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ec522de-40aa-4eb9-8e48-7f9bde10167b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.790506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1ec522de-40aa-4eb9-8e48-7f9bde10167b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:05.458820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1ec522de-40aa-4eb9-8e48-7f9bde10167b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:05.467433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1ec522de-40aa-4eb9-8e48-7f9bde10167b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:05.468999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1ec522de-40aa-4eb9-8e48-7f9bde10167b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:05.470732 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1ec522de-40aa-4eb9-8e48-7f9bde10167b tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 0.707841 Jul 20 04:27:05.499330 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1996/3970] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:04 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:05.499702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9944ce42-8c97-441e-af42-6089af04e3c1 req-ebe444d1-ab27-4819-9d5f-76fd5612eecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-unplugged", "status": "completed", "tag": "a9b48c51-1561-4d97-9677-27009946bf45"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:05.541696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9944ce42-8c97-441e-af42-6089af04e3c1 req-ebe444d1-ab27-4819-9d5f-76fd5612eecd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:05.550012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9944ce42-8c97-441e-af42-6089af04e3c1 req-ebe444d1-ab27-4819-9d5f-76fd5612eecd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:05.590279 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9944ce42-8c97-441e-af42-6089af04e3c1 req-ebe444d1-ab27-4819-9d5f-76fd5612eecd service nova] Creating event network-vif-unplugged:a9b48c51-1561-4d97-9677-27009946bf45 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:27:05.624175 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9944ce42-8c97-441e-af42-6089af04e3c1 req-ebe444d1-ab27-4819-9d5f-76fd5612eecd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128048 Jul 20 04:27:05.624814 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1997/3971] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:05.937645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ba600afd-9070-42ff-b131-8977cbabe8de req-00778455-9b70-4037-ae39-f34a47375422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-deleted", "tag": "9ef1b0a9-a805-494d-9371-757d4ab1d057"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:05.964424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ba600afd-9070-42ff-b131-8977cbabe8de req-00778455-9b70-4037-ae39-f34a47375422 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:05.964890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ba600afd-9070-42ff-b131-8977cbabe8de req-00778455-9b70-4037-ae39-f34a47375422 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:05.998586 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ba600afd-9070-42ff-b131-8977cbabe8de req-00778455-9b70-4037-ae39-f34a47375422 service nova] Creating event network-vif-deleted:9ef1b0a9-a805-494d-9371-757d4ab1d057 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:27:06.018600 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ba600afd-9070-42ff-b131-8977cbabe8de req-00778455-9b70-4037-ae39-f34a47375422 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086566 Jul 20 04:27:06.019598 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1998/3972] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:06.088004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ad50d910-36d5-462a-9114-a1def1d899f1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.107899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ad50d910-36d5-462a-9114-a1def1d899f1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.115635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ad50d910-36d5-462a-9114-a1def1d899f1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.123718 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ad50d910-36d5-462a-9114-a1def1d899f1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2908 microversion: 2.32 time: 1.503267 Jul 20 04:27:06.141671 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1975/3973] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:04 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2908 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:06.509529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a7e82057-e115-486a-bfac-c3862c48b5cd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:06.510601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a7e82057-e115-486a-bfac-c3862c48b5cd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:06.537210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7e82057-e115-486a-bfac-c3862c48b5cd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.538085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7e82057-e115-486a-bfac-c3862c48b5cd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.539891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7e82057-e115-486a-bfac-c3862c48b5cd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.540497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7e82057-e115-486a-bfac-c3862c48b5cd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.909820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a7e82057-e115-486a-bfac-c3862c48b5cd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.942835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a7e82057-e115-486a-bfac-c3862c48b5cd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.953122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a7e82057-e115-486a-bfac-c3862c48b5cd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.960359 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a7e82057-e115-486a-bfac-c3862c48b5cd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 0.450762 Jul 20 04:27:06.963137 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 1999/3974] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:06 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:07.148851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a66d75e3-b02d-4916-99c2-0bc13d918f20 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:07.160456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a66d75e3-b02d-4916-99c2-0bc13d918f20 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:07.198172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a66d75e3-b02d-4916-99c2-0bc13d918f20 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.201413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a66d75e3-b02d-4916-99c2-0bc13d918f20 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.202617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a66d75e3-b02d-4916-99c2-0bc13d918f20 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.203171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a66d75e3-b02d-4916-99c2-0bc13d918f20 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.612399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a66d75e3-b02d-4916-99c2-0bc13d918f20 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:07.630296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a66d75e3-b02d-4916-99c2-0bc13d918f20 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:07.634228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a66d75e3-b02d-4916-99c2-0bc13d918f20 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:07.638653 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a66d75e3-b02d-4916-99c2-0bc13d918f20 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2702 microversion: 2.32 time: 0.496813 Jul 20 04:27:07.639363 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1976/3975] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:07 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2702 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:07.813399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-015f79e8-2df1-4f8a-8bb2-34ef3caff37a req-fa46aa42-a423-410c-8d56-757fe9643e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-unplugged", "status": "completed", "tag": "cf931418-c175-456d-a8cf-dcc9a12f42e8"}, {"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-unplugged", "status": "completed", "tag": "b90b46cd-4019-4d40-b56c-2fad4191a7fb"}, {"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-unplugged", "status": "completed", "tag": "86a07295-dd78-44c7-98ae-020642c58a78"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:07.833167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-015f79e8-2df1-4f8a-8bb2-34ef3caff37a req-fa46aa42-a423-410c-8d56-757fe9643e3f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.835475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-015f79e8-2df1-4f8a-8bb2-34ef3caff37a req-fa46aa42-a423-410c-8d56-757fe9643e3f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.875171 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-015f79e8-2df1-4f8a-8bb2-34ef3caff37a req-fa46aa42-a423-410c-8d56-757fe9643e3f service nova] Creating event network-vif-unplugged:cf931418-c175-456d-a8cf-dcc9a12f42e8 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:27:07.877737 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-015f79e8-2df1-4f8a-8bb2-34ef3caff37a req-fa46aa42-a423-410c-8d56-757fe9643e3f service nova] Creating event network-vif-unplugged:b90b46cd-4019-4d40-b56c-2fad4191a7fb for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:27:07.879679 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-015f79e8-2df1-4f8a-8bb2-34ef3caff37a req-fa46aa42-a423-410c-8d56-757fe9643e3f service nova] Creating event network-vif-unplugged:86a07295-dd78-44c7-98ae-020642c58a78 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:27:07.895293 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-015f79e8-2df1-4f8a-8bb2-34ef3caff37a req-fa46aa42-a423-410c-8d56-757fe9643e3f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.085953 Jul 20 04:27:07.900521 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2000/3976] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:07.983177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-333aad01-f209-47d6-acf2-ddc3b6763ac9 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:07.983852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-333aad01-f209-47d6-acf2-ddc3b6763ac9 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:07.993457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-333aad01-f209-47d6-acf2-ddc3b6763ac9 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.994808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-333aad01-f209-47d6-acf2-ddc3b6763ac9 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.998739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-333aad01-f209-47d6-acf2-ddc3b6763ac9 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.999362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-333aad01-f209-47d6-acf2-ddc3b6763ac9 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:08.071354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8b391353-f3ce-49fb-b4de-971d7ed22e9f req-d2454feb-85b8-4fdc-81cf-0dbdd16dfb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-deleted", "tag": "b90b46cd-4019-4d40-b56c-2fad4191a7fb"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:08.091406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8b391353-f3ce-49fb-b4de-971d7ed22e9f req-d2454feb-85b8-4fdc-81cf-0dbdd16dfb87 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.098171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8b391353-f3ce-49fb-b4de-971d7ed22e9f req-d2454feb-85b8-4fdc-81cf-0dbdd16dfb87 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:08.177607 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8b391353-f3ce-49fb-b4de-971d7ed22e9f req-d2454feb-85b8-4fdc-81cf-0dbdd16dfb87 service nova] Creating event network-vif-deleted:b90b46cd-4019-4d40-b56c-2fad4191a7fb for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:27:08.218196 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8b391353-f3ce-49fb-b4de-971d7ed22e9f req-d2454feb-85b8-4fdc-81cf-0dbdd16dfb87 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134497 Jul 20 04:27:08.222839 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2001/3977] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:08.433354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-333aad01-f209-47d6-acf2-ddc3b6763ac9 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:08.450847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-333aad01-f209-47d6-acf2-ddc3b6763ac9 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:08.452882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-333aad01-f209-47d6-acf2-ddc3b6763ac9 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:08.456289 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-333aad01-f209-47d6-acf2-ddc3b6763ac9 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 0.477880 Jul 20 04:27:08.470032 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1977/3978] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:07 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:08.659615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97f46076-f317-4ef8-8aeb-77abffcf8c1f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:08.660508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97f46076-f317-4ef8-8aeb-77abffcf8c1f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:08.677000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97f46076-f317-4ef8-8aeb-77abffcf8c1f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.679540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97f46076-f317-4ef8-8aeb-77abffcf8c1f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:08.680823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97f46076-f317-4ef8-8aeb-77abffcf8c1f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.694586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97f46076-f317-4ef8-8aeb-77abffcf8c1f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.479878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-83a4dd43-7c17-44bd-963e-ee2bf5fac590 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:09.481177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-83a4dd43-7c17-44bd-963e-ee2bf5fac590 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:09.487495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97f46076-f317-4ef8-8aeb-77abffcf8c1f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:09.498217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83a4dd43-7c17-44bd-963e-ee2bf5fac590 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.502175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83a4dd43-7c17-44bd-963e-ee2bf5fac590 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.504732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97f46076-f317-4ef8-8aeb-77abffcf8c1f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:09.505451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83a4dd43-7c17-44bd-963e-ee2bf5fac590 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.506018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83a4dd43-7c17-44bd-963e-ee2bf5fac590 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.514381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97f46076-f317-4ef8-8aeb-77abffcf8c1f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:09.515916 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97f46076-f317-4ef8-8aeb-77abffcf8c1f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2542 microversion: 2.32 time: 0.860871 Jul 20 04:27:09.516516 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2002/3979] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:08 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2542 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:10.283177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-83a4dd43-7c17-44bd-963e-ee2bf5fac590 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:10.299288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-83a4dd43-7c17-44bd-963e-ee2bf5fac590 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:10.302727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-83a4dd43-7c17-44bd-963e-ee2bf5fac590 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:10.305870 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-83a4dd43-7c17-44bd-963e-ee2bf5fac590 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 0.832141 Jul 20 04:27:10.313325 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1978/3980] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:09 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:10.331510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-7b827aaf-609b-4579-ac8e-09e815f09bb0 req-6ab4346d-77e8-4a10-ba35-ef865413edc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-deleted", "tag": "cf931418-c175-456d-a8cf-dcc9a12f42e8"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:10.351009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7b827aaf-609b-4579-ac8e-09e815f09bb0 req-6ab4346d-77e8-4a10-ba35-ef865413edc3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.361545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7b827aaf-609b-4579-ac8e-09e815f09bb0 req-6ab4346d-77e8-4a10-ba35-ef865413edc3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.401895 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-7b827aaf-609b-4579-ac8e-09e815f09bb0 req-6ab4346d-77e8-4a10-ba35-ef865413edc3 service nova] Creating event network-vif-deleted:cf931418-c175-456d-a8cf-dcc9a12f42e8 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:27:10.417928 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-7b827aaf-609b-4579-ac8e-09e815f09bb0 req-6ab4346d-77e8-4a10-ba35-ef865413edc3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090109 Jul 20 04:27:10.420537 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2003/3981] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:10.541349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10308ac6-abc3-4f26-9c11-1afc2ee0eea6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:10.543249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10308ac6-abc3-4f26-9c11-1afc2ee0eea6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:10.560332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10308ac6-abc3-4f26-9c11-1afc2ee0eea6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.563498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10308ac6-abc3-4f26-9c11-1afc2ee0eea6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.568445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10308ac6-abc3-4f26-9c11-1afc2ee0eea6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.568913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10308ac6-abc3-4f26-9c11-1afc2ee0eea6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.850148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-658543b6-db95-4389-8ef3-9ac53ffb9f99 req-63a57c6a-8ad1-4b5c-bd0d-d2007997ae0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62df52a-640b-4a48-ba7d-c07b79861b5a", "name": "network-vif-plugged", "status": "completed", "tag": "bacd40a9-c5fe-4ee6-8ccb-b94fcf5db671"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:10.866946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-658543b6-db95-4389-8ef3-9ac53ffb9f99 req-63a57c6a-8ad1-4b5c-bd0d-d2007997ae0d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.867377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-658543b6-db95-4389-8ef3-9ac53ffb9f99 req-63a57c6a-8ad1-4b5c-bd0d-d2007997ae0d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.902167 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-658543b6-db95-4389-8ef3-9ac53ffb9f99 req-63a57c6a-8ad1-4b5c-bd0d-d2007997ae0d service nova] Creating event network-vif-plugged:bacd40a9-c5fe-4ee6-8ccb-b94fcf5db671 for instance b62df52a-640b-4a48-ba7d-c07b79861b5a on n-h1-760456-11 Jul 20 04:27:10.912213 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-658543b6-db95-4389-8ef3-9ac53ffb9f99 req-63a57c6a-8ad1-4b5c-bd0d-d2007997ae0d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066844 Jul 20 04:27:10.915925 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2004/3982] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:11.259856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10308ac6-abc3-4f26-9c11-1afc2ee0eea6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:11.299025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10308ac6-abc3-4f26-9c11-1afc2ee0eea6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:11.310068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10308ac6-abc3-4f26-9c11-1afc2ee0eea6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:11.318173 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10308ac6-abc3-4f26-9c11-1afc2ee0eea6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2339 microversion: 2.32 time: 0.785460 Jul 20 04:27:11.327215 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1979/3983] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:10 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2339 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:11.333965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2cb8924f-4a36-4085-9c8b-68ee43f5250e tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:11.334859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2cb8924f-4a36-4085-9c8b-68ee43f5250e tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:11.360560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2cb8924f-4a36-4085-9c8b-68ee43f5250e tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:11.365419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2cb8924f-4a36-4085-9c8b-68ee43f5250e tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:11.367412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2cb8924f-4a36-4085-9c8b-68ee43f5250e tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:11.376162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2cb8924f-4a36-4085-9c8b-68ee43f5250e tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.257566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2cb8924f-4a36-4085-9c8b-68ee43f5250e tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.269876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2cb8924f-4a36-4085-9c8b-68ee43f5250e tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.271915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2cb8924f-4a36-4085-9c8b-68ee43f5250e tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.273596 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2cb8924f-4a36-4085-9c8b-68ee43f5250e tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1358 microversion: 2.21 time: 0.944403 Jul 20 04:27:12.287318 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2005/3984] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:11 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1358 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:12.342758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b134759d-807c-42b1-85cd-aeaeced5e591 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.343441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b134759d-807c-42b1-85cd-aeaeced5e591 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:12.362477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b134759d-807c-42b1-85cd-aeaeced5e591 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.362577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b134759d-807c-42b1-85cd-aeaeced5e591 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.363395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b134759d-807c-42b1-85cd-aeaeced5e591 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.363847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b134759d-807c-42b1-85cd-aeaeced5e591 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.498433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4b4b8e0c-7333-41ff-ad26-9cd52b41575c req-c9921c69-de77-4c18-ac2e-1012df34905e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-deleted", "tag": "86a07295-dd78-44c7-98ae-020642c58a78"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:12.532419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4b4b8e0c-7333-41ff-ad26-9cd52b41575c req-c9921c69-de77-4c18-ac2e-1012df34905e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.533406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4b4b8e0c-7333-41ff-ad26-9cd52b41575c req-c9921c69-de77-4c18-ac2e-1012df34905e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.581373 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4b4b8e0c-7333-41ff-ad26-9cd52b41575c req-c9921c69-de77-4c18-ac2e-1012df34905e service nova] Creating event network-vif-deleted:86a07295-dd78-44c7-98ae-020642c58a78 for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:27:12.589805 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4b4b8e0c-7333-41ff-ad26-9cd52b41575c req-c9921c69-de77-4c18-ac2e-1012df34905e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094857 Jul 20 04:27:12.591771 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2006/3985] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:12.867362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b134759d-807c-42b1-85cd-aeaeced5e591 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.933502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b134759d-807c-42b1-85cd-aeaeced5e591 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.935417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b134759d-807c-42b1-85cd-aeaeced5e591 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.936672 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b134759d-807c-42b1-85cd-aeaeced5e591 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 2339 microversion: 2.32 time: 0.599811 Jul 20 04:27:12.943590 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1980/3986] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:12 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 2339 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:13.295823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4ad36c54-cf30-4d08-a19b-b5ca0d1c9fbd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:13.296886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4ad36c54-cf30-4d08-a19b-b5ca0d1c9fbd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:13.310842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ad36c54-cf30-4d08-a19b-b5ca0d1c9fbd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:13.312384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ad36c54-cf30-4d08-a19b-b5ca0d1c9fbd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:13.316115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ad36c54-cf30-4d08-a19b-b5ca0d1c9fbd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:13.316845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ad36c54-cf30-4d08-a19b-b5ca0d1c9fbd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:13.967065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-add95edf-7a4a-475f-bd2f-dbcf9e3856f3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:13.969795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-add95edf-7a4a-475f-bd2f-dbcf9e3856f3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:13.996109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-add95edf-7a4a-475f-bd2f-dbcf9e3856f3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.000102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-add95edf-7a4a-475f-bd2f-dbcf9e3856f3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.004263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-add95edf-7a4a-475f-bd2f-dbcf9e3856f3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.006958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-add95edf-7a4a-475f-bd2f-dbcf9e3856f3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.107716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4ad36c54-cf30-4d08-a19b-b5ca0d1c9fbd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.131616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4ad36c54-cf30-4d08-a19b-b5ca0d1c9fbd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.135255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4ad36c54-cf30-4d08-a19b-b5ca0d1c9fbd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.139757 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4ad36c54-cf30-4d08-a19b-b5ca0d1c9fbd tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1550 microversion: 2.21 time: 0.849615 Jul 20 04:27:14.143274 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2007/3987] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:13 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1550 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:14.163875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b0fe1e6-bcb5-4a60-9ffb-9cb5371c5610 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.165249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4b0fe1e6-bcb5-4a60-9ffb-9cb5371c5610 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:14.177596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b0fe1e6-bcb5-4a60-9ffb-9cb5371c5610 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.178072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b0fe1e6-bcb5-4a60-9ffb-9cb5371c5610 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.180257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b0fe1e6-bcb5-4a60-9ffb-9cb5371c5610 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.180721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b0fe1e6-bcb5-4a60-9ffb-9cb5371c5610 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.279361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4b0fe1e6-bcb5-4a60-9ffb-9cb5371c5610 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:14.481586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-add95edf-7a4a-475f-bd2f-dbcf9e3856f3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.481786 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4b0fe1e6-bcb5-4a60-9ffb-9cb5371c5610 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 204 len: 0 microversion: 2.21 time: 0.323324 Jul 20 04:27:14.486447 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2008/3988] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:27:14 2022] DELETE /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:27:14.497601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8afca6fc-2b3a-4177-971a-d6295ac0d8e5 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.498757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8afca6fc-2b3a-4177-971a-d6295ac0d8e5 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:14.500152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-add95edf-7a4a-475f-bd2f-dbcf9e3856f3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.507449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-add95edf-7a4a-475f-bd2f-dbcf9e3856f3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.513017 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-add95edf-7a4a-475f-bd2f-dbcf9e3856f3 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.556388 Jul 20 04:27:14.515128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8afca6fc-2b3a-4177-971a-d6295ac0d8e5 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.516693 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1981/3989] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:13 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:14.517961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8afca6fc-2b3a-4177-971a-d6295ac0d8e5 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.519198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8afca6fc-2b3a-4177-971a-d6295ac0d8e5 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.520376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8afca6fc-2b3a-4177-971a-d6295ac0d8e5 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.705690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d7e090ad-7df4-42df-aeac-3f6ae11d5552 req-62277b7e-d18d-4103-8821-05d33b467741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e49aad2-cba4-4a5a-b719-5c57d8a13e9e", "name": "network-vif-deleted", "tag": "34004e40-bf86-4b70-ba0c-469bb3766bbd"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:14.732007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d7e090ad-7df4-42df-aeac-3f6ae11d5552 req-62277b7e-d18d-4103-8821-05d33b467741 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.732805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d7e090ad-7df4-42df-aeac-3f6ae11d5552 req-62277b7e-d18d-4103-8821-05d33b467741 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.796351 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d7e090ad-7df4-42df-aeac-3f6ae11d5552 req-62277b7e-d18d-4103-8821-05d33b467741 service nova] Creating event network-vif-deleted:34004e40-bf86-4b70-ba0c-469bb3766bbd for instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e on n-h1-760456-11 Jul 20 04:27:14.818081 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d7e090ad-7df4-42df-aeac-3f6ae11d5552 req-62277b7e-d18d-4103-8821-05d33b467741 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118561 Jul 20 04:27:14.820897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1982/3990] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:14.881225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8afca6fc-2b3a-4177-971a-d6295ac0d8e5 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.899888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8afca6fc-2b3a-4177-971a-d6295ac0d8e5 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.911165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8afca6fc-2b3a-4177-971a-d6295ac0d8e5 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.920989 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8afca6fc-2b3a-4177-971a-d6295ac0d8e5 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1556 microversion: 2.21 time: 0.432784 Jul 20 04:27:14.931949 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2009/3991] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:14 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1556 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:15.563480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-449605e4-43b6-44b2-a7ec-58e32b431b9b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:15.565472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-449605e4-43b6-44b2-a7ec-58e32b431b9b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:15.595517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-449605e4-43b6-44b2-a7ec-58e32b431b9b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:15.596210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-449605e4-43b6-44b2-a7ec-58e32b431b9b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.597252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-449605e4-43b6-44b2-a7ec-58e32b431b9b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:15.598428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-449605e4-43b6-44b2-a7ec-58e32b431b9b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.941086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bf5ddf59-c9f7-4fc5-9371-91c71b7266f4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:15.941792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bf5ddf59-c9f7-4fc5-9371-91c71b7266f4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:15.952537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-449605e4-43b6-44b2-a7ec-58e32b431b9b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:15.960292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf5ddf59-c9f7-4fc5-9371-91c71b7266f4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:15.969280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf5ddf59-c9f7-4fc5-9371-91c71b7266f4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.970352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf5ddf59-c9f7-4fc5-9371-91c71b7266f4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:15.970913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bf5ddf59-c9f7-4fc5-9371-91c71b7266f4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.974460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-449605e4-43b6-44b2-a7ec-58e32b431b9b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:15.985146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-449605e4-43b6-44b2-a7ec-58e32b431b9b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:15.993956 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-449605e4-43b6-44b2-a7ec-58e32b431b9b tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.456259 Jul 20 04:27:15.994849 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1983/3992] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:15 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:17.023550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b5e7655c-b0d2-465b-8627-ff9f50949b94 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:17.024937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b5e7655c-b0d2-465b-8627-ff9f50949b94 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:17.043694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5e7655c-b0d2-465b-8627-ff9f50949b94 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:17.048893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5e7655c-b0d2-465b-8627-ff9f50949b94 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:17.051732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5e7655c-b0d2-465b-8627-ff9f50949b94 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:17.053745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5e7655c-b0d2-465b-8627-ff9f50949b94 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:17.248408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bf5ddf59-c9f7-4fc5-9371-91c71b7266f4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:17.285805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b5e7655c-b0d2-465b-8627-ff9f50949b94 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:17.294349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bf5ddf59-c9f7-4fc5-9371-91c71b7266f4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:17.302075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bf5ddf59-c9f7-4fc5-9371-91c71b7266f4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21a5e03823b142198363b07a08d4f4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4be66f05acc44aba09f0fb11ddfa74f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:17.304345 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bf5ddf59-c9f7-4fc5-9371-91c71b7266f4 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 200 len: 1556 microversion: 2.21 time: 1.368591 Jul 20 04:27:17.306609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b5e7655c-b0d2-465b-8627-ff9f50949b94 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:17.307410 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2010/3993] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:15 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 1556 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:17.316464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b5e7655c-b0d2-465b-8627-ff9f50949b94 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:17.317794 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b5e7655c-b0d2-465b-8627-ff9f50949b94 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.299160 Jul 20 04:27:17.326359 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1984/3994] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:17 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:17.510035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9609df5b-1961-4235-bbc7-a781f848ea7c req-20caf7f0-3b4a-4534-a84d-f566b0f188ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62df52a-640b-4a48-ba7d-c07b79861b5a", "name": "network-vif-deleted", "tag": "bacd40a9-c5fe-4ee6-8ccb-b94fcf5db671"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:17.538739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9609df5b-1961-4235-bbc7-a781f848ea7c req-20caf7f0-3b4a-4534-a84d-f566b0f188ce service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:17.539204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9609df5b-1961-4235-bbc7-a781f848ea7c req-20caf7f0-3b4a-4534-a84d-f566b0f188ce service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:17.588697 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9609df5b-1961-4235-bbc7-a781f848ea7c req-20caf7f0-3b4a-4534-a84d-f566b0f188ce service nova] Creating event network-vif-deleted:bacd40a9-c5fe-4ee6-8ccb-b94fcf5db671 for instance b62df52a-640b-4a48-ba7d-c07b79861b5a on n-h1-760456-11 Jul 20 04:27:17.613231 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9609df5b-1961-4235-bbc7-a781f848ea7c req-20caf7f0-3b4a-4534-a84d-f566b0f188ce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107553 Jul 20 04:27:17.618584 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2011/3995] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:18.325126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bf01bfa2-84ee-43c7-a151-26846fd62f37 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:18.325912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bf01bfa2-84ee-43c7-a151-26846fd62f37 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:18.341665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf01bfa2-84ee-43c7-a151-26846fd62f37 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.348521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf01bfa2-84ee-43c7-a151-26846fd62f37 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.351259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf01bfa2-84ee-43c7-a151-26846fd62f37 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.351882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb3765a1-5755-48cf-a924-feeb8a6b1ce1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:18.352372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf01bfa2-84ee-43c7-a151-26846fd62f37 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.353689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb3765a1-5755-48cf-a924-feeb8a6b1ce1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:18.371108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb3765a1-5755-48cf-a924-feeb8a6b1ce1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.374555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb3765a1-5755-48cf-a924-feeb8a6b1ce1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.375804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb3765a1-5755-48cf-a924-feeb8a6b1ce1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.377998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb3765a1-5755-48cf-a924-feeb8a6b1ce1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.399908 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-bf01bfa2-84ee-43c7-a151-26846fd62f37 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] HTTP exception thrown: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bf01bfa2-84ee-43c7-a151-26846fd62f37 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Request method failure captured: Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a HTTP/1.1 Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14QDKKOW4kC9IXZdHK9PQQ0XlgJb7M6BbcZYljuS88Rv30ZpNSaReGwtaZNPSsKWonNOX27nm_DOBYoItN6exUTJ8OqAM8u8BcEOp89JwPjnJzjo9WDlYxv74bPluM7coy591I7UNugSDLgStNwDWpAHVUTDOwyrKsy6uLTe1yvDsCg Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: f4be66f05acc44aba09f0fb11ddfa74f Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-InstanceActionsV221TestJSON-853884535 Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-InstanceActionsV221TestJSON-853884535 Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: f4be66f05acc44aba09f0fb11ddfa74f Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-853884535 Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-InstanceActionsV221TestJSON-853884535-project Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 21a5e03823b142198363b07a08d4f4d1 Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-InstanceActionsV221TestJSON-853884535-project Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'b62df52a-640b-4a48-ba7d-c07b79861b5a'} Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.404751 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:18.409075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.409075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:18.409075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:18.409075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:18.409075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:18.409075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:18.409075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.409075 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.413430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bf01bfa2-84ee-43c7-a151-26846fd62f37 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Returning 404 to user: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:18.417886 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bf01bfa2-84ee-43c7-a151-26846fd62f37 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 404 len: 111 microversion: 2.21 time: 0.096745 Jul 20 04:27:18.424987 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1985/3996] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:18 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:18.445443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bdd44b1b-828a-401e-9119-23b15b1f3dd8 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '.version_select at 0x7fb84120ac10>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:18.446488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bdd44b1b-828a-401e-9119-23b15b1f3dd8 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:18.468567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdd44b1b-828a-401e-9119-23b15b1f3dd8 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.469522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdd44b1b-828a-401e-9119-23b15b1f3dd8 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.475270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdd44b1b-828a-401e-9119-23b15b1f3dd8 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.476139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdd44b1b-828a-401e-9119-23b15b1f3dd8 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.668186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb3765a1-5755-48cf-a924-feeb8a6b1ce1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:18.681310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb3765a1-5755-48cf-a924-feeb8a6b1ce1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:18.682878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb3765a1-5755-48cf-a924-feeb8a6b1ce1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:18.693865 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb3765a1-5755-48cf-a924-feeb8a6b1ce1 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.352736 Jul 20 04:27:18.695190 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2012/3997] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:18 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:18.723790 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bdd44b1b-828a-401e-9119-23b15b1f3dd8 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.293313 Jul 20 04:27:18.725331 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1986/3998] 10.222.0.59 () {60 vars in 1336 bytes} [Wed Jul 20 04:27:18 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a/os-instance-actions => generated 611 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:27:18.737114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca23a5b2-4af6-4779-9ae3-12def257c0a7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:18.737873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ca23a5b2-4af6-4779-9ae3-12def257c0a7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:18.748988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca23a5b2-4af6-4779-9ae3-12def257c0a7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.749637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca23a5b2-4af6-4779-9ae3-12def257c0a7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.750791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca23a5b2-4af6-4779-9ae3-12def257c0a7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.752264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca23a5b2-4af6-4779-9ae3-12def257c0a7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.766165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:18.786463 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-ca23a5b2-4af6-4779-9ae3-12def257c0a7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] HTTP exception thrown: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca23a5b2-4af6-4779-9ae3-12def257c0a7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Request method failure captured: Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a HTTP/1.1 Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14QDKKOW4kC9IXZdHK9PQQ0XlgJb7M6BbcZYljuS88Rv30ZpNSaReGwtaZNPSsKWonNOX27nm_DOBYoItN6exUTJ8OqAM8u8BcEOp89JwPjnJzjo9WDlYxv74bPluM7coy591I7UNugSDLgStNwDWpAHVUTDOwyrKsy6uLTe1yvDsCg Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: f4be66f05acc44aba09f0fb11ddfa74f Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-InstanceActionsV221TestJSON-853884535 Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-InstanceActionsV221TestJSON-853884535 Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: f4be66f05acc44aba09f0fb11ddfa74f Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-853884535 Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-InstanceActionsV221TestJSON-853884535-project Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 21a5e03823b142198363b07a08d4f4d1 Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-InstanceActionsV221TestJSON-853884535-project Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'b62df52a-640b-4a48-ba7d-c07b79861b5a'} Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:18.793216 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.797555 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.802202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca23a5b2-4af6-4779-9ae3-12def257c0a7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Returning 404 to user: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:18.803286 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ca23a5b2-4af6-4779-9ae3-12def257c0a7 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 404 len: 111 microversion: 2.21 time: 0.070164 Jul 20 04:27:18.810560 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2013/3999] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:27:18 2022] DELETE /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:18.814694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-185f1569-aba7-43b8-acc0-b357b2524387 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:18.815317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-185f1569-aba7-43b8-acc0-b357b2524387 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] [instance: b62df52a-640b-4a48-ba7d-c07b79861b5a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:18.835021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-185f1569-aba7-43b8-acc0-b357b2524387 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.835671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-185f1569-aba7-43b8-acc0-b357b2524387 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.836543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-185f1569-aba7-43b8-acc0-b357b2524387 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:18.837074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-185f1569-aba7-43b8-acc0-b357b2524387 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:18.903681 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-185f1569-aba7-43b8-acc0-b357b2524387 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] HTTP exception thrown: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-185f1569-aba7-43b8-acc0-b357b2524387 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Request method failure captured: Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a HTTP/1.1 Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14QDKKOW4kC9IXZdHK9PQQ0XlgJb7M6BbcZYljuS88Rv30ZpNSaReGwtaZNPSsKWonNOX27nm_DOBYoItN6exUTJ8OqAM8u8BcEOp89JwPjnJzjo9WDlYxv74bPluM7coy591I7UNugSDLgStNwDWpAHVUTDOwyrKsy6uLTe1yvDsCg Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: f4be66f05acc44aba09f0fb11ddfa74f Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-InstanceActionsV221TestJSON-853884535 Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f4be66f05acc44aba09f0fb11ddfa74f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-InstanceActionsV221TestJSON-853884535 Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: f4be66f05acc44aba09f0fb11ddfa74f Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-853884535 Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-InstanceActionsV221TestJSON-853884535-project Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 21a5e03823b142198363b07a08d4f4d1 Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-InstanceActionsV221TestJSON-853884535-project Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'b62df52a-640b-4a48-ba7d-c07b79861b5a'} Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.909896 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:18.913667 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.913667 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:18.913667 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:18.913667 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:18.913667 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:18.913667 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:18.913667 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. Jul 20 04:27:18.913667 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:18.921864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-185f1569-aba7-43b8-acc0-b357b2524387 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] Returning 404 to user: Instance b62df52a-640b-4a48-ba7d-c07b79861b5a could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:18.930783 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-185f1569-aba7-43b8-acc0-b357b2524387 tempest-InstanceActionsV221TestJSON-853884535 tempest-InstanceActionsV221TestJSON-853884535-project] 10.222.0.59 "GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a" status: 404 len: 111 microversion: 2.21 time: 0.120841 Jul 20 04:27:18.932380 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1987/4000] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:18 2022] GET /compute/v2.1/servers/b62df52a-640b-4a48-ba7d-c07b79861b5a => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:27:19.715795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9b45935-1f36-4074-ad1d-58fce462309f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:19.717652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c9b45935-1f36-4074-ad1d-58fce462309f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:19.741894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9b45935-1f36-4074-ad1d-58fce462309f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:19.754618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9b45935-1f36-4074-ad1d-58fce462309f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:19.756201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9b45935-1f36-4074-ad1d-58fce462309f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:19.757843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9b45935-1f36-4074-ad1d-58fce462309f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:19.954416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c9b45935-1f36-4074-ad1d-58fce462309f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:19.969083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c9b45935-1f36-4074-ad1d-58fce462309f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:19.973954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c9b45935-1f36-4074-ad1d-58fce462309f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:19.975644 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c9b45935-1f36-4074-ad1d-58fce462309f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.266099 Jul 20 04:27:19.978691 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2014/4001] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:19 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:20.999418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-61add189-c309-4c83-adb8-b0702140cfcd tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:21.000684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-61add189-c309-4c83-adb8-b0702140cfcd tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:21.029455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61add189-c309-4c83-adb8-b0702140cfcd tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.029937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61add189-c309-4c83-adb8-b0702140cfcd tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.030771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61add189-c309-4c83-adb8-b0702140cfcd tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.036806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61add189-c309-4c83-adb8-b0702140cfcd tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.280057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-61add189-c309-4c83-adb8-b0702140cfcd tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.300366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-61add189-c309-4c83-adb8-b0702140cfcd tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.303758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-61add189-c309-4c83-adb8-b0702140cfcd tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.308455 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-61add189-c309-4c83-adb8-b0702140cfcd tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.314315 Jul 20 04:27:21.330853 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1988/4002] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:20 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:22.329866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-936ba42b-ec66-4efd-9185-5e1e9eba079c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:22.332267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-936ba42b-ec66-4efd-9185-5e1e9eba079c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:22.373558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-936ba42b-ec66-4efd-9185-5e1e9eba079c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.379600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-936ba42b-ec66-4efd-9185-5e1e9eba079c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.382184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-936ba42b-ec66-4efd-9185-5e1e9eba079c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.387656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-936ba42b-ec66-4efd-9185-5e1e9eba079c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.748029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-936ba42b-ec66-4efd-9185-5e1e9eba079c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:22.766727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-936ba42b-ec66-4efd-9185-5e1e9eba079c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:22.772935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-936ba42b-ec66-4efd-9185-5e1e9eba079c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:22.777847 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-936ba42b-ec66-4efd-9185-5e1e9eba079c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.452571 Jul 20 04:27:22.778896 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2015/4003] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:22 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:23.798366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-05ee3ed2-4e40-476c-8180-d1100250ec8f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:23.799584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05ee3ed2-4e40-476c-8180-d1100250ec8f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:23.826361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05ee3ed2-4e40-476c-8180-d1100250ec8f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:23.827243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05ee3ed2-4e40-476c-8180-d1100250ec8f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:23.831181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05ee3ed2-4e40-476c-8180-d1100250ec8f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:23.831821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05ee3ed2-4e40-476c-8180-d1100250ec8f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.171017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05ee3ed2-4e40-476c-8180-d1100250ec8f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:24.196315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05ee3ed2-4e40-476c-8180-d1100250ec8f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:24.213310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05ee3ed2-4e40-476c-8180-d1100250ec8f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:24.220950 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-05ee3ed2-4e40-476c-8180-d1100250ec8f tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.427174 Jul 20 04:27:24.239734 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1989/4004] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:23 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:25.254277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04176373-f365-4339-afbe-205dda6eda16 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:25.254931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04176373-f365-4339-afbe-205dda6eda16 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:25.268025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04176373-f365-4339-afbe-205dda6eda16 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:25.271211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04176373-f365-4339-afbe-205dda6eda16 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:25.274976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04176373-f365-4339-afbe-205dda6eda16 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:25.277076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04176373-f365-4339-afbe-205dda6eda16 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:25.675615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-04176373-f365-4339-afbe-205dda6eda16 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:25.711060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-04176373-f365-4339-afbe-205dda6eda16 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:25.713972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-04176373-f365-4339-afbe-205dda6eda16 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:25.715899 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04176373-f365-4339-afbe-205dda6eda16 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.467368 Jul 20 04:27:25.735600 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2016/4005] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:25 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:26.742335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a77968c-2035-48c4-8df0-9c6edc7b8a22 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:26.744613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0a77968c-2035-48c4-8df0-9c6edc7b8a22 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:26.771767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a77968c-2035-48c4-8df0-9c6edc7b8a22 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.773133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a77968c-2035-48c4-8df0-9c6edc7b8a22 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.774447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a77968c-2035-48c4-8df0-9c6edc7b8a22 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.785311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a77968c-2035-48c4-8df0-9c6edc7b8a22 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:27.586695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0a77968c-2035-48c4-8df0-9c6edc7b8a22 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:27.604146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0a77968c-2035-48c4-8df0-9c6edc7b8a22 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:27.607568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0a77968c-2035-48c4-8df0-9c6edc7b8a22 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:27.608801 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a77968c-2035-48c4-8df0-9c6edc7b8a22 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.874479 Jul 20 04:27:27.609404 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1990/4006] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:26 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:28.630226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-701acf48-6e1f-487a-bb51-2a1c13cc3cb5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:28.630763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-701acf48-6e1f-487a-bb51-2a1c13cc3cb5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:28.634205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:28.644234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-701acf48-6e1f-487a-bb51-2a1c13cc3cb5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.644697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-701acf48-6e1f-487a-bb51-2a1c13cc3cb5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.645497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-701acf48-6e1f-487a-bb51-2a1c13cc3cb5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.645943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-701acf48-6e1f-487a-bb51-2a1c13cc3cb5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.880894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-701acf48-6e1f-487a-bb51-2a1c13cc3cb5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.911035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-701acf48-6e1f-487a-bb51-2a1c13cc3cb5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.917315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-701acf48-6e1f-487a-bb51-2a1c13cc3cb5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.922394 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-701acf48-6e1f-487a-bb51-2a1c13cc3cb5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.297508 Jul 20 04:27:28.923554 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2017/4007] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:28 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:29.945465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-abde0afa-ae7e-4f1d-9dd9-e78281698cd0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:29.946615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-abde0afa-ae7e-4f1d-9dd9-e78281698cd0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:29.961516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abde0afa-ae7e-4f1d-9dd9-e78281698cd0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.963552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abde0afa-ae7e-4f1d-9dd9-e78281698cd0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:29.964372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abde0afa-ae7e-4f1d-9dd9-e78281698cd0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.964834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abde0afa-ae7e-4f1d-9dd9-e78281698cd0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.269906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04136f15-3053-48ce-8898-a791a9d5bce3 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:30.271575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04136f15-3053-48ce-8898-a791a9d5bce3 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:30.289423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04136f15-3053-48ce-8898-a791a9d5bce3 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.290327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04136f15-3053-48ce-8898-a791a9d5bce3 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.293557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04136f15-3053-48ce-8898-a791a9d5bce3 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.294037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04136f15-3053-48ce-8898-a791a9d5bce3 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.335696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04136f15-3053-48ce-8898-a791a9d5bce3 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:30.537776 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04136f15-3053-48ce-8898-a791a9d5bce3 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 204 len: 0 microversion: 2.1 time: 0.278534 Jul 20 04:27:30.540257 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2018/4008] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:30 2022] DELETE /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:30.559429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c014759-c991-403b-b4b5-bef93327e6ca tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:30.561890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2c014759-c991-403b-b4b5-bef93327e6ca tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:30.586026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c014759-c991-403b-b4b5-bef93327e6ca tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.599700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c014759-c991-403b-b4b5-bef93327e6ca tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.604069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c014759-c991-403b-b4b5-bef93327e6ca tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.605319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c014759-c991-403b-b4b5-bef93327e6ca tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.773677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:30.928183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-abde0afa-ae7e-4f1d-9dd9-e78281698cd0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.944077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-abde0afa-ae7e-4f1d-9dd9-e78281698cd0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.948403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-abde0afa-ae7e-4f1d-9dd9-e78281698cd0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.951735 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-abde0afa-ae7e-4f1d-9dd9-e78281698cd0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 1.009234 Jul 20 04:27:30.953850 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1991/4009] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:29 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:31.503037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c014759-c991-403b-b4b5-bef93327e6ca tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:31.515853 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c014759-c991-403b-b4b5-bef93327e6ca tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1664 microversion: 2.1 time: 0.965486 Jul 20 04:27:31.520821 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2019/4010] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:30 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1664 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:31.993009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc61cb39-2df4-4055-b152-17e67e2737cf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:31.993680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cc61cb39-2df4-4055-b152-17e67e2737cf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:32.012513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=38 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:32.015268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc61cb39-2df4-4055-b152-17e67e2737cf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.019731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc61cb39-2df4-4055-b152-17e67e2737cf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.020755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc61cb39-2df4-4055-b152-17e67e2737cf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.023721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc61cb39-2df4-4055-b152-17e67e2737cf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.253586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cc61cb39-2df4-4055-b152-17e67e2737cf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:32.284869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cc61cb39-2df4-4055-b152-17e67e2737cf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:32.286753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cc61cb39-2df4-4055-b152-17e67e2737cf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:32.287991 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cc61cb39-2df4-4055-b152-17e67e2737cf tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.318597 Jul 20 04:27:32.299648 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1992/4011] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:31 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:32.536185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83372672-1cc2-44a9-8c60-ae09497e27ec tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:32.537572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-83372672-1cc2-44a9-8c60-ae09497e27ec tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:32.556119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83372672-1cc2-44a9-8c60-ae09497e27ec tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.556595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83372672-1cc2-44a9-8c60-ae09497e27ec tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.557429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83372672-1cc2-44a9-8c60-ae09497e27ec tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.558499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83372672-1cc2-44a9-8c60-ae09497e27ec tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.908153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-83372672-1cc2-44a9-8c60-ae09497e27ec tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:32.919873 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-83372672-1cc2-44a9-8c60-ae09497e27ec tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1664 microversion: 2.1 time: 0.389337 Jul 20 04:27:32.932615 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2020/4012] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:32 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1664 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:33.329590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df95435c-b8f9-4daf-9798-eec66855e238 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:33.332462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-df95435c-b8f9-4daf-9798-eec66855e238 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:33.360238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df95435c-b8f9-4daf-9798-eec66855e238 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:33.361906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df95435c-b8f9-4daf-9798-eec66855e238 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:33.368591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df95435c-b8f9-4daf-9798-eec66855e238 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:33.371074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df95435c-b8f9-4daf-9798-eec66855e238 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:33.632073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df95435c-b8f9-4daf-9798-eec66855e238 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:33.664202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df95435c-b8f9-4daf-9798-eec66855e238 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:33.665863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df95435c-b8f9-4daf-9798-eec66855e238 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:33.677197 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-df95435c-b8f9-4daf-9798-eec66855e238 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.362942 Jul 20 04:27:33.693751 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1993/4013] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:33 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:33.939958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8e551c2d-60bd-4cf4-bde4-8a29d43ccc3b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:33.942217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8e551c2d-60bd-4cf4-bde4-8a29d43ccc3b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:33.950320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e551c2d-60bd-4cf4-bde4-8a29d43ccc3b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:33.951269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e551c2d-60bd-4cf4-bde4-8a29d43ccc3b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:33.952651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e551c2d-60bd-4cf4-bde4-8a29d43ccc3b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:33.953440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e551c2d-60bd-4cf4-bde4-8a29d43ccc3b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.594036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8e551c2d-60bd-4cf4-bde4-8a29d43ccc3b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:34.602384 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8e551c2d-60bd-4cf4-bde4-8a29d43ccc3b tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1664 microversion: 2.1 time: 0.667583 Jul 20 04:27:34.613693 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2021/4014] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:33 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1664 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:34.696936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9601ccb5-6695-43a3-9397-2da7030357a2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:34.697558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9601ccb5-6695-43a3-9397-2da7030357a2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:34.721394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9601ccb5-6695-43a3-9397-2da7030357a2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.736608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9601ccb5-6695-43a3-9397-2da7030357a2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.750195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9601ccb5-6695-43a3-9397-2da7030357a2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.752666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9601ccb5-6695-43a3-9397-2da7030357a2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.268740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9601ccb5-6695-43a3-9397-2da7030357a2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:35.292449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9601ccb5-6695-43a3-9397-2da7030357a2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:35.324129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9601ccb5-6695-43a3-9397-2da7030357a2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:35.333407 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9601ccb5-6695-43a3-9397-2da7030357a2 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.632884 Jul 20 04:27:35.334297 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1994/4015] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:34 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:35.628673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c9b2b52-7a73-4bc9-9bfa-91b3aaacba6c tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:35.629310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3c9b2b52-7a73-4bc9-9bfa-91b3aaacba6c tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:35.666892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c9b2b52-7a73-4bc9-9bfa-91b3aaacba6c tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.667489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c9b2b52-7a73-4bc9-9bfa-91b3aaacba6c tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.668334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c9b2b52-7a73-4bc9-9bfa-91b3aaacba6c tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.668786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c9b2b52-7a73-4bc9-9bfa-91b3aaacba6c tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.887959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3c9b2b52-7a73-4bc9-9bfa-91b3aaacba6c tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:35.901635 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3c9b2b52-7a73-4bc9-9bfa-91b3aaacba6c tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1596 microversion: 2.1 time: 0.281372 Jul 20 04:27:35.903994 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2022/4016] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:35 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1596 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:36.356060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-272c7735-6024-45e4-96d0-76856aba0cb4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:36.357575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-272c7735-6024-45e4-96d0-76856aba0cb4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:36.387188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-272c7735-6024-45e4-96d0-76856aba0cb4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.389746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-272c7735-6024-45e4-96d0-76856aba0cb4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.390872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-272c7735-6024-45e4-96d0-76856aba0cb4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.392364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-272c7735-6024-45e4-96d0-76856aba0cb4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.765028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-272c7735-6024-45e4-96d0-76856aba0cb4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:36.810841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-272c7735-6024-45e4-96d0-76856aba0cb4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:36.822984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-272c7735-6024-45e4-96d0-76856aba0cb4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:36.829790 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-272c7735-6024-45e4-96d0-76856aba0cb4 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.475230 Jul 20 04:27:36.833857 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1995/4017] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:36 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:36.921991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1fc41658-38e5-4d38-a222-3fd99e0dfb69 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:36.922755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1fc41658-38e5-4d38-a222-3fd99e0dfb69 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:36.944563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fc41658-38e5-4d38-a222-3fd99e0dfb69 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.945134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fc41658-38e5-4d38-a222-3fd99e0dfb69 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.945993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fc41658-38e5-4d38-a222-3fd99e0dfb69 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.946477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fc41658-38e5-4d38-a222-3fd99e0dfb69 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:37.220599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1fc41658-38e5-4d38-a222-3fd99e0dfb69 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:37.231481 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1fc41658-38e5-4d38-a222-3fd99e0dfb69 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1596 microversion: 2.1 time: 0.314328 Jul 20 04:27:37.245933 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2023/4018] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:36 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1596 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:37.514580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5de02efa-ff27-4ad5-895c-10b8ed52e31a req-a3e24ada-3d05-44bd-bc37-5cbe66f8c24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a40b6d7-f555-47c1-ada4-403fd310538c", "name": "network-vif-deleted", "tag": "da1344eb-40ae-4d16-8070-db65871b1e43"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:37.548393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5de02efa-ff27-4ad5-895c-10b8ed52e31a req-a3e24ada-3d05-44bd-bc37-5cbe66f8c24b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:37.550782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5de02efa-ff27-4ad5-895c-10b8ed52e31a req-a3e24ada-3d05-44bd-bc37-5cbe66f8c24b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:37.600176 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5de02efa-ff27-4ad5-895c-10b8ed52e31a req-a3e24ada-3d05-44bd-bc37-5cbe66f8c24b service nova] Creating event network-vif-deleted:da1344eb-40ae-4d16-8070-db65871b1e43 for instance 4a40b6d7-f555-47c1-ada4-403fd310538c on n-h2-760456-11 Jul 20 04:27:37.621642 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5de02efa-ff27-4ad5-895c-10b8ed52e31a req-a3e24ada-3d05-44bd-bc37-5cbe66f8c24b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110229 Jul 20 04:27:37.624910 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1996/4019] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:37.854722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cf300f7b-4b85-4e8e-9096-33d4f083ba9a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:37.855736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cf300f7b-4b85-4e8e-9096-33d4f083ba9a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:37.868815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf300f7b-4b85-4e8e-9096-33d4f083ba9a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:37.875161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf300f7b-4b85-4e8e-9096-33d4f083ba9a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:37.881574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf300f7b-4b85-4e8e-9096-33d4f083ba9a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:37.882943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf300f7b-4b85-4e8e-9096-33d4f083ba9a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.193871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cf300f7b-4b85-4e8e-9096-33d4f083ba9a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:38.212857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cf300f7b-4b85-4e8e-9096-33d4f083ba9a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:38.225023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cf300f7b-4b85-4e8e-9096-33d4f083ba9a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:38.231078 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cf300f7b-4b85-4e8e-9096-33d4f083ba9a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.380718 Jul 20 04:27:38.238633 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2024/4020] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:37 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:38.256481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:38.262777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:38.276974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.290862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.291861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.292570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.438449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.438449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.448066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lazy-loading 'fault' on Instance uuid 4a40b6d7-f555-47c1-ada4-403fd310538c {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:27:38.636491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0e73fdd5142acaad64b423e592249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cc955243624af284b786e810c70833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:38.645476 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f6b255a-0bfd-4d7a-8aad-6e1a6749735d tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 200 len: 1315 microversion: 2.1 time: 0.393442 Jul 20 04:27:38.654626 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1997/4021] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:38 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:39.258705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2d844c5f-ba30-445b-abb6-9c1cda1c494a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:39.259522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2d844c5f-ba30-445b-abb6-9c1cda1c494a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:39.277263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d844c5f-ba30-445b-abb6-9c1cda1c494a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.278569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d844c5f-ba30-445b-abb6-9c1cda1c494a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.281351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d844c5f-ba30-445b-abb6-9c1cda1c494a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.283254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d844c5f-ba30-445b-abb6-9c1cda1c494a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.451871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d844c5f-ba30-445b-abb6-9c1cda1c494a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:39.471633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d844c5f-ba30-445b-abb6-9c1cda1c494a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:39.479576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d844c5f-ba30-445b-abb6-9c1cda1c494a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:39.488910 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2d844c5f-ba30-445b-abb6-9c1cda1c494a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.230126 Jul 20 04:27:39.490232 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2025/4022] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:39 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:39.665849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b9d1672-bd68-4f9e-8718-124adb61de88 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:39.666678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6b9d1672-bd68-4f9e-8718-124adb61de88 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] [instance: 4a40b6d7-f555-47c1-ada4-403fd310538c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:39.681826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b9d1672-bd68-4f9e-8718-124adb61de88 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.689336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b9d1672-bd68-4f9e-8718-124adb61de88 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.690321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b9d1672-bd68-4f9e-8718-124adb61de88 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.690997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b9d1672-bd68-4f9e-8718-124adb61de88 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.740397 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-6b9d1672-bd68-4f9e-8718-124adb61de88 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] HTTP exception thrown: Instance 4a40b6d7-f555-47c1-ada4-403fd310538c could not be found. Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b9d1672-bd68-4f9e-8718-124adb61de88 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Request method failure captured: Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c HTTP/1.1 Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14PqZ3oX5PMnclRy1nMznwsp5iia_AevuwKQ7ywzKx4PyIYoZH4RZ7y4Ea7P3G4nIzhmKJ3vxtCZyNZ6goIv6FOrR8LkK5xLgp8OZ5GhPzTIBm82lNu9GQ7Bc7Sqx5SbkqSWoXKoAY3BtF2tSmThGQuX0_2Vwbb8C5if9k1QaHeUDrA Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b1cc955243624af284b786e810c70833 Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestFqdnHostnames-1544500539 Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b1cc955243624af284b786e810c70833"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b1cc955243624af284b786e810c70833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b1cc955243624af284b786e810c70833"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b1cc955243624af284b786e810c70833"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestFqdnHostnames-1544500539 Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b1cc955243624af284b786e810c70833 Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1544500539 Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestFqdnHostnames-1544500539-project Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2db0e73fdd5142acaad64b423e592249 Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestFqdnHostnames-1544500539-project Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4a40b6d7-f555-47c1-ada4-403fd310538c could not be found. Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4a40b6d7-f555-47c1-ada4-403fd310538c'} Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a40b6d7-f555-47c1-ada4-403fd310538c could not be found. Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a40b6d7-f555-47c1-ada4-403fd310538c could not be found. Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:39.742365 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:39.746950 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:39.746950 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:39.746950 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:39.746950 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:39.746950 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:39.746950 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a40b6d7-f555-47c1-ada4-403fd310538c could not be found. Jul 20 04:27:39.746950 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:27:39.762827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b9d1672-bd68-4f9e-8718-124adb61de88 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Returning 404 to user: Instance 4a40b6d7-f555-47c1-ada4-403fd310538c could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:39.763897 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b9d1672-bd68-4f9e-8718-124adb61de88 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c" status: 404 len: 111 microversion: 2.1 time: 0.102337 Jul 20 04:27:39.764600 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1998/4023] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:39 2022] GET /compute/v2.1/servers/4a40b6d7-f555-47c1-ada4-403fd310538c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:39.773406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b1dd21b-4ef3-4e2a-b22a-050e4a38e203 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] Calling method '.version_select at 0x7fb841d01280>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:39.820430 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6b1dd21b-4ef3-4e2a-b22a-050e4a38e203 tempest-ServersTestFqdnHostnames-1544500539 tempest-ServersTestFqdnHostnames-1544500539-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-725374488" status: 202 len: 0 microversion: 2.1 time: 0.050806 Jul 20 04:27:39.821701 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2026/4024] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 04:27:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-725374488 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:40.508961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9142a2d9-a28d-444a-b8c9-4ed6be617748 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:40.509740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9142a2d9-a28d-444a-b8c9-4ed6be617748 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:40.528394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9142a2d9-a28d-444a-b8c9-4ed6be617748 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:40.533004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9142a2d9-a28d-444a-b8c9-4ed6be617748 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:40.537175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9142a2d9-a28d-444a-b8c9-4ed6be617748 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:40.537970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9142a2d9-a28d-444a-b8c9-4ed6be617748 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:40.767093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9142a2d9-a28d-444a-b8c9-4ed6be617748 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:40.782599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9142a2d9-a28d-444a-b8c9-4ed6be617748 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:40.785140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9142a2d9-a28d-444a-b8c9-4ed6be617748 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:40.799108 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9142a2d9-a28d-444a-b8c9-4ed6be617748 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.293921 Jul 20 04:27:40.804262 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 1999/4025] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:40 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:41.825332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-866f2842-6c04-4d21-a20e-cbd9c760b969 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:41.825962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-866f2842-6c04-4d21-a20e-cbd9c760b969 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:41.845614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-866f2842-6c04-4d21-a20e-cbd9c760b969 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.846083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-866f2842-6c04-4d21-a20e-cbd9c760b969 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.846924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-866f2842-6c04-4d21-a20e-cbd9c760b969 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.847386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-866f2842-6c04-4d21-a20e-cbd9c760b969 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.031009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-866f2842-6c04-4d21-a20e-cbd9c760b969 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.044324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-866f2842-6c04-4d21-a20e-cbd9c760b969 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.045867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-866f2842-6c04-4d21-a20e-cbd9c760b969 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.064053 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-866f2842-6c04-4d21-a20e-cbd9c760b969 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.242469 Jul 20 04:27:42.065000 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2027/4026] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:41 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:43.083881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b247f537-2ffa-4d59-a058-6fbe9d89bce0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:43.084506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b247f537-2ffa-4d59-a058-6fbe9d89bce0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:43.116966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b247f537-2ffa-4d59-a058-6fbe9d89bce0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.117718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b247f537-2ffa-4d59-a058-6fbe9d89bce0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.131993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b247f537-2ffa-4d59-a058-6fbe9d89bce0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.132464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b247f537-2ffa-4d59-a058-6fbe9d89bce0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.569747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b247f537-2ffa-4d59-a058-6fbe9d89bce0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.580081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b247f537-2ffa-4d59-a058-6fbe9d89bce0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.588360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b247f537-2ffa-4d59-a058-6fbe9d89bce0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.591738 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b247f537-2ffa-4d59-a058-6fbe9d89bce0 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.512882 Jul 20 04:27:43.599124 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2000/4027] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:43 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:44.617853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d31e7127-0284-47a6-a8fd-952c86c4e303 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:44.619300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d31e7127-0284-47a6-a8fd-952c86c4e303 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:44.635357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d31e7127-0284-47a6-a8fd-952c86c4e303 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.642243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d31e7127-0284-47a6-a8fd-952c86c4e303 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.643494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d31e7127-0284-47a6-a8fd-952c86c4e303 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.644112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d31e7127-0284-47a6-a8fd-952c86c4e303 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:45.027617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d31e7127-0284-47a6-a8fd-952c86c4e303 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:45.051328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d31e7127-0284-47a6-a8fd-952c86c4e303 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:45.055887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d31e7127-0284-47a6-a8fd-952c86c4e303 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:45.057327 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d31e7127-0284-47a6-a8fd-952c86c4e303 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1604 microversion: 2.32 time: 0.444482 Jul 20 04:27:45.060841 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2028/4028] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:44 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1604 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:46.082706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:46.083331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:46.098684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.099082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.108438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.108914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.261926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.267694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.269897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lazy-loading 'fault' on Instance uuid 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:27:46.401466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:46.411569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:46.413106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4c2a58aa4047368a21fcc59bcdb42d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b85c906b4a2497f88c62f8b2c021ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:46.430749 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-72fcd892-3ebc-4840-a767-ebf1a69f0e0a tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 200 len: 1609 microversion: 2.32 time: 0.338201 Jul 20 04:27:46.442774 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2001/4029] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:46 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 1609 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:47.456182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-250a1f83-e8f9-4409-8b22-6fec842ebc6c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:47.457542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-250a1f83-e8f9-4409-8b22-6fec842ebc6c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:47.475548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-250a1f83-e8f9-4409-8b22-6fec842ebc6c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.478713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-250a1f83-e8f9-4409-8b22-6fec842ebc6c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.479841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-250a1f83-e8f9-4409-8b22-6fec842ebc6c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.480516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-250a1f83-e8f9-4409-8b22-6fec842ebc6c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.519676 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-250a1f83-e8f9-4409-8b22-6fec842ebc6c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] HTTP exception thrown: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-250a1f83-e8f9-4409-8b22-6fec842ebc6c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Request method failure captured: Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e HTTP/1.1 Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14KULc5jYbIJlf1zdCxNqADWEEcXfUFKI9bMK3gD1NJmEXCUw5ZAmUpGV0wcGa7_gx5NSaOgExpEwENNTKj5qvZH-U1faIv_bCRnBVRGGSsDkft4mXVgfdHCp5T4J-GOJQJ5D-2iAh-4WRzN6fa4K0Y9uSEI45CRNrJTiwcOQ081pIc Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1b85c906b4a2497f88c62f8b2c021ae5 Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TaggedBootDevicesTest-200731701 Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TaggedBootDevicesTest-200731701 Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1b85c906b4a2497f88c62f8b2c021ae5 Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TaggedBootDevicesTest-200731701 Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TaggedBootDevicesTest-200731701-project Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 0b4c2a58aa4047368a21fcc59bcdb42d Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TaggedBootDevicesTest-200731701-project Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4e49aad2-cba4-4a5a-b719-5c57d8a13e9e'} Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:47.523665 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:27:47.527450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:47.527450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:47.527450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:47.527450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:47.527450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:47.527450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:27:47.527450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:27:47.531237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-250a1f83-e8f9-4409-8b22-6fec842ebc6c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Returning 404 to user: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:47.535833 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-250a1f83-e8f9-4409-8b22-6fec842ebc6c tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 404 len: 111 microversion: 2.32 time: 0.083307 Jul 20 04:27:47.538562 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2029/4030] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:47 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:47.546202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8427a1e1-69c9-4486-9f50-7d4ce22b47ca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '.version_select at 0x7fb841288790>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:47.583467 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8427a1e1-69c9-4486-9f50-7d4ce22b47ca tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771184430" status: 204 len: 0 microversion: 2.32 time: 0.041463 Jul 20 04:27:47.587396 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2002/4031] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:27:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771184430 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:27:54.807215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1652408334", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "fe8c3d4a-bea7-4989-abb3-d7005cdca4e7"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:54.942312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] validate_networks() for [('fe8c3d4a-bea7-4989-abb3-d7005cdca4e7', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:27:57.519754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:57.979636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:27:57.980218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:27:57.980706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:27:57.981126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:27:57.981545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:27:58.010988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.012043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.012951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.020076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.088867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Getting quotas for project e84ee4736e8c4818bffd3b624ed7edbc. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:58.104873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Getting quotas for user 5a6f9350148f496183a3fa7aeb2c4680 and project e84ee4736e8c4818bffd3b624ed7edbc. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:58.150142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Going to run 3 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:27:58.158783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:58.286809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: a458c18a-83a4-4d50-aa70-405fc0efc33c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:58.363245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=a458c18a-83a4-4d50-aa70-405fc0efc33c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:58.574088 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b677d4f-1cee-4b39-81ef-3afe9d4f2612 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.356493 Jul 20 04:27:58.584796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=61 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:58.585549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:58.589485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c61dcb0c-df19-4e89-8a70-6053dec8aba1 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:58.594351 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2030/4032] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:27:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:27:58.597092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c61dcb0c-df19-4e89-8a70-6053dec8aba1 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:58.597890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c61dcb0c-df19-4e89-8a70-6053dec8aba1 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Searching by: {'deleted': False, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:58.659754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c61dcb0c-df19-4e89-8a70-6053dec8aba1 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.660213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c61dcb0c-df19-4e89-8a70-6053dec8aba1 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.676833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c61dcb0c-df19-4e89-8a70-6053dec8aba1 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:58.679317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c61dcb0c-df19-4e89-8a70-6053dec8aba1 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:58.748741 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c61dcb0c-df19-4e89-8a70-6053dec8aba1 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.166402 Jul 20 04:27:58.761500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e8d38edf-2056-4c35-be51-7f68032c4efa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:58.762182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e8d38edf-2056-4c35-be51-7f68032c4efa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:58.769164 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2003/4033] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:27:58 2022] GET /compute/v2.1/servers => generated 1018 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:58.784828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:59.055665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e8d38edf-2056-4c35-be51-7f68032c4efa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:59.071580 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e8d38edf-2056-4c35-be51-7f68032c4efa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1223 microversion: 2.1 time: 0.308917 Jul 20 04:27:59.072339 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2031/4034] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:58 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1223 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:00.103790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0484bd2d-1bfb-443a-9e2c-10425174665c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:00.104897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0484bd2d-1bfb-443a-9e2c-10425174665c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:00.274636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0484bd2d-1bfb-443a-9e2c-10425174665c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:00.283368 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0484bd2d-1bfb-443a-9e2c-10425174665c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1223 microversion: 2.1 time: 0.196691 Jul 20 04:28:00.292990 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2004/4035] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:00 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1223 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:01.306565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4589d017-aba0-4847-80ee-1cbe9939c4a6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:01.307327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4589d017-aba0-4847-80ee-1cbe9939c4a6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:01.340123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4589d017-aba0-4847-80ee-1cbe9939c4a6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:01.344083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4589d017-aba0-4847-80ee-1cbe9939c4a6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:01.354446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4589d017-aba0-4847-80ee-1cbe9939c4a6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:01.358056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4589d017-aba0-4847-80ee-1cbe9939c4a6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:01.720686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4589d017-aba0-4847-80ee-1cbe9939c4a6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:01.732395 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4589d017-aba0-4847-80ee-1cbe9939c4a6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1219 microversion: 2.1 time: 0.435740 Jul 20 04:28:01.743031 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2032/4036] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:01 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1219 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:01.999474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2dff77eb-918c-4709-8701-6925cace43a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:02.002640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2dff77eb-918c-4709-8701-6925cace43a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:02.024608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dff77eb-918c-4709-8701-6925cace43a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.028971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dff77eb-918c-4709-8701-6925cace43a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:02.037761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dff77eb-918c-4709-8701-6925cace43a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.039079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dff77eb-918c-4709-8701-6925cace43a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:02.100240 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-2dff77eb-918c-4709-8701-6925cace43a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] HTTP exception thrown: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2dff77eb-918c-4709-8701-6925cace43a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Request method failure captured: Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e HTTP/1.1 Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14KULc5jYbIJlf1zdCxNqADWEEcXfUFKI9bMK3gD1NJmEXCUw5ZAmUpGV0wcGa7_gx5NSaOgExpEwENNTKj5qvZH-U1faIv_bCRnBVRGGSsDkft4mXVgfdHCp5T4J-GOJQJ5D-2iAh-4WRzN6fa4K0Y9uSEI45CRNrJTiwcOQ081pIc Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1b85c906b4a2497f88c62f8b2c021ae5 Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TaggedBootDevicesTest-200731701 Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TaggedBootDevicesTest-200731701 Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1b85c906b4a2497f88c62f8b2c021ae5 Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TaggedBootDevicesTest-200731701 Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TaggedBootDevicesTest-200731701-project Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 0b4c2a58aa4047368a21fcc59bcdb42d Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TaggedBootDevicesTest-200731701-project Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4e49aad2-cba4-4a5a-b719-5c57d8a13e9e'} Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:02.111048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2dff77eb-918c-4709-8701-6925cace43a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Returning 404 to user: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:02.116768 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2dff77eb-918c-4709-8701-6925cace43a5 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 404 len: 111 microversion: 2.32 time: 0.125817 Jul 20 04:28:02.129771 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2005/4037] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:28:01 2022] DELETE /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:28:02.137919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c70c4ce6-a662-42dd-8d85-eb00d07787c6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:02.138619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c70c4ce6-a662-42dd-8d85-eb00d07787c6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] [instance: 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:02.166234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c70c4ce6-a662-42dd-8d85-eb00d07787c6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.178803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c70c4ce6-a662-42dd-8d85-eb00d07787c6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:02.183831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c70c4ce6-a662-42dd-8d85-eb00d07787c6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.184580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c70c4ce6-a662-42dd-8d85-eb00d07787c6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:02.223414 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-c70c4ce6-a662-42dd-8d85-eb00d07787c6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] HTTP exception thrown: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c70c4ce6-a662-42dd-8d85-eb00d07787c6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Request method failure captured: Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e HTTP/1.1 Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14KULc5jYbIJlf1zdCxNqADWEEcXfUFKI9bMK3gD1NJmEXCUw5ZAmUpGV0wcGa7_gx5NSaOgExpEwENNTKj5qvZH-U1faIv_bCRnBVRGGSsDkft4mXVgfdHCp5T4J-GOJQJ5D-2iAh-4WRzN6fa4K0Y9uSEI45CRNrJTiwcOQ081pIc Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1b85c906b4a2497f88c62f8b2c021ae5 Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TaggedBootDevicesTest-200731701 Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b85c906b4a2497f88c62f8b2c021ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TaggedBootDevicesTest-200731701 Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1b85c906b4a2497f88c62f8b2c021ae5 Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TaggedBootDevicesTest-200731701 Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TaggedBootDevicesTest-200731701-project Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 0b4c2a58aa4047368a21fcc59bcdb42d Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TaggedBootDevicesTest-200731701-project Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4e49aad2-cba4-4a5a-b719-5c57d8a13e9e'} Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:02.227109 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:02.236800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:02.236800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:02.236800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:02.236800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:02.236800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:02.236800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. Jul 20 04:28:02.236800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:02.236800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c70c4ce6-a662-42dd-8d85-eb00d07787c6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] Returning 404 to user: Instance 4e49aad2-cba4-4a5a-b719-5c57d8a13e9e could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:02.236800 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c70c4ce6-a662-42dd-8d85-eb00d07787c6 tempest-TaggedBootDevicesTest-200731701 tempest-TaggedBootDevicesTest-200731701-project] 10.222.0.59 "GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e" status: 404 len: 111 microversion: 2.32 time: 0.097297 Jul 20 04:28:02.236800 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2033/4038] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:02 2022] GET /compute/v2.1/servers/4e49aad2-cba4-4a5a-b719-5c57d8a13e9e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:28:02.761196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-50b54084-6edd-43f4-8f17-c220649dd793 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:02.762066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-50b54084-6edd-43f4-8f17-c220649dd793 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:02.794386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50b54084-6edd-43f4-8f17-c220649dd793 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.795157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50b54084-6edd-43f4-8f17-c220649dd793 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:02.797696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50b54084-6edd-43f4-8f17-c220649dd793 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.804302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50b54084-6edd-43f4-8f17-c220649dd793 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.326332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-50b54084-6edd-43f4-8f17-c220649dd793 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:03.341119 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-50b54084-6edd-43f4-8f17-c220649dd793 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1283 microversion: 2.1 time: 0.585487 Jul 20 04:28:03.341732 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2006/4039] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:02 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1283 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:04.366509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0aec41af-473f-4ca5-82cd-3c3ba1283cd3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:04.367278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0aec41af-473f-4ca5-82cd-3c3ba1283cd3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:04.390037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aec41af-473f-4ca5-82cd-3c3ba1283cd3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:04.391619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aec41af-473f-4ca5-82cd-3c3ba1283cd3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:04.396333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aec41af-473f-4ca5-82cd-3c3ba1283cd3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:04.397583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aec41af-473f-4ca5-82cd-3c3ba1283cd3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:04.631381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0aec41af-473f-4ca5-82cd-3c3ba1283cd3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:04.643253 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0aec41af-473f-4ca5-82cd-3c3ba1283cd3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1281 microversion: 2.1 time: 0.282023 Jul 20 04:28:04.647964 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2034/4040] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:04 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1281 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:05.662101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0cd887c-87d4-4631-bf61-d2e3898af44e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:05.662750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0cd887c-87d4-4631-bf61-d2e3898af44e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:05.681766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0cd887c-87d4-4631-bf61-d2e3898af44e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:05.682233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0cd887c-87d4-4631-bf61-d2e3898af44e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:05.683062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0cd887c-87d4-4631-bf61-d2e3898af44e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:05.683502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0cd887c-87d4-4631-bf61-d2e3898af44e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.026981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c0cd887c-87d4-4631-bf61-d2e3898af44e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.035154 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0cd887c-87d4-4631-bf61-d2e3898af44e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1281 microversion: 2.1 time: 0.377337 Jul 20 04:28:06.035762 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2007/4041] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:05 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1281 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:07.054237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e98915aa-b2a7-408f-9a72-dfe26a91bf6e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:07.055522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e98915aa-b2a7-408f-9a72-dfe26a91bf6e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:07.069585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e98915aa-b2a7-408f-9a72-dfe26a91bf6e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:07.070086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e98915aa-b2a7-408f-9a72-dfe26a91bf6e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:07.071268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e98915aa-b2a7-408f-9a72-dfe26a91bf6e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:07.071780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e98915aa-b2a7-408f-9a72-dfe26a91bf6e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:07.584948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e98915aa-b2a7-408f-9a72-dfe26a91bf6e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:07.598950 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e98915aa-b2a7-408f-9a72-dfe26a91bf6e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 0.549778 Jul 20 04:28:07.600097 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2035/4042] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:07 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:08.619474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0ed1295f-f3b1-407f-9c5e-3063e4956eb2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:08.626279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0ed1295f-f3b1-407f-9c5e-3063e4956eb2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:08.641707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ed1295f-f3b1-407f-9c5e-3063e4956eb2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:08.645411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ed1295f-f3b1-407f-9c5e-3063e4956eb2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:08.648577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ed1295f-f3b1-407f-9c5e-3063e4956eb2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:08.649111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ed1295f-f3b1-407f-9c5e-3063e4956eb2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:08.715984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:09.217370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0ed1295f-f3b1-407f-9c5e-3063e4956eb2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:09.225678 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0ed1295f-f3b1-407f-9c5e-3063e4956eb2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 0.612607 Jul 20 04:28:09.234509 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2008/4043] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:08 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:10.250463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1776890d-e6c4-4187-9224-98aaccb3506c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:10.251085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1776890d-e6c4-4187-9224-98aaccb3506c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:10.253625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:10.255778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:10.289468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1776890d-e6c4-4187-9224-98aaccb3506c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.292490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1776890d-e6c4-4187-9224-98aaccb3506c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:10.296841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1776890d-e6c4-4187-9224-98aaccb3506c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.302109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1776890d-e6c4-4187-9224-98aaccb3506c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.029518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1776890d-e6c4-4187-9224-98aaccb3506c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:11.049102 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1776890d-e6c4-4187-9224-98aaccb3506c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 0.801045 Jul 20 04:28:11.065086 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2036/4044] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:10 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:11.236090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:12.056066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-33902953-09ac-40f4-92b1-4c1fba754c73 req-1e4fa2ed-9c6c-42ad-ae16-cbdaea2be4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b", "tag": "18c9e6ba-2c98-4f5d-b4e2-e6726eaf5965"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:12.070904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ab97f55-63d0-4aec-9952-3e4a23ca5cb8 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:12.073450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ab97f55-63d0-4aec-9952-3e4a23ca5cb8 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:12.086636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-33902953-09ac-40f4-92b1-4c1fba754c73 req-1e4fa2ed-9c6c-42ad-ae16-cbdaea2be4b8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.089626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-33902953-09ac-40f4-92b1-4c1fba754c73 req-1e4fa2ed-9c6c-42ad-ae16-cbdaea2be4b8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.091855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ab97f55-63d0-4aec-9952-3e4a23ca5cb8 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.096476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ab97f55-63d0-4aec-9952-3e4a23ca5cb8 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.099498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ab97f55-63d0-4aec-9952-3e4a23ca5cb8 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.100885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ab97f55-63d0-4aec-9952-3e4a23ca5cb8 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.158955 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-33902953-09ac-40f4-92b1-4c1fba754c73 req-1e4fa2ed-9c6c-42ad-ae16-cbdaea2be4b8 service nova] Creating event network-changed:18c9e6ba-2c98-4f5d-b4e2-e6726eaf5965 for instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b on n-h1-760456-11 Jul 20 04:28:12.171708 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-33902953-09ac-40f4-92b1-4c1fba754c73 req-1e4fa2ed-9c6c-42ad-ae16-cbdaea2be4b8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.941437 Jul 20 04:28:12.179370 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2009/4045] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:13.660656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-bb8da5e8-e3c9-465c-91ff-80f4ebb31a66 req-4d836a35-b948-4693-afbc-de7991b69e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "347bdc7d-c086-4495-ac23-65382faeb684", "tag": "919f2c7a-a428-47e2-b674-df53fdd0e184"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:13.714278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bb8da5e8-e3c9-465c-91ff-80f4ebb31a66 req-4d836a35-b948-4693-afbc-de7991b69e79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:13.714934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bb8da5e8-e3c9-465c-91ff-80f4ebb31a66 req-4d836a35-b948-4693-afbc-de7991b69e79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:13.748467 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-bb8da5e8-e3c9-465c-91ff-80f4ebb31a66 req-4d836a35-b948-4693-afbc-de7991b69e79 service nova] Creating event network-changed:919f2c7a-a428-47e2-b674-df53fdd0e184 for instance 347bdc7d-c086-4495-ac23-65382faeb684 on n-h2-760456-11 Jul 20 04:28:13.760861 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-bb8da5e8-e3c9-465c-91ff-80f4ebb31a66 req-4d836a35-b948-4693-afbc-de7991b69e79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.689487 Jul 20 04:28:13.761753 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2010/4046] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:28:14.039093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ab97f55-63d0-4aec-9952-3e4a23ca5cb8 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:14.066620 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ab97f55-63d0-4aec-9952-3e4a23ca5cb8 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 1.999949 Jul 20 04:28:14.078434 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2037/4047] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:12 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:15.088036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0112a088-aca7-463f-9104-d36112060c56 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:15.089750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0112a088-aca7-463f-9104-d36112060c56 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:15.118131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0112a088-aca7-463f-9104-d36112060c56 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:15.120475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0112a088-aca7-463f-9104-d36112060c56 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:15.121294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0112a088-aca7-463f-9104-d36112060c56 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:15.132340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0112a088-aca7-463f-9104-d36112060c56 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:15.976420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0112a088-aca7-463f-9104-d36112060c56 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:15.999960 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0112a088-aca7-463f-9104-d36112060c56 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 0.917822 Jul 20 04:28:16.002814 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2011/4048] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:15 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:16.446364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-cefb6245-ea8e-4a04-a80e-86a7c7859054 req-7b6a0580-8294-4149-a4be-937891533b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a458c18a-83a4-4d50-aa70-405fc0efc33c", "tag": "7a9e5d23-3540-4ecb-907e-77dde73c1f4f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:16.473478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cefb6245-ea8e-4a04-a80e-86a7c7859054 req-7b6a0580-8294-4149-a4be-937891533b88 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:16.473947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cefb6245-ea8e-4a04-a80e-86a7c7859054 req-7b6a0580-8294-4149-a4be-937891533b88 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:16.533202 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-cefb6245-ea8e-4a04-a80e-86a7c7859054 req-7b6a0580-8294-4149-a4be-937891533b88 service nova] Creating event network-changed:7a9e5d23-3540-4ecb-907e-77dde73c1f4f for instance a458c18a-83a4-4d50-aa70-405fc0efc33c on n-h2-760456-11 Jul 20 04:28:16.543264 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-cefb6245-ea8e-4a04-a80e-86a7c7859054 req-7b6a0580-8294-4149-a4be-937891533b88 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099322 Jul 20 04:28:16.548123 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2038/4049] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:17.026376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6a898107-f277-4183-a9d8-ef1c87f0ea7c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:17.028619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6a898107-f277-4183-a9d8-ef1c87f0ea7c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:17.044261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a898107-f277-4183-a9d8-ef1c87f0ea7c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.047488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a898107-f277-4183-a9d8-ef1c87f0ea7c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.050882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a898107-f277-4183-a9d8-ef1c87f0ea7c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:17.056779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a898107-f277-4183-a9d8-ef1c87f0ea7c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:17.529124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6a898107-f277-4183-a9d8-ef1c87f0ea7c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:17.537930 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6a898107-f277-4183-a9d8-ef1c87f0ea7c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 0.524854 Jul 20 04:28:17.547255 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2012/4050] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:17 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:18.566004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6d0fe45-aee7-4dd8-8a07-477921e61105 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:18.566848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6d0fe45-aee7-4dd8-8a07-477921e61105 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:18.596026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6d0fe45-aee7-4dd8-8a07-477921e61105 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.596753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6d0fe45-aee7-4dd8-8a07-477921e61105 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.597794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6d0fe45-aee7-4dd8-8a07-477921e61105 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.600428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6d0fe45-aee7-4dd8-8a07-477921e61105 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.379690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6d0fe45-aee7-4dd8-8a07-477921e61105 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.407796 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6d0fe45-aee7-4dd8-8a07-477921e61105 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 1.844181 Jul 20 04:28:20.419134 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2039/4051] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:18 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:21.435427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5faf2530-7a67-4d4c-8004-dc7689a27fb3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.436498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5faf2530-7a67-4d4c-8004-dc7689a27fb3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:21.449477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5faf2530-7a67-4d4c-8004-dc7689a27fb3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.451554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5faf2530-7a67-4d4c-8004-dc7689a27fb3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.453846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5faf2530-7a67-4d4c-8004-dc7689a27fb3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.456980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5faf2530-7a67-4d4c-8004-dc7689a27fb3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.681491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-53ac0fe5-a1fc-4cd3-b830-69379361c262 req-af436d07-cd4d-48f6-93c0-aeb02a737424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b", "name": "network-vif-plugged", "status": "completed", "tag": "18c9e6ba-2c98-4f5d-b4e2-e6726eaf5965"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:22.711630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-53ac0fe5-a1fc-4cd3-b830-69379361c262 req-af436d07-cd4d-48f6-93c0-aeb02a737424 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.718636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-53ac0fe5-a1fc-4cd3-b830-69379361c262 req-af436d07-cd4d-48f6-93c0-aeb02a737424 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.758360 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-53ac0fe5-a1fc-4cd3-b830-69379361c262 req-af436d07-cd4d-48f6-93c0-aeb02a737424 service nova] Creating event network-vif-plugged:18c9e6ba-2c98-4f5d-b4e2-e6726eaf5965 for instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b on n-h1-760456-11 Jul 20 04:28:22.776671 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-53ac0fe5-a1fc-4cd3-b830-69379361c262 req-af436d07-cd4d-48f6-93c0-aeb02a737424 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.623830 Jul 20 04:28:22.792908 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2040/4052] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:28:23.113544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5faf2530-7a67-4d4c-8004-dc7689a27fb3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.137301 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5faf2530-7a67-4d4c-8004-dc7689a27fb3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 1.705359 Jul 20 04:28:23.142575 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2013/4053] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:24.159224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-534be063-4778-4bde-8d19-cab7b1d1a19e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:24.159975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-534be063-4778-4bde-8d19-cab7b1d1a19e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:24.186879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-534be063-4778-4bde-8d19-cab7b1d1a19e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.196309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-534be063-4778-4bde-8d19-cab7b1d1a19e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.197670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-534be063-4778-4bde-8d19-cab7b1d1a19e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.198622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-534be063-4778-4bde-8d19-cab7b1d1a19e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.804893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-534be063-4778-4bde-8d19-cab7b1d1a19e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:24.821821 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-534be063-4778-4bde-8d19-cab7b1d1a19e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 0.666599 Jul 20 04:28:24.825260 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2041/4054] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:24 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:25.480598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4983fb3e-20bd-4706-af6c-86bd2bf37a6a req-21c3d7c6-215a-4901-94bf-5dfed81b01c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "347bdc7d-c086-4495-ac23-65382faeb684", "name": "network-vif-plugged", "status": "completed", "tag": "919f2c7a-a428-47e2-b674-df53fdd0e184"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:25.513129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4983fb3e-20bd-4706-af6c-86bd2bf37a6a req-21c3d7c6-215a-4901-94bf-5dfed81b01c9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.523632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4983fb3e-20bd-4706-af6c-86bd2bf37a6a req-21c3d7c6-215a-4901-94bf-5dfed81b01c9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.578175 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4983fb3e-20bd-4706-af6c-86bd2bf37a6a req-21c3d7c6-215a-4901-94bf-5dfed81b01c9 service nova] Creating event network-vif-plugged:919f2c7a-a428-47e2-b674-df53fdd0e184 for instance 347bdc7d-c086-4495-ac23-65382faeb684 on n-h2-760456-11 Jul 20 04:28:25.598396 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4983fb3e-20bd-4706-af6c-86bd2bf37a6a req-21c3d7c6-215a-4901-94bf-5dfed81b01c9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121406 Jul 20 04:28:25.602001 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2014/4055] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:25.844129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8ce95ab8-cb42-4ce6-acd6-3c777b238ed4 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:25.845599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8ce95ab8-cb42-4ce6-acd6-3c777b238ed4 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:25.876228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ce95ab8-cb42-4ce6-acd6-3c777b238ed4 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.877799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ce95ab8-cb42-4ce6-acd6-3c777b238ed4 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.879737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ce95ab8-cb42-4ce6-acd6-3c777b238ed4 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.880746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ce95ab8-cb42-4ce6-acd6-3c777b238ed4 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.300595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8ce95ab8-cb42-4ce6-acd6-3c777b238ed4 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.321014 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8ce95ab8-cb42-4ce6-acd6-3c777b238ed4 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 0.483951 Jul 20 04:28:26.332003 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2042/4056] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:25 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:27.340196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0633038a-ebe2-49bc-849c-18df3dcc353e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:27.341553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0633038a-ebe2-49bc-849c-18df3dcc353e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:27.361179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0633038a-ebe2-49bc-849c-18df3dcc353e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.362019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0633038a-ebe2-49bc-849c-18df3dcc353e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.364883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0633038a-ebe2-49bc-849c-18df3dcc353e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.365705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0633038a-ebe2-49bc-849c-18df3dcc353e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.704481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ee4c1bff-aa28-46d0-8b71-dcc3fb2ef7c4 req-e4ce8b10-e196-4098-85a9-b263ead58bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a458c18a-83a4-4d50-aa70-405fc0efc33c", "name": "network-vif-plugged", "status": "completed", "tag": "7a9e5d23-3540-4ecb-907e-77dde73c1f4f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:27.721793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ee4c1bff-aa28-46d0-8b71-dcc3fb2ef7c4 req-e4ce8b10-e196-4098-85a9-b263ead58bb3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.729029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ee4c1bff-aa28-46d0-8b71-dcc3fb2ef7c4 req-e4ce8b10-e196-4098-85a9-b263ead58bb3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.744808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=57 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:27.777895 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ee4c1bff-aa28-46d0-8b71-dcc3fb2ef7c4 req-e4ce8b10-e196-4098-85a9-b263ead58bb3 service nova] Creating event network-vif-plugged:7a9e5d23-3540-4ecb-907e-77dde73c1f4f for instance a458c18a-83a4-4d50-aa70-405fc0efc33c on n-h2-760456-11 Jul 20 04:28:27.796072 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ee4c1bff-aa28-46d0-8b71-dcc3fb2ef7c4 req-e4ce8b10-e196-4098-85a9-b263ead58bb3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096842 Jul 20 04:28:27.800365 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2043/4057] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:28:29.768473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0633038a-ebe2-49bc-849c-18df3dcc353e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:29.776850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=51 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:29.780575 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0633038a-ebe2-49bc-849c-18df3dcc353e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1323 microversion: 2.1 time: 2.445648 Jul 20 04:28:29.785286 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2015/4058] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:27 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1323 bytes in 2451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:30.803691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3931a90e-710c-4501-b3fc-d8e6446b7b2d tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:30.804553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3931a90e-710c-4501-b3fc-d8e6446b7b2d tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:30.820173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=26 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:30.828190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3931a90e-710c-4501-b3fc-d8e6446b7b2d tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:30.831529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3931a90e-710c-4501-b3fc-d8e6446b7b2d tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:30.832515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3931a90e-710c-4501-b3fc-d8e6446b7b2d tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:30.833124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3931a90e-710c-4501-b3fc-d8e6446b7b2d tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:31.921206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3931a90e-710c-4501-b3fc-d8e6446b7b2d tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:31.929404 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3931a90e-710c-4501-b3fc-d8e6446b7b2d tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 200 len: 1516 microversion: 2.1 time: 1.131392 Jul 20 04:28:31.930013 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2044/4059] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:30 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 1516 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:31.951595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8816692f-58b9-4bd1-b881-bde646013eac tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:31.952942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8816692f-58b9-4bd1-b881-bde646013eac tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: a458c18a-83a4-4d50-aa70-405fc0efc33c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:31.964277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=29 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:31.965884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8816692f-58b9-4bd1-b881-bde646013eac tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:31.966376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8816692f-58b9-4bd1-b881-bde646013eac tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:31.967171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8816692f-58b9-4bd1-b881-bde646013eac tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:31.976594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8816692f-58b9-4bd1-b881-bde646013eac tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.419516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8816692f-58b9-4bd1-b881-bde646013eac tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:32.428782 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8816692f-58b9-4bd1-b881-bde646013eac tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c" status: 200 len: 1516 microversion: 2.1 time: 0.481697 Jul 20 04:28:32.437352 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2016/4060] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:31 2022] GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c => generated 1516 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:32.456351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b811dbe-3957-4412-90ac-6733a8c83faa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:32.457962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6b811dbe-3957-4412-90ac-6733a8c83faa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:32.473774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b811dbe-3957-4412-90ac-6733a8c83faa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.476534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b811dbe-3957-4412-90ac-6733a8c83faa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.477643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b811dbe-3957-4412-90ac-6733a8c83faa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.479659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b811dbe-3957-4412-90ac-6733a8c83faa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:33.529207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6b811dbe-3957-4412-90ac-6733a8c83faa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:33.545853 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6b811dbe-3957-4412-90ac-6733a8c83faa tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b" status: 200 len: 1517 microversion: 2.1 time: 1.095349 Jul 20 04:28:33.552170 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2045/4061] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:32 2022] GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b => generated 1517 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:33.572680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9ebb8fa-fbe2-43fe-b702-43a40649c95b tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:33.573967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b9ebb8fa-fbe2-43fe-b702-43a40649c95b tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:33.584051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9ebb8fa-fbe2-43fe-b702-43a40649c95b tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:33.584879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9ebb8fa-fbe2-43fe-b702-43a40649c95b tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:33.585985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9ebb8fa-fbe2-43fe-b702-43a40649c95b tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:33.586692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9ebb8fa-fbe2-43fe-b702-43a40649c95b tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:33.617568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b9ebb8fa-fbe2-43fe-b702-43a40649c95b tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:28:33.736700 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b9ebb8fa-fbe2-43fe-b702-43a40649c95b tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b" status: 204 len: 0 microversion: 2.1 time: 0.167986 Jul 20 04:28:33.739824 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2017/4062] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:28:33 2022] DELETE /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:28:33.749465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e2c8e5ed-69ff-4fea-8d94-283608ab16b5 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:33.750204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e2c8e5ed-69ff-4fea-8d94-283608ab16b5 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:33.777367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2c8e5ed-69ff-4fea-8d94-283608ab16b5 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:33.777851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2c8e5ed-69ff-4fea-8d94-283608ab16b5 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:33.790683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2c8e5ed-69ff-4fea-8d94-283608ab16b5 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:33.791165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2c8e5ed-69ff-4fea-8d94-283608ab16b5 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:34.874565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e2c8e5ed-69ff-4fea-8d94-283608ab16b5 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:34.892386 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e2c8e5ed-69ff-4fea-8d94-283608ab16b5 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b" status: 200 len: 1523 microversion: 2.1 time: 1.148602 Jul 20 04:28:34.905905 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2046/4063] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:33 2022] GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b => generated 1523 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:35.915669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e02204d6-4968-4ce8-8a15-4eeb4abace8c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:35.916957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e02204d6-4968-4ce8-8a15-4eeb4abace8c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:35.946836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e02204d6-4968-4ce8-8a15-4eeb4abace8c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:35.948900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e02204d6-4968-4ce8-8a15-4eeb4abace8c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:35.949986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e02204d6-4968-4ce8-8a15-4eeb4abace8c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:35.954346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e02204d6-4968-4ce8-8a15-4eeb4abace8c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:36.751426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e02204d6-4968-4ce8-8a15-4eeb4abace8c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:36.759907 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e02204d6-4968-4ce8-8a15-4eeb4abace8c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b" status: 200 len: 1523 microversion: 2.1 time: 0.850725 Jul 20 04:28:36.760502 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2018/4064] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:35 2022] GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b => generated 1523 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:36.851335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-783401089", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "ed49e598-2214-4014-9576-08d84cb315b0"}, {"uuid": "24f6569b-0ac0-4e35-bc4b-7803e618eeac"}, {"uuid": "ed49e598-2214-4014-9576-08d84cb315b0"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:36.942582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] validate_networks() for [('ed49e598-2214-4014-9576-08d84cb315b0', None, None, None, None, None), ('24f6569b-0ac0-4e35-bc4b-7803e618eeac', None, None, None, None, None), ('ed49e598-2214-4014-9576-08d84cb315b0', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:37.335202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-762c85f0-b952-4496-8e49-564c1e8b1246 req-88158f57-376d-4813-b01c-1ac7d3ca0e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b", "name": "network-vif-deleted", "tag": "18c9e6ba-2c98-4f5d-b4e2-e6726eaf5965"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:37.375532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-762c85f0-b952-4496-8e49-564c1e8b1246 req-88158f57-376d-4813-b01c-1ac7d3ca0e60 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.376246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-762c85f0-b952-4496-8e49-564c1e8b1246 req-88158f57-376d-4813-b01c-1ac7d3ca0e60 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:37.401952 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-762c85f0-b952-4496-8e49-564c1e8b1246 req-88158f57-376d-4813-b01c-1ac7d3ca0e60 service nova] Creating event network-vif-deleted:18c9e6ba-2c98-4f5d-b4e2-e6726eaf5965 for instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b on n-h1-760456-11 Jul 20 04:28:37.418559 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-762c85f0-b952-4496-8e49-564c1e8b1246 req-88158f57-376d-4813-b01c-1ac7d3ca0e60 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092001 Jul 20 04:28:37.419264 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2019/4065] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:28:37.778160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:37.779331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:37.796239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.816800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:37.818685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.822329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:37.948209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.948598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:37.950543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lazy-loading 'fault' on Instance uuid 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:28:38.301540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:38.310670 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-22a8b3db-237d-4bc2-ba0a-e5a88a2237c3 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b" status: 200 len: 1313 microversion: 2.1 time: 0.537171 Jul 20 04:28:38.314031 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2020/4066] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:37 2022] GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:39.332108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29cba5d2-0f00-420d-b4cb-06aa1d484092 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:39.333667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-29cba5d2-0f00-420d-b4cb-06aa1d484092 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:39.344623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29cba5d2-0f00-420d-b4cb-06aa1d484092 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.345790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29cba5d2-0f00-420d-b4cb-06aa1d484092 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.347087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29cba5d2-0f00-420d-b4cb-06aa1d484092 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.347869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29cba5d2-0f00-420d-b4cb-06aa1d484092 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.367233 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-29cba5d2-0f00-420d-b4cb-06aa1d484092 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] HTTP exception thrown: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29cba5d2-0f00-420d-b4cb-06aa1d484092 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Request method failure captured: Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b HTTP/1.1 Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14RJNgUEdS52s_wYfinyIDyTFr8xywdGaj05YLdGIv-Fwkn1wljxtQj3lcM4FE4_Q8xJ_2YT7tsrFELgbgSo83w1Q7ZSECnX9OdsqlFpl7HbBYr4gLyO5z0Xcu2UjAOEuuIX5hRipERWB_vRuLY9_PfLDd-MIB8ssNVQr-LhfOtbgw0 Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 5a6f9350148f496183a3fa7aeb2c4680 Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b'} Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:39.369561 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.375970 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:39.375970 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:39.375970 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:39.375970 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:39.375970 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:39.375970 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:39.375970 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.379867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29cba5d2-0f00-420d-b4cb-06aa1d484092 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Returning 404 to user: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:39.381495 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-29cba5d2-0f00-420d-b4cb-06aa1d484092 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b" status: 404 len: 111 microversion: 2.1 time: 0.054528 Jul 20 04:28:39.383891 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2021/4067] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:39 2022] GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:28:39.396977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6c70072-1546-4a79-8d3d-74f32a7e58a9 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:39.410490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a6c70072-1546-4a79-8d3d-74f32a7e58a9 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:39.413440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a6c70072-1546-4a79-8d3d-74f32a7e58a9 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:28:39.427420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6c70072-1546-4a79-8d3d-74f32a7e58a9 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.428618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6c70072-1546-4a79-8d3d-74f32a7e58a9 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.431808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6c70072-1546-4a79-8d3d-74f32a7e58a9 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.432746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6c70072-1546-4a79-8d3d-74f32a7e58a9 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.650545 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a6c70072-1546-4a79-8d3d-74f32a7e58a9 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.261410 Jul 20 04:28:39.661629 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2022/4068] 10.222.0.59 () {58 vars in 1229 bytes} [Wed Jul 20 04:28:39 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:28:39.676488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48d132c4-531f-4fd7-b1f2-375448140f01 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48d132c4-531f-4fd7-b1f2-375448140f01 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Request method failure captured: Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14RJNgUEdS52s_wYfinyIDyTFr8xywdGaj05YLdGIv-Fwkn1wljxtQj3lcM4FE4_Q8xJ_2YT7tsrFELgbgSo83w1Q7ZSECnX9OdsqlFpl7HbBYr4gLyO5z0Xcu2UjAOEuuIX5hRipERWB_vRuLY9_PfLDd-MIB8ssNVQr-LhfOtbgw0 Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 5a6f9350148f496183a3fa7aeb2c4680 Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: action_args: {} Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:28:39.682907 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:39.687367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48d132c4-531f-4fd7-b1f2-375448140f01 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:39.688422 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48d132c4-531f-4fd7-b1f2-375448140f01 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.021497 Jul 20 04:28:39.688422 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2023/4069] 10.222.0.59 () {58 vars in 1181 bytes} [Wed Jul 20 04:28:39 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:28:39.704131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-82241a9c-cd85-4824-9976-568d5a62c5a7 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:39.710498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-82241a9c-cd85-4824-9976-568d5a62c5a7 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:39.715217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-82241a9c-cd85-4824-9976-568d5a62c5a7 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Searching by: {'deleted': False, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:28:39.728121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82241a9c-cd85-4824-9976-568d5a62c5a7 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.728579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82241a9c-cd85-4824-9976-568d5a62c5a7 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.729386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82241a9c-cd85-4824-9976-568d5a62c5a7 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.729831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82241a9c-cd85-4824-9976-568d5a62c5a7 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.798111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-82241a9c-cd85-4824-9976-568d5a62c5a7 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:28:39.897827 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-82241a9c-cd85-4824-9976-568d5a62c5a7 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.201545 Jul 20 04:28:39.898760 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2024/4070] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:28:39 2022] GET /compute/v2.1/servers => generated 683 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:39.911399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e334b7b1-4840-4f07-a0b0-d765c9e4d027 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:39.917863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e334b7b1-4840-4f07-a0b0-d765c9e4d027 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:39.918916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.compute.servers [None req-e334b7b1-4840-4f07-a0b0-d765c9e4d027 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Removing options 'limit' from query {{(pid=119605) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:28:39.922411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e334b7b1-4840-4f07-a0b0-d765c9e4d027 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Searching by: {'deleted': False, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:28:39.928944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e334b7b1-4840-4f07-a0b0-d765c9e4d027 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.929870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e334b7b1-4840-4f07-a0b0-d765c9e4d027 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.930951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e334b7b1-4840-4f07-a0b0-d765c9e4d027 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:39.931891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e334b7b1-4840-4f07-a0b0-d765c9e4d027 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.967868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-e334b7b1-4840-4f07-a0b0-d765c9e4d027 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:28:40.043590 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e334b7b1-4840-4f07-a0b0-d765c9e4d027 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.135950 Jul 20 04:28:40.044334 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2025/4071] 10.222.0.59 () {58 vars in 1143 bytes} [Wed Jul 20 04:28:39 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:40.079106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f26f053-a4ba-4826-870e-cd466df653b0 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f26f053-a4ba-4826-870e-cd466df653b0 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Request method failure captured: Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14RJNgUEdS52s_wYfinyIDyTFr8xywdGaj05YLdGIv-Fwkn1wljxtQj3lcM4FE4_Q8xJ_2YT7tsrFELgbgSo83w1Q7ZSECnX9OdsqlFpl7HbBYr4gLyO5z0Xcu2UjAOEuuIX5hRipERWB_vRuLY9_PfLDd-MIB8ssNVQr-LhfOtbgw0 Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 5a6f9350148f496183a3fa7aeb2c4680 Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: action_args: {} Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi '-1' Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:28:40.087509 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.092511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f26f053-a4ba-4826-870e-cd466df653b0 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:40.094780 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8f26f053-a4ba-4826-870e-cd466df653b0 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.031514 Jul 20 04:28:40.105321 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2026/4072] 10.222.0.59 () {58 vars in 1141 bytes} [Wed Jul 20 04:28:40 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:28:40.111167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-09d71a35-af5b-45c5-a720-5aed7a12f669 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-09d71a35-af5b-45c5-a720-5aed7a12f669 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Request method failure captured: Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14RJNgUEdS52s_wYfinyIDyTFr8xywdGaj05YLdGIv-Fwkn1wljxtQj3lcM4FE4_Q8xJ_2YT7tsrFELgbgSo83w1Q7ZSECnX9OdsqlFpl7HbBYr4gLyO5z0Xcu2UjAOEuuIX5hRipERWB_vRuLY9_PfLDd-MIB8ssNVQr-LhfOtbgw0 Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 5a6f9350148f496183a3fa7aeb2c4680 Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: action_args: {} Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'testing' Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:28:40.115213 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-09d71a35-af5b-45c5-a720-5aed7a12f669 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:40.120324 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-09d71a35-af5b-45c5-a720-5aed7a12f669 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.012881 Jul 20 04:28:40.128179 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2027/4073] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:28:40 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:28:40.134532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75c9bce4-18fd-4678-91c5-0d76e2c4f70e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:40.139493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-75c9bce4-18fd-4678-91c5-0d76e2c4f70e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:40.139493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-75c9bce4-18fd-4678-91c5-0d76e2c4f70e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:28:40.146945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.compute.servers [None req-75c9bce4-18fd-4678-91c5-0d76e2c4f70e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Flavor 'non_existing_flavor' could not be found {{(pid=119605) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 20 04:28:40.148148 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75c9bce4-18fd-4678-91c5-0d76e2c4f70e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.018639 Jul 20 04:28:40.153241 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2028/4074] 10.222.0.59 () {58 vars in 1177 bytes} [Wed Jul 20 04:28:40 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:28:40.162641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d801a2a8-680d-4ff7-8de8-247acef967d2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:40.166083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d801a2a8-680d-4ff7-8de8-247acef967d2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:40.175374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d801a2a8-680d-4ff7-8de8-247acef967d2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:28:40.183674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d801a2a8-680d-4ff7-8de8-247acef967d2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.185038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d801a2a8-680d-4ff7-8de8-247acef967d2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.187663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d801a2a8-680d-4ff7-8de8-247acef967d2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.188864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d801a2a8-680d-4ff7-8de8-247acef967d2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.335215 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d801a2a8-680d-4ff7-8de8-247acef967d2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.176976 Jul 20 04:28:40.339126 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2029/4075] 10.222.0.59 () {58 vars in 1173 bytes} [Wed Jul 20 04:28:40 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:28:40.351059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3036c534-e4c1-46ad-a638-db838fc8baa6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:40.355949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3036c534-e4c1-46ad-a638-db838fc8baa6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:40.357234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3036c534-e4c1-46ad-a638-db838fc8baa6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:28:40.366833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3036c534-e4c1-46ad-a638-db838fc8baa6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.367791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3036c534-e4c1-46ad-a638-db838fc8baa6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.369026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3036c534-e4c1-46ad-a638-db838fc8baa6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.369791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3036c534-e4c1-46ad-a638-db838fc8baa6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.509404 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3036c534-e4c1-46ad-a638-db838fc8baa6 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.163371 Jul 20 04:28:40.517079 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2030/4076] 10.222.0.59 () {58 vars in 1183 bytes} [Wed Jul 20 04:28:40 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:28:40.522985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:40.526355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:40.527216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Searching by: {'deleted': False, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:28:40.533819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.534303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.535164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.535608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:40.567225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:28:40.611455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:40.627331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:40.627799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.093317 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dcfd8155-0495-4c51-beee-754c10a75679 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.573930 Jul 20 04:28:41.095401 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2031/4077] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:28:40 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:41.155200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a6e6312-fed4-435c-983b-7c034125ee02 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:41.167328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0a6e6312-fed4-435c-983b-7c034125ee02 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:41.176865 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a6e6312-fed4-435c-983b-7c034125ee02 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.043594 Jul 20 04:28:41.183153 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2032/4078] 10.222.0.59 () {58 vars in 1177 bytes} [Wed Jul 20 04:28:41 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:28:41.189021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-858128bc-3d87-4cbd-a10c-aa35a0ff3981 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:41.193248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-858128bc-3d87-4cbd-a10c-aa35a0ff3981 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:41.193924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-858128bc-3d87-4cbd-a10c-aa35a0ff3981 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Searching by: {'deleted': False, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:28:41.203766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-858128bc-3d87-4cbd-a10c-aa35a0ff3981 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.204115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-858128bc-3d87-4cbd-a10c-aa35a0ff3981 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.208657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-858128bc-3d87-4cbd-a10c-aa35a0ff3981 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.210803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-858128bc-3d87-4cbd-a10c-aa35a0ff3981 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.317492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-858128bc-3d87-4cbd-a10c-aa35a0ff3981 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:28:41.390710 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-858128bc-3d87-4cbd-a10c-aa35a0ff3981 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.205990 Jul 20 04:28:41.400392 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2033/4079] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 04:28:41 2022] GET /compute/v2.1/servers => generated 683 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:28:41.411771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-86f7902a-9f21-4592-ad66-c53dc3da80ef tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:41.412132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-86f7902a-9f21-4592-ad66-c53dc3da80ef tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:41.428212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86f7902a-9f21-4592-ad66-c53dc3da80ef tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.433131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:41.433634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:41.434156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:41.434665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:41.435658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:41.441651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86f7902a-9f21-4592-ad66-c53dc3da80ef tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.444465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86f7902a-9f21-4592-ad66-c53dc3da80ef tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.446553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86f7902a-9f21-4592-ad66-c53dc3da80ef tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.477333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.478236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.482440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.484684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.494844 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-86f7902a-9f21-4592-ad66-c53dc3da80ef tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] HTTP exception thrown: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-86f7902a-9f21-4592-ad66-c53dc3da80ef tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Request method failure captured: Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b HTTP/1.1 Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14RJNgUEdS52s_wYfinyIDyTFr8xywdGaj05YLdGIv-Fwkn1wljxtQj3lcM4FE4_Q8xJ_2YT7tsrFELgbgSo83w1Q7ZSECnX9OdsqlFpl7HbBYr4gLyO5z0Xcu2UjAOEuuIX5hRipERWB_vRuLY9_PfLDd-MIB8ssNVQr-LhfOtbgw0 Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 5a6f9350148f496183a3fa7aeb2c4680 Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b'} Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:41.501379 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-86f7902a-9f21-4592-ad66-c53dc3da80ef tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Returning 404 to user: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:41.506278 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-86f7902a-9f21-4592-ad66-c53dc3da80ef tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b" status: 404 len: 111 microversion: 2.1 time: 0.103080 Jul 20 04:28:41.510786 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2034/4080] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:28:41 2022] DELETE /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:28:41.527947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2dd0864d-a5f8-40f5-8334-1183d9f5a38e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:41.528565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2dd0864d-a5f8-40f5-8334-1183d9f5a38e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: a458c18a-83a4-4d50-aa70-405fc0efc33c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:41.547578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd0864d-a5f8-40f5-8334-1183d9f5a38e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.548049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd0864d-a5f8-40f5-8334-1183d9f5a38e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.553688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd0864d-a5f8-40f5-8334-1183d9f5a38e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.554416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd0864d-a5f8-40f5-8334-1183d9f5a38e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.568037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Getting quotas for project 4cf3839dd67a4a6ab91bba230b6aa8e3. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:41.590714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Getting quotas for user bdf595a75d684e629dc60f0ae7386935 and project 4cf3839dd67a4a6ab91bba230b6aa8e3. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:41.603096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2dd0864d-a5f8-40f5-8334-1183d9f5a38e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: a458c18a-83a4-4d50-aa70-405fc0efc33c] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:28:41.673540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:41.683921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:41.783118 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd0b044e-9266-46d2-ade0-b052adf83fb5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.936995 Jul 20 04:28:41.784506 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2047/4081] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:28:41.804564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-36dcef7c-caab-4b94-8ee3-0129f7ebfb1a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:41.805426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-36dcef7c-caab-4b94-8ee3-0129f7ebfb1a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:41.806949 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2dd0864d-a5f8-40f5-8334-1183d9f5a38e tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c" status: 204 len: 0 microversion: 2.1 time: 0.290892 Jul 20 04:28:41.809831 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2035/4082] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:28:41 2022] DELETE /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:28:41.825995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3349d015-886f-4a3a-916b-eb69b4a67356 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:41.828769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3349d015-886f-4a3a-916b-eb69b4a67356 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:41.843621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3349d015-886f-4a3a-916b-eb69b4a67356 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.845579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3349d015-886f-4a3a-916b-eb69b4a67356 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.846763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3349d015-886f-4a3a-916b-eb69b4a67356 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.847579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3349d015-886f-4a3a-916b-eb69b4a67356 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.854175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:41.889677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3349d015-886f-4a3a-916b-eb69b4a67356 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:28:41.993105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-36dcef7c-caab-4b94-8ee3-0129f7ebfb1a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:42.003707 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-36dcef7c-caab-4b94-8ee3-0129f7ebfb1a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1212 microversion: 2.1 time: 0.204623 Jul 20 04:28:42.006626 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2048/4083] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:41 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1212 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:42.063578 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3349d015-886f-4a3a-916b-eb69b4a67356 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "DELETE /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 204 len: 0 microversion: 2.1 time: 0.248304 Jul 20 04:28:42.064954 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2036/4084] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:28:41 2022] DELETE /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:28:42.073331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26548228-a86f-4f77-8041-943604d6f2a2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:42.074861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26548228-a86f-4f77-8041-943604d6f2a2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:42.082862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26548228-a86f-4f77-8041-943604d6f2a2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.083713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26548228-a86f-4f77-8041-943604d6f2a2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.085018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26548228-a86f-4f77-8041-943604d6f2a2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.085698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26548228-a86f-4f77-8041-943604d6f2a2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.107691 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-26548228-a86f-4f77-8041-943604d6f2a2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] HTTP exception thrown: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26548228-a86f-4f77-8041-943604d6f2a2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Request method failure captured: Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b HTTP/1.1 Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14RJNgUEdS52s_wYfinyIDyTFr8xywdGaj05YLdGIv-Fwkn1wljxtQj3lcM4FE4_Q8xJ_2YT7tsrFELgbgSo83w1Q7ZSECnX9OdsqlFpl7HbBYr4gLyO5z0Xcu2UjAOEuuIX5hRipERWB_vRuLY9_PfLDd-MIB8ssNVQr-LhfOtbgw0 Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 5a6f9350148f496183a3fa7aeb2c4680 Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b'} Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:42.112353 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:42.116254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:42.116254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:42.116254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:42.116254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:42.116254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:42.116254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. Jul 20 04:28:42.116254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:42.120282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26548228-a86f-4f77-8041-943604d6f2a2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Returning 404 to user: Instance 4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:42.121474 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26548228-a86f-4f77-8041-943604d6f2a2 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b" status: 404 len: 111 microversion: 2.1 time: 0.052119 Jul 20 04:28:42.122510 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2049/4085] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:42 2022] GET /compute/v2.1/servers/4dff7e1c-5c72-4ebd-a152-dc0727b1ec2b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:28:42.132699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f19d5f20-66f9-45aa-a95a-d254f24a78cf tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:42.134019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f19d5f20-66f9-45aa-a95a-d254f24a78cf tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: a458c18a-83a4-4d50-aa70-405fc0efc33c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:42.143099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f19d5f20-66f9-45aa-a95a-d254f24a78cf tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.144013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f19d5f20-66f9-45aa-a95a-d254f24a78cf tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.145094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f19d5f20-66f9-45aa-a95a-d254f24a78cf tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.145818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f19d5f20-66f9-45aa-a95a-d254f24a78cf tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.724851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f19d5f20-66f9-45aa-a95a-d254f24a78cf tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:42.739335 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f19d5f20-66f9-45aa-a95a-d254f24a78cf tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c" status: 200 len: 1522 microversion: 2.1 time: 0.611089 Jul 20 04:28:42.754493 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2037/4086] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:42 2022] GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c => generated 1522 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:43.023455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3135b785-573f-4b78-867f-758060f46ba9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:43.024081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3135b785-573f-4b78-867f-758060f46ba9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:43.252101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3135b785-573f-4b78-867f-758060f46ba9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:43.287916 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3135b785-573f-4b78-867f-758060f46ba9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1212 microversion: 2.1 time: 0.265979 Jul 20 04:28:43.289100 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2050/4087] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:43 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1212 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:43.763181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b0c2c389-fb6d-4a7f-9365-59a8a18c672a tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:43.764479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b0c2c389-fb6d-4a7f-9365-59a8a18c672a tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: a458c18a-83a4-4d50-aa70-405fc0efc33c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:43.772880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0c2c389-fb6d-4a7f-9365-59a8a18c672a tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:43.773347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0c2c389-fb6d-4a7f-9365-59a8a18c672a tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:43.774143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0c2c389-fb6d-4a7f-9365-59a8a18c672a tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:43.786732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0c2c389-fb6d-4a7f-9365-59a8a18c672a tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:44.308169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-24ef49d5-623f-4b03-ac6b-c40b3d7328d7 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:44.309195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-24ef49d5-623f-4b03-ac6b-c40b3d7328d7 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:44.344357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24ef49d5-623f-4b03-ac6b-c40b3d7328d7 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:44.346278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24ef49d5-623f-4b03-ac6b-c40b3d7328d7 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:44.353127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24ef49d5-623f-4b03-ac6b-c40b3d7328d7 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:44.354582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24ef49d5-623f-4b03-ac6b-c40b3d7328d7 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:44.605706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-24ef49d5-623f-4b03-ac6b-c40b3d7328d7 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:44.622482 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-24ef49d5-623f-4b03-ac6b-c40b3d7328d7 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1282 microversion: 2.1 time: 0.320172 Jul 20 04:28:44.626407 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2051/4088] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:44 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1282 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:28:45.644936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a60b8ae7-1465-4190-8832-09f516f7386c tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:45.646026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a60b8ae7-1465-4190-8832-09f516f7386c tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:45.667802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a60b8ae7-1465-4190-8832-09f516f7386c tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:45.668357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a60b8ae7-1465-4190-8832-09f516f7386c tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:45.669530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a60b8ae7-1465-4190-8832-09f516f7386c tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:45.671313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a60b8ae7-1465-4190-8832-09f516f7386c tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:45.829482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a60b8ae7-1465-4190-8832-09f516f7386c tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:45.839524 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a60b8ae7-1465-4190-8832-09f516f7386c tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1270 microversion: 2.1 time: 0.199061 Jul 20 04:28:45.843207 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2052/4089] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:45 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:46.464399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0c2c389-fb6d-4a7f-9365-59a8a18c672a tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:46.479280 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b0c2c389-fb6d-4a7f-9365-59a8a18c672a tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c" status: 200 len: 1522 microversion: 2.1 time: 2.719914 Jul 20 04:28:46.489135 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2038/4090] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:43 2022] GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c => generated 1522 bytes in 2730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:46.861560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6bc4853e-6534-4c14-b635-eed3f7f7ff34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:46.863077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6bc4853e-6534-4c14-b635-eed3f7f7ff34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:46.881954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc4853e-6534-4c14-b635-eed3f7f7ff34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.883310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc4853e-6534-4c14-b635-eed3f7f7ff34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.889760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc4853e-6534-4c14-b635-eed3f7f7ff34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.893462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc4853e-6534-4c14-b635-eed3f7f7ff34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.083953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ad29497c-fc60-4b94-bb25-9529a61f0eeb req-3d92d2a9-3881-4cff-b271-2fadd2ce1a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "347bdc7d-c086-4495-ac23-65382faeb684", "name": "network-vif-deleted", "tag": "919f2c7a-a428-47e2-b674-df53fdd0e184"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:47.114085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ad29497c-fc60-4b94-bb25-9529a61f0eeb req-3d92d2a9-3881-4cff-b271-2fadd2ce1a7d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.119120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ad29497c-fc60-4b94-bb25-9529a61f0eeb req-3d92d2a9-3881-4cff-b271-2fadd2ce1a7d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.141132 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ad29497c-fc60-4b94-bb25-9529a61f0eeb req-3d92d2a9-3881-4cff-b271-2fadd2ce1a7d service nova] Creating event network-vif-deleted:919f2c7a-a428-47e2-b674-df53fdd0e184 for instance 347bdc7d-c086-4495-ac23-65382faeb684 on n-h2-760456-11 Jul 20 04:28:47.146931 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ad29497c-fc60-4b94-bb25-9529a61f0eeb req-3d92d2a9-3881-4cff-b271-2fadd2ce1a7d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070005 Jul 20 04:28:47.148139 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2039/4091] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:47.391924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6bc4853e-6534-4c14-b635-eed3f7f7ff34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.409307 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6bc4853e-6534-4c14-b635-eed3f7f7ff34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1312 microversion: 2.1 time: 0.553577 Jul 20 04:28:47.413086 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2053/4092] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:46 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1312 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:47.505063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f90cebc-51f7-408b-9cf7-654f873ccebe tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:47.505782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8f90cebc-51f7-408b-9cf7-654f873ccebe tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: a458c18a-83a4-4d50-aa70-405fc0efc33c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:47.533507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f90cebc-51f7-408b-9cf7-654f873ccebe tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.534002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f90cebc-51f7-408b-9cf7-654f873ccebe tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.539119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f90cebc-51f7-408b-9cf7-654f873ccebe tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.539663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f90cebc-51f7-408b-9cf7-654f873ccebe tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.428944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3563825f-9014-4576-a5ae-3b18ef56814a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:48.429658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3563825f-9014-4576-a5ae-3b18ef56814a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:48.448239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3563825f-9014-4576-a5ae-3b18ef56814a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:48.448239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3563825f-9014-4576-a5ae-3b18ef56814a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.448884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3563825f-9014-4576-a5ae-3b18ef56814a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:48.449335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3563825f-9014-4576-a5ae-3b18ef56814a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.992495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3563825f-9014-4576-a5ae-3b18ef56814a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.023302 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3563825f-9014-4576-a5ae-3b18ef56814a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1333 microversion: 2.1 time: 0.596721 Jul 20 04:28:49.034890 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2054/4093] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:48 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1333 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:49.267543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8f90cebc-51f7-408b-9cf7-654f873ccebe tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.283681 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8f90cebc-51f7-408b-9cf7-654f873ccebe tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c" status: 200 len: 1522 microversion: 2.1 time: 1.785744 Jul 20 04:28:49.285541 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2040/4094] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:47 2022] GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c => generated 1522 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:50.044215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b5dfb90-50f8-4d18-973f-f26b23d9a9c3 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:50.045690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b5dfb90-50f8-4d18-973f-f26b23d9a9c3 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:50.061781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b5dfb90-50f8-4d18-973f-f26b23d9a9c3 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.064214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b5dfb90-50f8-4d18-973f-f26b23d9a9c3 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.067711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b5dfb90-50f8-4d18-973f-f26b23d9a9c3 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.068361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b5dfb90-50f8-4d18-973f-f26b23d9a9c3 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.302540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:50.303164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: a458c18a-83a4-4d50-aa70-405fc0efc33c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:50.313185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.316667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.320038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.323957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.418672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.419336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.421160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lazy-loading 'fault' on Instance uuid a458c18a-83a4-4d50-aa70-405fc0efc33c {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:28:50.544183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6f9350148f496183a3fa7aeb2c4680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84ee4736e8c4818bffd3b624ed7edbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:50.557410 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-273e33c7-20d9-4444-ab76-9049705fa409 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c" status: 200 len: 1313 microversion: 2.1 time: 0.258708 Jul 20 04:28:50.559034 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2041/4095] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:50 2022] GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:50.566554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-dab93bf2-e2ba-4bdc-8005-b530a276816d req-5f816a57-469f-4057-9800-750fadcc1f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a458c18a-83a4-4d50-aa70-405fc0efc33c", "name": "network-vif-deleted", "tag": "7a9e5d23-3540-4ecb-907e-77dde73c1f4f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:50.622396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:50.629308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-dab93bf2-e2ba-4bdc-8005-b530a276816d req-5f816a57-469f-4057-9800-750fadcc1f7b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:50.630497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-dab93bf2-e2ba-4bdc-8005-b530a276816d req-5f816a57-469f-4057-9800-750fadcc1f7b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:50.668674 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-dab93bf2-e2ba-4bdc-8005-b530a276816d req-5f816a57-469f-4057-9800-750fadcc1f7b service nova] Creating event network-vif-deleted:7a9e5d23-3540-4ecb-907e-77dde73c1f4f for instance a458c18a-83a4-4d50-aa70-405fc0efc33c on n-h2-760456-11 Jul 20 04:28:50.676967 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-dab93bf2-e2ba-4bdc-8005-b530a276816d req-5f816a57-469f-4057-9800-750fadcc1f7b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116059 Jul 20 04:28:50.678405 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2042/4096] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:51.155052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b5dfb90-50f8-4d18-973f-f26b23d9a9c3 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:51.187240 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b5dfb90-50f8-4d18-973f-f26b23d9a9c3 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 1.144423 Jul 20 04:28:51.195097 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2055/4097] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:50 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:51.456469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-38ebeb24-498a-4b6a-ae9e-166772e5e8c6 req-b14fbcd2-0156-4d85-a847-2ab463c288f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "tag": "2c15d928-9efd-43dd-a927-aee74278b54a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:51.463876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=14 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:51.479188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-38ebeb24-498a-4b6a-ae9e-166772e5e8c6 req-b14fbcd2-0156-4d85-a847-2ab463c288f3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:51.479946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-38ebeb24-498a-4b6a-ae9e-166772e5e8c6 req-b14fbcd2-0156-4d85-a847-2ab463c288f3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:51.499738 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-38ebeb24-498a-4b6a-ae9e-166772e5e8c6 req-b14fbcd2-0156-4d85-a847-2ab463c288f3 service nova] Creating event network-changed:2c15d928-9efd-43dd-a927-aee74278b54a for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:28:51.509328 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-38ebeb24-498a-4b6a-ae9e-166772e5e8c6 req-b14fbcd2-0156-4d85-a847-2ab463c288f3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058124 Jul 20 04:28:51.511345 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2043/4098] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:51.576972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e6ac9971-a597-473e-8ec9-bb698067ec20 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:51.577829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e6ac9971-a597-473e-8ec9-bb698067ec20 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: a458c18a-83a4-4d50-aa70-405fc0efc33c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:51.587138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:51.588793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6ac9971-a597-473e-8ec9-bb698067ec20 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:51.589261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6ac9971-a597-473e-8ec9-bb698067ec20 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:51.590046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6ac9971-a597-473e-8ec9-bb698067ec20 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:51.590516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6ac9971-a597-473e-8ec9-bb698067ec20 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:51.628123 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e6ac9971-a597-473e-8ec9-bb698067ec20 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] HTTP exception thrown: Instance a458c18a-83a4-4d50-aa70-405fc0efc33c could not be found. Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e6ac9971-a597-473e-8ec9-bb698067ec20 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Request method failure captured: Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c HTTP/1.1 Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14RJNgUEdS52s_wYfinyIDyTFr8xywdGaj05YLdGIv-Fwkn1wljxtQj3lcM4FE4_Q8xJ_2YT7tsrFELgbgSo83w1Q7ZSECnX9OdsqlFpl7HbBYr4gLyO5z0Xcu2UjAOEuuIX5hRipERWB_vRuLY9_PfLDd-MIB8ssNVQr-LhfOtbgw0 Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 5a6f9350148f496183a3fa7aeb2c4680 Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance a458c18a-83a4-4d50-aa70-405fc0efc33c could not be found. Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'a458c18a-83a4-4d50-aa70-405fc0efc33c'} Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a458c18a-83a4-4d50-aa70-405fc0efc33c could not be found. Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a458c18a-83a4-4d50-aa70-405fc0efc33c could not be found. Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:51.630159 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:51.634030 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:51.634030 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:51.634030 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:51.634030 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:51.634030 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:51.634030 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a458c18a-83a4-4d50-aa70-405fc0efc33c could not be found. Jul 20 04:28:51.634030 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:28:51.636222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e6ac9971-a597-473e-8ec9-bb698067ec20 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Returning 404 to user: Instance a458c18a-83a4-4d50-aa70-405fc0efc33c could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:51.637375 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e6ac9971-a597-473e-8ec9-bb698067ec20 tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c" status: 404 len: 111 microversion: 2.1 time: 0.064686 Jul 20 04:28:51.638746 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2056/4099] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:51 2022] GET /compute/v2.1/servers/a458c18a-83a4-4d50-aa70-405fc0efc33c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:28:51.658149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5851bfb2-6772-4383-8979-5fdc52100c1c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:51.660218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5851bfb2-6772-4383-8979-5fdc52100c1c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] [instance: 347bdc7d-c086-4495-ac23-65382faeb684] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:51.678849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5851bfb2-6772-4383-8979-5fdc52100c1c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:51.679650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5851bfb2-6772-4383-8979-5fdc52100c1c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:51.680600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5851bfb2-6772-4383-8979-5fdc52100c1c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:51.681056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5851bfb2-6772-4383-8979-5fdc52100c1c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:51.715823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-5851bfb2-6772-4383-8979-5fdc52100c1c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] HTTP exception thrown: Instance 347bdc7d-c086-4495-ac23-65382faeb684 could not be found. Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5851bfb2-6772-4383-8979-5fdc52100c1c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Request method failure captured: Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 HTTP/1.1 Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14RJNgUEdS52s_wYfinyIDyTFr8xywdGaj05YLdGIv-Fwkn1wljxtQj3lcM4FE4_Q8xJ_2YT7tsrFELgbgSo83w1Q7ZSECnX9OdsqlFpl7HbBYr4gLyO5z0Xcu2UjAOEuuIX5hRipERWB_vRuLY9_PfLDd-MIB8ssNVQr-LhfOtbgw0 Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e84ee4736e8c4818bffd3b624ed7edbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e84ee4736e8c4818bffd3b624ed7edbc Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1401132123 Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 5a6f9350148f496183a3fa7aeb2c4680 Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ListServersNegativeTestJSON-1401132123-project Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 347bdc7d-c086-4495-ac23-65382faeb684 could not be found. Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '347bdc7d-c086-4495-ac23-65382faeb684'} Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 347bdc7d-c086-4495-ac23-65382faeb684 could not be found. Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 347bdc7d-c086-4495-ac23-65382faeb684 could not be found. Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:28:51.721163 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:51.725306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:28:51.725306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:28:51.725306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:28:51.725306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:28:51.725306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:28:51.725306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 347bdc7d-c086-4495-ac23-65382faeb684 could not be found. Jul 20 04:28:51.725306 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:28:51.725306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5851bfb2-6772-4383-8979-5fdc52100c1c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] Returning 404 to user: Instance 347bdc7d-c086-4495-ac23-65382faeb684 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:28:51.727399 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5851bfb2-6772-4383-8979-5fdc52100c1c tempest-ListServersNegativeTestJSON-1401132123 tempest-ListServersNegativeTestJSON-1401132123-project] 10.222.0.59 "GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684" status: 404 len: 111 microversion: 2.1 time: 0.083684 Jul 20 04:28:51.728378 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2044/4100] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:51 2022] GET /compute/v2.1/servers/347bdc7d-c086-4495-ac23-65382faeb684 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:28:52.209945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d85e68a5-dbea-48b7-b39c-0d9a58f26448 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:52.210606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d85e68a5-dbea-48b7-b39c-0d9a58f26448 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:52.222046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d85e68a5-dbea-48b7-b39c-0d9a58f26448 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.222849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d85e68a5-dbea-48b7-b39c-0d9a58f26448 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:52.223843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d85e68a5-dbea-48b7-b39c-0d9a58f26448 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.224451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d85e68a5-dbea-48b7-b39c-0d9a58f26448 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:52.783809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d85e68a5-dbea-48b7-b39c-0d9a58f26448 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:52.796124 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d85e68a5-dbea-48b7-b39c-0d9a58f26448 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.589941 Jul 20 04:28:52.802395 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2057/4101] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:52 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:53.540607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-6089a93d-795f-4ea1-93a5-3cdd06d194f8 req-5f11a0b4-6257-4f63-b305-390590f96b82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "tag": "233a077e-b300-4594-b90b-43b86cb73e2f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:53.556416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6089a93d-795f-4ea1-93a5-3cdd06d194f8 req-5f11a0b4-6257-4f63-b305-390590f96b82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.556875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6089a93d-795f-4ea1-93a5-3cdd06d194f8 req-5f11a0b4-6257-4f63-b305-390590f96b82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.582640 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6089a93d-795f-4ea1-93a5-3cdd06d194f8 req-5f11a0b4-6257-4f63-b305-390590f96b82 service nova] Creating event network-changed:233a077e-b300-4594-b90b-43b86cb73e2f for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:28:53.592463 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-6089a93d-795f-4ea1-93a5-3cdd06d194f8 req-5f11a0b4-6257-4f63-b305-390590f96b82 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055257 Jul 20 04:28:53.598637 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2045/4102] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:53.813698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2fbc42ff-a88d-4012-b05a-add7227571a0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:53.814877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2fbc42ff-a88d-4012-b05a-add7227571a0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:53.825258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=10 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:53.832212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fbc42ff-a88d-4012-b05a-add7227571a0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.833071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fbc42ff-a88d-4012-b05a-add7227571a0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.834077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fbc42ff-a88d-4012-b05a-add7227571a0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.834737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fbc42ff-a88d-4012-b05a-add7227571a0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.500725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2fbc42ff-a88d-4012-b05a-add7227571a0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:54.516757 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2fbc42ff-a88d-4012-b05a-add7227571a0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.707541 Jul 20 04:28:54.527814 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2058/4103] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:53 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:55.546538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0355507-cbde-420c-a267-2d5b3ffccae8 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:55.547250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0355507-cbde-420c-a267-2d5b3ffccae8 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:55.566743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0355507-cbde-420c-a267-2d5b3ffccae8 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.567208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0355507-cbde-420c-a267-2d5b3ffccae8 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:55.577182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0355507-cbde-420c-a267-2d5b3ffccae8 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:55.577759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0355507-cbde-420c-a267-2d5b3ffccae8 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:56.387000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c0355507-cbde-420c-a267-2d5b3ffccae8 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:56.396682 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0355507-cbde-420c-a267-2d5b3ffccae8 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.856992 Jul 20 04:28:56.397278 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2046/4104] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:55 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:56.815801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-30c4bb53-3f79-44df-bb42-2e1d5e2396ce req-636d8fb5-2f78-44db-8825-015731ff4007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "tag": "c25ae45e-218d-452c-b4d6-36912ca2d014"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:56.852601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-30c4bb53-3f79-44df-bb42-2e1d5e2396ce req-636d8fb5-2f78-44db-8825-015731ff4007 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:56.856095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-30c4bb53-3f79-44df-bb42-2e1d5e2396ce req-636d8fb5-2f78-44db-8825-015731ff4007 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:56.898508 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-30c4bb53-3f79-44df-bb42-2e1d5e2396ce req-636d8fb5-2f78-44db-8825-015731ff4007 service nova] Creating event network-changed:c25ae45e-218d-452c-b4d6-36912ca2d014 for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:28:56.926423 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-30c4bb53-3f79-44df-bb42-2e1d5e2396ce req-636d8fb5-2f78-44db-8825-015731ff4007 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107033 Jul 20 04:28:56.927562 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2059/4105] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:57.413688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b3619a38-aed3-459c-b11d-e2e820f11fca tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:57.414363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b3619a38-aed3-459c-b11d-e2e820f11fca tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:57.429772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3619a38-aed3-459c-b11d-e2e820f11fca tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:57.430549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3619a38-aed3-459c-b11d-e2e820f11fca tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:57.433056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3619a38-aed3-459c-b11d-e2e820f11fca tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:57.434292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3619a38-aed3-459c-b11d-e2e820f11fca tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:58.511188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b3619a38-aed3-459c-b11d-e2e820f11fca tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:58.528276 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b3619a38-aed3-459c-b11d-e2e820f11fca tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 1.113114 Jul 20 04:28:58.529843 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2047/4106] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:57 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:59.546959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ff2c4fb5-1fbd-4cf7-857c-3d827e2aa05d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:59.547769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ff2c4fb5-1fbd-4cf7-857c-3d827e2aa05d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:59.563889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff2c4fb5-1fbd-4cf7-857c-3d827e2aa05d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.564441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff2c4fb5-1fbd-4cf7-857c-3d827e2aa05d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.565316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff2c4fb5-1fbd-4cf7-857c-3d827e2aa05d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.575079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff2c4fb5-1fbd-4cf7-857c-3d827e2aa05d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.620475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=70 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:00.583414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ff2c4fb5-1fbd-4cf7-857c-3d827e2aa05d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:00.594473 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ff2c4fb5-1fbd-4cf7-857c-3d827e2aa05d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 1.053051 Jul 20 04:29:00.601172 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2060/4107] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:59 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:01.627138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d5a8b57-97b2-4420-ad0c-eb396f68e719 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:01.628346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7d5a8b57-97b2-4420-ad0c-eb396f68e719 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:01.641773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d5a8b57-97b2-4420-ad0c-eb396f68e719 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.642055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d5a8b57-97b2-4420-ad0c-eb396f68e719 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:01.645658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d5a8b57-97b2-4420-ad0c-eb396f68e719 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:01.646410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d5a8b57-97b2-4420-ad0c-eb396f68e719 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:02.118858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7d5a8b57-97b2-4420-ad0c-eb396f68e719 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:02.128654 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7d5a8b57-97b2-4420-ad0c-eb396f68e719 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.506914 Jul 20 04:29:02.134289 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2048/4108] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:01 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:03.154716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b06de3a-b9e2-438b-8b50-00e6a100d54b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:03.154716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3b06de3a-b9e2-438b-8b50-00e6a100d54b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:03.162582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:03.164311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b06de3a-b9e2-438b-8b50-00e6a100d54b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.165013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b06de3a-b9e2-438b-8b50-00e6a100d54b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:03.165780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b06de3a-b9e2-438b-8b50-00e6a100d54b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:03.166506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b06de3a-b9e2-438b-8b50-00e6a100d54b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:04.049324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3b06de3a-b9e2-438b-8b50-00e6a100d54b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:04.074763 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b06de3a-b9e2-438b-8b50-00e6a100d54b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.932251 Jul 20 04:29:04.090877 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2061/4109] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:03 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:05.096061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-05efaf52-1483-4bfd-adf4-b3d92430db27 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:05.097390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05efaf52-1483-4bfd-adf4-b3d92430db27 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:05.111458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:05.113317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05efaf52-1483-4bfd-adf4-b3d92430db27 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:05.113950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05efaf52-1483-4bfd-adf4-b3d92430db27 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:05.115561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05efaf52-1483-4bfd-adf4-b3d92430db27 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:05.121880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05efaf52-1483-4bfd-adf4-b3d92430db27 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:05.431034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05efaf52-1483-4bfd-adf4-b3d92430db27 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:05.441385 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-05efaf52-1483-4bfd-adf4-b3d92430db27 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.351590 Jul 20 04:29:05.443121 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2049/4110] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:05 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:06.461853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e90c536-8951-4b0b-b2df-eff07ff457ac tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:06.462595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e90c536-8951-4b0b-b2df-eff07ff457ac tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:06.473643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e90c536-8951-4b0b-b2df-eff07ff457ac tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.486926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e90c536-8951-4b0b-b2df-eff07ff457ac tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.490231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e90c536-8951-4b0b-b2df-eff07ff457ac tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.492243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e90c536-8951-4b0b-b2df-eff07ff457ac tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.331613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e90c536-8951-4b0b-b2df-eff07ff457ac tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:07.356629 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e90c536-8951-4b0b-b2df-eff07ff457ac tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.900946 Jul 20 04:29:07.359111 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2062/4111] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:06 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:08.377690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa9d6644-c34f-415e-9bb9-d4de6072b14a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:08.378735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fa9d6644-c34f-415e-9bb9-d4de6072b14a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:08.395767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa9d6644-c34f-415e-9bb9-d4de6072b14a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.397022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa9d6644-c34f-415e-9bb9-d4de6072b14a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.402092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa9d6644-c34f-415e-9bb9-d4de6072b14a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.403019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa9d6644-c34f-415e-9bb9-d4de6072b14a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.785946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fa9d6644-c34f-415e-9bb9-d4de6072b14a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.801652 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa9d6644-c34f-415e-9bb9-d4de6072b14a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.429296 Jul 20 04:29:08.814069 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2050/4112] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:08 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:09.819428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-79c48f72-6856-484e-b2d9-a331a0bc0a00 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:09.820048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-79c48f72-6856-484e-b2d9-a331a0bc0a00 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:09.833693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79c48f72-6856-484e-b2d9-a331a0bc0a00 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.834647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79c48f72-6856-484e-b2d9-a331a0bc0a00 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:09.837194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79c48f72-6856-484e-b2d9-a331a0bc0a00 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:09.838004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79c48f72-6856-484e-b2d9-a331a0bc0a00 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:10.443169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-79c48f72-6856-484e-b2d9-a331a0bc0a00 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:10.457209 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-79c48f72-6856-484e-b2d9-a331a0bc0a00 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.638853 Jul 20 04:29:10.459089 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2063/4113] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:09 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:11.477364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fb8c55db-3e03-40ad-a841-540dacb12fc9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:11.478010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fb8c55db-3e03-40ad-a841-540dacb12fc9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:11.500310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb8c55db-3e03-40ad-a841-540dacb12fc9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:11.501014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb8c55db-3e03-40ad-a841-540dacb12fc9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:11.501822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb8c55db-3e03-40ad-a841-540dacb12fc9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:11.502322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb8c55db-3e03-40ad-a841-540dacb12fc9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.149490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fb8c55db-3e03-40ad-a841-540dacb12fc9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:12.151809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:12.158848 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fb8c55db-3e03-40ad-a841-540dacb12fc9 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.685491 Jul 20 04:29:12.166410 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2051/4114] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:11 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:12.540601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4c79073d-50c9-475a-aa54-9d3defbaaca4 req-57785f59-19f7-4e23-850f-36f87c4420be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "name": "network-vif-plugged", "status": "completed", "tag": "2c15d928-9efd-43dd-a927-aee74278b54a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:12.577458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4c79073d-50c9-475a-aa54-9d3defbaaca4 req-57785f59-19f7-4e23-850f-36f87c4420be service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.590099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4c79073d-50c9-475a-aa54-9d3defbaaca4 req-57785f59-19f7-4e23-850f-36f87c4420be service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.652640 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4c79073d-50c9-475a-aa54-9d3defbaaca4 req-57785f59-19f7-4e23-850f-36f87c4420be service nova] Creating event network-vif-plugged:2c15d928-9efd-43dd-a927-aee74278b54a for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:29:12.674153 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4c79073d-50c9-475a-aa54-9d3defbaaca4 req-57785f59-19f7-4e23-850f-36f87c4420be service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138870 Jul 20 04:29:12.681382 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2064/4115] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:13.182010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fc9638c3-8571-4445-9737-2b5c782de963 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:13.182580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fc9638c3-8571-4445-9737-2b5c782de963 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:13.196544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc9638c3-8571-4445-9737-2b5c782de963 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.205357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc9638c3-8571-4445-9737-2b5c782de963 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.206513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc9638c3-8571-4445-9737-2b5c782de963 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.209696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc9638c3-8571-4445-9737-2b5c782de963 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.903365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d01a393d-706b-4f14-835a-afc8a415bd49 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1286252022", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:13.906060 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d01a393d-706b-4f14-835a-afc8a415bd49 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] HTTP exception thrown: min_count must be <= max_count Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d01a393d-706b-4f14-835a-afc8a415bd49 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Request method failure captured: Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 184 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14SZTkDgoUeRxhN86xi6wm1330U9J0JbPwmLEmfFE5JmjGs1HUxHPZVHfanhEh51Z-f3IuFq4nsCOpJjjoQKyY4MSIWC6cZruEK3hIXq1bpk3iKYnxH3iuvnX5V0-gO26fzgsuDFNAHTrVOav01HXRvGWfcvlxm1tvwTQfWmxTvZ1Q8 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1761fbce42fa4382abad2dab4e0ac400 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1761fbce42fa4382abad2dab4e0ac400 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-MultipleCreateNegativeTestJSON-1512241703-project Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: ceee33ba198b43debfaa771752043f65 Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1512241703-project Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1286252022", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: exception: min_count must be <= max_count Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1286252022', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 20 04:29:13.909673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:13.916140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d01a393d-706b-4f14-835a-afc8a415bd49 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Returning 400 to user: min_count must be <= max_count {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:13.917213 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d01a393d-706b-4f14-835a-afc8a415bd49 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.505426 Jul 20 04:29:13.918302 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2065/4116] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:13 2022] POST /compute/v2.1/servers => generated 74 bytes in 507 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 20 04:29:14.004100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b461d09-0307-4bed-b4c6-c0c8597408f5 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1171341688", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "max_count": 0}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b461d09-0307-4bed-b4c6-c0c8597408f5 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Request method failure captured: Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 168 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14SZTkDgoUeRxhN86xi6wm1330U9J0JbPwmLEmfFE5JmjGs1HUxHPZVHfanhEh51Z-f3IuFq4nsCOpJjjoQKyY4MSIWC6cZruEK3hIXq1bpk3iKYnxH3iuvnX5V0-gO26fzgsuDFNAHTrVOav01HXRvGWfcvlxm1tvwTQfWmxTvZ1Q8 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1761fbce42fa4382abad2dab4e0ac400 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1761fbce42fa4382abad2dab4e0ac400 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-MultipleCreateNegativeTestJSON-1512241703-project Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: ceee33ba198b43debfaa771752043f65 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1512241703-project Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1171341688", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "max_count": 0}} Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1171341688', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'max_count': 0}}} Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 0 Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:29:14.009024 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:14.013351 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.016364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b461d09-0307-4bed-b4c6-c0c8597408f5 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:14.019587 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b461d09-0307-4bed-b4c6-c0c8597408f5 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020759 Jul 20 04:29:14.022265 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2066/4117] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:13 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:14.269765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a7e88eef-08db-4a26-b55c-bcd7c0ee6340 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-83416953", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "max_count": 2.5}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a7e88eef-08db-4a26-b55c-bcd7c0ee6340 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Request method failure captured: Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 168 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14SZTkDgoUeRxhN86xi6wm1330U9J0JbPwmLEmfFE5JmjGs1HUxHPZVHfanhEh51Z-f3IuFq4nsCOpJjjoQKyY4MSIWC6cZruEK3hIXq1bpk3iKYnxH3iuvnX5V0-gO26fzgsuDFNAHTrVOav01HXRvGWfcvlxm1tvwTQfWmxTvZ1Q8 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1761fbce42fa4382abad2dab4e0ac400 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1761fbce42fa4382abad2dab4e0ac400 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-MultipleCreateNegativeTestJSON-1512241703-project Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: ceee33ba198b43debfaa771752043f65 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1512241703-project Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-83416953", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "max_count": 2.5}} Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-83416953', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'max_count': 2.5}}} Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 2.5 Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:29:14.273038 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a7e88eef-08db-4a26-b55c-bcd7c0ee6340 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:14.277243 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a7e88eef-08db-4a26-b55c-bcd7c0ee6340 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009574 Jul 20 04:29:14.278762 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2067/4118] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:29:14.409056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fc9638c3-8571-4445-9737-2b5c782de963 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:14.420796 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fc9638c3-8571-4445-9737-2b5c782de963 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 1.244642 Jul 20 04:29:14.422033 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2052/4119] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:13 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:14.517544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-78cf0112-75e3-4cba-9846-7e190eb9b162 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-232353501", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 0}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-78cf0112-75e3-4cba-9846-7e190eb9b162 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Request method failure captured: Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 167 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14SZTkDgoUeRxhN86xi6wm1330U9J0JbPwmLEmfFE5JmjGs1HUxHPZVHfanhEh51Z-f3IuFq4nsCOpJjjoQKyY4MSIWC6cZruEK3hIXq1bpk3iKYnxH3iuvnX5V0-gO26fzgsuDFNAHTrVOav01HXRvGWfcvlxm1tvwTQfWmxTvZ1Q8 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1761fbce42fa4382abad2dab4e0ac400 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1761fbce42fa4382abad2dab4e0ac400 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-MultipleCreateNegativeTestJSON-1512241703-project Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: ceee33ba198b43debfaa771752043f65 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1512241703-project Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-232353501", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 0}} Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-232353501', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'min_count': 0}}} Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 0 Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:29:14.520963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-78cf0112-75e3-4cba-9846-7e190eb9b162 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:14.525431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-78cf0112-75e3-4cba-9846-7e190eb9b162 tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.011576 Jul 20 04:29:14.526465 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2068/4120] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:14 2022] POST /compute/v2.1/servers => generated 130 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:14.695687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ecfc84d6-bff4-424f-8c51-ac2b1a0123ee tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1208023069", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 2.5}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ecfc84d6-bff4-424f-8c51-ac2b1a0123ee tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Request method failure captured: Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 170 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14SZTkDgoUeRxhN86xi6wm1330U9J0JbPwmLEmfFE5JmjGs1HUxHPZVHfanhEh51Z-f3IuFq4nsCOpJjjoQKyY4MSIWC6cZruEK3hIXq1bpk3iKYnxH3iuvnX5V0-gO26fzgsuDFNAHTrVOav01HXRvGWfcvlxm1tvwTQfWmxTvZ1Q8 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1761fbce42fa4382abad2dab4e0ac400 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1761fbce42fa4382abad2dab4e0ac400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1761fbce42fa4382abad2dab4e0ac400 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1512241703 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-MultipleCreateNegativeTestJSON-1512241703-project Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: ceee33ba198b43debfaa771752043f65 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1512241703-project Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1208023069", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "min_count": 2.5}} Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1208023069', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'min_count': 2.5}}} Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 2.5 Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:29:14.698582 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ecfc84d6-bff4-424f-8c51-ac2b1a0123ee tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:14.710278 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ecfc84d6-bff4-424f-8c51-ac2b1a0123ee tempest-MultipleCreateNegativeTestJSON-1512241703 tempest-MultipleCreateNegativeTestJSON-1512241703-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.008269 Jul 20 04:29:14.711636 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2053/4121] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:14.793144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b303003e-3100-4020-a076-0fd98cfd68a1 req-d34ddd7b-e7f2-48e2-a1b9-8a4b3ef9e14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "name": "network-vif-plugged", "status": "completed", "tag": "c25ae45e-218d-452c-b4d6-36912ca2d014"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:14.818770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b303003e-3100-4020-a076-0fd98cfd68a1 req-d34ddd7b-e7f2-48e2-a1b9-8a4b3ef9e14e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.819211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b303003e-3100-4020-a076-0fd98cfd68a1 req-d34ddd7b-e7f2-48e2-a1b9-8a4b3ef9e14e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.833831 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b303003e-3100-4020-a076-0fd98cfd68a1 req-d34ddd7b-e7f2-48e2-a1b9-8a4b3ef9e14e service nova] Creating event network-vif-plugged:c25ae45e-218d-452c-b4d6-36912ca2d014 for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:29:14.854919 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b303003e-3100-4020-a076-0fd98cfd68a1 req-d34ddd7b-e7f2-48e2-a1b9-8a4b3ef9e14e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068253 Jul 20 04:29:14.857958 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2069/4122] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:15.440729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-271b0078-512a-4802-8fbe-1da44cf5f9c4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:15.442356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-271b0078-512a-4802-8fbe-1da44cf5f9c4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:15.481265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-271b0078-512a-4802-8fbe-1da44cf5f9c4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.483202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-271b0078-512a-4802-8fbe-1da44cf5f9c4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.484028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-271b0078-512a-4802-8fbe-1da44cf5f9c4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.484476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-271b0078-512a-4802-8fbe-1da44cf5f9c4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.269195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-271b0078-512a-4802-8fbe-1da44cf5f9c4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:16.281691 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-271b0078-512a-4802-8fbe-1da44cf5f9c4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.848363 Jul 20 04:29:16.294639 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2054/4123] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:15 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:16.986997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6a8f7d48-71f0-49ad-834c-655342cdc557 req-d76b2327-b337-4bb3-bf9b-a703395e13d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "name": "network-vif-plugged", "status": "completed", "tag": "233a077e-b300-4594-b90b-43b86cb73e2f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:17.014989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6a8f7d48-71f0-49ad-834c-655342cdc557 req-d76b2327-b337-4bb3-bf9b-a703395e13d9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.015381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6a8f7d48-71f0-49ad-834c-655342cdc557 req-d76b2327-b337-4bb3-bf9b-a703395e13d9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.052022 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6a8f7d48-71f0-49ad-834c-655342cdc557 req-d76b2327-b337-4bb3-bf9b-a703395e13d9 service nova] Creating event network-vif-plugged:233a077e-b300-4594-b90b-43b86cb73e2f for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:29:17.062180 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6a8f7d48-71f0-49ad-834c-655342cdc557 req-d76b2327-b337-4bb3-bf9b-a703395e13d9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082496 Jul 20 04:29:17.065006 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2070/4124] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:17.301259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ace6cab0-3c18-4fe6-a719-ccefd802e630 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.304929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ace6cab0-3c18-4fe6-a719-ccefd802e630 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.322080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ace6cab0-3c18-4fe6-a719-ccefd802e630 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.326329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ace6cab0-3c18-4fe6-a719-ccefd802e630 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.327680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ace6cab0-3c18-4fe6-a719-ccefd802e630 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.328357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ace6cab0-3c18-4fe6-a719-ccefd802e630 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.116501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ace6cab0-3c18-4fe6-a719-ccefd802e630 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.136503 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ace6cab0-3c18-4fe6-a719-ccefd802e630 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1354 microversion: 2.1 time: 0.838871 Jul 20 04:29:18.139289 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2055/4125] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1354 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:19.160932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1e622e69-cc1f-49e4-91f2-ce72d08fa675 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.161658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1e622e69-cc1f-49e4-91f2-ce72d08fa675 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.189773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e622e69-cc1f-49e4-91f2-ce72d08fa675 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.190615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e622e69-cc1f-49e4-91f2-ce72d08fa675 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.192208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e622e69-cc1f-49e4-91f2-ce72d08fa675 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.193680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e622e69-cc1f-49e4-91f2-ce72d08fa675 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.871155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1e622e69-cc1f-49e4-91f2-ce72d08fa675 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:19.892169 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1e622e69-cc1f-49e4-91f2-ce72d08fa675 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1803 microversion: 2.1 time: 0.741668 Jul 20 04:29:19.902728 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2071/4126] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1803 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:19.921234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-11a01a02-a43a-4b93-bc7c-18791722f565 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.923016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-11a01a02-a43a-4b93-bc7c-18791722f565 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.940948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11a01a02-a43a-4b93-bc7c-18791722f565 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.943095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11a01a02-a43a-4b93-bc7c-18791722f565 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.946404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11a01a02-a43a-4b93-bc7c-18791722f565 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.947130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11a01a02-a43a-4b93-bc7c-18791722f565 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.009207 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-11a01a02-a43a-4b93-bc7c-18791722f565 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6/ips" status: 200 len: 217 microversion: 2.1 time: 0.093067 Jul 20 04:29:20.011673 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2056/4127] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6/ips => generated 217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:20.022449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-87ec8205-c536-4293-9235-1f41e34669ba tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.023218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-87ec8205-c536-4293-9235-1f41e34669ba tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.036841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87ec8205-c536-4293-9235-1f41e34669ba tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.040162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87ec8205-c536-4293-9235-1f41e34669ba tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.043118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87ec8205-c536-4293-9235-1f41e34669ba tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.044667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87ec8205-c536-4293-9235-1f41e34669ba tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.115662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-87ec8205-c536-4293-9235-1f41e34669ba tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:20.287616 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-87ec8205-c536-4293-9235-1f41e34669ba tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 204 len: 0 microversion: 2.1 time: 0.269807 Jul 20 04:29:20.288557 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2072/4128] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:20 2022] DELETE /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:29:20.298306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b03faa2-e7b5-4caf-a64b-4fc0b5aff56a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.299184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b03faa2-e7b5-4caf-a64b-4fc0b5aff56a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.315458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b03faa2-e7b5-4caf-a64b-4fc0b5aff56a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.317064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b03faa2-e7b5-4caf-a64b-4fc0b5aff56a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.319278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b03faa2-e7b5-4caf-a64b-4fc0b5aff56a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.321409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b03faa2-e7b5-4caf-a64b-4fc0b5aff56a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.338436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0b03faa2-e7b5-4caf-a64b-4fc0b5aff56a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:21.351977 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b03faa2-e7b5-4caf-a64b-4fc0b5aff56a tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1809 microversion: 2.1 time: 1.058978 Jul 20 04:29:21.353369 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2057/4129] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1809 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:22.373011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-946d050a-0a10-4591-97d9-949f9f6f1578 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:22.373735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-946d050a-0a10-4591-97d9-949f9f6f1578 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:22.393445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-946d050a-0a10-4591-97d9-949f9f6f1578 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.393920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-946d050a-0a10-4591-97d9-949f9f6f1578 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:22.394750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-946d050a-0a10-4591-97d9-949f9f6f1578 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:22.395201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-946d050a-0a10-4591-97d9-949f9f6f1578 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:23.305484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-946d050a-0a10-4591-97d9-949f9f6f1578 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:23.316059 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-946d050a-0a10-4591-97d9-949f9f6f1578 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1809 microversion: 2.1 time: 0.948376 Jul 20 04:29:23.316659 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2073/4130] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:22 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1809 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:23.548199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-85f7d32e-f8a5-47fd-99d9-6d10d52e6ed4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'create', calling method: .version_select at 0x7fb841b6c670>, body: {"keypair": {"name": "tempest-keypair-358498932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHguqq0Cr0u632svY2PV2r1i6fYNBKwOUTqc6M0dzxUPmGuv5OqlZqjusHCVtxtY+BSe6xboV59L9lwRfqWQWMZ51B2kkTL0Flww/qI8JrElOcZWWKLoAmsVD7BqkBPW7Q=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:23.587703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-85f7d32e-f8a5-47fd-99d9-6d10d52e6ed4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:23.608879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-85f7d32e-f8a5-47fd-99d9-6d10d52e6ed4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for user a3a58233b2b044d9b1285b616c79f9b8 and project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:23.670548 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-85f7d32e-f8a5-47fd-99d9-6d10d52e6ed4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.510832 Jul 20 04:29:23.678314 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2058/4131] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:29:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:24.333284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aa3c28ba-4bb8-43c2-98eb-4d79ba76450e tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.334777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aa3c28ba-4bb8-43c2-98eb-4d79ba76450e tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:24.349489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa3c28ba-4bb8-43c2-98eb-4d79ba76450e tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.351537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa3c28ba-4bb8-43c2-98eb-4d79ba76450e tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.354143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa3c28ba-4bb8-43c2-98eb-4d79ba76450e tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.355040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa3c28ba-4bb8-43c2-98eb-4d79ba76450e tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:25.586235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aa3c28ba-4bb8-43c2-98eb-4d79ba76450e tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:25.625656 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aa3c28ba-4bb8-43c2-98eb-4d79ba76450e tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1809 microversion: 2.1 time: 1.296267 Jul 20 04:29:25.641534 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2074/4132] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:24 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1809 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:26.636297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-35ec6460-5839-454f-8a3d-fd0b03bd8ead req-35eedb9e-80f3-4098-94ff-011c850a8203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "name": "network-vif-deleted", "tag": "2c15d928-9efd-43dd-a927-aee74278b54a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:26.644453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca491bb7-9b5d-4497-9dbe-bd1000bb7cf0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:26.645085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ca491bb7-9b5d-4497-9dbe-bd1000bb7cf0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:26.657915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca491bb7-9b5d-4497-9dbe-bd1000bb7cf0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.661167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca491bb7-9b5d-4497-9dbe-bd1000bb7cf0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.665264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-35ec6460-5839-454f-8a3d-fd0b03bd8ead req-35eedb9e-80f3-4098-94ff-011c850a8203 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.665559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca491bb7-9b5d-4497-9dbe-bd1000bb7cf0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.665720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-35ec6460-5839-454f-8a3d-fd0b03bd8ead req-35eedb9e-80f3-4098-94ff-011c850a8203 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.667001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca491bb7-9b5d-4497-9dbe-bd1000bb7cf0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.706234 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-35ec6460-5839-454f-8a3d-fd0b03bd8ead req-35eedb9e-80f3-4098-94ff-011c850a8203 service nova] Creating event network-vif-deleted:2c15d928-9efd-43dd-a927-aee74278b54a for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:29:26.722647 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-35ec6460-5839-454f-8a3d-fd0b03bd8ead req-35eedb9e-80f3-4098-94ff-011c850a8203 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091361 Jul 20 04:29:26.725107 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2059/4133] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:26.785588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-336a4674-251b-48dc-9f76-7ff34a69ab97 req-e3933741-9c9f-4e3d-bc28-f641498b7407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "name": "network-vif-unplugged", "status": "completed", "tag": "c25ae45e-218d-452c-b4d6-36912ca2d014"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:26.826209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-336a4674-251b-48dc-9f76-7ff34a69ab97 req-e3933741-9c9f-4e3d-bc28-f641498b7407 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.826927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-336a4674-251b-48dc-9f76-7ff34a69ab97 req-e3933741-9c9f-4e3d-bc28-f641498b7407 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.852744 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-336a4674-251b-48dc-9f76-7ff34a69ab97 req-e3933741-9c9f-4e3d-bc28-f641498b7407 service nova] Creating event network-vif-unplugged:c25ae45e-218d-452c-b4d6-36912ca2d014 for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:29:26.871157 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-336a4674-251b-48dc-9f76-7ff34a69ab97 req-e3933741-9c9f-4e3d-bc28-f641498b7407 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090926 Jul 20 04:29:26.873307 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2060/4134] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:28.139851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ca491bb7-9b5d-4497-9dbe-bd1000bb7cf0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:28.180080 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ca491bb7-9b5d-4497-9dbe-bd1000bb7cf0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1788 microversion: 2.1 time: 1.536559 Jul 20 04:29:28.201031 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2075/4135] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:26 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1788 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:28.968269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3428e123-9f87-4220-8ad8-1b2b7582f0fb req-a91d94a1-91a0-4cd2-ae2a-986ce135994b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "name": "network-vif-unplugged", "status": "completed", "tag": "233a077e-b300-4594-b90b-43b86cb73e2f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:29.017859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3428e123-9f87-4220-8ad8-1b2b7582f0fb req-a91d94a1-91a0-4cd2-ae2a-986ce135994b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:29.019329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3428e123-9f87-4220-8ad8-1b2b7582f0fb req-a91d94a1-91a0-4cd2-ae2a-986ce135994b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:29.054779 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3428e123-9f87-4220-8ad8-1b2b7582f0fb req-a91d94a1-91a0-4cd2-ae2a-986ce135994b service nova] Creating event network-vif-unplugged:233a077e-b300-4594-b90b-43b86cb73e2f for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:29:29.070379 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3428e123-9f87-4220-8ad8-1b2b7582f0fb req-a91d94a1-91a0-4cd2-ae2a-986ce135994b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110317 Jul 20 04:29:29.079210 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2061/4136] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:29.206884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-96df00db-0330-4456-97f5-5c9d3e9795db tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:29.208287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-96df00db-0330-4456-97f5-5c9d3e9795db tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:29.224492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96df00db-0330-4456-97f5-5c9d3e9795db tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:29.225355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96df00db-0330-4456-97f5-5c9d3e9795db tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:29.229260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96df00db-0330-4456-97f5-5c9d3e9795db tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:29.230288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96df00db-0330-4456-97f5-5c9d3e9795db tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:29.344208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-135ef9de-aba8-4faa-a976-21a98fab0d6b req-b671d282-2c16-4907-be23-543b9dd1e93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "name": "network-vif-deleted", "tag": "c25ae45e-218d-452c-b4d6-36912ca2d014"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:29.361170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-135ef9de-aba8-4faa-a976-21a98fab0d6b req-b671d282-2c16-4907-be23-543b9dd1e93f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:29.362015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-135ef9de-aba8-4faa-a976-21a98fab0d6b req-b671d282-2c16-4907-be23-543b9dd1e93f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:29.378235 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-135ef9de-aba8-4faa-a976-21a98fab0d6b req-b671d282-2c16-4907-be23-543b9dd1e93f service nova] Creating event network-vif-deleted:c25ae45e-218d-452c-b4d6-36912ca2d014 for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:29:29.385527 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-135ef9de-aba8-4faa-a976-21a98fab0d6b req-b671d282-2c16-4907-be23-543b9dd1e93f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047960 Jul 20 04:29:29.386888 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2062/4137] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:30.908339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1144200792", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4388b376-1cd5-454f-a519-55f9a04383ba"}], "security_groups": [{"name": "tempest-securitygroup--1809135833"}], "key_name": "tempest-keypair-358498932", "user_data": "}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:31.612298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-96df00db-0330-4456-97f5-5c9d3e9795db tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:31.615316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:31.631678 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-96df00db-0330-4456-97f5-5c9d3e9795db tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1652 microversion: 2.1 time: 2.430274 Jul 20 04:29:31.635425 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2076/4138] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:29 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1652 bytes in 2435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:31.918636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] validate_networks() for [('4388b376-1cd5-454f-a519-55f9a04383ba', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:29:32.657094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8656a125-82d7-45bf-be63-628fffce8fd2 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:32.658279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8656a125-82d7-45bf-be63-628fffce8fd2 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:32.673804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8656a125-82d7-45bf-be63-628fffce8fd2 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.691712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8656a125-82d7-45bf-be63-628fffce8fd2 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.692897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8656a125-82d7-45bf-be63-628fffce8fd2 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.697925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8656a125-82d7-45bf-be63-628fffce8fd2 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:33.008187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8656a125-82d7-45bf-be63-628fffce8fd2 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:33.027077 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8656a125-82d7-45bf-be63-628fffce8fd2 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 200 len: 1452 microversion: 2.1 time: 0.367137 Jul 20 04:29:33.042743 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2077/4139] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:32 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 1452 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:33.068845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b4aa6b00-50e4-43f5-b303-2a0eb68a566f req-a4cd3030-91dc-49dd-8ae5-bdc42108bf53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6", "name": "network-vif-deleted", "tag": "233a077e-b300-4594-b90b-43b86cb73e2f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:33.096683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b4aa6b00-50e4-43f5-b303-2a0eb68a566f req-a4cd3030-91dc-49dd-8ae5-bdc42108bf53 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:33.111947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b4aa6b00-50e4-43f5-b303-2a0eb68a566f req-a4cd3030-91dc-49dd-8ae5-bdc42108bf53 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:33.185324 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b4aa6b00-50e4-43f5-b303-2a0eb68a566f req-a4cd3030-91dc-49dd-8ae5-bdc42108bf53 service nova] Creating event network-vif-deleted:233a077e-b300-4594-b90b-43b86cb73e2f for instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 on n-h1-760456-11 Jul 20 04:29:33.217926 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b4aa6b00-50e4-43f5-b303-2a0eb68a566f req-a4cd3030-91dc-49dd-8ae5-bdc42108bf53 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173249 Jul 20 04:29:33.218609 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2078/4140] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:33.628098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:34.065382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-810082c7-801e-48a4-8cd7-1cac94163274 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:34.066070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-810082c7-801e-48a4-8cd7-1cac94163274 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:34.070747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:34.084818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-810082c7-801e-48a4-8cd7-1cac94163274 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:34.092629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-810082c7-801e-48a4-8cd7-1cac94163274 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:34.098295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-810082c7-801e-48a4-8cd7-1cac94163274 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:34.098950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-810082c7-801e-48a4-8cd7-1cac94163274 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:34.146521 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-810082c7-801e-48a4-8cd7-1cac94163274 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] HTTP exception thrown: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-810082c7-801e-48a4-8cd7-1cac94163274 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Request method failure captured: Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 HTTP/1.1 Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14RpvhRV4EQwebbmUaIfRRlDwhdM0mBhaNJYIBhuTcIlLtmF63aBcedJxDJVv82Yv2m1emJw4RTXcKXP0v7v47QG9nU2yCeIEyPuqSsZL9Y0GDMaz-SbRv1xwTVSr4GgiBaRuZdk2jCIPq81CeEljxzvQW1LOLjHiMG8pMfMlWVYdUU Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestMultiNic-812693220 Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestMultiNic-812693220-project Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: bdf595a75d684e629dc60f0ae7386935 Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestMultiNic-812693220-project Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6'} Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:34.148292 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:34.153200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:34.153200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:34.153200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:34.153200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:34.153200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:34.153200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:29:34.153200 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:29:34.154890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-810082c7-801e-48a4-8cd7-1cac94163274 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Returning 404 to user: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:34.156743 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-810082c7-801e-48a4-8cd7-1cac94163274 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 404 len: 111 microversion: 2.1 time: 0.095609 Jul 20 04:29:34.163784 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2079/4141] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:34 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:29:35.965588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:35.969816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:35.970515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:35.973622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:35.974889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:35.980272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:36.041763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.042272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.045613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.046489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.100704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:36.135574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for user a3a58233b2b044d9b1285b616c79f9b8 and project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:36.171667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:36.179261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:36.274925 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-860b4b55-7362-4d44-980f-56d2aa591f67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.373005 Jul 20 04:29:36.277170 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2063/4142] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 5378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:29:36.287736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a92eaa2-c05c-4e99-94f1-9bea707ebb08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:36.289216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1a92eaa2-c05c-4e99-94f1-9bea707ebb08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:36.788532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a92eaa2-c05c-4e99-94f1-9bea707ebb08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:36.818935 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a92eaa2-c05c-4e99-94f1-9bea707ebb08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1238 microversion: 2.1 time: 0.536329 Jul 20 04:29:36.826578 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2080/4143] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:36 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1238 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:37.842127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-22d6837d-4bc3-464c-b2e1-587469cc0fb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:37.842127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22d6837d-4bc3-464c-b2e1-587469cc0fb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:37.854208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22d6837d-4bc3-464c-b2e1-587469cc0fb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.857501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22d6837d-4bc3-464c-b2e1-587469cc0fb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.858543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22d6837d-4bc3-464c-b2e1-587469cc0fb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.862597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22d6837d-4bc3-464c-b2e1-587469cc0fb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:38.264099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-22d6837d-4bc3-464c-b2e1-587469cc0fb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:38.280175 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-22d6837d-4bc3-464c-b2e1-587469cc0fb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1234 microversion: 2.1 time: 0.443890 Jul 20 04:29:38.282445 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2064/4144] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:37 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1234 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:39.306865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d5f93a23-21e3-4c65-aeb4-804319b32f9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:39.312607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d5f93a23-21e3-4c65-aeb4-804319b32f9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:39.338075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5f93a23-21e3-4c65-aeb4-804319b32f9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.347478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5f93a23-21e3-4c65-aeb4-804319b32f9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.349304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5f93a23-21e3-4c65-aeb4-804319b32f9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.351619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5f93a23-21e3-4c65-aeb4-804319b32f9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.727343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d5f93a23-21e3-4c65-aeb4-804319b32f9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:39.745781 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d5f93a23-21e3-4c65-aeb4-804319b32f9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1296 microversion: 2.1 time: 0.449581 Jul 20 04:29:39.750027 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2081/4145] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:39 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1296 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:40.765720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b5c3c00-bbc5-4a7f-ae58-2a8f262891fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:40.766511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b5c3c00-bbc5-4a7f-ae58-2a8f262891fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:40.788229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b5c3c00-bbc5-4a7f-ae58-2a8f262891fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.788776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b5c3c00-bbc5-4a7f-ae58-2a8f262891fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.789735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b5c3c00-bbc5-4a7f-ae58-2a8f262891fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.791677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b5c3c00-bbc5-4a7f-ae58-2a8f262891fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.978343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0b5c3c00-bbc5-4a7f-ae58-2a8f262891fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:40.990549 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b5c3c00-bbc5-4a7f-ae58-2a8f262891fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1296 microversion: 2.1 time: 0.228852 Jul 20 04:29:40.992393 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2065/4146] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:40 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1296 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:42.016379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4643c53-26a8-4b30-ae70-c5d5cdd1a5c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:42.018076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b4643c53-26a8-4b30-ae70-c5d5cdd1a5c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:42.034582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4643c53-26a8-4b30-ae70-c5d5cdd1a5c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:42.052589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4643c53-26a8-4b30-ae70-c5d5cdd1a5c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:42.053900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4643c53-26a8-4b30-ae70-c5d5cdd1a5c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:42.057863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4643c53-26a8-4b30-ae70-c5d5cdd1a5c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:42.314581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1219354480", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:42.435742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] validate_networks() for [('125d9e24-188e-44f7-91fc-3980215e3cdb', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:29:43.008372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b4643c53-26a8-4b30-ae70-c5d5cdd1a5c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:43.023008 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b4643c53-26a8-4b30-ae70-c5d5cdd1a5c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 1.012111 Jul 20 04:29:43.025680 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2066/4147] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:42 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:43.057279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-237583230", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "6e030ec2-6bd1-4fba-89f0-ee15d95331bd"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:43.181768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] validate_networks() for [('6e030ec2-6bd1-4fba-89f0-ee15d95331bd', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:29:43.690540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:43.691034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:43.691449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:43.691867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:43.692289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:43.713973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:43.719760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.721542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:43.721676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.763653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Getting quotas for project ce0206e02d3d4e199c266d1bc82003b0. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:43.773251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Getting quotas for user 7a6085c4cb104f20a1f1dd6a8d30b4ce and project ce0206e02d3d4e199c266d1bc82003b0. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:43.809440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:43.812191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:43.913451 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-46865691-a3df-418d-8f37-0662b8b86275 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.944792 Jul 20 04:29:43.920129 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2082/4148] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:29:43.927577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0b3f3b9c-62fa-4db7-b6c3-346eb887fd44 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:43.928445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0b3f3b9c-62fa-4db7-b6c3-346eb887fd44 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:44.071918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0b3f3b9c-62fa-4db7-b6c3-346eb887fd44 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:44.089015 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0b3f3b9c-62fa-4db7-b6c3-346eb887fd44 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1214 microversion: 2.1 time: 0.167055 Jul 20 04:29:44.101289 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2083/4149] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:43 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:44.114940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-79424867-680c-4376-ad33-c13ae25d85c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:44.118817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-79424867-680c-4376-ad33-c13ae25d85c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:44.138527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79424867-680c-4376-ad33-c13ae25d85c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:44.138991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79424867-680c-4376-ad33-c13ae25d85c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.145379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79424867-680c-4376-ad33-c13ae25d85c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:44.145846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79424867-680c-4376-ad33-c13ae25d85c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.554670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-79424867-680c-4376-ad33-c13ae25d85c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:44.566945 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-79424867-680c-4376-ad33-c13ae25d85c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 0.463359 Jul 20 04:29:44.567722 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2084/4150] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:44 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:45.108501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f1111da3-17cc-4e62-ad1f-c36ca18d9847 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:45.109120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f1111da3-17cc-4e62-ad1f-c36ca18d9847 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:45.120980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1111da3-17cc-4e62-ad1f-c36ca18d9847 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.127395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1111da3-17cc-4e62-ad1f-c36ca18d9847 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:45.128885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1111da3-17cc-4e62-ad1f-c36ca18d9847 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.129561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1111da3-17cc-4e62-ad1f-c36ca18d9847 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:45.302364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f1111da3-17cc-4e62-ad1f-c36ca18d9847 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:45.323854 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f1111da3-17cc-4e62-ad1f-c36ca18d9847 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1210 microversion: 2.1 time: 0.220146 Jul 20 04:29:45.324885 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2085/4151] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:45 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:45.584056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ef06a12-9e24-42dd-aa58-2d08d84587e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:45.585561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ef06a12-9e24-42dd-aa58-2d08d84587e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:45.608239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ef06a12-9e24-42dd-aa58-2d08d84587e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.608701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ef06a12-9e24-42dd-aa58-2d08d84587e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:45.609502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ef06a12-9e24-42dd-aa58-2d08d84587e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.609947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ef06a12-9e24-42dd-aa58-2d08d84587e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.008689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ef06a12-9e24-42dd-aa58-2d08d84587e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:46.021001 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ef06a12-9e24-42dd-aa58-2d08d84587e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 0.440929 Jul 20 04:29:46.023279 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2086/4152] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:45 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:46.079661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:46.154703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:46.325281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:46.325960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:46.326677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:46.327292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:46.328078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:46.341847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7a174f47-068d-4144-94c6-473d589497b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:46.343075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7a174f47-068d-4144-94c6-473d589497b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:46.354684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:46.358277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.360417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:46.361838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.363970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a174f47-068d-4144-94c6-473d589497b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:46.364635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a174f47-068d-4144-94c6-473d589497b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.365493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a174f47-068d-4144-94c6-473d589497b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:46.365944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a174f47-068d-4144-94c6-473d589497b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.412484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=58 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:46.464607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Getting quotas for project 9ab426ff745841d6bb7e17629290159f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:46.487760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Getting quotas for user 9c7ea326a3b04e31a4c4fd8a62c7d52d and project 9ab426ff745841d6bb7e17629290159f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:46.532250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:46.537037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:46.662415 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d7e6060b-8198-4bc3-a224-263916129646 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.634169 Jul 20 04:29:46.667084 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2067/4153] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:29:46.678632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-831b3559-73b2-49a3-ac9a-f2ed0ade43f4 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:46.680435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-831b3559-73b2-49a3-ac9a-f2ed0ade43f4 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:46.796175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-831b3559-73b2-49a3-ac9a-f2ed0ade43f4 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:46.810680 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-831b3559-73b2-49a3-ac9a-f2ed0ade43f4 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1213 microversion: 2.1 time: 0.135787 Jul 20 04:29:46.812834 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2068/4154] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:46 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:47.039204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c84acb56-47db-4be6-9023-80f1fa82f221 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:47.039821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c84acb56-47db-4be6-9023-80f1fa82f221 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:47.051185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c84acb56-47db-4be6-9023-80f1fa82f221 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.051854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c84acb56-47db-4be6-9023-80f1fa82f221 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.053530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c84acb56-47db-4be6-9023-80f1fa82f221 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.054139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c84acb56-47db-4be6-9023-80f1fa82f221 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.142836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7a174f47-068d-4144-94c6-473d589497b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:47.153954 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7a174f47-068d-4144-94c6-473d589497b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1272 microversion: 2.1 time: 0.816364 Jul 20 04:29:47.154266 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2087/4155] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:46 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1272 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:47.420188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-36118131-ef86-4f2b-a17e-74fdf1220586 req-e3ef6799-aaea-4a08-a2e7-aed2e912ad06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b78332-e314-4da3-8a21-1ccfa545f11a", "tag": "8c4c6b64-e711-449a-a899-27913ed07df2"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:47.447127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-36118131-ef86-4f2b-a17e-74fdf1220586 req-e3ef6799-aaea-4a08-a2e7-aed2e912ad06 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.447587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-36118131-ef86-4f2b-a17e-74fdf1220586 req-e3ef6799-aaea-4a08-a2e7-aed2e912ad06 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.481234 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-36118131-ef86-4f2b-a17e-74fdf1220586 req-e3ef6799-aaea-4a08-a2e7-aed2e912ad06 service nova] Creating event network-changed:8c4c6b64-e711-449a-a899-27913ed07df2 for instance 44b78332-e314-4da3-8a21-1ccfa545f11a on n-h2-760456-11 Jul 20 04:29:47.493593 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-36118131-ef86-4f2b-a17e-74fdf1220586 req-e3ef6799-aaea-4a08-a2e7-aed2e912ad06 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077450 Jul 20 04:29:47.497137 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2088/4156] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:29:47.502157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c84acb56-47db-4be6-9023-80f1fa82f221 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:47.512664 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c84acb56-47db-4be6-9023-80f1fa82f221 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 0.477265 Jul 20 04:29:47.542411 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2069/4157] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:47 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:47.832988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c641f489-e275-472c-848e-6f01228f900d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:47.834009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c641f489-e275-472c-848e-6f01228f900d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:47.844846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c641f489-e275-472c-848e-6f01228f900d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.845678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c641f489-e275-472c-848e-6f01228f900d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.846903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c641f489-e275-472c-848e-6f01228f900d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.847546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c641f489-e275-472c-848e-6f01228f900d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:48.016212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c641f489-e275-472c-848e-6f01228f900d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:48.030742 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c641f489-e275-472c-848e-6f01228f900d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1209 microversion: 2.1 time: 0.202737 Jul 20 04:29:48.032947 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2089/4158] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:47 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1209 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:48.172696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1041abe8-f04b-4758-a34b-412bcda9ef90 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:48.173565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1041abe8-f04b-4758-a34b-412bcda9ef90 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:48.192312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1041abe8-f04b-4758-a34b-412bcda9ef90 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:48.192821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1041abe8-f04b-4758-a34b-412bcda9ef90 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:48.193795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1041abe8-f04b-4758-a34b-412bcda9ef90 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:48.194417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1041abe8-f04b-4758-a34b-412bcda9ef90 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:48.551914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8765dbe0-8f70-458c-82f8-186751e970a6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:48.552557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8765dbe0-8f70-458c-82f8-186751e970a6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:48.571770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8765dbe0-8f70-458c-82f8-186751e970a6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:48.572540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8765dbe0-8f70-458c-82f8-186751e970a6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:48.573367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8765dbe0-8f70-458c-82f8-186751e970a6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:48.575310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8765dbe0-8f70-458c-82f8-186751e970a6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:49.055779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8765dbe0-8f70-458c-82f8-186751e970a6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:49.065665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1041abe8-f04b-4758-a34b-412bcda9ef90 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:49.094939 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8765dbe0-8f70-458c-82f8-186751e970a6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 0.546587 Jul 20 04:29:49.096643 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1041abe8-f04b-4758-a34b-412bcda9ef90 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1314 microversion: 2.1 time: 0.928992 Jul 20 04:29:49.097230 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2090/4159] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:48 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:49.112102 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2070/4160] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:48 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1314 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:49.117880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-944e0a1e-7bc6-443f-83a4-ed80e652befe tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:49.121995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-944e0a1e-7bc6-443f-83a4-ed80e652befe tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:49.141848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-944e0a1e-7bc6-443f-83a4-ed80e652befe tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:49.142833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-944e0a1e-7bc6-443f-83a4-ed80e652befe tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:49.145721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-944e0a1e-7bc6-443f-83a4-ed80e652befe tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:49.146395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-944e0a1e-7bc6-443f-83a4-ed80e652befe tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:49.244796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-944e0a1e-7bc6-443f-83a4-ed80e652befe tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:49.261930 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-944e0a1e-7bc6-443f-83a4-ed80e652befe tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1271 microversion: 2.1 time: 0.162681 Jul 20 04:29:49.265510 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2091/4161] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:49 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:50.061421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c00c8664-e6f5-4aa2-a3d8-aba058e73dd5 req-738f6f84-74b4-439d-abd4-e53e41cec3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30ff4e64-da30-4eac-a9f9-61576b446fef", "tag": "2a034c5b-4cca-4960-83bb-28492bef618b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:50.084012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c00c8664-e6f5-4aa2-a3d8-aba058e73dd5 req-738f6f84-74b4-439d-abd4-e53e41cec3ea service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.084624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c00c8664-e6f5-4aa2-a3d8-aba058e73dd5 req-738f6f84-74b4-439d-abd4-e53e41cec3ea service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.116783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cc5e2050-438b-4eb5-bf30-bc1395bfe608 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:50.117519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cc5e2050-438b-4eb5-bf30-bc1395bfe608 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:50.129000 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c00c8664-e6f5-4aa2-a3d8-aba058e73dd5 req-738f6f84-74b4-439d-abd4-e53e41cec3ea service nova] Creating event network-changed:2a034c5b-4cca-4960-83bb-28492bef618b for instance 30ff4e64-da30-4eac-a9f9-61576b446fef on n-h1-760456-11 Jul 20 04:29:50.131529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc5e2050-438b-4eb5-bf30-bc1395bfe608 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.133076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc5e2050-438b-4eb5-bf30-bc1395bfe608 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.136300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc5e2050-438b-4eb5-bf30-bc1395bfe608 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.138060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc5e2050-438b-4eb5-bf30-bc1395bfe608 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.139701 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c00c8664-e6f5-4aa2-a3d8-aba058e73dd5 req-738f6f84-74b4-439d-abd4-e53e41cec3ea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083811 Jul 20 04:29:50.141928 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2071/4162] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:50.151758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b30c271a-019b-4153-a925-8cac38a97ba4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:50.154413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b30c271a-019b-4153-a925-8cac38a97ba4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:50.167406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b30c271a-019b-4153-a925-8cac38a97ba4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.168738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b30c271a-019b-4153-a925-8cac38a97ba4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.170358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b30c271a-019b-4153-a925-8cac38a97ba4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.171156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b30c271a-019b-4153-a925-8cac38a97ba4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.749423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cc5e2050-438b-4eb5-bf30-bc1395bfe608 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:50.754937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b30c271a-019b-4153-a925-8cac38a97ba4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:50.772341 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cc5e2050-438b-4eb5-bf30-bc1395bfe608 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 0.662297 Jul 20 04:29:50.773476 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2092/4163] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:50 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:50.774544 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b30c271a-019b-4153-a925-8cac38a97ba4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1314 microversion: 2.1 time: 0.629555 Jul 20 04:29:50.786864 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2072/4164] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:50 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:50.787667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0ec24c8-5c5d-4f97-9b52-48f96a48b494 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:50.791452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0ec24c8-5c5d-4f97-9b52-48f96a48b494 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:50.800448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0ec24c8-5c5d-4f97-9b52-48f96a48b494 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.801265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0ec24c8-5c5d-4f97-9b52-48f96a48b494 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.802225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0ec24c8-5c5d-4f97-9b52-48f96a48b494 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:50.802690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0ec24c8-5c5d-4f97-9b52-48f96a48b494 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.051550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a0ec24c8-5c5d-4f97-9b52-48f96a48b494 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:51.081771 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0ec24c8-5c5d-4f97-9b52-48f96a48b494 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1271 microversion: 2.1 time: 0.302959 Jul 20 04:29:51.082459 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2093/4165] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:50 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:51.791716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1e47e44f-f5de-4645-ba33-7876e8bccf11 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:51.792405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-247d65bc-c181-4662-a1ce-9a454076549e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:51.792832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1e47e44f-f5de-4645-ba33-7876e8bccf11 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:51.792954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-247d65bc-c181-4662-a1ce-9a454076549e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:51.806689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247d65bc-c181-4662-a1ce-9a454076549e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.808688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247d65bc-c181-4662-a1ce-9a454076549e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.810876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e47e44f-f5de-4645-ba33-7876e8bccf11 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.811278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e47e44f-f5de-4645-ba33-7876e8bccf11 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.812019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247d65bc-c181-4662-a1ce-9a454076549e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.812146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e47e44f-f5de-4645-ba33-7876e8bccf11 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.812566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e47e44f-f5de-4645-ba33-7876e8bccf11 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.813098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247d65bc-c181-4662-a1ce-9a454076549e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.219709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1e47e44f-f5de-4645-ba33-7876e8bccf11 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:52.237047 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1e47e44f-f5de-4645-ba33-7876e8bccf11 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1314 microversion: 2.1 time: 0.449250 Jul 20 04:29:52.237831 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2094/4166] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:51 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:52.252023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd9a4997-68ba-4eb3-9803-1e8510844ae3 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:52.253506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd9a4997-68ba-4eb3-9803-1e8510844ae3 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:52.281992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd9a4997-68ba-4eb3-9803-1e8510844ae3 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.282975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd9a4997-68ba-4eb3-9803-1e8510844ae3 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.284205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd9a4997-68ba-4eb3-9803-1e8510844ae3 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:52.284905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd9a4997-68ba-4eb3-9803-1e8510844ae3 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.495536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cd9a4997-68ba-4eb3-9803-1e8510844ae3 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:52.506169 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd9a4997-68ba-4eb3-9803-1e8510844ae3 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1271 microversion: 2.1 time: 0.266925 Jul 20 04:29:52.512571 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2095/4167] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:52 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1271 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:52.989503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-247d65bc-c181-4662-a1ce-9a454076549e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:53.004104 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-247d65bc-c181-4662-a1ce-9a454076549e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 1.213713 Jul 20 04:29:53.004899 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2073/4168] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:51 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:53.257044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b3488583-9821-4ab4-9e05-11f75c694913 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:53.257807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b3488583-9821-4ab4-9e05-11f75c694913 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:53.284692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3488583-9821-4ab4-9e05-11f75c694913 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.285639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3488583-9821-4ab4-9e05-11f75c694913 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.287019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3488583-9821-4ab4-9e05-11f75c694913 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.287730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3488583-9821-4ab4-9e05-11f75c694913 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.534606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca566160-2c4c-4f55-9c16-0eb66b3de878 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:53.535687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ca566160-2c4c-4f55-9c16-0eb66b3de878 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:53.552385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca566160-2c4c-4f55-9c16-0eb66b3de878 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.554320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca566160-2c4c-4f55-9c16-0eb66b3de878 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.555420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca566160-2c4c-4f55-9c16-0eb66b3de878 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.557727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca566160-2c4c-4f55-9c16-0eb66b3de878 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.735342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:53.794986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b3488583-9821-4ab4-9e05-11f75c694913 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:53.806705 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b3488583-9821-4ab4-9e05-11f75c694913 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1314 microversion: 2.1 time: 0.554327 Jul 20 04:29:53.808018 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2096/4169] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:53 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:54.022570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-752570b1-e67b-409f-8b60-7bb1051a355a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:54.023666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-752570b1-e67b-409f-8b60-7bb1051a355a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:54.038427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-752570b1-e67b-409f-8b60-7bb1051a355a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:54.049507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-752570b1-e67b-409f-8b60-7bb1051a355a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:54.050795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-752570b1-e67b-409f-8b60-7bb1051a355a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:54.051479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-752570b1-e67b-409f-8b60-7bb1051a355a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:54.097621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=10 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:54.385337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-752570b1-e67b-409f-8b60-7bb1051a355a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:54.407951 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-752570b1-e67b-409f-8b60-7bb1051a355a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 0.389282 Jul 20 04:29:54.409375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ca566160-2c4c-4f55-9c16-0eb66b3de878 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:54.442518 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2097/4170] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:54 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:54.450683 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ca566160-2c4c-4f55-9c16-0eb66b3de878 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1313 microversion: 2.1 time: 0.921993 Jul 20 04:29:54.451950 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2074/4171] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:53 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1313 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:54.452943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1212447535", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "61de9312-9364-4b51-8912-fd5e4e651f4c"}, {"uuid": "9e15bec5-ae93-46f3-964c-8c96c8f75eec"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:54.610500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] validate_networks() for [('61de9312-9364-4b51-8912-fd5e4e651f4c', None, None, None, None, None), ('9e15bec5-ae93-46f3-964c-8c96c8f75eec', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:29:54.826716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1afac9ef-47e5-461b-86b6-2d14b704c221 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:54.827466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1afac9ef-47e5-461b-86b6-2d14b704c221 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:54.838908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1afac9ef-47e5-461b-86b6-2d14b704c221 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:54.843206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1afac9ef-47e5-461b-86b6-2d14b704c221 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:54.844248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1afac9ef-47e5-461b-86b6-2d14b704c221 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:54.854171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1afac9ef-47e5-461b-86b6-2d14b704c221 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.977126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1afac9ef-47e5-461b-86b6-2d14b704c221 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:55.990484 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1afac9ef-47e5-461b-86b6-2d14b704c221 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1314 microversion: 2.1 time: 1.167866 Jul 20 04:29:55.991747 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2075/4172] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:54 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1314 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:55.997500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e45a3e7d-91c3-4ae6-ada5-12b6cf96c23b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:56.007250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e45a3e7d-91c3-4ae6-ada5-12b6cf96c23b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:56.021717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e45a3e7d-91c3-4ae6-ada5-12b6cf96c23b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.025131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e45a3e7d-91c3-4ae6-ada5-12b6cf96c23b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:56.026215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e45a3e7d-91c3-4ae6-ada5-12b6cf96c23b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.026916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e45a3e7d-91c3-4ae6-ada5-12b6cf96c23b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:56.407196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:56.806406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:56.919418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:56.921343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:56.922145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:56.922921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:56.923640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:56.968405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.971582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:56.974610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:56.975375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.007588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:57.040172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Getting quotas for project 4cf3839dd67a4a6ab91bba230b6aa8e3. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:57.053157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Getting quotas for user bdf595a75d684e629dc60f0ae7386935 and project 4cf3839dd67a4a6ab91bba230b6aa8e3. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:57.085472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:57.088354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:57.175846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e45a3e7d-91c3-4ae6-ada5-12b6cf96c23b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:57.196452 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e45a3e7d-91c3-4ae6-ada5-12b6cf96c23b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 1.203337 Jul 20 04:29:57.197050 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2076/4173] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:55 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:57.221662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-37a6edc8-b275-4bcf-9bae-7bb16da03883 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:57.222374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-37a6edc8-b275-4bcf-9bae-7bb16da03883 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:57.229062 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-09ff9120-2caa-462f-94dc-1e1711ad5ac1 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.784436 Jul 20 04:29:57.229745 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2098/4174] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:29:57.249395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37a6edc8-b275-4bcf-9bae-7bb16da03883 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.249886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37a6edc8-b275-4bcf-9bae-7bb16da03883 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.250794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37a6edc8-b275-4bcf-9bae-7bb16da03883 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.251249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37a6edc8-b275-4bcf-9bae-7bb16da03883 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.262183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3bdbbb28-9c77-4f4e-8f3b-eb10b50575ce tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:57.267737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3bdbbb28-9c77-4f4e-8f3b-eb10b50575ce tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:57.299123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3bdbbb28-9c77-4f4e-8f3b-eb10b50575ce tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.299595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3bdbbb28-9c77-4f4e-8f3b-eb10b50575ce tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.302904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3bdbbb28-9c77-4f4e-8f3b-eb10b50575ce tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.304518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3bdbbb28-9c77-4f4e-8f3b-eb10b50575ce tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.120332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3bdbbb28-9c77-4f4e-8f3b-eb10b50575ce tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:58.146847 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3bdbbb28-9c77-4f4e-8f3b-eb10b50575ce tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1314 microversion: 2.1 time: 0.906624 Jul 20 04:29:58.150218 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2099/4175] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:57 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:58.179599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8aee4040-c813-418f-a1b8-89c51930ebf5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:58.191794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8aee4040-c813-418f-a1b8-89c51930ebf5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:58.461465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8aee4040-c813-418f-a1b8-89c51930ebf5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:58.487438 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8aee4040-c813-418f-a1b8-89c51930ebf5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1213 microversion: 2.1 time: 0.324638 Jul 20 04:29:58.497097 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2100/4176] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:58 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1213 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:58.502159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-238fed59-cbf1-432a-bd6f-c25e8268cc15 req-1eda2da9-c6dc-4219-91aa-8f8147ab2567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c767e9b-1c26-465d-8578-30e480afbf9c", "tag": "0a84f5ab-f0e9-42d5-a67c-0b795e658efb"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:58.525239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-238fed59-cbf1-432a-bd6f-c25e8268cc15 req-1eda2da9-c6dc-4219-91aa-8f8147ab2567 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.525602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-238fed59-cbf1-432a-bd6f-c25e8268cc15 req-1eda2da9-c6dc-4219-91aa-8f8147ab2567 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.551756 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-238fed59-cbf1-432a-bd6f-c25e8268cc15 req-1eda2da9-c6dc-4219-91aa-8f8147ab2567 service nova] Creating event network-changed:0a84f5ab-f0e9-42d5-a67c-0b795e658efb for instance 5c767e9b-1c26-465d-8578-30e480afbf9c on n-h2-760456-11 Jul 20 04:29:58.565284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-37a6edc8-b275-4bcf-9bae-7bb16da03883 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:58.575394 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-238fed59-cbf1-432a-bd6f-c25e8268cc15 req-1eda2da9-c6dc-4219-91aa-8f8147ab2567 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075442 Jul 20 04:29:58.576057 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2101/4177] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:58.577952 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-37a6edc8-b275-4bcf-9bae-7bb16da03883 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1313 microversion: 2.1 time: 1.371469 Jul 20 04:29:58.580654 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2077/4178] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:57 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1313 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:58.593477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0999c38-91cc-43b0-b235-d365c2ad2865 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:58.594203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0999c38-91cc-43b0-b235-d365c2ad2865 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:58.607325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0999c38-91cc-43b0-b235-d365c2ad2865 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.607800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0999c38-91cc-43b0-b235-d365c2ad2865 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.608840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0999c38-91cc-43b0-b235-d365c2ad2865 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.609303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0999c38-91cc-43b0-b235-d365c2ad2865 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.923171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a0999c38-91cc-43b0-b235-d365c2ad2865 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:58.936061 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0999c38-91cc-43b0-b235-d365c2ad2865 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 0.358414 Jul 20 04:29:58.938945 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2102/4179] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:58 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:59.168696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b0759efe-e91c-462d-8c75-96c410eb8149 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:59.169436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b0759efe-e91c-462d-8c75-96c410eb8149 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:59.203033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0759efe-e91c-462d-8c75-96c410eb8149 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.211029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0759efe-e91c-462d-8c75-96c410eb8149 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:59.211920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0759efe-e91c-462d-8c75-96c410eb8149 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.212383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0759efe-e91c-462d-8c75-96c410eb8149 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:59.512478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5fc0e1a3-f58d-4bf6-8f47-af04f5004560 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:59.513121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5fc0e1a3-f58d-4bf6-8f47-af04f5004560 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:59.530164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fc0e1a3-f58d-4bf6-8f47-af04f5004560 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.534968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fc0e1a3-f58d-4bf6-8f47-af04f5004560 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:59.536866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fc0e1a3-f58d-4bf6-8f47-af04f5004560 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.537521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fc0e1a3-f58d-4bf6-8f47-af04f5004560 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:59.748154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0759efe-e91c-462d-8c75-96c410eb8149 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:59.773565 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b0759efe-e91c-462d-8c75-96c410eb8149 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1314 microversion: 2.1 time: 0.605643 Jul 20 04:29:59.777937 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2078/4180] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:59 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:59.782997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ee3f5f4-f2cd-45a5-8d72-c45ff3bf0ad9 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:59.783619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ee3f5f4-f2cd-45a5-8d72-c45ff3bf0ad9 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:59.820633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ee3f5f4-f2cd-45a5-8d72-c45ff3bf0ad9 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.824961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ee3f5f4-f2cd-45a5-8d72-c45ff3bf0ad9 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:59.826215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ee3f5f4-f2cd-45a5-8d72-c45ff3bf0ad9 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:59.834145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ee3f5f4-f2cd-45a5-8d72-c45ff3bf0ad9 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.435284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5fc0e1a3-f58d-4bf6-8f47-af04f5004560 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:00.454635 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5fc0e1a3-f58d-4bf6-8f47-af04f5004560 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1273 microversion: 2.1 time: 0.943035 Jul 20 04:30:00.471025 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2103/4181] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:59 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1273 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:00.500596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30833b01-abad-4b0c-b83d-f91575816cab tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.512834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-30833b01-abad-4b0c-b83d-f91575816cab tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:00.558628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30833b01-abad-4b0c-b83d-f91575816cab tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.559730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30833b01-abad-4b0c-b83d-f91575816cab tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.560774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30833b01-abad-4b0c-b83d-f91575816cab tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.561477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30833b01-abad-4b0c-b83d-f91575816cab tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.878721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ee3f5f4-f2cd-45a5-8d72-c45ff3bf0ad9 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:00.909974 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ee3f5f4-f2cd-45a5-8d72-c45ff3bf0ad9 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1313 microversion: 2.1 time: 1.126892 Jul 20 04:30:00.912223 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2079/4182] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:59 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1313 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:00.927889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-85194088-5277-4966-8e77-e4add7df6b9c req-96973f1b-7ce1-4377-9045-cd038a1bcb3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b78332-e314-4da3-8a21-1ccfa545f11a", "name": "network-vif-plugged", "status": "completed", "tag": "8c4c6b64-e711-449a-a899-27913ed07df2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:00.952140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-85194088-5277-4966-8e77-e4add7df6b9c req-96973f1b-7ce1-4377-9045-cd038a1bcb3e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.952616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-85194088-5277-4966-8e77-e4add7df6b9c req-96973f1b-7ce1-4377-9045-cd038a1bcb3e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.981201 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-85194088-5277-4966-8e77-e4add7df6b9c req-96973f1b-7ce1-4377-9045-cd038a1bcb3e service nova] Creating event network-vif-plugged:8c4c6b64-e711-449a-a899-27913ed07df2 for instance 44b78332-e314-4da3-8a21-1ccfa545f11a on n-h2-760456-11 Jul 20 04:30:00.995113 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-85194088-5277-4966-8e77-e4add7df6b9c req-96973f1b-7ce1-4377-9045-cd038a1bcb3e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078997 Jul 20 04:30:00.998575 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2080/4183] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:01.020884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-31b98044-eaa0-4156-af8d-6c3ad927cc3a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.021845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-31b98044-eaa0-4156-af8d-6c3ad927cc3a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:01.032972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31b98044-eaa0-4156-af8d-6c3ad927cc3a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.033706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31b98044-eaa0-4156-af8d-6c3ad927cc3a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.034702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31b98044-eaa0-4156-af8d-6c3ad927cc3a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.040007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31b98044-eaa0-4156-af8d-6c3ad927cc3a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.283085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-30833b01-abad-4b0c-b83d-f91575816cab tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:01.315681 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-30833b01-abad-4b0c-b83d-f91575816cab tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 0.838995 Jul 20 04:30:01.326590 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2104/4184] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:01.490150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-599f752b-1d4c-4194-819a-fe09264ef9cb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.491675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-599f752b-1d4c-4194-819a-fe09264ef9cb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:01.501946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-599f752b-1d4c-4194-819a-fe09264ef9cb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.509944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-599f752b-1d4c-4194-819a-fe09264ef9cb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.514210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-599f752b-1d4c-4194-819a-fe09264ef9cb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.515081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-599f752b-1d4c-4194-819a-fe09264ef9cb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.854658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-599f752b-1d4c-4194-819a-fe09264ef9cb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:01.896095 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-599f752b-1d4c-4194-819a-fe09264ef9cb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1271 microversion: 2.1 time: 0.405930 Jul 20 04:30:01.898028 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2105/4185] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:01 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1271 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:01.938325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e241b4b1-8f97-4747-94ca-94b9fa045862 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.939317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e241b4b1-8f97-4747-94ca-94b9fa045862 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:01.954817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e241b4b1-8f97-4747-94ca-94b9fa045862 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.955938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e241b4b1-8f97-4747-94ca-94b9fa045862 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.957274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e241b4b1-8f97-4747-94ca-94b9fa045862 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.958683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e241b4b1-8f97-4747-94ca-94b9fa045862 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.014005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-31b98044-eaa0-4156-af8d-6c3ad927cc3a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:02.033556 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-31b98044-eaa0-4156-af8d-6c3ad927cc3a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1314 microversion: 2.1 time: 1.032852 Jul 20 04:30:02.042211 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2081/4186] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1314 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:02.334656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e4c0f38-5489-4b5c-97af-321bc2ff67fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.335494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6e4c0f38-5489-4b5c-97af-321bc2ff67fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:02.355359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e4c0f38-5489-4b5c-97af-321bc2ff67fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.364937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e4c0f38-5489-4b5c-97af-321bc2ff67fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.379541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e4c0f38-5489-4b5c-97af-321bc2ff67fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.380888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e4c0f38-5489-4b5c-97af-321bc2ff67fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.543163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e241b4b1-8f97-4747-94ca-94b9fa045862 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:02.563639 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e241b4b1-8f97-4747-94ca-94b9fa045862 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1313 microversion: 2.1 time: 0.635087 Jul 20 04:30:02.566201 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2106/4187] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:01 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:02.912459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6e4c0f38-5489-4b5c-97af-321bc2ff67fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:02.916059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc0e1cdb-1879-4f52-8b42-0aa8ed7eab67 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.916895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc0e1cdb-1879-4f52-8b42-0aa8ed7eab67 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:02.928577 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6e4c0f38-5489-4b5c-97af-321bc2ff67fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1364 microversion: 2.1 time: 0.593368 Jul 20 04:30:02.932070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc0e1cdb-1879-4f52-8b42-0aa8ed7eab67 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.932070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc0e1cdb-1879-4f52-8b42-0aa8ed7eab67 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.932325 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2082/4188] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:02 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1364 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:02.944968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc0e1cdb-1879-4f52-8b42-0aa8ed7eab67 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.945458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc0e1cdb-1879-4f52-8b42-0aa8ed7eab67 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.062956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-25c6934d-daf9-4676-8fdd-eeb93cea79e7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:03.064195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-25c6934d-daf9-4676-8fdd-eeb93cea79e7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:03.079260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25c6934d-daf9-4676-8fdd-eeb93cea79e7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.079978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25c6934d-daf9-4676-8fdd-eeb93cea79e7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.081523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25c6934d-daf9-4676-8fdd-eeb93cea79e7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.087589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25c6934d-daf9-4676-8fdd-eeb93cea79e7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.463242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc0e1cdb-1879-4f52-8b42-0aa8ed7eab67 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:03.473066 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc0e1cdb-1879-4f52-8b42-0aa8ed7eab67 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1313 microversion: 2.1 time: 0.561317 Jul 20 04:30:03.478725 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2107/4189] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:02 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:03.505164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3f3e8e21-f253-4cdf-9fd0-b9f2a075a18c req-e02576b5-d4db-471d-a227-b15c5cb41657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ff4e64-da30-4eac-a9f9-61576b446fef", "name": "network-vif-plugged", "status": "completed", "tag": "2a034c5b-4cca-4960-83bb-28492bef618b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:03.530281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3f3e8e21-f253-4cdf-9fd0-b9f2a075a18c req-e02576b5-d4db-471d-a227-b15c5cb41657 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.538027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3f3e8e21-f253-4cdf-9fd0-b9f2a075a18c req-e02576b5-d4db-471d-a227-b15c5cb41657 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.563966 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3f3e8e21-f253-4cdf-9fd0-b9f2a075a18c req-e02576b5-d4db-471d-a227-b15c5cb41657 service nova] Creating event network-vif-plugged:2a034c5b-4cca-4960-83bb-28492bef618b for instance 30ff4e64-da30-4eac-a9f9-61576b446fef on n-h1-760456-11 Jul 20 04:30:03.573261 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3f3e8e21-f253-4cdf-9fd0-b9f2a075a18c req-e02576b5-d4db-471d-a227-b15c5cb41657 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089996 Jul 20 04:30:03.579323 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2108/4190] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:03.586905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a66bcba1-fdf5-43fd-8898-aac907a0ca6e tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:03.592447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a66bcba1-fdf5-43fd-8898-aac907a0ca6e tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:03.605803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a66bcba1-fdf5-43fd-8898-aac907a0ca6e tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.607429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a66bcba1-fdf5-43fd-8898-aac907a0ca6e tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.608692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a66bcba1-fdf5-43fd-8898-aac907a0ca6e tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.612575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a66bcba1-fdf5-43fd-8898-aac907a0ca6e tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.913245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-25c6934d-daf9-4676-8fdd-eeb93cea79e7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:03.922346 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-25c6934d-daf9-4676-8fdd-eeb93cea79e7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1314 microversion: 2.1 time: 0.865100 Jul 20 04:30:03.931495 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2083/4191] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:03 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:03.956711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f186063-5e18-46b7-94ba-0cf22fe17b7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:03.957379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f186063-5e18-46b7-94ba-0cf22fe17b7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:03.985214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f186063-5e18-46b7-94ba-0cf22fe17b7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.990831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f186063-5e18-46b7-94ba-0cf22fe17b7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:03.991727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f186063-5e18-46b7-94ba-0cf22fe17b7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:03.992402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f186063-5e18-46b7-94ba-0cf22fe17b7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:04.721754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f186063-5e18-46b7-94ba-0cf22fe17b7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:04.742092 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f186063-5e18-46b7-94ba-0cf22fe17b7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1550 microversion: 2.1 time: 0.797165 Jul 20 04:30:04.743196 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2084/4192] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:03 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1550 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:04.748733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e0b7a90-ab93-45fa-ace2-f5948a8af648 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:04.769359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a66bcba1-fdf5-43fd-8898-aac907a0ca6e tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:04.779833 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a66bcba1-fdf5-43fd-8898-aac907a0ca6e tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1313 microversion: 2.1 time: 1.197623 Jul 20 04:30:04.781019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e0b7a90-ab93-45fa-ace2-f5948a8af648 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:04.787689 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2109/4193] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:03 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1313 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:04.803965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ecd744a-b630-463b-9d82-34f11be1cdc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:04.806401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0b7a90-ab93-45fa-ace2-f5948a8af648 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:04.808016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2ecd744a-b630-463b-9d82-34f11be1cdc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:04.815848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0b7a90-ab93-45fa-ace2-f5948a8af648 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:04.816380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:04.832803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0b7a90-ab93-45fa-ace2-f5948a8af648 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:04.833504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ecd744a-b630-463b-9d82-34f11be1cdc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:04.834711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ecd744a-b630-463b-9d82-34f11be1cdc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:04.836209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ecd744a-b630-463b-9d82-34f11be1cdc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:04.838092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ecd744a-b630-463b-9d82-34f11be1cdc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:04.852031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0b7a90-ab93-45fa-ace2-f5948a8af648 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.132825 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ecd744a-b630-463b-9d82-34f11be1cdc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.343713 Jul 20 04:30:05.133915 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2110/4194] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:30:04 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/os-interface => generated 284 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:05.139432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b74019aa-0849-452b-b770-580c5dae2ee5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:05.140306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b74019aa-0849-452b-b770-580c5dae2ee5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:05.157832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b74019aa-0849-452b-b770-580c5dae2ee5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.158552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b74019aa-0849-452b-b770-580c5dae2ee5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.159577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b74019aa-0849-452b-b770-580c5dae2ee5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.160190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b74019aa-0849-452b-b770-580c5dae2ee5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.210578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b74019aa-0849-452b-b770-580c5dae2ee5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:06.252332 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b74019aa-0849-452b-b770-580c5dae2ee5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1314 microversion: 2.1 time: 1.102226 Jul 20 04:30:06.253022 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2111/4195] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:05 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1314 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:06.290176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1459fb43-3413-47cd-a5e7-7fc9fb31c47d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:06.291297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1459fb43-3413-47cd-a5e7-7fc9fb31c47d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:06.318035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1459fb43-3413-47cd-a5e7-7fc9fb31c47d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.321572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1459fb43-3413-47cd-a5e7-7fc9fb31c47d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.322715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1459fb43-3413-47cd-a5e7-7fc9fb31c47d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.326627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1459fb43-3413-47cd-a5e7-7fc9fb31c47d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:06.974957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e0b7a90-ab93-45fa-ace2-f5948a8af648 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:06.987849 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e0b7a90-ab93-45fa-ace2-f5948a8af648 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 2.243361 Jul 20 04:30:06.991037 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2085/4196] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:04 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 2247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:07.013103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:07.256823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1459fb43-3413-47cd-a5e7-7fc9fb31c47d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:07.273144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b6415b7-6f2c-4cab-98ae-d4b315a6f6b4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:07.273882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3b6415b7-6f2c-4cab-98ae-d4b315a6f6b4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:07.275180 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1459fb43-3413-47cd-a5e7-7fc9fb31c47d tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1313 microversion: 2.1 time: 1.006204 Jul 20 04:30:07.280272 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2112/4197] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:06 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1313 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:07.285302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:07.288888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b6415b7-6f2c-4cab-98ae-d4b315a6f6b4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.289473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b6415b7-6f2c-4cab-98ae-d4b315a6f6b4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.294800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b6415b7-6f2c-4cab-98ae-d4b315a6f6b4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.295447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b6415b7-6f2c-4cab-98ae-d4b315a6f6b4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.807825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ff861710-7f63-4a39-858d-c5de08117d1e req-95fe89f4-23b8-476f-92a6-c92a25471809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c767e9b-1c26-465d-8578-30e480afbf9c", "name": "network-vif-plugged", "status": "completed", "tag": "0a84f5ab-f0e9-42d5-a67c-0b795e658efb"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:07.821492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ff861710-7f63-4a39-858d-c5de08117d1e req-95fe89f4-23b8-476f-92a6-c92a25471809 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.825805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ff861710-7f63-4a39-858d-c5de08117d1e req-95fe89f4-23b8-476f-92a6-c92a25471809 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.849117 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ff861710-7f63-4a39-858d-c5de08117d1e req-95fe89f4-23b8-476f-92a6-c92a25471809 service nova] Creating event network-vif-plugged:0a84f5ab-f0e9-42d5-a67c-0b795e658efb for instance 5c767e9b-1c26-465d-8578-30e480afbf9c on n-h2-760456-11 Jul 20 04:30:07.868318 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ff861710-7f63-4a39-858d-c5de08117d1e req-95fe89f4-23b8-476f-92a6-c92a25471809 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064640 Jul 20 04:30:07.869361 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2113/4198] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:07.930568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3b6415b7-6f2c-4cab-98ae-d4b315a6f6b4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:07.934298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:07.976621 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3b6415b7-6f2c-4cab-98ae-d4b315a6f6b4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1501 microversion: 2.1 time: 0.707682 Jul 20 04:30:07.985589 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2086/4199] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:07 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1501 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:07.999568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-869e676b-a947-47b2-8cbe-6ff13ac98920 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:08.000966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-869e676b-a947-47b2-8cbe-6ff13ac98920 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:08.024553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-869e676b-a947-47b2-8cbe-6ff13ac98920 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.025362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-869e676b-a947-47b2-8cbe-6ff13ac98920 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.034718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e46029b-f7a0-4f43-9970-ecd9c1991893 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:08.035604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-869e676b-a947-47b2-8cbe-6ff13ac98920 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.036457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-869e676b-a947-47b2-8cbe-6ff13ac98920 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.040188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e46029b-f7a0-4f43-9970-ecd9c1991893 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:08.065088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e46029b-f7a0-4f43-9970-ecd9c1991893 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.068046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e46029b-f7a0-4f43-9970-ecd9c1991893 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.069975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e46029b-f7a0-4f43-9970-ecd9c1991893 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.075704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e46029b-f7a0-4f43-9970-ecd9c1991893 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.168334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-869e676b-a947-47b2-8cbe-6ff13ac98920 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lazy-loading 'flavor' on Instance uuid 30ff4e64-da30-4eac-a9f9-61576b446fef {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:30:08.374198 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-869e676b-a947-47b2-8cbe-6ff13ac98920 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "POST /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef/action" status: 200 len: 32 microversion: 2.1 time: 0.377578 Jul 20 04:30:08.376679 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2114/4200] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:07 2022] POST /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef/action => generated 32 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:30:08.398091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d04d4fbf-7ef0-40f0-9c89-88f7b1892e38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:08.399391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d04d4fbf-7ef0-40f0-9c89-88f7b1892e38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:08.407890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d04d4fbf-7ef0-40f0-9c89-88f7b1892e38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.409134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d04d4fbf-7ef0-40f0-9c89-88f7b1892e38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.410640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d04d4fbf-7ef0-40f0-9c89-88f7b1892e38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.411327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d04d4fbf-7ef0-40f0-9c89-88f7b1892e38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.484960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:08.683230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e46029b-f7a0-4f43-9970-ecd9c1991893 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:08.696004 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e46029b-f7a0-4f43-9970-ecd9c1991893 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.687040 Jul 20 04:30:08.719250 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2087/4201] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:08 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:08.728487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d25a765f-71a2-4862-b336-eaf158700f79 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:08.729565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d25a765f-71a2-4862-b336-eaf158700f79 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:08.742753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25a765f-71a2-4862-b336-eaf158700f79 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.744765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25a765f-71a2-4862-b336-eaf158700f79 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.747961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25a765f-71a2-4862-b336-eaf158700f79 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.749283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25a765f-71a2-4862-b336-eaf158700f79 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.178452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d25a765f-71a2-4862-b336-eaf158700f79 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:09.179431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d04d4fbf-7ef0-40f0-9c89-88f7b1892e38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:09.190075 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d25a765f-71a2-4862-b336-eaf158700f79 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 0.469650 Jul 20 04:30:09.191123 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2088/4202] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:08 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:09.191283 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d04d4fbf-7ef0-40f0-9c89-88f7b1892e38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1313 microversion: 2.1 time: 0.812985 Jul 20 04:30:09.191774 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2115/4203] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:08 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1313 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:09.669211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6d9e12d1-1dea-4350-a8c3-ca439cceb536 req-0b9ddf29-48ed-4f7d-b325-4434585440fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b78332-e314-4da3-8a21-1ccfa545f11a", "tag": "8c4c6b64-e711-449a-a899-27913ed07df2"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:09.692887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6d9e12d1-1dea-4350-a8c3-ca439cceb536 req-0b9ddf29-48ed-4f7d-b325-4434585440fd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.696936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6d9e12d1-1dea-4350-a8c3-ca439cceb536 req-0b9ddf29-48ed-4f7d-b325-4434585440fd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.720991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-88f0dd98-4677-4d7d-b3b8-b22da71733bf tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:09.721889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-88f0dd98-4677-4d7d-b3b8-b22da71733bf tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:09.740955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88f0dd98-4677-4d7d-b3b8-b22da71733bf tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.741459 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6d9e12d1-1dea-4350-a8c3-ca439cceb536 req-0b9ddf29-48ed-4f7d-b325-4434585440fd service nova] Creating event network-changed:8c4c6b64-e711-449a-a899-27913ed07df2 for instance 44b78332-e314-4da3-8a21-1ccfa545f11a on n-h2-760456-11 Jul 20 04:30:09.748057 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6d9e12d1-1dea-4350-a8c3-ca439cceb536 req-0b9ddf29-48ed-4f7d-b325-4434585440fd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087235 Jul 20 04:30:09.750357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88f0dd98-4677-4d7d-b3b8-b22da71733bf tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.753296 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2116/4204] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:09.754708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88f0dd98-4677-4d7d-b3b8-b22da71733bf tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.754708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88f0dd98-4677-4d7d-b3b8-b22da71733bf tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.172412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-88f0dd98-4677-4d7d-b3b8-b22da71733bf tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:10.186804 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-88f0dd98-4677-4d7d-b3b8-b22da71733bf tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.469693 Jul 20 04:30:10.188627 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2089/4205] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:09 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:10.234715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9f325878-e1c8-48ad-bed3-9477b3ce20f0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:10.235693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9f325878-e1c8-48ad-bed3-9477b3ce20f0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:10.237074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a95fb041-41db-479a-9038-3ff3a3127b29 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:10.242945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a95fb041-41db-479a-9038-3ff3a3127b29 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:10.259724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f325878-e1c8-48ad-bed3-9477b3ce20f0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.260193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f325878-e1c8-48ad-bed3-9477b3ce20f0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.273710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f325878-e1c8-48ad-bed3-9477b3ce20f0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.274179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9f325878-e1c8-48ad-bed3-9477b3ce20f0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.278644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a95fb041-41db-479a-9038-3ff3a3127b29 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.279114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a95fb041-41db-479a-9038-3ff3a3127b29 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.280684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a95fb041-41db-479a-9038-3ff3a3127b29 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.281146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a95fb041-41db-479a-9038-3ff3a3127b29 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.343608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:10.850193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9f325878-e1c8-48ad-bed3-9477b3ce20f0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:10.886097 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9f325878-e1c8-48ad-bed3-9477b3ce20f0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 0.674283 Jul 20 04:30:10.888604 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2090/4206] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:10 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:11.197750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a95fb041-41db-479a-9038-3ff3a3127b29 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:11.213757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5251edaf-45ff-4bdf-9638-5e956d4746da tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:11.215177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5251edaf-45ff-4bdf-9638-5e956d4746da tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:11.223681 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a95fb041-41db-479a-9038-3ff3a3127b29 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1496 microversion: 2.1 time: 1.018105 Jul 20 04:30:11.226785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5251edaf-45ff-4bdf-9638-5e956d4746da tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.227255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5251edaf-45ff-4bdf-9638-5e956d4746da tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.238287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5251edaf-45ff-4bdf-9638-5e956d4746da tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.238287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5251edaf-45ff-4bdf-9638-5e956d4746da tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.238703 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2117/4207] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:10 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1496 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:11.802633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5251edaf-45ff-4bdf-9638-5e956d4746da tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:11.812666 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5251edaf-45ff-4bdf-9638-5e956d4746da tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.604994 Jul 20 04:30:11.814376 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2091/4208] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:11 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:11.894318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-66b9e6ab-d17f-41e9-895e-bb2065735bf8 req-f5e84736-a6ef-45cc-a727-8dc78fe78911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "497d6c63-e92f-42c4-84b9-dfddd053908f", "tag": "b8ee7db5-e9fc-4612-bef8-8d81a96fa814"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:11.906937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40be149c-a03f-485b-b509-f799f68ef8ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:11.908018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40be149c-a03f-485b-b509-f799f68ef8ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:11.940128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40be149c-a03f-485b-b509-f799f68ef8ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.943409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40be149c-a03f-485b-b509-f799f68ef8ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.946338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40be149c-a03f-485b-b509-f799f68ef8ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.947076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40be149c-a03f-485b-b509-f799f68ef8ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.951855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-66b9e6ab-d17f-41e9-895e-bb2065735bf8 req-f5e84736-a6ef-45cc-a727-8dc78fe78911 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:11.954739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-66b9e6ab-d17f-41e9-895e-bb2065735bf8 req-f5e84736-a6ef-45cc-a727-8dc78fe78911 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.998016 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-66b9e6ab-d17f-41e9-895e-bb2065735bf8 req-f5e84736-a6ef-45cc-a727-8dc78fe78911 service nova] Creating event network-changed:b8ee7db5-e9fc-4612-bef8-8d81a96fa814 for instance 497d6c63-e92f-42c4-84b9-dfddd053908f on n-h1-760456-11 Jul 20 04:30:12.020880 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-66b9e6ab-d17f-41e9-895e-bb2065735bf8 req-f5e84736-a6ef-45cc-a727-8dc78fe78911 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130239 Jul 20 04:30:12.022960 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2118/4209] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:12.040858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c1b2e1a0-0451-4894-ba0e-c8f8a625e9fa tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:12.047566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c1b2e1a0-0451-4894-ba0e-c8f8a625e9fa tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:12.071473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1b2e1a0-0451-4894-ba0e-c8f8a625e9fa tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:12.071937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1b2e1a0-0451-4894-ba0e-c8f8a625e9fa tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:12.072730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1b2e1a0-0451-4894-ba0e-c8f8a625e9fa tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:12.073691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c1b2e1a0-0451-4894-ba0e-c8f8a625e9fa tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:12.186628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c1b2e1a0-0451-4894-ba0e-c8f8a625e9fa tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:12.469510 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c1b2e1a0-0451-4894-ba0e-c8f8a625e9fa tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 204 len: 0 microversion: 2.1 time: 0.445030 Jul 20 04:30:12.471151 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2119/4210] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:12 2022] DELETE /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:12.485680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-942e7872-f8a2-4dac-96fa-1105738a6d26 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:12.487756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-942e7872-f8a2-4dac-96fa-1105738a6d26 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:12.501930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942e7872-f8a2-4dac-96fa-1105738a6d26 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:12.506857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942e7872-f8a2-4dac-96fa-1105738a6d26 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:12.508096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942e7872-f8a2-4dac-96fa-1105738a6d26 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:12.508731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-942e7872-f8a2-4dac-96fa-1105738a6d26 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.315301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-942e7872-f8a2-4dac-96fa-1105738a6d26 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:13.329399 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-942e7872-f8a2-4dac-96fa-1105738a6d26 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1502 microversion: 2.1 time: 0.853563 Jul 20 04:30:13.334099 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2120/4211] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:12 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1502 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:13.354231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-180d5c53-5b0e-4475-bf96-f904b132ddec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:13.356093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-180d5c53-5b0e-4475-bf96-f904b132ddec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:13.364138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-180d5c53-5b0e-4475-bf96-f904b132ddec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.365009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-180d5c53-5b0e-4475-bf96-f904b132ddec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.366201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-180d5c53-5b0e-4475-bf96-f904b132ddec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.366978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-180d5c53-5b0e-4475-bf96-f904b132ddec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.743745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-180d5c53-5b0e-4475-bf96-f904b132ddec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:13.759532 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-180d5c53-5b0e-4475-bf96-f904b132ddec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.415354 Jul 20 04:30:13.772846 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2121/4212] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:13 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:13.918237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-40be149c-a03f-485b-b509-f799f68ef8ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:13.928232 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40be149c-a03f-485b-b509-f799f68ef8ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 2.026668 Jul 20 04:30:13.928828 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2092/4213] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:11 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:14.196560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-73937df7-e1fa-4027-bd82-46e83de2e741 req-22ba47c9-205d-4671-af47-ddc694be88a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "497d6c63-e92f-42c4-84b9-dfddd053908f", "tag": "75f52ec8-e3bb-4b2c-bd9f-3716c292ab7b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:14.212689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-73937df7-e1fa-4027-bd82-46e83de2e741 req-22ba47c9-205d-4671-af47-ddc694be88a6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.214981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-73937df7-e1fa-4027-bd82-46e83de2e741 req-22ba47c9-205d-4671-af47-ddc694be88a6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.239763 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-73937df7-e1fa-4027-bd82-46e83de2e741 req-22ba47c9-205d-4671-af47-ddc694be88a6 service nova] Creating event network-changed:75f52ec8-e3bb-4b2c-bd9f-3716c292ab7b for instance 497d6c63-e92f-42c4-84b9-dfddd053908f on n-h1-760456-11 Jul 20 04:30:14.286958 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-73937df7-e1fa-4027-bd82-46e83de2e741 req-22ba47c9-205d-4671-af47-ddc694be88a6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091727 Jul 20 04:30:14.294316 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2122/4214] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:14.352877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35e147d3-ad13-4712-9117-7777e397ce66 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:14.354186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-35e147d3-ad13-4712-9117-7777e397ce66 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:14.392097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35e147d3-ad13-4712-9117-7777e397ce66 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.393742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35e147d3-ad13-4712-9117-7777e397ce66 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.396866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35e147d3-ad13-4712-9117-7777e397ce66 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.400629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35e147d3-ad13-4712-9117-7777e397ce66 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.790239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6cd963b3-2d78-456e-a293-92141844d7a5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:14.791688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6cd963b3-2d78-456e-a293-92141844d7a5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:14.810355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cd963b3-2d78-456e-a293-92141844d7a5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.812371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cd963b3-2d78-456e-a293-92141844d7a5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.815904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cd963b3-2d78-456e-a293-92141844d7a5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.818645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cd963b3-2d78-456e-a293-92141844d7a5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.987696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-35e147d3-ad13-4712-9117-7777e397ce66 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:14.999443 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-35e147d3-ad13-4712-9117-7777e397ce66 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1502 microversion: 2.1 time: 0.650415 Jul 20 04:30:15.000259 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2093/4215] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:14 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1502 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:15.019337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9601383-00da-427c-acba-3a49ff466a81 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:15.020519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b9601383-00da-427c-acba-3a49ff466a81 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:15.034667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9601383-00da-427c-acba-3a49ff466a81 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.035140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9601383-00da-427c-acba-3a49ff466a81 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.035941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9601383-00da-427c-acba-3a49ff466a81 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.036392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9601383-00da-427c-acba-3a49ff466a81 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.291640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6cd963b3-2d78-456e-a293-92141844d7a5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:15.301283 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6cd963b3-2d78-456e-a293-92141844d7a5 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.523543 Jul 20 04:30:15.311759 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2123/4216] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:14 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:15.435888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b9601383-00da-427c-acba-3a49ff466a81 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:15.457531 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b9601383-00da-427c-acba-3a49ff466a81 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 0.443451 Jul 20 04:30:15.458428 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2094/4217] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:15 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:15.598232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-79af60ed-9480-49e1-92f9-4078536f211e req-dc8d04d2-f33e-43f5-a6c0-40664cccbecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c767e9b-1c26-465d-8578-30e480afbf9c", "name": "network-vif-deleted", "tag": "0a84f5ab-f0e9-42d5-a67c-0b795e658efb"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:15.612397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-79af60ed-9480-49e1-92f9-4078536f211e req-dc8d04d2-f33e-43f5-a6c0-40664cccbecf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.613485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-79af60ed-9480-49e1-92f9-4078536f211e req-dc8d04d2-f33e-43f5-a6c0-40664cccbecf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.648102 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-79af60ed-9480-49e1-92f9-4078536f211e req-dc8d04d2-f33e-43f5-a6c0-40664cccbecf service nova] Creating event network-vif-deleted:0a84f5ab-f0e9-42d5-a67c-0b795e658efb for instance 5c767e9b-1c26-465d-8578-30e480afbf9c on n-h2-760456-11 Jul 20 04:30:15.672171 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-79af60ed-9480-49e1-92f9-4078536f211e req-dc8d04d2-f33e-43f5-a6c0-40664cccbecf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078566 Jul 20 04:30:15.673524 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2124/4218] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:16.017770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:16.018520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:16.033653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.036200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.037122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.038477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.080531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.081478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.082159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lazy-loading 'fault' on Instance uuid 5c767e9b-1c26-465d-8578-30e480afbf9c {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:30:16.284859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:16.294812 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b06f65d-a54c-480b-a335-366a8d45df37 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 200 len: 1303 microversion: 2.1 time: 0.281281 Jul 20 04:30:16.298997 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2095/4219] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:16 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 1303 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:16.320471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-69bc01a9-bbc7-40d7-84f7-318f3135a6ec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:16.321185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-69bc01a9-bbc7-40d7-84f7-318f3135a6ec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:16.341974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69bc01a9-bbc7-40d7-84f7-318f3135a6ec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.342412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69bc01a9-bbc7-40d7-84f7-318f3135a6ec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.346569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69bc01a9-bbc7-40d7-84f7-318f3135a6ec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.347602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69bc01a9-bbc7-40d7-84f7-318f3135a6ec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.477859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f7f5f67b-7235-4acc-9a3e-eaff59731a15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:16.478538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f7f5f67b-7235-4acc-9a3e-eaff59731a15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:16.491863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7f5f67b-7235-4acc-9a3e-eaff59731a15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.494379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7f5f67b-7235-4acc-9a3e-eaff59731a15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.495924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7f5f67b-7235-4acc-9a3e-eaff59731a15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:16.496560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f7f5f67b-7235-4acc-9a3e-eaff59731a15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.767618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-69bc01a9-bbc7-40d7-84f7-318f3135a6ec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:16.779495 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-69bc01a9-bbc7-40d7-84f7-318f3135a6ec tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.464169 Jul 20 04:30:16.781458 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2125/4220] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:16 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:16.820995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f7f5f67b-7235-4acc-9a3e-eaff59731a15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:16.829290 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f7f5f67b-7235-4acc-9a3e-eaff59731a15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 0.358133 Jul 20 04:30:16.829892 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2096/4221] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:16 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:17.316360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ee9d3167-0bfd-49ed-900a-530f46d77a38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:17.318145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ee9d3167-0bfd-49ed-900a-530f46d77a38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 5c767e9b-1c26-465d-8578-30e480afbf9c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:17.330723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee9d3167-0bfd-49ed-900a-530f46d77a38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.333560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee9d3167-0bfd-49ed-900a-530f46d77a38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.335447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee9d3167-0bfd-49ed-900a-530f46d77a38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.338822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee9d3167-0bfd-49ed-900a-530f46d77a38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.387633 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-ee9d3167-0bfd-49ed-900a-530f46d77a38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] HTTP exception thrown: Instance 5c767e9b-1c26-465d-8578-30e480afbf9c could not be found. Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ee9d3167-0bfd-49ed-900a-530f46d77a38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Request method failure captured: Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c HTTP/1.1 Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14SzDqY19CA35K9QeA23TyWU6l7hPhcJXSZnwkibIT25qwZXIekyIXDkaXuN1EgRgtwji6knbkbALdbiyJAp7HGAEd59rVEOydtdF9QRRJF6ZzmoIxxznsutouuSW0xcMLFAk4w9y8bLdVlIViBss1sXPThfTRp_80Y4yUI9y0BPMaU Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 9ab426ff745841d6bb7e17629290159f Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-VolumesActionsTest-1683356261 Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9ab426ff745841d6bb7e17629290159f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ab426ff745841d6bb7e17629290159f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ab426ff745841d6bb7e17629290159f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9ab426ff745841d6bb7e17629290159f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-VolumesActionsTest-1683356261 Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 9ab426ff745841d6bb7e17629290159f Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-VolumesActionsTest-1683356261 Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-VolumesActionsTest-1683356261-project Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9c7ea326a3b04e31a4c4fd8a62c7d52d Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-VolumesActionsTest-1683356261-project Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 5c767e9b-1c26-465d-8578-30e480afbf9c could not be found. Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '5c767e9b-1c26-465d-8578-30e480afbf9c'} Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c767e9b-1c26-465d-8578-30e480afbf9c could not be found. Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c767e9b-1c26-465d-8578-30e480afbf9c could not be found. Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:17.389803 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:17.394026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:17.394026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:17.394026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:17.394026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:17.394026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:17.394026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c767e9b-1c26-465d-8578-30e480afbf9c could not be found. Jul 20 04:30:17.394026 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:17.399648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ee9d3167-0bfd-49ed-900a-530f46d77a38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Returning 404 to user: Instance 5c767e9b-1c26-465d-8578-30e480afbf9c could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:17.403074 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ee9d3167-0bfd-49ed-900a-530f46d77a38 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c" status: 404 len: 111 microversion: 2.1 time: 0.092477 Jul 20 04:30:17.415366 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2126/4222] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:17 2022] GET /compute/v2.1/servers/5c767e9b-1c26-465d-8578-30e480afbf9c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:17.584627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-975641134", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "6e030ec2-6bd1-4fba-89f0-ee15d95331bd"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:17.773661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] validate_networks() for [('6e030ec2-6bd1-4fba-89f0-ee15d95331bd', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:17.798616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d8c21441-5648-4e0f-8c8b-de75301b2022 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:17.799380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d8c21441-5648-4e0f-8c8b-de75301b2022 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:17.812604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8c21441-5648-4e0f-8c8b-de75301b2022 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.813180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8c21441-5648-4e0f-8c8b-de75301b2022 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.818499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8c21441-5648-4e0f-8c8b-de75301b2022 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.819201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8c21441-5648-4e0f-8c8b-de75301b2022 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.156576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8c21441-5648-4e0f-8c8b-de75301b2022 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:18.168768 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d8c21441-5648-4e0f-8c8b-de75301b2022 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.375452 Jul 20 04:30:18.173010 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2127/4223] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:17 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:18.184322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a022389-acf3-4271-98a2-e30479fbaaf2 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:18.185242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5a022389-acf3-4271-98a2-e30479fbaaf2 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:18.197356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a022389-acf3-4271-98a2-e30479fbaaf2 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.197860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a022389-acf3-4271-98a2-e30479fbaaf2 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.202926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a022389-acf3-4271-98a2-e30479fbaaf2 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.203599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a022389-acf3-4271-98a2-e30479fbaaf2 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.435894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a022389-acf3-4271-98a2-e30479fbaaf2 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:18.451633 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5a022389-acf3-4271-98a2-e30479fbaaf2 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 0.275215 Jul 20 04:30:18.453331 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2128/4224] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:18 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:18.778465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:18.778973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:18.779639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:18.780131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:18.780690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:18.818233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.821868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.827837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:18.833419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.875413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Getting quotas for project 9ab426ff745841d6bb7e17629290159f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:18.887380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Getting quotas for user 9c7ea326a3b04e31a4c4fd8a62c7d52d and project 9ab426ff745841d6bb7e17629290159f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:18.932230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:18.936752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:19.048130 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-05a7273e-f450-4d79-acba-d07f67608384 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467741 Jul 20 04:30:19.051562 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2097/4225] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:19.063149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b28f9565-645b-4bce-976b-8eda425f9f55 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:19.064027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b28f9565-645b-4bce-976b-8eda425f9f55 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:19.189053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eb44a40d-2ea3-4e87-92b8-011d7d7b7023 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:19.189692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eb44a40d-2ea3-4e87-92b8-011d7d7b7023 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:19.208945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb44a40d-2ea3-4e87-92b8-011d7d7b7023 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:19.209326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb44a40d-2ea3-4e87-92b8-011d7d7b7023 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.210903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb44a40d-2ea3-4e87-92b8-011d7d7b7023 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:19.211579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb44a40d-2ea3-4e87-92b8-011d7d7b7023 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.243414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b28f9565-645b-4bce-976b-8eda425f9f55 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:19.257257 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b28f9565-645b-4bce-976b-8eda425f9f55 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1213 microversion: 2.1 time: 0.195581 Jul 20 04:30:19.258338 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2129/4226] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:19 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1213 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:19.474145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-041c6b2f-2049-4af4-a0e3-12eb2d3b4e59 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:19.475734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-041c6b2f-2049-4af4-a0e3-12eb2d3b4e59 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:19.491426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-041c6b2f-2049-4af4-a0e3-12eb2d3b4e59 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:19.492103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-041c6b2f-2049-4af4-a0e3-12eb2d3b4e59 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.502465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eb44a40d-2ea3-4e87-92b8-011d7d7b7023 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:19.505783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-041c6b2f-2049-4af4-a0e3-12eb2d3b4e59 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:19.507675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-041c6b2f-2049-4af4-a0e3-12eb2d3b4e59 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.518546 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eb44a40d-2ea3-4e87-92b8-011d7d7b7023 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.331403 Jul 20 04:30:19.520630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2098/4227] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:19 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:19.841652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-041c6b2f-2049-4af4-a0e3-12eb2d3b4e59 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:19.859094 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-041c6b2f-2049-4af4-a0e3-12eb2d3b4e59 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 0.388037 Jul 20 04:30:19.862463 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2130/4228] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:19 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:20.284080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-92929f93-53ee-4481-877c-71a9cceadaee tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:20.285532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-92929f93-53ee-4481-877c-71a9cceadaee tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:20.301678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92929f93-53ee-4481-877c-71a9cceadaee tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.313828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92929f93-53ee-4481-877c-71a9cceadaee tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.316108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92929f93-53ee-4481-877c-71a9cceadaee tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.317502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92929f93-53ee-4481-877c-71a9cceadaee tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.487984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-92929f93-53ee-4481-877c-71a9cceadaee tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:20.499732 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-92929f93-53ee-4481-877c-71a9cceadaee tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1265 microversion: 2.1 time: 0.227540 Jul 20 04:30:20.508976 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2099/4229] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:20 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:20.546178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6538d1c1-c1ad-417e-bc97-50b97d790c91 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:20.547172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6538d1c1-c1ad-417e-bc97-50b97d790c91 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:20.573036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6538d1c1-c1ad-417e-bc97-50b97d790c91 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.577292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6538d1c1-c1ad-417e-bc97-50b97d790c91 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.578893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6538d1c1-c1ad-417e-bc97-50b97d790c91 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.579476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6538d1c1-c1ad-417e-bc97-50b97d790c91 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.790609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6538d1c1-c1ad-417e-bc97-50b97d790c91 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:20.803742 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6538d1c1-c1ad-417e-bc97-50b97d790c91 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.264838 Jul 20 04:30:20.810447 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2131/4230] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:20 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:20.878981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b5825c11-4504-4f15-b7e1-cd85b38ac4c0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:20.879602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b5825c11-4504-4f15-b7e1-cd85b38ac4c0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:20.900487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5825c11-4504-4f15-b7e1-cd85b38ac4c0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.901098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5825c11-4504-4f15-b7e1-cd85b38ac4c0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.901953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5825c11-4504-4f15-b7e1-cd85b38ac4c0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.903461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5825c11-4504-4f15-b7e1-cd85b38ac4c0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.519089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a016542-b9ce-442e-a619-5e0434f92c07 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:21.519731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3a016542-b9ce-442e-a619-5e0434f92c07 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:21.529599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a016542-b9ce-442e-a619-5e0434f92c07 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.530227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a016542-b9ce-442e-a619-5e0434f92c07 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.536524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a016542-b9ce-442e-a619-5e0434f92c07 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.537271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a016542-b9ce-442e-a619-5e0434f92c07 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.785249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3a016542-b9ce-442e-a619-5e0434f92c07 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:21.817745 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3a016542-b9ce-442e-a619-5e0434f92c07 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1271 microversion: 2.1 time: 0.304357 Jul 20 04:30:21.819744 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2132/4231] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:21 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:21.829236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b93bd8e2-c9ca-491d-bb48-b4221938c983 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:21.842948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b93bd8e2-c9ca-491d-bb48-b4221938c983 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:21.850209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b93bd8e2-c9ca-491d-bb48-b4221938c983 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.850847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b93bd8e2-c9ca-491d-bb48-b4221938c983 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.851740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b93bd8e2-c9ca-491d-bb48-b4221938c983 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:21.852279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b93bd8e2-c9ca-491d-bb48-b4221938c983 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:22.043555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b5825c11-4504-4f15-b7e1-cd85b38ac4c0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:22.051968 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b5825c11-4504-4f15-b7e1-cd85b38ac4c0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 1.178289 Jul 20 04:30:22.063275 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2100/4232] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:20 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:22.483230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b93bd8e2-c9ca-491d-bb48-b4221938c983 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:22.512488 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b93bd8e2-c9ca-491d-bb48-b4221938c983 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.688908 Jul 20 04:30:22.513135 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2133/4233] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:21 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:22.835727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9cb48754-89f9-4e40-b4e7-b7876a092860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:22.836744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9cb48754-89f9-4e40-b4e7-b7876a092860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:22.850491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9cb48754-89f9-4e40-b4e7-b7876a092860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.854719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9cb48754-89f9-4e40-b4e7-b7876a092860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:22.856140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9cb48754-89f9-4e40-b4e7-b7876a092860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.856766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9cb48754-89f9-4e40-b4e7-b7876a092860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.070351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-672f9b58-ee4f-468b-a5b4-16fe14caf1d7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:23.071694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-672f9b58-ee4f-468b-a5b4-16fe14caf1d7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:23.093025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-672f9b58-ee4f-468b-a5b4-16fe14caf1d7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.103074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-672f9b58-ee4f-468b-a5b4-16fe14caf1d7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.104265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-672f9b58-ee4f-468b-a5b4-16fe14caf1d7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.104913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-672f9b58-ee4f-468b-a5b4-16fe14caf1d7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.438703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9cb48754-89f9-4e40-b4e7-b7876a092860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:23.451924 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9cb48754-89f9-4e40-b4e7-b7876a092860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1313 microversion: 2.1 time: 0.620192 Jul 20 04:30:23.456649 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2101/4234] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:22 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:23.531570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-69e3b5d6-52f4-451a-9051-d49dce831abb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:23.533610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-69e3b5d6-52f4-451a-9051-d49dce831abb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:23.554179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69e3b5d6-52f4-451a-9051-d49dce831abb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.555442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69e3b5d6-52f4-451a-9051-d49dce831abb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.561831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69e3b5d6-52f4-451a-9051-d49dce831abb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.567109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69e3b5d6-52f4-451a-9051-d49dce831abb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.585629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-672f9b58-ee4f-468b-a5b4-16fe14caf1d7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:23.613702 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-672f9b58-ee4f-468b-a5b4-16fe14caf1d7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 0.547134 Jul 20 04:30:23.614348 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2134/4235] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:23 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:23.805969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-92f4cc4a-fb5d-41e1-b6ac-202f29719ddc req-304bc29f-8776-4d21-a566-2249e07764a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497d6c63-e92f-42c4-84b9-dfddd053908f", "name": "network-vif-plugged", "status": "completed", "tag": "75f52ec8-e3bb-4b2c-bd9f-3716c292ab7b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:23.820823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-92f4cc4a-fb5d-41e1-b6ac-202f29719ddc req-304bc29f-8776-4d21-a566-2249e07764a9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:23.824320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-92f4cc4a-fb5d-41e1-b6ac-202f29719ddc req-304bc29f-8776-4d21-a566-2249e07764a9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.869478 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-92f4cc4a-fb5d-41e1-b6ac-202f29719ddc req-304bc29f-8776-4d21-a566-2249e07764a9 service nova] Creating event network-vif-plugged:75f52ec8-e3bb-4b2c-bd9f-3716c292ab7b for instance 497d6c63-e92f-42c4-84b9-dfddd053908f on n-h1-760456-11 Jul 20 04:30:23.881120 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-92f4cc4a-fb5d-41e1-b6ac-202f29719ddc req-304bc29f-8776-4d21-a566-2249e07764a9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078942 Jul 20 04:30:23.884433 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2135/4236] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:24.167070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-69e3b5d6-52f4-451a-9051-d49dce831abb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:24.183809 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-69e3b5d6-52f4-451a-9051-d49dce831abb tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.654047 Jul 20 04:30:24.197143 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2102/4237] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:23 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:24.471605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8c78380-37c5-4967-842f-d54c9abf4016 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:24.472334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f8c78380-37c5-4967-842f-d54c9abf4016 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:24.489419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8c78380-37c5-4967-842f-d54c9abf4016 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:24.489899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8c78380-37c5-4967-842f-d54c9abf4016 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:24.490755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8c78380-37c5-4967-842f-d54c9abf4016 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:24.491212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8c78380-37c5-4967-842f-d54c9abf4016 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:24.632266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a44e3030-8c01-4257-ac9c-aa8a45ccd5af tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:24.633484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a44e3030-8c01-4257-ac9c-aa8a45ccd5af tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:24.643699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a44e3030-8c01-4257-ac9c-aa8a45ccd5af tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:24.646836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a44e3030-8c01-4257-ac9c-aa8a45ccd5af tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:24.647860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a44e3030-8c01-4257-ac9c-aa8a45ccd5af tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:24.648484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a44e3030-8c01-4257-ac9c-aa8a45ccd5af tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:24.923987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f8c78380-37c5-4967-842f-d54c9abf4016 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:24.926989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:24.937068 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f8c78380-37c5-4967-842f-d54c9abf4016 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1313 microversion: 2.1 time: 0.470685 Jul 20 04:30:24.939824 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2136/4238] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:24 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:25.191781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a44e3030-8c01-4257-ac9c-aa8a45ccd5af tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:25.202218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0611f450-1a1e-4171-bf0b-afad5e571945 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:25.203860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0611f450-1a1e-4171-bf0b-afad5e571945 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:25.204373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:25.220706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0611f450-1a1e-4171-bf0b-afad5e571945 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:25.222785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0611f450-1a1e-4171-bf0b-afad5e571945 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:25.223664 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a44e3030-8c01-4257-ac9c-aa8a45ccd5af tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 0.594667 Jul 20 04:30:25.224538 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2103/4239] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:24 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:25.225827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0611f450-1a1e-4171-bf0b-afad5e571945 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:25.226920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0611f450-1a1e-4171-bf0b-afad5e571945 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:25.487824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0611f450-1a1e-4171-bf0b-afad5e571945 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:25.515976 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0611f450-1a1e-4171-bf0b-afad5e571945 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.317197 Jul 20 04:30:25.530976 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2137/4240] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:25 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:25.657333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-699ef9fb-b4cf-44b6-9dd4-0d0fb1d5d043 req-6c3cfe26-e675-4098-aab6-ad5550409e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c82e4c-c67c-47f1-a7bb-7bf62a3e1647", "tag": "af9c004d-78dd-4984-af82-5290beeac76a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:25.707491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-699ef9fb-b4cf-44b6-9dd4-0d0fb1d5d043 req-6c3cfe26-e675-4098-aab6-ad5550409e48 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:25.714470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-699ef9fb-b4cf-44b6-9dd4-0d0fb1d5d043 req-6c3cfe26-e675-4098-aab6-ad5550409e48 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:25.759244 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-699ef9fb-b4cf-44b6-9dd4-0d0fb1d5d043 req-6c3cfe26-e675-4098-aab6-ad5550409e48 service nova] Creating event network-changed:af9c004d-78dd-4984-af82-5290beeac76a for instance 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 on n-h2-760456-11 Jul 20 04:30:25.785178 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-699ef9fb-b4cf-44b6-9dd4-0d0fb1d5d043 req-6c3cfe26-e675-4098-aab6-ad5550409e48 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133850 Jul 20 04:30:25.801653 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2104/4241] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:25.944288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-0bb6fa6b-9b24-4483-9bbc-142ede2bd685 req-9f363a92-78d2-4f1c-8bdb-9ed1d742912d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497d6c63-e92f-42c4-84b9-dfddd053908f", "name": "network-vif-plugged", "status": "completed", "tag": "b8ee7db5-e9fc-4612-bef8-8d81a96fa814"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:25.960275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-74368790-0e6b-4949-bfa6-d588f9d4f8d6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:25.961376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-74368790-0e6b-4949-bfa6-d588f9d4f8d6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:25.971656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0bb6fa6b-9b24-4483-9bbc-142ede2bd685 req-9f363a92-78d2-4f1c-8bdb-9ed1d742912d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:25.977949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74368790-0e6b-4949-bfa6-d588f9d4f8d6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:25.978554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0bb6fa6b-9b24-4483-9bbc-142ede2bd685 req-9f363a92-78d2-4f1c-8bdb-9ed1d742912d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:25.979573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74368790-0e6b-4949-bfa6-d588f9d4f8d6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.001145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74368790-0e6b-4949-bfa6-d588f9d4f8d6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.002742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74368790-0e6b-4949-bfa6-d588f9d4f8d6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.032492 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-0bb6fa6b-9b24-4483-9bbc-142ede2bd685 req-9f363a92-78d2-4f1c-8bdb-9ed1d742912d service nova] Creating event network-vif-plugged:b8ee7db5-e9fc-4612-bef8-8d81a96fa814 for instance 497d6c63-e92f-42c4-84b9-dfddd053908f on n-h1-760456-11 Jul 20 04:30:26.047638 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-0bb6fa6b-9b24-4483-9bbc-142ede2bd685 req-9f363a92-78d2-4f1c-8bdb-9ed1d742912d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108032 Jul 20 04:30:26.049029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2138/4242] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:26.241891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-af7000cd-4dfc-4856-b1c5-f1221d85b743 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:26.243023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-af7000cd-4dfc-4856-b1c5-f1221d85b743 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:26.259366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af7000cd-4dfc-4856-b1c5-f1221d85b743 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.260728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af7000cd-4dfc-4856-b1c5-f1221d85b743 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.262767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af7000cd-4dfc-4856-b1c5-f1221d85b743 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.265490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af7000cd-4dfc-4856-b1c5-f1221d85b743 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.546971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-74368790-0e6b-4949-bfa6-d588f9d4f8d6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:26.569021 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-74368790-0e6b-4949-bfa6-d588f9d4f8d6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1313 microversion: 2.1 time: 0.613013 Jul 20 04:30:26.570396 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2105/4243] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:25 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:26.576561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b002d46e-17f5-4c08-bfe3-1d7654bd0aef tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:26.577516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b002d46e-17f5-4c08-bfe3-1d7654bd0aef tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:26.606197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b002d46e-17f5-4c08-bfe3-1d7654bd0aef tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.608710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b002d46e-17f5-4c08-bfe3-1d7654bd0aef tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.611106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b002d46e-17f5-4c08-bfe3-1d7654bd0aef tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.615093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b002d46e-17f5-4c08-bfe3-1d7654bd0aef tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.930842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b002d46e-17f5-4c08-bfe3-1d7654bd0aef tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:26.942992 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b002d46e-17f5-4c08-bfe3-1d7654bd0aef tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.370989 Jul 20 04:30:26.943853 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2106/4244] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:26 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:26.969583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-af7000cd-4dfc-4856-b1c5-f1221d85b743 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:26.988633 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-af7000cd-4dfc-4856-b1c5-f1221d85b743 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 0.749903 Jul 20 04:30:27.005660 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2139/4245] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:26 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:27.592300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-62aaa37f-3baa-41d1-955a-c05357110ca0 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.592927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-62aaa37f-3baa-41d1-955a-c05357110ca0 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:27.613969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62aaa37f-3baa-41d1-955a-c05357110ca0 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.617579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62aaa37f-3baa-41d1-955a-c05357110ca0 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.618506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62aaa37f-3baa-41d1-955a-c05357110ca0 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.618962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62aaa37f-3baa-41d1-955a-c05357110ca0 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.966536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f0f10729-10d7-45a0-ad54-570f3560900d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.967541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f0f10729-10d7-45a0-ad54-570f3560900d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:27.991448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0f10729-10d7-45a0-ad54-570f3560900d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.996491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0f10729-10d7-45a0-ad54-570f3560900d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:28.007322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0f10729-10d7-45a0-ad54-570f3560900d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:28.013382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f0f10729-10d7-45a0-ad54-570f3560900d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:28.315269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-62aaa37f-3baa-41d1-955a-c05357110ca0 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:28.342113 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-62aaa37f-3baa-41d1-955a-c05357110ca0 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1313 microversion: 2.1 time: 0.756009 Jul 20 04:30:28.346981 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2107/4246] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:27 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1313 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:28.377493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0afe00df-d9f0-440a-8dad-0c105434cb8e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:28.379367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0afe00df-d9f0-440a-8dad-0c105434cb8e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:28.394658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0afe00df-d9f0-440a-8dad-0c105434cb8e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:28.397875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0afe00df-d9f0-440a-8dad-0c105434cb8e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:28.403633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0afe00df-d9f0-440a-8dad-0c105434cb8e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:28.406751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0afe00df-d9f0-440a-8dad-0c105434cb8e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:28.737138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f0f10729-10d7-45a0-ad54-570f3560900d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:28.751061 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f0f10729-10d7-45a0-ad54-570f3560900d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1334 microversion: 2.1 time: 0.794168 Jul 20 04:30:28.762567 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2140/4247] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:27 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1334 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:28.852872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:28.906199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:29.032691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0afe00df-d9f0-440a-8dad-0c105434cb8e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:29.041441 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0afe00df-d9f0-440a-8dad-0c105434cb8e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1507 microversion: 2.1 time: 0.692514 Jul 20 04:30:29.045712 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2108/4248] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:28 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1507 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:29.411649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e2cd8a1d-34ed-4ba1-8475-7ac3d114844f tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:29.414883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e2cd8a1d-34ed-4ba1-8475-7ac3d114844f tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:29.440094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:29.452236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2cd8a1d-34ed-4ba1-8475-7ac3d114844f tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:29.466341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2cd8a1d-34ed-4ba1-8475-7ac3d114844f tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:29.468101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2cd8a1d-34ed-4ba1-8475-7ac3d114844f tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:29.468950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2cd8a1d-34ed-4ba1-8475-7ac3d114844f tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:29.774349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-64f2388b-b371-406a-8634-3c74d52ba071 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:29.777375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-64f2388b-b371-406a-8634-3c74d52ba071 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:29.789172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64f2388b-b371-406a-8634-3c74d52ba071 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:29.820462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64f2388b-b371-406a-8634-3c74d52ba071 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:29.822487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64f2388b-b371-406a-8634-3c74d52ba071 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:29.823494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64f2388b-b371-406a-8634-3c74d52ba071 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:29.900143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e2cd8a1d-34ed-4ba1-8475-7ac3d114844f tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:29.911391 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e2cd8a1d-34ed-4ba1-8475-7ac3d114844f tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1313 microversion: 2.1 time: 0.547661 Jul 20 04:30:29.915524 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2141/4249] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:29 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:30.075551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c114aa5-1f36-4e00-9a87-50c59c214cfb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:30.076422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9c114aa5-1f36-4e00-9a87-50c59c214cfb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:30.099946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c114aa5-1f36-4e00-9a87-50c59c214cfb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.100424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c114aa5-1f36-4e00-9a87-50c59c214cfb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.103622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c114aa5-1f36-4e00-9a87-50c59c214cfb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.109326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c114aa5-1f36-4e00-9a87-50c59c214cfb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.298735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-64f2388b-b371-406a-8634-3c74d52ba071 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:30.333416 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-64f2388b-b371-406a-8634-3c74d52ba071 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1668 microversion: 2.1 time: 0.566044 Jul 20 04:30:30.349838 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2109/4250] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:29 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1668 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:30.375831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a83408e2-dc06-4c35-b223-9d3f45df725b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:30.376933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a83408e2-dc06-4c35-b223-9d3f45df725b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:30.399262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a83408e2-dc06-4c35-b223-9d3f45df725b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.407124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a83408e2-dc06-4c35-b223-9d3f45df725b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.408350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a83408e2-dc06-4c35-b223-9d3f45df725b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.409035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a83408e2-dc06-4c35-b223-9d3f45df725b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.491100 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a83408e2-dc06-4c35-b223-9d3f45df725b tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f/ips" status: 200 len: 178 microversion: 2.1 time: 0.123030 Jul 20 04:30:30.496420 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2110/4251] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:30:30 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f/ips => generated 178 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:30.521266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-336c7681-e5cc-4525-8ebd-9ee1795595dd tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:30.526321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-336c7681-e5cc-4525-8ebd-9ee1795595dd tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:30.557893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-336c7681-e5cc-4525-8ebd-9ee1795595dd tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.561210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-336c7681-e5cc-4525-8ebd-9ee1795595dd tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.565355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-336c7681-e5cc-4525-8ebd-9ee1795595dd tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.567787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-336c7681-e5cc-4525-8ebd-9ee1795595dd tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.672199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9c114aa5-1f36-4e00-9a87-50c59c214cfb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:30.693781 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9c114aa5-1f36-4e00-9a87-50c59c214cfb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1487 microversion: 2.1 time: 0.615722 Jul 20 04:30:30.695094 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2142/4252] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:30 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1487 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:30.731409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-336c7681-e5cc-4525-8ebd-9ee1795595dd tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:30.941104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3303d8b1-28d7-4fa3-8e75-7401ee8c8cdd tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:30.942032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3303d8b1-28d7-4fa3-8e75-7401ee8c8cdd tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:30.974619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3303d8b1-28d7-4fa3-8e75-7401ee8c8cdd tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.975551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3303d8b1-28d7-4fa3-8e75-7401ee8c8cdd tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.995960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3303d8b1-28d7-4fa3-8e75-7401ee8c8cdd tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.005094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3303d8b1-28d7-4fa3-8e75-7401ee8c8cdd tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.067994 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-336c7681-e5cc-4525-8ebd-9ee1795595dd tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "DELETE /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 204 len: 0 microversion: 2.1 time: 0.556337 Jul 20 04:30:31.072979 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2111/4253] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:30 2022] DELETE /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:31.099007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b5e0cbc-ba7e-4ad4-aff9-156c1db1897d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:31.103901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8b5e0cbc-ba7e-4ad4-aff9-156c1db1897d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:31.122002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b5e0cbc-ba7e-4ad4-aff9-156c1db1897d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.125826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b5e0cbc-ba7e-4ad4-aff9-156c1db1897d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.127548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b5e0cbc-ba7e-4ad4-aff9-156c1db1897d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.130982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b5e0cbc-ba7e-4ad4-aff9-156c1db1897d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.584508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3303d8b1-28d7-4fa3-8e75-7401ee8c8cdd tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:31.603189 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3303d8b1-28d7-4fa3-8e75-7401ee8c8cdd tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1313 microversion: 2.1 time: 0.671312 Jul 20 04:30:31.613985 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2143/4254] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:30 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1313 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:31.623375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8b5e0cbc-ba7e-4ad4-aff9-156c1db1897d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:31.636671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1744068894", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:31.637124 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8b5e0cbc-ba7e-4ad4-aff9-156c1db1897d tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1674 microversion: 2.1 time: 0.553361 Jul 20 04:30:31.638389 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2112/4255] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:31 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1674 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:31.828483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] validate_networks() for [('125d9e24-188e-44f7-91fc-3980215e3cdb', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:32.623756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b1db5ad-72bd-4212-933a-3c8a6c050029 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:32.625663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b1db5ad-72bd-4212-933a-3c8a6c050029 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:32.651693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b1db5ad-72bd-4212-933a-3c8a6c050029 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.653571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b1db5ad-72bd-4212-933a-3c8a6c050029 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.665392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b1db5ad-72bd-4212-933a-3c8a6c050029 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.668639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b1db5ad-72bd-4212-933a-3c8a6c050029 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.343538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:33.344851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:33.346627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:33.347196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:33.348618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:33.438120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.439202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.441251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.442059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.527471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Getting quotas for project ce0206e02d3d4e199c266d1bc82003b0. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:33.549145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Getting quotas for user 7a6085c4cb104f20a1f1dd6a8d30b4ce and project ce0206e02d3d4e199c266d1bc82003b0. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:33.580775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:33.584138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:33.662057 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7a86bc7d-0442-4478-810b-f3d70c1131bb tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.037736 Jul 20 04:30:33.663163 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2144/4256] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:33.670772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06288956-5dfb-4045-b243-2ef3a02e8455 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:33.672048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-06288956-5dfb-4045-b243-2ef3a02e8455 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:33.680843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06288956-5dfb-4045-b243-2ef3a02e8455 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.681650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06288956-5dfb-4045-b243-2ef3a02e8455 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.683362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06288956-5dfb-4045-b243-2ef3a02e8455 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.684408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06288956-5dfb-4045-b243-2ef3a02e8455 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.778766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7b1db5ad-72bd-4212-933a-3c8a6c050029 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:33.798787 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b1db5ad-72bd-4212-933a-3c8a6c050029 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1313 microversion: 2.1 time: 1.181597 Jul 20 04:30:33.800721 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2113/4257] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:32 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1313 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:33.811000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ecf6b44-3ff1-40dd-8c61-3d443f32c7b9 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:33.811851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ecf6b44-3ff1-40dd-8c61-3d443f32c7b9 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:34.012718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5ecf6b44-3ff1-40dd-8c61-3d443f32c7b9 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:34.031874 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ecf6b44-3ff1-40dd-8c61-3d443f32c7b9 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1214 microversion: 2.1 time: 0.229413 Jul 20 04:30:34.033501 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2114/4258] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:33 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:34.039938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-06288956-5dfb-4045-b243-2ef3a02e8455 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:34.050362 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-06288956-5dfb-4045-b243-2ef3a02e8455 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1674 microversion: 2.1 time: 0.385375 Jul 20 04:30:34.051191 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2145/4259] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:33 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1674 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:34.680869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-265301d4-45a1-4f8c-ac47-a2becd43b155 req-0c10a331-10b0-4a84-bbfd-5b173b8fc6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497d6c63-e92f-42c4-84b9-dfddd053908f", "name": "network-vif-deleted", "tag": "75f52ec8-e3bb-4b2c-bd9f-3716c292ab7b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:34.716496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-265301d4-45a1-4f8c-ac47-a2becd43b155 req-0c10a331-10b0-4a84-bbfd-5b173b8fc6df service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.717358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-265301d4-45a1-4f8c-ac47-a2becd43b155 req-0c10a331-10b0-4a84-bbfd-5b173b8fc6df service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:34.775443 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-265301d4-45a1-4f8c-ac47-a2becd43b155 req-0c10a331-10b0-4a84-bbfd-5b173b8fc6df service nova] Creating event network-vif-deleted:75f52ec8-e3bb-4b2c-bd9f-3716c292ab7b for instance 497d6c63-e92f-42c4-84b9-dfddd053908f on n-h1-760456-11 Jul 20 04:30:34.808152 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-265301d4-45a1-4f8c-ac47-a2becd43b155 req-0c10a331-10b0-4a84-bbfd-5b173b8fc6df service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120127 Jul 20 04:30:34.816122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b38b93d5-890d-47cb-becc-669c03515fb6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:34.817511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b38b93d5-890d-47cb-becc-669c03515fb6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:34.825205 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2115/4260] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:34.852166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b38b93d5-890d-47cb-becc-669c03515fb6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.853034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b38b93d5-890d-47cb-becc-669c03515fb6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:34.857308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b38b93d5-890d-47cb-becc-669c03515fb6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.861332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b38b93d5-890d-47cb-becc-669c03515fb6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.054838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0229bf7-e73d-4137-b316-63d3646c3738 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:35.055972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0229bf7-e73d-4137-b316-63d3646c3738 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:35.092901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0229bf7-e73d-4137-b316-63d3646c3738 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.103519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0229bf7-e73d-4137-b316-63d3646c3738 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.104783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0229bf7-e73d-4137-b316-63d3646c3738 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.108322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0229bf7-e73d-4137-b316-63d3646c3738 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.386751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c0229bf7-e73d-4137-b316-63d3646c3738 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:35.404907 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0229bf7-e73d-4137-b316-63d3646c3738 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1218 microversion: 2.1 time: 0.358716 Jul 20 04:30:35.416720 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2116/4261] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:35 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1218 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:35.417232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f777f4ea-0825-4d42-935f-065fc20f7737 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:35.417410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f777f4ea-0825-4d42-935f-065fc20f7737 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:35.456529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f777f4ea-0825-4d42-935f-065fc20f7737 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.457699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f777f4ea-0825-4d42-935f-065fc20f7737 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.460949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f777f4ea-0825-4d42-935f-065fc20f7737 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.464577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f777f4ea-0825-4d42-935f-065fc20f7737 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.560543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b38b93d5-890d-47cb-becc-669c03515fb6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:35.580416 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b38b93d5-890d-47cb-becc-669c03515fb6 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1313 microversion: 2.1 time: 0.766662 Jul 20 04:30:35.583232 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2146/4262] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:34 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:36.038715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c2a02fa3-849d-403d-a10e-93330009f9b4 req-60b3a5b4-35b5-4e12-b5e4-da1ec8bb605b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c82e4c-c67c-47f1-a7bb-7bf62a3e1647", "name": "network-vif-plugged", "status": "completed", "tag": "af9c004d-78dd-4984-af82-5290beeac76a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:36.054661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:36.083801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c2a02fa3-849d-403d-a10e-93330009f9b4 req-60b3a5b4-35b5-4e12-b5e4-da1ec8bb605b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.084394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c2a02fa3-849d-403d-a10e-93330009f9b4 req-60b3a5b4-35b5-4e12-b5e4-da1ec8bb605b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.158809 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c2a02fa3-849d-403d-a10e-93330009f9b4 req-60b3a5b4-35b5-4e12-b5e4-da1ec8bb605b service nova] Creating event network-vif-plugged:af9c004d-78dd-4984-af82-5290beeac76a for instance 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 on n-h2-760456-11 Jul 20 04:30:36.194571 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c2a02fa3-849d-403d-a10e-93330009f9b4 req-60b3a5b4-35b5-4e12-b5e4-da1ec8bb605b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159377 Jul 20 04:30:36.203145 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2147/4263] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:36.427071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4ac8b4d8-885e-4923-9201-2de98e26e453 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:36.428440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4ac8b4d8-885e-4923-9201-2de98e26e453 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:36.467025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ac8b4d8-885e-4923-9201-2de98e26e453 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.467810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ac8b4d8-885e-4923-9201-2de98e26e453 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.474677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ac8b4d8-885e-4923-9201-2de98e26e453 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.475398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ac8b4d8-885e-4923-9201-2de98e26e453 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.501552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f777f4ea-0825-4d42-935f-065fc20f7737 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:36.517844 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f777f4ea-0825-4d42-935f-065fc20f7737 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1495 microversion: 2.1 time: 1.105402 Jul 20 04:30:36.532487 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2117/4264] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:35 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1495 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:36.602017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-68907613-c98d-426f-9b83-a3f0d5cb5f7b tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:36.602826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-68907613-c98d-426f-9b83-a3f0d5cb5f7b tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:36.625579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68907613-c98d-426f-9b83-a3f0d5cb5f7b tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.626617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68907613-c98d-426f-9b83-a3f0d5cb5f7b tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.634450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68907613-c98d-426f-9b83-a3f0d5cb5f7b tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.636961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-68907613-c98d-426f-9b83-a3f0d5cb5f7b tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.803954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4ac8b4d8-885e-4923-9201-2de98e26e453 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:36.820105 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4ac8b4d8-885e-4923-9201-2de98e26e453 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1272 microversion: 2.1 time: 0.398721 Jul 20 04:30:36.824125 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2148/4265] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:36 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1272 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:36.900258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c315a994-2112-4817-96ff-3e3f1c6894f7 req-a7afdb02-3f7a-4592-b463-c9bc01580761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497d6c63-e92f-42c4-84b9-dfddd053908f", "name": "network-vif-deleted", "tag": "b8ee7db5-e9fc-4612-bef8-8d81a96fa814"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:36.925142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c315a994-2112-4817-96ff-3e3f1c6894f7 req-a7afdb02-3f7a-4592-b463-c9bc01580761 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.929202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c315a994-2112-4817-96ff-3e3f1c6894f7 req-a7afdb02-3f7a-4592-b463-c9bc01580761 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.023332 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c315a994-2112-4817-96ff-3e3f1c6894f7 req-a7afdb02-3f7a-4592-b463-c9bc01580761 service nova] Creating event network-vif-deleted:b8ee7db5-e9fc-4612-bef8-8d81a96fa814 for instance 497d6c63-e92f-42c4-84b9-dfddd053908f on n-h1-760456-11 Jul 20 04:30:37.059439 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c315a994-2112-4817-96ff-3e3f1c6894f7 req-a7afdb02-3f7a-4592-b463-c9bc01580761 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159337 Jul 20 04:30:37.067431 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2149/4266] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:37.305978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-68907613-c98d-426f-9b83-a3f0d5cb5f7b tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:37.345811 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-68907613-c98d-426f-9b83-a3f0d5cb5f7b tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1313 microversion: 2.1 time: 0.733338 Jul 20 04:30:37.355082 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2118/4267] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:36 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1313 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:37.538067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:37.539181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:37.558848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.559719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.561197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.564499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.711373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.714860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.717193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lazy-loading 'fault' on Instance uuid 497d6c63-e92f-42c4-84b9-dfddd053908f {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:30:37.844422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4f0db902-5532-4351-863d-acc1aeeebf4c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:37.847668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4f0db902-5532-4351-863d-acc1aeeebf4c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:37.856373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:37.861534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf595a75d684e629dc60f0ae7386935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3839dd67a4a6ab91bba230b6aa8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:37.874113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f0db902-5532-4351-863d-acc1aeeebf4c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.875223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f0db902-5532-4351-863d-acc1aeeebf4c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.876033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f0db902-5532-4351-863d-acc1aeeebf4c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.876740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f0db902-5532-4351-863d-acc1aeeebf4c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.876876 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1565a345-4066-41d0-97e8-d6557812fed0 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 200 len: 1303 microversion: 2.1 time: 0.341029 Jul 20 04:30:37.887311 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2150/4268] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:37 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 1303 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:38.052864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f0db902-5532-4351-863d-acc1aeeebf4c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:38.073642 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4f0db902-5532-4351-863d-acc1aeeebf4c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1272 microversion: 2.1 time: 0.239106 Jul 20 04:30:38.075672 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2119/4269] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:37 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:38.371121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-511d0230-438f-4ba8-aa02-b71eb946ee62 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:38.372500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-511d0230-438f-4ba8-aa02-b71eb946ee62 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:38.381465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-511d0230-438f-4ba8-aa02-b71eb946ee62 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.388458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-511d0230-438f-4ba8-aa02-b71eb946ee62 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.390400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-511d0230-438f-4ba8-aa02-b71eb946ee62 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.391684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-511d0230-438f-4ba8-aa02-b71eb946ee62 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.900006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9a8abeab-45e6-46fe-a176-74742cc6cc34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:38.902450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9a8abeab-45e6-46fe-a176-74742cc6cc34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:38.924713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a8abeab-45e6-46fe-a176-74742cc6cc34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.926561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a8abeab-45e6-46fe-a176-74742cc6cc34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.933145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a8abeab-45e6-46fe-a176-74742cc6cc34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.937205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9a8abeab-45e6-46fe-a176-74742cc6cc34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.982540 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-9a8abeab-45e6-46fe-a176-74742cc6cc34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] HTTP exception thrown: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9a8abeab-45e6-46fe-a176-74742cc6cc34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Request method failure captured: Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f HTTP/1.1 Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14RpvhRV4EQwebbmUaIfRRlDwhdM0mBhaNJYIBhuTcIlLtmF63aBcedJxDJVv82Yv2m1emJw4RTXcKXP0v7v47QG9nU2yCeIEyPuqSsZL9Y0GDMaz-SbRv1xwTVSr4GgiBaRuZdk2jCIPq81CeEljxzvQW1LOLjHiMG8pMfMlWVYdUU Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestMultiNic-812693220-project Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: bdf595a75d684e629dc60f0ae7386935 Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestMultiNic-812693220-project Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '497d6c63-e92f-42c4-84b9-dfddd053908f'} Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:38.985527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:38.991003 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:38.991003 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:38.991003 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:38.991003 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:38.991003 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:38.991003 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:38.991003 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:38.995822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9a8abeab-45e6-46fe-a176-74742cc6cc34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Returning 404 to user: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:39.003431 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9a8abeab-45e6-46fe-a176-74742cc6cc34 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 404 len: 111 microversion: 2.1 time: 0.105168 Jul 20 04:30:39.007423 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2120/4270] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:38 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:39.096113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89b5c1ce-7f59-4fa6-a654-09284288a9f5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:39.100555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-89b5c1ce-7f59-4fa6-a654-09284288a9f5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:39.117026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89b5c1ce-7f59-4fa6-a654-09284288a9f5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.119770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89b5c1ce-7f59-4fa6-a654-09284288a9f5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.121138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89b5c1ce-7f59-4fa6-a654-09284288a9f5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.122140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89b5c1ce-7f59-4fa6-a654-09284288a9f5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.504249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89b5c1ce-7f59-4fa6-a654-09284288a9f5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:39.549083 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89b5c1ce-7f59-4fa6-a654-09284288a9f5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 0.461033 Jul 20 04:30:39.563385 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2121/4271] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:39 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:39.648394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-511d0230-438f-4ba8-aa02-b71eb946ee62 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:39.687868 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-511d0230-438f-4ba8-aa02-b71eb946ee62 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1497 microversion: 2.1 time: 1.320735 Jul 20 04:30:39.700919 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2151/4272] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:38 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1497 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:40.567537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c1a973bb-4e8e-479c-ade2-f46854cafd15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.568774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c1a973bb-4e8e-479c-ade2-f46854cafd15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:40.576698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1a973bb-4e8e-479c-ade2-f46854cafd15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.577434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1a973bb-4e8e-479c-ade2-f46854cafd15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.578434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1a973bb-4e8e-479c-ade2-f46854cafd15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.579062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1a973bb-4e8e-479c-ade2-f46854cafd15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.582118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:40.820294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6bc04e3-eb91-470d-9e44-1a77e74085d1 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.821387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6bc04e3-eb91-470d-9e44-1a77e74085d1 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:40.834001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6bc04e3-eb91-470d-9e44-1a77e74085d1 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.834399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6bc04e3-eb91-470d-9e44-1a77e74085d1 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.835205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6bc04e3-eb91-470d-9e44-1a77e74085d1 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.848789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6bc04e3-eb91-470d-9e44-1a77e74085d1 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.937642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6bc04e3-eb91-470d-9e44-1a77e74085d1 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:41.186826 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6bc04e3-eb91-470d-9e44-1a77e74085d1 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "DELETE /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 204 len: 0 microversion: 2.1 time: 0.368363 Jul 20 04:30:41.187763 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2152/4273] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:40 2022] DELETE /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:41.203586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9b47aa0-7dbb-44c0-9955-f54e086fc0f1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:41.207774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9b47aa0-7dbb-44c0-9955-f54e086fc0f1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:41.231160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9b47aa0-7dbb-44c0-9955-f54e086fc0f1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.231627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9b47aa0-7dbb-44c0-9955-f54e086fc0f1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.234355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9b47aa0-7dbb-44c0-9955-f54e086fc0f1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.238459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9b47aa0-7dbb-44c0-9955-f54e086fc0f1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.433622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9b47aa0-7dbb-44c0-9955-f54e086fc0f1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:41.442531 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9b47aa0-7dbb-44c0-9955-f54e086fc0f1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.253292 Jul 20 04:30:41.445227 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2153/4274] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:41 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:41.451583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c6a4edb5-4a9b-49f3-8831-ca176e8f5a05 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:41.452633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c6a4edb5-4a9b-49f3-8831-ca176e8f5a05 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:41.460226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6a4edb5-4a9b-49f3-8831-ca176e8f5a05 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.461082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6a4edb5-4a9b-49f3-8831-ca176e8f5a05 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.462168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6a4edb5-4a9b-49f3-8831-ca176e8f5a05 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.463022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6a4edb5-4a9b-49f3-8831-ca176e8f5a05 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.467369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:41.691577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c1a973bb-4e8e-479c-ade2-f46854cafd15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:41.705718 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c1a973bb-4e8e-479c-ade2-f46854cafd15 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 1.141996 Jul 20 04:30:41.711097 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2122/4275] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:40 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:41.716265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-23ff868f-49a0-425f-8618-015779e779cd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:41.717211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-23ff868f-49a0-425f-8618-015779e779cd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:41.741791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23ff868f-49a0-425f-8618-015779e779cd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.744833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23ff868f-49a0-425f-8618-015779e779cd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.745812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23ff868f-49a0-425f-8618-015779e779cd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.747013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23ff868f-49a0-425f-8618-015779e779cd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.798395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6a4edb5-4a9b-49f3-8831-ca176e8f5a05 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:41.809636 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c6a4edb5-4a9b-49f3-8831-ca176e8f5a05 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1503 microversion: 2.1 time: 0.362641 Jul 20 04:30:41.810799 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2154/4276] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:41 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:42.723631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-513d71bb-2d5d-4194-aa3b-83720eb5bed4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:42.724205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-23ff868f-49a0-425f-8618-015779e779cd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:42.725493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-513d71bb-2d5d-4194-aa3b-83720eb5bed4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:42.733683 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-23ff868f-49a0-425f-8618-015779e779cd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 1.021100 Jul 20 04:30:42.742600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-513d71bb-2d5d-4194-aa3b-83720eb5bed4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.743414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-513d71bb-2d5d-4194-aa3b-83720eb5bed4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.745787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-513d71bb-2d5d-4194-aa3b-83720eb5bed4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.746391 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2123/4277] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:41 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:42.746862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-513d71bb-2d5d-4194-aa3b-83720eb5bed4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.754464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-33f244a5-80cc-4d81-854b-dc34b19af8ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:42.755371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-33f244a5-80cc-4d81-854b-dc34b19af8ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:42.765278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33f244a5-80cc-4d81-854b-dc34b19af8ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.767180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33f244a5-80cc-4d81-854b-dc34b19af8ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.768488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33f244a5-80cc-4d81-854b-dc34b19af8ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.769218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33f244a5-80cc-4d81-854b-dc34b19af8ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.945788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-513d71bb-2d5d-4194-aa3b-83720eb5bed4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:42.954746 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-513d71bb-2d5d-4194-aa3b-83720eb5bed4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 0.234606 Jul 20 04:30:42.955453 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2155/4278] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:42 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:42.970925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ec10152b-2a95-4090-8604-74b69a3106ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:42.971549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ec10152b-2a95-4090-8604-74b69a3106ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:42.978058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec10152b-2a95-4090-8604-74b69a3106ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.979094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec10152b-2a95-4090-8604-74b69a3106ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.979908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec10152b-2a95-4090-8604-74b69a3106ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.980355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec10152b-2a95-4090-8604-74b69a3106ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.223808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ec10152b-2a95-4090-8604-74b69a3106ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:43.236606 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ec10152b-2a95-4090-8604-74b69a3106ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1503 microversion: 2.1 time: 0.269208 Jul 20 04:30:43.250747 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2156/4279] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:42 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:43.579726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-33f244a5-80cc-4d81-854b-dc34b19af8ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:43.633166 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-33f244a5-80cc-4d81-854b-dc34b19af8ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.880782 Jul 20 04:30:43.639663 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2124/4280] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:42 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:43.660508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9248ac70-e74e-4788-b0b9-3c6945c68a70 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1259883994"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:43.663948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9248ac70-e74e-4788-b0b9-3c6945c68a70 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:43.672190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:43.678081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:43.690114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a3ebed0c-439d-491a-b8e7-9571c8e55717 req-68f38963-2534-4ac6-995d-a3bfceed82fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac47ff84-f717-4754-8d77-f04484dc86e1", "tag": "04896d77-27ec-43cc-a641-87a188d2f503"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:43.720803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9248ac70-e74e-4788-b0b9-3c6945c68a70 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.730831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9248ac70-e74e-4788-b0b9-3c6945c68a70 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.735548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9248ac70-e74e-4788-b0b9-3c6945c68a70 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.737630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9248ac70-e74e-4788-b0b9-3c6945c68a70 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.747090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a3ebed0c-439d-491a-b8e7-9571c8e55717 req-68f38963-2534-4ac6-995d-a3bfceed82fa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.747717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a3ebed0c-439d-491a-b8e7-9571c8e55717 req-68f38963-2534-4ac6-995d-a3bfceed82fa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.789441 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a3ebed0c-439d-491a-b8e7-9571c8e55717 req-68f38963-2534-4ac6-995d-a3bfceed82fa service nova] Creating event network-changed:04896d77-27ec-43cc-a641-87a188d2f503 for instance ac47ff84-f717-4754-8d77-f04484dc86e1 on n-h2-760456-11 Jul 20 04:30:43.795908 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a3ebed0c-439d-491a-b8e7-9571c8e55717 req-68f38963-2534-4ac6-995d-a3bfceed82fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130317 Jul 20 04:30:43.801627 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2125/4281] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:43.973177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec47ab0a-a0b4-4037-a121-7f5156c36dc7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:43.973897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ec47ab0a-a0b4-4037-a121-7f5156c36dc7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:43.983214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec47ab0a-a0b4-4037-a121-7f5156c36dc7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.999061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec47ab0a-a0b4-4037-a121-7f5156c36dc7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.999921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec47ab0a-a0b4-4037-a121-7f5156c36dc7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.000377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec47ab0a-a0b4-4037-a121-7f5156c36dc7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.083503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:44.496827 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9248ac70-e74e-4788-b0b9-3c6945c68a70 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.848659 Jul 20 04:30:44.506054 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2157/4282] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:43 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 04:30:44.528831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c72d807-6d14-4bf2-9116-d1efee2dc860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:44.531480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3c72d807-6d14-4bf2-9116-d1efee2dc860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:44.549168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c72d807-6d14-4bf2-9116-d1efee2dc860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.549689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c72d807-6d14-4bf2-9116-d1efee2dc860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.555629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c72d807-6d14-4bf2-9116-d1efee2dc860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.555852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c72d807-6d14-4bf2-9116-d1efee2dc860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.751981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ec47ab0a-a0b4-4037-a121-7f5156c36dc7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:44.760506 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec47ab0a-a0b4-4037-a121-7f5156c36dc7 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 0.791075 Jul 20 04:30:44.761340 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2126/4283] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:43 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:45.244528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3c72d807-6d14-4bf2-9116-d1efee2dc860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:45.260313 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3c72d807-6d14-4bf2-9116-d1efee2dc860 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1503 microversion: 2.1 time: 0.743441 Jul 20 04:30:45.265581 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2158/4284] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:44 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1503 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:45.764132 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:30:45.764354 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 04:30:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:30:45.783439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba46e754-6d3d-4f74-9f04-44a033481f31 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:45.784735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ba46e754-6d3d-4f74-9f04-44a033481f31 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:45.809659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba46e754-6d3d-4f74-9f04-44a033481f31 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.810126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba46e754-6d3d-4f74-9f04-44a033481f31 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.813484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba46e754-6d3d-4f74-9f04-44a033481f31 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.813952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba46e754-6d3d-4f74-9f04-44a033481f31 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.853833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ae272445-6887-4b33-aa3f-c31ef3bc014d req-a84fa192-b727-4124-9909-1b1ff5934420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c82e4c-c67c-47f1-a7bb-7bf62a3e1647", "name": "network-vif-deleted", "tag": "af9c004d-78dd-4984-af82-5290beeac76a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:45.877449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ae272445-6887-4b33-aa3f-c31ef3bc014d req-a84fa192-b727-4124-9909-1b1ff5934420 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.880337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ae272445-6887-4b33-aa3f-c31ef3bc014d req-a84fa192-b727-4124-9909-1b1ff5934420 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.899977 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ae272445-6887-4b33-aa3f-c31ef3bc014d req-a84fa192-b727-4124-9909-1b1ff5934420 service nova] Creating event network-vif-deleted:af9c004d-78dd-4984-af82-5290beeac76a for instance 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 on n-h2-760456-11 Jul 20 04:30:45.941562 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ae272445-6887-4b33-aa3f-c31ef3bc014d req-a84fa192-b727-4124-9909-1b1ff5934420 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087360 Jul 20 04:30:45.944916 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2159/4285] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:46.230553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8f78b58-1b13-474b-9f00-bcfdb32776b4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.231260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f8f78b58-1b13-474b-9f00-bcfdb32776b4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:46.247176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8f78b58-1b13-474b-9f00-bcfdb32776b4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.247849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8f78b58-1b13-474b-9f00-bcfdb32776b4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.250142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8f78b58-1b13-474b-9f00-bcfdb32776b4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.251997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8f78b58-1b13-474b-9f00-bcfdb32776b4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.288824 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-f8f78b58-1b13-474b-9f00-bcfdb32776b4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] HTTP exception thrown: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8f78b58-1b13-474b-9f00-bcfdb32776b4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Request method failure captured: Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f HTTP/1.1 Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14RpvhRV4EQwebbmUaIfRRlDwhdM0mBhaNJYIBhuTcIlLtmF63aBcedJxDJVv82Yv2m1emJw4RTXcKXP0v7v47QG9nU2yCeIEyPuqSsZL9Y0GDMaz-SbRv1xwTVSr4GgiBaRuZdk2jCIPq81CeEljxzvQW1LOLjHiMG8pMfMlWVYdUU Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestMultiNic-812693220-project Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: bdf595a75d684e629dc60f0ae7386935 Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestMultiNic-812693220-project Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '497d6c63-e92f-42c4-84b9-dfddd053908f'} Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:46.291591 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:46.296149 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.296149 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:46.296149 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.296149 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.296149 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:46.296149 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:46.296149 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:46.296149 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:46.296149 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:46.296149 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.317877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8f78b58-1b13-474b-9f00-bcfdb32776b4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Returning 404 to user: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:46.321730 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f8f78b58-1b13-474b-9f00-bcfdb32776b4 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "DELETE /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 404 len: 111 microversion: 2.1 time: 0.097502 Jul 20 04:30:46.325231 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2160/4286] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:46 2022] DELETE /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:46.334619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.339209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:46.352548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.353864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.354827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.355392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.391624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ba46e754-6d3d-4f74-9f04-44a033481f31 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:46.402498 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ba46e754-6d3d-4f74-9f04-44a033481f31 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 0.628437 Jul 20 04:30:46.403109 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2127/4287] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:45 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:46.405228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.405958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.406709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lazy-loading 'fault' on Instance uuid 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:30:46.418119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-02e73fcb-d49b-4cc6-930a-4cc27ee2fb8f tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.418788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-02e73fcb-d49b-4cc6-930a-4cc27ee2fb8f tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: 497d6c63-e92f-42c4-84b9-dfddd053908f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:46.428504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02e73fcb-d49b-4cc6-930a-4cc27ee2fb8f tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.428965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02e73fcb-d49b-4cc6-930a-4cc27ee2fb8f tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.429755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02e73fcb-d49b-4cc6-930a-4cc27ee2fb8f tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.430195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02e73fcb-d49b-4cc6-930a-4cc27ee2fb8f tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.476214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ea326a3b04e31a4c4fd8a62c7d52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab426ff745841d6bb7e17629290159f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:46.476580 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-02e73fcb-d49b-4cc6-930a-4cc27ee2fb8f tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] HTTP exception thrown: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:46.486492 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0ba8f85d-b401-4cc4-bf1d-6103c4803a80 tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 200 len: 1303 microversion: 2.1 time: 0.159895 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-02e73fcb-d49b-4cc6-930a-4cc27ee2fb8f tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Request method failure captured: Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f HTTP/1.1 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14RpvhRV4EQwebbmUaIfRRlDwhdM0mBhaNJYIBhuTcIlLtmF63aBcedJxDJVv82Yv2m1emJw4RTXcKXP0v7v47QG9nU2yCeIEyPuqSsZL9Y0GDMaz-SbRv1xwTVSr4GgiBaRuZdk2jCIPq81CeEljxzvQW1LOLjHiMG8pMfMlWVYdUU Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestMultiNic-812693220-project Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: bdf595a75d684e629dc60f0ae7386935 Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestMultiNic-812693220-project Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '497d6c63-e92f-42c4-84b9-dfddd053908f'} Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:46.486902 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.491661 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.491661 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:46.491661 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:46.491661 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:46.491661 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:46.491661 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. Jul 20 04:30:46.491661 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.502165 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2161/4288] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:46 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 1303 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:46.502957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-02e73fcb-d49b-4cc6-930a-4cc27ee2fb8f tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Returning 404 to user: Instance 497d6c63-e92f-42c4-84b9-dfddd053908f could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:46.503906 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-02e73fcb-d49b-4cc6-930a-4cc27ee2fb8f tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f" status: 404 len: 111 microversion: 2.1 time: 0.097597 Jul 20 04:30:46.518260 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2128/4289] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:46 2022] GET /compute/v2.1/servers/497d6c63-e92f-42c4-84b9-dfddd053908f => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:46.546363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca6bd87d-ac51-4c6a-b353-c4704403fa74 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.546879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ca6bd87d-ac51-4c6a-b353-c4704403fa74 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:46.562930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca6bd87d-ac51-4c6a-b353-c4704403fa74 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.568776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca6bd87d-ac51-4c6a-b353-c4704403fa74 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.569630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca6bd87d-ac51-4c6a-b353-c4704403fa74 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.570086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ca6bd87d-ac51-4c6a-b353-c4704403fa74 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.601250 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-ca6bd87d-ac51-4c6a-b353-c4704403fa74 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] HTTP exception thrown: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca6bd87d-ac51-4c6a-b353-c4704403fa74 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Request method failure captured: Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 HTTP/1.1 Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14RpvhRV4EQwebbmUaIfRRlDwhdM0mBhaNJYIBhuTcIlLtmF63aBcedJxDJVv82Yv2m1emJw4RTXcKXP0v7v47QG9nU2yCeIEyPuqSsZL9Y0GDMaz-SbRv1xwTVSr4GgiBaRuZdk2jCIPq81CeEljxzvQW1LOLjHiMG8pMfMlWVYdUU Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestMultiNic-812693220-project Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: bdf595a75d684e629dc60f0ae7386935 Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestMultiNic-812693220-project Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6'} Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:46.602913 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ca6bd87d-ac51-4c6a-b353-c4704403fa74 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Returning 404 to user: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:46.607499 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ca6bd87d-ac51-4c6a-b353-c4704403fa74 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 404 len: 111 microversion: 2.1 time: 0.085025 Jul 20 04:30:46.611051 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2162/4290] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:46 2022] DELETE /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:46.616334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-725dc083-178e-4ca5-b05e-b8cc7762db11 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.616893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-725dc083-178e-4ca5-b05e-b8cc7762db11 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] [instance: cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:46.630675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-725dc083-178e-4ca5-b05e-b8cc7762db11 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.631111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-725dc083-178e-4ca5-b05e-b8cc7762db11 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.632114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-725dc083-178e-4ca5-b05e-b8cc7762db11 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.632737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-725dc083-178e-4ca5-b05e-b8cc7762db11 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.679907 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-725dc083-178e-4ca5-b05e-b8cc7762db11 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] HTTP exception thrown: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-725dc083-178e-4ca5-b05e-b8cc7762db11 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Request method failure captured: Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 HTTP/1.1 Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14RpvhRV4EQwebbmUaIfRRlDwhdM0mBhaNJYIBhuTcIlLtmF63aBcedJxDJVv82Yv2m1emJw4RTXcKXP0v7v47QG9nU2yCeIEyPuqSsZL9Y0GDMaz-SbRv1xwTVSr4GgiBaRuZdk2jCIPq81CeEljxzvQW1LOLjHiMG8pMfMlWVYdUU Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4cf3839dd67a4a6ab91bba230b6aa8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 4cf3839dd67a4a6ab91bba230b6aa8e3 Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestMultiNic-812693220 Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestMultiNic-812693220-project Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: bdf595a75d684e629dc60f0ae7386935 Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestMultiNic-812693220-project Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6'} Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:46.682462 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.686563 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:46.686563 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:46.686563 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:46.686563 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:46.686563 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:46.686563 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. Jul 20 04:30:46.686563 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:46.686563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-725dc083-178e-4ca5-b05e-b8cc7762db11 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] Returning 404 to user: Instance cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:46.686563 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-725dc083-178e-4ca5-b05e-b8cc7762db11 tempest-ServersTestMultiNic-812693220 tempest-ServersTestMultiNic-812693220-project] 10.222.0.59 "GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6" status: 404 len: 111 microversion: 2.1 time: 0.071722 Jul 20 04:30:46.686563 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2129/4291] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:46 2022] GET /compute/v2.1/servers/cc5ce06e-31d7-4e98-9736-9eb6bbd41dd6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:47.422198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-682b1447-dd97-4710-aafc-f1f57308eb58 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:47.422834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-682b1447-dd97-4710-aafc-f1f57308eb58 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:47.438496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-682b1447-dd97-4710-aafc-f1f57308eb58 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.442371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-682b1447-dd97-4710-aafc-f1f57308eb58 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.443412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-682b1447-dd97-4710-aafc-f1f57308eb58 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.444073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-682b1447-dd97-4710-aafc-f1f57308eb58 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.509254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4728162f-ecd4-441b-b314-dc18431b42ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:47.510027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4728162f-ecd4-441b-b314-dc18431b42ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] [instance: 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:47.520107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4728162f-ecd4-441b-b314-dc18431b42ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.520574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4728162f-ecd4-441b-b314-dc18431b42ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.521366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4728162f-ecd4-441b-b314-dc18431b42ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.521846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4728162f-ecd4-441b-b314-dc18431b42ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.590304 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-4728162f-ecd4-441b-b314-dc18431b42ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] HTTP exception thrown: Instance 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 could not be found. Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4728162f-ecd4-441b-b314-dc18431b42ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Request method failure captured: Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 HTTP/1.1 Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14SzDqY19CA35K9QeA23TyWU6l7hPhcJXSZnwkibIT25qwZXIekyIXDkaXuN1EgRgtwji6knbkbALdbiyJAp7HGAEd59rVEOydtdF9QRRJF6ZzmoIxxznsutouuSW0xcMLFAk4w9y8bLdVlIViBss1sXPThfTRp_80Y4yUI9y0BPMaU Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 9ab426ff745841d6bb7e17629290159f Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesActionsTest-1683356261 Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9ab426ff745841d6bb7e17629290159f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ab426ff745841d6bb7e17629290159f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ab426ff745841d6bb7e17629290159f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9ab426ff745841d6bb7e17629290159f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesActionsTest-1683356261 Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 9ab426ff745841d6bb7e17629290159f Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesActionsTest-1683356261 Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesActionsTest-1683356261-project Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9c7ea326a3b04e31a4c4fd8a62c7d52d Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesActionsTest-1683356261-project Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 could not be found. Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '84c82e4c-c67c-47f1-a7bb-7bf62a3e1647'} Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 could not be found. Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 could not be found. Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:47.591984 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:47.596012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:47.596012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:47.596012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:47.596012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:47.596012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:47.596012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 could not be found. Jul 20 04:30:47.596012 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:30:47.596012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4728162f-ecd4-441b-b314-dc18431b42ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] Returning 404 to user: Instance 84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:47.622484 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4728162f-ecd4-441b-b314-dc18431b42ef tempest-VolumesActionsTest-1683356261 tempest-VolumesActionsTest-1683356261-project] 10.222.0.59 "GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647" status: 404 len: 111 microversion: 2.1 time: 0.088447 Jul 20 04:30:47.623785 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2130/4292] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:47 2022] GET /compute/v2.1/servers/84c82e4c-c67c-47f1-a7bb-7bf62a3e1647 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:48.044279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-682b1447-dd97-4710-aafc-f1f57308eb58 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:48.064321 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-682b1447-dd97-4710-aafc-f1f57308eb58 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 0.647178 Jul 20 04:30:48.084365 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2163/4293] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:47 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:49.093210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f33163b6-45d5-46e1-b391-96f623c953f6 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:49.094960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f33163b6-45d5-46e1-b391-96f623c953f6 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:49.119298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f33163b6-45d5-46e1-b391-96f623c953f6 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.127067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f33163b6-45d5-46e1-b391-96f623c953f6 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:49.132047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f33163b6-45d5-46e1-b391-96f623c953f6 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.132781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f33163b6-45d5-46e1-b391-96f623c953f6 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.672716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f33163b6-45d5-46e1-b391-96f623c953f6 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:50.684898 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f33163b6-45d5-46e1-b391-96f623c953f6 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 1.597208 Jul 20 04:30:50.687254 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2131/4294] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:49 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:51.705028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a88d2a48-2178-412c-844b-d6093dd4550b tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:51.706288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a88d2a48-2178-412c-844b-d6093dd4550b tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:51.729662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a88d2a48-2178-412c-844b-d6093dd4550b tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.732398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a88d2a48-2178-412c-844b-d6093dd4550b tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.735806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a88d2a48-2178-412c-844b-d6093dd4550b tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.740537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a88d2a48-2178-412c-844b-d6093dd4550b tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.376023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a88d2a48-2178-412c-844b-d6093dd4550b tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:53.386210 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a88d2a48-2178-412c-844b-d6093dd4550b tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 1.685332 Jul 20 04:30:53.410025 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2164/4295] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:51 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:54.414611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e181e99-c38a-46e8-ba74-f6d39ab596c8 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:54.417013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5e181e99-c38a-46e8-ba74-f6d39ab596c8 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:54.437140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e181e99-c38a-46e8-ba74-f6d39ab596c8 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:54.440116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e181e99-c38a-46e8-ba74-f6d39ab596c8 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:54.441398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e181e99-c38a-46e8-ba74-f6d39ab596c8 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:54.442088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e181e99-c38a-46e8-ba74-f6d39ab596c8 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:56.304033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5e181e99-c38a-46e8-ba74-f6d39ab596c8 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:56.312753 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5e181e99-c38a-46e8-ba74-f6d39ab596c8 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 1.904789 Jul 20 04:30:56.327212 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2132/4296] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:54 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:57.011374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e1198d9e-f73a-4d7b-a665-398e3a72314f req-362c1e6e-2987-4d8e-9b69-ec066d11ab78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b78332-e314-4da3-8a21-1ccfa545f11a", "name": "network-vif-plugged", "status": "completed", "tag": "8c4c6b64-e711-449a-a899-27913ed07df2"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:57.029128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e1198d9e-f73a-4d7b-a665-398e3a72314f req-362c1e6e-2987-4d8e-9b69-ec066d11ab78 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.029579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e1198d9e-f73a-4d7b-a665-398e3a72314f req-362c1e6e-2987-4d8e-9b69-ec066d11ab78 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.111234 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e1198d9e-f73a-4d7b-a665-398e3a72314f req-362c1e6e-2987-4d8e-9b69-ec066d11ab78 service nova] Creating event network-vif-plugged:8c4c6b64-e711-449a-a899-27913ed07df2 for instance 44b78332-e314-4da3-8a21-1ccfa545f11a on n-h2-760456-11 Jul 20 04:30:57.139504 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e1198d9e-f73a-4d7b-a665-398e3a72314f req-362c1e6e-2987-4d8e-9b69-ec066d11ab78 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132247 Jul 20 04:30:57.154357 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2165/4297] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:57.346071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9109200-42ef-4ab6-8e57-faee9ba30223 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:57.346728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b9109200-42ef-4ab6-8e57-faee9ba30223 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:57.394140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9109200-42ef-4ab6-8e57-faee9ba30223 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.394642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9109200-42ef-4ab6-8e57-faee9ba30223 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.395458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9109200-42ef-4ab6-8e57-faee9ba30223 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.395902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9109200-42ef-4ab6-8e57-faee9ba30223 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.209264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b9109200-42ef-4ab6-8e57-faee9ba30223 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:58.229122 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b9109200-42ef-4ab6-8e57-faee9ba30223 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 0.880262 Jul 20 04:30:58.229796 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2133/4298] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:57 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:59.248203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-345af71d-ec8f-4873-bf79-488f5766345f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:59.248910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-345af71d-ec8f-4873-bf79-488f5766345f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:59.289725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-345af71d-ec8f-4873-bf79-488f5766345f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:59.293420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-345af71d-ec8f-4873-bf79-488f5766345f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:59.300289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-345af71d-ec8f-4873-bf79-488f5766345f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:59.300765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-345af71d-ec8f-4873-bf79-488f5766345f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.030760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-345af71d-ec8f-4873-bf79-488f5766345f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:00.046466 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-345af71d-ec8f-4873-bf79-488f5766345f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 0.802857 Jul 20 04:31:00.047317 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2166/4299] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:59 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:00.089969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-79141399-df6f-487e-9625-2cfd04c11037 req-a18e392c-1335-441a-8f58-ad176e44b859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac47ff84-f717-4754-8d77-f04484dc86e1", "name": "network-vif-plugged", "status": "completed", "tag": "04896d77-27ec-43cc-a641-87a188d2f503"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:00.125729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-79141399-df6f-487e-9625-2cfd04c11037 req-a18e392c-1335-441a-8f58-ad176e44b859 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:00.126779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-79141399-df6f-487e-9625-2cfd04c11037 req-a18e392c-1335-441a-8f58-ad176e44b859 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:00.173454 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-79141399-df6f-487e-9625-2cfd04c11037 req-a18e392c-1335-441a-8f58-ad176e44b859 service nova] Creating event network-vif-plugged:04896d77-27ec-43cc-a641-87a188d2f503 for instance ac47ff84-f717-4754-8d77-f04484dc86e1 on n-h2-760456-11 Jul 20 04:31:00.203212 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-79141399-df6f-487e-9625-2cfd04c11037 req-a18e392c-1335-441a-8f58-ad176e44b859 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118209 Jul 20 04:31:00.207086 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2134/4300] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:01.067822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4345c37b-f5f8-466a-96ba-ee9c45a39a73 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:01.068464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4345c37b-f5f8-466a-96ba-ee9c45a39a73 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:01.082904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4345c37b-f5f8-466a-96ba-ee9c45a39a73 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:01.083480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4345c37b-f5f8-466a-96ba-ee9c45a39a73 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:01.084165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4345c37b-f5f8-466a-96ba-ee9c45a39a73 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:01.084623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4345c37b-f5f8-466a-96ba-ee9c45a39a73 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:01.755529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4345c37b-f5f8-466a-96ba-ee9c45a39a73 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:01.767683 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4345c37b-f5f8-466a-96ba-ee9c45a39a73 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1314 microversion: 2.1 time: 0.703894 Jul 20 04:31:01.769602 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2167/4301] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:01 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:02.785640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-544de2e2-9bdc-4387-aa61-33d6396f4de5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:02.787016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-544de2e2-9bdc-4387-aa61-33d6396f4de5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:02.799718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-544de2e2-9bdc-4387-aa61-33d6396f4de5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:02.804667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-544de2e2-9bdc-4387-aa61-33d6396f4de5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:02.807785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-544de2e2-9bdc-4387-aa61-33d6396f4de5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:02.815045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-544de2e2-9bdc-4387-aa61-33d6396f4de5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.439388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-544de2e2-9bdc-4387-aa61-33d6396f4de5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:03.457206 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-544de2e2-9bdc-4387-aa61-33d6396f4de5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1500 microversion: 2.1 time: 0.667014 Jul 20 04:31:03.458790 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2135/4302] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:02 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1500 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:03.483207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-64caa0fe-5da5-4e0e-92d4-d33b4a0ab36a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:03.484317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-64caa0fe-5da5-4e0e-92d4-d33b4a0ab36a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:03.523728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64caa0fe-5da5-4e0e-92d4-d33b4a0ab36a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.524485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64caa0fe-5da5-4e0e-92d4-d33b4a0ab36a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.529083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64caa0fe-5da5-4e0e-92d4-d33b4a0ab36a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.536255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64caa0fe-5da5-4e0e-92d4-d33b4a0ab36a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.636829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-64caa0fe-5da5-4e0e-92d4-d33b4a0ab36a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lazy-loading 'flavor' on Instance uuid ac47ff84-f717-4754-8d77-f04484dc86e1 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:31:03.742665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1579649187", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": "none"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:03.873585 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-64caa0fe-5da5-4e0e-92d4-d33b4a0ab36a tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "POST /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1/action" status: 200 len: 32 microversion: 2.1 time: 0.399033 Jul 20 04:31:03.877609 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2136/4303] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:31:03 2022] POST /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:31:03.891867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0280a579-667a-475f-b4d5-9f39e9e894c4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:03.893354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0280a579-667a-475f-b4d5-9f39e9e894c4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:03.908363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0280a579-667a-475f-b4d5-9f39e9e894c4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.911295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0280a579-667a-475f-b4d5-9f39e9e894c4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.912482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0280a579-667a-475f-b4d5-9f39e9e894c4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.915409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0280a579-667a-475f-b4d5-9f39e9e894c4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.233380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0280a579-667a-475f-b4d5-9f39e9e894c4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:04.248620 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0280a579-667a-475f-b4d5-9f39e9e894c4 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.362548 Jul 20 04:31:04.249773 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2137/4304] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:03 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:05.266313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4be04ade-5bc4-4f8c-a7d1-c3ade80f749c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:05.267001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4be04ade-5bc4-4f8c-a7d1-c3ade80f749c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:05.304809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4be04ade-5bc4-4f8c-a7d1-c3ade80f749c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.305847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4be04ade-5bc4-4f8c-a7d1-c3ade80f749c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.309620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4be04ade-5bc4-4f8c-a7d1-c3ade80f749c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.315153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4be04ade-5bc4-4f8c-a7d1-c3ade80f749c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.748676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4be04ade-5bc4-4f8c-a7d1-c3ade80f749c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:05.768662 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4be04ade-5bc4-4f8c-a7d1-c3ade80f749c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.504012 Jul 20 04:31:05.785346 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2138/4305] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:05 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:06.789053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-44ceee90-50d9-47f3-8d98-b62a98fb3dd0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:06.789672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-44ceee90-50d9-47f3-8d98-b62a98fb3dd0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:06.808674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44ceee90-50d9-47f3-8d98-b62a98fb3dd0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:06.811594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44ceee90-50d9-47f3-8d98-b62a98fb3dd0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:06.814336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44ceee90-50d9-47f3-8d98-b62a98fb3dd0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:06.815835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44ceee90-50d9-47f3-8d98-b62a98fb3dd0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:07.570242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-44ceee90-50d9-47f3-8d98-b62a98fb3dd0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:07.584995 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-44ceee90-50d9-47f3-8d98-b62a98fb3dd0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.799890 Jul 20 04:31:07.585514 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2139/4306] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:06 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:08.690542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6ce5460c-5afa-47ae-9b00-1f5b4da60f12 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'create', calling method: .version_select at 0x7fb841e45280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2083771904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBscASspq0TH2adrzJIW1mr353fhSeSJwcUigwZB2l3vDaRpwdND4YiiaaH0ZogORAnewYqJLJzbcTbnHdi3VMAfnPCiZYeFaqAGPXfHesIa/8s875l3XAw+VCgFL/NNGg=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:08.695570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=42 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:08.739537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-6ce5460c-5afa-47ae-9b00-1f5b4da60f12 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:08.766009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-6ce5460c-5afa-47ae-9b00-1f5b4da60f12 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for user 8f84ec28420a4cdcb88920cd86ce0160 and project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:08.834571 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6ce5460c-5afa-47ae-9b00-1f5b4da60f12 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.824269 Jul 20 04:31:08.835253 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2140/4307] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:31:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:08.856396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f8b9bbb7-d826-4c70-8f17-80e3f1830dbc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:08.857021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f8b9bbb7-d826-4c70-8f17-80e3f1830dbc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:08.877000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8b9bbb7-d826-4c70-8f17-80e3f1830dbc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:08.877466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8b9bbb7-d826-4c70-8f17-80e3f1830dbc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:08.881359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8b9bbb7-d826-4c70-8f17-80e3f1830dbc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:08.882148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8b9bbb7-d826-4c70-8f17-80e3f1830dbc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:08.887676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:09.508118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f8b9bbb7-d826-4c70-8f17-80e3f1830dbc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:09.529046 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f8b9bbb7-d826-4c70-8f17-80e3f1830dbc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.678748 Jul 20 04:31:09.529836 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2141/4308] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:08 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:10.551533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b827811b-b79d-4c0c-8faf-b6af2c9b1ec0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:10.552943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b827811b-b79d-4c0c-8faf-b6af2c9b1ec0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:10.569277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b827811b-b79d-4c0c-8faf-b6af2c9b1ec0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.573223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b827811b-b79d-4c0c-8faf-b6af2c9b1ec0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.579940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b827811b-b79d-4c0c-8faf-b6af2c9b1ec0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.580669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b827811b-b79d-4c0c-8faf-b6af2c9b1ec0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.972197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b827811b-b79d-4c0c-8faf-b6af2c9b1ec0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:10.991904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b827811b-b79d-4c0c-8faf-b6af2c9b1ec0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.448021 Jul 20 04:31:10.995964 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2142/4309] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:10 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:11.765768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:12.015136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d7ae765-dadf-4491-8518-27627539b540 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:12.015843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7d7ae765-dadf-4491-8518-27627539b540 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:12.044483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d7ae765-dadf-4491-8518-27627539b540 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.050381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d7ae765-dadf-4491-8518-27627539b540 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.059160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d7ae765-dadf-4491-8518-27627539b540 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.059643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d7ae765-dadf-4491-8518-27627539b540 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.806941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7d7ae765-dadf-4491-8518-27627539b540 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:12.823275 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7d7ae765-dadf-4491-8518-27627539b540 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.813171 Jul 20 04:31:12.824965 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2143/4310] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:12 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:13.762895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:13.842377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7944d5c9-d3ef-440e-ab68-946eb70c7906 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:13.843153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7944d5c9-d3ef-440e-ab68-946eb70c7906 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:13.865998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7944d5c9-d3ef-440e-ab68-946eb70c7906 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.870946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7944d5c9-d3ef-440e-ab68-946eb70c7906 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.874338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7944d5c9-d3ef-440e-ab68-946eb70c7906 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:13.875306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7944d5c9-d3ef-440e-ab68-946eb70c7906 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:15.572807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7944d5c9-d3ef-440e-ab68-946eb70c7906 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:15.591175 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7944d5c9-d3ef-440e-ab68-946eb70c7906 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 1.753551 Jul 20 04:31:15.592563 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2144/4311] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:13 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:16.665539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-98cbd324-dafa-4c4a-ac2e-08454b09f968 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:16.666998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-98cbd324-dafa-4c4a-ac2e-08454b09f968 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:16.686815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98cbd324-dafa-4c4a-ac2e-08454b09f968 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.687947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98cbd324-dafa-4c4a-ac2e-08454b09f968 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.689512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98cbd324-dafa-4c4a-ac2e-08454b09f968 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.693157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98cbd324-dafa-4c4a-ac2e-08454b09f968 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.342141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-98cbd324-dafa-4c4a-ac2e-08454b09f968 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:17.352803 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-98cbd324-dafa-4c4a-ac2e-08454b09f968 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.746879 Jul 20 04:31:17.369924 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2145/4312] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:16 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:18.374759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43edb674-e956-4f10-aab6-2de73b462c51 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:18.375656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43edb674-e956-4f10-aab6-2de73b462c51 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:18.401978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43edb674-e956-4f10-aab6-2de73b462c51 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.412724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43edb674-e956-4f10-aab6-2de73b462c51 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.413952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43edb674-e956-4f10-aab6-2de73b462c51 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.417095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43edb674-e956-4f10-aab6-2de73b462c51 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.655176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:18.655639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:18.656083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:18.656503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:18.656924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:18.668517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.669919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.671075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.672048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.699967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Getting quotas for project f196321e90284d19aca0426ba9e97a2c. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:18.707189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Getting quotas for user 11686826b5904fd6a8ad081354022c4d and project f196321e90284d19aca0426ba9e97a2c. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:18.729197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:18.732616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:18.777867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:18.915505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-43edb674-e956-4f10-aab6-2de73b462c51 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:18.925837 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43edb674-e956-4f10-aab6-2de73b462c51 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.560027 Jul 20 04:31:18.950213 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2146/4313] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:18 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:18.957913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-031309ff-910a-441a-b9ae-bfada2be0146 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:18.965874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-031309ff-910a-441a-b9ae-bfada2be0146 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:18.967955 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8966297e-3a5f-4c06-95d9-2e07b35b6451 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 15.643975 Jul 20 04:31:18.974611 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2168/4314] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:31:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 15651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 04:31:19.002651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83f62c53-8a9a-41f4-9c27-b8ba6b4b8804 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:19.003252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-83f62c53-8a9a-41f4-9c27-b8ba6b4b8804 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:19.014286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-031309ff-910a-441a-b9ae-bfada2be0146 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.019014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-031309ff-910a-441a-b9ae-bfada2be0146 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.021683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-031309ff-910a-441a-b9ae-bfada2be0146 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.022150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-031309ff-910a-441a-b9ae-bfada2be0146 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.435080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-83f62c53-8a9a-41f4-9c27-b8ba6b4b8804 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:19.462894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-83f62c53-8a9a-41f4-9c27-b8ba6b4b8804 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:19.468488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-83f62c53-8a9a-41f4-9c27-b8ba6b4b8804 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:19.469977 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-83f62c53-8a9a-41f4-9c27-b8ba6b4b8804 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1278 microversion: 2.57 time: 0.478802 Jul 20 04:31:19.487730 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2169/4315] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:18 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1278 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:19.656060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-031309ff-910a-441a-b9ae-bfada2be0146 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:19.669804 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-031309ff-910a-441a-b9ae-bfada2be0146 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 0.718038 Jul 20 04:31:19.679371 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2147/4316] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:18 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:19.954435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3135e5f0-ff93-4396-9243-6f4d5721d65e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:19.955159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3135e5f0-ff93-4396-9243-6f4d5721d65e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:19.980610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3135e5f0-ff93-4396-9243-6f4d5721d65e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.981453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3135e5f0-ff93-4396-9243-6f4d5721d65e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.982549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3135e5f0-ff93-4396-9243-6f4d5721d65e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.985022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3135e5f0-ff93-4396-9243-6f4d5721d65e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.497013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fbce0cc2-31f7-4e8f-87a0-f52a9172e92a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:20.497946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fbce0cc2-31f7-4e8f-87a0-f52a9172e92a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:20.516018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fbce0cc2-31f7-4e8f-87a0-f52a9172e92a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.516808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fbce0cc2-31f7-4e8f-87a0-f52a9172e92a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.520709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fbce0cc2-31f7-4e8f-87a0-f52a9172e92a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.521560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fbce0cc2-31f7-4e8f-87a0-f52a9172e92a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.776762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fbce0cc2-31f7-4e8f-87a0-f52a9172e92a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:20.794098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fbce0cc2-31f7-4e8f-87a0-f52a9172e92a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:20.798185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fbce0cc2-31f7-4e8f-87a0-f52a9172e92a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:20.801485 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fbce0cc2-31f7-4e8f-87a0-f52a9172e92a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1274 microversion: 2.57 time: 0.312134 Jul 20 04:31:20.804262 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2148/4317] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:20 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1274 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:20.817671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e7092093-fcae-43e3-9d9b-2dc967395700 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:20.818597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e7092093-fcae-43e3-9d9b-2dc967395700 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:20.837758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7092093-fcae-43e3-9d9b-2dc967395700 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.838437 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7092093-fcae-43e3-9d9b-2dc967395700 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.839419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7092093-fcae-43e3-9d9b-2dc967395700 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.839879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7092093-fcae-43e3-9d9b-2dc967395700 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.768287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3135e5f0-ff93-4396-9243-6f4d5721d65e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:21.779130 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3135e5f0-ff93-4396-9243-6f4d5721d65e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 1.830020 Jul 20 04:31:21.789593 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2170/4318] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:19 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:21.805869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7092093-fcae-43e3-9d9b-2dc967395700 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:21.820154 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e7092093-fcae-43e3-9d9b-2dc967395700 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 1.006656 Jul 20 04:31:21.821333 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2149/4319] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:20 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:21.836385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e0414efd-8ee9-44d6-844a-bf783b116f69 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:21.838419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e0414efd-8ee9-44d6-844a-bf783b116f69 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:21.845851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2f25bba9-2536-4bcb-82d8-ec3d4af0518f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1544558345"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:21.847121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2f25bba9-2536-4bcb-82d8-ec3d4af0518f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:21.851542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0414efd-8ee9-44d6-844a-bf783b116f69 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.854944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0414efd-8ee9-44d6-844a-bf783b116f69 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.856073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0414efd-8ee9-44d6-844a-bf783b116f69 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.860106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e0414efd-8ee9-44d6-844a-bf783b116f69 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.872823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f25bba9-2536-4bcb-82d8-ec3d4af0518f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.873322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f25bba9-2536-4bcb-82d8-ec3d4af0518f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.874133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f25bba9-2536-4bcb-82d8-ec3d4af0518f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.874633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f25bba9-2536-4bcb-82d8-ec3d4af0518f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.142383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e0414efd-8ee9-44d6-844a-bf783b116f69 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:22.163070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e0414efd-8ee9-44d6-844a-bf783b116f69 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:22.176460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e0414efd-8ee9-44d6-844a-bf783b116f69 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:22.177866 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e0414efd-8ee9-44d6-844a-bf783b116f69 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1336 microversion: 2.57 time: 0.359286 Jul 20 04:31:22.184979 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2171/4320] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:21 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1336 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:22.808608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c83cd27-b3e3-457c-bf4a-cb7cfa5464ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.809337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0c83cd27-b3e3-457c-bf4a-cb7cfa5464ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.843376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c83cd27-b3e3-457c-bf4a-cb7cfa5464ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.845174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c83cd27-b3e3-457c-bf4a-cb7cfa5464ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.846323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c83cd27-b3e3-457c-bf4a-cb7cfa5464ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.846954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c83cd27-b3e3-457c-bf4a-cb7cfa5464ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:23.214163 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2f25bba9-2536-4bcb-82d8-ec3d4af0518f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 1.379694 Jul 20 04:31:23.224303 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2150/4321] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:31:21 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 20 04:31:23.286558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-948387c0-a86a-4371-8e4b-ec4517f6b522 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:23.296463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-948387c0-a86a-4371-8e4b-ec4517f6b522 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:23.335324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-948387c0-a86a-4371-8e4b-ec4517f6b522 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:23.341101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-948387c0-a86a-4371-8e4b-ec4517f6b522 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:23.350912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-948387c0-a86a-4371-8e4b-ec4517f6b522 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:23.353882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-948387c0-a86a-4371-8e4b-ec4517f6b522 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:23.997001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-948387c0-a86a-4371-8e4b-ec4517f6b522 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:24.014145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-948387c0-a86a-4371-8e4b-ec4517f6b522 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:24.017881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-948387c0-a86a-4371-8e4b-ec4517f6b522 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:24.029693 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-948387c0-a86a-4371-8e4b-ec4517f6b522 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1336 microversion: 2.57 time: 0.793747 Jul 20 04:31:24.034667 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2151/4322] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:23 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1336 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:24.055137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-0b496a43-6d6f-415c-b2b0-1f38df5e5dad req-8b955548-01cf-4947-bbb0-b4e7ac6539f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b78332-e314-4da3-8a21-1ccfa545f11a", "name": "network-vif-unplugged", "status": "completed", "tag": "8c4c6b64-e711-449a-a899-27913ed07df2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:24.078515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-0b496a43-6d6f-415c-b2b0-1f38df5e5dad req-8b955548-01cf-4947-bbb0-b4e7ac6539f9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.079285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-0b496a43-6d6f-415c-b2b0-1f38df5e5dad req-8b955548-01cf-4947-bbb0-b4e7ac6539f9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.112362 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-0b496a43-6d6f-415c-b2b0-1f38df5e5dad req-8b955548-01cf-4947-bbb0-b4e7ac6539f9 service nova] Creating event network-vif-unplugged:8c4c6b64-e711-449a-a899-27913ed07df2 for instance 44b78332-e314-4da3-8a21-1ccfa545f11a on n-h2-760456-11 Jul 20 04:31:24.121697 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-0b496a43-6d6f-415c-b2b0-1f38df5e5dad req-8b955548-01cf-4947-bbb0-b4e7ac6539f9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085463 Jul 20 04:31:24.132266 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2152/4323] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:24.159390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0c83cd27-b3e3-457c-bf4a-cb7cfa5464ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:24.187262 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0c83cd27-b3e3-457c-bf4a-cb7cfa5464ba tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 1.380264 Jul 20 04:31:24.192830 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2172/4324] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:22 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:24.808248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-298912265", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:24.900263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:25.051049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d65c505f-fac1-4c5e-9605-71bbd852ad20 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:25.052124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d65c505f-fac1-4c5e-9605-71bbd852ad20 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:25.065146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d65c505f-fac1-4c5e-9605-71bbd852ad20 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.067009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d65c505f-fac1-4c5e-9605-71bbd852ad20 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.069665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d65c505f-fac1-4c5e-9605-71bbd852ad20 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.070946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d65c505f-fac1-4c5e-9605-71bbd852ad20 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.253943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d65c505f-fac1-4c5e-9605-71bbd852ad20 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:25.279671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d65c505f-fac1-4c5e-9605-71bbd852ad20 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:25.285490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d65c505f-fac1-4c5e-9605-71bbd852ad20 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:25.288730 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d65c505f-fac1-4c5e-9605-71bbd852ad20 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1357 microversion: 2.57 time: 0.242591 Jul 20 04:31:25.289954 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2173/4325] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:25 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:25.296244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-14f7567c-7ee8-49ea-bbf6-aa4a68d83917 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:25.297713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-14f7567c-7ee8-49ea-bbf6-aa4a68d83917 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:25.317264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14f7567c-7ee8-49ea-bbf6-aa4a68d83917 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.318204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14f7567c-7ee8-49ea-bbf6-aa4a68d83917 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.319274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14f7567c-7ee8-49ea-bbf6-aa4a68d83917 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.319906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14f7567c-7ee8-49ea-bbf6-aa4a68d83917 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.130138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-14f7567c-7ee8-49ea-bbf6-aa4a68d83917 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:26.147336 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-14f7567c-7ee8-49ea-bbf6-aa4a68d83917 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.855530 Jul 20 04:31:26.162507 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2174/4326] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:25 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:26.196565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:26.198554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:26.240926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.247714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.254337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.265415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.292893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:26.293491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:26.293798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:26.294559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:26.295175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:26.359722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.360194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.361035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.377375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.470053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Getting quotas for project 6daa9e3aedc34be499667381884f27e8. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:26.495296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Getting quotas for user b75f138079e843ceabc43c0c00347361 and project 6daa9e3aedc34be499667381884f27e8. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:26.557465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:26.571921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:26.621029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:26.628484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:26.630537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:26.634797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:26.635521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:26.744327 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d513d257-8525-41ab-aec6-a080709bbc99 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.940393 Jul 20 04:31:26.761177 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2153/4327] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:31:26.808724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d6ce6042-80c4-407b-b5cd-c4d58ac166bc tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:26.814781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d6ce6042-80c4-407b-b5cd-c4d58ac166bc tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:26.885397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:26.904742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.905579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.933318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.933318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.060406 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-116742b9-1384-46fe-b6b4-bc809d1d7c82 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "POST /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b/action" status: 202 len: 1138 microversion: 2.57 time: 0.883380 Jul 20 04:31:27.066205 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2175/4328] 10.222.0.59 () {62 vars in 1319 bytes} [Wed Jul 20 04:31:26 2022] POST /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b/action => generated 1138 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:31:27.090964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e9da9eb-b124-4085-af0b-c2e8239daeeb tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:27.091867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e9da9eb-b124-4085-af0b-c2e8239daeeb tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:27.131043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e9da9eb-b124-4085-af0b-c2e8239daeeb tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.131522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e9da9eb-b124-4085-af0b-c2e8239daeeb tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.132335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e9da9eb-b124-4085-af0b-c2e8239daeeb tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.132789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e9da9eb-b124-4085-af0b-c2e8239daeeb tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.153058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d6ce6042-80c4-407b-b5cd-c4d58ac166bc tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:27.171602 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d6ce6042-80c4-407b-b5cd-c4d58ac166bc tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1213 microversion: 2.1 time: 0.405915 Jul 20 04:31:27.176928 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2154/4329] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:26 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1213 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:27.220957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a32f6da1-b3a3-4807-8932-0b47ddc6973f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:27.224792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a32f6da1-b3a3-4807-8932-0b47ddc6973f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:27.262207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a32f6da1-b3a3-4807-8932-0b47ddc6973f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.265250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a32f6da1-b3a3-4807-8932-0b47ddc6973f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.269607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a32f6da1-b3a3-4807-8932-0b47ddc6973f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.270599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a32f6da1-b3a3-4807-8932-0b47ddc6973f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.512578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e9da9eb-b124-4085-af0b-c2e8239daeeb tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:27.525683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e9da9eb-b124-4085-af0b-c2e8239daeeb tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:27.543823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e9da9eb-b124-4085-af0b-c2e8239daeeb tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:27.560128 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e9da9eb-b124-4085-af0b-c2e8239daeeb tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.478627 Jul 20 04:31:27.563454 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2176/4330] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:27 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:28.196312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-53a59f60-7cef-4c6d-801f-575d630427b2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:28.197447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-53a59f60-7cef-4c6d-801f-575d630427b2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:28.310130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a32f6da1-b3a3-4807-8932-0b47ddc6973f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:28.332328 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a32f6da1-b3a3-4807-8932-0b47ddc6973f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 1.129871 Jul 20 04:31:28.332945 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2155/4331] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:27 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:28.416981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-53a59f60-7cef-4c6d-801f-575d630427b2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:28.424211 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-53a59f60-7cef-4c6d-801f-575d630427b2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1213 microversion: 2.1 time: 0.232468 Jul 20 04:31:28.424825 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2177/4332] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:28 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1213 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:28.584431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fca92785-b323-45f0-b7f2-60dba24f0a6b tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:28.585559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fca92785-b323-45f0-b7f2-60dba24f0a6b tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:28.606326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fca92785-b323-45f0-b7f2-60dba24f0a6b tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.607256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fca92785-b323-45f0-b7f2-60dba24f0a6b tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:28.608342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fca92785-b323-45f0-b7f2-60dba24f0a6b tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.611331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fca92785-b323-45f0-b7f2-60dba24f0a6b tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:28.831579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fca92785-b323-45f0-b7f2-60dba24f0a6b tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:28.845425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fca92785-b323-45f0-b7f2-60dba24f0a6b tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:28.853722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fca92785-b323-45f0-b7f2-60dba24f0a6b tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:28.855159 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fca92785-b323-45f0-b7f2-60dba24f0a6b tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.275397 Jul 20 04:31:28.855751 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2156/4333] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:28 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:29.350825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b6d17a51-1868-440a-a1e6-55196ca230c5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:29.352818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b6d17a51-1868-440a-a1e6-55196ca230c5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:29.356590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:29.384587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6d17a51-1868-440a-a1e6-55196ca230c5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.385364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6d17a51-1868-440a-a1e6-55196ca230c5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.394856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6d17a51-1868-440a-a1e6-55196ca230c5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.397543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6d17a51-1868-440a-a1e6-55196ca230c5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.442114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-273f4ee3-4ce6-4d66-8e59-73b8f65301b4 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:29.442753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-273f4ee3-4ce6-4d66-8e59-73b8f65301b4 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:29.469083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-273f4ee3-4ce6-4d66-8e59-73b8f65301b4 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.473486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-273f4ee3-4ce6-4d66-8e59-73b8f65301b4 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.476322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-273f4ee3-4ce6-4d66-8e59-73b8f65301b4 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.481638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-273f4ee3-4ce6-4d66-8e59-73b8f65301b4 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.668228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-273f4ee3-4ce6-4d66-8e59-73b8f65301b4 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:29.677547 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-273f4ee3-4ce6-4d66-8e59-73b8f65301b4 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1283 microversion: 2.1 time: 0.240361 Jul 20 04:31:29.686704 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2157/4334] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:29 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1283 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:29.874979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-53ef82e2-0460-4d79-a942-1e212049301e tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:29.875815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-53ef82e2-0460-4d79-a942-1e212049301e tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:29.895087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53ef82e2-0460-4d79-a942-1e212049301e tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.907696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53ef82e2-0460-4d79-a942-1e212049301e tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:29.910688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53ef82e2-0460-4d79-a942-1e212049301e tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:29.919604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53ef82e2-0460-4d79-a942-1e212049301e tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.100007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-53ef82e2-0460-4d79-a942-1e212049301e tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:30.103173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:30.115675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-53ef82e2-0460-4d79-a942-1e212049301e tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:30.118385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-53ef82e2-0460-4d79-a942-1e212049301e tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:30.126210 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-53ef82e2-0460-4d79-a942-1e212049301e tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.254711 Jul 20 04:31:30.127143 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2158/4335] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:29 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:30.695237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b6033c3-712c-49d5-8eb1-08a97f68d576 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:30.696623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9b6033c3-712c-49d5-8eb1-08a97f68d576 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:30.749280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b6033c3-712c-49d5-8eb1-08a97f68d576 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.760281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b6033c3-712c-49d5-8eb1-08a97f68d576 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.763524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b6033c3-712c-49d5-8eb1-08a97f68d576 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.764787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b6033c3-712c-49d5-8eb1-08a97f68d576 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.978297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b6033c3-712c-49d5-8eb1-08a97f68d576 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:30.989708 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9b6033c3-712c-49d5-8eb1-08a97f68d576 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1271 microversion: 2.1 time: 0.298367 Jul 20 04:31:30.996513 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2159/4336] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:30 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1271 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:31.156550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c0a5273-683a-4b1f-beac-b0785e082af0 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:31.161559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c0a5273-683a-4b1f-beac-b0785e082af0 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:31.174812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0a5273-683a-4b1f-beac-b0785e082af0 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.175564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0a5273-683a-4b1f-beac-b0785e082af0 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.177233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0a5273-683a-4b1f-beac-b0785e082af0 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.179356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0a5273-683a-4b1f-beac-b0785e082af0 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.368124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c0a5273-683a-4b1f-beac-b0785e082af0 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:31.385425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c0a5273-683a-4b1f-beac-b0785e082af0 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:31.387410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c0a5273-683a-4b1f-beac-b0785e082af0 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:31.389188 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c0a5273-683a-4b1f-beac-b0785e082af0 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.242290 Jul 20 04:31:31.390337 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2160/4337] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:31 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:31.428592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c668799c-ec51-4a50-abe6-2397c58f635e req-bcba9416-3093-4a31-8784-8d9421b61a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b78332-e314-4da3-8a21-1ccfa545f11a", "name": "network-vif-plugged", "status": "completed", "tag": "8c4c6b64-e711-449a-a899-27913ed07df2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:31.454200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c668799c-ec51-4a50-abe6-2397c58f635e req-bcba9416-3093-4a31-8784-8d9421b61a84 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.456005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c668799c-ec51-4a50-abe6-2397c58f635e req-bcba9416-3093-4a31-8784-8d9421b61a84 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.486503 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c668799c-ec51-4a50-abe6-2397c58f635e req-bcba9416-3093-4a31-8784-8d9421b61a84 service nova] Creating event network-vif-plugged:8c4c6b64-e711-449a-a899-27913ed07df2 for instance 44b78332-e314-4da3-8a21-1ccfa545f11a on n-h2-760456-11 Jul 20 04:31:31.496725 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c668799c-ec51-4a50-abe6-2397c58f635e req-bcba9416-3093-4a31-8784-8d9421b61a84 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073745 Jul 20 04:31:31.500660 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2161/4338] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:32.014242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-83bdd0cf-33ce-49e3-b581-a78419344526 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:32.014976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-83bdd0cf-33ce-49e3-b581-a78419344526 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:32.039445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83bdd0cf-33ce-49e3-b581-a78419344526 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.042202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83bdd0cf-33ce-49e3-b581-a78419344526 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.043616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83bdd0cf-33ce-49e3-b581-a78419344526 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.045378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83bdd0cf-33ce-49e3-b581-a78419344526 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.272855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-83bdd0cf-33ce-49e3-b581-a78419344526 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:32.283395 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-83bdd0cf-33ce-49e3-b581-a78419344526 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1271 microversion: 2.1 time: 0.276067 Jul 20 04:31:32.284921 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2162/4339] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:32 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:32.409772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b14c5070-c78f-445e-8a45-29cb4f111972 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:32.411138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b14c5070-c78f-445e-8a45-29cb4f111972 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:32.425675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b14c5070-c78f-445e-8a45-29cb4f111972 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.427700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b14c5070-c78f-445e-8a45-29cb4f111972 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.434073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b14c5070-c78f-445e-8a45-29cb4f111972 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.435271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b14c5070-c78f-445e-8a45-29cb4f111972 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.656971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b14c5070-c78f-445e-8a45-29cb4f111972 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:32.674833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b14c5070-c78f-445e-8a45-29cb4f111972 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:32.677049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b14c5070-c78f-445e-8a45-29cb4f111972 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:32.678374 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b14c5070-c78f-445e-8a45-29cb4f111972 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.273540 Jul 20 04:31:32.678944 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2163/4340] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:32 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:32.716535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b6d17a51-1868-440a-a1e6-55196ca230c5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:32.730811 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b6d17a51-1868-440a-a1e6-55196ca230c5 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 3.380310 Jul 20 04:31:32.733254 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2178/4341] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:29 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 3388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:33.301522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e790f824-d9eb-4e5e-98f2-bffd99875d81 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:33.303156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e790f824-d9eb-4e5e-98f2-bffd99875d81 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:33.319360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e790f824-d9eb-4e5e-98f2-bffd99875d81 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.325667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e790f824-d9eb-4e5e-98f2-bffd99875d81 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.331690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e790f824-d9eb-4e5e-98f2-bffd99875d81 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.332677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e790f824-d9eb-4e5e-98f2-bffd99875d81 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.540015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e790f824-d9eb-4e5e-98f2-bffd99875d81 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:33.548636 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e790f824-d9eb-4e5e-98f2-bffd99875d81 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1271 microversion: 2.1 time: 0.251445 Jul 20 04:31:33.558152 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2164/4342] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:33 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:33.701494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8c5d67a1-5b5c-409e-a1c3-1aa45c5322f2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:33.702280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8c5d67a1-5b5c-409e-a1c3-1aa45c5322f2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:33.725671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c5d67a1-5b5c-409e-a1c3-1aa45c5322f2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.726326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c5d67a1-5b5c-409e-a1c3-1aa45c5322f2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.728537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c5d67a1-5b5c-409e-a1c3-1aa45c5322f2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.730107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c5d67a1-5b5c-409e-a1c3-1aa45c5322f2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.753931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c908e547-ca05-4dd8-853e-0a22dbc8f8ed tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:33.754593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c908e547-ca05-4dd8-853e-0a22dbc8f8ed tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:33.766963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c908e547-ca05-4dd8-853e-0a22dbc8f8ed tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.767150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c908e547-ca05-4dd8-853e-0a22dbc8f8ed tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.767880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c908e547-ca05-4dd8-853e-0a22dbc8f8ed tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.768327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c908e547-ca05-4dd8-853e-0a22dbc8f8ed tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.283451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c908e547-ca05-4dd8-853e-0a22dbc8f8ed tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.298887 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c908e547-ca05-4dd8-853e-0a22dbc8f8ed tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.548914 Jul 20 04:31:34.317805 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2165/4343] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:33 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:34.581483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f1cc70f-5bc9-4e10-b7dd-88ab18a7781f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:34.582128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f1cc70f-5bc9-4e10-b7dd-88ab18a7781f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:34.605918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f1cc70f-5bc9-4e10-b7dd-88ab18a7781f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.606929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f1cc70f-5bc9-4e10-b7dd-88ab18a7781f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.615378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f1cc70f-5bc9-4e10-b7dd-88ab18a7781f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.619261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f1cc70f-5bc9-4e10-b7dd-88ab18a7781f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.829920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f1cc70f-5bc9-4e10-b7dd-88ab18a7781f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.862938 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f1cc70f-5bc9-4e10-b7dd-88ab18a7781f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1271 microversion: 2.1 time: 0.300568 Jul 20 04:31:34.885684 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2166/4344] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:34 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1271 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:34.913316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c5d67a1-5b5c-409e-a1c3-1aa45c5322f2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.925443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c5d67a1-5b5c-409e-a1c3-1aa45c5322f2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.935882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c5d67a1-5b5c-409e-a1c3-1aa45c5322f2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.937439 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8c5d67a1-5b5c-409e-a1c3-1aa45c5322f2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 1.241757 Jul 20 04:31:34.938571 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2179/4345] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:33 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:35.325555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bfb4e797-4ae4-4fd3-ba20-92d485ecbab0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:35.330553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bfb4e797-4ae4-4fd3-ba20-92d485ecbab0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:35.340564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfb4e797-4ae4-4fd3-ba20-92d485ecbab0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.343439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfb4e797-4ae4-4fd3-ba20-92d485ecbab0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.344444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfb4e797-4ae4-4fd3-ba20-92d485ecbab0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.347855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfb4e797-4ae4-4fd3-ba20-92d485ecbab0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.458834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1372088727", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "4b2728c4-7c23-4cdd-b3ec-0de438e0a914"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2083771904", "security_groups": [{"name": "tempest-secgroup-smoke-258960731"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:35.741335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bfb4e797-4ae4-4fd3-ba20-92d485ecbab0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:35.751967 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bfb4e797-4ae4-4fd3-ba20-92d485ecbab0 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.433264 Jul 20 04:31:35.752568 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2167/4346] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:35 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:35.881498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0aded40-ef47-4259-b346-86b3822409fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:35.882610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0aded40-ef47-4259-b346-86b3822409fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:35.915793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0aded40-ef47-4259-b346-86b3822409fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.926120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0aded40-ef47-4259-b346-86b3822409fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.931749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0aded40-ef47-4259-b346-86b3822409fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.932809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0aded40-ef47-4259-b346-86b3822409fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.108191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c0aded40-ef47-4259-b346-86b3822409fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:36.120513 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0aded40-ef47-4259-b346-86b3822409fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1271 microversion: 2.1 time: 0.242989 Jul 20 04:31:36.121683 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2168/4347] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:35 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:36.126807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e0ed149-e3e5-4030-860f-f9fefc3ebb4d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:36.127613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e0ed149-e3e5-4030-860f-f9fefc3ebb4d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:36.136396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0ed149-e3e5-4030-860f-f9fefc3ebb4d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.137210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0ed149-e3e5-4030-860f-f9fefc3ebb4d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.138331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0ed149-e3e5-4030-860f-f9fefc3ebb4d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.145607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0ed149-e3e5-4030-860f-f9fefc3ebb4d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.388215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e0ed149-e3e5-4030-860f-f9fefc3ebb4d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:36.401065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e0ed149-e3e5-4030-860f-f9fefc3ebb4d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:36.402639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e0ed149-e3e5-4030-860f-f9fefc3ebb4d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:36.412347 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e0ed149-e3e5-4030-860f-f9fefc3ebb4d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.287994 Jul 20 04:31:36.415006 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2169/4348] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:36 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:36.770227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-05cae3a1-4c97-446e-99c0-2d870c6d3a6f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:36.772021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05cae3a1-4c97-446e-99c0-2d870c6d3a6f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:36.786834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:36.792187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05cae3a1-4c97-446e-99c0-2d870c6d3a6f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.794960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05cae3a1-4c97-446e-99c0-2d870c6d3a6f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.796052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05cae3a1-4c97-446e-99c0-2d870c6d3a6f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.798856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05cae3a1-4c97-446e-99c0-2d870c6d3a6f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.019139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05cae3a1-4c97-446e-99c0-2d870c6d3a6f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:37.048837 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-05cae3a1-4c97-446e-99c0-2d870c6d3a6f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1486 microversion: 2.1 time: 0.283359 Jul 20 04:31:37.049777 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2170/4349] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:36 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1486 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:37.066544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-86effa41-cf39-4e3a-9739-bdffcf7cf970 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:37.067459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-86effa41-cf39-4e3a-9739-bdffcf7cf970 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:37.076221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86effa41-cf39-4e3a-9739-bdffcf7cf970 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.077008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86effa41-cf39-4e3a-9739-bdffcf7cf970 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.079563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86effa41-cf39-4e3a-9739-bdffcf7cf970 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.080222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86effa41-cf39-4e3a-9739-bdffcf7cf970 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.159637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:37.231283 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-86effa41-cf39-4e3a-9739-bdffcf7cf970 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "POST /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1/action" status: 202 len: 0 microversion: 2.1 time: 0.168010 Jul 20 04:31:37.234916 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2171/4350] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:31:37 2022] POST /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:31:37.255856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bbcbb7e9-15b6-4947-a69b-754c531260a2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:37.256781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bbcbb7e9-15b6-4947-a69b-754c531260a2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:37.289688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbcbb7e9-15b6-4947-a69b-754c531260a2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.297247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbcbb7e9-15b6-4947-a69b-754c531260a2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.321306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbcbb7e9-15b6-4947-a69b-754c531260a2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.321420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbcbb7e9-15b6-4947-a69b-754c531260a2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.924193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bbcbb7e9-15b6-4947-a69b-754c531260a2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:37.932907 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bbcbb7e9-15b6-4947-a69b-754c531260a2 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1313 microversion: 2.1 time: 0.699867 Jul 20 04:31:37.939790 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2172/4351] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:37 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1313 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:37.944879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c63a9d39-5c1f-4fcb-9227-b9b18a64570e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:37.950782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c63a9d39-5c1f-4fcb-9227-b9b18a64570e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:37.968513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c63a9d39-5c1f-4fcb-9227-b9b18a64570e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.968977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c63a9d39-5c1f-4fcb-9227-b9b18a64570e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.969769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c63a9d39-5c1f-4fcb-9227-b9b18a64570e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.970335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c63a9d39-5c1f-4fcb-9227-b9b18a64570e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.366599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] validate_networks() for [('4b2728c4-7c23-4cdd-b3ec-0de438e0a914', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:38.424094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=10 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:38.482882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c63a9d39-5c1f-4fcb-9227-b9b18a64570e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.501905 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c63a9d39-5c1f-4fcb-9227-b9b18a64570e tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1494 microversion: 2.1 time: 0.559910 Jul 20 04:31:38.506493 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2173/4352] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:37 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1494 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:38.522957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fc10fc2-dd33-4167-9be6-db60ab584696 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:38.528142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1fc10fc2-dd33-4167-9be6-db60ab584696 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:38.551452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fc10fc2-dd33-4167-9be6-db60ab584696 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.555897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fc10fc2-dd33-4167-9be6-db60ab584696 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.556840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fc10fc2-dd33-4167-9be6-db60ab584696 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.557309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1fc10fc2-dd33-4167-9be6-db60ab584696 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.872221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1fc10fc2-dd33-4167-9be6-db60ab584696 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.889319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1fc10fc2-dd33-4167-9be6-db60ab584696 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.895178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1fc10fc2-dd33-4167-9be6-db60ab584696 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.896478 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1fc10fc2-dd33-4167-9be6-db60ab584696 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.388950 Jul 20 04:31:38.900906 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2174/4353] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:38 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:38.963815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-52b74151-9df7-4a1e-8ca9-4a5b74b1f703 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:38.964481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-52b74151-9df7-4a1e-8ca9-4a5b74b1f703 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:38.967605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:38.985459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52b74151-9df7-4a1e-8ca9-4a5b74b1f703 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.986282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52b74151-9df7-4a1e-8ca9-4a5b74b1f703 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.987296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52b74151-9df7-4a1e-8ca9-4a5b74b1f703 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.988096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52b74151-9df7-4a1e-8ca9-4a5b74b1f703 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.057955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:39.471760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-52b74151-9df7-4a1e-8ca9-4a5b74b1f703 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:39.483212 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-52b74151-9df7-4a1e-8ca9-4a5b74b1f703 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1313 microversion: 2.1 time: 0.530115 Jul 20 04:31:39.484552 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2175/4354] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:38 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:39.538450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40972808-9bde-459d-bb62-45c68075ed67 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:39.541013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40972808-9bde-459d-bb62-45c68075ed67 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:39.561173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40972808-9bde-459d-bb62-45c68075ed67 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.561861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40972808-9bde-459d-bb62-45c68075ed67 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.563689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40972808-9bde-459d-bb62-45c68075ed67 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.564496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40972808-9bde-459d-bb62-45c68075ed67 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.999646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-40972808-9bde-459d-bb62-45c68075ed67 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:40.012387 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40972808-9bde-459d-bb62-45c68075ed67 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1494 microversion: 2.1 time: 0.495162 Jul 20 04:31:40.024363 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2176/4355] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:39 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1494 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:40.026528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3ca65b6e-7bd6-4ce5-ba0d-b3a09beb4458 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:40.027284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3ca65b6e-7bd6-4ce5-ba0d-b3a09beb4458 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:40.043759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ca65b6e-7bd6-4ce5-ba0d-b3a09beb4458 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.046617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ca65b6e-7bd6-4ce5-ba0d-b3a09beb4458 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.047709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ca65b6e-7bd6-4ce5-ba0d-b3a09beb4458 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.050209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ca65b6e-7bd6-4ce5-ba0d-b3a09beb4458 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.199152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3ca65b6e-7bd6-4ce5-ba0d-b3a09beb4458 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:40.212962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3ca65b6e-7bd6-4ce5-ba0d-b3a09beb4458 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:40.221825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3ca65b6e-7bd6-4ce5-ba0d-b3a09beb4458 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:40.223364 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3ca65b6e-7bd6-4ce5-ba0d-b3a09beb4458 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.206324 Jul 20 04:31:40.224771 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2177/4356] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:40 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:40.501891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4e550b37-c239-4227-b9d2-a3429942228e tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:40.502722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4e550b37-c239-4227-b9d2-a3429942228e tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:40.531270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e550b37-c239-4227-b9d2-a3429942228e tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.532061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e550b37-c239-4227-b9d2-a3429942228e tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.536576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e550b37-c239-4227-b9d2-a3429942228e tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.540154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e550b37-c239-4227-b9d2-a3429942228e tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.008331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:41.008968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:41.009322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:41.009738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:41.010165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:41.043809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.044411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.045302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.045748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.135957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:41.144591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for user 8f84ec28420a4cdcb88920cd86ce0160 and project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:41.199960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:41.202094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:41.338237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4e550b37-c239-4227-b9d2-a3429942228e tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.361631 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4e550b37-c239-4227-b9d2-a3429942228e tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1313 microversion: 2.1 time: 0.849625 Jul 20 04:31:41.364405 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2178/4357] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:40 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1313 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:41.381914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d32b0e7-4a70-4cdc-800b-0e81c963d290 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.383107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d32b0e7-4a70-4cdc-800b-0e81c963d290 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:41.392206 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0fbaa6f9-8649-4083-83cc-6fb84d822f69 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.939152 Jul 20 04:31:41.407172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d32b0e7-4a70-4cdc-800b-0e81c963d290 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.409344 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2180/4358] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 5957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:31:41.426797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d32b0e7-4a70-4cdc-800b-0e81c963d290 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.427649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d32b0e7-4a70-4cdc-800b-0e81c963d290 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.427974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a7672cb-9f70-485c-96e0-d3380eb33e29 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.428166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d32b0e7-4a70-4cdc-800b-0e81c963d290 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.434801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5a7672cb-9f70-485c-96e0-d3380eb33e29 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:41.478985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a7672cb-9f70-485c-96e0-d3380eb33e29 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.481064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a7672cb-9f70-485c-96e0-d3380eb33e29 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.483226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a7672cb-9f70-485c-96e0-d3380eb33e29 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.485231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a7672cb-9f70-485c-96e0-d3380eb33e29 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.859344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a7672cb-9f70-485c-96e0-d3380eb33e29 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.862303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:41.883204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a7672cb-9f70-485c-96e0-d3380eb33e29 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.889931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a7672cb-9f70-485c-96e0-d3380eb33e29 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.899414 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5a7672cb-9f70-485c-96e0-d3380eb33e29 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.488349 Jul 20 04:31:41.922886 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2181/4359] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:41 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:41.928915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b1c37091-1020-41da-9e85-f09c15913d6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.930997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b1c37091-1020-41da-9e85-f09c15913d6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:42.225200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d32b0e7-4a70-4cdc-800b-0e81c963d290 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:42.232861 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d32b0e7-4a70-4cdc-800b-0e81c963d290 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1494 microversion: 2.1 time: 0.867172 Jul 20 04:31:42.247573 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2179/4360] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:41 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1494 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:42.256248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b1c37091-1020-41da-9e85-f09c15913d6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:42.259390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-73383ba2-899a-4496-8b9f-6bf98577388a req-6cab0a9d-34c7-4ec3-8446-a9ee8b6c5034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceef6679-563f-406f-9dfd-c4b216eb0b04", "tag": "c7dc9466-5672-4a11-a1c1-a9acee91187d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:42.275939 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b1c37091-1020-41da-9e85-f09c15913d6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1267 microversion: 2.1 time: 0.351479 Jul 20 04:31:42.276497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-73383ba2-899a-4496-8b9f-6bf98577388a req-6cab0a9d-34c7-4ec3-8446-a9ee8b6c5034 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.276943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-73383ba2-899a-4496-8b9f-6bf98577388a req-6cab0a9d-34c7-4ec3-8446-a9ee8b6c5034 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.286287 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2182/4361] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:41 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1267 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:42.319258 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-73383ba2-899a-4496-8b9f-6bf98577388a req-6cab0a9d-34c7-4ec3-8446-a9ee8b6c5034 service nova] Creating event network-changed:c7dc9466-5672-4a11-a1c1-a9acee91187d for instance ceef6679-563f-406f-9dfd-c4b216eb0b04 on n-h1-760456-11 Jul 20 04:31:42.342041 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-73383ba2-899a-4496-8b9f-6bf98577388a req-6cab0a9d-34c7-4ec3-8446-a9ee8b6c5034 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093089 Jul 20 04:31:42.354065 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2180/4362] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:42.380252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bd605b94-9483-409b-9832-3196e5d61437 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:42.381377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bd605b94-9483-409b-9832-3196e5d61437 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:42.398081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd605b94-9483-409b-9832-3196e5d61437 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.401985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd605b94-9483-409b-9832-3196e5d61437 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.403109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd605b94-9483-409b-9832-3196e5d61437 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.405292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd605b94-9483-409b-9832-3196e5d61437 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.921244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f2c3eba6-1246-44b5-a4fb-ebbae111bb16 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:42.922552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f2c3eba6-1246-44b5-a4fb-ebbae111bb16 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:42.942358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2c3eba6-1246-44b5-a4fb-ebbae111bb16 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.943249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2c3eba6-1246-44b5-a4fb-ebbae111bb16 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.944342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2c3eba6-1246-44b5-a4fb-ebbae111bb16 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.945847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2c3eba6-1246-44b5-a4fb-ebbae111bb16 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.190511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f2c3eba6-1246-44b5-a4fb-ebbae111bb16 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:43.218071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f2c3eba6-1246-44b5-a4fb-ebbae111bb16 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:43.225730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f2c3eba6-1246-44b5-a4fb-ebbae111bb16 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:43.236201 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f2c3eba6-1246-44b5-a4fb-ebbae111bb16 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.320125 Jul 20 04:31:43.240310 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2181/4363] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:42 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:43.282740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6f472fd-cf58-4572-99d9-93bdfbb10a87 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:43.285152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a6f472fd-cf58-4572-99d9-93bdfbb10a87 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:43.307048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6f472fd-cf58-4572-99d9-93bdfbb10a87 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.319203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6f472fd-cf58-4572-99d9-93bdfbb10a87 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.322289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6f472fd-cf58-4572-99d9-93bdfbb10a87 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.323314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6f472fd-cf58-4572-99d9-93bdfbb10a87 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.323675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bd605b94-9483-409b-9832-3196e5d61437 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:43.338697 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bd605b94-9483-409b-9832-3196e5d61437 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1313 microversion: 2.1 time: 0.962589 Jul 20 04:31:43.348964 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2183/4364] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:42 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1313 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:43.376134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-87da4938-4480-40d6-8840-c58523109bf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:43.387865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-87da4938-4480-40d6-8840-c58523109bf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:43.414528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87da4938-4480-40d6-8840-c58523109bf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.427514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87da4938-4480-40d6-8840-c58523109bf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.432408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87da4938-4480-40d6-8840-c58523109bf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.437644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-87da4938-4480-40d6-8840-c58523109bf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.782475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-87da4938-4480-40d6-8840-c58523109bf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:43.796130 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-87da4938-4480-40d6-8840-c58523109bf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1327 microversion: 2.1 time: 0.434023 Jul 20 04:31:43.809147 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2184/4365] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:43 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1327 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:44.105022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a6f472fd-cf58-4572-99d9-93bdfbb10a87 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.114765 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a6f472fd-cf58-4572-99d9-93bdfbb10a87 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1500 microversion: 2.1 time: 0.867678 Jul 20 04:31:44.126992 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2182/4366] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:43 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1500 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:44.136321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2d0f525f-913e-439f-9787-11be85d9d317 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:44.137660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2d0f525f-913e-439f-9787-11be85d9d317 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.142214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:44.146564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d0f525f-913e-439f-9787-11be85d9d317 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.147763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d0f525f-913e-439f-9787-11be85d9d317 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.149627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d0f525f-913e-439f-9787-11be85d9d317 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.150522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d0f525f-913e-439f-9787-11be85d9d317 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.187332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2d0f525f-913e-439f-9787-11be85d9d317 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:44.269192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89e2abb6-c6a7-4c03-8a7f-8a3469b0c9e3 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:44.271877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-89e2abb6-c6a7-4c03-8a7f-8a3469b0c9e3 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.294560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89e2abb6-c6a7-4c03-8a7f-8a3469b0c9e3 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.301582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89e2abb6-c6a7-4c03-8a7f-8a3469b0c9e3 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.305375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89e2abb6-c6a7-4c03-8a7f-8a3469b0c9e3 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.307410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89e2abb6-c6a7-4c03-8a7f-8a3469b0c9e3 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.388301 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2d0f525f-913e-439f-9787-11be85d9d317 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 204 len: 0 microversion: 2.1 time: 0.255491 Jul 20 04:31:44.393815 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2185/4367] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:44 2022] DELETE /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:44.409621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8805498a-ed89-4394-9bb7-024d0b5e1021 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:44.411207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8805498a-ed89-4394-9bb7-024d0b5e1021 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.428550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8805498a-ed89-4394-9bb7-024d0b5e1021 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.429018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8805498a-ed89-4394-9bb7-024d0b5e1021 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.430097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8805498a-ed89-4394-9bb7-024d0b5e1021 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.430992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8805498a-ed89-4394-9bb7-024d0b5e1021 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.559199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89e2abb6-c6a7-4c03-8a7f-8a3469b0c9e3 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.582265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89e2abb6-c6a7-4c03-8a7f-8a3469b0c9e3 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.587841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89e2abb6-c6a7-4c03-8a7f-8a3469b0c9e3 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.593100 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89e2abb6-c6a7-4c03-8a7f-8a3469b0c9e3 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.333558 Jul 20 04:31:44.596414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2183/4368] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:44 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:44.644759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-62027d74-5bc8-45e0-81af-dae3c986ed02 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:44.649112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-62027d74-5bc8-45e0-81af-dae3c986ed02 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.680496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62027d74-5bc8-45e0-81af-dae3c986ed02 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.684064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62027d74-5bc8-45e0-81af-dae3c986ed02 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.685473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62027d74-5bc8-45e0-81af-dae3c986ed02 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.685947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62027d74-5bc8-45e0-81af-dae3c986ed02 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.047071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8805498a-ed89-4394-9bb7-024d0b5e1021 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.054900 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8805498a-ed89-4394-9bb7-024d0b5e1021 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1313 microversion: 2.1 time: 0.657955 Jul 20 04:31:45.071889 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2186/4369] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:44 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:45.077749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bba31d11-1541-46b0-8d97-b8cd23828917 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:45.078412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bba31d11-1541-46b0-8d97-b8cd23828917 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.093997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bba31d11-1541-46b0-8d97-b8cd23828917 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.094502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bba31d11-1541-46b0-8d97-b8cd23828917 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.095306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bba31d11-1541-46b0-8d97-b8cd23828917 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.095764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bba31d11-1541-46b0-8d97-b8cd23828917 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.230061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bba31d11-1541-46b0-8d97-b8cd23828917 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.238888 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bba31d11-1541-46b0-8d97-b8cd23828917 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1325 microversion: 2.1 time: 0.165267 Jul 20 04:31:45.251338 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2187/4370] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:45 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:45.614865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cc7e46e3-b38a-475d-9e82-fc558e2c0d0d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:45.616277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cc7e46e3-b38a-475d-9e82-fc558e2c0d0d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.632034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc7e46e3-b38a-475d-9e82-fc558e2c0d0d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.639039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc7e46e3-b38a-475d-9e82-fc558e2c0d0d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.640204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc7e46e3-b38a-475d-9e82-fc558e2c0d0d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.640832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc7e46e3-b38a-475d-9e82-fc558e2c0d0d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.678934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-62027d74-5bc8-45e0-81af-dae3c986ed02 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.718915 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-62027d74-5bc8-45e0-81af-dae3c986ed02 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 1.098290 Jul 20 04:31:45.721320 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2184/4371] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:44 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:45.841711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cc7e46e3-b38a-475d-9e82-fc558e2c0d0d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.852878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cc7e46e3-b38a-475d-9e82-fc558e2c0d0d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.855725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cc7e46e3-b38a-475d-9e82-fc558e2c0d0d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.857873 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cc7e46e3-b38a-475d-9e82-fc558e2c0d0d tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.246571 Jul 20 04:31:45.880510 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2188/4372] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:45 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:46.078011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7c210728-d5df-4881-b654-725934ea08fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.081670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7c210728-d5df-4881-b654-725934ea08fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:46.109936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c210728-d5df-4881-b654-725934ea08fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.110555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c210728-d5df-4881-b654-725934ea08fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.119293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c210728-d5df-4881-b654-725934ea08fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.119859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c210728-d5df-4881-b654-725934ea08fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.268886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fd5c5c6c-bfc5-411b-9d86-fd85532c0e09 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.269522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fd5c5c6c-bfc5-411b-9d86-fd85532c0e09 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:46.282779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd5c5c6c-bfc5-411b-9d86-fd85532c0e09 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.283251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd5c5c6c-bfc5-411b-9d86-fd85532c0e09 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.284068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd5c5c6c-bfc5-411b-9d86-fd85532c0e09 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.284525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd5c5c6c-bfc5-411b-9d86-fd85532c0e09 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.462296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fd5c5c6c-bfc5-411b-9d86-fd85532c0e09 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:46.472952 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fd5c5c6c-bfc5-411b-9d86-fd85532c0e09 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1325 microversion: 2.1 time: 0.205278 Jul 20 04:31:46.482471 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2189/4373] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1325 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:46.739515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ca1976a-8d85-4cf6-a9e5-e3ba756a3323 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.741494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ca1976a-8d85-4cf6-a9e5-e3ba756a3323 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:46.755182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ca1976a-8d85-4cf6-a9e5-e3ba756a3323 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.759016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ca1976a-8d85-4cf6-a9e5-e3ba756a3323 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.761976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ca1976a-8d85-4cf6-a9e5-e3ba756a3323 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.762880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ca1976a-8d85-4cf6-a9e5-e3ba756a3323 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.887986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7c210728-d5df-4881-b654-725934ea08fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:46.897199 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7c210728-d5df-4881-b654-725934ea08fa tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1313 microversion: 2.1 time: 0.828969 Jul 20 04:31:46.898928 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2185/4374] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1313 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:46.915616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-577d8a4d-98b7-45ff-b71f-a40eff0698a8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.921228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-577d8a4d-98b7-45ff-b71f-a40eff0698a8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:46.936597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-577d8a4d-98b7-45ff-b71f-a40eff0698a8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.937316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-577d8a4d-98b7-45ff-b71f-a40eff0698a8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.938303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-577d8a4d-98b7-45ff-b71f-a40eff0698a8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.938916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-577d8a4d-98b7-45ff-b71f-a40eff0698a8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.154523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ca1976a-8d85-4cf6-a9e5-e3ba756a3323 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.171404 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ca1976a-8d85-4cf6-a9e5-e3ba756a3323 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.434103 Jul 20 04:31:47.173369 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2190/4375] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:47.404132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-577d8a4d-98b7-45ff-b71f-a40eff0698a8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.424552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-577d8a4d-98b7-45ff-b71f-a40eff0698a8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.427093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-577d8a4d-98b7-45ff-b71f-a40eff0698a8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.428386 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-577d8a4d-98b7-45ff-b71f-a40eff0698a8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.516889 Jul 20 04:31:47.428987 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2186/4376] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:47.491771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-318106b8-6d30-410b-ac19-de1c5cafbbb1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:47.493311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-318106b8-6d30-410b-ac19-de1c5cafbbb1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:47.512722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-318106b8-6d30-410b-ac19-de1c5cafbbb1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.518901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-318106b8-6d30-410b-ac19-de1c5cafbbb1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.522634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-318106b8-6d30-410b-ac19-de1c5cafbbb1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.531207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-318106b8-6d30-410b-ac19-de1c5cafbbb1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.738292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-318106b8-6d30-410b-ac19-de1c5cafbbb1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.755149 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-318106b8-6d30-410b-ac19-de1c5cafbbb1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1325 microversion: 2.1 time: 0.268908 Jul 20 04:31:47.756618 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2191/4377] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:47 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1325 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:47.916409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f2d9344f-15a0-47a0-99b6-0114d066e121 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:47.917890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f2d9344f-15a0-47a0-99b6-0114d066e121 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:47.928346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2d9344f-15a0-47a0-99b6-0114d066e121 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.930860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2d9344f-15a0-47a0-99b6-0114d066e121 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.935154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2d9344f-15a0-47a0-99b6-0114d066e121 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.935829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2d9344f-15a0-47a0-99b6-0114d066e121 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.089591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-373ab9ec-047e-460b-8bcc-35ffac4f27d0 req-4d2738d8-6e4b-4f94-bd33-1fa9035d4b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceef6679-563f-406f-9dfd-c4b216eb0b04", "name": "network-vif-plugged", "status": "completed", "tag": "c7dc9466-5672-4a11-a1c1-a9acee91187d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:48.115583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-373ab9ec-047e-460b-8bcc-35ffac4f27d0 req-4d2738d8-6e4b-4f94-bd33-1fa9035d4b79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.116045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-373ab9ec-047e-460b-8bcc-35ffac4f27d0 req-4d2738d8-6e4b-4f94-bd33-1fa9035d4b79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.192743 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-373ab9ec-047e-460b-8bcc-35ffac4f27d0 req-4d2738d8-6e4b-4f94-bd33-1fa9035d4b79 service nova] Creating event network-vif-plugged:c7dc9466-5672-4a11-a1c1-a9acee91187d for instance ceef6679-563f-406f-9dfd-c4b216eb0b04 on n-h1-760456-11 Jul 20 04:31:48.205887 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-373ab9ec-047e-460b-8bcc-35ffac4f27d0 req-4d2738d8-6e4b-4f94-bd33-1fa9035d4b79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134732 Jul 20 04:31:48.208930 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2192/4378] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:31:48.224588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-099d75b0-d0ce-4b7a-a61f-c5e474e1ae76 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:48.225332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-099d75b0-d0ce-4b7a-a61f-c5e474e1ae76 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:48.273688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-099d75b0-d0ce-4b7a-a61f-c5e474e1ae76 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.273688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-099d75b0-d0ce-4b7a-a61f-c5e474e1ae76 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.273688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-099d75b0-d0ce-4b7a-a61f-c5e474e1ae76 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.273688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-099d75b0-d0ce-4b7a-a61f-c5e474e1ae76 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.720621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-099d75b0-d0ce-4b7a-a61f-c5e474e1ae76 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.735250 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-099d75b0-d0ce-4b7a-a61f-c5e474e1ae76 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1506 microversion: 2.1 time: 0.522859 Jul 20 04:31:48.739642 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2193/4379] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:48 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:48.749301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7be71a2f-7fe8-4d21-b772-2e2d39fc1b6a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:48.749596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7be71a2f-7fe8-4d21-b772-2e2d39fc1b6a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:48.788300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7be71a2f-7fe8-4d21-b772-2e2d39fc1b6a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.789762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7be71a2f-7fe8-4d21-b772-2e2d39fc1b6a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.794340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7be71a2f-7fe8-4d21-b772-2e2d39fc1b6a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.795888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7be71a2f-7fe8-4d21-b772-2e2d39fc1b6a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.846299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f2d9344f-15a0-47a0-99b6-0114d066e121 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.856878 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f2d9344f-15a0-47a0-99b6-0114d066e121 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1313 microversion: 2.1 time: 0.945911 Jul 20 04:31:48.880355 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2187/4380] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:47 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1313 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:48.895975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-13f6ab83-069d-428d-9028-5bf2d1edeb9b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:48.897139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-13f6ab83-069d-428d-9028-5bf2d1edeb9b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:48.919178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13f6ab83-069d-428d-9028-5bf2d1edeb9b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.920385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13f6ab83-069d-428d-9028-5bf2d1edeb9b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.921379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13f6ab83-069d-428d-9028-5bf2d1edeb9b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.921998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13f6ab83-069d-428d-9028-5bf2d1edeb9b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.985708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7be71a2f-7fe8-4d21-b772-2e2d39fc1b6a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.999300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7be71a2f-7fe8-4d21-b772-2e2d39fc1b6a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.001320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7be71a2f-7fe8-4d21-b772-2e2d39fc1b6a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.002746 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7be71a2f-7fe8-4d21-b772-2e2d39fc1b6a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.261933 Jul 20 04:31:49.003314 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2194/4381] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:48 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:49.606764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-13f6ab83-069d-428d-9028-5bf2d1edeb9b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.618859 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-13f6ab83-069d-428d-9028-5bf2d1edeb9b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1392 microversion: 2.1 time: 0.732779 Jul 20 04:31:49.628830 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2188/4382] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:48 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1392 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:49.758667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c95213e1-81e7-4820-bc31-0dd64e9c38b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.759491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c95213e1-81e7-4820-bc31-0dd64e9c38b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.779167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c95213e1-81e7-4820-bc31-0dd64e9c38b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.779918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c95213e1-81e7-4820-bc31-0dd64e9c38b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.781387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c95213e1-81e7-4820-bc31-0dd64e9c38b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.782326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c95213e1-81e7-4820-bc31-0dd64e9c38b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.880530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c6d59bd-c8fe-4014-8153-90a5092501c1 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.881538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c6d59bd-c8fe-4014-8153-90a5092501c1 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.892696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c6d59bd-c8fe-4014-8153-90a5092501c1 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.911388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c6d59bd-c8fe-4014-8153-90a5092501c1 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.912567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c6d59bd-c8fe-4014-8153-90a5092501c1 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.915050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c6d59bd-c8fe-4014-8153-90a5092501c1 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.958024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c95213e1-81e7-4820-bc31-0dd64e9c38b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.995248 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c95213e1-81e7-4820-bc31-0dd64e9c38b1 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 200 len: 1464 microversion: 2.1 time: 0.241125 Jul 20 04:31:50.004538 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2195/4383] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 1464 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:50.038632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6e27da0-0765-43d8-a403-dfb74f219ca5 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:50.042801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d6e27da0-0765-43d8-a403-dfb74f219ca5 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:50.058105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6e27da0-0765-43d8-a403-dfb74f219ca5 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.060036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6e27da0-0765-43d8-a403-dfb74f219ca5 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.063467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6e27da0-0765-43d8-a403-dfb74f219ca5 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.066606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6e27da0-0765-43d8-a403-dfb74f219ca5 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.199603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d6e27da0-0765-43d8-a403-dfb74f219ca5 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.232314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d6e27da0-0765-43d8-a403-dfb74f219ca5 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.235075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d6e27da0-0765-43d8-a403-dfb74f219ca5 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.244420 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d6e27da0-0765-43d8-a403-dfb74f219ca5 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.211619 Jul 20 04:31:50.248325 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2196/4384] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:50 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:50.390817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-0fa9327d-e569-43fe-8013-bfbbde3949d1 req-a1a52841-8ca5-41d1-8e3b-249c1af8b635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac47ff84-f717-4754-8d77-f04484dc86e1", "name": "network-vif-deleted", "tag": "04896d77-27ec-43cc-a641-87a188d2f503"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:50.419334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0fa9327d-e569-43fe-8013-bfbbde3949d1 req-a1a52841-8ca5-41d1-8e3b-249c1af8b635 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.419534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0fa9327d-e569-43fe-8013-bfbbde3949d1 req-a1a52841-8ca5-41d1-8e3b-249c1af8b635 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.448564 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-0fa9327d-e569-43fe-8013-bfbbde3949d1 req-a1a52841-8ca5-41d1-8e3b-249c1af8b635 service nova] Creating event network-vif-deleted:04896d77-27ec-43cc-a641-87a188d2f503 for instance ac47ff84-f717-4754-8d77-f04484dc86e1 on n-h2-760456-11 Jul 20 04:31:50.466147 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-0fa9327d-e569-43fe-8013-bfbbde3949d1 req-a1a52841-8ca5-41d1-8e3b-249c1af8b635 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081557 Jul 20 04:31:50.469311 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2197/4385] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:50.639901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3466be53-a2a6-41be-a4a4-103edff21b36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:50.640599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3466be53-a2a6-41be-a4a4-103edff21b36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:50.657686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3466be53-a2a6-41be-a4a4-103edff21b36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.658167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3466be53-a2a6-41be-a4a4-103edff21b36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.664607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3466be53-a2a6-41be-a4a4-103edff21b36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.664607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3466be53-a2a6-41be-a4a4-103edff21b36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.734240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c6d59bd-c8fe-4014-8153-90a5092501c1 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.745963 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c6d59bd-c8fe-4014-8153-90a5092501c1 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1313 microversion: 2.1 time: 0.869161 Jul 20 04:31:50.762909 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2189/4386] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1313 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:51.020957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d13d9e4-2b6b-4efa-b7f6-60db5e379efc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.021759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8d13d9e4-2b6b-4efa-b7f6-60db5e379efc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: ac47ff84-f717-4754-8d77-f04484dc86e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.042443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d13d9e4-2b6b-4efa-b7f6-60db5e379efc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.044049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d13d9e4-2b6b-4efa-b7f6-60db5e379efc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.045609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d13d9e4-2b6b-4efa-b7f6-60db5e379efc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.046374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d13d9e4-2b6b-4efa-b7f6-60db5e379efc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.089317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3466be53-a2a6-41be-a4a4-103edff21b36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.100145 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8d13d9e4-2b6b-4efa-b7f6-60db5e379efc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] HTTP exception thrown: Instance ac47ff84-f717-4754-8d77-f04484dc86e1 could not be found. Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d13d9e4-2b6b-4efa-b7f6-60db5e379efc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Request method failure captured: Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 HTTP/1.1 Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14S10OHOgdVqLAG58BdXd1BZB8jDCRJCDtkAsH9J7fi1qXK1NQLTRO7U5diHcdAo0Hx76K_oKCwuNNtLcJ1lHwBWV3pTj57VexzHZZdGdIoJ9PBQe0OC4_6nQIdFWbVReI2Pqf9mZ8oQxRP46A71WolTnnU8Syk4NpGJZpczLMXnwjI Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ce0206e02d3d4e199c266d1bc82003b0 Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerRescueTestJSON-1759884912 Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ce0206e02d3d4e199c266d1bc82003b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ce0206e02d3d4e199c266d1bc82003b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ce0206e02d3d4e199c266d1bc82003b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ce0206e02d3d4e199c266d1bc82003b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerRescueTestJSON-1759884912 Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ce0206e02d3d4e199c266d1bc82003b0 Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerRescueTestJSON-1759884912 Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerRescueTestJSON-1759884912-project Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 7a6085c4cb104f20a1f1dd6a8d30b4ce Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerRescueTestJSON-1759884912-project Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance ac47ff84-f717-4754-8d77-f04484dc86e1 could not be found. Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'ac47ff84-f717-4754-8d77-f04484dc86e1'} Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac47ff84-f717-4754-8d77-f04484dc86e1 could not be found. Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac47ff84-f717-4754-8d77-f04484dc86e1 could not be found. Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:51.104558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.113604 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:51.113604 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:51.113604 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:51.113604 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:51.113604 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:51.113604 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac47ff84-f717-4754-8d77-f04484dc86e1 could not be found. Jul 20 04:31:51.113604 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:31:51.119030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:51.119641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d13d9e4-2b6b-4efa-b7f6-60db5e379efc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Returning 404 to user: Instance ac47ff84-f717-4754-8d77-f04484dc86e1 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:51.119641 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8d13d9e4-2b6b-4efa-b7f6-60db5e379efc tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1" status: 404 len: 111 microversion: 2.1 time: 0.095457 Jul 20 04:31:51.119641 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2190/4387] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:51 2022] GET /compute/v2.1/servers/ac47ff84-f717-4754-8d77-f04484dc86e1 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:31:51.123363 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3466be53-a2a6-41be-a4a4-103edff21b36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1392 microversion: 2.1 time: 0.489262 Jul 20 04:31:51.124011 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2198/4388] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:50 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1392 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:51.132483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-076abc4b-c816-4c89-9f2d-fa058287a566 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.136227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-076abc4b-c816-4c89-9f2d-fa058287a566 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.151832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-076abc4b-c816-4c89-9f2d-fa058287a566 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.152539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-076abc4b-c816-4c89-9f2d-fa058287a566 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.153574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-076abc4b-c816-4c89-9f2d-fa058287a566 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.154190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-076abc4b-c816-4c89-9f2d-fa058287a566 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.202393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-076abc4b-c816-4c89-9f2d-fa058287a566 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:51.266356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da8ddf9e-59e5-44b0-bfc4-26f0ee8657f8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.267408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-da8ddf9e-59e5-44b0-bfc4-26f0ee8657f8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.284400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da8ddf9e-59e5-44b0-bfc4-26f0ee8657f8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.287545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da8ddf9e-59e5-44b0-bfc4-26f0ee8657f8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.292732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da8ddf9e-59e5-44b0-bfc4-26f0ee8657f8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.293486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:51.296628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da8ddf9e-59e5-44b0-bfc4-26f0ee8657f8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.300210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:51.334715 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-076abc4b-c816-4c89-9f2d-fa058287a566 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "DELETE /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 204 len: 0 microversion: 2.1 time: 0.214485 Jul 20 04:31:51.339539 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2191/4389] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:51 2022] DELETE /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:51.346323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d17c644a-d26f-4200-b671-3fe9b028056c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.347520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d17c644a-d26f-4200-b671-3fe9b028056c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.355936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d17c644a-d26f-4200-b671-3fe9b028056c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.356797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d17c644a-d26f-4200-b671-3fe9b028056c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.357964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d17c644a-d26f-4200-b671-3fe9b028056c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.358691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d17c644a-d26f-4200-b671-3fe9b028056c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.498564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-da8ddf9e-59e5-44b0-bfc4-26f0ee8657f8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.510333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-da8ddf9e-59e5-44b0-bfc4-26f0ee8657f8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.512051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-da8ddf9e-59e5-44b0-bfc4-26f0ee8657f8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.514874 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-da8ddf9e-59e5-44b0-bfc4-26f0ee8657f8 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.253561 Jul 20 04:31:51.529653 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2199/4390] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:51 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:51.771962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f947842f-f9f4-49f0-89cc-e3580665433d tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.772932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f947842f-f9f4-49f0-89cc-e3580665433d tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.791455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f947842f-f9f4-49f0-89cc-e3580665433d tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.792143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f947842f-f9f4-49f0-89cc-e3580665433d tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.793328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f947842f-f9f4-49f0-89cc-e3580665433d tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.793995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f947842f-f9f4-49f0-89cc-e3580665433d tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.011484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f947842f-f9f4-49f0-89cc-e3580665433d tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:52.020972 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f947842f-f9f4-49f0-89cc-e3580665433d tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1463 microversion: 2.1 time: 0.252921 Jul 20 04:31:52.021504 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2200/4391] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:51 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1463 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:52.039420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-91b23bc2-4900-418f-bfae-932610d955e6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "082857f3-a18b-4347-9a5d-48441cd7a4c2", "device": "/dev/sdb"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:52.041232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-91b23bc2-4900-418f-bfae-932610d955e6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.048538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91b23bc2-4900-418f-bfae-932610d955e6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.049401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91b23bc2-4900-418f-bfae-932610d955e6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.050402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91b23bc2-4900-418f-bfae-932610d955e6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.051254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91b23bc2-4900-418f-bfae-932610d955e6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.091310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d17c644a-d26f-4200-b671-3fe9b028056c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:52.117096 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d17c644a-d26f-4200-b671-3fe9b028056c tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1493 microversion: 2.1 time: 0.775249 Jul 20 04:31:52.120964 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2192/4392] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:51 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1493 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:52.141101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0cc66069-5b10-4683-8889-c2e2018bf7e2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.142079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0cc66069-5b10-4683-8889-c2e2018bf7e2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.165799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cc66069-5b10-4683-8889-c2e2018bf7e2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.166623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cc66069-5b10-4683-8889-c2e2018bf7e2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.167732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cc66069-5b10-4683-8889-c2e2018bf7e2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.168549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cc66069-5b10-4683-8889-c2e2018bf7e2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.277117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:52.835074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0cc66069-5b10-4683-8889-c2e2018bf7e2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:52.854317 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0cc66069-5b10-4683-8889-c2e2018bf7e2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1392 microversion: 2.1 time: 0.717018 Jul 20 04:31:52.856460 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2193/4393] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1392 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:52.870310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-60d3eb96-9eae-42dc-9e74-e4621475d08a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.871364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-60d3eb96-9eae-42dc-9e74-e4621475d08a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.887999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60d3eb96-9eae-42dc-9e74-e4621475d08a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.889212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60d3eb96-9eae-42dc-9e74-e4621475d08a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.890275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60d3eb96-9eae-42dc-9e74-e4621475d08a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.891799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60d3eb96-9eae-42dc-9e74-e4621475d08a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.072925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-60d3eb96-9eae-42dc-9e74-e4621475d08a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.111852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-60d3eb96-9eae-42dc-9e74-e4621475d08a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.136152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-60d3eb96-9eae-42dc-9e74-e4621475d08a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.142427 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-60d3eb96-9eae-42dc-9e74-e4621475d08a tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1366 microversion: 2.57 time: 0.282195 Jul 20 04:31:53.149802 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2194/4394] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:53.157471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-65194a07-1b6e-44fb-92e7-c193fd75e418 req-6de91e0b-1ea1-403b-9966-2f9abfe8b433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6881eb5-fd94-4802-8fb1-ad74e99f0786", "tag": "aba34f57-d50c-4162-ad83-443faa06380d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:53.205113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-65194a07-1b6e-44fb-92e7-c193fd75e418 req-6de91e0b-1ea1-403b-9966-2f9abfe8b433 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.205564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-65194a07-1b6e-44fb-92e7-c193fd75e418 req-6de91e0b-1ea1-403b-9966-2f9abfe8b433 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.266877 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-65194a07-1b6e-44fb-92e7-c193fd75e418 req-6de91e0b-1ea1-403b-9966-2f9abfe8b433 service nova] Creating event network-changed:aba34f57-d50c-4162-ad83-443faa06380d for instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 on n-h2-760456-11 Jul 20 04:31:53.285603 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-65194a07-1b6e-44fb-92e7-c193fd75e418 req-6de91e0b-1ea1-403b-9966-2f9abfe8b433 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134052 Jul 20 04:31:53.286226 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2195/4395] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:53.315077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a1172c57-a4d9-43fa-97f5-9a74c80b0eca tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:53.317317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a1172c57-a4d9-43fa-97f5-9a74c80b0eca tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:53.340537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1172c57-a4d9-43fa-97f5-9a74c80b0eca tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.341431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1172c57-a4d9-43fa-97f5-9a74c80b0eca tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.342539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1172c57-a4d9-43fa-97f5-9a74c80b0eca tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.343180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1172c57-a4d9-43fa-97f5-9a74c80b0eca tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.204627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a1172c57-a4d9-43fa-97f5-9a74c80b0eca tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.239942 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a1172c57-a4d9-43fa-97f5-9a74c80b0eca tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1493 microversion: 2.1 time: 0.948159 Jul 20 04:31:54.245586 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2196/4396] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:53 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1493 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:54.265109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d2f07ee9-c366-4507-bfe5-77e0d7aefacc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.269854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d2f07ee9-c366-4507-bfe5-77e0d7aefacc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:54.297863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2f07ee9-c366-4507-bfe5-77e0d7aefacc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.301614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2f07ee9-c366-4507-bfe5-77e0d7aefacc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.311354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2f07ee9-c366-4507-bfe5-77e0d7aefacc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.313952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2f07ee9-c366-4507-bfe5-77e0d7aefacc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.566121 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-91b23bc2-4900-418f-bfae-932610d955e6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "POST /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.531025 Jul 20 04:31:54.567029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2201/4397] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:31:52 2022] POST /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04/os-volume_attachments => generated 194 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:54.593796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-44427b5b-3b1e-455f-839a-e4227036ca31 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:54.594729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-44427b5b-3b1e-455f-839a-e4227036ca31 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:54.619994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44427b5b-3b1e-455f-839a-e4227036ca31 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.620466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44427b5b-3b1e-455f-839a-e4227036ca31 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.621267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44427b5b-3b1e-455f-839a-e4227036ca31 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:54.621714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44427b5b-3b1e-455f-839a-e4227036ca31 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.749631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-44427b5b-3b1e-455f-839a-e4227036ca31 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.765665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-44427b5b-3b1e-455f-839a-e4227036ca31 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.767644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-44427b5b-3b1e-455f-839a-e4227036ca31 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.769138 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-44427b5b-3b1e-455f-839a-e4227036ca31 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1372 microversion: 2.57 time: 0.194663 Jul 20 04:31:54.769917 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2202/4398] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:54.770205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d2f07ee9-c366-4507-bfe5-77e0d7aefacc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.790816 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d2f07ee9-c366-4507-bfe5-77e0d7aefacc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1392 microversion: 2.1 time: 0.542055 Jul 20 04:31:54.800649 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2197/4399] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:54 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1392 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:55.264219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ebf9fdad-883d-4adb-bb30-dee1e782b245 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.265010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ebf9fdad-883d-4adb-bb30-dee1e782b245 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.274202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ebf9fdad-883d-4adb-bb30-dee1e782b245 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.277518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ebf9fdad-883d-4adb-bb30-dee1e782b245 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.283290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ebf9fdad-883d-4adb-bb30-dee1e782b245 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.283956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ebf9fdad-883d-4adb-bb30-dee1e782b245 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.461561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10bd236d-d319-4751-922a-fc0451de09c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.462009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10bd236d-d319-4751-922a-fc0451de09c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.475293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10bd236d-d319-4751-922a-fc0451de09c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.476338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10bd236d-d319-4751-922a-fc0451de09c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.477108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10bd236d-d319-4751-922a-fc0451de09c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.477676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10bd236d-d319-4751-922a-fc0451de09c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.724930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ebf9fdad-883d-4adb-bb30-dee1e782b245 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.737836 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ebf9fdad-883d-4adb-bb30-dee1e782b245 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1493 microversion: 2.1 time: 0.476994 Jul 20 04:31:55.745524 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2203/4400] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1493 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:55.794294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d8ba10c7-d923-4ea6-ad3a-21f2b85c1568 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.795226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d8ba10c7-d923-4ea6-ad3a-21f2b85c1568 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.819913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8ba10c7-d923-4ea6-ad3a-21f2b85c1568 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.821672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8ba10c7-d923-4ea6-ad3a-21f2b85c1568 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.823651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8ba10c7-d923-4ea6-ad3a-21f2b85c1568 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.825007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8ba10c7-d923-4ea6-ad3a-21f2b85c1568 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.161086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10bd236d-d319-4751-922a-fc0451de09c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.190079 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10bd236d-d319-4751-922a-fc0451de09c5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 0.736851 Jul 20 04:31:56.190802 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2198/4401] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:56.223962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ded61f26-2977-4773-b34e-e7486a466ff6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.231359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ded61f26-2977-4773-b34e-e7486a466ff6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.285790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded61f26-2977-4773-b34e-e7486a466ff6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.288782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded61f26-2977-4773-b34e-e7486a466ff6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.289881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded61f26-2977-4773-b34e-e7486a466ff6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.294843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded61f26-2977-4773-b34e-e7486a466ff6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.455834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8ba10c7-d923-4ea6-ad3a-21f2b85c1568 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.464784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8ba10c7-d923-4ea6-ad3a-21f2b85c1568 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.477664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8ba10c7-d923-4ea6-ad3a-21f2b85c1568 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.479544 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d8ba10c7-d923-4ea6-ad3a-21f2b85c1568 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1372 microversion: 2.57 time: 0.691679 Jul 20 04:31:56.495447 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2204/4402] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1372 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:56.765257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-086f362c-db87-4898-b457-992497873e1f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.765952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-086f362c-db87-4898-b457-992497873e1f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.774413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-086f362c-db87-4898-b457-992497873e1f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.775210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-086f362c-db87-4898-b457-992497873e1f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.776304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-086f362c-db87-4898-b457-992497873e1f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.777184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-086f362c-db87-4898-b457-992497873e1f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.947302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ded61f26-2977-4773-b34e-e7486a466ff6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.972547 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ded61f26-2977-4773-b34e-e7486a466ff6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1392 microversion: 2.1 time: 0.776827 Jul 20 04:31:56.978504 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2199/4403] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:56 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1392 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:56.989753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-086f362c-db87-4898-b457-992497873e1f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6085c4cb104f20a1f1dd6a8d30b4ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0206e02d3d4e199c266d1bc82003b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.992424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-17f16d00-012d-4c55-a286-a48de4108958 req-2bff5d0a-cab2-49b7-9418-1f4a604e99c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ff4e64-da30-4eac-a9f9-61576b446fef", "name": "network-vif-deleted", "tag": "2a034c5b-4cca-4960-83bb-28492bef618b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:57.007796 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-086f362c-db87-4898-b457-992497873e1f tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 200 len: 1451 microversion: 2.1 time: 0.248611 Jul 20 04:31:57.008911 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2205/4404] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:56 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 1451 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:57.013568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-17f16d00-012d-4c55-a286-a48de4108958 req-2bff5d0a-cab2-49b7-9418-1f4a604e99c6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.014283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-17f16d00-012d-4c55-a286-a48de4108958 req-2bff5d0a-cab2-49b7-9418-1f4a604e99c6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.038052 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-17f16d00-012d-4c55-a286-a48de4108958 req-2bff5d0a-cab2-49b7-9418-1f4a604e99c6 service nova] Creating event network-vif-deleted:2a034c5b-4cca-4960-83bb-28492bef618b for instance 30ff4e64-da30-4eac-a9f9-61576b446fef on n-h1-760456-11 Jul 20 04:31:57.048782 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-17f16d00-012d-4c55-a286-a48de4108958 req-2bff5d0a-cab2-49b7-9418-1f4a604e99c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065872 Jul 20 04:31:57.059264 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2200/4405] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:57.208501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6463eb8d-6cb3-4e98-9db5-8bb9b43ecffc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:57.209153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6463eb8d-6cb3-4e98-9db5-8bb9b43ecffc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:57.221015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6463eb8d-6cb3-4e98-9db5-8bb9b43ecffc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.222157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6463eb8d-6cb3-4e98-9db5-8bb9b43ecffc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.223012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6463eb8d-6cb3-4e98-9db5-8bb9b43ecffc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.225990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6463eb8d-6cb3-4e98-9db5-8bb9b43ecffc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.506373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07f60d3a-07bb-4c7e-a668-68b756056de2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:57.507443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-07f60d3a-07bb-4c7e-a668-68b756056de2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:57.525842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6463eb8d-6cb3-4e98-9db5-8bb9b43ecffc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.533607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07f60d3a-07bb-4c7e-a668-68b756056de2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.536964 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6463eb8d-6cb3-4e98-9db5-8bb9b43ecffc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.332524 Jul 20 04:31:57.539126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07f60d3a-07bb-4c7e-a668-68b756056de2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.540869 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2206/4406] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:57 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:57.552491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07f60d3a-07bb-4c7e-a668-68b756056de2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.553350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07f60d3a-07bb-4c7e-a668-68b756056de2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.557297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cbf32943-f13d-4fbf-ac51-c9c24afb714f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1022794465"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:57.560000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cbf32943-f13d-4fbf-ac51-c9c24afb714f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:57.588019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbf32943-f13d-4fbf-ac51-c9c24afb714f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.588543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbf32943-f13d-4fbf-ac51-c9c24afb714f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.592167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbf32943-f13d-4fbf-ac51-c9c24afb714f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.592636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbf32943-f13d-4fbf-ac51-c9c24afb714f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.764335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-07f60d3a-07bb-4c7e-a668-68b756056de2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.780068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-07f60d3a-07bb-4c7e-a668-68b756056de2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.786292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-07f60d3a-07bb-4c7e-a668-68b756056de2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.792593 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-07f60d3a-07bb-4c7e-a668-68b756056de2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1357 microversion: 2.57 time: 0.289929 Jul 20 04:31:57.794027 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2201/4407] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:57 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:31:57.824529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-916b9799-3886-48e3-9a36-7005cd4a02a2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:57.825535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-916b9799-3886-48e3-9a36-7005cd4a02a2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:57.839796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-916b9799-3886-48e3-9a36-7005cd4a02a2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.840533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-916b9799-3886-48e3-9a36-7005cd4a02a2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.844258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-916b9799-3886-48e3-9a36-7005cd4a02a2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.844907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-916b9799-3886-48e3-9a36-7005cd4a02a2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.929337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-916b9799-3886-48e3-9a36-7005cd4a02a2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:58.182198 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cbf32943-f13d-4fbf-ac51-c9c24afb714f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.627182 Jul 20 04:31:58.186954 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2207/4408] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:31:57 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 20 04:31:58.202472 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-916b9799-3886-48e3-9a36-7005cd4a02a2 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 204 len: 0 microversion: 2.57 time: 0.382844 Jul 20 04:31:58.209926 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2202/4409] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:31:57 2022] DELETE /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:31:58.214172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3161b2eb-7904-4542-8296-69e1ac03a653 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.215373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3161b2eb-7904-4542-8296-69e1ac03a653 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.219447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc2a24bf-14f4-4a08-8425-813199a95e06 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.231521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cc2a24bf-14f4-4a08-8425-813199a95e06 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] [instance: 30ff4e64-da30-4eac-a9f9-61576b446fef] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.237209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3161b2eb-7904-4542-8296-69e1ac03a653 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.237688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3161b2eb-7904-4542-8296-69e1ac03a653 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.238601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3161b2eb-7904-4542-8296-69e1ac03a653 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.239057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3161b2eb-7904-4542-8296-69e1ac03a653 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.253342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc2a24bf-14f4-4a08-8425-813199a95e06 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.258519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc2a24bf-14f4-4a08-8425-813199a95e06 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.259693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc2a24bf-14f4-4a08-8425-813199a95e06 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.263995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc2a24bf-14f4-4a08-8425-813199a95e06 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.318303 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-cc2a24bf-14f4-4a08-8425-813199a95e06 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] HTTP exception thrown: Instance 30ff4e64-da30-4eac-a9f9-61576b446fef could not be found. Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc2a24bf-14f4-4a08-8425-813199a95e06 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Request method failure captured: Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef HTTP/1.1 Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14S10OHOgdVqLAG58BdXd1BZB8jDCRJCDtkAsH9J7fi1qXK1NQLTRO7U5diHcdAo0Hx76K_oKCwuNNtLcJ1lHwBWV3pTj57VexzHZZdGdIoJ9PBQe0OC4_6nQIdFWbVReI2Pqf9mZ8oQxRP46A71WolTnnU8Syk4NpGJZpczLMXnwjI Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ce0206e02d3d4e199c266d1bc82003b0 Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerRescueTestJSON-1759884912 Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ce0206e02d3d4e199c266d1bc82003b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ce0206e02d3d4e199c266d1bc82003b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ce0206e02d3d4e199c266d1bc82003b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ce0206e02d3d4e199c266d1bc82003b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerRescueTestJSON-1759884912 Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ce0206e02d3d4e199c266d1bc82003b0 Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerRescueTestJSON-1759884912 Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerRescueTestJSON-1759884912-project Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 7a6085c4cb104f20a1f1dd6a8d30b4ce Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerRescueTestJSON-1759884912-project Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 30ff4e64-da30-4eac-a9f9-61576b446fef could not be found. Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '30ff4e64-da30-4eac-a9f9-61576b446fef'} Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30ff4e64-da30-4eac-a9f9-61576b446fef could not be found. Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30ff4e64-da30-4eac-a9f9-61576b446fef could not be found. Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:58.330065 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.337985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:58.337985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:58.337985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:58.337985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:58.337985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:58.337985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30ff4e64-da30-4eac-a9f9-61576b446fef could not be found. Jul 20 04:31:58.337985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:31:58.337985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc2a24bf-14f4-4a08-8425-813199a95e06 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] Returning 404 to user: Instance 30ff4e64-da30-4eac-a9f9-61576b446fef could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:58.339350 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cc2a24bf-14f4-4a08-8425-813199a95e06 tempest-ServerRescueTestJSON-1759884912 tempest-ServerRescueTestJSON-1759884912-project] 10.222.0.59 "GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef" status: 404 len: 111 microversion: 2.1 time: 0.124171 Jul 20 04:31:58.339997 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2203/4410] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/30ff4e64-da30-4eac-a9f9-61576b446fef => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:58.378405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a08e1e44-653b-4411-ad2e-53c4b8ddd05f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.382679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a08e1e44-653b-4411-ad2e-53c4b8ddd05f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.405802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a08e1e44-653b-4411-ad2e-53c4b8ddd05f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.407959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a08e1e44-653b-4411-ad2e-53c4b8ddd05f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.410973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a08e1e44-653b-4411-ad2e-53c4b8ddd05f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.412260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a08e1e44-653b-4411-ad2e-53c4b8ddd05f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.753055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3161b2eb-7904-4542-8296-69e1ac03a653 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:58.761487 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3161b2eb-7904-4542-8296-69e1ac03a653 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1392 microversion: 2.1 time: 0.567888 Jul 20 04:31:58.769252 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2208/4411] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1392 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:58.774914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6f40dadc-a4c1-4d70-be43-6222d1c86bdc tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.775603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6f40dadc-a4c1-4d70-be43-6222d1c86bdc tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.791726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f40dadc-a4c1-4d70-be43-6222d1c86bdc tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.792194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f40dadc-a4c1-4d70-be43-6222d1c86bdc tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.792999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f40dadc-a4c1-4d70-be43-6222d1c86bdc tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.793448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f40dadc-a4c1-4d70-be43-6222d1c86bdc tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.951668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a08e1e44-653b-4411-ad2e-53c4b8ddd05f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:58.963741 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a08e1e44-653b-4411-ad2e-53c4b8ddd05f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.622545 Jul 20 04:31:58.964336 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2204/4412] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:59.736941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a06b2126-a5df-48e8-9c0e-e91cbab4010f req-d0ccdc3c-ec9f-4228-9535-b227a6a67191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b78332-e314-4da3-8a21-1ccfa545f11a", "name": "network-vif-unplugged", "status": "completed", "tag": "8c4c6b64-e711-449a-a899-27913ed07df2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:59.767833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a06b2126-a5df-48e8-9c0e-e91cbab4010f req-d0ccdc3c-ec9f-4228-9535-b227a6a67191 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.768310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a06b2126-a5df-48e8-9c0e-e91cbab4010f req-d0ccdc3c-ec9f-4228-9535-b227a6a67191 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.824853 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a06b2126-a5df-48e8-9c0e-e91cbab4010f req-d0ccdc3c-ec9f-4228-9535-b227a6a67191 service nova] Creating event network-vif-unplugged:8c4c6b64-e711-449a-a899-27913ed07df2 for instance 44b78332-e314-4da3-8a21-1ccfa545f11a on n-h2-760456-11 Jul 20 04:31:59.847750 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a06b2126-a5df-48e8-9c0e-e91cbab4010f req-d0ccdc3c-ec9f-4228-9535-b227a6a67191 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112271 Jul 20 04:31:59.849096 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2205/4413] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:31:59.875333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-abc76eff-2b54-4e64-bafe-61090061eddd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.878216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-abc76eff-2b54-4e64-bafe-61090061eddd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:59.923361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abc76eff-2b54-4e64-bafe-61090061eddd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.933435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abc76eff-2b54-4e64-bafe-61090061eddd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.939352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abc76eff-2b54-4e64-bafe-61090061eddd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.940317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abc76eff-2b54-4e64-bafe-61090061eddd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.244038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6f40dadc-a4c1-4d70-be43-6222d1c86bdc tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.259489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6f40dadc-a4c1-4d70-be43-6222d1c86bdc tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.263016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6f40dadc-a4c1-4d70-be43-6222d1c86bdc tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11686826b5904fd6a8ad081354022c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f196321e90284d19aca0426ba9e97a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.265144 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6f40dadc-a4c1-4d70-be43-6222d1c86bdc tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 200 len: 1363 microversion: 2.57 time: 1.494584 Jul 20 04:32:00.290178 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2209/4414] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 1363 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:00.334436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8ff719c9-274a-4ef2-b2cf-957a5167de40 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.337155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8ff719c9-274a-4ef2-b2cf-957a5167de40 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:00.364358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ff719c9-274a-4ef2-b2cf-957a5167de40 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.364943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ff719c9-274a-4ef2-b2cf-957a5167de40 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.376232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ff719c9-274a-4ef2-b2cf-957a5167de40 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.376936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ff719c9-274a-4ef2-b2cf-957a5167de40 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.876049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8ff719c9-274a-4ef2-b2cf-957a5167de40 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.900759 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8ff719c9-274a-4ef2-b2cf-957a5167de40 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1687 microversion: 2.1 time: 0.597278 Jul 20 04:32:00.904236 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2210/4415] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:00 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1687 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:01.308851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7e5f7730-09ff-4d2b-b96a-4769db98b5f6 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.309616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7e5f7730-09ff-4d2b-b96a-4769db98b5f6 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] [instance: bf2a521e-31ac-487d-9437-f7533d2f039b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.318285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e5f7730-09ff-4d2b-b96a-4769db98b5f6 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.327089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e5f7730-09ff-4d2b-b96a-4769db98b5f6 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.327965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e5f7730-09ff-4d2b-b96a-4769db98b5f6 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.328431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e5f7730-09ff-4d2b-b96a-4769db98b5f6 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.370703 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-7e5f7730-09ff-4d2b-b96a-4769db98b5f6 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] HTTP exception thrown: Instance bf2a521e-31ac-487d-9437-f7533d2f039b could not be found. Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7e5f7730-09ff-4d2b-b96a-4769db98b5f6 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Request method failure captured: Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b HTTP/1.1 Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14UG8U42rkuribJuFQL4UkUUjx1Ud9AjdyOIfTzFL9CBKQX5_LtPpxuTmW45ErocSy7NeYfbLK7a-e8CUJRuNb944lA1j4Fc4zDXGSSsxvlelj4lkVeXIfS8EFJ_qhVV62Dl0K78HQXqYaXjFPBdTEATYHFb8HeQEEsZL9HLZktRvkI Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.57 Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: f196321e90284d19aca0426ba9e97a2c Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerShowV257Test-2034434163 Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f196321e90284d19aca0426ba9e97a2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f196321e90284d19aca0426ba9e97a2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f196321e90284d19aca0426ba9e97a2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f196321e90284d19aca0426ba9e97a2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerShowV257Test-2034434163 Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: f196321e90284d19aca0426ba9e97a2c Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerShowV257Test-2034434163 Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerShowV257Test-2034434163-project Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 11686826b5904fd6a8ad081354022c4d Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerShowV257Test-2034434163-project Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance bf2a521e-31ac-487d-9437-f7533d2f039b could not be found. Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'bf2a521e-31ac-487d-9437-f7533d2f039b'} Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2a521e-31ac-487d-9437-f7533d2f039b could not be found. Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2a521e-31ac-487d-9437-f7533d2f039b could not be found. Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:01.372421 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.377553 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:01.377553 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:01.377553 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:01.377553 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:01.377553 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:01.377553 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2a521e-31ac-487d-9437-f7533d2f039b could not be found. Jul 20 04:32:01.377553 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:32:01.395111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7e5f7730-09ff-4d2b-b96a-4769db98b5f6 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] Returning 404 to user: Instance bf2a521e-31ac-487d-9437-f7533d2f039b could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:01.396040 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7e5f7730-09ff-4d2b-b96a-4769db98b5f6 tempest-ServerShowV257Test-2034434163 tempest-ServerShowV257Test-2034434163-project] 10.222.0.59 "GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b" status: 404 len: 111 microversion: 2.57 time: 0.091563 Jul 20 04:32:01.404803 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2211/4416] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/bf2a521e-31ac-487d-9437-f7533d2f039b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:32:01.499075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-abc76eff-2b54-4e64-bafe-61090061eddd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.519291 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-abc76eff-2b54-4e64-bafe-61090061eddd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1392 microversion: 2.1 time: 1.660985 Jul 20 04:32:01.524680 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2206/4417] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1392 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:01.883506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a213e590-26db-4d35-84e5-1b909c42967c req-39ac5a62-8c40-4f9f-8efd-26af2494ce27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6881eb5-fd94-4802-8fb1-ad74e99f0786", "name": "network-vif-plugged", "status": "completed", "tag": "aba34f57-d50c-4162-ad83-443faa06380d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:01.903297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a213e590-26db-4d35-84e5-1b909c42967c req-39ac5a62-8c40-4f9f-8efd-26af2494ce27 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.904677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a213e590-26db-4d35-84e5-1b909c42967c req-39ac5a62-8c40-4f9f-8efd-26af2494ce27 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.923115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d35d2ba-1a5e-4421-9a3f-7f1af3ac627f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.923891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d35d2ba-1a5e-4421-9a3f-7f1af3ac627f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.954116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d35d2ba-1a5e-4421-9a3f-7f1af3ac627f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.955276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d35d2ba-1a5e-4421-9a3f-7f1af3ac627f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.963541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d35d2ba-1a5e-4421-9a3f-7f1af3ac627f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.968531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d35d2ba-1a5e-4421-9a3f-7f1af3ac627f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.982672 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a213e590-26db-4d35-84e5-1b909c42967c req-39ac5a62-8c40-4f9f-8efd-26af2494ce27 service nova] Creating event network-vif-plugged:aba34f57-d50c-4162-ad83-443faa06380d for instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 on n-h2-760456-11 Jul 20 04:32:02.004532 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a213e590-26db-4d35-84e5-1b909c42967c req-39ac5a62-8c40-4f9f-8efd-26af2494ce27 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124932 Jul 20 04:32:02.006626 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2212/4418] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:02.545616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-99234fba-a9cf-476e-9b4d-af7ee81c6c13 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.547029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-99234fba-a9cf-476e-9b4d-af7ee81c6c13 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.564464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99234fba-a9cf-476e-9b4d-af7ee81c6c13 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.565357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99234fba-a9cf-476e-9b4d-af7ee81c6c13 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.568718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99234fba-a9cf-476e-9b4d-af7ee81c6c13 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.570190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99234fba-a9cf-476e-9b4d-af7ee81c6c13 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.118747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-99234fba-a9cf-476e-9b4d-af7ee81c6c13 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.134165 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-99234fba-a9cf-476e-9b4d-af7ee81c6c13 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1392 microversion: 2.1 time: 0.596351 Jul 20 04:32:03.152290 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2213/4419] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1392 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:03.374894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3d35d2ba-1a5e-4421-9a3f-7f1af3ac627f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.383797 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d35d2ba-1a5e-4421-9a3f-7f1af3ac627f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 1.464810 Jul 20 04:32:03.384405 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2207/4420] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:04.159760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-870765cc-1954-48ac-982f-b72848699be3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:04.161293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-870765cc-1954-48ac-982f-b72848699be3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.173754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-870765cc-1954-48ac-982f-b72848699be3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.182333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-870765cc-1954-48ac-982f-b72848699be3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.183857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-870765cc-1954-48ac-982f-b72848699be3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.184906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-870765cc-1954-48ac-982f-b72848699be3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.249444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:04.403242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cd830183-5cc3-4116-9559-ea56ca3552f8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:04.406069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cd830183-5cc3-4116-9559-ea56ca3552f8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.426148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd830183-5cc3-4116-9559-ea56ca3552f8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.431814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd830183-5cc3-4116-9559-ea56ca3552f8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.436661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd830183-5cc3-4116-9559-ea56ca3552f8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.437455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd830183-5cc3-4116-9559-ea56ca3552f8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.558812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-870765cc-1954-48ac-982f-b72848699be3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:04.578333 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-870765cc-1954-48ac-982f-b72848699be3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1392 microversion: 2.1 time: 0.422874 Jul 20 04:32:04.579659 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2214/4421] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1392 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:05.598514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7454e29b-d8d4-4361-89b8-625ced02e2f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:05.601764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7454e29b-d8d4-4361-89b8-625ced02e2f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:05.636885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7454e29b-d8d4-4361-89b8-625ced02e2f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.639685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7454e29b-d8d4-4361-89b8-625ced02e2f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.644845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7454e29b-d8d4-4361-89b8-625ced02e2f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.652092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7454e29b-d8d4-4361-89b8-625ced02e2f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.719970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cd830183-5cc3-4116-9559-ea56ca3552f8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.730685 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cd830183-5cc3-4116-9559-ea56ca3552f8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 1.332035 Jul 20 04:32:05.744662 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2208/4422] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:05.759061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d5bf6fb1-fcb7-42dc-8d65-93e57766e197 req-b3ef3158-e117-4272-87a3-66478f678fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b78332-e314-4da3-8a21-1ccfa545f11a", "name": "network-vif-plugged", "status": "completed", "tag": "8c4c6b64-e711-449a-a899-27913ed07df2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:05.788017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d5bf6fb1-fcb7-42dc-8d65-93e57766e197 req-b3ef3158-e117-4272-87a3-66478f678fa5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.790242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d5bf6fb1-fcb7-42dc-8d65-93e57766e197 req-b3ef3158-e117-4272-87a3-66478f678fa5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.797687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:05.833063 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d5bf6fb1-fcb7-42dc-8d65-93e57766e197 req-b3ef3158-e117-4272-87a3-66478f678fa5 service nova] Creating event network-vif-plugged:8c4c6b64-e711-449a-a899-27913ed07df2 for instance 44b78332-e314-4da3-8a21-1ccfa545f11a on n-h2-760456-11 Jul 20 04:32:05.851748 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d5bf6fb1-fcb7-42dc-8d65-93e57766e197 req-b3ef3158-e117-4272-87a3-66478f678fa5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104541 Jul 20 04:32:05.860836 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2209/4423] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:06.395120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7454e29b-d8d4-4361-89b8-625ced02e2f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:06.414538 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7454e29b-d8d4-4361-89b8-625ced02e2f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1564 microversion: 2.1 time: 0.817268 Jul 20 04:32:06.417727 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2215/4424] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:05 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1564 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:06.442117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-41abc484-05b7-4ab5-a59c-bc1da149fe2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:06.443136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-41abc484-05b7-4ab5-a59c-bc1da149fe2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.472178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41abc484-05b7-4ab5-a59c-bc1da149fe2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.473333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41abc484-05b7-4ab5-a59c-bc1da149fe2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.479831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41abc484-05b7-4ab5-a59c-bc1da149fe2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.480531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41abc484-05b7-4ab5-a59c-bc1da149fe2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.751666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0bfba3ec-dc75-48f4-9197-7d5d2f23e815 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:06.752902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0bfba3ec-dc75-48f4-9197-7d5d2f23e815 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:06.769340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0bfba3ec-dc75-48f4-9197-7d5d2f23e815 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.773983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0bfba3ec-dc75-48f4-9197-7d5d2f23e815 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.775096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0bfba3ec-dc75-48f4-9197-7d5d2f23e815 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:06.778904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0bfba3ec-dc75-48f4-9197-7d5d2f23e815 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.047055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-41abc484-05b7-4ab5-a59c-bc1da149fe2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:07.063527 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-41abc484-05b7-4ab5-a59c-bc1da149fe2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1564 microversion: 2.1 time: 0.631907 Jul 20 04:32:07.068597 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2210/4425] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:06 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1564 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:07.863992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0bfba3ec-dc75-48f4-9197-7d5d2f23e815 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:07.881714 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0bfba3ec-dc75-48f4-9197-7d5d2f23e815 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 1.134192 Jul 20 04:32:07.884463 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2216/4426] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:06 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:08.901679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34be2720-385b-4766-8563-9487438d0ebb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:08.902418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-34be2720-385b-4766-8563-9487438d0ebb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:08.918103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34be2720-385b-4766-8563-9487438d0ebb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.918748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34be2720-385b-4766-8563-9487438d0ebb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.919674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34be2720-385b-4766-8563-9487438d0ebb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.921604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34be2720-385b-4766-8563-9487438d0ebb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.180450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-34be2720-385b-4766-8563-9487438d0ebb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.189695 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-34be2720-385b-4766-8563-9487438d0ebb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 1.292576 Jul 20 04:32:10.208807 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2211/4427] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:08 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:11.213453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7bcf203f-c2c9-4b8f-8dd7-ff6048a6097f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:11.214927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7bcf203f-c2c9-4b8f-8dd7-ff6048a6097f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:11.229746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bcf203f-c2c9-4b8f-8dd7-ff6048a6097f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:11.230557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bcf203f-c2c9-4b8f-8dd7-ff6048a6097f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:11.234971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bcf203f-c2c9-4b8f-8dd7-ff6048a6097f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:11.235884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bcf203f-c2c9-4b8f-8dd7-ff6048a6097f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:11.720479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7bcf203f-c2c9-4b8f-8dd7-ff6048a6097f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:11.747395 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7bcf203f-c2c9-4b8f-8dd7-ff6048a6097f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 0.538044 Jul 20 04:32:11.749864 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2217/4428] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:11 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:12.766720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-30f3fa82-79ea-42e2-94b5-f9d6454d29c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:12.768192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-30f3fa82-79ea-42e2-94b5-f9d6454d29c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:12.772985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:12.786041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30f3fa82-79ea-42e2-94b5-f9d6454d29c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.786862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30f3fa82-79ea-42e2-94b5-f9d6454d29c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.789040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30f3fa82-79ea-42e2-94b5-f9d6454d29c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.789984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30f3fa82-79ea-42e2-94b5-f9d6454d29c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.252251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-30f3fa82-79ea-42e2-94b5-f9d6454d29c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:15.269561 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-30f3fa82-79ea-42e2-94b5-f9d6454d29c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 2.507120 Jul 20 04:32:15.271249 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2212/4429] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:12 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:16.295177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8c03d88-38d1-4091-988e-e59cb7349fd5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:16.296458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f8c03d88-38d1-4091-988e-e59cb7349fd5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:16.307001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:16.315261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8c03d88-38d1-4091-988e-e59cb7349fd5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.319412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8c03d88-38d1-4091-988e-e59cb7349fd5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.321974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8c03d88-38d1-4091-988e-e59cb7349fd5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.322978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8c03d88-38d1-4091-988e-e59cb7349fd5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.346474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f8c03d88-38d1-4091-988e-e59cb7349fd5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:17.357128 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f8c03d88-38d1-4091-988e-e59cb7349fd5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 1.067115 Jul 20 04:32:17.360748 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2218/4430] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:16 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:18.374610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bef4f5fe-fea1-412e-992b-a9bbe350899a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:18.375235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bef4f5fe-fea1-412e-992b-a9bbe350899a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:18.393054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bef4f5fe-fea1-412e-992b-a9bbe350899a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.402875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bef4f5fe-fea1-412e-992b-a9bbe350899a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.404076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bef4f5fe-fea1-412e-992b-a9bbe350899a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.404601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bef4f5fe-fea1-412e-992b-a9bbe350899a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.344756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-254748819", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "14a5d451-75fb-4c3a-a30e-c5c04fce6bc2"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:20.378782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bef4f5fe-fea1-412e-992b-a9bbe350899a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:20.388032 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bef4f5fe-fea1-412e-992b-a9bbe350899a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 2.017395 Jul 20 04:32:20.388835 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2213/4431] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:18 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:20.423055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7bdd964a-59da-45cd-9d82-971e69baa2fa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:20.432250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7bdd964a-59da-45cd-9d82-971e69baa2fa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:20.462208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] validate_networks() for [('14a5d451-75fb-4c3a-a30e-c5c04fce6bc2', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:32:20.467278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bdd964a-59da-45cd-9d82-971e69baa2fa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.467754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bdd964a-59da-45cd-9d82-971e69baa2fa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.468535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bdd964a-59da-45cd-9d82-971e69baa2fa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.468983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bdd964a-59da-45cd-9d82-971e69baa2fa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.023261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7bdd964a-59da-45cd-9d82-971e69baa2fa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:21.034061 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7bdd964a-59da-45cd-9d82-971e69baa2fa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1564 microversion: 2.1 time: 0.628693 Jul 20 04:32:21.035604 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2214/4432] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:20 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1564 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:21.045089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-0d42f008-c3be-40c5-91b4-95daad15420b req-c9fdece2-ff67-4689-a863-a2b1052fc2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6881eb5-fd94-4802-8fb1-ad74e99f0786", "tag": "aba34f57-d50c-4162-ad83-443faa06380d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:21.074860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-0d42f008-c3be-40c5-91b4-95daad15420b req-c9fdece2-ff67-4689-a863-a2b1052fc2d6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.083194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-0d42f008-c3be-40c5-91b4-95daad15420b req-c9fdece2-ff67-4689-a863-a2b1052fc2d6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.145994 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-0d42f008-c3be-40c5-91b4-95daad15420b req-c9fdece2-ff67-4689-a863-a2b1052fc2d6 service nova] Creating event network-changed:aba34f57-d50c-4162-ad83-443faa06380d for instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 on n-h2-760456-11 Jul 20 04:32:21.154306 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-0d42f008-c3be-40c5-91b4-95daad15420b req-c9fdece2-ff67-4689-a863-a2b1052fc2d6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117275 Jul 20 04:32:21.157607 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2215/4433] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:21.405878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f109cb77-3d9d-44d3-96e6-d9663ecc62eb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:21.407392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f109cb77-3d9d-44d3-96e6-d9663ecc62eb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:21.418195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f109cb77-3d9d-44d3-96e6-d9663ecc62eb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.426891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f109cb77-3d9d-44d3-96e6-d9663ecc62eb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.428630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f109cb77-3d9d-44d3-96e6-d9663ecc62eb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.429259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f109cb77-3d9d-44d3-96e6-d9663ecc62eb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:22.257830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:32:22.260395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:32:22.261150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:32:22.261832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:32:22.262559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:32:22.296578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:22.300574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:22.308407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:22.313413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:22.425224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Getting quotas for project 94562eeb7ccf4e3598f06e96e871ef23. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:22.453530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Getting quotas for user 5c1b3b842fb74cbebb1a374b8cb2b053 and project 94562eeb7ccf4e3598f06e96e871ef23. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:22.508371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f109cb77-3d9d-44d3-96e6-d9663ecc62eb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:22.522822 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f109cb77-3d9d-44d3-96e6-d9663ecc62eb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 1.120749 Jul 20 04:32:22.529447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:32:22.532674 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2216/4434] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:21 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:22.543195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:32:22.675534 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d92a511c-8491-4376-be53-ecf1512252f6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.548615 Jul 20 04:32:22.686239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ebb5504-07fd-4b9f-92cf-e85db6d26345 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:22.686920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ebb5504-07fd-4b9f-92cf-e85db6d26345 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:22.701545 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2219/4435] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:32:23.231125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5ebb5504-07fd-4b9f-92cf-e85db6d26345 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:23.240656 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ebb5504-07fd-4b9f-92cf-e85db6d26345 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1214 microversion: 2.1 time: 0.556309 Jul 20 04:32:23.241335 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2217/4436] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:22 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1214 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:23.540130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c2a5fb7-1fc9-4ec6-8077-3e1ab817896b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:23.541404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9c2a5fb7-1fc9-4ec6-8077-3e1ab817896b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:23.556538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c2a5fb7-1fc9-4ec6-8077-3e1ab817896b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.557570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c2a5fb7-1fc9-4ec6-8077-3e1ab817896b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:23.559448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c2a5fb7-1fc9-4ec6-8077-3e1ab817896b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:23.560721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c2a5fb7-1fc9-4ec6-8077-3e1ab817896b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.225711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9c2a5fb7-1fc9-4ec6-8077-3e1ab817896b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.245220 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9c2a5fb7-1fc9-4ec6-8077-3e1ab817896b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 0.709522 Jul 20 04:32:24.266735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-514bfbe1-3c0c-4e18-a8e1-7766ca09825a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:24.269445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-514bfbe1-3c0c-4e18-a8e1-7766ca09825a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:24.294764 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2220/4437] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:23 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:24.298734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-514bfbe1-3c0c-4e18-a8e1-7766ca09825a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.299205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-514bfbe1-3c0c-4e18-a8e1-7766ca09825a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.306534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-514bfbe1-3c0c-4e18-a8e1-7766ca09825a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.311614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-514bfbe1-3c0c-4e18-a8e1-7766ca09825a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.052772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-514bfbe1-3c0c-4e18-a8e1-7766ca09825a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:25.064908 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-514bfbe1-3c0c-4e18-a8e1-7766ca09825a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1266 microversion: 2.1 time: 0.805588 Jul 20 04:32:25.074908 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2218/4438] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:24 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1266 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:25.264443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6e72f017-f3a4-4158-a272-f8108f9737d8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:25.265058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6e72f017-f3a4-4158-a272-f8108f9737d8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:25.284745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e72f017-f3a4-4158-a272-f8108f9737d8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.285551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e72f017-f3a4-4158-a272-f8108f9737d8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.286555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e72f017-f3a4-4158-a272-f8108f9737d8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:25.289259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e72f017-f3a4-4158-a272-f8108f9737d8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:25.935024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6e72f017-f3a4-4158-a272-f8108f9737d8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:25.946654 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6e72f017-f3a4-4158-a272-f8108f9737d8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 0.686087 Jul 20 04:32:25.950327 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2221/4439] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:25 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:26.095656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a35f3dc6-bb72-4cf0-854f-33c3c9cc4623 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:26.096281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a35f3dc6-bb72-4cf0-854f-33c3c9cc4623 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:26.147679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a35f3dc6-bb72-4cf0-854f-33c3c9cc4623 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.148392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a35f3dc6-bb72-4cf0-854f-33c3c9cc4623 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.149230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a35f3dc6-bb72-4cf0-854f-33c3c9cc4623 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.159432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a35f3dc6-bb72-4cf0-854f-33c3c9cc4623 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.967802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c13823ca-ca75-449c-9ff7-5b2c287336c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:26.975985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c13823ca-ca75-449c-9ff7-5b2c287336c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:26.990043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c13823ca-ca75-449c-9ff7-5b2c287336c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.001709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c13823ca-ca75-449c-9ff7-5b2c287336c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.007997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c13823ca-ca75-449c-9ff7-5b2c287336c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.008445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c13823ca-ca75-449c-9ff7-5b2c287336c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.082953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a35f3dc6-bb72-4cf0-854f-33c3c9cc4623 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.163550 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a35f3dc6-bb72-4cf0-854f-33c3c9cc4623 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1272 microversion: 2.1 time: 1.070673 Jul 20 04:32:27.164608 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2219/4440] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:26 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1272 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:27.804498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c13823ca-ca75-449c-9ff7-5b2c287336c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.815756 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c13823ca-ca75-449c-9ff7-5b2c287336c1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 0.852029 Jul 20 04:32:27.832407 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2222/4441] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:26 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:28.207818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c54b10c5-0692-4100-a389-65848bc4cfa4 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:28.208468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c54b10c5-0692-4100-a389-65848bc4cfa4 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:28.233228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c54b10c5-0692-4100-a389-65848bc4cfa4 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.233707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c54b10c5-0692-4100-a389-65848bc4cfa4 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.234554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c54b10c5-0692-4100-a389-65848bc4cfa4 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.235008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c54b10c5-0692-4100-a389-65848bc4cfa4 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.386515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c54b10c5-0692-4100-a389-65848bc4cfa4 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.402000 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c54b10c5-0692-4100-a389-65848bc4cfa4 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1272 microversion: 2.1 time: 0.207596 Jul 20 04:32:28.414216 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2220/4442] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:28 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:28.859299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c249ed66-eddc-4b17-b73f-bad779107368 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:28.860611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c249ed66-eddc-4b17-b73f-bad779107368 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:28.892037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c249ed66-eddc-4b17-b73f-bad779107368 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.902572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c249ed66-eddc-4b17-b73f-bad779107368 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.903919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c249ed66-eddc-4b17-b73f-bad779107368 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.908354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c249ed66-eddc-4b17-b73f-bad779107368 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.421788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b738438-0ab0-478a-bad4-52bc3bab0472 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:29.422638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b738438-0ab0-478a-bad4-52bc3bab0472 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:29.447840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b738438-0ab0-478a-bad4-52bc3bab0472 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.448315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b738438-0ab0-478a-bad4-52bc3bab0472 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.462148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b738438-0ab0-478a-bad4-52bc3bab0472 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.463136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b738438-0ab0-478a-bad4-52bc3bab0472 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.921215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0b738438-0ab0-478a-bad4-52bc3bab0472 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:29.967229 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b738438-0ab0-478a-bad4-52bc3bab0472 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1272 microversion: 2.1 time: 0.551456 Jul 20 04:32:29.971048 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2221/4443] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:29 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1272 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:30.727795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c249ed66-eddc-4b17-b73f-bad779107368 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.749168 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c249ed66-eddc-4b17-b73f-bad779107368 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 1.916045 Jul 20 04:32:30.768385 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2223/4444] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:28 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:30.795171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29f7da58-bd92-400b-837d-c3038de6db7f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:30.799149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-29f7da58-bd92-400b-837d-c3038de6db7f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:30.827451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29f7da58-bd92-400b-837d-c3038de6db7f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.827838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29f7da58-bd92-400b-837d-c3038de6db7f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.828642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29f7da58-bd92-400b-837d-c3038de6db7f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.829094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29f7da58-bd92-400b-837d-c3038de6db7f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.946408 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-29f7da58-bd92-400b-837d-c3038de6db7f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786/action" status: 200 len: 24560 microversion: 2.1 time: 0.159051 Jul 20 04:32:30.953659 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2222/4445] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:30 2022] POST /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786/action => generated 24560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:32:30.988166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1336810d-2580-40b0-ac9d-3b4fecb78a6a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:30.989161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1336810d-2580-40b0-ac9d-3b4fecb78a6a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:31.007662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1336810d-2580-40b0-ac9d-3b4fecb78a6a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.008854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1336810d-2580-40b0-ac9d-3b4fecb78a6a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.014947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1336810d-2580-40b0-ac9d-3b4fecb78a6a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.016471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1336810d-2580-40b0-ac9d-3b4fecb78a6a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.807791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a2214788-36d3-44d5-bd4e-ef493d38ac31 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:31.846779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a2214788-36d3-44d5-bd4e-ef493d38ac31 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:31.888515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2214788-36d3-44d5-bd4e-ef493d38ac31 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.890799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2214788-36d3-44d5-bd4e-ef493d38ac31 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.892653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2214788-36d3-44d5-bd4e-ef493d38ac31 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.896623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2214788-36d3-44d5-bd4e-ef493d38ac31 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.357730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:32.497861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:32.714842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a2214788-36d3-44d5-bd4e-ef493d38ac31 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:32.749855 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a2214788-36d3-44d5-bd4e-ef493d38ac31 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 0.957173 Jul 20 04:32:32.751444 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2223/4446] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:31 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:33.026279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1336810d-2580-40b0-ac9d-3b4fecb78a6a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:33.042098 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1336810d-2580-40b0-ac9d-3b4fecb78a6a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1314 microversion: 2.1 time: 2.058265 Jul 20 04:32:33.051543 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2224/4447] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:30 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1314 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:33.769549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6958a69c-f3d0-48a3-9fa9-153d3fe3e05b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:33.772538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6958a69c-f3d0-48a3-9fa9-153d3fe3e05b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:33.775949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:33.812592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6958a69c-f3d0-48a3-9fa9-153d3fe3e05b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.815893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6958a69c-f3d0-48a3-9fa9-153d3fe3e05b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:33.820079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6958a69c-f3d0-48a3-9fa9-153d3fe3e05b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.820730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6958a69c-f3d0-48a3-9fa9-153d3fe3e05b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.064913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f29b9c1d-600f-4f84-bef0-cca7a912a001 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:34.069973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f29b9c1d-600f-4f84-bef0-cca7a912a001 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:34.097587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f29b9c1d-600f-4f84-bef0-cca7a912a001 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:34.107675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f29b9c1d-600f-4f84-bef0-cca7a912a001 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.108861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f29b9c1d-600f-4f84-bef0-cca7a912a001 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:34.109702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f29b9c1d-600f-4f84-bef0-cca7a912a001 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.575018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6958a69c-f3d0-48a3-9fa9-153d3fe3e05b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:34.589059 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6958a69c-f3d0-48a3-9fa9-153d3fe3e05b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 0.823794 Jul 20 04:32:34.595139 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2224/4448] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:33 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:35.330553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f29b9c1d-600f-4f84-bef0-cca7a912a001 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:35.338285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=64 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:35.384581 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f29b9c1d-600f-4f84-bef0-cca7a912a001 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1314 microversion: 2.1 time: 1.328791 Jul 20 04:32:35.389117 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2225/4449] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:34 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1314 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:35.608321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8ccd05da-055f-460e-8007-175b2ad57de7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:35.610508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8ccd05da-055f-460e-8007-175b2ad57de7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:35.631481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ccd05da-055f-460e-8007-175b2ad57de7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:35.638221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ccd05da-055f-460e-8007-175b2ad57de7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:35.639186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ccd05da-055f-460e-8007-175b2ad57de7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:35.639647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8ccd05da-055f-460e-8007-175b2ad57de7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:35.989438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-19c7f8b1-945b-4dbc-9527-38d3a049292d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: .version_select at 0x7fb842205ee0>, body: {"keypair": {"name": "tempest-keypair-1010040000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI4YtHmxSFVUNGZZq7TQ3UU21+q2MnpB02aeIYzNuNHlRzr1z29fWKECoxpfRr9IhnOdkc/8hASbf3T+RPwfpiPChCpjVTADmyDDwWmOyRShBdLKcvEbUG409KvBQAwQw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:36.087518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-19c7f8b1-945b-4dbc-9527-38d3a049292d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for project e104a7716d8549cb8b99560ac90150c6. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:36.103797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-19c7f8b1-945b-4dbc-9527-38d3a049292d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for user 4bd10ebbd2fd4ef693e15194c2d8912c and project e104a7716d8549cb8b99560ac90150c6. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:36.168448 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-19c7f8b1-945b-4dbc-9527-38d3a049292d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.641029 Jul 20 04:32:36.176563 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2225/4450] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:32:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:36.186341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-bde3a985-6c53-4f06-89b6-d5ca4a854175 req-c71522c6-7a8d-4d79-8406-ce72cf108555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b4eae03-8c72-48d6-a555-d584b72ccbd5", "tag": "948c2908-2923-4d7d-a8bf-219a80fea3b6"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:36.213984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bde3a985-6c53-4f06-89b6-d5ca4a854175 req-c71522c6-7a8d-4d79-8406-ce72cf108555 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:36.215016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bde3a985-6c53-4f06-89b6-d5ca4a854175 req-c71522c6-7a8d-4d79-8406-ce72cf108555 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:36.246265 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-bde3a985-6c53-4f06-89b6-d5ca4a854175 req-c71522c6-7a8d-4d79-8406-ce72cf108555 service nova] Creating event network-changed:948c2908-2923-4d7d-a8bf-219a80fea3b6 for instance 3b4eae03-8c72-48d6-a555-d584b72ccbd5 on n-h1-760456-11 Jul 20 04:32:36.256915 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-bde3a985-6c53-4f06-89b6-d5ca4a854175 req-c71522c6-7a8d-4d79-8406-ce72cf108555 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078332 Jul 20 04:32:36.260233 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2226/4451] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:36.406763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d3560de-b2e7-4a22-83b1-0bd2a98cc413 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:36.407841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d3560de-b2e7-4a22-83b1-0bd2a98cc413 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:36.422364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d3560de-b2e7-4a22-83b1-0bd2a98cc413 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:36.424568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d3560de-b2e7-4a22-83b1-0bd2a98cc413 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:36.427238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d3560de-b2e7-4a22-83b1-0bd2a98cc413 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:36.429087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d3560de-b2e7-4a22-83b1-0bd2a98cc413 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:37.186313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8ccd05da-055f-460e-8007-175b2ad57de7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:37.254568 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8ccd05da-055f-460e-8007-175b2ad57de7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1682 microversion: 2.1 time: 1.651345 Jul 20 04:32:37.255180 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2226/4452] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:35 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1682 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:37.329158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d3560de-b2e7-4a22-83b1-0bd2a98cc413 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:37.338307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=86 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:37.381959 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d3560de-b2e7-4a22-83b1-0bd2a98cc413 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1314 microversion: 2.1 time: 0.977839 Jul 20 04:32:37.389311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8a182031-d86f-4a20-b816-5b8bc5dd27cc tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:37.390230 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2227/4453] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:36 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1314 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:37.390818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8a182031-d86f-4a20-b816-5b8bc5dd27cc tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:37.440746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a182031-d86f-4a20-b816-5b8bc5dd27cc tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:37.444398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a182031-d86f-4a20-b816-5b8bc5dd27cc tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:37.449234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a182031-d86f-4a20-b816-5b8bc5dd27cc tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:37.450058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a182031-d86f-4a20-b816-5b8bc5dd27cc tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.152148 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8a182031-d86f-4a20-b816-5b8bc5dd27cc tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1836 microversion: 2.1 time: 0.767294 Jul 20 04:32:38.152740 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2227/4454] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:37 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1836 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:38.178182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bdb2aa8f-de09-429e-9dd0-73556d053306 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:38.180257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bdb2aa8f-de09-429e-9dd0-73556d053306 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:38.202537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdb2aa8f-de09-429e-9dd0-73556d053306 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.203248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdb2aa8f-de09-429e-9dd0-73556d053306 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.204090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdb2aa8f-de09-429e-9dd0-73556d053306 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.204560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdb2aa8f-de09-429e-9dd0-73556d053306 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.273513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d128b7bb-c348-41ff-9f93-b6efa6df1a80 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:38.274153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d128b7bb-c348-41ff-9f93-b6efa6df1a80 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:38.285806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d128b7bb-c348-41ff-9f93-b6efa6df1a80 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.286298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d128b7bb-c348-41ff-9f93-b6efa6df1a80 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.295402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d128b7bb-c348-41ff-9f93-b6efa6df1a80 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.295811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d128b7bb-c348-41ff-9f93-b6efa6df1a80 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.612156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d128b7bb-c348-41ff-9f93-b6efa6df1a80 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:38.636834 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d128b7bb-c348-41ff-9f93-b6efa6df1a80 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.367718 Jul 20 04:32:38.641148 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2228/4455] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:38 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:38.649975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-11956fe9-a6f1-4773-a3e4-eee7cfd17ded tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:38.652949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-11956fe9-a6f1-4773-a3e4-eee7cfd17ded tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:38.663473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11956fe9-a6f1-4773-a3e4-eee7cfd17ded tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.664494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11956fe9-a6f1-4773-a3e4-eee7cfd17ded tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:38.665657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11956fe9-a6f1-4773-a3e4-eee7cfd17ded tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:38.666390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11956fe9-a6f1-4773-a3e4-eee7cfd17ded tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.190241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bdb2aa8f-de09-429e-9dd0-73556d053306 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:39.204657 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bdb2aa8f-de09-429e-9dd0-73556d053306 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1683 microversion: 2.1 time: 1.038952 Jul 20 04:32:39.207588 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2228/4456] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:38 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1683 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:39.235873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5d81a5b6-d946-4601-a313-733da5dfdb6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:39.241327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5d81a5b6-d946-4601-a313-733da5dfdb6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:39.271554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d81a5b6-d946-4601-a313-733da5dfdb6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.277836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d81a5b6-d946-4601-a313-733da5dfdb6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.278733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d81a5b6-d946-4601-a313-733da5dfdb6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.279195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d81a5b6-d946-4601-a313-733da5dfdb6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.419480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-11956fe9-a6f1-4773-a3e4-eee7cfd17ded tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:39.437780 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-11956fe9-a6f1-4773-a3e4-eee7cfd17ded tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1314 microversion: 2.1 time: 0.793494 Jul 20 04:32:39.446191 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2229/4457] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:38 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:39.463385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c07f7add-7ced-4401-af11-17444b7e7b9f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:39.464713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c07f7add-7ced-4401-af11-17444b7e7b9f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:39.479885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c07f7add-7ced-4401-af11-17444b7e7b9f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.480348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c07f7add-7ced-4401-af11-17444b7e7b9f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.484352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c07f7add-7ced-4401-af11-17444b7e7b9f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.485915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c07f7add-7ced-4401-af11-17444b7e7b9f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.601700 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c07f7add-7ced-4401-af11-17444b7e7b9f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786/action" status: 200 len: 32627 microversion: 2.1 time: 0.144203 Jul 20 04:32:39.609604 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2230/4458] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:39 2022] POST /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786/action => generated 32627 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:32:39.766076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e0151b2-a626-4144-a19d-a420182a0387 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:39.766809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e0151b2-a626-4144-a19d-a420182a0387 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:39.794579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e0151b2-a626-4144-a19d-a420182a0387 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.795201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e0151b2-a626-4144-a19d-a420182a0387 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.796070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e0151b2-a626-4144-a19d-a420182a0387 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:39.796677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e0151b2-a626-4144-a19d-a420182a0387 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:39.911296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e0151b2-a626-4144-a19d-a420182a0387 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0cda8f57395144619ff0d384bcc8c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8270f3bb5234529875e0a8e5ec3771a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:39.913084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e0151b2-a626-4144-a19d-a420182a0387 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] flavor_id is None. Assuming migration. {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:32:39.913718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e0151b2-a626-4144-a19d-a420182a0387 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:32:40.475271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5d81a5b6-d946-4601-a313-733da5dfdb6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:40.484653 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5d81a5b6-d946-4601-a313-733da5dfdb6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 1.262882 Jul 20 04:32:40.494010 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2229/4459] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:39 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:40.776192 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e0151b2-a626-4144-a19d-a420182a0387 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786/action" status: 202 len: 0 microversion: 2.1 time: 1.012855 Jul 20 04:32:40.779402 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2231/4460] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:39 2022] POST /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786/action => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:40.794310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9e7e4bee-0a27-40e7-bebe-e8b77fd648ef tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:40.798006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9e7e4bee-0a27-40e7-bebe-e8b77fd648ef tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:40.845513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e7e4bee-0a27-40e7-bebe-e8b77fd648ef tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.847136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e7e4bee-0a27-40e7-bebe-e8b77fd648ef tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:40.848866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e7e4bee-0a27-40e7-bebe-e8b77fd648ef tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:40.850947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e7e4bee-0a27-40e7-bebe-e8b77fd648ef tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:41.058854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-face290c-4d1b-4102-be2d-a23976ad0ff1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Action: 'create', calling method: .version_select at 0x7fb841cea430>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1916077816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsPoohtCRLh58au9IFMz9cj9XCE2syCSgeSyHcpzHWo3Dn5HuyTjiWGPzk/6+/glaBGRXcvPhhbF5GG8p+tIxcrfModLET7xNEWR8r998/4LHkx3hAmztVkNjEOYBVsBw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:41.101419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-face290c-4d1b-4102-be2d-a23976ad0ff1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Getting quotas for project 371a6852b8f441bfa719ab452a8c0d8a. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:41.118626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-face290c-4d1b-4102-be2d-a23976ad0ff1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Getting quotas for user 9c92ac6d960b4b76ac881b676a00744a and project 371a6852b8f441bfa719ab452a8c0d8a. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:41.191587 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-face290c-4d1b-4102-be2d-a23976ad0ff1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.696083 Jul 20 04:32:41.192415 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2230/4461] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:32:40 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:41.213986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-92e639e9-67e6-4d39-9faa-ee66ca2bcbc4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:41.214656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-92e639e9-67e6-4d39-9faa-ee66ca2bcbc4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:41.233178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92e639e9-67e6-4d39-9faa-ee66ca2bcbc4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:41.233898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92e639e9-67e6-4d39-9faa-ee66ca2bcbc4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:41.235158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92e639e9-67e6-4d39-9faa-ee66ca2bcbc4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:41.237961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92e639e9-67e6-4d39-9faa-ee66ca2bcbc4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:41.538986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9e7e4bee-0a27-40e7-bebe-e8b77fd648ef tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:41.552181 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9e7e4bee-0a27-40e7-bebe-e8b77fd648ef tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1314 microversion: 2.1 time: 0.770466 Jul 20 04:32:41.566081 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2232/4462] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:40 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:41.686123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e53279bf-3f20-4711-8e3f-657dfc3663da req-1d11178a-7165-4365-aab7-c6b544c05c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b78332-e314-4da3-8a21-1ccfa545f11a", "name": "network-vif-unplugged", "status": "completed", "tag": "8c4c6b64-e711-449a-a899-27913ed07df2"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:41.704023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e53279bf-3f20-4711-8e3f-657dfc3663da req-1d11178a-7165-4365-aab7-c6b544c05c6c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:41.704515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e53279bf-3f20-4711-8e3f-657dfc3663da req-1d11178a-7165-4365-aab7-c6b544c05c6c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:41.722637 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e53279bf-3f20-4711-8e3f-657dfc3663da req-1d11178a-7165-4365-aab7-c6b544c05c6c service nova] Creating event network-vif-unplugged:8c4c6b64-e711-449a-a899-27913ed07df2 for instance 44b78332-e314-4da3-8a21-1ccfa545f11a on n-h2-760456-11 Jul 20 04:32:41.751108 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e53279bf-3f20-4711-8e3f-657dfc3663da req-1d11178a-7165-4365-aab7-c6b544c05c6c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074285 Jul 20 04:32:41.752949 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2233/4463] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:42.418282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-487346554", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "7b0934fb-ee96-446d-a65b-fee23ff74766"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:42.556944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] validate_networks() for [('7b0934fb-ee96-446d-a65b-fee23ff74766', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:32:42.627599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-92e639e9-67e6-4d39-9faa-ee66ca2bcbc4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:42.641999 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-92e639e9-67e6-4d39-9faa-ee66ca2bcbc4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1692 microversion: 2.1 time: 1.442414 Jul 20 04:32:42.644766 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2231/4464] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:41 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1692 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:42.658129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0753d95b-e6d7-41de-8a06-a4102011c0ef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:42.659253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0753d95b-e6d7-41de-8a06-a4102011c0ef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:42.675192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0753d95b-e6d7-41de-8a06-a4102011c0ef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:42.676087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0753d95b-e6d7-41de-8a06-a4102011c0ef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:42.677011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0753d95b-e6d7-41de-8a06-a4102011c0ef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:42.680861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0753d95b-e6d7-41de-8a06-a4102011c0ef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:43.355030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0753d95b-e6d7-41de-8a06-a4102011c0ef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:43.364127 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0753d95b-e6d7-41de-8a06-a4102011c0ef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.716022 Jul 20 04:32:43.379055 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2232/4465] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:42 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:43.384663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-87188082-3362-49dc-993d-3d6829fc6f97 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:43.386448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-87188082-3362-49dc-993d-3d6829fc6f97 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:43.388770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:43.403519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87188082-3362-49dc-993d-3d6829fc6f97 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:43.404406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87188082-3362-49dc-993d-3d6829fc6f97 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:43.405479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87188082-3362-49dc-993d-3d6829fc6f97 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:43.406208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87188082-3362-49dc-993d-3d6829fc6f97 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:43.770427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-87188082-3362-49dc-993d-3d6829fc6f97 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:43.783848 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-87188082-3362-49dc-993d-3d6829fc6f97 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1314 microversion: 2.1 time: 0.401967 Jul 20 04:32:43.785500 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2233/4466] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:43 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:43.799508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d8aa6d6-aaa0-4800-a84e-9dea88e17521 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:43.801059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8d8aa6d6-aaa0-4800-a84e-9dea88e17521 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:43.818452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d8aa6d6-aaa0-4800-a84e-9dea88e17521 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:43.819080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d8aa6d6-aaa0-4800-a84e-9dea88e17521 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:43.821203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d8aa6d6-aaa0-4800-a84e-9dea88e17521 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:43.822877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d8aa6d6-aaa0-4800-a84e-9dea88e17521 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.481196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8d8aa6d6-aaa0-4800-a84e-9dea88e17521 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:44.494719 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8d8aa6d6-aaa0-4800-a84e-9dea88e17521 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.704376 Jul 20 04:32:44.496089 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2234/4467] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:43 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:44.514482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-77b6503a-5862-4ebe-a8cf-150053e50463 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:44.515380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-77b6503a-5862-4ebe-a8cf-150053e50463 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:44.524481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77b6503a-5862-4ebe-a8cf-150053e50463 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.532468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77b6503a-5862-4ebe-a8cf-150053e50463 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.533741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77b6503a-5862-4ebe-a8cf-150053e50463 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.534464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77b6503a-5862-4ebe-a8cf-150053e50463 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.903923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:32:44.904502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:32:44.904838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:32:44.905255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:32:44.905677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:32:44.920700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.922933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.924813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.925963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.968437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:44.980889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for user f224517836bf403a83da9e2e7f175907 and project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:44.998721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:32:45.002419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:32:45.127313 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-401f2ea3-dda5-45a6-bdaf-568f2ee478a8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.845185 Jul 20 04:32:45.134225 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2234/4468] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:32:45.150662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ca0c15b2-ae0e-4641-a8ad-c44d6a1eda9c req-bc8a70d7-1e8c-45d1-a59f-e5db71ca0347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4eae03-8c72-48d6-a555-d584b72ccbd5", "name": "network-vif-plugged", "status": "completed", "tag": "948c2908-2923-4d7d-a8bf-219a80fea3b6"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:45.175979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ca0c15b2-ae0e-4641-a8ad-c44d6a1eda9c req-bc8a70d7-1e8c-45d1-a59f-e5db71ca0347 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:45.180897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ca0c15b2-ae0e-4641-a8ad-c44d6a1eda9c req-bc8a70d7-1e8c-45d1-a59f-e5db71ca0347 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.249401 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ca0c15b2-ae0e-4641-a8ad-c44d6a1eda9c req-bc8a70d7-1e8c-45d1-a59f-e5db71ca0347 service nova] Creating event network-vif-plugged:948c2908-2923-4d7d-a8bf-219a80fea3b6 for instance 3b4eae03-8c72-48d6-a555-d584b72ccbd5 on n-h1-760456-11 Jul 20 04:32:45.262275 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ca0c15b2-ae0e-4641-a8ad-c44d6a1eda9c req-bc8a70d7-1e8c-45d1-a59f-e5db71ca0347 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124896 Jul 20 04:32:45.263694 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2235/4469] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:45.300302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37fa299f-6c45-4aa6-942e-e0c7a48cab33 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:45.311710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37fa299f-6c45-4aa6-942e-e0c7a48cab33 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:45.331131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37fa299f-6c45-4aa6-942e-e0c7a48cab33 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:45.332762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37fa299f-6c45-4aa6-942e-e0c7a48cab33 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.334859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37fa299f-6c45-4aa6-942e-e0c7a48cab33 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:45.336642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37fa299f-6c45-4aa6-942e-e0c7a48cab33 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.382466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-77b6503a-5862-4ebe-a8cf-150053e50463 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:45.394956 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-77b6503a-5862-4ebe-a8cf-150053e50463 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1692 microversion: 2.1 time: 0.897013 Jul 20 04:32:45.395808 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2235/4470] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:44 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1692 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:45.415291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-616e84a5-ca64-4a7c-8c38-923d128d7763 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:45.417663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-616e84a5-ca64-4a7c-8c38-923d128d7763 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:45.434171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-616e84a5-ca64-4a7c-8c38-923d128d7763 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:45.435085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-616e84a5-ca64-4a7c-8c38-923d128d7763 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.438497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-616e84a5-ca64-4a7c-8c38-923d128d7763 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:45.439744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-616e84a5-ca64-4a7c-8c38-923d128d7763 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.951399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-616e84a5-ca64-4a7c-8c38-923d128d7763 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:45.960536 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-616e84a5-ca64-4a7c-8c38-923d128d7763 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1314 microversion: 2.1 time: 0.562058 Jul 20 04:32:45.977201 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2236/4471] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:45 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:45.985446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f0eeacb-c867-483a-9615-f1b8bf02bcbe tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:45.988421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f0eeacb-c867-483a-9615-f1b8bf02bcbe tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:46.087163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-37fa299f-6c45-4aa6-942e-e0c7a48cab33 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:46.100531 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37fa299f-6c45-4aa6-942e-e0c7a48cab33 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.832928 Jul 20 04:32:46.101996 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2236/4472] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:45 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:46.120896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5662019-8cad-4223-9809-228cf08a6dae tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:46.123588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5662019-8cad-4223-9809-228cf08a6dae tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:46.141631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f0eeacb-c867-483a-9615-f1b8bf02bcbe tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:46.149752 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f0eeacb-c867-483a-9615-f1b8bf02bcbe tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1192 microversion: 2.1 time: 0.169179 Jul 20 04:32:46.158865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5662019-8cad-4223-9809-228cf08a6dae tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.159412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5662019-8cad-4223-9809-228cf08a6dae tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.161197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5662019-8cad-4223-9809-228cf08a6dae tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.162737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5662019-8cad-4223-9809-228cf08a6dae tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.171057 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2237/4473] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:45 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1192 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:46.350116 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5662019-8cad-4223-9809-228cf08a6dae tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.235878 Jul 20 04:32:46.351178 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2237/4474] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:46 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:32:46.359379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa414876-b386-406b-887f-9d810007dd6f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:46.368582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fa414876-b386-406b-887f-9d810007dd6f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:46.379707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa414876-b386-406b-887f-9d810007dd6f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.380635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa414876-b386-406b-887f-9d810007dd6f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.384656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa414876-b386-406b-887f-9d810007dd6f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.386373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa414876-b386-406b-887f-9d810007dd6f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.419987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37d19950-6cdc-4662-99c9-be191432b1d1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:46.426748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37d19950-6cdc-4662-99c9-be191432b1d1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:46.437590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37d19950-6cdc-4662-99c9-be191432b1d1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.438069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37d19950-6cdc-4662-99c9-be191432b1d1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:46.438907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37d19950-6cdc-4662-99c9-be191432b1d1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:46.449888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37d19950-6cdc-4662-99c9-be191432b1d1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:47.109582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-37d19950-6cdc-4662-99c9-be191432b1d1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:47.124372 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37d19950-6cdc-4662-99c9-be191432b1d1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1692 microversion: 2.1 time: 0.712995 Jul 20 04:32:47.126598 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2238/4475] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:46 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1692 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:47.138688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5380b90b-b640-4d97-b31e-f0150af01fad tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:47.146632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5380b90b-b640-4d97-b31e-f0150af01fad tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:47.161235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:47.173086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5380b90b-b640-4d97-b31e-f0150af01fad tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.173644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5380b90b-b640-4d97-b31e-f0150af01fad tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:47.174838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5380b90b-b640-4d97-b31e-f0150af01fad tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.175455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5380b90b-b640-4d97-b31e-f0150af01fad tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:47.298423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fa414876-b386-406b-887f-9d810007dd6f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:47.311508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa414876-b386-406b-887f-9d810007dd6f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1671 microversion: 2.1 time: 0.955671 Jul 20 04:32:47.312787 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2238/4476] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:46 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1671 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:47.324943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1784812729", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "383b582b-f62e-45d5-8b36-660b1731bf20"}], "security_groups": [{"name": "tempest-securitygroup--61433722"}], "key_name": "tempest-keypair-1010040000", "user_data": "}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:47.551163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5380b90b-b640-4d97-b31e-f0150af01fad tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:47.567319 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5380b90b-b640-4d97-b31e-f0150af01fad tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1501 microversion: 2.1 time: 0.435604 Jul 20 04:32:47.569771 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2239/4477] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:47 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1501 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:47.575063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6f14034-c9d3-4822-a2f2-425b78369c19 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:47.575900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6f14034-c9d3-4822-a2f2-425b78369c19 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:47.583329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6f14034-c9d3-4822-a2f2-425b78369c19 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.584031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6f14034-c9d3-4822-a2f2-425b78369c19 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:47.585003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6f14034-c9d3-4822-a2f2-425b78369c19 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.585648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6f14034-c9d3-4822-a2f2-425b78369c19 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:47.594188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] validate_networks() for [('383b582b-f62e-45d5-8b36-660b1731bf20', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:32:47.694950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6f14034-c9d3-4822-a2f2-425b78369c19 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:47.710395 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6f14034-c9d3-4822-a2f2-425b78369c19 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1250 microversion: 2.1 time: 0.134992 Jul 20 04:32:47.711120 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2240/4478] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:47 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1250 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:47.724246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f01f0c6b-d760-4da6-aba1-9612df3d86c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:47.724878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f01f0c6b-d760-4da6-aba1-9612df3d86c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:47.736161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f01f0c6b-d760-4da6-aba1-9612df3d86c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.737196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f01f0c6b-d760-4da6-aba1-9612df3d86c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:47.738555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f01f0c6b-d760-4da6-aba1-9612df3d86c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:47.739383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f01f0c6b-d760-4da6-aba1-9612df3d86c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.331095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f01f0c6b-d760-4da6-aba1-9612df3d86c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:48.343271 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f01f0c6b-d760-4da6-aba1-9612df3d86c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1501 microversion: 2.1 time: 0.631008 Jul 20 04:32:48.344151 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2241/4479] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:47 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1501 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:48.367960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-961fcebd-b233-4f55-a81f-8dffedd49b2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:48.368772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-961fcebd-b233-4f55-a81f-8dffedd49b2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:48.378698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-961fcebd-b233-4f55-a81f-8dffedd49b2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.379379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-961fcebd-b233-4f55-a81f-8dffedd49b2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.380442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-961fcebd-b233-4f55-a81f-8dffedd49b2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.381101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-961fcebd-b233-4f55-a81f-8dffedd49b2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.409673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:48.614781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-961fcebd-b233-4f55-a81f-8dffedd49b2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:48.627881 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-961fcebd-b233-4f55-a81f-8dffedd49b2b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1697 microversion: 2.1 time: 0.268957 Jul 20 04:32:48.630599 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2242/4480] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:48 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1697 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:48.636775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-43a8a10f-026f-4baa-ac08-e6764ae6da3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:48.637800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-43a8a10f-026f-4baa-ac08-e6764ae6da3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:48.664028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43a8a10f-026f-4baa-ac08-e6764ae6da3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.665065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43a8a10f-026f-4baa-ac08-e6764ae6da3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.667754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43a8a10f-026f-4baa-ac08-e6764ae6da3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.668326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43a8a10f-026f-4baa-ac08-e6764ae6da3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.940395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-43a8a10f-026f-4baa-ac08-e6764ae6da3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:48.949596 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-43a8a10f-026f-4baa-ac08-e6764ae6da3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1671 microversion: 2.1 time: 0.317500 Jul 20 04:32:48.964527 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2243/4481] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:48 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1671 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:48.969710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37e4aef2-1349-463c-ab85-57168f8093c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:48.970282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37e4aef2-1349-463c-ab85-57168f8093c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:48.989451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37e4aef2-1349-463c-ab85-57168f8093c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.991925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37e4aef2-1349-463c-ab85-57168f8093c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:48.994474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37e4aef2-1349-463c-ab85-57168f8093c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:48.996042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37e4aef2-1349-463c-ab85-57168f8093c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.065243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-37e4aef2-1349-463c-ab85-57168f8093c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lazy-loading 'flavor' on Instance uuid 3b4eae03-8c72-48d6-a555-d584b72ccbd5 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:32:49.218517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:32:49.219107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:32:49.219631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:32:49.220047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:32:49.220815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:32:49.244417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.244909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.246190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.248490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.272981 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37e4aef2-1349-463c-ab85-57168f8093c7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "POST /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5/action" status: 202 len: 0 microversion: 2.1 time: 0.306990 Jul 20 04:32:49.276867 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2244/4482] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:48 2022] POST /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:49.285268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aa64de0e-b59d-4036-80ad-7dcc5cb28552 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:49.286068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aa64de0e-b59d-4036-80ad-7dcc5cb28552 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:49.301422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa64de0e-b59d-4036-80ad-7dcc5cb28552 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.311069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa64de0e-b59d-4036-80ad-7dcc5cb28552 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.312221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa64de0e-b59d-4036-80ad-7dcc5cb28552 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.315398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for project e104a7716d8549cb8b99560ac90150c6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:49.323014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa64de0e-b59d-4036-80ad-7dcc5cb28552 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.329978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for user 4bd10ebbd2fd4ef693e15194c2d8912c and project e104a7716d8549cb8b99560ac90150c6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:49.361049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:32:49.363722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:32:49.467577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aa64de0e-b59d-4036-80ad-7dcc5cb28552 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:49.475565 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aa64de0e-b59d-4036-80ad-7dcc5cb28552 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1250 microversion: 2.1 time: 0.197149 Jul 20 04:32:49.488269 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-60a6d56e-b54d-4c6f-99c3-07707e07b168 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.171859 Jul 20 04:32:49.489639 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2239/4483] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:47 2022] POST /compute/v2.1/servers => generated 400 bytes in 2174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:32:49.498333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-11b9eb92-771d-46bb-a56d-83056e321299 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:49.499287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-11b9eb92-771d-46bb-a56d-83056e321299 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:49.507325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11b9eb92-771d-46bb-a56d-83056e321299 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.508520 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2245/4484] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:49 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1250 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:49.508830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11b9eb92-771d-46bb-a56d-83056e321299 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.510316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11b9eb92-771d-46bb-a56d-83056e321299 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.511136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11b9eb92-771d-46bb-a56d-83056e321299 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.512933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a3089ca-e3f6-4f82-ad97-9783d86ae304 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:49.513560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5a3089ca-e3f6-4f82-ad97-9783d86ae304 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:49.648867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a3089ca-e3f6-4f82-ad97-9783d86ae304 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:49.656440 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5a3089ca-e3f6-4f82-ad97-9783d86ae304 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1242 microversion: 2.1 time: 0.147187 Jul 20 04:32:49.670869 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2246/4485] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:49 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:49.682465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7ef7fecf-f84f-4c0e-ac7a-c58d1352dbc7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:49.683380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7ef7fecf-f84f-4c0e-ac7a-c58d1352dbc7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:49.701476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ef7fecf-f84f-4c0e-ac7a-c58d1352dbc7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.707335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ef7fecf-f84f-4c0e-ac7a-c58d1352dbc7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:49.709008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ef7fecf-f84f-4c0e-ac7a-c58d1352dbc7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:49.709655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ef7fecf-f84f-4c0e-ac7a-c58d1352dbc7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:50.040467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7ef7fecf-f84f-4c0e-ac7a-c58d1352dbc7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:50.049556 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7ef7fecf-f84f-4c0e-ac7a-c58d1352dbc7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1697 microversion: 2.1 time: 0.377123 Jul 20 04:32:50.062730 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2247/4486] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:49 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1697 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:50.068927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-84fca72d-18c5-40a7-9382-0529112434d4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:50.069842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-84fca72d-18c5-40a7-9382-0529112434d4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:50.080217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84fca72d-18c5-40a7-9382-0529112434d4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:50.080963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84fca72d-18c5-40a7-9382-0529112434d4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:50.082875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84fca72d-18c5-40a7-9382-0529112434d4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:50.084169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84fca72d-18c5-40a7-9382-0529112434d4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:50.088152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-11b9eb92-771d-46bb-a56d-83056e321299 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:50.099893 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-11b9eb92-771d-46bb-a56d-83056e321299 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1509 microversion: 2.1 time: 0.608265 Jul 20 04:32:50.107508 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2240/4487] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:49 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1509 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:50.409175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-84fca72d-18c5-40a7-9382-0529112434d4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:50.419657 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-84fca72d-18c5-40a7-9382-0529112434d4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.355733 Jul 20 04:32:50.436745 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2248/4488] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:50 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:50.443282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-00305284-bd91-4d4b-bd6a-9b9616af2841 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:50.445868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-00305284-bd91-4d4b-bd6a-9b9616af2841 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:50.457893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00305284-bd91-4d4b-bd6a-9b9616af2841 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:50.462958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00305284-bd91-4d4b-bd6a-9b9616af2841 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:50.464022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00305284-bd91-4d4b-bd6a-9b9616af2841 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:50.464625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-00305284-bd91-4d4b-bd6a-9b9616af2841 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:50.493119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f6658b0-588c-4742-9ac1-9f26a766d0ef tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:50.494422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3f6658b0-588c-4742-9ac1-9f26a766d0ef tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:50.510310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f6658b0-588c-4742-9ac1-9f26a766d0ef tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:50.510808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f6658b0-588c-4742-9ac1-9f26a766d0ef tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:50.516069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f6658b0-588c-4742-9ac1-9f26a766d0ef tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:50.516545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f6658b0-588c-4742-9ac1-9f26a766d0ef tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:50.602027 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-00305284-bd91-4d4b-bd6a-9b9616af2841 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 200 len: 322 microversion: 2.1 time: 0.163122 Jul 20 04:32:50.607330 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2241/4489] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:50 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:50.621885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f760af6-3358-4743-99d1-d4f32fe90de1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:50.622651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f760af6-3358-4743-99d1-d4f32fe90de1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:50.656996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f760af6-3358-4743-99d1-d4f32fe90de1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:50.657468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f760af6-3358-4743-99d1-d4f32fe90de1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:50.658338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f760af6-3358-4743-99d1-d4f32fe90de1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:50.658749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f760af6-3358-4743-99d1-d4f32fe90de1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.120719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3f6658b0-588c-4742-9ac1-9f26a766d0ef tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:51.142674 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f6658b0-588c-4742-9ac1-9f26a766d0ef tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1292 microversion: 2.1 time: 0.647125 Jul 20 04:32:51.143362 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2249/4490] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:50 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1292 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:51.148608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-234f3273-0e68-4597-91e5-cc6471014dbd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:51.155151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-234f3273-0e68-4597-91e5-cc6471014dbd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:51.166540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-234f3273-0e68-4597-91e5-cc6471014dbd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.167358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-234f3273-0e68-4597-91e5-cc6471014dbd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.168358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-234f3273-0e68-4597-91e5-cc6471014dbd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.169443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-234f3273-0e68-4597-91e5-cc6471014dbd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.410738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f760af6-3358-4743-99d1-d4f32fe90de1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:51.422949 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f760af6-3358-4743-99d1-d4f32fe90de1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.814236 Jul 20 04:32:51.437414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2242/4491] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:50 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:51.442949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-54a87e35-6807-421c-870d-d44704f5ba35 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:51.444200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-54a87e35-6807-421c-870d-d44704f5ba35 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:51.453722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a87e35-6807-421c-870d-d44704f5ba35 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.454425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a87e35-6807-421c-870d-d44704f5ba35 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.455400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a87e35-6807-421c-870d-d44704f5ba35 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.456022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a87e35-6807-421c-870d-d44704f5ba35 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.520036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-234f3273-0e68-4597-91e5-cc6471014dbd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:51.534590 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-234f3273-0e68-4597-91e5-cc6471014dbd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1294 microversion: 2.1 time: 0.389791 Jul 20 04:32:51.537901 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2250/4492] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:51 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1294 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:51.555375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-982f1601-ef75-46ae-9c1b-77269eafaf92 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:51.556512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-982f1601-ef75-46ae-9c1b-77269eafaf92 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:51.570476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-982f1601-ef75-46ae-9c1b-77269eafaf92 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.579437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-982f1601-ef75-46ae-9c1b-77269eafaf92 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.580528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-982f1601-ef75-46ae-9c1b-77269eafaf92 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.581156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-982f1601-ef75-46ae-9c1b-77269eafaf92 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.904288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-54a87e35-6807-421c-870d-d44704f5ba35 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:51.916389 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-54a87e35-6807-421c-870d-d44704f5ba35 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1697 microversion: 2.1 time: 0.477341 Jul 20 04:32:51.917131 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2243/4493] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:51 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1697 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:51.936978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-11fb93fe-b006-45a1-b70d-79e4aad580be tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:51.938788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-11fb93fe-b006-45a1-b70d-79e4aad580be tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:51.959475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb93fe-b006-45a1-b70d-79e4aad580be tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.959951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb93fe-b006-45a1-b70d-79e4aad580be tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:51.962737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb93fe-b006-45a1-b70d-79e4aad580be tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:51.963220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11fb93fe-b006-45a1-b70d-79e4aad580be tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:52.181925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-982f1601-ef75-46ae-9c1b-77269eafaf92 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:52.198571 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-982f1601-ef75-46ae-9c1b-77269eafaf92 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1492 microversion: 2.1 time: 0.656113 Jul 20 04:32:52.199182 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2251/4494] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:51 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1492 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:52.204340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f73c888a-374f-41bd-a20a-399ceaed7424 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:52.210671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f73c888a-374f-41bd-a20a-399ceaed7424 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:52.230708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f73c888a-374f-41bd-a20a-399ceaed7424 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:52.231313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f73c888a-374f-41bd-a20a-399ceaed7424 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:52.232179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f73c888a-374f-41bd-a20a-399ceaed7424 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:52.232632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f73c888a-374f-41bd-a20a-399ceaed7424 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:52.667076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f73c888a-374f-41bd-a20a-399ceaed7424 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:52.689112 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f73c888a-374f-41bd-a20a-399ceaed7424 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1292 microversion: 2.1 time: 0.488487 Jul 20 04:32:52.691183 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2252/4495] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:52 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1292 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:52.716045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2a99dcf6-3c9a-498f-9fc1-e5a0aba64c3b tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:52.725361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2a99dcf6-3c9a-498f-9fc1-e5a0aba64c3b tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:52.750198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a99dcf6-3c9a-498f-9fc1-e5a0aba64c3b tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:52.751019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a99dcf6-3c9a-498f-9fc1-e5a0aba64c3b tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:52.752693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a99dcf6-3c9a-498f-9fc1-e5a0aba64c3b tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:52.753156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a99dcf6-3c9a-498f-9fc1-e5a0aba64c3b tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:52.917987 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2a99dcf6-3c9a-498f-9fc1-e5a0aba64c3b tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "POST /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5/action" status: 202 len: 0 microversion: 2.1 time: 0.223880 Jul 20 04:32:52.922542 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2253/4496] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:52 2022] POST /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:32:52.936550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c345c304-c04a-4091-b9a5-5173a04a646a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:52.938564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c345c304-c04a-4091-b9a5-5173a04a646a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:52.981067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c345c304-c04a-4091-b9a5-5173a04a646a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:52.982864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c345c304-c04a-4091-b9a5-5173a04a646a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:52.984649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c345c304-c04a-4091-b9a5-5173a04a646a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:52.988077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c345c304-c04a-4091-b9a5-5173a04a646a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:53.514165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-11fb93fe-b006-45a1-b70d-79e4aad580be tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:53.527710 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-11fb93fe-b006-45a1-b70d-79e4aad580be tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 1.607565 Jul 20 04:32:53.534647 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2244/4497] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:51 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:53.541318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cbe01af0-4c90-4307-82f1-539d255635b6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:53.542492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cbe01af0-4c90-4307-82f1-539d255635b6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:53.550993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbe01af0-4c90-4307-82f1-539d255635b6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:53.551570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbe01af0-4c90-4307-82f1-539d255635b6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:53.553870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbe01af0-4c90-4307-82f1-539d255635b6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:53.557860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbe01af0-4c90-4307-82f1-539d255635b6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.026346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c345c304-c04a-4091-b9a5-5173a04a646a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:54.041833 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c345c304-c04a-4091-b9a5-5173a04a646a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1300 microversion: 2.1 time: 1.115750 Jul 20 04:32:54.055395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cbe01af0-4c90-4307-82f1-539d255635b6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:54.064259 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cbe01af0-4c90-4307-82f1-539d255635b6 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1498 microversion: 2.1 time: 0.528329 Jul 20 04:32:54.065555 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2245/4498] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:53 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1498 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:54.071218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-de588841-ab68-4550-baba-3f121bbeef6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:54.072416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-de588841-ab68-4550-baba-3f121bbeef6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:54.073990 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2254/4499] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:52 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1300 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:54.079492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de588841-ab68-4550-baba-3f121bbeef6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.080165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de588841-ab68-4550-baba-3f121bbeef6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.081245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de588841-ab68-4550-baba-3f121bbeef6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.082759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de588841-ab68-4550-baba-3f121bbeef6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.091664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1ca91466-8d8c-4602-a2d5-8f2365609575 req-58902acc-bcd5-439f-bfd1-4a6d329c7010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f", "tag": "ccda5a64-d554-4528-8f90-8440290a063a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:54.113766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1ca91466-8d8c-4602-a2d5-8f2365609575 req-58902acc-bcd5-439f-bfd1-4a6d329c7010 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.117387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1ca91466-8d8c-4602-a2d5-8f2365609575 req-58902acc-bcd5-439f-bfd1-4a6d329c7010 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.152460 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1ca91466-8d8c-4602-a2d5-8f2365609575 req-58902acc-bcd5-439f-bfd1-4a6d329c7010 service nova] Creating event network-changed:ccda5a64-d554-4528-8f90-8440290a063a for instance 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f on n-h2-760456-11 Jul 20 04:32:54.157973 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1ca91466-8d8c-4602-a2d5-8f2365609575 req-58902acc-bcd5-439f-bfd1-4a6d329c7010 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081244 Jul 20 04:32:54.158972 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2255/4500] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:54.166057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a19eb008-0112-443f-a6ff-1e9cdc541cbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:54.167265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a19eb008-0112-443f-a6ff-1e9cdc541cbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:54.175423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a19eb008-0112-443f-a6ff-1e9cdc541cbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.176261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a19eb008-0112-443f-a6ff-1e9cdc541cbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.177492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a19eb008-0112-443f-a6ff-1e9cdc541cbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.178189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a19eb008-0112-443f-a6ff-1e9cdc541cbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.647411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-de588841-ab68-4550-baba-3f121bbeef6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:54.668411 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-de588841-ab68-4550-baba-3f121bbeef6d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1697 microversion: 2.1 time: 0.597311 Jul 20 04:32:54.687394 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2246/4501] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:54 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1697 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:54.704182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-97a0dab6-2f9a-484f-a2a5-caeaa75e9962 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:54.714211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-97a0dab6-2f9a-484f-a2a5-caeaa75e9962 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:54.745678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97a0dab6-2f9a-484f-a2a5-caeaa75e9962 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.746141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97a0dab6-2f9a-484f-a2a5-caeaa75e9962 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.746967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97a0dab6-2f9a-484f-a2a5-caeaa75e9962 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.751118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97a0dab6-2f9a-484f-a2a5-caeaa75e9962 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.784521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:54.840299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a19eb008-0112-443f-a6ff-1e9cdc541cbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:54.856466 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a19eb008-0112-443f-a6ff-1e9cdc541cbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.695987 Jul 20 04:32:54.857335 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2256/4502] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:54 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:54.873629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-433953fb-b90b-4c9f-9355-5f50c19a665b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:54.874536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-433953fb-b90b-4c9f-9355-5f50c19a665b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:54.890046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-433953fb-b90b-4c9f-9355-5f50c19a665b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.890785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-433953fb-b90b-4c9f-9355-5f50c19a665b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.893002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-433953fb-b90b-4c9f-9355-5f50c19a665b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:54.893919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-433953fb-b90b-4c9f-9355-5f50c19a665b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:54.961629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:55.080682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-97a0dab6-2f9a-484f-a2a5-caeaa75e9962 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:55.090783 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-97a0dab6-2f9a-484f-a2a5-caeaa75e9962 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1292 microversion: 2.1 time: 0.402218 Jul 20 04:32:55.092389 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2247/4503] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:54 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1292 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:55.099557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ce5ea54d-3462-446e-b8de-bca220d02a0c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:55.100570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ce5ea54d-3462-446e-b8de-bca220d02a0c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:55.108525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce5ea54d-3462-446e-b8de-bca220d02a0c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.109313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce5ea54d-3462-446e-b8de-bca220d02a0c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.110368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce5ea54d-3462-446e-b8de-bca220d02a0c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.111040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce5ea54d-3462-446e-b8de-bca220d02a0c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.200979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ce5ea54d-3462-446e-b8de-bca220d02a0c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:55.214994 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ce5ea54d-3462-446e-b8de-bca220d02a0c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1300 microversion: 2.1 time: 0.119052 Jul 20 04:32:55.215744 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2248/4504] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:55 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:55.225918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9dd4a299-81de-4ced-82db-32ed238bbdcf tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:55.229938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9dd4a299-81de-4ced-82db-32ed238bbdcf tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:55.242999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9dd4a299-81de-4ced-82db-32ed238bbdcf tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.245380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9dd4a299-81de-4ced-82db-32ed238bbdcf tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.247210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9dd4a299-81de-4ced-82db-32ed238bbdcf tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.249335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9dd4a299-81de-4ced-82db-32ed238bbdcf tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.605218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9dd4a299-81de-4ced-82db-32ed238bbdcf tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:55.626017 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9dd4a299-81de-4ced-82db-32ed238bbdcf tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1498 microversion: 2.1 time: 0.408593 Jul 20 04:32:55.642224 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2249/4505] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:55 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1498 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:55.709926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bab319a6-1cb3-4c19-acbd-7e0c31b5435d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:55.710865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bab319a6-1cb3-4c19-acbd-7e0c31b5435d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:55.733860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab319a6-1cb3-4c19-acbd-7e0c31b5435d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.737194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab319a6-1cb3-4c19-acbd-7e0c31b5435d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.738539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-433953fb-b90b-4c9f-9355-5f50c19a665b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:55.740015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab319a6-1cb3-4c19-acbd-7e0c31b5435d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:55.742867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab319a6-1cb3-4c19-acbd-7e0c31b5435d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:55.761421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:55.766278 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-433953fb-b90b-4c9f-9355-5f50c19a665b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.896459 Jul 20 04:32:55.767454 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2257/4506] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:54 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:55.972207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1299640120", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "4388b376-1cd5-454f-a519-55f9a04383ba"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:56.081123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bab319a6-1cb3-4c19-acbd-7e0c31b5435d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:56.094061 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bab319a6-1cb3-4c19-acbd-7e0c31b5435d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1697 microversion: 2.1 time: 0.395733 Jul 20 04:32:56.097892 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2250/4507] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:55 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1697 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:56.100998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] validate_networks() for [('4388b376-1cd5-454f-a519-55f9a04383ba', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:32:56.112563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-994f42fe-67d8-4b6f-ad78-58dee4febe2d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:56.113459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-994f42fe-67d8-4b6f-ad78-58dee4febe2d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:56.121040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-994f42fe-67d8-4b6f-ad78-58dee4febe2d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.121495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-994f42fe-67d8-4b6f-ad78-58dee4febe2d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.122705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-994f42fe-67d8-4b6f-ad78-58dee4febe2d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.123316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-994f42fe-67d8-4b6f-ad78-58dee4febe2d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.356819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-994f42fe-67d8-4b6f-ad78-58dee4febe2d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:56.365914 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-994f42fe-67d8-4b6f-ad78-58dee4febe2d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1292 microversion: 2.1 time: 0.257440 Jul 20 04:32:56.366600 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2251/4508] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:56 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1292 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:56.379930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ce40dce5-6719-47df-a8f8-85091dba393c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:56.380599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ce40dce5-6719-47df-a8f8-85091dba393c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:56.393070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce40dce5-6719-47df-a8f8-85091dba393c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.393539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce40dce5-6719-47df-a8f8-85091dba393c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.400960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce40dce5-6719-47df-a8f8-85091dba393c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.401641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce40dce5-6719-47df-a8f8-85091dba393c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.680867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ce40dce5-6719-47df-a8f8-85091dba393c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:56.689515 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ce40dce5-6719-47df-a8f8-85091dba393c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1366 microversion: 2.1 time: 0.321831 Jul 20 04:32:56.691414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2252/4509] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:56 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:56.697519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e0ecccb6-f53c-424e-9d01-4419a5341e17 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:56.698381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e0ecccb6-f53c-424e-9d01-4419a5341e17 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:56.708136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0ecccb6-f53c-424e-9d01-4419a5341e17 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.711119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0ecccb6-f53c-424e-9d01-4419a5341e17 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.712697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0ecccb6-f53c-424e-9d01-4419a5341e17 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:56.713365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0ecccb6-f53c-424e-9d01-4419a5341e17 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:56.966913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e0ecccb6-f53c-424e-9d01-4419a5341e17 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:56.979617 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e0ecccb6-f53c-424e-9d01-4419a5341e17 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1501 microversion: 2.1 time: 0.286796 Jul 20 04:32:56.982399 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2253/4510] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:56 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1501 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:57.009450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-601c2d3e-79b9-4dd6-887d-e5dcef8e6267 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:57.010410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-601c2d3e-79b9-4dd6-887d-e5dcef8e6267 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:57.028018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-601c2d3e-79b9-4dd6-887d-e5dcef8e6267 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.029107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-601c2d3e-79b9-4dd6-887d-e5dcef8e6267 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.031114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-601c2d3e-79b9-4dd6-887d-e5dcef8e6267 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.032069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-601c2d3e-79b9-4dd6-887d-e5dcef8e6267 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.064823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-601c2d3e-79b9-4dd6-887d-e5dcef8e6267 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lazy-loading 'flavor' on Instance uuid 3b4eae03-8c72-48d6-a555-d584b72ccbd5 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:32:57.152300 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-601c2d3e-79b9-4dd6-887d-e5dcef8e6267 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "POST /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5/action" status: 202 len: 0 microversion: 2.1 time: 0.157668 Jul 20 04:32:57.153784 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2254/4511] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:56 2022] POST /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:32:57.159997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-247ec9ff-db0f-4958-95ef-b2bec9462d54 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:57.161242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-247ec9ff-db0f-4958-95ef-b2bec9462d54 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:57.169959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247ec9ff-db0f-4958-95ef-b2bec9462d54 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.170948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247ec9ff-db0f-4958-95ef-b2bec9462d54 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.173788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247ec9ff-db0f-4958-95ef-b2bec9462d54 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.174654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-247ec9ff-db0f-4958-95ef-b2bec9462d54 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.343078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-247ec9ff-db0f-4958-95ef-b2bec9462d54 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:57.357897 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-247ec9ff-db0f-4958-95ef-b2bec9462d54 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1697 microversion: 2.1 time: 0.202636 Jul 20 04:32:57.358741 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2255/4512] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:57 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1697 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:57.375251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a217195a-4855-4d00-a34b-4e0a14c7f2d9 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:57.376394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a217195a-4855-4d00-a34b-4e0a14c7f2d9 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:57.384621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a217195a-4855-4d00-a34b-4e0a14c7f2d9 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.384971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a217195a-4855-4d00-a34b-4e0a14c7f2d9 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.385821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a217195a-4855-4d00-a34b-4e0a14c7f2d9 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.386336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a217195a-4855-4d00-a34b-4e0a14c7f2d9 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.601449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a217195a-4855-4d00-a34b-4e0a14c7f2d9 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:57.609676 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a217195a-4855-4d00-a34b-4e0a14c7f2d9 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1509 microversion: 2.1 time: 0.245050 Jul 20 04:32:57.610303 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2256/4513] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:57 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:57.616631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-092b583b-eae6-4609-b61f-25b6ef4faf44 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:57.617259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-092b583b-eae6-4609-b61f-25b6ef4faf44 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:57.623527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-092b583b-eae6-4609-b61f-25b6ef4faf44 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.623984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-092b583b-eae6-4609-b61f-25b6ef4faf44 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.624778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-092b583b-eae6-4609-b61f-25b6ef4faf44 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.625221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-092b583b-eae6-4609-b61f-25b6ef4faf44 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.871180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-092b583b-eae6-4609-b61f-25b6ef4faf44 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:57.889041 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-092b583b-eae6-4609-b61f-25b6ef4faf44 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1292 microversion: 2.1 time: 0.277609 Jul 20 04:32:57.899277 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2257/4514] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:57 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1292 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:57.899277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-95421159-48f1-4aab-a023-ba05bafda189 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:57.899604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-95421159-48f1-4aab-a023-ba05bafda189 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:57.908114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95421159-48f1-4aab-a023-ba05bafda189 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.908663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95421159-48f1-4aab-a023-ba05bafda189 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:57.909622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95421159-48f1-4aab-a023-ba05bafda189 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:57.911144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95421159-48f1-4aab-a023-ba05bafda189 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.114016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:32:58.115781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:32:58.116469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:32:58.116999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:32:58.117535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:32:58.138492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-95421159-48f1-4aab-a023-ba05bafda189 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:58.147326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.148013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.149640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.149883 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-95421159-48f1-4aab-a023-ba05bafda189 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1366 microversion: 2.1 time: 0.257462 Jul 20 04:32:58.150329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.160318 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2258/4515] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:57 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:58.172582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:58.179369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for user a3a58233b2b044d9b1285b616c79f9b8 and project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:58.197557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:32:58.200148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:32:58.282085 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4f7a3848-1efa-4d17-a04b-b8d830f2e508 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.323845 Jul 20 04:32:58.300442 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2258/4516] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:32:58.310958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4294cd60-d1f5-432b-9cec-1c381358a2da tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:58.311685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4294cd60-d1f5-432b-9cec-1c381358a2da tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:58.381177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f6a5550e-3a80-449a-91a7-51595f4afaf1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:58.381825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f6a5550e-3a80-449a-91a7-51595f4afaf1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:58.396677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6a5550e-3a80-449a-91a7-51595f4afaf1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.397143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6a5550e-3a80-449a-91a7-51595f4afaf1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.404832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6a5550e-3a80-449a-91a7-51595f4afaf1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.405522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6a5550e-3a80-449a-91a7-51595f4afaf1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.437318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4294cd60-d1f5-432b-9cec-1c381358a2da tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:58.455300 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4294cd60-d1f5-432b-9cec-1c381358a2da tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1215 microversion: 2.1 time: 0.148161 Jul 20 04:32:58.469434 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2259/4517] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:58 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:58.629099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a925a529-961e-421e-b4de-4e138ce93319 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:58.629809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a925a529-961e-421e-b4de-4e138ce93319 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:58.639963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a925a529-961e-421e-b4de-4e138ce93319 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.640442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a925a529-961e-421e-b4de-4e138ce93319 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.646136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a925a529-961e-421e-b4de-4e138ce93319 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.649087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a925a529-961e-421e-b4de-4e138ce93319 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.265402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:59.328223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a925a529-961e-421e-b4de-4e138ce93319 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.342851 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a925a529-961e-421e-b4de-4e138ce93319 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1492 microversion: 2.1 time: 0.719034 Jul 20 04:32:59.343775 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2260/4518] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:58 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1492 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:59.352320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f4dab832-ca9a-4bda-bbbb-69db4f03a102 req-0d671561-56a0-488a-9c9e-1acebf29149b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223", "tag": "7219a53b-f8cc-4bac-a4d7-2bdb5abb1ffe"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:59.374223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f4dab832-ca9a-4bda-bbbb-69db4f03a102 req-0d671561-56a0-488a-9c9e-1acebf29149b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.376964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f4dab832-ca9a-4bda-bbbb-69db4f03a102 req-0d671561-56a0-488a-9c9e-1acebf29149b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.405261 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f4dab832-ca9a-4bda-bbbb-69db4f03a102 req-0d671561-56a0-488a-9c9e-1acebf29149b service nova] Creating event network-changed:7219a53b-f8cc-4bac-a4d7-2bdb5abb1ffe for instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 on n-h1-760456-11 Jul 20 04:32:59.420727 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f4dab832-ca9a-4bda-bbbb-69db4f03a102 req-0d671561-56a0-488a-9c9e-1acebf29149b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072969 Jul 20 04:32:59.422220 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2261/4519] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:59.435682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48b2bf9b-0a34-406c-8bd4-01ee7bc65b96 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:59.437422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-48b2bf9b-0a34-406c-8bd4-01ee7bc65b96 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:59.451611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48b2bf9b-0a34-406c-8bd4-01ee7bc65b96 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.452075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48b2bf9b-0a34-406c-8bd4-01ee7bc65b96 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.455099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48b2bf9b-0a34-406c-8bd4-01ee7bc65b96 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.455569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48b2bf9b-0a34-406c-8bd4-01ee7bc65b96 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.885426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-48b2bf9b-0a34-406c-8bd4-01ee7bc65b96 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.902928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f6a5550e-3a80-449a-91a7-51595f4afaf1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.914405 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f6a5550e-3a80-449a-91a7-51595f4afaf1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1697 microversion: 2.1 time: 1.539145 Jul 20 04:32:59.915263 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2259/4520] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:58 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1697 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:59.924942 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48b2bf9b-0a34-406c-8bd4-01ee7bc65b96 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1292 microversion: 2.1 time: 0.501255 Jul 20 04:32:59.928166 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2262/4521] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:59 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1292 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:59.931344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8c1c54dd-bc2a-4b5d-9f17-0e799bd3ee86 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:59.933561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8c1c54dd-bc2a-4b5d-9f17-0e799bd3ee86 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:59.936911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-25ed2bda-be7e-491a-9ddd-bd75d6a99e1a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:59.943972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-25ed2bda-be7e-491a-9ddd-bd75d6a99e1a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:59.971024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c1c54dd-bc2a-4b5d-9f17-0e799bd3ee86 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.971824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c1c54dd-bc2a-4b5d-9f17-0e799bd3ee86 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.976989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c1c54dd-bc2a-4b5d-9f17-0e799bd3ee86 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.979131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c1c54dd-bc2a-4b5d-9f17-0e799bd3ee86 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.983521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25ed2bda-be7e-491a-9ddd-bd75d6a99e1a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.984445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25ed2bda-be7e-491a-9ddd-bd75d6a99e1a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.987141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25ed2bda-be7e-491a-9ddd-bd75d6a99e1a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.987871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25ed2bda-be7e-491a-9ddd-bd75d6a99e1a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.129506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:00.157815 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-25ed2bda-be7e-491a-9ddd-bd75d6a99e1a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "POST /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5/action" status: 202 len: 0 microversion: 2.1 time: 0.228194 Jul 20 04:33:00.158837 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2263/4522] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:59 2022] POST /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:00.165449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8283670b-102d-4f3e-b2ce-e3594d9decc7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:00.166725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8283670b-102d-4f3e-b2ce-e3594d9decc7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:00.175091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8283670b-102d-4f3e-b2ce-e3594d9decc7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.176199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8283670b-102d-4f3e-b2ce-e3594d9decc7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.177998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8283670b-102d-4f3e-b2ce-e3594d9decc7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.178822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8283670b-102d-4f3e-b2ce-e3594d9decc7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.314841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8283670b-102d-4f3e-b2ce-e3594d9decc7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:00.324357 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8283670b-102d-4f3e-b2ce-e3594d9decc7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1285 microversion: 2.1 time: 0.164023 Jul 20 04:33:00.336449 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2264/4523] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:00 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:00.343126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a2dac3c8-9510-4415-9c02-34c95aacbb01 req-9f0ab24a-f639-4fde-a7f3-1a527724e926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f", "name": "network-vif-plugged", "status": "completed", "tag": "ccda5a64-d554-4528-8f90-8440290a063a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:00.358898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a2dac3c8-9510-4415-9c02-34c95aacbb01 req-9f0ab24a-f639-4fde-a7f3-1a527724e926 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.359941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a2dac3c8-9510-4415-9c02-34c95aacbb01 req-9f0ab24a-f639-4fde-a7f3-1a527724e926 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.387844 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a2dac3c8-9510-4415-9c02-34c95aacbb01 req-9f0ab24a-f639-4fde-a7f3-1a527724e926 service nova] Creating event network-vif-plugged:ccda5a64-d554-4528-8f90-8440290a063a for instance 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f on n-h2-760456-11 Jul 20 04:33:00.420626 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a2dac3c8-9510-4415-9c02-34c95aacbb01 req-9f0ab24a-f639-4fde-a7f3-1a527724e926 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057283 Jul 20 04:33:00.424991 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2265/4524] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:00.456197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e152b3c-2a06-42cd-877e-4563174c5f63 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:00.457132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e152b3c-2a06-42cd-877e-4563174c5f63 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:00.473066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e152b3c-2a06-42cd-877e-4563174c5f63 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.476920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e152b3c-2a06-42cd-877e-4563174c5f63 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.477978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e152b3c-2a06-42cd-877e-4563174c5f63 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.478656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e152b3c-2a06-42cd-877e-4563174c5f63 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.120567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c1c54dd-bc2a-4b5d-9f17-0e799bd3ee86 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:01.132222 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8c1c54dd-bc2a-4b5d-9f17-0e799bd3ee86 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1366 microversion: 2.1 time: 1.212104 Jul 20 04:33:01.133473 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2260/4525] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:59 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1366 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:01.175510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dda63ac8-7d26-46a1-9ba5-1056c3776635 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:01.177431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dda63ac8-7d26-46a1-9ba5-1056c3776635 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:01.194120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dda63ac8-7d26-46a1-9ba5-1056c3776635 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.194964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dda63ac8-7d26-46a1-9ba5-1056c3776635 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.196064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dda63ac8-7d26-46a1-9ba5-1056c3776635 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.197157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dda63ac8-7d26-46a1-9ba5-1056c3776635 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.389560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e152b3c-2a06-42cd-877e-4563174c5f63 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:01.401587 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e152b3c-2a06-42cd-877e-4563174c5f63 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1498 microversion: 2.1 time: 0.974888 Jul 20 04:33:01.402046 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2266/4526] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:00 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1498 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:01.425245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d6c5fbe9-4f64-4267-8e0e-df2a4a83bc1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:01.429057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d6c5fbe9-4f64-4267-8e0e-df2a4a83bc1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:01.444927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6c5fbe9-4f64-4267-8e0e-df2a4a83bc1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.445842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6c5fbe9-4f64-4267-8e0e-df2a4a83bc1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.447554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6c5fbe9-4f64-4267-8e0e-df2a4a83bc1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.451237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6c5fbe9-4f64-4267-8e0e-df2a4a83bc1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.717854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dda63ac8-7d26-46a1-9ba5-1056c3776635 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:01.741022 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dda63ac8-7d26-46a1-9ba5-1056c3776635 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1696 microversion: 2.1 time: 0.569448 Jul 20 04:33:01.741897 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2261/4527] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:01 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1696 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:01.746791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ff7766ae-847a-470b-a573-5c27660ee31f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:01.748383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ff7766ae-847a-470b-a573-5c27660ee31f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:01.776556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff7766ae-847a-470b-a573-5c27660ee31f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.777204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff7766ae-847a-470b-a573-5c27660ee31f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.778072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff7766ae-847a-470b-a573-5c27660ee31f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.778549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff7766ae-847a-470b-a573-5c27660ee31f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.893596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ff7766ae-847a-470b-a573-5c27660ee31f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:01.913636 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ff7766ae-847a-470b-a573-5c27660ee31f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1273 microversion: 2.1 time: 0.170311 Jul 20 04:33:01.914655 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2262/4528] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:01 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:01.924023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f6c8fb2e-8d5d-4603-a77a-f9f27af4e074 req-f73aac97-ec22-4de5-9fad-e20cd51d4423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6881eb5-fd94-4802-8fb1-ad74e99f0786", "name": "network-vif-unplugged", "status": "completed", "tag": "aba34f57-d50c-4162-ad83-443faa06380d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:01.950394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f6c8fb2e-8d5d-4603-a77a-f9f27af4e074 req-f73aac97-ec22-4de5-9fad-e20cd51d4423 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.951328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f6c8fb2e-8d5d-4603-a77a-f9f27af4e074 req-f73aac97-ec22-4de5-9fad-e20cd51d4423 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.970649 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f6c8fb2e-8d5d-4603-a77a-f9f27af4e074 req-f73aac97-ec22-4de5-9fad-e20cd51d4423 service nova] Creating event network-vif-unplugged:aba34f57-d50c-4162-ad83-443faa06380d for instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 on n-h1-760456-11 Jul 20 04:33:01.984544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-f6c8fb2e-8d5d-4603-a77a-f9f27af4e074 req-f73aac97-ec22-4de5-9fad-e20cd51d4423 service nova] Instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:33:01.999766 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f6c8fb2e-8d5d-4603-a77a-f9f27af4e074 req-f73aac97-ec22-4de5-9fad-e20cd51d4423 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081972 Jul 20 04:33:02.001395 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2263/4529] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:02.167189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6f361dc5-615e-4276-b4c6-9a82c9841db0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:02.167929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6f361dc5-615e-4276-b4c6-9a82c9841db0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:02.174431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f361dc5-615e-4276-b4c6-9a82c9841db0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.174894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f361dc5-615e-4276-b4c6-9a82c9841db0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.175685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f361dc5-615e-4276-b4c6-9a82c9841db0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.176135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f361dc5-615e-4276-b4c6-9a82c9841db0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.527420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d6c5fbe9-4f64-4267-8e0e-df2a4a83bc1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:02.544371 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d6c5fbe9-4f64-4267-8e0e-df2a4a83bc1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1292 microversion: 2.1 time: 1.141210 Jul 20 04:33:02.545414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2267/4530] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:01 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1292 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:02.554066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-598d0e76-ec87-4160-8427-afd864dbef9c tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:02.558590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-598d0e76-ec87-4160-8427-afd864dbef9c tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:02.572105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-598d0e76-ec87-4160-8427-afd864dbef9c tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.575178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-598d0e76-ec87-4160-8427-afd864dbef9c tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.577160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-598d0e76-ec87-4160-8427-afd864dbef9c tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.578227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-598d0e76-ec87-4160-8427-afd864dbef9c tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.811416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6f361dc5-615e-4276-b4c6-9a82c9841db0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:02.825409 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6f361dc5-615e-4276-b4c6-9a82c9841db0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1366 microversion: 2.1 time: 0.670601 Jul 20 04:33:02.827742 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2264/4531] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:02 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1366 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:02.842404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9cb0d57b-89e8-4ff5-867a-613b8e24bf0d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:02.843272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9cb0d57b-89e8-4ff5-867a-613b8e24bf0d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:02.868063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cb0d57b-89e8-4ff5-867a-613b8e24bf0d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.868468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cb0d57b-89e8-4ff5-867a-613b8e24bf0d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.873546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cb0d57b-89e8-4ff5-867a-613b8e24bf0d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.874461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9cb0d57b-89e8-4ff5-867a-613b8e24bf0d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.051433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-598d0e76-ec87-4160-8427-afd864dbef9c tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.063453 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-598d0e76-ec87-4160-8427-afd864dbef9c tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1498 microversion: 2.1 time: 0.516794 Jul 20 04:33:03.068378 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2268/4532] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:02 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1498 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:03.076004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-32f20e6c-2a41-4305-bcaa-4e5cdb3d64f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:03.076628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-32f20e6c-2a41-4305-bcaa-4e5cdb3d64f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:03.111766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32f20e6c-2a41-4305-bcaa-4e5cdb3d64f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.112330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32f20e6c-2a41-4305-bcaa-4e5cdb3d64f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.113017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32f20e6c-2a41-4305-bcaa-4e5cdb3d64f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.113460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32f20e6c-2a41-4305-bcaa-4e5cdb3d64f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.241961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-32f20e6c-2a41-4305-bcaa-4e5cdb3d64f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.275150 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-32f20e6c-2a41-4305-bcaa-4e5cdb3d64f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1273 microversion: 2.1 time: 0.205208 Jul 20 04:33:03.278737 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2269/4533] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:03 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:03.322568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-714878438-access_point-1972679422", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "abe5db1f-37d8-493c-97d3-e8dd84d82a12"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1916077816", "security_groups": [{"name": "tempest-secgroup_access--1239994306"}, {"name": "tempest-secgroup_general--1306478829"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:03.796683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9cb0d57b-89e8-4ff5-867a-613b8e24bf0d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.809830 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9cb0d57b-89e8-4ff5-867a-613b8e24bf0d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1696 microversion: 2.1 time: 0.980352 Jul 20 04:33:03.810462 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2265/4534] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:02 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1696 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:03.820046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5fb799f8-98f5-4330-a7c9-ab4121c75c61 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:03.820891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5fb799f8-98f5-4330-a7c9-ab4121c75c61 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:03.830892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fb799f8-98f5-4330-a7c9-ab4121c75c61 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.833844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fb799f8-98f5-4330-a7c9-ab4121c75c61 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.836431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fb799f8-98f5-4330-a7c9-ab4121c75c61 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.839512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fb799f8-98f5-4330-a7c9-ab4121c75c61 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.009804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] validate_networks() for [('abe5db1f-37d8-493c-97d3-e8dd84d82a12', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:04.260323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5fb799f8-98f5-4330-a7c9-ab4121c75c61 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:04.274355 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5fb799f8-98f5-4330-a7c9-ab4121c75c61 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1474 microversion: 2.1 time: 0.459102 Jul 20 04:33:04.275134 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2266/4535] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:03 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1474 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:04.284839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-965a2e0d-1814-4eee-93de-d66526abf599 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:04.286627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-965a2e0d-1814-4eee-93de-d66526abf599 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:04.310926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-965a2e0d-1814-4eee-93de-d66526abf599 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.311446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-965a2e0d-1814-4eee-93de-d66526abf599 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.312297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-965a2e0d-1814-4eee-93de-d66526abf599 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.312731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-965a2e0d-1814-4eee-93de-d66526abf599 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.687503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-965a2e0d-1814-4eee-93de-d66526abf599 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:04.698838 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-965a2e0d-1814-4eee-93de-d66526abf599 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1366 microversion: 2.1 time: 0.422480 Jul 20 04:33:04.699857 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2267/4536] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:04 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:04.705273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e81f9d77-b1bb-4039-9545-8566a1a973e8 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:04.706231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e81f9d77-b1bb-4039-9545-8566a1a973e8 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:04.714906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e81f9d77-b1bb-4039-9545-8566a1a973e8 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.715815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e81f9d77-b1bb-4039-9545-8566a1a973e8 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.716907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e81f9d77-b1bb-4039-9545-8566a1a973e8 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.717798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e81f9d77-b1bb-4039-9545-8566a1a973e8 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.987031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e81f9d77-b1bb-4039-9545-8566a1a973e8 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:04.998054 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e81f9d77-b1bb-4039-9545-8566a1a973e8 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1501 microversion: 2.1 time: 0.296531 Jul 20 04:33:04.998906 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2268/4537] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:04 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1501 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:05.004328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b7513174-c6a3-4b83-9f88-21b4355f23f0 req-46e2672c-6624-4d47-a088-19373cd39472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6881eb5-fd94-4802-8fb1-ad74e99f0786", "tag": "aba34f57-d50c-4162-ad83-443faa06380d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:05.020046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b7513174-c6a3-4b83-9f88-21b4355f23f0 req-46e2672c-6624-4d47-a088-19373cd39472 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.021565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b7513174-c6a3-4b83-9f88-21b4355f23f0 req-46e2672c-6624-4d47-a088-19373cd39472 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.040007 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b7513174-c6a3-4b83-9f88-21b4355f23f0 req-46e2672c-6624-4d47-a088-19373cd39472 service nova] Creating event network-changed:aba34f57-d50c-4162-ad83-443faa06380d for instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 on n-h1-760456-11 Jul 20 04:33:05.046421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-b7513174-c6a3-4b83-9f88-21b4355f23f0 req-46e2672c-6624-4d47-a088-19373cd39472 service nova] Instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:33:05.062897 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b7513174-c6a3-4b83-9f88-21b4355f23f0 req-46e2672c-6624-4d47-a088-19373cd39472 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061323 Jul 20 04:33:05.069966 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2269/4538] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:05.076364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-695e8a2c-7a20-43cd-b4e3-7572f28b4408 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:05.077322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-695e8a2c-7a20-43cd-b4e3-7572f28b4408 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:05.098184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-695e8a2c-7a20-43cd-b4e3-7572f28b4408 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.099569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-695e8a2c-7a20-43cd-b4e3-7572f28b4408 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.100247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-695e8a2c-7a20-43cd-b4e3-7572f28b4408 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.100711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-695e8a2c-7a20-43cd-b4e3-7572f28b4408 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.206752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:05.208768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:05.209761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:05.210475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:05.211541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:05.223985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=19 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:05.228174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.229229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.230516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.232137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.255924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:05.267883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Getting quotas for project 371a6852b8f441bfa719ab452a8c0d8a. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:05.279400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Getting quotas for user 9c92ac6d960b4b76ac881b676a00744a and project 371a6852b8f441bfa719ab452a8c0d8a. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:05.296728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:05.300488 n-d-760456-11 devstack@n-api.service[119605]: WARNING nova.utils [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-714878438-access_point-1972679422 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-714878438-acc Jul 20 04:33:05.301891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:05.376634 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4fdba2c9-ea67-4b55-bac5-8bd52434a080 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 2.094228 Jul 20 04:33:05.383227 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2270/4539] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:03 2022] POST /compute/v2.1/servers => generated 458 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:05.390135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-536956681", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:05.472506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-695e8a2c-7a20-43cd-b4e3-7572f28b4408 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:05.486191 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-695e8a2c-7a20-43cd-b4e3-7572f28b4408 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1315 microversion: 2.1 time: 0.414564 Jul 20 04:33:05.488102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] validate_networks() for [('7b0934fb-ee96-446d-a65b-fee23ff74766', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:05.494291 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2270/4540] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:05 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:05.497737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-73c4d8f8-39e3-43f4-be2b-e24553402c4b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:05.498378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-73c4d8f8-39e3-43f4-be2b-e24553402c4b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:05.507296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73c4d8f8-39e3-43f4-be2b-e24553402c4b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.507756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73c4d8f8-39e3-43f4-be2b-e24553402c4b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.508549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73c4d8f8-39e3-43f4-be2b-e24553402c4b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.508993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73c4d8f8-39e3-43f4-be2b-e24553402c4b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.699914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-73c4d8f8-39e3-43f4-be2b-e24553402c4b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:05.708459 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-73c4d8f8-39e3-43f4-be2b-e24553402c4b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1694 microversion: 2.1 time: 0.213738 Jul 20 04:33:05.709429 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2271/4541] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:05 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1694 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:05.714629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4bca8d77-d617-470f-8163-c47c44b51ce7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:05.715442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4bca8d77-d617-470f-8163-c47c44b51ce7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:05.721904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bca8d77-d617-470f-8163-c47c44b51ce7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.722757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bca8d77-d617-470f-8163-c47c44b51ce7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.723730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bca8d77-d617-470f-8163-c47c44b51ce7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.724416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bca8d77-d617-470f-8163-c47c44b51ce7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.756510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4bca8d77-d617-470f-8163-c47c44b51ce7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:05.873044 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4bca8d77-d617-470f-8163-c47c44b51ce7 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 204 len: 0 microversion: 2.1 time: 0.160445 Jul 20 04:33:05.876018 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2272/4542] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:33:05 2022] DELETE /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:05.896407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-960944c0-3fe6-4cc5-b275-96c66badbd32 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:05.898414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-960944c0-3fe6-4cc5-b275-96c66badbd32 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:06.069037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-960944c0-3fe6-4cc5-b275-96c66badbd32 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:06.077486 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-960944c0-3fe6-4cc5-b275-96c66badbd32 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1294 microversion: 2.1 time: 0.196186 Jul 20 04:33:06.078113 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2273/4543] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:05 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1294 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:06.096912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b5019d13-4341-4902-9c4e-560b0e2aa2e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:06.097611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b5019d13-4341-4902-9c4e-560b0e2aa2e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:06.141628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5019d13-4341-4902-9c4e-560b0e2aa2e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.142047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5019d13-4341-4902-9c4e-560b0e2aa2e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.144912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5019d13-4341-4902-9c4e-560b0e2aa2e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.145774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5019d13-4341-4902-9c4e-560b0e2aa2e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.386826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b5019d13-4341-4902-9c4e-560b0e2aa2e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:06.400916 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b5019d13-4341-4902-9c4e-560b0e2aa2e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1366 microversion: 2.1 time: 0.309201 Jul 20 04:33:06.421318 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2274/4544] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:06 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:06.457856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7a7b8b1-a9c9-4ae4-ba27-e6aac96c70c5 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:06.458903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7a7b8b1-a9c9-4ae4-ba27-e6aac96c70c5 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:06.477289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7a7b8b1-a9c9-4ae4-ba27-e6aac96c70c5 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.478800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7a7b8b1-a9c9-4ae4-ba27-e6aac96c70c5 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.487558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7a7b8b1-a9c9-4ae4-ba27-e6aac96c70c5 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.489934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7a7b8b1-a9c9-4ae4-ba27-e6aac96c70c5 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.499154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:07.009770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e7a7b8b1-a9c9-4ae4-ba27-e6aac96c70c5 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:07.024528 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7a7b8b1-a9c9-4ae4-ba27-e6aac96c70c5 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1507 microversion: 2.1 time: 0.590273 Jul 20 04:33:07.036476 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2275/4545] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:06 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1507 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:07.047269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd4d661e-fc8e-4e09-a7cf-328775af7f77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:07.048444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd4d661e-fc8e-4e09-a7cf-328775af7f77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:07.073394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd4d661e-fc8e-4e09-a7cf-328775af7f77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.075369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd4d661e-fc8e-4e09-a7cf-328775af7f77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.076283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd4d661e-fc8e-4e09-a7cf-328775af7f77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.076744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd4d661e-fc8e-4e09-a7cf-328775af7f77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.360832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cd4d661e-fc8e-4e09-a7cf-328775af7f77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:07.373851 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd4d661e-fc8e-4e09-a7cf-328775af7f77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1315 microversion: 2.1 time: 0.330994 Jul 20 04:33:07.386348 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2276/4546] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:07 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:07.392827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-459de031-e12b-4dac-9861-57afc54705cc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:07.394140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-459de031-e12b-4dac-9861-57afc54705cc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:07.425556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:07.439492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-459de031-e12b-4dac-9861-57afc54705cc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.440477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-459de031-e12b-4dac-9861-57afc54705cc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.441811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-459de031-e12b-4dac-9861-57afc54705cc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.442861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-459de031-e12b-4dac-9861-57afc54705cc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.527898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:07.529140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:07.529889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:07.530743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:07.531408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:07.560327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.561175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.562229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.563052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.627219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:07.633773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for user f224517836bf403a83da9e2e7f175907 and project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:07.663758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:07.666276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: d42c0a8b-0ae0-40f7-9019-d1e6462c532d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:07.726566 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4e391072-92bc-4014-8b31-98ffa3995732 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.340724 Jul 20 04:33:07.728034 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2271/4547] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:07.733603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a5682347-635a-4d72-b9ab-0c4bf0f3c41a req-036bfab4-cf9e-45d6-a58a-b0ec1473be54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223", "name": "network-vif-plugged", "status": "completed", "tag": "7219a53b-f8cc-4bac-a4d7-2bdb5abb1ffe"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:07.753748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a5682347-635a-4d72-b9ab-0c4bf0f3c41a req-036bfab4-cf9e-45d6-a58a-b0ec1473be54 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.754704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a5682347-635a-4d72-b9ab-0c4bf0f3c41a req-036bfab4-cf9e-45d6-a58a-b0ec1473be54 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.782368 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a5682347-635a-4d72-b9ab-0c4bf0f3c41a req-036bfab4-cf9e-45d6-a58a-b0ec1473be54 service nova] Creating event network-vif-plugged:7219a53b-f8cc-4bac-a4d7-2bdb5abb1ffe for instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 on n-h1-760456-11 Jul 20 04:33:07.798919 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a5682347-635a-4d72-b9ab-0c4bf0f3c41a req-036bfab4-cf9e-45d6-a58a-b0ec1473be54 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069257 Jul 20 04:33:07.822055 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2272/4548] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:07.834011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4c7702c3-6667-40b4-b69f-0f8239c2ee1f req-38b0daa5-fc2b-4ab5-8ad2-6a2c504773e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0940158d-6b8d-43cd-b5bf-134af097880b", "tag": "32b43f15-4ce8-4265-bd37-9a9fd82b618e"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:07.853498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4c7702c3-6667-40b4-b69f-0f8239c2ee1f req-38b0daa5-fc2b-4ab5-8ad2-6a2c504773e3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.854849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4c7702c3-6667-40b4-b69f-0f8239c2ee1f req-38b0daa5-fc2b-4ab5-8ad2-6a2c504773e3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.873090 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4c7702c3-6667-40b4-b69f-0f8239c2ee1f req-38b0daa5-fc2b-4ab5-8ad2-6a2c504773e3 service nova] Creating event network-changed:32b43f15-4ce8-4265-bd37-9a9fd82b618e for instance 0940158d-6b8d-43cd-b5bf-134af097880b on n-h2-760456-11 Jul 20 04:33:07.879128 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4c7702c3-6667-40b4-b69f-0f8239c2ee1f req-38b0daa5-fc2b-4ab5-8ad2-6a2c504773e3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055256 Jul 20 04:33:07.882328 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2273/4549] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:07.887948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-08558d43-183c-46de-acc6-ea0356762b7e tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:07.902211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-08558d43-183c-46de-acc6-ea0356762b7e tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:07.917100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08558d43-183c-46de-acc6-ea0356762b7e tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.929505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08558d43-183c-46de-acc6-ea0356762b7e tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:07.951587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08558d43-183c-46de-acc6-ea0356762b7e tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:07.954191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-08558d43-183c-46de-acc6-ea0356762b7e tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.160136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:08.266098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-459de031-e12b-4dac-9861-57afc54705cc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:08.278976 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-459de031-e12b-4dac-9861-57afc54705cc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1694 microversion: 2.1 time: 0.888056 Jul 20 04:33:08.280011 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2277/4550] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:07 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1694 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:08.306652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-246700fe-7a68-47c1-9206-295a6903f165 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:08.309374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-246700fe-7a68-47c1-9206-295a6903f165 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:08.312844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-08558d43-183c-46de-acc6-ea0356762b7e tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:08.325214 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-08558d43-183c-46de-acc6-ea0356762b7e tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1290 microversion: 2.1 time: 0.441347 Jul 20 04:33:08.326059 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2274/4551] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:07 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1290 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:08.342927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6a7505a-3978-46f2-9941-4df478859128 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:08.343684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6a7505a-3978-46f2-9941-4df478859128 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: d42c0a8b-0ae0-40f7-9019-d1e6462c532d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:08.358479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-246700fe-7a68-47c1-9206-295a6903f165 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.360929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-246700fe-7a68-47c1-9206-295a6903f165 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.363004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-246700fe-7a68-47c1-9206-295a6903f165 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.365129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-246700fe-7a68-47c1-9206-295a6903f165 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.381600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6a7505a-3978-46f2-9941-4df478859128 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: d42c0a8b-0ae0-40f7-9019-d1e6462c532d] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:08.896197 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.scheduler.client.report [None req-f6a7505a-3978-46f2-9941-4df478859128 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Deleted allocations for instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d Jul 20 04:33:08.932698 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6a7505a-3978-46f2-9941-4df478859128 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d" status: 204 len: 0 microversion: 2.1 time: 0.594427 Jul 20 04:33:08.933703 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2275/4552] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:33:08 2022] DELETE /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:08.945215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ae01202a-b464-4831-8877-1b47c898cd9d tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:08.949066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ae01202a-b464-4831-8877-1b47c898cd9d tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:08.965259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae01202a-b464-4831-8877-1b47c898cd9d tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.966857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae01202a-b464-4831-8877-1b47c898cd9d tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.981360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae01202a-b464-4831-8877-1b47c898cd9d tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.981886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ae01202a-b464-4831-8877-1b47c898cd9d tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:09.262398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-246700fe-7a68-47c1-9206-295a6903f165 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:09.280474 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-246700fe-7a68-47c1-9206-295a6903f165 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1366 microversion: 2.1 time: 0.994163 Jul 20 04:33:09.282003 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2278/4553] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:08 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1366 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:09.296997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5abf2623-62b5-4e93-8cba-14ff702619ee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:09.298910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5abf2623-62b5-4e93-8cba-14ff702619ee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:09.319399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5abf2623-62b5-4e93-8cba-14ff702619ee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:09.319863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5abf2623-62b5-4e93-8cba-14ff702619ee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:09.320653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5abf2623-62b5-4e93-8cba-14ff702619ee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:09.321097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5abf2623-62b5-4e93-8cba-14ff702619ee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:09.544436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ae01202a-b464-4831-8877-1b47c898cd9d tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:09.561634 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ae01202a-b464-4831-8877-1b47c898cd9d tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1507 microversion: 2.1 time: 0.626043 Jul 20 04:33:09.573977 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2276/4554] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:08 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1507 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:09.586411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c11bd1d1-6f96-4f11-936d-ce9a411f77c1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:09.587080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c11bd1d1-6f96-4f11-936d-ce9a411f77c1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: d42c0a8b-0ae0-40f7-9019-d1e6462c532d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:09.605909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c11bd1d1-6f96-4f11-936d-ce9a411f77c1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:09.606410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c11bd1d1-6f96-4f11-936d-ce9a411f77c1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:09.610654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c11bd1d1-6f96-4f11-936d-ce9a411f77c1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:09.611201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c11bd1d1-6f96-4f11-936d-ce9a411f77c1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:09.650626 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c11bd1d1-6f96-4f11-936d-ce9a411f77c1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c11bd1d1-6f96-4f11-936d-ce9a411f77c1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d HTTP/1.1 Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'd42c0a8b-0ae0-40f7-9019-d1e6462c532d'} Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:09.652323 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:09.658044 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:09.658044 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:09.658044 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:09.658044 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:09.658044 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:33:09.658044 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:09.658044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c11bd1d1-6f96-4f11-936d-ce9a411f77c1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:09.658044 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c11bd1d1-6f96-4f11-936d-ce9a411f77c1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d" status: 404 len: 111 microversion: 2.1 time: 0.077542 Jul 20 04:33:09.658044 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2277/4555] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:09 2022] GET /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:33:09.670202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7a3055ee-d919-43d0-9c62-4353cd843b30 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:09.670862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7a3055ee-d919-43d0-9c62-4353cd843b30 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:09.682243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a3055ee-d919-43d0-9c62-4353cd843b30 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:09.686842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a3055ee-d919-43d0-9c62-4353cd843b30 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:09.688140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a3055ee-d919-43d0-9c62-4353cd843b30 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:09.688826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a3055ee-d919-43d0-9c62-4353cd843b30 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.282623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7a3055ee-d919-43d0-9c62-4353cd843b30 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.292667 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7a3055ee-d919-43d0-9c62-4353cd843b30 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1691 microversion: 2.1 time: 0.636534 Jul 20 04:33:10.306979 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2278/4556] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:09 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1691 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:10.329095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-83c0ff57-4654-44d4-9adb-4a831e17c559 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:10.330395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-83c0ff57-4654-44d4-9adb-4a831e17c559 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:10.339730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83c0ff57-4654-44d4-9adb-4a831e17c559 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.347178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83c0ff57-4654-44d4-9adb-4a831e17c559 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.349572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83c0ff57-4654-44d4-9adb-4a831e17c559 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.353345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83c0ff57-4654-44d4-9adb-4a831e17c559 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.367031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5abf2623-62b5-4e93-8cba-14ff702619ee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.381856 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5abf2623-62b5-4e93-8cba-14ff702619ee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1315 microversion: 2.1 time: 1.098012 Jul 20 04:33:10.383061 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2279/4557] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:09 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1315 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:10.404033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-564545814", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "7b0934fb-ee96-446d-a65b-fee23ff74766"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:10.508891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-83c0ff57-4654-44d4-9adb-4a831e17c559 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.509812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] validate_networks() for [('7b0934fb-ee96-446d-a65b-fee23ff74766', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:10.516862 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-83c0ff57-4654-44d4-9adb-4a831e17c559 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1352 microversion: 2.1 time: 0.208431 Jul 20 04:33:10.517456 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2279/4558] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:10 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1352 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:10.530866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1cdd2fa8-a0d8-4fe2-af13-bb8182fb25a3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:10.534062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1cdd2fa8-a0d8-4fe2-af13-bb8182fb25a3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:10.542866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cdd2fa8-a0d8-4fe2-af13-bb8182fb25a3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.543419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cdd2fa8-a0d8-4fe2-af13-bb8182fb25a3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.550136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cdd2fa8-a0d8-4fe2-af13-bb8182fb25a3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.554217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cdd2fa8-a0d8-4fe2-af13-bb8182fb25a3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.066703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1cdd2fa8-a0d8-4fe2-af13-bb8182fb25a3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:11.089904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1cdd2fa8-a0d8-4fe2-af13-bb8182fb25a3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1556 microversion: 2.1 time: 0.567796 Jul 20 04:33:11.091200 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2280/4559] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:10 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1556 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:11.096204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-04b8e542-ce6d-4a95-b965-dfdf1ffe1be8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:11.107083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-04b8e542-ce6d-4a95-b965-dfdf1ffe1be8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:11.115045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04b8e542-ce6d-4a95-b965-dfdf1ffe1be8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.115790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04b8e542-ce6d-4a95-b965-dfdf1ffe1be8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.116768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04b8e542-ce6d-4a95-b965-dfdf1ffe1be8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.117381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04b8e542-ce6d-4a95-b965-dfdf1ffe1be8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.225783 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-04b8e542-ce6d-4a95-b965-dfdf1ffe1be8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786/action" status: 204 len: 0 microversion: 2.1 time: 0.133034 Jul 20 04:33:11.242908 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2281/4560] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:11 2022] POST /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786/action => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:11.268207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:11.268937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:11.284199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.284831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.288796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.289268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.351078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.351206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.362235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lazy-loading 'fault' on Instance uuid 3b4eae03-8c72-48d6-a555-d584b72ccbd5 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:33:11.500966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c1b3b842fb74cbebb1a374b8cb2b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94562eeb7ccf4e3598f06e96e871ef23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:11.510379 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-59152296-da0e-4d00-86e8-71758b3f9281 tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 200 len: 1304 microversion: 2.1 time: 0.262639 Jul 20 04:33:11.518615 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2282/4561] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:11 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 1304 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:11.657982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e64017d7-e03f-43d5-808b-6efbff3e8417 req-3da9aee4-798f-4fb9-890a-eef6f8acd273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4eae03-8c72-48d6-a555-d584b72ccbd5", "name": "network-vif-deleted", "tag": "948c2908-2923-4d7d-a8bf-219a80fea3b6"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:11.677323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e64017d7-e03f-43d5-808b-6efbff3e8417 req-3da9aee4-798f-4fb9-890a-eef6f8acd273 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.678054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e64017d7-e03f-43d5-808b-6efbff3e8417 req-3da9aee4-798f-4fb9-890a-eef6f8acd273 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.685914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:11.707282 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e64017d7-e03f-43d5-808b-6efbff3e8417 req-3da9aee4-798f-4fb9-890a-eef6f8acd273 service nova] Creating event network-vif-deleted:948c2908-2923-4d7d-a8bf-219a80fea3b6 for instance 3b4eae03-8c72-48d6-a555-d584b72ccbd5 on n-h1-760456-11 Jul 20 04:33:11.722653 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e64017d7-e03f-43d5-808b-6efbff3e8417 req-3da9aee4-798f-4fb9-890a-eef6f8acd273 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202236 Jul 20 04:33:11.724990 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2283/4562] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:11.736637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38adb4ec-1903-45ff-96cf-114134cbe6b5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:11.741463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-38adb4ec-1903-45ff-96cf-114134cbe6b5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:11.759471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38adb4ec-1903-45ff-96cf-114134cbe6b5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.760224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38adb4ec-1903-45ff-96cf-114134cbe6b5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.761282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38adb4ec-1903-45ff-96cf-114134cbe6b5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.761829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38adb4ec-1903-45ff-96cf-114134cbe6b5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.015632 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-38adb4ec-1903-45ff-96cf-114134cbe6b5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.288872 Jul 20 04:33:12.016245 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2284/4563] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:33:11 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:12.023050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a5551406-00f1-4512-a0d2-e35f9557122a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:12.023671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a5551406-00f1-4512-a0d2-e35f9557122a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:12.033937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5551406-00f1-4512-a0d2-e35f9557122a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.037406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5551406-00f1-4512-a0d2-e35f9557122a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.039706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5551406-00f1-4512-a0d2-e35f9557122a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.040501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5551406-00f1-4512-a0d2-e35f9557122a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.314228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:12.314823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:12.315313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:12.315736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:12.316267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:12.345961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.346835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.347689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.349856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.386599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:12.396021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for user f224517836bf403a83da9e2e7f175907 and project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:12.413466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:12.416537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:12.504476 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fc9ca9a5-0304-4fd5-bcef-e995ec9c3185 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.118928 Jul 20 04:33:12.506391 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2280/4564] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:12.512385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-238f6bc5-285a-4ed9-85ed-a9d1914b09aa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:12.513398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-238f6bc5-285a-4ed9-85ed-a9d1914b09aa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:12.521465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-238f6bc5-285a-4ed9-85ed-a9d1914b09aa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.522952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-238f6bc5-285a-4ed9-85ed-a9d1914b09aa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.523782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-238f6bc5-285a-4ed9-85ed-a9d1914b09aa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.524240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-238f6bc5-285a-4ed9-85ed-a9d1914b09aa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.908493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a5551406-00f1-4512-a0d2-e35f9557122a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:12.920663 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a5551406-00f1-4512-a0d2-e35f9557122a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1691 microversion: 2.1 time: 0.903203 Jul 20 04:33:12.921256 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2285/4565] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:12 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1691 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:12.950989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cefe28f3-3f83-4375-af2c-7b3f4d7aa09f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:12.954910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cefe28f3-3f83-4375-af2c-7b3f4d7aa09f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:12.967870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cefe28f3-3f83-4375-af2c-7b3f4d7aa09f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.970115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cefe28f3-3f83-4375-af2c-7b3f4d7aa09f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.971208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cefe28f3-3f83-4375-af2c-7b3f4d7aa09f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.973273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cefe28f3-3f83-4375-af2c-7b3f4d7aa09f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.455393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-238f6bc5-285a-4ed9-85ed-a9d1914b09aa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.466340 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-238f6bc5-285a-4ed9-85ed-a9d1914b09aa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1315 microversion: 2.1 time: 0.958813 Jul 20 04:33:13.481190 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2281/4566] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:12 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1315 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:13.490634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-960b9ab5-5e75-431b-8f40-62fa345e6710 req-3042c8fa-a741-4c5c-a64f-4b54f5ae89b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6881eb5-fd94-4802-8fb1-ad74e99f0786", "name": "network-vif-plugged", "status": "completed", "tag": "aba34f57-d50c-4162-ad83-443faa06380d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:13.517331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-960b9ab5-5e75-431b-8f40-62fa345e6710 req-3042c8fa-a741-4c5c-a64f-4b54f5ae89b7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.517952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-960b9ab5-5e75-431b-8f40-62fa345e6710 req-3042c8fa-a741-4c5c-a64f-4b54f5ae89b7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.549548 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-960b9ab5-5e75-431b-8f40-62fa345e6710 req-3042c8fa-a741-4c5c-a64f-4b54f5ae89b7 service nova] Creating event network-vif-plugged:aba34f57-d50c-4162-ad83-443faa06380d for instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 on n-h1-760456-11 Jul 20 04:33:13.579507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-960b9ab5-5e75-431b-8f40-62fa345e6710 req-3042c8fa-a741-4c5c-a64f-4b54f5ae89b7 service nova] Instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:33:13.601849 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-960b9ab5-5e75-431b-8f40-62fa345e6710 req-3042c8fa-a741-4c5c-a64f-4b54f5ae89b7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118957 Jul 20 04:33:13.602514 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2282/4567] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:13.607745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-55913e89-e606-40df-b6cf-b40329a01f52 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:13.608463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-55913e89-e606-40df-b6cf-b40329a01f52 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:13.626608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55913e89-e606-40df-b6cf-b40329a01f52 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.627076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55913e89-e606-40df-b6cf-b40329a01f52 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.627876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55913e89-e606-40df-b6cf-b40329a01f52 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.628412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55913e89-e606-40df-b6cf-b40329a01f52 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.788328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-55913e89-e606-40df-b6cf-b40329a01f52 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.833344 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-55913e89-e606-40df-b6cf-b40329a01f52 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1272 microversion: 2.1 time: 0.227746 Jul 20 04:33:13.835065 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2283/4568] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:13.840865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7e08166a-4fc7-4844-96c9-3492a44e520a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:13.842277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7e08166a-4fc7-4844-96c9-3492a44e520a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] [instance: 3b4eae03-8c72-48d6-a555-d584b72ccbd5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:13.897401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e08166a-4fc7-4844-96c9-3492a44e520a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.899277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e08166a-4fc7-4844-96c9-3492a44e520a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.900835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e08166a-4fc7-4844-96c9-3492a44e520a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.901487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e08166a-4fc7-4844-96c9-3492a44e520a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.944238 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-7e08166a-4fc7-4844-96c9-3492a44e520a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] HTTP exception thrown: Instance 3b4eae03-8c72-48d6-a555-d584b72ccbd5 could not be found. Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7e08166a-4fc7-4844-96c9-3492a44e520a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Request method failure captured: Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 HTTP/1.1 Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14VP7O2F1bdRKsiq0_7zpBxOBTI-L4K0wQABvZ4dhOAGmxzUOSOP8YZR43kH96cop4L5DBqsk3rozn-LolNFxmwXMQi1WghM4bD8N9mDCfhPR3hN2nsj5Sb0Ct2HL9PkYjMudDVegZ-DZXl8VV8CQ5ypmMJIHo7x_XFnb7sfmSJyqlw Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 94562eeb7ccf4e3598f06e96e871ef23 Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestServerAdvancedOps-890938901 Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/94562eeb7ccf4e3598f06e96e871ef23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/94562eeb7ccf4e3598f06e96e871ef23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/94562eeb7ccf4e3598f06e96e871ef23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_94562eeb7ccf4e3598f06e96e871ef23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestServerAdvancedOps-890938901 Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 94562eeb7ccf4e3598f06e96e871ef23 Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestServerAdvancedOps-890938901 Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestServerAdvancedOps-890938901-project Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 5c1b3b842fb74cbebb1a374b8cb2b053 Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestServerAdvancedOps-890938901-project Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 3b4eae03-8c72-48d6-a555-d584b72ccbd5 could not be found. Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '3b4eae03-8c72-48d6-a555-d584b72ccbd5'} Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b4eae03-8c72-48d6-a555-d584b72ccbd5 could not be found. Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b4eae03-8c72-48d6-a555-d584b72ccbd5 could not be found. Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:13.960732 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:33:13.966133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:13.966133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:13.966133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:13.966133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:13.966133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:13.966133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b4eae03-8c72-48d6-a555-d584b72ccbd5 could not be found. Jul 20 04:33:13.966133 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:33:13.970615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7e08166a-4fc7-4844-96c9-3492a44e520a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] Returning 404 to user: Instance 3b4eae03-8c72-48d6-a555-d584b72ccbd5 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:13.971873 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7e08166a-4fc7-4844-96c9-3492a44e520a tempest-TestServerAdvancedOps-890938901 tempest-TestServerAdvancedOps-890938901-project] 10.222.0.59 "GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5" status: 404 len: 111 microversion: 2.1 time: 0.135781 Jul 20 04:33:13.974115 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2284/4569] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/servers/3b4eae03-8c72-48d6-a555-d584b72ccbd5 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:33:13.991857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-36a39e4e-1026-4315-8fd4-578fe129b86d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:13.992949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-36a39e4e-1026-4315-8fd4-578fe129b86d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:14.005412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36a39e4e-1026-4315-8fd4-578fe129b86d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.005972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36a39e4e-1026-4315-8fd4-578fe129b86d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.007575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36a39e4e-1026-4315-8fd4-578fe129b86d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.008385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36a39e4e-1026-4315-8fd4-578fe129b86d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.076432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cefe28f3-3f83-4375-af2c-7b3f4d7aa09f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:14.089868 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cefe28f3-3f83-4375-af2c-7b3f4d7aa09f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1472 microversion: 2.1 time: 1.145562 Jul 20 04:33:14.092726 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2286/4570] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:12 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1472 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:14.483987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c0096e0-0474-4929-b70e-2539e7b0bb2b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:14.485090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c0096e0-0474-4929-b70e-2539e7b0bb2b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:14.491868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c0096e0-0474-4929-b70e-2539e7b0bb2b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.492683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c0096e0-0474-4929-b70e-2539e7b0bb2b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.493719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c0096e0-0474-4929-b70e-2539e7b0bb2b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.494440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c0096e0-0474-4929-b70e-2539e7b0bb2b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.672595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-36a39e4e-1026-4315-8fd4-578fe129b86d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:14.681564 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-36a39e4e-1026-4315-8fd4-578fe129b86d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1691 microversion: 2.1 time: 0.705960 Jul 20 04:33:14.684736 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2285/4571] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1691 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:14.853052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-90cd7c09-9408-45f0-8d71-7a0a27465082 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:14.853753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-90cd7c09-9408-45f0-8d71-7a0a27465082 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:14.861014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90cd7c09-9408-45f0-8d71-7a0a27465082 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.867527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90cd7c09-9408-45f0-8d71-7a0a27465082 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.868641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90cd7c09-9408-45f0-8d71-7a0a27465082 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.869074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90cd7c09-9408-45f0-8d71-7a0a27465082 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.109917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6c0096e0-0474-4929-b70e-2539e7b0bb2b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:15.136419 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6c0096e0-0474-4929-b70e-2539e7b0bb2b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1315 microversion: 2.1 time: 0.651444 Jul 20 04:33:15.144150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90cd7c09-9408-45f0-8d71-7a0a27465082 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:15.146887 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2287/4572] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:14 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:15.152788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36bed9f7-b07a-4096-8223-c690b02fd264 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:15.154086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-36bed9f7-b07a-4096-8223-c690b02fd264 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:15.162086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36bed9f7-b07a-4096-8223-c690b02fd264 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.162622 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-90cd7c09-9408-45f0-8d71-7a0a27465082 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1278 microversion: 2.1 time: 0.314627 Jul 20 04:33:15.162975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36bed9f7-b07a-4096-8223-c690b02fd264 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.164028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36bed9f7-b07a-4096-8223-c690b02fd264 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.164704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36bed9f7-b07a-4096-8223-c690b02fd264 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.168832 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2286/4573] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:14 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1278 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:15.626705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-60d926ed-bdb9-4ad6-a00c-dfc3c5b0b8f0 req-380968b2-ce0c-471b-9aff-073660d84598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0940158d-6b8d-43cd-b5bf-134af097880b", "name": "network-vif-plugged", "status": "completed", "tag": "32b43f15-4ce8-4265-bd37-9a9fd82b618e"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:15.642545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-60d926ed-bdb9-4ad6-a00c-dfc3c5b0b8f0 req-380968b2-ce0c-471b-9aff-073660d84598 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.644441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-60d926ed-bdb9-4ad6-a00c-dfc3c5b0b8f0 req-380968b2-ce0c-471b-9aff-073660d84598 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.672901 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-60d926ed-bdb9-4ad6-a00c-dfc3c5b0b8f0 req-380968b2-ce0c-471b-9aff-073660d84598 service nova] Creating event network-vif-plugged:32b43f15-4ce8-4265-bd37-9a9fd82b618e for instance 0940158d-6b8d-43cd-b5bf-134af097880b on n-h2-760456-11 Jul 20 04:33:15.682495 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-60d926ed-bdb9-4ad6-a00c-dfc3c5b0b8f0 req-380968b2-ce0c-471b-9aff-073660d84598 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064702 Jul 20 04:33:15.683651 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2287/4574] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:15.700735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d532eb1-07d7-4b2f-8e9b-b134e6d83928 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:15.702073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d532eb1-07d7-4b2f-8e9b-b134e6d83928 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:15.722485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d532eb1-07d7-4b2f-8e9b-b134e6d83928 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.724074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d532eb1-07d7-4b2f-8e9b-b134e6d83928 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.724770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d532eb1-07d7-4b2f-8e9b-b134e6d83928 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.725342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d532eb1-07d7-4b2f-8e9b-b134e6d83928 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.830176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-36bed9f7-b07a-4096-8223-c690b02fd264 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:15.854286 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-36bed9f7-b07a-4096-8223-c690b02fd264 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1472 microversion: 2.1 time: 0.706019 Jul 20 04:33:15.856104 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2288/4575] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:15 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1472 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:16.076796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-410500dc-fdc9-4385-bd1d-1166fe8b66f3 req-779861d6-9e3b-4a7b-b517-bde34f0be509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85bd8d6-2ced-4348-8d60-1a511efe1dbf", "tag": "4855b0c7-7ed8-4f67-a524-a68644b35601"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:16.096316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-410500dc-fdc9-4385-bd1d-1166fe8b66f3 req-779861d6-9e3b-4a7b-b517-bde34f0be509 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.102102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-410500dc-fdc9-4385-bd1d-1166fe8b66f3 req-779861d6-9e3b-4a7b-b517-bde34f0be509 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.157312 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-410500dc-fdc9-4385-bd1d-1166fe8b66f3 req-779861d6-9e3b-4a7b-b517-bde34f0be509 service nova] Creating event network-changed:4855b0c7-7ed8-4f67-a524-a68644b35601 for instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf on n-h1-760456-11 Jul 20 04:33:16.169070 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-410500dc-fdc9-4385-bd1d-1166fe8b66f3 req-779861d6-9e3b-4a7b-b517-bde34f0be509 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305873 Jul 20 04:33:16.170003 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2289/4576] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:16.179953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4a09a257-f4cb-42d8-a7aa-f66d598ec1b1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:16.183878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4a09a257-f4cb-42d8-a7aa-f66d598ec1b1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:16.196877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a09a257-f4cb-42d8-a7aa-f66d598ec1b1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.199873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a09a257-f4cb-42d8-a7aa-f66d598ec1b1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.203594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a09a257-f4cb-42d8-a7aa-f66d598ec1b1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.204212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a09a257-f4cb-42d8-a7aa-f66d598ec1b1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.548191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d532eb1-07d7-4b2f-8e9b-b134e6d83928 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:16.571197 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d532eb1-07d7-4b2f-8e9b-b134e6d83928 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1683 microversion: 2.1 time: 0.874786 Jul 20 04:33:16.573609 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2288/4577] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:15 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1683 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:16.581247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5b27beb3-f8a7-4825-ae11-77cf4081b15e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:16.582145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5b27beb3-f8a7-4825-ae11-77cf4081b15e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:16.604486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b27beb3-f8a7-4825-ae11-77cf4081b15e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.605995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b27beb3-f8a7-4825-ae11-77cf4081b15e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.607146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b27beb3-f8a7-4825-ae11-77cf4081b15e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.607980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b27beb3-f8a7-4825-ae11-77cf4081b15e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:17.244461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4a09a257-f4cb-42d8-a7aa-f66d598ec1b1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:17.260329 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4a09a257-f4cb-42d8-a7aa-f66d598ec1b1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1315 microversion: 2.1 time: 1.088843 Jul 20 04:33:17.261367 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2290/4578] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:16 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1315 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:17.273704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3413e2b-8853-4adc-b1ff-1ada07234c05 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:17.274456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f3413e2b-8853-4adc-b1ff-1ada07234c05 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:17.284195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3413e2b-8853-4adc-b1ff-1ada07234c05 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:17.286611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3413e2b-8853-4adc-b1ff-1ada07234c05 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:17.290342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3413e2b-8853-4adc-b1ff-1ada07234c05 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:17.291623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3413e2b-8853-4adc-b1ff-1ada07234c05 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:17.607338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:17.696431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b27beb3-f8a7-4825-ae11-77cf4081b15e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:17.715175 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5b27beb3-f8a7-4825-ae11-77cf4081b15e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1320 microversion: 2.1 time: 1.137071 Jul 20 04:33:17.717359 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2289/4579] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:16 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1320 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:17.964808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f3413e2b-8853-4adc-b1ff-1ada07234c05 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:17.974746 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f3413e2b-8853-4adc-b1ff-1ada07234c05 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1472 microversion: 2.1 time: 0.712063 Jul 20 04:33:17.982897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2291/4580] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:17 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1472 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:18.235226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-56972ed1-41da-4709-8a5a-86d8b757074e req-bda7c7e0-c41c-470b-83e7-d28f835bfc56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223", "tag": "7219a53b-f8cc-4bac-a4d7-2bdb5abb1ffe"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:18.266849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-56972ed1-41da-4709-8a5a-86d8b757074e req-bda7c7e0-c41c-470b-83e7-d28f835bfc56 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.268728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-56972ed1-41da-4709-8a5a-86d8b757074e req-bda7c7e0-c41c-470b-83e7-d28f835bfc56 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.277107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3a0f4fa2-b991-4386-a185-790361ec55fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:18.277720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3a0f4fa2-b991-4386-a185-790361ec55fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:18.285297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a0f4fa2-b991-4386-a185-790361ec55fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.289473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a0f4fa2-b991-4386-a185-790361ec55fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.290318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a0f4fa2-b991-4386-a185-790361ec55fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.290765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a0f4fa2-b991-4386-a185-790361ec55fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.311680 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-56972ed1-41da-4709-8a5a-86d8b757074e req-bda7c7e0-c41c-470b-83e7-d28f835bfc56 service nova] Creating event network-changed:7219a53b-f8cc-4bac-a4d7-2bdb5abb1ffe for instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 on n-h1-760456-11 Jul 20 04:33:18.319824 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-56972ed1-41da-4709-8a5a-86d8b757074e req-bda7c7e0-c41c-470b-83e7-d28f835bfc56 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089023 Jul 20 04:33:18.324124 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2290/4581] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:18.334537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a9343f3e-c9e2-4d0f-8765-0a19ce681e76 req-a7eebe77-5a3f-44f6-ba17-51eea867215f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc1ba40-3317-4f43-b0eb-f70d7b70278c", "tag": "8b98b113-521f-4c80-919e-c7c5276a5f63"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:18.345791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a9343f3e-c9e2-4d0f-8765-0a19ce681e76 req-a7eebe77-5a3f-44f6-ba17-51eea867215f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.346647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a9343f3e-c9e2-4d0f-8765-0a19ce681e76 req-a7eebe77-5a3f-44f6-ba17-51eea867215f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.360621 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a9343f3e-c9e2-4d0f-8765-0a19ce681e76 req-a7eebe77-5a3f-44f6-ba17-51eea867215f service nova] Creating event network-changed:8b98b113-521f-4c80-919e-c7c5276a5f63 for instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c on n-h1-760456-11 Jul 20 04:33:18.367890 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a9343f3e-c9e2-4d0f-8765-0a19ce681e76 req-a7eebe77-5a3f-44f6-ba17-51eea867215f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041176 Jul 20 04:33:18.369136 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2291/4582] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:18.559952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3a0f4fa2-b991-4386-a185-790361ec55fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:18.570185 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3a0f4fa2-b991-4386-a185-790361ec55fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1501 microversion: 2.1 time: 0.297045 Jul 20 04:33:18.573980 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2292/4583] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:18 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1501 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:18.595915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2cfc0a48-4126-4992-892d-788fae903e5e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:18.605216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2cfc0a48-4126-4992-892d-788fae903e5e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.605859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2cfc0a48-4126-4992-892d-788fae903e5e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.638407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2cfc0a48-4126-4992-892d-788fae903e5e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Going to try to stop instance {{(pid=119606) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:33:18.697927 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2cfc0a48-4126-4992-892d-788fae903e5e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b/action" status: 202 len: 0 microversion: 2.1 time: 0.109615 Jul 20 04:33:18.702568 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2292/4584] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:18 2022] POST /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:18.707230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-440de73e-5a2a-4dfd-8cba-67e6745e7b94 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:18.708136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-440de73e-5a2a-4dfd-8cba-67e6745e7b94 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:18.709819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=13 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:18.753704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-191bd275-f36c-4df2-8705-3725fb49316d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:18.757859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-191bd275-f36c-4df2-8705-3725fb49316d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:18.769535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-440de73e-5a2a-4dfd-8cba-67e6745e7b94 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.769885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-191bd275-f36c-4df2-8705-3725fb49316d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.770718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-191bd275-f36c-4df2-8705-3725fb49316d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.771527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-440de73e-5a2a-4dfd-8cba-67e6745e7b94 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.771773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-191bd275-f36c-4df2-8705-3725fb49316d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.773182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-191bd275-f36c-4df2-8705-3725fb49316d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.773816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-440de73e-5a2a-4dfd-8cba-67e6745e7b94 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.774313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-440de73e-5a2a-4dfd-8cba-67e6745e7b94 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.215634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-440de73e-5a2a-4dfd-8cba-67e6745e7b94 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.224375 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-440de73e-5a2a-4dfd-8cba-67e6745e7b94 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.520956 Jul 20 04:33:19.224922 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2293/4585] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:18 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:19.238221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eda6cc5c-1a37-4c86-ae77-21d010e4d269 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:19.243843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eda6cc5c-1a37-4c86-ae77-21d010e4d269 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:19.258999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eda6cc5c-1a37-4c86-ae77-21d010e4d269 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.259575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eda6cc5c-1a37-4c86-ae77-21d010e4d269 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.260829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eda6cc5c-1a37-4c86-ae77-21d010e4d269 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.262070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eda6cc5c-1a37-4c86-ae77-21d010e4d269 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.746942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-191bd275-f36c-4df2-8705-3725fb49316d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.761595 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-191bd275-f36c-4df2-8705-3725fb49316d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1320 microversion: 2.1 time: 1.030571 Jul 20 04:33:19.772107 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2293/4586] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:18 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1320 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:20.094864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eda6cc5c-1a37-4c86-ae77-21d010e4d269 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:20.113279 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eda6cc5c-1a37-4c86-ae77-21d010e4d269 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1472 microversion: 2.1 time: 0.881279 Jul 20 04:33:20.139352 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2294/4587] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:19 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1472 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:20.250102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2dc24b6-ea24-4579-9b5d-81f6a6802eaf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:20.251020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f2dc24b6-ea24-4579-9b5d-81f6a6802eaf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:20.267439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2dc24b6-ea24-4579-9b5d-81f6a6802eaf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.269223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2dc24b6-ea24-4579-9b5d-81f6a6802eaf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.270861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2dc24b6-ea24-4579-9b5d-81f6a6802eaf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.274275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2dc24b6-ea24-4579-9b5d-81f6a6802eaf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.305444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:20.728844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f2dc24b6-ea24-4579-9b5d-81f6a6802eaf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:20.738029 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f2dc24b6-ea24-4579-9b5d-81f6a6802eaf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.491745 Jul 20 04:33:20.752311 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2294/4588] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:20 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:20.779080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-59d26fed-bbc2-490c-befc-d54fdb92d80a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:20.780612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-59d26fed-bbc2-490c-befc-d54fdb92d80a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:20.790910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59d26fed-bbc2-490c-befc-d54fdb92d80a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.807108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59d26fed-bbc2-490c-befc-d54fdb92d80a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.808345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59d26fed-bbc2-490c-befc-d54fdb92d80a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.809026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59d26fed-bbc2-490c-befc-d54fdb92d80a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.148948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-59d26fed-bbc2-490c-befc-d54fdb92d80a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.156559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-561e68cd-aecc-40ef-a085-e816b0cfab35 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:21.157486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-561e68cd-aecc-40ef-a085-e816b0cfab35 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:21.164713 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-59d26fed-bbc2-490c-befc-d54fdb92d80a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1320 microversion: 2.1 time: 0.389358 Jul 20 04:33:21.165328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-561e68cd-aecc-40ef-a085-e816b0cfab35 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.165799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-561e68cd-aecc-40ef-a085-e816b0cfab35 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.166831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-561e68cd-aecc-40ef-a085-e816b0cfab35 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.167453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-561e68cd-aecc-40ef-a085-e816b0cfab35 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.174750 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2295/4589] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:20 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:21.748083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-561e68cd-aecc-40ef-a085-e816b0cfab35 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.759621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-025a3c58-9122-439c-b111-cd53abfc488c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:21.760356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-025a3c58-9122-439c-b111-cd53abfc488c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:21.766870 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-561e68cd-aecc-40ef-a085-e816b0cfab35 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1472 microversion: 2.1 time: 0.614409 Jul 20 04:33:21.769538 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2295/4590] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:21 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1472 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:21.776711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-025a3c58-9122-439c-b111-cd53abfc488c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.777951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-025a3c58-9122-439c-b111-cd53abfc488c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.778774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-025a3c58-9122-439c-b111-cd53abfc488c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.779215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-025a3c58-9122-439c-b111-cd53abfc488c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.016417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-025a3c58-9122-439c-b111-cd53abfc488c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:22.029194 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-025a3c58-9122-439c-b111-cd53abfc488c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.273175 Jul 20 04:33:22.030129 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2296/4591] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:21 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:22.075764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-7a3d73ee-f2e6-4102-bc69-b934cfe89b43 req-49190f93-7c76-46ad-9e51-eba5a4c7f1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85bd8d6-2ced-4348-8d60-1a511efe1dbf", "name": "network-vif-plugged", "status": "completed", "tag": "4855b0c7-7ed8-4f67-a524-a68644b35601"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:22.087377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7a3d73ee-f2e6-4102-bc69-b934cfe89b43 req-49190f93-7c76-46ad-9e51-eba5a4c7f1c0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.088044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7a3d73ee-f2e6-4102-bc69-b934cfe89b43 req-49190f93-7c76-46ad-9e51-eba5a4c7f1c0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.105877 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-7a3d73ee-f2e6-4102-bc69-b934cfe89b43 req-49190f93-7c76-46ad-9e51-eba5a4c7f1c0 service nova] Creating event network-vif-plugged:4855b0c7-7ed8-4f67-a524-a68644b35601 for instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf on n-h1-760456-11 Jul 20 04:33:22.112187 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-7a3d73ee-f2e6-4102-bc69-b934cfe89b43 req-49190f93-7c76-46ad-9e51-eba5a4c7f1c0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040014 Jul 20 04:33:22.114129 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2296/4592] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:22.183561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-278b1fa4-2761-4308-bc0e-4b65f7450159 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:22.184985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-278b1fa4-2761-4308-bc0e-4b65f7450159 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:22.192491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-278b1fa4-2761-4308-bc0e-4b65f7450159 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.193342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-278b1fa4-2761-4308-bc0e-4b65f7450159 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.194326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-278b1fa4-2761-4308-bc0e-4b65f7450159 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.195046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-278b1fa4-2761-4308-bc0e-4b65f7450159 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.446728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-278b1fa4-2761-4308-bc0e-4b65f7450159 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:22.454508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-278b1fa4-2761-4308-bc0e-4b65f7450159 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1320 microversion: 2.1 time: 0.275545 Jul 20 04:33:22.464370 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2297/4593] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:22 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1320 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:22.781768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:22.782727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=22 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:22.787638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-024e6d14-bcbc-45b0-a64a-a0cea950e48d tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:22.788368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-024e6d14-bcbc-45b0-a64a-a0cea950e48d tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:22.796069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-024e6d14-bcbc-45b0-a64a-a0cea950e48d tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.796635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-024e6d14-bcbc-45b0-a64a-a0cea950e48d tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.797678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-024e6d14-bcbc-45b0-a64a-a0cea950e48d tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.798447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-024e6d14-bcbc-45b0-a64a-a0cea950e48d tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.039970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-024e6d14-bcbc-45b0-a64a-a0cea950e48d tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:23.049227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d070b7e0-eef4-44b1-9d42-39f5525dadb2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:23.051944 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-024e6d14-bcbc-45b0-a64a-a0cea950e48d tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1472 microversion: 2.1 time: 0.269357 Jul 20 04:33:23.052271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d070b7e0-eef4-44b1-9d42-39f5525dadb2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:23.061987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d070b7e0-eef4-44b1-9d42-39f5525dadb2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.062954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d070b7e0-eef4-44b1-9d42-39f5525dadb2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.065499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d070b7e0-eef4-44b1-9d42-39f5525dadb2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.066265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d070b7e0-eef4-44b1-9d42-39f5525dadb2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.075374 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2297/4594] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:22 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:23.291691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d070b7e0-eef4-44b1-9d42-39f5525dadb2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:23.304167 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d070b7e0-eef4-44b1-9d42-39f5525dadb2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.259357 Jul 20 04:33:23.304768 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2298/4595] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:23 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:23.475772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9f80706-daea-4c8e-b709-6072d340671a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:23.476701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9f80706-daea-4c8e-b709-6072d340671a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:23.487508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9f80706-daea-4c8e-b709-6072d340671a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.488254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9f80706-daea-4c8e-b709-6072d340671a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.490008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9f80706-daea-4c8e-b709-6072d340671a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:23.491251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9f80706-daea-4c8e-b709-6072d340671a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:23.710065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9f80706-daea-4c8e-b709-6072d340671a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:23.725600 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9f80706-daea-4c8e-b709-6072d340671a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1320 microversion: 2.1 time: 0.255431 Jul 20 04:33:23.726327 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2298/4596] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:23 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:24.070498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f802816e-a675-4625-9150-e5ab934bd8c1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:24.071118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f802816e-a675-4625-9150-e5ab934bd8c1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:24.080040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f802816e-a675-4625-9150-e5ab934bd8c1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.080750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f802816e-a675-4625-9150-e5ab934bd8c1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.081905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f802816e-a675-4625-9150-e5ab934bd8c1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.083336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f802816e-a675-4625-9150-e5ab934bd8c1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.325870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-151c9625-10d6-4d2a-be51-007513dba5ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:24.328377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-151c9625-10d6-4d2a-be51-007513dba5ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:24.338899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-151c9625-10d6-4d2a-be51-007513dba5ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.339628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-151c9625-10d6-4d2a-be51-007513dba5ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.340750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-151c9625-10d6-4d2a-be51-007513dba5ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.341379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-151c9625-10d6-4d2a-be51-007513dba5ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.401273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f802816e-a675-4625-9150-e5ab934bd8c1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:24.434286 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f802816e-a675-4625-9150-e5ab934bd8c1 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1643 microversion: 2.1 time: 0.367591 Jul 20 04:33:24.434973 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2299/4597] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:24 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1643 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:24.452241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1e54be92-bf67-40a5-ac81-e6532c9a6596 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:24.453145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1e54be92-bf67-40a5-ac81-e6532c9a6596 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:24.455284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:24.464581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e54be92-bf67-40a5-ac81-e6532c9a6596 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.465344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e54be92-bf67-40a5-ac81-e6532c9a6596 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.466197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e54be92-bf67-40a5-ac81-e6532c9a6596 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.466666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e54be92-bf67-40a5-ac81-e6532c9a6596 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.557712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-151c9625-10d6-4d2a-be51-007513dba5ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:24.567728 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-151c9625-10d6-4d2a-be51-007513dba5ad tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.248114 Jul 20 04:33:24.577532 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2299/4598] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:24 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:24.705458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1e54be92-bf67-40a5-ac81-e6532c9a6596 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:24.716547 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1e54be92-bf67-40a5-ac81-e6532c9a6596 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1643 microversion: 2.1 time: 0.268221 Jul 20 04:33:24.717724 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2300/4599] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:24 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1643 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:24.732664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cbc308b9-84eb-409e-93b1-9391438c5f1f tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:24.733285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cbc308b9-84eb-409e-93b1-9391438c5f1f tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:24.740747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbc308b9-84eb-409e-93b1-9391438c5f1f tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.741540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbc308b9-84eb-409e-93b1-9391438c5f1f tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.742361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbc308b9-84eb-409e-93b1-9391438c5f1f tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.742981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbc308b9-84eb-409e-93b1-9391438c5f1f tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.753854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c6f77f89-8dd9-40e6-afdd-23a80ae1e3a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:24.754909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c6f77f89-8dd9-40e6-afdd-23a80ae1e3a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:24.770127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6f77f89-8dd9-40e6-afdd-23a80ae1e3a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.772777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6f77f89-8dd9-40e6-afdd-23a80ae1e3a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.773755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6f77f89-8dd9-40e6-afdd-23a80ae1e3a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.776126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6f77f89-8dd9-40e6-afdd-23a80ae1e3a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.813222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:25.000781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c6f77f89-8dd9-40e6-afdd-23a80ae1e3a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:25.012690 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c6f77f89-8dd9-40e6-afdd-23a80ae1e3a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1320 microversion: 2.1 time: 0.267392 Jul 20 04:33:25.014347 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2301/4600] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:24 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:25.058131 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cbc308b9-84eb-409e-93b1-9391438c5f1f tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1796 microversion: 2.1 time: 0.329027 Jul 20 04:33:25.072503 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2300/4601] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:24 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1796 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:25.586093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-302368ec-35e8-46ac-b979-af2301b4bdba tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:25.587891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-302368ec-35e8-46ac-b979-af2301b4bdba tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:25.595787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-302368ec-35e8-46ac-b979-af2301b4bdba tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:25.596576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-302368ec-35e8-46ac-b979-af2301b4bdba tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:25.597543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-302368ec-35e8-46ac-b979-af2301b4bdba tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:25.598995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-302368ec-35e8-46ac-b979-af2301b4bdba tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.023152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-302368ec-35e8-46ac-b979-af2301b4bdba tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:26.033118 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-302368ec-35e8-46ac-b979-af2301b4bdba tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.451809 Jul 20 04:33:26.033733 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2302/4602] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:25 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:26.036598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1944a51f-a172-4c2d-8c7f-e76820e869cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:26.037504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1944a51f-a172-4c2d-8c7f-e76820e869cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:26.045022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1944a51f-a172-4c2d-8c7f-e76820e869cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:26.046167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1944a51f-a172-4c2d-8c7f-e76820e869cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.055680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1944a51f-a172-4c2d-8c7f-e76820e869cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:26.060865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1944a51f-a172-4c2d-8c7f-e76820e869cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.305130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1944a51f-a172-4c2d-8c7f-e76820e869cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:26.314771 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1944a51f-a172-4c2d-8c7f-e76820e869cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1320 microversion: 2.1 time: 0.287978 Jul 20 04:33:26.318031 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2301/4603] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:26 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:26.545282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a91ae574-de96-4fa9-800c-3bd5072b9bfd req-354ed312-0051-4e76-bf13-0ac9d1c47c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc1ba40-3317-4f43-b0eb-f70d7b70278c", "name": "network-vif-plugged", "status": "completed", "tag": "8b98b113-521f-4c80-919e-c7c5276a5f63"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:26.559999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a91ae574-de96-4fa9-800c-3bd5072b9bfd req-354ed312-0051-4e76-bf13-0ac9d1c47c35 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:26.560448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a91ae574-de96-4fa9-800c-3bd5072b9bfd req-354ed312-0051-4e76-bf13-0ac9d1c47c35 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.587067 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a91ae574-de96-4fa9-800c-3bd5072b9bfd req-354ed312-0051-4e76-bf13-0ac9d1c47c35 service nova] Creating event network-vif-plugged:8b98b113-521f-4c80-919e-c7c5276a5f63 for instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c on n-h1-760456-11 Jul 20 04:33:26.592692 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a91ae574-de96-4fa9-800c-3bd5072b9bfd req-354ed312-0051-4e76-bf13-0ac9d1c47c35 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.478896 Jul 20 04:33:26.593931 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2303/4604] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:27.052401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-51ceca1e-f7d8-470e-bd94-7ebed88fe5fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:27.053024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-51ceca1e-f7d8-470e-bd94-7ebed88fe5fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:27.068810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51ceca1e-f7d8-470e-bd94-7ebed88fe5fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:27.069270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51ceca1e-f7d8-470e-bd94-7ebed88fe5fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.070210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51ceca1e-f7d8-470e-bd94-7ebed88fe5fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:27.070514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51ceca1e-f7d8-470e-bd94-7ebed88fe5fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.257150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-51ceca1e-f7d8-470e-bd94-7ebed88fe5fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:27.266176 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-51ceca1e-f7d8-470e-bd94-7ebed88fe5fd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.218264 Jul 20 04:33:27.280567 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2302/4605] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:27 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:27.336574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45b159cb-983d-4d3f-909b-f7d0cb78d10f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:27.337970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-45b159cb-983d-4d3f-909b-f7d0cb78d10f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:27.351775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45b159cb-983d-4d3f-909b-f7d0cb78d10f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:27.353467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45b159cb-983d-4d3f-909b-f7d0cb78d10f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.355027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45b159cb-983d-4d3f-909b-f7d0cb78d10f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:27.355663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45b159cb-983d-4d3f-909b-f7d0cb78d10f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.682775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45b159cb-983d-4d3f-909b-f7d0cb78d10f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:27.692949 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-45b159cb-983d-4d3f-909b-f7d0cb78d10f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1320 microversion: 2.1 time: 0.363302 Jul 20 04:33:27.694911 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2304/4606] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:27 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1320 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:28.288551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97b8defa-6fcd-481e-8c4a-c804f3434e0d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:28.289587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97b8defa-6fcd-481e-8c4a-c804f3434e0d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:28.302007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97b8defa-6fcd-481e-8c4a-c804f3434e0d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.306633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97b8defa-6fcd-481e-8c4a-c804f3434e0d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.307773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97b8defa-6fcd-481e-8c4a-c804f3434e0d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.309548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97b8defa-6fcd-481e-8c4a-c804f3434e0d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.635298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97b8defa-6fcd-481e-8c4a-c804f3434e0d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:28.668498 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97b8defa-6fcd-481e-8c4a-c804f3434e0d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.384370 Jul 20 04:33:28.684166 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2303/4607] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:28 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:28.710946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eb806422-6cc8-4972-ae6b-e1995b5d6917 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:28.711557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eb806422-6cc8-4972-ae6b-e1995b5d6917 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:28.729935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb806422-6cc8-4972-ae6b-e1995b5d6917 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.732066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb806422-6cc8-4972-ae6b-e1995b5d6917 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.734379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb806422-6cc8-4972-ae6b-e1995b5d6917 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.737286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb806422-6cc8-4972-ae6b-e1995b5d6917 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:28.904573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e8162638-8875-4b6a-9ad6-0e22e9771c69 req-d8a3ee25-4f93-48ca-896e-d71b150b614a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85bd8d6-2ced-4348-8d60-1a511efe1dbf", "tag": "4855b0c7-7ed8-4f67-a524-a68644b35601"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:28.951492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e8162638-8875-4b6a-9ad6-0e22e9771c69 req-d8a3ee25-4f93-48ca-896e-d71b150b614a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:28.952626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e8162638-8875-4b6a-9ad6-0e22e9771c69 req-d8a3ee25-4f93-48ca-896e-d71b150b614a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.005885 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e8162638-8875-4b6a-9ad6-0e22e9771c69 req-d8a3ee25-4f93-48ca-896e-d71b150b614a service nova] Creating event network-changed:4855b0c7-7ed8-4f67-a524-a68644b35601 for instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf on n-h1-760456-11 Jul 20 04:33:29.024258 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e8162638-8875-4b6a-9ad6-0e22e9771c69 req-d8a3ee25-4f93-48ca-896e-d71b150b614a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130920 Jul 20 04:33:29.030978 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2304/4608] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:29.212397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eb806422-6cc8-4972-ae6b-e1995b5d6917 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:29.226809 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eb806422-6cc8-4972-ae6b-e1995b5d6917 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1502 microversion: 2.1 time: 0.521644 Jul 20 04:33:29.228795 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2305/4609] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:28 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1502 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:29.246694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c20b1678-fcc6-4127-9f48-1452d23d38cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:29.247786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c20b1678-fcc6-4127-9f48-1452d23d38cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:29.268960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c20b1678-fcc6-4127-9f48-1452d23d38cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:29.276015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c20b1678-fcc6-4127-9f48-1452d23d38cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.277352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c20b1678-fcc6-4127-9f48-1452d23d38cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:29.277479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c20b1678-fcc6-4127-9f48-1452d23d38cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.649889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c20b1678-fcc6-4127-9f48-1452d23d38cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:29.663337 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c20b1678-fcc6-4127-9f48-1452d23d38cc tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1502 microversion: 2.1 time: 0.420916 Jul 20 04:33:29.666475 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2305/4610] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:29 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1502 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:29.683194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa63765a-eab7-47b0-9888-0f3e21a4302d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:29.683707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aa63765a-eab7-47b0-9888-0f3e21a4302d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:29.694900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-81dcc5a2-6c21-4a71-bf1f-e6b9343a9e7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:29.695553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa63765a-eab7-47b0-9888-0f3e21a4302d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:29.696037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa63765a-eab7-47b0-9888-0f3e21a4302d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.696352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-81dcc5a2-6c21-4a71-bf1f-e6b9343a9e7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:29.698736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa63765a-eab7-47b0-9888-0f3e21a4302d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:29.699204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa63765a-eab7-47b0-9888-0f3e21a4302d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.714526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81dcc5a2-6c21-4a71-bf1f-e6b9343a9e7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:29.721185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81dcc5a2-6c21-4a71-bf1f-e6b9343a9e7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.722333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81dcc5a2-6c21-4a71-bf1f-e6b9343a9e7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:29.723560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81dcc5a2-6c21-4a71-bf1f-e6b9343a9e7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:29.764431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aa63765a-eab7-47b0-9888-0f3e21a4302d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:29.979678 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aa63765a-eab7-47b0-9888-0f3e21a4302d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 204 len: 0 microversion: 2.1 time: 0.299289 Jul 20 04:33:29.986364 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2306/4611] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:33:29 2022] DELETE /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:29.997013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a876975f-185a-4402-a85d-2e396e42c0ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:30.002586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a876975f-185a-4402-a85d-2e396e42c0ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:30.024215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a876975f-185a-4402-a85d-2e396e42c0ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:30.024715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a876975f-185a-4402-a85d-2e396e42c0ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:30.025503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a876975f-185a-4402-a85d-2e396e42c0ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:30.025948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a876975f-185a-4402-a85d-2e396e42c0ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:30.274612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-81dcc5a2-6c21-4a71-bf1f-e6b9343a9e7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:30.283796 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-81dcc5a2-6c21-4a71-bf1f-e6b9343a9e7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.595755 Jul 20 04:33:30.287022 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2306/4612] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:29 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:30.401841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a876975f-185a-4402-a85d-2e396e42c0ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:30.413273 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a876975f-185a-4402-a85d-2e396e42c0ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1508 microversion: 2.1 time: 0.421069 Jul 20 04:33:30.414465 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2307/4613] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:29 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:31.306331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8482e7a9-ad00-4f0e-acf3-cdf7fb192941 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:31.307248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8482e7a9-ad00-4f0e-acf3-cdf7fb192941 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:31.326137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8482e7a9-ad00-4f0e-acf3-cdf7fb192941 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.334083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8482e7a9-ad00-4f0e-acf3-cdf7fb192941 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.335506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8482e7a9-ad00-4f0e-acf3-cdf7fb192941 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.336366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8482e7a9-ad00-4f0e-acf3-cdf7fb192941 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.431949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-31449951-e6cb-442a-abaa-d02ef9b76087 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:31.433209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-31449951-e6cb-442a-abaa-d02ef9b76087 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:31.443250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31449951-e6cb-442a-abaa-d02ef9b76087 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.444218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31449951-e6cb-442a-abaa-d02ef9b76087 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.445324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31449951-e6cb-442a-abaa-d02ef9b76087 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:31.445954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31449951-e6cb-442a-abaa-d02ef9b76087 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:31.782129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-31449951-e6cb-442a-abaa-d02ef9b76087 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:31.795395 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-31449951-e6cb-442a-abaa-d02ef9b76087 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1508 microversion: 2.1 time: 0.367539 Jul 20 04:33:31.801716 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2308/4614] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:31 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:32.127365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8482e7a9-ad00-4f0e-acf3-cdf7fb192941 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:32.143352 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8482e7a9-ad00-4f0e-acf3-cdf7fb192941 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.843598 Jul 20 04:33:32.144776 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2307/4615] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:31 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:32.815272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cba42224-2bfd-4956-a7be-f42b143aac99 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:32.816292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cba42224-2bfd-4956-a7be-f42b143aac99 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:32.834038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cba42224-2bfd-4956-a7be-f42b143aac99 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:32.845937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cba42224-2bfd-4956-a7be-f42b143aac99 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:32.848347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cba42224-2bfd-4956-a7be-f42b143aac99 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:32.849880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cba42224-2bfd-4956-a7be-f42b143aac99 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.029023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cba42224-2bfd-4956-a7be-f42b143aac99 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:33.050048 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cba42224-2bfd-4956-a7be-f42b143aac99 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 200 len: 1466 microversion: 2.1 time: 0.239072 Jul 20 04:33:33.059630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2309/4616] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:32 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 1466 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:33.094006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8e599bb9-6f0d-443b-89dc-9b05335931cf req-b7902c25-e52b-4b3e-aa00-f5712775a6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc1ba40-3317-4f43-b0eb-f70d7b70278c", "name": "network-vif-deleted", "tag": "8b98b113-521f-4c80-919e-c7c5276a5f63"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:33.106067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8e599bb9-6f0d-443b-89dc-9b05335931cf req-b7902c25-e52b-4b3e-aa00-f5712775a6dc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.106946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8e599bb9-6f0d-443b-89dc-9b05335931cf req-b7902c25-e52b-4b3e-aa00-f5712775a6dc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.135197 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8e599bb9-6f0d-443b-89dc-9b05335931cf req-b7902c25-e52b-4b3e-aa00-f5712775a6dc service nova] Creating event network-vif-deleted:8b98b113-521f-4c80-919e-c7c5276a5f63 for instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c on n-h1-760456-11 Jul 20 04:33:33.142935 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8e599bb9-6f0d-443b-89dc-9b05335931cf req-b7902c25-e52b-4b3e-aa00-f5712775a6dc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055054 Jul 20 04:33:33.143997 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2308/4617] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:33.163188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c06042bd-bb28-4bb3-b03a-4d804cad4047 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:33.164099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c06042bd-bb28-4bb3-b03a-4d804cad4047 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:33.171261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c06042bd-bb28-4bb3-b03a-4d804cad4047 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.173158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c06042bd-bb28-4bb3-b03a-4d804cad4047 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.178956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c06042bd-bb28-4bb3-b03a-4d804cad4047 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.179767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c06042bd-bb28-4bb3-b03a-4d804cad4047 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.502301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c06042bd-bb28-4bb3-b03a-4d804cad4047 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:33.516673 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c06042bd-bb28-4bb3-b03a-4d804cad4047 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.358108 Jul 20 04:33:33.517710 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2310/4618] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:33 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:34.078946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e2776032-7460-4b72-9b9f-674f2bd7f9c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:34.080265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e2776032-7460-4b72-9b9f-674f2bd7f9c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:34.092393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2776032-7460-4b72-9b9f-674f2bd7f9c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.093265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2776032-7460-4b72-9b9f-674f2bd7f9c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.095071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2776032-7460-4b72-9b9f-674f2bd7f9c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.096209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2776032-7460-4b72-9b9f-674f2bd7f9c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.129072 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e2776032-7460-4b72-9b9f-674f2bd7f9c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e2776032-7460-4b72-9b9f-674f2bd7f9c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c HTTP/1.1 Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'ccc1ba40-3317-4f43-b0eb-f70d7b70278c'} Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:33:34.136977 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:34.145369 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:34.145369 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:34.145369 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:34.145369 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:34.145369 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:33:34.145369 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:33:34.147901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e2776032-7460-4b72-9b9f-674f2bd7f9c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:34.149069 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e2776032-7460-4b72-9b9f-674f2bd7f9c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 404 len: 111 microversion: 2.1 time: 0.075801 Jul 20 04:33:34.151969 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2309/4619] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:34 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:33:34.172486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a0443ccb-832e-43d2-a3f6-723065159e71 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'create', calling method: .version_select at 0x7fb841537040>, body: {"keypair": {"name": "tempest-key-622431606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7F72OpvSKKQV1JzVLRaWP7F40U/k+2OombIs1dLK2HvHL6QzI9eAlQxTgeBZo/W+h6bMmocJleKmrMVOpbwDyia6qkfiggzF4klDv4wbJ1+RltuHpE+0zfh98MWQuiUQ=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:34.216127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a0443ccb-832e-43d2-a3f6-723065159e71 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for project df53fc243b9d475caab3cd428bf51d2f. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:34.232566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a0443ccb-832e-43d2-a3f6-723065159e71 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for user f224517836bf403a83da9e2e7f175907 and project df53fc243b9d475caab3cd428bf51d2f. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:34.280819 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a0443ccb-832e-43d2-a3f6-723065159e71 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.115042 Jul 20 04:33:34.292639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b725be05-d3f3-4189-9405-ad48214bfb2f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '.version_select at 0x7fb8410dfc10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:34.293255 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2311/4620] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:33:34 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:34.295842 n-d-760456-11 devstack@n-api.service[119606]: WARNING oslo_db.sqlalchemy.utils [None req-b725be05-d3f3-4189-9405-ad48214bfb2f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:33:34.334339 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b725be05-d3f3-4189-9405-ad48214bfb2f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.024536 Jul 20 04:33:34.345892 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2310/4621] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:33:34 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:34.536612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3a4ba7b3-ee40-4ebc-b12a-65ef608d3ef9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:34.537841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3a4ba7b3-ee40-4ebc-b12a-65ef608d3ef9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:34.548723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a4ba7b3-ee40-4ebc-b12a-65ef608d3ef9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.552831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a4ba7b3-ee40-4ebc-b12a-65ef608d3ef9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.554951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a4ba7b3-ee40-4ebc-b12a-65ef608d3ef9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.557019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a4ba7b3-ee40-4ebc-b12a-65ef608d3ef9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.576581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1941673368", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "key_name": "tempest-key-622431606", "networks": [{"uuid": "7b0934fb-ee96-446d-a65b-fee23ff74766"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:34.684600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] validate_networks() for [('7b0934fb-ee96-446d-a65b-fee23ff74766', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:34.897334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3a4ba7b3-ee40-4ebc-b12a-65ef608d3ef9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:34.909214 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3a4ba7b3-ee40-4ebc-b12a-65ef608d3ef9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.377634 Jul 20 04:33:34.921442 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2312/4622] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:34 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:35.288888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e07ec604-c11a-4766-a00d-422a0e425100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:35.289944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e07ec604-c11a-4766-a00d-422a0e425100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:35.299119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e07ec604-c11a-4766-a00d-422a0e425100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.302504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e07ec604-c11a-4766-a00d-422a0e425100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.306831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e07ec604-c11a-4766-a00d-422a0e425100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.307846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e07ec604-c11a-4766-a00d-422a0e425100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.404174 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e07ec604-c11a-4766-a00d-422a0e425100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786/action" status: 200 len: 24581 microversion: 2.1 time: 0.119613 Jul 20 04:33:35.405302 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2313/4623] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:35 2022] POST /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786/action => generated 24581 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:33:35.561592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:35.562080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:35.562518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:35.562941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:35.563369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:35.586649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.587474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.590161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.590891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.636874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:35.650736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for user f224517836bf403a83da9e2e7f175907 and project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:35.698741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:35.701144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:35.824806 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1c17e9ca-5041-436c-8361-599a1cf37888 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249643 Jul 20 04:33:35.828355 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2311/4624] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:35.846168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-50d5e3b1-d2f4-4667-9d9e-328e671cc95a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:35.847856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-50d5e3b1-d2f4-4667-9d9e-328e671cc95a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:35.930789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cec1dcd8-7b0b-4bf1-b304-143e4b9058c2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:35.931423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cec1dcd8-7b0b-4bf1-b304-143e4b9058c2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:35.954903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:35.956880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cec1dcd8-7b0b-4bf1-b304-143e4b9058c2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.964027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cec1dcd8-7b0b-4bf1-b304-143e4b9058c2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:35.969705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cec1dcd8-7b0b-4bf1-b304-143e4b9058c2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:35.970414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cec1dcd8-7b0b-4bf1-b304-143e4b9058c2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.021036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-50d5e3b1-d2f4-4667-9d9e-328e671cc95a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:36.030012 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-50d5e3b1-d2f4-4667-9d9e-328e671cc95a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1228 microversion: 2.1 time: 0.190456 Jul 20 04:33:36.035431 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2314/4625] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:35 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1228 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:36.304259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cec1dcd8-7b0b-4bf1-b304-143e4b9058c2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:36.317289 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cec1dcd8-7b0b-4bf1-b304-143e4b9058c2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.391574 Jul 20 04:33:36.317927 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2312/4626] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:35 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:37.057659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-791a27b6-75e5-4ded-bdaf-65c1f20d28df tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:37.059334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-791a27b6-75e5-4ded-bdaf-65c1f20d28df tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:37.070018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-791a27b6-75e5-4ded-bdaf-65c1f20d28df tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.070803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-791a27b6-75e5-4ded-bdaf-65c1f20d28df tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.071779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-791a27b6-75e5-4ded-bdaf-65c1f20d28df tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.072583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-791a27b6-75e5-4ded-bdaf-65c1f20d28df tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.255708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-791a27b6-75e5-4ded-bdaf-65c1f20d28df tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.265813 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-791a27b6-75e5-4ded-bdaf-65c1f20d28df tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1224 microversion: 2.1 time: 0.216704 Jul 20 04:33:37.268155 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2315/4627] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1224 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:37.345195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-11d5a3f2-e958-4b30-accf-8ce7531bd6a2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:37.346025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-11d5a3f2-e958-4b30-accf-8ce7531bd6a2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:37.372340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11d5a3f2-e958-4b30-accf-8ce7531bd6a2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.372799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11d5a3f2-e958-4b30-accf-8ce7531bd6a2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.373601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11d5a3f2-e958-4b30-accf-8ce7531bd6a2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.374041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11d5a3f2-e958-4b30-accf-8ce7531bd6a2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.733178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-11d5a3f2-e958-4b30-accf-8ce7531bd6a2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:37.744258 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-11d5a3f2-e958-4b30-accf-8ce7531bd6a2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.410144 Jul 20 04:33:37.744866 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2313/4628] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:38.288132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a2809ddb-6193-4d57-9c70-56faba2e751a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.288992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a2809ddb-6193-4d57-9c70-56faba2e751a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.303236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2809ddb-6193-4d57-9c70-56faba2e751a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.307420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2809ddb-6193-4d57-9c70-56faba2e751a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.308829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2809ddb-6193-4d57-9c70-56faba2e751a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.309490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2809ddb-6193-4d57-9c70-56faba2e751a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.423843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a2809ddb-6193-4d57-9c70-56faba2e751a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:38.433498 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a2809ddb-6193-4d57-9c70-56faba2e751a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1286 microversion: 2.1 time: 0.150555 Jul 20 04:33:38.435137 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2316/4629] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:38.764977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4cff816-3a26-4b14-bb61-6d174aa361b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.766213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a4cff816-3a26-4b14-bb61-6d174aa361b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.790382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4cff816-3a26-4b14-bb61-6d174aa361b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.799695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4cff816-3a26-4b14-bb61-6d174aa361b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.800719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4cff816-3a26-4b14-bb61-6d174aa361b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.805064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4cff816-3a26-4b14-bb61-6d174aa361b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.451026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d63b7d7f-40dc-4b08-bdc3-3329df6bdd25 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:39.451661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d63b7d7f-40dc-4b08-bdc3-3329df6bdd25 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:39.464153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d63b7d7f-40dc-4b08-bdc3-3329df6bdd25 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:39.464621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d63b7d7f-40dc-4b08-bdc3-3329df6bdd25 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.465422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d63b7d7f-40dc-4b08-bdc3-3329df6bdd25 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:39.465870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d63b7d7f-40dc-4b08-bdc3-3329df6bdd25 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.749874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d63b7d7f-40dc-4b08-bdc3-3329df6bdd25 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:39.759017 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d63b7d7f-40dc-4b08-bdc3-3329df6bdd25 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1328 microversion: 2.1 time: 0.312147 Jul 20 04:33:39.763416 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2317/4630] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:39 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1328 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:39.856954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a4cff816-3a26-4b14-bb61-6d174aa361b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:39.875179 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a4cff816-3a26-4b14-bb61-6d174aa361b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 1.113172 Jul 20 04:33:39.877352 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2314/4631] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:40.439694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3b4c3410-4a83-4b15-b43f-371265172585 req-d8cdfcaa-a617-4889-949e-9d475d3dc153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c37f4e1e-e8c0-41ae-9bfa-e01910ea2985", "tag": "0d55f639-fa94-43b1-963f-6fb87d2461d2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:40.457491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3b4c3410-4a83-4b15-b43f-371265172585 req-d8cdfcaa-a617-4889-949e-9d475d3dc153 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.461501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3b4c3410-4a83-4b15-b43f-371265172585 req-d8cdfcaa-a617-4889-949e-9d475d3dc153 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.481428 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3b4c3410-4a83-4b15-b43f-371265172585 req-d8cdfcaa-a617-4889-949e-9d475d3dc153 service nova] Creating event network-changed:0d55f639-fa94-43b1-963f-6fb87d2461d2 for instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 on n-h2-760456-11 Jul 20 04:33:40.494722 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3b4c3410-4a83-4b15-b43f-371265172585 req-d8cdfcaa-a617-4889-949e-9d475d3dc153 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058562 Jul 20 04:33:40.496165 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2318/4632] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:40.779930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-992b31e5-4167-48d0-8869-9f60e2f019a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:40.780573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-992b31e5-4167-48d0-8869-9f60e2f019a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:40.804070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-992b31e5-4167-48d0-8869-9f60e2f019a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.804841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-992b31e5-4167-48d0-8869-9f60e2f019a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.805901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-992b31e5-4167-48d0-8869-9f60e2f019a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.806572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-992b31e5-4167-48d0-8869-9f60e2f019a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.865300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:40.897897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f4e54ca-ed9d-407d-8a3b-e1fda09caf63 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:40.898890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0f4e54ca-ed9d-407d-8a3b-e1fda09caf63 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:40.913351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f4e54ca-ed9d-407d-8a3b-e1fda09caf63 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.913821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f4e54ca-ed9d-407d-8a3b-e1fda09caf63 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.917631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f4e54ca-ed9d-407d-8a3b-e1fda09caf63 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.928175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f4e54ca-ed9d-407d-8a3b-e1fda09caf63 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.264119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-992b31e5-4167-48d0-8869-9f60e2f019a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:41.278977 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-992b31e5-4167-48d0-8869-9f60e2f019a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1328 microversion: 2.1 time: 0.503291 Jul 20 04:33:41.282511 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2315/4633] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:40 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1328 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:41.636000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0f4e54ca-ed9d-407d-8a3b-e1fda09caf63 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:41.645756 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0f4e54ca-ed9d-407d-8a3b-e1fda09caf63 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.752736 Jul 20 04:33:41.649080 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2319/4634] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:40 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:42.305313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6aa58794-b8d9-4bfc-bfeb-daa6a73eeae2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:42.306584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6aa58794-b8d9-4bfc-bfeb-daa6a73eeae2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:42.317783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6aa58794-b8d9-4bfc-bfeb-daa6a73eeae2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:42.318929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6aa58794-b8d9-4bfc-bfeb-daa6a73eeae2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.319999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6aa58794-b8d9-4bfc-bfeb-daa6a73eeae2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:42.329770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6aa58794-b8d9-4bfc-bfeb-daa6a73eeae2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.670785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-686b63f3-0038-40cb-ac47-41c97f24ca24 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:42.680831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-686b63f3-0038-40cb-ac47-41c97f24ca24 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:42.688733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-686b63f3-0038-40cb-ac47-41c97f24ca24 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:42.689207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-686b63f3-0038-40cb-ac47-41c97f24ca24 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.693639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-686b63f3-0038-40cb-ac47-41c97f24ca24 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:42.694390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-686b63f3-0038-40cb-ac47-41c97f24ca24 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.710446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:42.741487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6aa58794-b8d9-4bfc-bfeb-daa6a73eeae2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:42.751944 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6aa58794-b8d9-4bfc-bfeb-daa6a73eeae2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1328 microversion: 2.1 time: 0.451331 Jul 20 04:33:42.756427 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2316/4635] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:42 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1328 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:43.216889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-686b63f3-0038-40cb-ac47-41c97f24ca24 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:43.257692 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-686b63f3-0038-40cb-ac47-41c97f24ca24 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.595852 Jul 20 04:33:43.258708 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2320/4636] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:42 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:43.770630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b88043cc-a02a-4ee8-bde3-8cb340057359 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:43.771512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b88043cc-a02a-4ee8-bde3-8cb340057359 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:43.785684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b88043cc-a02a-4ee8-bde3-8cb340057359 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.787636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b88043cc-a02a-4ee8-bde3-8cb340057359 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:43.788782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b88043cc-a02a-4ee8-bde3-8cb340057359 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:43.791793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b88043cc-a02a-4ee8-bde3-8cb340057359 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.116876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b88043cc-a02a-4ee8-bde3-8cb340057359 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:44.153103 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b88043cc-a02a-4ee8-bde3-8cb340057359 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1328 microversion: 2.1 time: 0.387198 Jul 20 04:33:44.159024 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2317/4637] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:43 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1328 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:44.277294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45c9ed05-c872-4838-954e-9f5e2f8651d6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:44.278638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-45c9ed05-c872-4838-954e-9f5e2f8651d6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:44.286180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45c9ed05-c872-4838-954e-9f5e2f8651d6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.288058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45c9ed05-c872-4838-954e-9f5e2f8651d6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.289262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45c9ed05-c872-4838-954e-9f5e2f8651d6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.289964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45c9ed05-c872-4838-954e-9f5e2f8651d6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.641470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45c9ed05-c872-4838-954e-9f5e2f8651d6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:44.652651 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-45c9ed05-c872-4838-954e-9f5e2f8651d6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.384095 Jul 20 04:33:44.659988 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2321/4638] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:44 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:45.189194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8c7caf7e-e85b-42d4-942c-5adc523ef03a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:45.189194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8c7caf7e-e85b-42d4-942c-5adc523ef03a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:45.204734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c7caf7e-e85b-42d4-942c-5adc523ef03a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.206972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c7caf7e-e85b-42d4-942c-5adc523ef03a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.209257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c7caf7e-e85b-42d4-942c-5adc523ef03a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.209730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c7caf7e-e85b-42d4-942c-5adc523ef03a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.591245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c7caf7e-e85b-42d4-942c-5adc523ef03a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:45.605717 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8c7caf7e-e85b-42d4-942c-5adc523ef03a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1328 microversion: 2.1 time: 0.433670 Jul 20 04:33:45.606362 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2318/4639] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:45 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1328 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:45.690023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf974257-adfd-4000-9c90-b11821b75b49 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:45.691799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cf974257-adfd-4000-9c90-b11821b75b49 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:45.704002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf974257-adfd-4000-9c90-b11821b75b49 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.705118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf974257-adfd-4000-9c90-b11821b75b49 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.708580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf974257-adfd-4000-9c90-b11821b75b49 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.709766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf974257-adfd-4000-9c90-b11821b75b49 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.991943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-7ed3149e-a09e-4da2-a313-b45e8fc63b01 req-7fc1f342-5a84-4498-a485-0154bc784fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c37f4e1e-e8c0-41ae-9bfa-e01910ea2985", "name": "network-vif-plugged", "status": "completed", "tag": "0d55f639-fa94-43b1-963f-6fb87d2461d2"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:45.997175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:46.010766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:46.025565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:46.051793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7ed3149e-a09e-4da2-a313-b45e8fc63b01 req-7fc1f342-5a84-4498-a485-0154bc784fdc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.053000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7ed3149e-a09e-4da2-a313-b45e8fc63b01 req-7fc1f342-5a84-4498-a485-0154bc784fdc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.105017 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-7ed3149e-a09e-4da2-a313-b45e8fc63b01 req-7fc1f342-5a84-4498-a485-0154bc784fdc service nova] Creating event network-vif-plugged:0d55f639-fa94-43b1-963f-6fb87d2461d2 for instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 on n-h2-760456-11 Jul 20 04:33:46.114136 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-7ed3149e-a09e-4da2-a313-b45e8fc63b01 req-7fc1f342-5a84-4498-a485-0154bc784fdc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128275 Jul 20 04:33:46.115440 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2319/4640] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:33:46.190224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cf974257-adfd-4000-9c90-b11821b75b49 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:46.214659 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf974257-adfd-4000-9c90-b11821b75b49 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.541839 Jul 20 04:33:46.220898 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2322/4641] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:45 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:46.341594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7714d439-7fa4-40d9-bca6-c7fc7b5a1b11 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:46.342395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7714d439-7fa4-40d9-bca6-c7fc7b5a1b11 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:46.361093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7714d439-7fa4-40d9-bca6-c7fc7b5a1b11 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.361093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7714d439-7fa4-40d9-bca6-c7fc7b5a1b11 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.361787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7714d439-7fa4-40d9-bca6-c7fc7b5a1b11 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.362262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7714d439-7fa4-40d9-bca6-c7fc7b5a1b11 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.629511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4c35bcdc-4ab5-4970-97c9-728f1a130040 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:46.630115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4c35bcdc-4ab5-4970-97c9-728f1a130040 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:46.637615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c35bcdc-4ab5-4970-97c9-728f1a130040 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.638241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c35bcdc-4ab5-4970-97c9-728f1a130040 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.639138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c35bcdc-4ab5-4970-97c9-728f1a130040 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.639650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4c35bcdc-4ab5-4970-97c9-728f1a130040 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.953458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4c35bcdc-4ab5-4970-97c9-728f1a130040 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:46.989529 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4c35bcdc-4ab5-4970-97c9-728f1a130040 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1328 microversion: 2.1 time: 0.367880 Jul 20 04:33:46.997486 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2323/4642] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:46 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1328 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:47.056294 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7714d439-7fa4-40d9-bca6-c7fc7b5a1b11 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1836 microversion: 2.1 time: 0.727720 Jul 20 04:33:47.058008 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2320/4643] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:46 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1836 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:47.239348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7db6e8ad-3ec7-453a-a75b-f990b9625115 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:47.240189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7db6e8ad-3ec7-453a-a75b-f990b9625115 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:47.262398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7db6e8ad-3ec7-453a-a75b-f990b9625115 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:47.272409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7db6e8ad-3ec7-453a-a75b-f990b9625115 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:47.273254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7db6e8ad-3ec7-453a-a75b-f990b9625115 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:47.273719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7db6e8ad-3ec7-453a-a75b-f990b9625115 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:47.949199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7db6e8ad-3ec7-453a-a75b-f990b9625115 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:47.961996 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7db6e8ad-3ec7-453a-a75b-f990b9625115 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1511 microversion: 2.1 time: 0.728324 Jul 20 04:33:47.971723 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2324/4644] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:47 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1511 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:48.008266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6a5b982-1400-48b7-b662-953f518acdd7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:48.009113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6a5b982-1400-48b7-b662-953f518acdd7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:48.023315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6a5b982-1400-48b7-b662-953f518acdd7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.026117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6a5b982-1400-48b7-b662-953f518acdd7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.027262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6a5b982-1400-48b7-b662-953f518acdd7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.027934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6a5b982-1400-48b7-b662-953f518acdd7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.522576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6a5b982-1400-48b7-b662-953f518acdd7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:48.530963 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6a5b982-1400-48b7-b662-953f518acdd7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1510 microversion: 2.1 time: 0.526634 Jul 20 04:33:48.547267 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2321/4645] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:48 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1510 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:48.555054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07a5275f-6f3d-4720-85aa-aa08acb223bd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:48.555687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-07a5275f-6f3d-4720-85aa-aa08acb223bd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:48.564921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07a5275f-6f3d-4720-85aa-aa08acb223bd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.565384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07a5275f-6f3d-4720-85aa-aa08acb223bd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.566286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07a5275f-6f3d-4720-85aa-aa08acb223bd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.576794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07a5275f-6f3d-4720-85aa-aa08acb223bd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.902600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4cca4cf0-89c6-493d-b4a7-f256caf3e397 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:48.903139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4cca4cf0-89c6-493d-b4a7-f256caf3e397 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:48.909795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cca4cf0-89c6-493d-b4a7-f256caf3e397 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.910552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cca4cf0-89c6-493d-b4a7-f256caf3e397 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.911669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cca4cf0-89c6-493d-b4a7-f256caf3e397 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:48.912286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4cca4cf0-89c6-493d-b4a7-f256caf3e397 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.942376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4cca4cf0-89c6-493d-b4a7-f256caf3e397 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:49.062678 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4cca4cf0-89c6-493d-b4a7-f256caf3e397 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 204 len: 0 microversion: 2.1 time: 0.168602 Jul 20 04:33:49.064771 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2322/4646] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:33:48 2022] DELETE /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:49.072864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a91d3996-007a-4a14-831d-ac162b6a7aa3 req-49b4872e-1934-42e3-9dd6-38f6d736c3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6881eb5-fd94-4802-8fb1-ad74e99f0786", "tag": "aba34f57-d50c-4162-ad83-443faa06380d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:49.087726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a91d3996-007a-4a14-831d-ac162b6a7aa3 req-49b4872e-1934-42e3-9dd6-38f6d736c3c2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.088461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a91d3996-007a-4a14-831d-ac162b6a7aa3 req-49b4872e-1934-42e3-9dd6-38f6d736c3c2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.103617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a91d3996-007a-4a14-831d-ac162b6a7aa3 req-49b4872e-1934-42e3-9dd6-38f6d736c3c2 service nova] Creating event network-changed:aba34f57-d50c-4162-ad83-443faa06380d for instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 on n-h1-760456-11 Jul 20 04:33:49.109431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a91d3996-007a-4a14-831d-ac162b6a7aa3 req-49b4872e-1934-42e3-9dd6-38f6d736c3c2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041767 Jul 20 04:33:49.111202 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2323/4647] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:49.122610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7e9ccccf-fc2d-4a3a-b3cd-3d9673902ce4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.124076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7e9ccccf-fc2d-4a3a-b3cd-3d9673902ce4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.138122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e9ccccf-fc2d-4a3a-b3cd-3d9673902ce4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.139206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e9ccccf-fc2d-4a3a-b3cd-3d9673902ce4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.140588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e9ccccf-fc2d-4a3a-b3cd-3d9673902ce4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.141475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e9ccccf-fc2d-4a3a-b3cd-3d9673902ce4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.319860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7e9ccccf-fc2d-4a3a-b3cd-3d9673902ce4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:49.329680 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7e9ccccf-fc2d-4a3a-b3cd-3d9673902ce4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1488 microversion: 2.1 time: 0.216693 Jul 20 04:33:49.330686 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2324/4648] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:49 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1488 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:49.336090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4fe9c2ab-65c1-4efb-a278-60f6e32fbd98 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.336966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4fe9c2ab-65c1-4efb-a278-60f6e32fbd98 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.343736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fe9c2ab-65c1-4efb-a278-60f6e32fbd98 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.345024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fe9c2ab-65c1-4efb-a278-60f6e32fbd98 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.346012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fe9c2ab-65c1-4efb-a278-60f6e32fbd98 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.348189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fe9c2ab-65c1-4efb-a278-60f6e32fbd98 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.378497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-07a5275f-6f3d-4720-85aa-aa08acb223bd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:49.391270 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-07a5275f-6f3d-4720-85aa-aa08acb223bd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1510 microversion: 2.1 time: 0.837169 Jul 20 04:33:49.392778 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2325/4649] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:48 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1510 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:49.404500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ff4ae75-d1a7-4737-ae10-bd491dd6e36c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:49.405784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ff4ae75-d1a7-4737-ae10-bd491dd6e36c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.428260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ff4ae75-d1a7-4737-ae10-bd491dd6e36c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.428826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ff4ae75-d1a7-4737-ae10-bd491dd6e36c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.430859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ff4ae75-d1a7-4737-ae10-bd491dd6e36c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.431542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ff4ae75-d1a7-4737-ae10-bd491dd6e36c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.494131 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ff4ae75-d1a7-4737-ae10-bd491dd6e36c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 200 len: 135 microversion: 2.1 time: 0.099700 Jul 20 04:33:49.495919 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2326/4650] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:49 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 135 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:49.503672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b211f0a-342f-46de-a6fd-9fcd5dabcd6e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.505954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b211f0a-342f-46de-a6fd-9fcd5dabcd6e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.521836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4fe9c2ab-65c1-4efb-a278-60f6e32fbd98 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:49.525000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b211f0a-342f-46de-a6fd-9fcd5dabcd6e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.525604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b211f0a-342f-46de-a6fd-9fcd5dabcd6e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.526707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b211f0a-342f-46de-a6fd-9fcd5dabcd6e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.527388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b211f0a-342f-46de-a6fd-9fcd5dabcd6e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.531015 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4fe9c2ab-65c1-4efb-a278-60f6e32fbd98 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1689 microversion: 2.1 time: 0.198873 Jul 20 04:33:49.535033 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2325/4651] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:49 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:49.541652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a4de352-8066-4803-8099-98709f8c7e36 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.544308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4a4de352-8066-4803-8099-98709f8c7e36 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.568302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a4de352-8066-4803-8099-98709f8c7e36 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.570519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b211f0a-342f-46de-a6fd-9fcd5dabcd6e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:49.573880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a4de352-8066-4803-8099-98709f8c7e36 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.574795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a4de352-8066-4803-8099-98709f8c7e36 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.575255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a4de352-8066-4803-8099-98709f8c7e36 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.680240 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b211f0a-342f-46de-a6fd-9fcd5dabcd6e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 204 len: 0 microversion: 2.1 time: 0.182240 Jul 20 04:33:49.681290 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2327/4652] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:33:49 2022] DELETE /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:49.688123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ac92e5e-2b24-48ac-aa76-3ffe2748083f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.689140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8ac92e5e-2b24-48ac-aa76-3ffe2748083f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.704713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ac92e5e-2b24-48ac-aa76-3ffe2748083f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.705178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ac92e5e-2b24-48ac-aa76-3ffe2748083f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.706860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ac92e5e-2b24-48ac-aa76-3ffe2748083f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.707592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ac92e5e-2b24-48ac-aa76-3ffe2748083f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.822482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-8ac92e5e-2b24-48ac-aa76-3ffe2748083f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lazy-loading 'services' on Instance uuid ceef6679-563f-406f-9dfd-c4b216eb0b04 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:33:49.897009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4a4de352-8066-4803-8099-98709f8c7e36 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:49.910401 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4a4de352-8066-4803-8099-98709f8c7e36 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.370386 Jul 20 04:33:49.911079 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2326/4653] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:49 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:49.922196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4e68dc79-98d0-4b51-9c80-cfcdec8585a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.922876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4e68dc79-98d0-4b51-9c80-cfcdec8585a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:49.945415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e68dc79-98d0-4b51-9c80-cfcdec8585a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.945901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e68dc79-98d0-4b51-9c80-cfcdec8585a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.947036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e68dc79-98d0-4b51-9c80-cfcdec8585a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:49.947494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e68dc79-98d0-4b51-9c80-cfcdec8585a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:49.967783 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8ac92e5e-2b24-48ac-aa76-3ffe2748083f tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04/os-volume_attachments/082857f3-a18b-4347-9a5d-48441cd7a4c2" status: 202 len: 0 microversion: 2.1 time: 0.284740 Jul 20 04:33:49.968670 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2328/4654] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:33:49 2022] DELETE /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04/os-volume_attachments/082857f3-a18b-4347-9a5d-48441cd7a4c2 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:49.977745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c7a332b9-7042-4f4e-803b-bd2bae13bd10 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:49.980415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c7a332b9-7042-4f4e-803b-bd2bae13bd10 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:50.008505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7a332b9-7042-4f4e-803b-bd2bae13bd10 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.009375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7a332b9-7042-4f4e-803b-bd2bae13bd10 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.010435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7a332b9-7042-4f4e-803b-bd2bae13bd10 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.011115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7a332b9-7042-4f4e-803b-bd2bae13bd10 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.178099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4e68dc79-98d0-4b51-9c80-cfcdec8585a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.186597 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4e68dc79-98d0-4b51-9c80-cfcdec8585a9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1516 microversion: 2.1 time: 0.274410 Jul 20 04:33:50.187426 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2327/4655] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:49 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1516 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:50.263352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c7a332b9-7042-4f4e-803b-bd2bae13bd10 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.273672 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c7a332b9-7042-4f4e-803b-bd2bae13bd10 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.303163 Jul 20 04:33:50.274906 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2329/4656] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:49 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:50.292907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-05913153-d6aa-4f87-ac4c-945b6289080a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:50.294761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-05913153-d6aa-4f87-ac4c-945b6289080a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:50.305118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05913153-d6aa-4f87-ac4c-945b6289080a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.306377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05913153-d6aa-4f87-ac4c-945b6289080a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.308423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05913153-d6aa-4f87-ac4c-945b6289080a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.308903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05913153-d6aa-4f87-ac4c-945b6289080a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.502414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-05913153-d6aa-4f87-ac4c-945b6289080a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.513412 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-05913153-d6aa-4f87-ac4c-945b6289080a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.224234 Jul 20 04:33:50.514462 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2328/4657] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:50 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:50.536114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bafb18c3-bc66-4cda-9be8-ed99b85eb504 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:50.536836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bafb18c3-bc66-4cda-9be8-ed99b85eb504 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:50.543164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bafb18c3-bc66-4cda-9be8-ed99b85eb504 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.543940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bafb18c3-bc66-4cda-9be8-ed99b85eb504 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.544909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bafb18c3-bc66-4cda-9be8-ed99b85eb504 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.545531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bafb18c3-bc66-4cda-9be8-ed99b85eb504 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.551826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-092cc0ab-6731-4d93-bb06-d6824bca0a36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:50.552702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-092cc0ab-6731-4d93-bb06-d6824bca0a36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:50.559561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-092cc0ab-6731-4d93-bb06-d6824bca0a36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.560280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-092cc0ab-6731-4d93-bb06-d6824bca0a36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.561301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-092cc0ab-6731-4d93-bb06-d6824bca0a36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.561949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-092cc0ab-6731-4d93-bb06-d6824bca0a36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.751828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-092cc0ab-6731-4d93-bb06-d6824bca0a36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.761190 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-092cc0ab-6731-4d93-bb06-d6824bca0a36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1689 microversion: 2.1 time: 0.216043 Jul 20 04:33:50.761964 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2329/4658] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:50 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:50.766877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-73f7d0d0-09d3-477b-a15b-2be156de17bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:50.767504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-73f7d0d0-09d3-477b-a15b-2be156de17bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:50.775328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73f7d0d0-09d3-477b-a15b-2be156de17bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.776147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73f7d0d0-09d3-477b-a15b-2be156de17bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.777169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73f7d0d0-09d3-477b-a15b-2be156de17bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:50.778073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73f7d0d0-09d3-477b-a15b-2be156de17bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:50.805487 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-73f7d0d0-09d3-477b-a15b-2be156de17bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/ips" status: 200 len: 150 microversion: 2.1 time: 0.042185 Jul 20 04:33:50.806528 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2330/4659] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:33:50 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:50.897595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bafb18c3-bc66-4cda-9be8-ed99b85eb504 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:50.910222 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bafb18c3-bc66-4cda-9be8-ed99b85eb504 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.383156 Jul 20 04:33:50.911945 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2330/4660] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:50 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:51.111451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-631993185", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "4388b376-1cd5-454f-a519-55f9a04383ba"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:51.204735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-24d8cfa5-b49f-4676-a478-cf962ccbee04 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:51.205362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-24d8cfa5-b49f-4676-a478-cf962ccbee04 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:51.209172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] validate_networks() for [('4388b376-1cd5-454f-a519-55f9a04383ba', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:51.213687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24d8cfa5-b49f-4676-a478-cf962ccbee04 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.214150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24d8cfa5-b49f-4676-a478-cf962ccbee04 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.214963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24d8cfa5-b49f-4676-a478-cf962ccbee04 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.225383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24d8cfa5-b49f-4676-a478-cf962ccbee04 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.915658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24d8cfa5-b49f-4676-a478-cf962ccbee04 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:51.923781 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-24d8cfa5-b49f-4676-a478-cf962ccbee04 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1516 microversion: 2.1 time: 0.722832 Jul 20 04:33:51.924379 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2331/4661] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:51 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1516 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:51.946505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3ca5161f-4028-4cc4-b270-2e73c6afd109 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:51.947344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3ca5161f-4028-4cc4-b270-2e73c6afd109 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:51.957196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ca5161f-4028-4cc4-b270-2e73c6afd109 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.957668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ca5161f-4028-4cc4-b270-2e73c6afd109 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:51.958510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ca5161f-4028-4cc4-b270-2e73c6afd109 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:51.958961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ca5161f-4028-4cc4-b270-2e73c6afd109 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.140248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3ca5161f-4028-4cc4-b270-2e73c6afd109 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:52.148823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3ca5161f-4028-4cc4-b270-2e73c6afd109 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 200 len: 1622 microversion: 2.1 time: 0.217275 Jul 20 04:33:52.162318 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2332/4662] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:51 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 1622 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:52.169058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-68d26703-c728-4f22-86a2-7cd04ab07adb req-86923ce3-4d4b-4138-81e1-464429519400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6881eb5-fd94-4802-8fb1-ad74e99f0786", "name": "network-vif-deleted", "tag": "aba34f57-d50c-4162-ad83-443faa06380d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:52.181824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-68d26703-c728-4f22-86a2-7cd04ab07adb req-86923ce3-4d4b-4138-81e1-464429519400 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.182573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-68d26703-c728-4f22-86a2-7cd04ab07adb req-86923ce3-4d4b-4138-81e1-464429519400 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.205945 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-68d26703-c728-4f22-86a2-7cd04ab07adb req-86923ce3-4d4b-4138-81e1-464429519400 service nova] Creating event network-vif-deleted:aba34f57-d50c-4162-ad83-443faa06380d for instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 on n-h1-760456-11 Jul 20 04:33:52.216713 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-68d26703-c728-4f22-86a2-7cd04ab07adb req-86923ce3-4d4b-4138-81e1-464429519400 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048557 Jul 20 04:33:52.217619 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2333/4663] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:52.945494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cae82172-03a1-44bc-90a1-03168a736a94 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:52.947082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cae82172-03a1-44bc-90a1-03168a736a94 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:52.955434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cae82172-03a1-44bc-90a1-03168a736a94 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.958203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cae82172-03a1-44bc-90a1-03168a736a94 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:52.959317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cae82172-03a1-44bc-90a1-03168a736a94 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:52.960238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cae82172-03a1-44bc-90a1-03168a736a94 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.166353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:53.167344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:53.168023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:53.169527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:53.170177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:53.171257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cae82172-03a1-44bc-90a1-03168a736a94 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:53.180175 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cae82172-03a1-44bc-90a1-03168a736a94 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 200 len: 1474 microversion: 2.1 time: 0.242194 Jul 20 04:33:53.180773 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2334/4664] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:52 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 1474 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:53.194030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-999b1e7c-1c07-4ef1-ae1e-5c8ed950fd76 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:53.198769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-999b1e7c-1c07-4ef1-ae1e-5c8ed950fd76 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: d6881eb5-fd94-4802-8fb1-ad74e99f0786] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:53.210827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-999b1e7c-1c07-4ef1-ae1e-5c8ed950fd76 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.211312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-999b1e7c-1c07-4ef1-ae1e-5c8ed950fd76 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.212091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-999b1e7c-1c07-4ef1-ae1e-5c8ed950fd76 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.212520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-999b1e7c-1c07-4ef1-ae1e-5c8ed950fd76 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.216148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.221153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.234734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.235676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.243794 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-999b1e7c-1c07-4ef1-ae1e-5c8ed950fd76 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] HTTP exception thrown: Instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 could not be found. Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-999b1e7c-1c07-4ef1-ae1e-5c8ed950fd76 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Request method failure captured: Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 HTTP/1.1 Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14UK5JrQIbQ4DeMrb4AGON-It-xq1HUlcS1_w91iY9qX9BKMuqasTROhXwJnYYXL1FDMvpvHevyFT98KP_rG1E4C2KjxwioZKHqAupgnDNOBVhKjLYq21w0dkR-FwoM0QcIMxRYXi6rjnAGtO1rszx2hLyQfwkkhBDqwPm7fq7NZS_Y Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: c92a62f7017e4b8f8bbeb960856d1e20 Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: c92a62f7017e4b8f8bbeb960856d1e20 Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestNetworkAdvancedServerOps-1362507395-project Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8f84ec28420a4cdcb88920cd86ce0160 Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1362507395-project Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 could not be found. Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'd6881eb5-fd94-4802-8fb1-ad74e99f0786'} Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 could not be found. Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 could not be found. Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:53.251680 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:53.257359 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:53.257359 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:53.257359 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:53.257359 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:53.257359 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:53.257359 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:53.257359 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 could not be found. Jul 20 04:33:53.257359 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:53.257359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-999b1e7c-1c07-4ef1-ae1e-5c8ed950fd76 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Returning 404 to user: Instance d6881eb5-fd94-4802-8fb1-ad74e99f0786 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:53.257359 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-999b1e7c-1c07-4ef1-ae1e-5c8ed950fd76 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786" status: 404 len: 111 microversion: 2.1 time: 0.070322 Jul 20 04:33:53.261793 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2335/4665] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:53 2022] GET /compute/v2.1/servers/d6881eb5-fd94-4802-8fb1-ad74e99f0786 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:33:53.284009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:53.299976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for user a3a58233b2b044d9b1285b616c79f9b8 and project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:53.319530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:53.322141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:53.397703 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d3d1f8db-258f-4fd2-a6d5-410f82a22a1a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.290314 Jul 20 04:33:53.399255 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2331/4666] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:53.415331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-505e4131-5809-4cb1-abf1-0cba16eb7707 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:53.416361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-505e4131-5809-4cb1-abf1-0cba16eb7707 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:53.566874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-505e4131-5809-4cb1-abf1-0cba16eb7707 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:53.575075 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-505e4131-5809-4cb1-abf1-0cba16eb7707 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1214 microversion: 2.1 time: 0.169881 Jul 20 04:33:53.588579 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2336/4667] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:53 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:53.798981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-976f0e5d-f37c-4a7c-89bc-042e549e306d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:53.802808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-976f0e5d-f37c-4a7c-89bc-042e549e306d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:53.827832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-976f0e5d-f37c-4a7c-89bc-042e549e306d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.835450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-976f0e5d-f37c-4a7c-89bc-042e549e306d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:53.837928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-976f0e5d-f37c-4a7c-89bc-042e549e306d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:53.840980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-976f0e5d-f37c-4a7c-89bc-042e549e306d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.038341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:54.201955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-188df004-cfc4-4187-8cec-890186ea4bad tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:54.202867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-188df004-cfc4-4187-8cec-890186ea4bad tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:54.214342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:54.227497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-188df004-cfc4-4187-8cec-890186ea4bad tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.228330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-188df004-cfc4-4187-8cec-890186ea4bad tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.229383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-188df004-cfc4-4187-8cec-890186ea4bad tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.231134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-188df004-cfc4-4187-8cec-890186ea4bad tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.247595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:54.266209 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-188df004-cfc4-4187-8cec-890186ea4bad tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-188df004-cfc4-4187-8cec-890186ea4bad tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 HTTP/1.1 Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c37f4e1e-e8c0-41ae-9bfa-e01910ea2985'} Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:54.268244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:54.274711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:54.274711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:54.274711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:54.274711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:54.274711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:33:54.274711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:33:54.276897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-188df004-cfc4-4187-8cec-890186ea4bad tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:54.278023 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-188df004-cfc4-4187-8cec-890186ea4bad tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 404 len: 111 microversion: 2.1 time: 0.081831 Jul 20 04:33:54.279018 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2337/4668] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:54 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:33:54.292699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-95c498fc-cada-464b-ba17-da772797a5ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '.version_select at 0x7fb8410a8dc0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:54.324743 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-976f0e5d-f37c-4a7c-89bc-042e549e306d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.534443 Jul 20 04:33:54.334039 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2332/4669] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:33:53 2022] POST /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:54.352089 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-95c498fc-cada-464b-ba17-da772797a5ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-key-622431606" status: 202 len: 0 microversion: 2.1 time: 0.063571 Jul 20 04:33:54.352984 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2338/4670] 10.222.0.59 () {58 vars in 1205 bytes} [Wed Jul 20 04:33:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-622431606 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:54.439947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1478331929", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "7b0934fb-ee96-446d-a65b-fee23ff74766"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:54.570464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] validate_networks() for [('7b0934fb-ee96-446d-a65b-fee23ff74766', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:54.592924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a583a3be-3d7b-4754-b744-fe6690bffd93 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:54.593561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a583a3be-3d7b-4754-b744-fe6690bffd93 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:54.618185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a583a3be-3d7b-4754-b744-fe6690bffd93 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.636086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a583a3be-3d7b-4754-b744-fe6690bffd93 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.636967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a583a3be-3d7b-4754-b744-fe6690bffd93 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.637430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a583a3be-3d7b-4754-b744-fe6690bffd93 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.763275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a583a3be-3d7b-4754-b744-fe6690bffd93 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:54.779700 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a583a3be-3d7b-4754-b744-fe6690bffd93 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1218 microversion: 2.1 time: 0.190621 Jul 20 04:33:54.780855 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2339/4671] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:54 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:33:54.786688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d7e98570-7d69-41e3-b2ea-3ee72cbbbb65 req-cdb8b862-5e82-4a8f-bb9a-d7f39dbc6515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c37f4e1e-e8c0-41ae-9bfa-e01910ea2985", "name": "network-vif-deleted", "tag": "0d55f639-fa94-43b1-963f-6fb87d2461d2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:54.808194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d7e98570-7d69-41e3-b2ea-3ee72cbbbb65 req-cdb8b862-5e82-4a8f-bb9a-d7f39dbc6515 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:54.808943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d7e98570-7d69-41e3-b2ea-3ee72cbbbb65 req-cdb8b862-5e82-4a8f-bb9a-d7f39dbc6515 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:54.826997 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d7e98570-7d69-41e3-b2ea-3ee72cbbbb65 req-cdb8b862-5e82-4a8f-bb9a-d7f39dbc6515 service nova] Creating event network-vif-deleted:0d55f639-fa94-43b1-963f-6fb87d2461d2 for instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 on n-h2-760456-11 Jul 20 04:33:54.844436 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d7e98570-7d69-41e3-b2ea-3ee72cbbbb65 req-cdb8b862-5e82-4a8f-bb9a-d7f39dbc6515 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062053 Jul 20 04:33:54.844977 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2340/4672] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:55.410285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:55.411305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:55.411977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:55.412567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:55.413156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:55.433726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.434539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.435541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.436161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.474848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:55.481407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for user f224517836bf403a83da9e2e7f175907 and project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:55.496879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:55.500831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:55.611785 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-12f5ffc1-454e-425f-9afb-d183824ffc3d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184819 Jul 20 04:33:55.617050 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2333/4673] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:55.631980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4fa6dc5e-f308-4716-869d-3c44f4279a11 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:55.633206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4fa6dc5e-f308-4716-869d-3c44f4279a11 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:55.797721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae91c477-a964-45b6-b0c9-8592a48e7825 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:55.798698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ae91c477-a964-45b6-b0c9-8592a48e7825 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:55.837146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae91c477-a964-45b6-b0c9-8592a48e7825 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.837609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae91c477-a964-45b6-b0c9-8592a48e7825 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.850397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae91c477-a964-45b6-b0c9-8592a48e7825 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.850992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae91c477-a964-45b6-b0c9-8592a48e7825 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.928049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4fa6dc5e-f308-4716-869d-3c44f4279a11 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:55.954419 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4fa6dc5e-f308-4716-869d-3c44f4279a11 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1209 microversion: 2.1 time: 0.327848 Jul 20 04:33:55.955093 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2341/4674] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:55 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1209 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:56.521930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae91c477-a964-45b6-b0c9-8592a48e7825 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:56.535967 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae91c477-a964-45b6-b0c9-8592a48e7825 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1284 microversion: 2.1 time: 0.741873 Jul 20 04:33:56.538981 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2334/4675] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:55 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1284 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:56.974064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8143d45d-0e2b-4c88-b5ca-4da8e462c61d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:56.974718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8143d45d-0e2b-4c88-b5ca-4da8e462c61d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:57.006122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8143d45d-0e2b-4c88-b5ca-4da8e462c61d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.006619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8143d45d-0e2b-4c88-b5ca-4da8e462c61d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.007553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8143d45d-0e2b-4c88-b5ca-4da8e462c61d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.029292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8143d45d-0e2b-4c88-b5ca-4da8e462c61d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.443785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8143d45d-0e2b-4c88-b5ca-4da8e462c61d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.452904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8143d45d-0e2b-4c88-b5ca-4da8e462c61d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1261 microversion: 2.1 time: 0.483555 Jul 20 04:33:57.463218 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2342/4676] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:56 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1261 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:57.555691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3306ca5d-bfd8-425d-aaf5-6acfee2b24ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:57.556903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3306ca5d-bfd8-425d-aaf5-6acfee2b24ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:57.574092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3306ca5d-bfd8-425d-aaf5-6acfee2b24ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.574865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3306ca5d-bfd8-425d-aaf5-6acfee2b24ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.575896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3306ca5d-bfd8-425d-aaf5-6acfee2b24ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.576517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3306ca5d-bfd8-425d-aaf5-6acfee2b24ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.886615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3306ca5d-bfd8-425d-aaf5-6acfee2b24ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.898856 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3306ca5d-bfd8-425d-aaf5-6acfee2b24ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1314 microversion: 2.1 time: 0.346907 Jul 20 04:33:57.909744 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2335/4677] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:57 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:58.515015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-105f8be0-22b4-4b13-ba08-b9c6386c9a37 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:58.515722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-105f8be0-22b4-4b13-ba08-b9c6386c9a37 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:58.531684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-105f8be0-22b4-4b13-ba08-b9c6386c9a37 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.532414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-105f8be0-22b4-4b13-ba08-b9c6386c9a37 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.533209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-105f8be0-22b4-4b13-ba08-b9c6386c9a37 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.533932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-105f8be0-22b4-4b13-ba08-b9c6386c9a37 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.684850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ff4f7cba-d73c-4962-8b24-c51492c78a83 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:58.685527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ff4f7cba-d73c-4962-8b24-c51492c78a83 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:58.703816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff4f7cba-d73c-4962-8b24-c51492c78a83 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.704559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff4f7cba-d73c-4962-8b24-c51492c78a83 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.706011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff4f7cba-d73c-4962-8b24-c51492c78a83 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.709808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff4f7cba-d73c-4962-8b24-c51492c78a83 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.729870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-105f8be0-22b4-4b13-ba08-b9c6386c9a37 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:58.743323 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-105f8be0-22b4-4b13-ba08-b9c6386c9a37 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1267 microversion: 2.1 time: 0.273951 Jul 20 04:33:58.744765 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2343/4678] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:58 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:58.773461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ff4f7cba-d73c-4962-8b24-c51492c78a83 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:58.869130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2b544909-e8f7-4fa6-85d8-633b3d6bfea2 req-fa1574bf-0654-42bd-b44b-576e1631a429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f10cf4-af8b-4e85-bb96-2df270fa0e4d", "tag": "6485dee1-45fc-4292-9069-759307e48816"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:58.906934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2b544909-e8f7-4fa6-85d8-633b3d6bfea2 req-fa1574bf-0654-42bd-b44b-576e1631a429 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.908037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2b544909-e8f7-4fa6-85d8-633b3d6bfea2 req-fa1574bf-0654-42bd-b44b-576e1631a429 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.953821 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2b544909-e8f7-4fa6-85d8-633b3d6bfea2 req-fa1574bf-0654-42bd-b44b-576e1631a429 service nova] Creating event network-changed:6485dee1-45fc-4292-9069-759307e48816 for instance 33f10cf4-af8b-4e85-bb96-2df270fa0e4d on n-h2-760456-11 Jul 20 04:33:58.974014 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2b544909-e8f7-4fa6-85d8-633b3d6bfea2 req-fa1574bf-0654-42bd-b44b-576e1631a429 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109009 Jul 20 04:33:58.985836 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2344/4679] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:59.004052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bc8ac58a-c4fb-4b16-9a5e-d79f41cec94b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:59.006062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bc8ac58a-c4fb-4b16-9a5e-d79f41cec94b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:59.037488 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ff4f7cba-d73c-4962-8b24-c51492c78a83 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 204 len: 0 microversion: 2.1 time: 0.355421 Jul 20 04:33:59.038078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc8ac58a-c4fb-4b16-9a5e-d79f41cec94b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.039539 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2336/4680] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:33:58 2022] DELETE /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:33:59.042897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc8ac58a-c4fb-4b16-9a5e-d79f41cec94b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.043762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc8ac58a-c4fb-4b16-9a5e-d79f41cec94b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.044265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc8ac58a-c4fb-4b16-9a5e-d79f41cec94b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.057918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-34279c0f-0481-430b-ac0b-a9e75ded659b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:59.059225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-34279c0f-0481-430b-ac0b-a9e75ded659b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:59.077336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34279c0f-0481-430b-ac0b-a9e75ded659b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.079053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34279c0f-0481-430b-ac0b-a9e75ded659b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.079887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34279c0f-0481-430b-ac0b-a9e75ded659b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.085214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34279c0f-0481-430b-ac0b-a9e75ded659b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.435811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc8ac58a-c4fb-4b16-9a5e-d79f41cec94b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:59.451508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bc8ac58a-c4fb-4b16-9a5e-d79f41cec94b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1314 microversion: 2.1 time: 0.461115 Jul 20 04:33:59.459944 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2345/4681] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:58 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:59.765406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2b341375-c2bb-4a2b-85dc-a6685cc6b5ac tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:59.770912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2b341375-c2bb-4a2b-85dc-a6685cc6b5ac tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:59.775086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-34279c0f-0481-430b-ac0b-a9e75ded659b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:59.785078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b341375-c2bb-4a2b-85dc-a6685cc6b5ac tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.785957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b341375-c2bb-4a2b-85dc-a6685cc6b5ac tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.787003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b341375-c2bb-4a2b-85dc-a6685cc6b5ac tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.787688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b341375-c2bb-4a2b-85dc-a6685cc6b5ac tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.790043 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-34279c0f-0481-430b-ac0b-a9e75ded659b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1469 microversion: 2.1 time: 0.743376 Jul 20 04:33:59.794963 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2337/4682] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:59 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1469 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:00.195929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2b341375-c2bb-4a2b-85dc-a6685cc6b5ac tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:00.209261 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2b341375-c2bb-4a2b-85dc-a6685cc6b5ac tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1309 microversion: 2.1 time: 0.448636 Jul 20 04:34:00.210183 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2346/4683] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:59 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1309 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:00.477479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db47a2f1-7b85-4d33-933e-1afbc0c85f16 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:00.478353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-db47a2f1-7b85-4d33-933e-1afbc0c85f16 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:00.492337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db47a2f1-7b85-4d33-933e-1afbc0c85f16 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.493171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db47a2f1-7b85-4d33-933e-1afbc0c85f16 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:00.494353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db47a2f1-7b85-4d33-933e-1afbc0c85f16 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.495400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db47a2f1-7b85-4d33-933e-1afbc0c85f16 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:00.816120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07d2a4f2-deee-49ed-996f-cad29f72abd6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:00.817417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-07d2a4f2-deee-49ed-996f-cad29f72abd6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:00.825276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07d2a4f2-deee-49ed-996f-cad29f72abd6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.825997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07d2a4f2-deee-49ed-996f-cad29f72abd6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:00.827067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07d2a4f2-deee-49ed-996f-cad29f72abd6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.827718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07d2a4f2-deee-49ed-996f-cad29f72abd6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:01.310602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-07d2a4f2-deee-49ed-996f-cad29f72abd6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:01.324046 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-07d2a4f2-deee-49ed-996f-cad29f72abd6 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1469 microversion: 2.1 time: 0.519412 Jul 20 04:34:01.326014 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2347/4684] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:00 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1469 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:01.332423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26a3222e-251f-47d3-a2e8-21f7fa30dd59 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:01.333377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-26a3222e-251f-47d3-a2e8-21f7fa30dd59 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:01.341071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26a3222e-251f-47d3-a2e8-21f7fa30dd59 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:01.341861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26a3222e-251f-47d3-a2e8-21f7fa30dd59 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:01.342920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26a3222e-251f-47d3-a2e8-21f7fa30dd59 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:01.343557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26a3222e-251f-47d3-a2e8-21f7fa30dd59 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:01.723188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-db47a2f1-7b85-4d33-933e-1afbc0c85f16 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:01.745328 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-db47a2f1-7b85-4d33-933e-1afbc0c85f16 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1314 microversion: 2.1 time: 1.274791 Jul 20 04:34:01.746565 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2338/4685] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:00 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1314 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:01.897065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-41c995f7-0aed-4e83-9ec0-b5f1560d44c5 req-53880e16-16eb-4fd2-abf7-0e2275b6d04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceef6679-563f-406f-9dfd-c4b216eb0b04", "name": "network-vif-deleted", "tag": "c7dc9466-5672-4a11-a1c1-a9acee91187d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:01.923152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-41c995f7-0aed-4e83-9ec0-b5f1560d44c5 req-53880e16-16eb-4fd2-abf7-0e2275b6d04f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:01.923860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-41c995f7-0aed-4e83-9ec0-b5f1560d44c5 req-53880e16-16eb-4fd2-abf7-0e2275b6d04f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:01.960547 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-41c995f7-0aed-4e83-9ec0-b5f1560d44c5 req-53880e16-16eb-4fd2-abf7-0e2275b6d04f service nova] Creating event network-vif-deleted:c7dc9466-5672-4a11-a1c1-a9acee91187d for instance ceef6679-563f-406f-9dfd-c4b216eb0b04 on n-h1-760456-11 Jul 20 04:34:01.974888 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-41c995f7-0aed-4e83-9ec0-b5f1560d44c5 req-53880e16-16eb-4fd2-abf7-0e2275b6d04f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079781 Jul 20 04:34:01.975823 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2339/4686] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:02.160797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-26a3222e-251f-47d3-a2e8-21f7fa30dd59 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.189501 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-26a3222e-251f-47d3-a2e8-21f7fa30dd59 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1309 microversion: 2.1 time: 0.861648 Jul 20 04:34:02.190688 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2348/4687] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:01 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1309 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:02.349251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:02.352742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:02.367097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.371216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.374656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.376093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.528135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.531539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.532279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lazy-loading 'fault' on Instance uuid ceef6679-563f-406f-9dfd-c4b216eb0b04 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:02.764408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-24517431-2684-401c-9411-5f54737b97ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:02.765013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-24517431-2684-401c-9411-5f54737b97ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:02.768309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75f138079e843ceabc43c0c00347361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daa9e3aedc34be499667381884f27e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.771459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24517431-2684-401c-9411-5f54737b97ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.771961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24517431-2684-401c-9411-5f54737b97ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.772843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24517431-2684-401c-9411-5f54737b97ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.773516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24517431-2684-401c-9411-5f54737b97ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.776067 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4ca6cf1f-e726-4a78-a60f-1e2b7d8c518b tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 200 len: 1303 microversion: 2.1 time: 0.434841 Jul 20 04:34:02.780728 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2340/4688] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:02 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 1303 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:02.947245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24517431-2684-401c-9411-5f54737b97ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.960453 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-24517431-2684-401c-9411-5f54737b97ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1314 microversion: 2.1 time: 0.200239 Jul 20 04:34:02.972075 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2349/4689] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:02 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:03.207429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-720e3582-abe4-4b47-81cc-e643e90b818c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.208535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-720e3582-abe4-4b47-81cc-e643e90b818c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:03.214369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:03.217160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-720e3582-abe4-4b47-81cc-e643e90b818c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.217852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-720e3582-abe4-4b47-81cc-e643e90b818c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.218952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-720e3582-abe4-4b47-81cc-e643e90b818c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.219666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-720e3582-abe4-4b47-81cc-e643e90b818c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.326624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-cc8e35b6-a6bc-49ad-bd97-74134d3bd3e9 req-b96fc883-3067-46a6-a210-4df989b14640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260", "tag": "fe0d3839-e8c6-440c-b7c6-8d5a42ed275a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:03.339932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cc8e35b6-a6bc-49ad-bd97-74134d3bd3e9 req-b96fc883-3067-46a6-a210-4df989b14640 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.343406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cc8e35b6-a6bc-49ad-bd97-74134d3bd3e9 req-b96fc883-3067-46a6-a210-4df989b14640 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.374805 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-cc8e35b6-a6bc-49ad-bd97-74134d3bd3e9 req-b96fc883-3067-46a6-a210-4df989b14640 service nova] Creating event network-changed:fe0d3839-e8c6-440c-b7c6-8d5a42ed275a for instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 on n-h1-760456-11 Jul 20 04:34:03.397823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-cc8e35b6-a6bc-49ad-bd97-74134d3bd3e9 req-b96fc883-3067-46a6-a210-4df989b14640 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074783 Jul 20 04:34:03.402755 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2350/4690] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:03.697012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-94e90734-d16b-4fdb-a387-582cbd9a6c3d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '.version_select at 0x7fb84121c9d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.736685 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-94e90734-d16b-4fdb-a387-582cbd9a6c3d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2083771904" status: 202 len: 0 microversion: 2.1 time: 0.046280 Jul 20 04:34:03.745255 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2351/4691] 10.222.0.59 () {58 vars in 1283 bytes} [Wed Jul 20 04:34:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2083771904 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:03.771808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c42fb8ec-f53d-4e8a-9348-a5f5659396a4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'create', calling method: .version_select at 0x7fb84120a670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1412421735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaseEKVqLdg2lskRJgDVU2vHHrTBe0n6iB8vOyh/E+rrUx08teiwJWBs5PQNZGfPvdRgA2gbN/+kRksVGG9NO+ZLNp2nuNaUarZt9bnQkrP9+3BbarI0405Lc4cBCU23Q=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:03.803490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-c42fb8ec-f53d-4e8a-9348-a5f5659396a4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:03.811261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-c42fb8ec-f53d-4e8a-9348-a5f5659396a4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for user 8f84ec28420a4cdcb88920cd86ce0160 and project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:03.861221 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c42fb8ec-f53d-4e8a-9348-a5f5659396a4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.094012 Jul 20 04:34:03.867648 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2352/4692] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:34:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:34:03.878825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-20c449ab-9e1e-487a-97cd-e6b4fffa2881 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.891433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-20c449ab-9e1e-487a-97cd-e6b4fffa2881 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] [instance: ceef6679-563f-406f-9dfd-c4b216eb0b04] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:03.906700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20c449ab-9e1e-487a-97cd-e6b4fffa2881 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.907634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20c449ab-9e1e-487a-97cd-e6b4fffa2881 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.908590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20c449ab-9e1e-487a-97cd-e6b4fffa2881 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.909348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20c449ab-9e1e-487a-97cd-e6b4fffa2881 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.936343 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-20c449ab-9e1e-487a-97cd-e6b4fffa2881 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] HTTP exception thrown: Instance ceef6679-563f-406f-9dfd-c4b216eb0b04 could not be found. Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-20c449ab-9e1e-487a-97cd-e6b4fffa2881 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Request method failure captured: Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 HTTP/1.1 Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14UXVUqRL5E8GznOYlkL4LgPkmCfMKQm66_JUlaLMiI54xmeHkPMDgn2Bly1gn9N0GAXz3ymWykz9fchb9O3t-lRqeMPY_hDCpxoHxhodyW50oPkhLH8ly9Y7PKxCt6HzuYJnpiZqDtnhRcmNH0PpqFOSF0g1aIe-FWlK9S5_MX6-yA Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 6daa9e3aedc34be499667381884f27e8 Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesBackupsTest-1433450570 Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6daa9e3aedc34be499667381884f27e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6daa9e3aedc34be499667381884f27e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6daa9e3aedc34be499667381884f27e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6daa9e3aedc34be499667381884f27e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesBackupsTest-1433450570 Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 6daa9e3aedc34be499667381884f27e8 Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesBackupsTest-1433450570 Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesBackupsTest-1433450570-project Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: b75f138079e843ceabc43c0c00347361 Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesBackupsTest-1433450570-project Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance ceef6679-563f-406f-9dfd-c4b216eb0b04 could not be found. Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'ceef6679-563f-406f-9dfd-c4b216eb0b04'} Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceef6679-563f-406f-9dfd-c4b216eb0b04 could not be found. Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceef6679-563f-406f-9dfd-c4b216eb0b04 could not be found. Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:03.938576 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:03.945503 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:03.945503 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:03.945503 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:03.945503 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:03.945503 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:03.945503 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceef6679-563f-406f-9dfd-c4b216eb0b04 could not be found. Jul 20 04:34:03.945503 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:03.946058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-20c449ab-9e1e-487a-97cd-e6b4fffa2881 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] Returning 404 to user: Instance ceef6679-563f-406f-9dfd-c4b216eb0b04 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:03.947196 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-20c449ab-9e1e-487a-97cd-e6b4fffa2881 tempest-VolumesBackupsTest-1433450570 tempest-VolumesBackupsTest-1433450570-project] 10.222.0.59 "GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04" status: 404 len: 111 microversion: 2.1 time: 0.077708 Jul 20 04:34:03.955154 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2353/4693] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:03 2022] GET /compute/v2.1/servers/ceef6679-563f-406f-9dfd-c4b216eb0b04 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:03.978904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d25b5ad4-7437-44c4-aebc-187fd98b96c8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.979763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d25b5ad4-7437-44c4-aebc-187fd98b96c8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:03.993812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25b5ad4-7437-44c4-aebc-187fd98b96c8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.994611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25b5ad4-7437-44c4-aebc-187fd98b96c8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.995560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25b5ad4-7437-44c4-aebc-187fd98b96c8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.996164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25b5ad4-7437-44c4-aebc-187fd98b96c8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:04.252219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-720e3582-abe4-4b47-81cc-e643e90b818c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:04.263069 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-720e3582-abe4-4b47-81cc-e643e90b818c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1309 microversion: 2.1 time: 1.059980 Jul 20 04:34:04.272929 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2341/4694] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:03 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1309 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:04.368935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d25b5ad4-7437-44c4-aebc-187fd98b96c8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:04.385223 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d25b5ad4-7437-44c4-aebc-187fd98b96c8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1314 microversion: 2.1 time: 0.409984 Jul 20 04:34:04.388311 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2354/4695] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:03 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:05.283454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08b9674f-3a46-41bc-93f1-afae70da9d1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:05.285469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-08b9674f-3a46-41bc-93f1-afae70da9d1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:05.296837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08b9674f-3a46-41bc-93f1-afae70da9d1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:05.297886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08b9674f-3a46-41bc-93f1-afae70da9d1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:05.300214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08b9674f-3a46-41bc-93f1-afae70da9d1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:05.301262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08b9674f-3a46-41bc-93f1-afae70da9d1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:05.410128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8e31afcc-99d6-419a-b56d-71ed9754c958 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:05.410888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8e31afcc-99d6-419a-b56d-71ed9754c958 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:05.424052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e31afcc-99d6-419a-b56d-71ed9754c958 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:05.425682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e31afcc-99d6-419a-b56d-71ed9754c958 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:05.426890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e31afcc-99d6-419a-b56d-71ed9754c958 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:05.428107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e31afcc-99d6-419a-b56d-71ed9754c958 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:05.461733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:05.490867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:05.549437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-08b9674f-3a46-41bc-93f1-afae70da9d1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:05.565175 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08b9674f-3a46-41bc-93f1-afae70da9d1c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1309 microversion: 2.1 time: 0.287948 Jul 20 04:34:05.574942 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2342/4696] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:05 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1309 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:05.781357 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:34:05.781620 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 04:34:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:34:05.906232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8e31afcc-99d6-419a-b56d-71ed9754c958 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:05.915548 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8e31afcc-99d6-419a-b56d-71ed9754c958 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1314 microversion: 2.1 time: 0.514294 Jul 20 04:34:05.920289 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2355/4697] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:05 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:05.944688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3395503e-94da-4b62-a2f9-3974ea386df6 req-c011cf9c-f352-4427-b037-69a67f7147ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f10cf4-af8b-4e85-bb96-2df270fa0e4d", "name": "network-vif-plugged", "status": "completed", "tag": "6485dee1-45fc-4292-9069-759307e48816"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:05.961497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3395503e-94da-4b62-a2f9-3974ea386df6 req-c011cf9c-f352-4427-b037-69a67f7147ab service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:05.962598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3395503e-94da-4b62-a2f9-3974ea386df6 req-c011cf9c-f352-4427-b037-69a67f7147ab service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:05.981458 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3395503e-94da-4b62-a2f9-3974ea386df6 req-c011cf9c-f352-4427-b037-69a67f7147ab service nova] Creating event network-vif-plugged:6485dee1-45fc-4292-9069-759307e48816 for instance 33f10cf4-af8b-4e85-bb96-2df270fa0e4d on n-h2-760456-11 Jul 20 04:34:05.988242 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3395503e-94da-4b62-a2f9-3974ea386df6 req-c011cf9c-f352-4427-b037-69a67f7147ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053667 Jul 20 04:34:05.989978 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2343/4698] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:06.584689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dbd780b1-af0a-4ca4-a1bc-2c96079474af tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:06.588970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dbd780b1-af0a-4ca4-a1bc-2c96079474af tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:06.599514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbd780b1-af0a-4ca4-a1bc-2c96079474af tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.600302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbd780b1-af0a-4ca4-a1bc-2c96079474af tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.601386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbd780b1-af0a-4ca4-a1bc-2c96079474af tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.602538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbd780b1-af0a-4ca4-a1bc-2c96079474af tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.936461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6caaa6be-3788-47ad-b1e2-d4967efb5f5a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:06.938005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6caaa6be-3788-47ad-b1e2-d4967efb5f5a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:06.948708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6caaa6be-3788-47ad-b1e2-d4967efb5f5a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.949590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6caaa6be-3788-47ad-b1e2-d4967efb5f5a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.954421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6caaa6be-3788-47ad-b1e2-d4967efb5f5a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.956496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6caaa6be-3788-47ad-b1e2-d4967efb5f5a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.285111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6caaa6be-3788-47ad-b1e2-d4967efb5f5a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:07.293419 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6caaa6be-3788-47ad-b1e2-d4967efb5f5a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1314 microversion: 2.1 time: 0.363235 Jul 20 04:34:07.294654 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2344/4699] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:06 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:07.364290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dbd780b1-af0a-4ca4-a1bc-2c96079474af tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:07.397481 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dbd780b1-af0a-4ca4-a1bc-2c96079474af tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1309 microversion: 2.1 time: 0.818147 Jul 20 04:34:07.401333 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2356/4700] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:06 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1309 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:08.311346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c6b84aeb-33cf-4bde-aa12-a8634a32924b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:08.311975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c6b84aeb-33cf-4bde-aa12-a8634a32924b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:08.327882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6b84aeb-33cf-4bde-aa12-a8634a32924b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.330590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6b84aeb-33cf-4bde-aa12-a8634a32924b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.331976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6b84aeb-33cf-4bde-aa12-a8634a32924b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.332524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6b84aeb-33cf-4bde-aa12-a8634a32924b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.405774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5ffbcf2a-cf0b-4a36-84cd-a5c8c3d3b50f req-173e3b93-4425-4865-8c20-99c154786602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260", "name": "network-vif-plugged", "status": "completed", "tag": "fe0d3839-e8c6-440c-b7c6-8d5a42ed275a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:08.427133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5ffbcf2a-cf0b-4a36-84cd-a5c8c3d3b50f req-173e3b93-4425-4865-8c20-99c154786602 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.428124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5ffbcf2a-cf0b-4a36-84cd-a5c8c3d3b50f req-173e3b93-4425-4865-8c20-99c154786602 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.446295 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5ffbcf2a-cf0b-4a36-84cd-a5c8c3d3b50f req-173e3b93-4425-4865-8c20-99c154786602 service nova] Creating event network-vif-plugged:fe0d3839-e8c6-440c-b7c6-8d5a42ed275a for instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 on n-h1-760456-11 Jul 20 04:34:08.454506 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5ffbcf2a-cf0b-4a36-84cd-a5c8c3d3b50f req-173e3b93-4425-4865-8c20-99c154786602 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052684 Jul 20 04:34:08.455546 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2357/4701] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:08.465209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6668721-8aa0-419e-99cd-f6f0c730773a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:08.465943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e6668721-8aa0-419e-99cd-f6f0c730773a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:08.488988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6668721-8aa0-419e-99cd-f6f0c730773a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.496704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6668721-8aa0-419e-99cd-f6f0c730773a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.498072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6668721-8aa0-419e-99cd-f6f0c730773a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.499589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6668721-8aa0-419e-99cd-f6f0c730773a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.765864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6b84aeb-33cf-4bde-aa12-a8634a32924b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:08.779924 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c6b84aeb-33cf-4bde-aa12-a8634a32924b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1500 microversion: 2.1 time: 0.471077 Jul 20 04:34:08.781501 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2345/4702] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:08 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1500 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:08.800441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4d52a521-d144-4a9d-af52-f61c7a8d023e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:08.801746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4d52a521-d144-4a9d-af52-f61c7a8d023e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:08.809842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d52a521-d144-4a9d-af52-f61c7a8d023e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.810510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d52a521-d144-4a9d-af52-f61c7a8d023e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.811391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d52a521-d144-4a9d-af52-f61c7a8d023e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.811957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d52a521-d144-4a9d-af52-f61c7a8d023e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.921288 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4d52a521-d144-4a9d-af52-f61c7a8d023e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 14 microversion: 2.1 time: 0.074933 Jul 20 04:34:08.921288 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2346/4703] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:08 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:34:08.921874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6668721-8aa0-419e-99cd-f6f0c730773a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:08.934791 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6668721-8aa0-419e-99cd-f6f0c730773a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1309 microversion: 2.1 time: 0.476506 Jul 20 04:34:08.936256 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2358/4704] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:08 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1309 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:09.883331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-329402ed-7d66-414d-b05f-258ac97b1b18 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:09.884538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-329402ed-7d66-414d-b05f-258ac97b1b18 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:09.911625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329402ed-7d66-414d-b05f-258ac97b1b18 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.912098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329402ed-7d66-414d-b05f-258ac97b1b18 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.912904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329402ed-7d66-414d-b05f-258ac97b1b18 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.917273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329402ed-7d66-414d-b05f-258ac97b1b18 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.954303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-de2d7c4f-12f3-4fe2-8bc6-929a3e558e02 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:09.955693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-de2d7c4f-12f3-4fe2-8bc6-929a3e558e02 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:09.968859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de2d7c4f-12f3-4fe2-8bc6-929a3e558e02 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.971810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de2d7c4f-12f3-4fe2-8bc6-929a3e558e02 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.973330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de2d7c4f-12f3-4fe2-8bc6-929a3e558e02 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.974095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de2d7c4f-12f3-4fe2-8bc6-929a3e558e02 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.018363 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-329402ed-7d66-414d-b05f-258ac97b1b18 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 14 microversion: 2.1 time: 0.139329 Jul 20 04:34:10.019713 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2347/4705] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:09 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:34:10.473935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-de2d7c4f-12f3-4fe2-8bc6-929a3e558e02 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:10.490151 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-de2d7c4f-12f3-4fe2-8bc6-929a3e558e02 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1490 microversion: 2.1 time: 0.540634 Jul 20 04:34:10.491416 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2359/4706] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:09 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1490 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:10.570182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1478331929", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "7b0934fb-ee96-446d-a65b-fee23ff74766"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:10.637797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] validate_networks() for [('7b0934fb-ee96-446d-a65b-fee23ff74766', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:11.030657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-23cfbac4-9570-4436-9adf-766bf247718d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:11.032193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-23cfbac4-9570-4436-9adf-766bf247718d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:11.046857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23cfbac4-9570-4436-9adf-766bf247718d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.049328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23cfbac4-9570-4436-9adf-766bf247718d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.052619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23cfbac4-9570-4436-9adf-766bf247718d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.053251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23cfbac4-9570-4436-9adf-766bf247718d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.104282 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-23cfbac4-9570-4436-9adf-766bf247718d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 14 microversion: 2.1 time: 0.075703 Jul 20 04:34:11.105954 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2360/4707] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:11 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:34:12.117356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7c48c962-dd66-48cc-b8c0-4176121fd522 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:12.119272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7c48c962-dd66-48cc-b8c0-4176121fd522 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:12.138648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c48c962-dd66-48cc-b8c0-4176121fd522 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.149155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c48c962-dd66-48cc-b8c0-4176121fd522 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.151025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c48c962-dd66-48cc-b8c0-4176121fd522 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.151639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c48c962-dd66-48cc-b8c0-4176121fd522 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.227034 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7c48c962-dd66-48cc-b8c0-4176121fd522 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 14 microversion: 2.1 time: 0.113272 Jul 20 04:34:12.232477 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2361/4708] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:12 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:34:12.290966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:12.291459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:12.292291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:12.292291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:12.292665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:12.318855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.319318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.329440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.330034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.438002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:12.469885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for user f224517836bf403a83da9e2e7f175907 and project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:12.548424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:12.557361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:12.765265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-91562a4f-00c5-4077-b09d-4c85b74ff1d8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: .version_select at 0x7fb8414dc280>, body: {"keypair": {"name": "tempest-keypair-1972091813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOkpHcneNfPASWPeYNJ9qwca8IBc9OwvlfxHw40gm7UsaIeJjGBZ0zYRq9ppSNBFe1jbH+z9qHHvqhQ7R4Kh4rvVgUKk7VQsm6TkSpHxPiiLg9OKIi12HJ9LsoDnWva3Q=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:12.787768 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e51c1730-754e-4943-a5be-4da1dc6b78d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.223357 Jul 20 04:34:12.788992 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2348/4709] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:12.801447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3bfb66a7-3569-4060-8a7f-2284ea9ed288 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:12.803887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3bfb66a7-3569-4060-8a7f-2284ea9ed288 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:12.827672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-91562a4f-00c5-4077-b09d-4c85b74ff1d8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for project e104a7716d8549cb8b99560ac90150c6. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:12.846420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-91562a4f-00c5-4077-b09d-4c85b74ff1d8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for user 4bd10ebbd2fd4ef693e15194c2d8912c and project e104a7716d8549cb8b99560ac90150c6. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:12.879015 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-91562a4f-00c5-4077-b09d-4c85b74ff1d8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126785 Jul 20 04:34:12.885854 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2362/4710] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:34:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:12.991216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3bfb66a7-3569-4060-8a7f-2284ea9ed288 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:13.003732 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3bfb66a7-3569-4060-8a7f-2284ea9ed288 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1209 microversion: 2.1 time: 0.205165 Jul 20 04:34:13.006607 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2349/4711] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:12 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1209 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:13.248769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-930ac35b-6536-4827-bdb8-a83207c824a7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:13.249967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-930ac35b-6536-4827-bdb8-a83207c824a7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.271307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-930ac35b-6536-4827-bdb8-a83207c824a7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.274034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-930ac35b-6536-4827-bdb8-a83207c824a7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.274968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-930ac35b-6536-4827-bdb8-a83207c824a7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.278172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-930ac35b-6536-4827-bdb8-a83207c824a7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.374858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:13.425083 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-930ac35b-6536-4827-bdb8-a83207c824a7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 14 microversion: 2.1 time: 0.182819 Jul 20 04:34:13.426091 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2363/4712] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:13 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:34:14.023500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-588604fe-c5e1-4cc4-8f31-a3e19b7ca1cd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.024000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-588604fe-c5e1-4cc4-8f31-a3e19b7ca1cd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.037628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-588604fe-c5e1-4cc4-8f31-a3e19b7ca1cd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.038132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-588604fe-c5e1-4cc4-8f31-a3e19b7ca1cd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.039094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-588604fe-c5e1-4cc4-8f31-a3e19b7ca1cd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.039551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-588604fe-c5e1-4cc4-8f31-a3e19b7ca1cd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.101969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:14.439217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c83c3243-3279-4b39-93f8-b7110624adb3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:14.441041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c83c3243-3279-4b39-93f8-b7110624adb3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.474768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c83c3243-3279-4b39-93f8-b7110624adb3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.475586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c83c3243-3279-4b39-93f8-b7110624adb3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.479529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c83c3243-3279-4b39-93f8-b7110624adb3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.480277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c83c3243-3279-4b39-93f8-b7110624adb3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.568211 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c83c3243-3279-4b39-93f8-b7110624adb3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 14 microversion: 2.1 time: 0.135392 Jul 20 04:34:14.569555 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2364/4713] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:14 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:34:14.639463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-588604fe-c5e1-4cc4-8f31-a3e19b7ca1cd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:14.653792 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-588604fe-c5e1-4cc4-8f31-a3e19b7ca1cd tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1205 microversion: 2.1 time: 0.636526 Jul 20 04:34:14.654747 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2350/4714] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:14 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1205 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:15.580774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7827af33-7bc2-431c-b69c-e71c333f4891 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:15.582284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7827af33-7bc2-431c-b69c-e71c333f4891 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:15.605878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7827af33-7bc2-431c-b69c-e71c333f4891 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:15.606386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7827af33-7bc2-431c-b69c-e71c333f4891 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:15.607456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7827af33-7bc2-431c-b69c-e71c333f4891 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:15.607921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7827af33-7bc2-431c-b69c-e71c333f4891 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:15.678869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce59e719-5985-4bc9-a8e1-12281acee9f4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:15.680074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce59e719-5985-4bc9-a8e1-12281acee9f4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:15.687737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce59e719-5985-4bc9-a8e1-12281acee9f4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:15.701086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce59e719-5985-4bc9-a8e1-12281acee9f4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:15.702206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce59e719-5985-4bc9-a8e1-12281acee9f4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:15.702843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce59e719-5985-4bc9-a8e1-12281acee9f4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:15.716681 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7827af33-7bc2-431c-b69c-e71c333f4891 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 14 microversion: 2.1 time: 0.140315 Jul 20 04:34:15.718046 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2365/4715] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:15 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:34:16.275009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce59e719-5985-4bc9-a8e1-12281acee9f4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:16.286628 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce59e719-5985-4bc9-a8e1-12281acee9f4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1267 microversion: 2.1 time: 0.611845 Jul 20 04:34:16.288514 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2351/4716] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:15 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1267 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:16.742426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0d159a1e-6e0a-40ef-80d9-5ae1ac2a390e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:16.744365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0d159a1e-6e0a-40ef-80d9-5ae1ac2a390e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:16.764374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d159a1e-6e0a-40ef-80d9-5ae1ac2a390e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:16.765084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d159a1e-6e0a-40ef-80d9-5ae1ac2a390e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:16.766955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d159a1e-6e0a-40ef-80d9-5ae1ac2a390e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:16.769995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d159a1e-6e0a-40ef-80d9-5ae1ac2a390e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:16.873326 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0d159a1e-6e0a-40ef-80d9-5ae1ac2a390e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 14 microversion: 2.1 time: 0.143385 Jul 20 04:34:16.874344 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2366/4717] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:16 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:34:17.306958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c87a1112-9e72-4ff8-a6ae-f10ab3ada270 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:17.308370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c87a1112-9e72-4ff8-a6ae-f10ab3ada270 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:17.326524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c87a1112-9e72-4ff8-a6ae-f10ab3ada270 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:17.328747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c87a1112-9e72-4ff8-a6ae-f10ab3ada270 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:17.333079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c87a1112-9e72-4ff8-a6ae-f10ab3ada270 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:17.334405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c87a1112-9e72-4ff8-a6ae-f10ab3ada270 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:17.582819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c87a1112-9e72-4ff8-a6ae-f10ab3ada270 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:17.595388 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c87a1112-9e72-4ff8-a6ae-f10ab3ada270 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1267 microversion: 2.1 time: 0.291433 Jul 20 04:34:17.597517 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2352/4718] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:17 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:17.894026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cb547816-bc13-426b-808f-6964272437d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:17.895259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cb547816-bc13-426b-808f-6964272437d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:17.937803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb547816-bc13-426b-808f-6964272437d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:17.938281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb547816-bc13-426b-808f-6964272437d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:17.955064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb547816-bc13-426b-808f-6964272437d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:17.955905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb547816-bc13-426b-808f-6964272437d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.096705 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cb547816-bc13-426b-808f-6964272437d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 14 microversion: 2.1 time: 0.214983 Jul 20 04:34:18.098440 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2367/4719] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:17 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:34:18.614574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c4c29fd6-c38a-4781-b228-0c23cbc5cbc6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:18.615314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c4c29fd6-c38a-4781-b228-0c23cbc5cbc6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:18.627569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4c29fd6-c38a-4781-b228-0c23cbc5cbc6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.630921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4c29fd6-c38a-4781-b228-0c23cbc5cbc6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.632779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4c29fd6-c38a-4781-b228-0c23cbc5cbc6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.634789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4c29fd6-c38a-4781-b228-0c23cbc5cbc6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:19.096868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c4c29fd6-c38a-4781-b228-0c23cbc5cbc6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:19.117280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1e5717c6-cf50-429a-a15b-a7fb60fa29bf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:19.118404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1e5717c6-cf50-429a-a15b-a7fb60fa29bf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:19.123762 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c4c29fd6-c38a-4781-b228-0c23cbc5cbc6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1309 microversion: 2.1 time: 0.514235 Jul 20 04:34:19.124931 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2353/4720] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:18 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1309 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:19.148171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e5717c6-cf50-429a-a15b-a7fb60fa29bf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:19.151259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e5717c6-cf50-429a-a15b-a7fb60fa29bf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:19.153975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e5717c6-cf50-429a-a15b-a7fb60fa29bf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:19.155937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e5717c6-cf50-429a-a15b-a7fb60fa29bf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:19.218112 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1e5717c6-cf50-429a-a15b-a7fb60fa29bf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 14 microversion: 2.1 time: 0.103945 Jul 20 04:34:19.220157 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2368/4721] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:19 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:34:19.648367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-242069852", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "5a587f3f-235b-4e8b-b1ed-ddcb142c4033"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1412421735", "security_groups": [{"name": "tempest-secgroup-smoke-826770391"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:19.747248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2062663585", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "383b582b-f62e-45d5-8b36-660b1731bf20"}], "security_groups": [{"name": "tempest-securitygroup--1147626548"}], "key_name": "tempest-keypair-1972091813", "user_data": "}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:19.953091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] validate_networks() for [('5a587f3f-235b-4e8b-b1ed-ddcb142c4033', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:20.140155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] validate_networks() for [('383b582b-f62e-45d5-8b36-660b1731bf20', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:21.485650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:21.486236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:21.488235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:21.488664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:21.489085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:21.504691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=13 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:21.513141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.514010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.515224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.515669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.552263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for project e104a7716d8549cb8b99560ac90150c6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:21.563531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for user 4bd10ebbd2fd4ef693e15194c2d8912c and project e104a7716d8549cb8b99560ac90150c6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:21.591797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:21.641494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:21.652320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:21.822120 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-603902ef-3558-4a9a-85f5-5ef453db708c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.079998 Jul 20 04:34:21.829066 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2369/4722] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:34:21.850822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-67a4c19e-3904-448b-b786-4fe9d9db86e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:21.851449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-67a4c19e-3904-448b-b786-4fe9d9db86e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:21.863451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67a4c19e-3904-448b-b786-4fe9d9db86e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.864090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67a4c19e-3904-448b-b786-4fe9d9db86e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.865068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67a4c19e-3904-448b-b786-4fe9d9db86e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.865877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67a4c19e-3904-448b-b786-4fe9d9db86e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.378006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:22.437543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-67a4c19e-3904-448b-b786-4fe9d9db86e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:22.454168 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-67a4c19e-3904-448b-b786-4fe9d9db86e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1309 microversion: 2.1 time: 0.623719 Jul 20 04:34:22.455897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2370/4723] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:21 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1309 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:22.464362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d67b6b1-e3f5-4348-895e-d3a07943ab4a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:22.471670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d67b6b1-e3f5-4348-895e-d3a07943ab4a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:22.483997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d67b6b1-e3f5-4348-895e-d3a07943ab4a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.488466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d67b6b1-e3f5-4348-895e-d3a07943ab4a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.492032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d67b6b1-e3f5-4348-895e-d3a07943ab4a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.492717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d67b6b1-e3f5-4348-895e-d3a07943ab4a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.580792 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d67b6b1-e3f5-4348-895e-d3a07943ab4a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action" status: 200 len: 16402 microversion: 2.1 time: 0.122546 Jul 20 04:34:22.586035 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2371/4724] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:22 2022] POST /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d/action => generated 16402 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:34:22.598892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d3dc6ef8-76cd-4702-94d8-badbb93741e9 req-441437bb-30b4-4c3f-b162-51bbdbfe786c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4", "tag": "6da6dca8-8bfd-4def-9925-1b94fbd6f6c0"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:22.639395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d3dc6ef8-76cd-4702-94d8-badbb93741e9 req-441437bb-30b4-4c3f-b162-51bbdbfe786c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.640057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d3dc6ef8-76cd-4702-94d8-badbb93741e9 req-441437bb-30b4-4c3f-b162-51bbdbfe786c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.673849 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d3dc6ef8-76cd-4702-94d8-badbb93741e9 req-441437bb-30b4-4c3f-b162-51bbdbfe786c service nova] Creating event network-changed:6da6dca8-8bfd-4def-9925-1b94fbd6f6c0 for instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 on n-h2-760456-11 Jul 20 04:34:22.693593 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d3dc6ef8-76cd-4702-94d8-badbb93741e9 req-441437bb-30b4-4c3f-b162-51bbdbfe786c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105805 Jul 20 04:34:22.695204 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2372/4725] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:22.708986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6e6005f-a570-4644-b55d-73903ce5b89b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:22.709967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a6e6005f-a570-4644-b55d-73903ce5b89b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:22.724761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6e6005f-a570-4644-b55d-73903ce5b89b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.730053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6e6005f-a570-4644-b55d-73903ce5b89b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.731099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6e6005f-a570-4644-b55d-73903ce5b89b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.731900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6e6005f-a570-4644-b55d-73903ce5b89b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.895821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:22.896273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:22.896762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:22.897185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:22.897889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:22.932344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.932822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.933657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:22.934123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:22.954197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a6e6005f-a570-4644-b55d-73903ce5b89b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:22.980314 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a6e6005f-a570-4644-b55d-73903ce5b89b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1246 microversion: 2.1 time: 0.277538 Jul 20 04:34:22.981308 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2373/4726] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:22 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1246 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:22.996751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:23.010555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for user 8f84ec28420a4cdcb88920cd86ce0160 and project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:23.053210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:23.058298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:23.146302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ad27236-4f54-45d2-b022-bf40aee42e67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:23.147152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ad27236-4f54-45d2-b022-bf40aee42e67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:23.168409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ad27236-4f54-45d2-b022-bf40aee42e67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.169832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ad27236-4f54-45d2-b022-bf40aee42e67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.171760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ad27236-4f54-45d2-b022-bf40aee42e67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.177266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ad27236-4f54-45d2-b022-bf40aee42e67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.247609 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d21e9ee9-cb58-450b-9184-15b66be300db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.604613 Jul 20 04:34:23.259611 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2354/4727] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 3618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:23.272802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-85852d6f-43f8-43b8-bcf2-98771de220ee tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:23.273704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-85852d6f-43f8-43b8-bcf2-98771de220ee tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:23.415152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-85852d6f-43f8-43b8-bcf2-98771de220ee tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:23.426771 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-85852d6f-43f8-43b8-bcf2-98771de220ee tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1266 microversion: 2.1 time: 0.160957 Jul 20 04:34:23.439917 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2355/4728] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:23 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:23.472538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17030f36-1825-4750-b69c-dbdb932acbd5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:23.473332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-17030f36-1825-4750-b69c-dbdb932acbd5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:23.485054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17030f36-1825-4750-b69c-dbdb932acbd5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.488103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17030f36-1825-4750-b69c-dbdb932acbd5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.488946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17030f36-1825-4750-b69c-dbdb932acbd5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.489409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17030f36-1825-4750-b69c-dbdb932acbd5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.273237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-17030f36-1825-4750-b69c-dbdb932acbd5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:24.286727 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-17030f36-1825-4750-b69c-dbdb932acbd5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1309 microversion: 2.1 time: 0.818359 Jul 20 04:34:24.287334 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2356/4729] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:23 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1309 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:24.315359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a413cc39-8f3a-4917-9986-e872bcb541cb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:24.316178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a413cc39-8f3a-4917-9986-e872bcb541cb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:24.334003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a413cc39-8f3a-4917-9986-e872bcb541cb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.334822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a413cc39-8f3a-4917-9986-e872bcb541cb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.338308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a413cc39-8f3a-4917-9986-e872bcb541cb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.339045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a413cc39-8f3a-4917-9986-e872bcb541cb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.531115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a413cc39-8f3a-4917-9986-e872bcb541cb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:24.546240 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a413cc39-8f3a-4917-9986-e872bcb541cb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1300 microversion: 2.1 time: 0.241752 Jul 20 04:34:24.547451 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2357/4730] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:24 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1300 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:24.552930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62731927-3630-40be-b482-e159b7f86d5f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:24.554033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-62731927-3630-40be-b482-e159b7f86d5f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:24.560604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62731927-3630-40be-b482-e159b7f86d5f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.561791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62731927-3630-40be-b482-e159b7f86d5f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.562759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62731927-3630-40be-b482-e159b7f86d5f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.563357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62731927-3630-40be-b482-e159b7f86d5f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.984216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-62731927-3630-40be-b482-e159b7f86d5f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.011754 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62731927-3630-40be-b482-e159b7f86d5f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1262 microversion: 2.1 time: 0.450425 Jul 20 04:34:25.026465 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2358/4731] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:24 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1262 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:25.081067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1ad27236-4f54-45d2-b022-bf40aee42e67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.092808 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ad27236-4f54-45d2-b022-bf40aee42e67 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 2.110133 Jul 20 04:34:25.093803 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2374/4732] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:22 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:25.119326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49948b50-8bbd-4112-9365-756442e9fbfa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:25.120236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-49948b50-8bbd-4112-9365-756442e9fbfa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:25.138986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49948b50-8bbd-4112-9365-756442e9fbfa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.140834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49948b50-8bbd-4112-9365-756442e9fbfa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.146824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49948b50-8bbd-4112-9365-756442e9fbfa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.148350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49948b50-8bbd-4112-9365-756442e9fbfa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.305864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a11efd3-2296-47c8-aa0b-4cfa160c2f77 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:25.306753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2a11efd3-2296-47c8-aa0b-4cfa160c2f77 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:25.319456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a11efd3-2296-47c8-aa0b-4cfa160c2f77 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.320208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a11efd3-2296-47c8-aa0b-4cfa160c2f77 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.321164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a11efd3-2296-47c8-aa0b-4cfa160c2f77 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.321758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a11efd3-2296-47c8-aa0b-4cfa160c2f77 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.887342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2a11efd3-2296-47c8-aa0b-4cfa160c2f77 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.896709 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a11efd3-2296-47c8-aa0b-4cfa160c2f77 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1309 microversion: 2.1 time: 0.594950 Jul 20 04:34:25.906740 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2375/4733] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:25 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1309 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:25.921422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-063d0e4b-d592-4b54-bf4a-7a87c49a4142 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:25.925579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-063d0e4b-d592-4b54-bf4a-7a87c49a4142 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:25.943671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063d0e4b-d592-4b54-bf4a-7a87c49a4142 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.944072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063d0e4b-d592-4b54-bf4a-7a87c49a4142 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.944864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063d0e4b-d592-4b54-bf4a-7a87c49a4142 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.945390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063d0e4b-d592-4b54-bf4a-7a87c49a4142 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.145086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-063d0e4b-d592-4b54-bf4a-7a87c49a4142 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.155530 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-063d0e4b-d592-4b54-bf4a-7a87c49a4142 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1300 microversion: 2.1 time: 0.247563 Jul 20 04:34:26.168181 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2376/4734] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:25 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1300 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:26.173342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a9f12c10-d613-4383-b4d9-8f1edb9de7c4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:26.174134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a9f12c10-d613-4383-b4d9-8f1edb9de7c4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:26.190332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9f12c10-d613-4383-b4d9-8f1edb9de7c4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.190740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9f12c10-d613-4383-b4d9-8f1edb9de7c4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.191539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9f12c10-d613-4383-b4d9-8f1edb9de7c4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.191989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9f12c10-d613-4383-b4d9-8f1edb9de7c4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.319712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-49948b50-8bbd-4112-9365-756442e9fbfa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.328257 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-49948b50-8bbd-4112-9365-756442e9fbfa tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 1.215496 Jul 20 04:34:26.336148 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2359/4735] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:25 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:26.338231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a9f12c10-d613-4383-b4d9-8f1edb9de7c4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.350140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-95368712", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "9055ff40-3cca-47cb-9432-dea7e3cd48a5"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1916077816", "security_groups": []}, "os:scheduler_hints": {"different_host": ["d85bd8d6-2ced-4348-8d60-1a511efe1dbf"]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:26.352010 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a9f12c10-d613-4383-b4d9-8f1edb9de7c4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1324 microversion: 2.1 time: 0.182421 Jul 20 04:34:26.355262 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2377/4736] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:26 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:26.370198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7c47313-fc6a-4681-909b-8970716fc766 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:26.370198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b7c47313-fc6a-4681-909b-8970716fc766 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:26.387296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7c47313-fc6a-4681-909b-8970716fc766 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.388952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7c47313-fc6a-4681-909b-8970716fc766 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.389827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7c47313-fc6a-4681-909b-8970716fc766 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.392129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7c47313-fc6a-4681-909b-8970716fc766 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.459337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] validate_networks() for [('9055ff40-3cca-47cb-9432-dea7e3cd48a5', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:26.734565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b7c47313-fc6a-4681-909b-8970716fc766 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.755932 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b7c47313-fc6a-4681-909b-8970716fc766 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.399490 Jul 20 04:34:26.756529 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2378/4737] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:26 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:26.773931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-100d99d2-365a-4cc0-91ce-1d65d2dabc54 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:26.774626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-100d99d2-365a-4cc0-91ce-1d65d2dabc54 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:26.783780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-100d99d2-365a-4cc0-91ce-1d65d2dabc54 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.785654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-100d99d2-365a-4cc0-91ce-1d65d2dabc54 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.792084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-100d99d2-365a-4cc0-91ce-1d65d2dabc54 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.792543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-100d99d2-365a-4cc0-91ce-1d65d2dabc54 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:27.391175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-100d99d2-365a-4cc0-91ce-1d65d2dabc54 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:27.409668 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-100d99d2-365a-4cc0-91ce-1d65d2dabc54 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.640096 Jul 20 04:34:27.415393 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2379/4738] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:26 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:27.429819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a8806365-12ff-479b-b656-cad6d8e50046 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:27.431717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a8806365-12ff-479b-b656-cad6d8e50046 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:27.462043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8806365-12ff-479b-b656-cad6d8e50046 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:27.462552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8806365-12ff-479b-b656-cad6d8e50046 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:27.464637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8806365-12ff-479b-b656-cad6d8e50046 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:27.466580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8806365-12ff-479b-b656-cad6d8e50046 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.014831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a8806365-12ff-479b-b656-cad6d8e50046 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:28.029079 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a8806365-12ff-479b-b656-cad6d8e50046 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1309 microversion: 2.1 time: 0.609849 Jul 20 04:34:28.031516 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2380/4739] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:27 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1309 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:28.044080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-59c3acb3-2e1e-47d9-985c-e67653ae4386 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:28.044966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-59c3acb3-2e1e-47d9-985c-e67653ae4386 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:28.069632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59c3acb3-2e1e-47d9-985c-e67653ae4386 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.072418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59c3acb3-2e1e-47d9-985c-e67653ae4386 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.073494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59c3acb3-2e1e-47d9-985c-e67653ae4386 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.076676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59c3acb3-2e1e-47d9-985c-e67653ae4386 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.695598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-59c3acb3-2e1e-47d9-985c-e67653ae4386 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:28.716315 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-59c3acb3-2e1e-47d9-985c-e67653ae4386 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1368 microversion: 2.1 time: 0.683421 Jul 20 04:34:28.718120 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2381/4740] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:28 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1368 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:28.745380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-93346247-b28a-4f53-86e3-baf496f19c9e tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:28.747798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-93346247-b28a-4f53-86e3-baf496f19c9e tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:28.775414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93346247-b28a-4f53-86e3-baf496f19c9e tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.776954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93346247-b28a-4f53-86e3-baf496f19c9e tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.781547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93346247-b28a-4f53-86e3-baf496f19c9e tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.783235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93346247-b28a-4f53-86e3-baf496f19c9e tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.365727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:29.368296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:29.370493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:29.371195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:29.371761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:29.398720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.399591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.400687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.401385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.426328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Getting quotas for project 371a6852b8f441bfa719ab452a8c0d8a. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:29.433361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Getting quotas for user 9c92ac6d960b4b76ac881b676a00744a and project 371a6852b8f441bfa719ab452a8c0d8a. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:29.451152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:29.455186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:29.536965 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-36fda2ca-35f5-4bc4-b72f-f78280b2f526 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.199457 Jul 20 04:34:29.548797 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2360/4741] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:26 2022] POST /compute/v2.1/servers => generated 361 bytes in 3212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:29.578017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-345462b1-bc38-4589-8781-fec89f1e65a3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:29.579905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-345462b1-bc38-4589-8781-fec89f1e65a3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:29.616385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-345462b1-bc38-4589-8781-fec89f1e65a3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.617095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-345462b1-bc38-4589-8781-fec89f1e65a3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.620194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-345462b1-bc38-4589-8781-fec89f1e65a3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.628203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-345462b1-bc38-4589-8781-fec89f1e65a3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.735811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-345462b1-bc38-4589-8781-fec89f1e65a3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Locking {{(pid=119606) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 20 04:34:29.859625 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-345462b1-bc38-4589-8781-fec89f1e65a3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.307406 Jul 20 04:34:29.865490 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2361/4742] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:29 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:29.872441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4145b829-b648-45e8-952c-ed9bc69ac0e1 req-f672ed70-c922-427d-97d6-3211bacb6341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4", "name": "network-vif-plugged", "status": "completed", "tag": "6da6dca8-8bfd-4def-9925-1b94fbd6f6c0"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:29.884315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4145b829-b648-45e8-952c-ed9bc69ac0e1 req-f672ed70-c922-427d-97d6-3211bacb6341 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.885377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4145b829-b648-45e8-952c-ed9bc69ac0e1 req-f672ed70-c922-427d-97d6-3211bacb6341 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.913624 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4145b829-b648-45e8-952c-ed9bc69ac0e1 req-f672ed70-c922-427d-97d6-3211bacb6341 service nova] Creating event network-vif-plugged:6da6dca8-8bfd-4def-9925-1b94fbd6f6c0 for instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 on n-h2-760456-11 Jul 20 04:34:29.932899 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4145b829-b648-45e8-952c-ed9bc69ac0e1 req-f672ed70-c922-427d-97d6-3211bacb6341 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064128 Jul 20 04:34:29.937396 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2362/4743] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:29.960040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c3fc5b57-82ef-4a66-9b2a-c97f3a4f97e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:29.961460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c3fc5b57-82ef-4a66-9b2a-c97f3a4f97e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:29.977757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3fc5b57-82ef-4a66-9b2a-c97f3a4f97e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.978411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3fc5b57-82ef-4a66-9b2a-c97f3a4f97e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.979726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3fc5b57-82ef-4a66-9b2a-c97f3a4f97e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.980759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3fc5b57-82ef-4a66-9b2a-c97f3a4f97e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.027367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-93346247-b28a-4f53-86e3-baf496f19c9e tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:30.039384 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-93346247-b28a-4f53-86e3-baf496f19c9e tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 1.307230 Jul 20 04:34:30.040541 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2382/4744] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:28 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:30.078485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4c73b7a9-2985-40eb-8097-c2675db34abe tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:30.083148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4c73b7a9-2985-40eb-8097-c2675db34abe tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:30.376860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4c73b7a9-2985-40eb-8097-c2675db34abe tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:30.392366 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4c73b7a9-2985-40eb-8097-c2675db34abe tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1240 microversion: 2.1 time: 0.350054 Jul 20 04:34:30.403089 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2383/4745] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:30 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1240 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:30.415506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5165e9db-e41f-41ee-a2b1-5b2554d4ee4f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:30.416211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5165e9db-e41f-41ee-a2b1-5b2554d4ee4f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:30.432113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5165e9db-e41f-41ee-a2b1-5b2554d4ee4f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.432944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5165e9db-e41f-41ee-a2b1-5b2554d4ee4f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.434220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5165e9db-e41f-41ee-a2b1-5b2554d4ee4f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.434903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5165e9db-e41f-41ee-a2b1-5b2554d4ee4f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.047141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5165e9db-e41f-41ee-a2b1-5b2554d4ee4f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:31.056554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c3fc5b57-82ef-4a66-9b2a-c97f3a4f97e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:31.059993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:31.068230 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5165e9db-e41f-41ee-a2b1-5b2554d4ee4f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1368 microversion: 2.1 time: 0.663702 Jul 20 04:34:31.068837 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2384/4746] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:30 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1368 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:31.083946 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c3fc5b57-82ef-4a66-9b2a-c97f3a4f97e6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1309 microversion: 2.1 time: 1.141804 Jul 20 04:34:31.085423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-76beaafe-d821-450d-b97b-7003fa2e44b2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:31.086416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-76beaafe-d821-450d-b97b-7003fa2e44b2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:31.101668 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2363/4747] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:29 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1309 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:31.103963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76beaafe-d821-450d-b97b-7003fa2e44b2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.104683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76beaafe-d821-450d-b97b-7003fa2e44b2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.105694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76beaafe-d821-450d-b97b-7003fa2e44b2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.107060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8de19f75-bce5-46f5-9584-318f6db24e32 req-bb64e304-1859-4085-a414-a576841ef2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4", "tag": "93f589ec-140a-4193-b51f-d3e3db3a4102"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:31.107378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76beaafe-d821-450d-b97b-7003fa2e44b2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.119097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8de19f75-bce5-46f5-9584-318f6db24e32 req-bb64e304-1859-4085-a414-a576841ef2c6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.119924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8de19f75-bce5-46f5-9584-318f6db24e32 req-bb64e304-1859-4085-a414-a576841ef2c6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.162045 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8de19f75-bce5-46f5-9584-318f6db24e32 req-bb64e304-1859-4085-a414-a576841ef2c6 service nova] Creating event network-changed:93f589ec-140a-4193-b51f-d3e3db3a4102 for instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 on n-h1-760456-11 Jul 20 04:34:31.180162 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8de19f75-bce5-46f5-9584-318f6db24e32 req-bb64e304-1859-4085-a414-a576841ef2c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076995 Jul 20 04:34:31.181773 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2364/4748] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:31.195861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6c9047f6-5360-4f90-b92f-c83601b72029 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:31.197239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6c9047f6-5360-4f90-b92f-c83601b72029 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:31.213508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c9047f6-5360-4f90-b92f-c83601b72029 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.215713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c9047f6-5360-4f90-b92f-c83601b72029 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.219426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c9047f6-5360-4f90-b92f-c83601b72029 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.223179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c9047f6-5360-4f90-b92f-c83601b72029 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.419558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-76beaafe-d821-450d-b97b-7003fa2e44b2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:31.429422 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-76beaafe-d821-450d-b97b-7003fa2e44b2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.355599 Jul 20 04:34:31.447294 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2385/4749] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:31 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:31.452359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f5ff3bd1-539d-4177-942d-3a57e6635cd7 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:31.453314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f5ff3bd1-539d-4177-942d-3a57e6635cd7 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:31.460226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5ff3bd1-539d-4177-942d-3a57e6635cd7 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.461011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5ff3bd1-539d-4177-942d-3a57e6635cd7 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.462049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5ff3bd1-539d-4177-942d-3a57e6635cd7 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.462747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5ff3bd1-539d-4177-942d-3a57e6635cd7 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.538350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:31.612014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f5ff3bd1-539d-4177-942d-3a57e6635cd7 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:31.636671 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f5ff3bd1-539d-4177-942d-3a57e6635cd7 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1300 microversion: 2.1 time: 0.188054 Jul 20 04:34:31.637893 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2386/4750] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:31 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:31.644214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2c0726e3-401b-4d92-960d-fa253d18d6e6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:31.651536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c0726e3-401b-4d92-960d-fa253d18d6e6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.652568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c0726e3-401b-4d92-960d-fa253d18d6e6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.688136 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-2c0726e3-401b-4d92-960d-fa253d18d6e6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] HTTP exception thrown: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a is locked Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2c0726e3-401b-4d92-960d-fa253d18d6e6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Request method failure captured: Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action HTTP/1.1 Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 15 Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14SiUlkQNYk--daNjLwIoEjtsFT5_8UlpOU3P-5mDFLyXSRv-FzhEH1ynPPVEM_64IvlQlWrMD095ewIpF0tstjiya8gbRdB-HqL3UAUp669y1SWiwiBAgJe5VUCMiWH0WBVcOTUefMYnTyIure1GlP0xwZ9qJH3u8xEI1jzCtXBPfQ Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: a3a58233b2b044d9b1285b616c79f9b8 Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: {"os-stop": {}} Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a is locked Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '44b78332-e314-4da3-8a21-1ccfa545f11a', 'body': {'os-stop': {}}} Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a is locked Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a is locked Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a is locked Jul 20 04:34:31.694560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:31.701157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2c0726e3-401b-4d92-960d-fa253d18d6e6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Returning 409 to user: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a is locked {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:31.703432 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2c0726e3-401b-4d92-960d-fa253d18d6e6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 409 len: 107 microversion: 2.1 time: 0.064539 Jul 20 04:34:31.704784 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2387/4751] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:31 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 107 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:34:31.718654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a7e7411e-a8be-418b-895b-69d06b9f812d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:31.720250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7e7411e-a8be-418b-895b-69d06b9f812d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:31.730653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7e7411e-a8be-418b-895b-69d06b9f812d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.731765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7e7411e-a8be-418b-895b-69d06b9f812d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.732722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7e7411e-a8be-418b-895b-69d06b9f812d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.733306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7e7411e-a8be-418b-895b-69d06b9f812d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.735790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6c9047f6-5360-4f90-b92f-c83601b72029 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:31.746608 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6c9047f6-5360-4f90-b92f-c83601b72029 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.563343 Jul 20 04:34:31.747214 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2365/4752] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:31 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:31.806700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7e7411e-a8be-418b-895b-69d06b9f812d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Unlocking {{(pid=119605) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 20 04:34:31.946776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a7e7411e-a8be-418b-895b-69d06b9f812d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.236107 Jul 20 04:34:31.950472 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2388/4753] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:31 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:31.956427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b1661fbb-3164-43ca-a77d-2cb52f9a79b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:31.959838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:31.968727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1661fbb-3164-43ca-a77d-2cb52f9a79b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.969264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1661fbb-3164-43ca-a77d-2cb52f9a79b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.018888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b1661fbb-3164-43ca-a77d-2cb52f9a79b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Going to try to stop instance {{(pid=119606) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:34:32.076600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-54289158-e1d4-41f4-a42d-447ac9c11562 req-1b8ee6ed-36e8-4ee6-9678-bebce807711a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:32.103103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-54289158-e1d4-41f4-a42d-447ac9c11562 req-1b8ee6ed-36e8-4ee6-9678-bebce807711a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.108282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-54289158-e1d4-41f4-a42d-447ac9c11562 req-1b8ee6ed-36e8-4ee6-9678-bebce807711a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.118056 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b1661fbb-3164-43ca-a77d-2cb52f9a79b7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.166054 Jul 20 04:34:32.121612 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2366/4754] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:31 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:32.137708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a2a91292-7bf2-4af2-9f66-5c711b924784 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:32.138827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a2a91292-7bf2-4af2-9f66-5c711b924784 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:32.150076 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-54289158-e1d4-41f4-a42d-447ac9c11562 req-1b8ee6ed-36e8-4ee6-9678-bebce807711a service nova] Creating event network-changed:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h1-760456-11 Jul 20 04:34:32.160576 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-54289158-e1d4-41f4-a42d-447ac9c11562 req-1b8ee6ed-36e8-4ee6-9678-bebce807711a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088927 Jul 20 04:34:32.162650 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2389/4755] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:34:32.169883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2a91292-7bf2-4af2-9f66-5c711b924784 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.172986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2a91292-7bf2-4af2-9f66-5c711b924784 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.176796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2a91292-7bf2-4af2-9f66-5c711b924784 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.177619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-74e0c14e-6753-44db-a4b2-4a9435e4348f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:32.178570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-74e0c14e-6753-44db-a4b2-4a9435e4348f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:32.179386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2a91292-7bf2-4af2-9f66-5c711b924784 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.186157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:32.190173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74e0c14e-6753-44db-a4b2-4a9435e4348f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.190872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74e0c14e-6753-44db-a4b2-4a9435e4348f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.191735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74e0c14e-6753-44db-a4b2-4a9435e4348f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.192172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74e0c14e-6753-44db-a4b2-4a9435e4348f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.427089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-74e0c14e-6753-44db-a4b2-4a9435e4348f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:32.450151 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-74e0c14e-6753-44db-a4b2-4a9435e4348f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1309 microversion: 2.1 time: 0.277934 Jul 20 04:34:32.451484 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2390/4756] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:32 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:32.462599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c69c539b-3078-4a36-a31d-801dbd48efcf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:32.463485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c69c539b-3078-4a36-a31d-801dbd48efcf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:32.471378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c69c539b-3078-4a36-a31d-801dbd48efcf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.472711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c69c539b-3078-4a36-a31d-801dbd48efcf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.474550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c69c539b-3078-4a36-a31d-801dbd48efcf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.475223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c69c539b-3078-4a36-a31d-801dbd48efcf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.558641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a2a91292-7bf2-4af2-9f66-5c711b924784 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:32.573895 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a2a91292-7bf2-4af2-9f66-5c711b924784 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1368 microversion: 2.1 time: 0.452708 Jul 20 04:34:32.574985 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2367/4757] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:32 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1368 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:32.638739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c69c539b-3078-4a36-a31d-801dbd48efcf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:32.647981 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c69c539b-3078-4a36-a31d-801dbd48efcf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.193116 Jul 20 04:34:32.654713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-77e51fa5-9342-413e-8d0f-10f7249e517f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:32.655611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-77e51fa5-9342-413e-8d0f-10f7249e517f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:32.658645 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2391/4758] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:32 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:32.662681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77e51fa5-9342-413e-8d0f-10f7249e517f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.663141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77e51fa5-9342-413e-8d0f-10f7249e517f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.663961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77e51fa5-9342-413e-8d0f-10f7249e517f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.664402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77e51fa5-9342-413e-8d0f-10f7249e517f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.757355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-77e51fa5-9342-413e-8d0f-10f7249e517f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:32.769123 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-77e51fa5-9342-413e-8d0f-10f7249e517f tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1298 microversion: 2.1 time: 0.118222 Jul 20 04:34:32.777248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bde6f752-db94-4235-9d42-9dda54b8b2f0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:32.777873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bde6f752-db94-4235-9d42-9dda54b8b2f0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:32.780286 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2368/4759] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:32 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:32.785259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bde6f752-db94-4235-9d42-9dda54b8b2f0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.785724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bde6f752-db94-4235-9d42-9dda54b8b2f0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.786596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bde6f752-db94-4235-9d42-9dda54b8b2f0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.787206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bde6f752-db94-4235-9d42-9dda54b8b2f0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.029491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bde6f752-db94-4235-9d42-9dda54b8b2f0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:33.043379 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bde6f752-db94-4235-9d42-9dda54b8b2f0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.272238 Jul 20 04:34:33.044312 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2392/4760] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:32 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:33.469690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d41578de-9eab-45bd-8872-dc971b3480c7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:33.471793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d41578de-9eab-45bd-8872-dc971b3480c7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:33.478561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d41578de-9eab-45bd-8872-dc971b3480c7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.491066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d41578de-9eab-45bd-8872-dc971b3480c7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.492232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d41578de-9eab-45bd-8872-dc971b3480c7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.492881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d41578de-9eab-45bd-8872-dc971b3480c7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.592047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-332986e2-2f71-404b-9c5a-75ce971adbac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:33.593297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-332986e2-2f71-404b-9c5a-75ce971adbac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:33.604451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-332986e2-2f71-404b-9c5a-75ce971adbac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.605187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-332986e2-2f71-404b-9c5a-75ce971adbac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.606150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-332986e2-2f71-404b-9c5a-75ce971adbac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.606826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-332986e2-2f71-404b-9c5a-75ce971adbac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.783253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-332986e2-2f71-404b-9c5a-75ce971adbac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:33.796519 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-332986e2-2f71-404b-9c5a-75ce971adbac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1368 microversion: 2.1 time: 0.208278 Jul 20 04:34:33.799676 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2393/4761] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:33 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:33.804906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a939ee59-a227-4ce3-8e32-d1129ebd9e7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:33.806522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a939ee59-a227-4ce3-8e32-d1129ebd9e7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:33.814818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a939ee59-a227-4ce3-8e32-d1129ebd9e7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.815784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a939ee59-a227-4ce3-8e32-d1129ebd9e7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.817349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a939ee59-a227-4ce3-8e32-d1129ebd9e7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.817977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a939ee59-a227-4ce3-8e32-d1129ebd9e7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.841704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d41578de-9eab-45bd-8872-dc971b3480c7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:33.850567 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d41578de-9eab-45bd-8872-dc971b3480c7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1491 microversion: 2.1 time: 0.384948 Jul 20 04:34:33.851885 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2369/4762] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:33 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1491 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:33.856930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-25af7ffc-7c40-4123-b2de-29af4635ea91 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:33.857783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-25af7ffc-7c40-4123-b2de-29af4635ea91 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:33.866101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25af7ffc-7c40-4123-b2de-29af4635ea91 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.867713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25af7ffc-7c40-4123-b2de-29af4635ea91 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.868614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25af7ffc-7c40-4123-b2de-29af4635ea91 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.869861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25af7ffc-7c40-4123-b2de-29af4635ea91 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.031339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-25af7ffc-7c40-4123-b2de-29af4635ea91 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.052102 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-25af7ffc-7c40-4123-b2de-29af4635ea91 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1298 microversion: 2.1 time: 0.198834 Jul 20 04:34:34.052717 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2370/4763] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:33 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1298 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:34.063070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a939ee59-a227-4ce3-8e32-d1129ebd9e7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.077906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1b2ba8ff-6b2b-4db4-9e31-19390ce2a516 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:34.078124 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a939ee59-a227-4ce3-8e32-d1129ebd9e7a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.274776 Jul 20 04:34:34.078774 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2394/4764] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:33 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:34.086109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1a478702-0d94-4e42-8fe4-374e0588ccde tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:34.086962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1a478702-0d94-4e42-8fe4-374e0588ccde tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:34.090661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1b2ba8ff-6b2b-4db4-9e31-19390ce2a516 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:34.096411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a478702-0d94-4e42-8fe4-374e0588ccde tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.096989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a478702-0d94-4e42-8fe4-374e0588ccde tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.097911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a478702-0d94-4e42-8fe4-374e0588ccde tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.098575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a478702-0d94-4e42-8fe4-374e0588ccde tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.110039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b2ba8ff-6b2b-4db4-9e31-19390ce2a516 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.110539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b2ba8ff-6b2b-4db4-9e31-19390ce2a516 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.112106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b2ba8ff-6b2b-4db4-9e31-19390ce2a516 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.112573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b2ba8ff-6b2b-4db4-9e31-19390ce2a516 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.384683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1b2ba8ff-6b2b-4db4-9e31-19390ce2a516 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.397844 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1b2ba8ff-6b2b-4db4-9e31-19390ce2a516 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1490 microversion: 2.1 time: 0.327891 Jul 20 04:34:34.398777 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2371/4765] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:34 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1490 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:34.405424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1a478702-0d94-4e42-8fe4-374e0588ccde tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.415488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e91bd932-cb70-43d7-8327-519a52bc3ada tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:34.416179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e91bd932-cb70-43d7-8327-519a52bc3ada tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:34.423419 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1a478702-0d94-4e42-8fe4-374e0588ccde tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.340396 Jul 20 04:34:34.424459 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2395/4766] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:34 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:34.429004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e91bd932-cb70-43d7-8327-519a52bc3ada tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.429623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e91bd932-cb70-43d7-8327-519a52bc3ada tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.430580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e91bd932-cb70-43d7-8327-519a52bc3ada tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.431371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e91bd932-cb70-43d7-8327-519a52bc3ada tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.705532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1f832681-d490-4d1b-a96c-43f13bf20ed2 req-d13de8ee-1830-41d8-863f-6255a3ac0919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8828de2f-4984-4159-b2b0-d2098074e6ee", "tag": "947993be-24ef-475e-849e-3c1c6013f41e"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:34.725536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1f832681-d490-4d1b-a96c-43f13bf20ed2 req-d13de8ee-1830-41d8-863f-6255a3ac0919 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.728931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1f832681-d490-4d1b-a96c-43f13bf20ed2 req-d13de8ee-1830-41d8-863f-6255a3ac0919 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.757378 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1f832681-d490-4d1b-a96c-43f13bf20ed2 req-d13de8ee-1830-41d8-863f-6255a3ac0919 service nova] Creating event network-changed:947993be-24ef-475e-849e-3c1c6013f41e for instance 8828de2f-4984-4159-b2b0-d2098074e6ee on n-h2-760456-11 Jul 20 04:34:34.764449 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1f832681-d490-4d1b-a96c-43f13bf20ed2 req-d13de8ee-1830-41d8-863f-6255a3ac0919 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075627 Jul 20 04:34:34.765149 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2396/4767] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:34:34.805504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e91bd932-cb70-43d7-8327-519a52bc3ada tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.818862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bba56307-f90d-4edf-a9c0-6df61af9acae tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:34.819814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bba56307-f90d-4edf-a9c0-6df61af9acae tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:34.838897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bba56307-f90d-4edf-a9c0-6df61af9acae tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.839366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bba56307-f90d-4edf-a9c0-6df61af9acae tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.840221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bba56307-f90d-4edf-a9c0-6df61af9acae tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.840659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bba56307-f90d-4edf-a9c0-6df61af9acae tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.842398 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e91bd932-cb70-43d7-8327-519a52bc3ada tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1491 microversion: 2.1 time: 0.429498 Jul 20 04:34:34.846849 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2372/4768] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:34 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1491 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:34.867319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0036c07d-2812-4a3d-9e79-30c43965407e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:34.868241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0036c07d-2812-4a3d-9e79-30c43965407e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:34.881839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0036c07d-2812-4a3d-9e79-30c43965407e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.883458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0036c07d-2812-4a3d-9e79-30c43965407e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.884799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0036c07d-2812-4a3d-9e79-30c43965407e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.885949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0036c07d-2812-4a3d-9e79-30c43965407e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.934537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0036c07d-2812-4a3d-9e79-30c43965407e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:34:35.119374 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0036c07d-2812-4a3d-9e79-30c43965407e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 204 len: 0 microversion: 2.1 time: 0.260504 Jul 20 04:34:35.123803 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2373/4769] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:34 2022] DELETE /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:35.130688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3003c8e9-8e2c-4c02-b632-43c919914d5a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:35.137543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3003c8e9-8e2c-4c02-b632-43c919914d5a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:35.151607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3003c8e9-8e2c-4c02-b632-43c919914d5a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.152089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3003c8e9-8e2c-4c02-b632-43c919914d5a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.155168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3003c8e9-8e2c-4c02-b632-43c919914d5a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.156070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3003c8e9-8e2c-4c02-b632-43c919914d5a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.380146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bba56307-f90d-4edf-a9c0-6df61af9acae tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:35.396159 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bba56307-f90d-4edf-a9c0-6df61af9acae tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1368 microversion: 2.1 time: 0.581035 Jul 20 04:34:35.396813 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2397/4770] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:34 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1368 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:35.415889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-651501b9-54db-432c-856e-53a8bef2b951 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:35.418062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-651501b9-54db-432c-856e-53a8bef2b951 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:35.428766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-651501b9-54db-432c-856e-53a8bef2b951 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.429663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-651501b9-54db-432c-856e-53a8bef2b951 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.430777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-651501b9-54db-432c-856e-53a8bef2b951 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.431851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-651501b9-54db-432c-856e-53a8bef2b951 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.587372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3003c8e9-8e2c-4c02-b632-43c919914d5a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:35.599598 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3003c8e9-8e2c-4c02-b632-43c919914d5a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1298 microversion: 2.1 time: 0.473785 Jul 20 04:34:35.600811 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2374/4771] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:35 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1298 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:35.618803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aa31aab9-0bec-4909-b808-e5667b2a8f79 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:35.620229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aa31aab9-0bec-4909-b808-e5667b2a8f79 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:35.633486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa31aab9-0bec-4909-b808-e5667b2a8f79 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.635089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa31aab9-0bec-4909-b808-e5667b2a8f79 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.636640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa31aab9-0bec-4909-b808-e5667b2a8f79 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.637431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa31aab9-0bec-4909-b808-e5667b2a8f79 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.805428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-651501b9-54db-432c-856e-53a8bef2b951 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:35.816730 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-651501b9-54db-432c-856e-53a8bef2b951 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.407295 Jul 20 04:34:35.831377 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2398/4772] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:35 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:35.837927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a629507d-5702-41a2-be59-bcfc09e47505 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:35.839052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a629507d-5702-41a2-be59-bcfc09e47505 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:35.847953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a629507d-5702-41a2-be59-bcfc09e47505 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.848692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a629507d-5702-41a2-be59-bcfc09e47505 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.849970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a629507d-5702-41a2-be59-bcfc09e47505 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.850661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a629507d-5702-41a2-be59-bcfc09e47505 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.968022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aa31aab9-0bec-4909-b808-e5667b2a8f79 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:35.983286 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aa31aab9-0bec-4909-b808-e5667b2a8f79 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1497 microversion: 2.1 time: 0.370955 Jul 20 04:34:35.984331 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2375/4773] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:35 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1497 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:36.040805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a629507d-5702-41a2-be59-bcfc09e47505 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:36.052429 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a629507d-5702-41a2-be59-bcfc09e47505 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.218969 Jul 20 04:34:36.053351 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2399/4774] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:35 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:36.420616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fa3f1272-5c90-4fbf-9e4c-57900407aa83 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:36.424607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fa3f1272-5c90-4fbf-9e4c-57900407aa83 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:36.438361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa3f1272-5c90-4fbf-9e4c-57900407aa83 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.439608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa3f1272-5c90-4fbf-9e4c-57900407aa83 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.440757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa3f1272-5c90-4fbf-9e4c-57900407aa83 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.441421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fa3f1272-5c90-4fbf-9e4c-57900407aa83 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.622585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4f965f4-79d6-4ced-846e-28f39344fedd tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:36.624620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b4f965f4-79d6-4ced-846e-28f39344fedd tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:36.633824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4f965f4-79d6-4ced-846e-28f39344fedd tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.635872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4f965f4-79d6-4ced-846e-28f39344fedd tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.636858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4f965f4-79d6-4ced-846e-28f39344fedd tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.637455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4f965f4-79d6-4ced-846e-28f39344fedd tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.765164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fa3f1272-5c90-4fbf-9e4c-57900407aa83 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:36.778568 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fa3f1272-5c90-4fbf-9e4c-57900407aa83 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1368 microversion: 2.1 time: 0.366968 Jul 20 04:34:36.790832 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2376/4775] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:36 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1368 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:36.837657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-001993eb-404e-45a1-9022-12757d50d696 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:36.838418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-001993eb-404e-45a1-9022-12757d50d696 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:36.853485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-001993eb-404e-45a1-9022-12757d50d696 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.853951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-001993eb-404e-45a1-9022-12757d50d696 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.854792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-001993eb-404e-45a1-9022-12757d50d696 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.855243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-001993eb-404e-45a1-9022-12757d50d696 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.920005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b4f965f4-79d6-4ced-846e-28f39344fedd tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:36.928301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:36.931086 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b4f965f4-79d6-4ced-846e-28f39344fedd tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1298 microversion: 2.1 time: 0.316802 Jul 20 04:34:36.943178 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2400/4776] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:36 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1298 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:37.009809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-752aae08-2368-4d51-8d0c-e35801e3617e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:37.011017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-752aae08-2368-4d51-8d0c-e35801e3617e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:37.018132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-752aae08-2368-4d51-8d0c-e35801e3617e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.019342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-752aae08-2368-4d51-8d0c-e35801e3617e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.020354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-752aae08-2368-4d51-8d0c-e35801e3617e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.021200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-752aae08-2368-4d51-8d0c-e35801e3617e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.273211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-001993eb-404e-45a1-9022-12757d50d696 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.282291 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-001993eb-404e-45a1-9022-12757d50d696 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.449054 Jul 20 04:34:37.286053 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2377/4777] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:36 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:37.295343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-64b42d85-faa3-4c5e-b977-232b489660b7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:37.295343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-64b42d85-faa3-4c5e-b977-232b489660b7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:37.311524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64b42d85-faa3-4c5e-b977-232b489660b7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.312003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64b42d85-faa3-4c5e-b977-232b489660b7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.312813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64b42d85-faa3-4c5e-b977-232b489660b7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.313264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64b42d85-faa3-4c5e-b977-232b489660b7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.459325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-752aae08-2368-4d51-8d0c-e35801e3617e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.469144 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-752aae08-2368-4d51-8d0c-e35801e3617e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1497 microversion: 2.1 time: 0.469296 Jul 20 04:34:37.483983 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2401/4778] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:36 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1497 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:37.549334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-822b6dd2-6778-4486-a7fa-8d9bdf044682 req-d3f79fb1-1a2b-41ac-9e88-a285fa7c6b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4", "name": "network-vif-deleted", "tag": "6da6dca8-8bfd-4def-9925-1b94fbd6f6c0"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:37.558695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-822b6dd2-6778-4486-a7fa-8d9bdf044682 req-d3f79fb1-1a2b-41ac-9e88-a285fa7c6b68 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.559594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-822b6dd2-6778-4486-a7fa-8d9bdf044682 req-d3f79fb1-1a2b-41ac-9e88-a285fa7c6b68 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.590041 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-822b6dd2-6778-4486-a7fa-8d9bdf044682 req-d3f79fb1-1a2b-41ac-9e88-a285fa7c6b68 service nova] Creating event network-vif-deleted:6da6dca8-8bfd-4def-9925-1b94fbd6f6c0 for instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 on n-h2-760456-11 Jul 20 04:34:37.604657 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-822b6dd2-6778-4486-a7fa-8d9bdf044682 req-d3f79fb1-1a2b-41ac-9e88-a285fa7c6b68 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059726 Jul 20 04:34:37.605615 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2402/4779] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:37.721989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-64b42d85-faa3-4c5e-b977-232b489660b7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:37.745973 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-64b42d85-faa3-4c5e-b977-232b489660b7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.457952 Jul 20 04:34:37.768671 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2378/4780] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:37 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:37.796667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cab4996d-e079-4c31-864f-5beedaf100fd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:37.797386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cab4996d-e079-4c31-864f-5beedaf100fd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:37.815750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cab4996d-e079-4c31-864f-5beedaf100fd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.816294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cab4996d-e079-4c31-864f-5beedaf100fd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.817075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cab4996d-e079-4c31-864f-5beedaf100fd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.817782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cab4996d-e079-4c31-864f-5beedaf100fd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.950554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bfcd4e4f-f393-45f6-9306-41f368181f6a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:37.951523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bfcd4e4f-f393-45f6-9306-41f368181f6a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:37.964108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfcd4e4f-f393-45f6-9306-41f368181f6a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.964859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfcd4e4f-f393-45f6-9306-41f368181f6a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.967218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfcd4e4f-f393-45f6-9306-41f368181f6a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.970026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfcd4e4f-f393-45f6-9306-41f368181f6a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.169112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bfcd4e4f-f393-45f6-9306-41f368181f6a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:38.189328 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bfcd4e4f-f393-45f6-9306-41f368181f6a tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1298 microversion: 2.1 time: 0.243507 Jul 20 04:34:38.201953 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2379/4781] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:37 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1298 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:38.306427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1af880b-3561-4911-b3d3-30b3d8a6fdf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:38.308888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d1af880b-3561-4911-b3d3-30b3d8a6fdf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:38.318447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1af880b-3561-4911-b3d3-30b3d8a6fdf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.319674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1af880b-3561-4911-b3d3-30b3d8a6fdf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.321500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1af880b-3561-4911-b3d3-30b3d8a6fdf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.323188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1af880b-3561-4911-b3d3-30b3d8a6fdf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.400842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cab4996d-e079-4c31-864f-5beedaf100fd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:38.418916 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cab4996d-e079-4c31-864f-5beedaf100fd tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1368 microversion: 2.1 time: 0.626449 Jul 20 04:34:38.419524 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2403/4782] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:37 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1368 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:38.490707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:38.491559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:38.503411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.509297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.510421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.511051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.567195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1af880b-3561-4911-b3d3-30b3d8a6fdf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:38.582609 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1af880b-3561-4911-b3d3-30b3d8a6fdf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.283201 Jul 20 04:34:38.586222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.588198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.589880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lazy-loading 'fault' on Instance uuid 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:38.604655 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2380/4783] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:38 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:38.770121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b0eb5c8f-cd71-4b53-8ba2-722f514944b5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:38.771415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b0eb5c8f-cd71-4b53-8ba2-722f514944b5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:38.783744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0eb5c8f-cd71-4b53-8ba2-722f514944b5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.785081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0eb5c8f-cd71-4b53-8ba2-722f514944b5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:38.786286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0eb5c8f-cd71-4b53-8ba2-722f514944b5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:38.787338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0eb5c8f-cd71-4b53-8ba2-722f514944b5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.031869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:39.047102 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-44ecb3a0-d563-44bc-a98e-f7c90d2f6207 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 200 len: 1299 microversion: 2.1 time: 0.554245 Jul 20 04:34:39.050799 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2404/4784] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:38 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 1299 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:39.096406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0eb5c8f-cd71-4b53-8ba2-722f514944b5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:39.112293 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b0eb5c8f-cd71-4b53-8ba2-722f514944b5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.349533 Jul 20 04:34:39.125617 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2381/4785] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:38 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:39.213194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f0670f4-d288-4805-abd7-879694ea1d71 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:39.213833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f0670f4-d288-4805-abd7-879694ea1d71 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:39.226661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f0670f4-d288-4805-abd7-879694ea1d71 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.227221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f0670f4-d288-4805-abd7-879694ea1d71 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.228054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f0670f4-d288-4805-abd7-879694ea1d71 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.230824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f0670f4-d288-4805-abd7-879694ea1d71 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.437013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83f07ab1-7823-488a-aaaa-666589d183e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:39.437642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-83f07ab1-7823-488a-aaaa-666589d183e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:39.442989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5f0670f4-d288-4805-abd7-879694ea1d71 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:39.452474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:39.475820 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f0670f4-d288-4805-abd7-879694ea1d71 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1298 microversion: 2.1 time: 0.271971 Jul 20 04:34:39.481694 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2405/4786] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:39 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1298 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:39.483007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=22 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:39.488512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83f07ab1-7823-488a-aaaa-666589d183e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.491370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83f07ab1-7823-488a-aaaa-666589d183e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.494352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83f07ab1-7823-488a-aaaa-666589d183e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.499807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83f07ab1-7823-488a-aaaa-666589d183e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.526847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:39.613612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c5cf2746-49f9-4952-888a-32cce2c92801 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:39.614738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c5cf2746-49f9-4952-888a-32cce2c92801 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:39.650384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5cf2746-49f9-4952-888a-32cce2c92801 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.652343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5cf2746-49f9-4952-888a-32cce2c92801 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.653583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5cf2746-49f9-4952-888a-32cce2c92801 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.654739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5cf2746-49f9-4952-888a-32cce2c92801 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.830577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-83f07ab1-7823-488a-aaaa-666589d183e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:39.841396 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-83f07ab1-7823-488a-aaaa-666589d183e6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1368 microversion: 2.1 time: 0.408296 Jul 20 04:34:39.851204 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2382/4787] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:39 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1368 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:39.856656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-bb418bee-8527-4027-a0c3-ec8568fe0f80 req-7f2b9daf-ab52-4f0f-a2c7-f6b259de44c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4", "name": "network-vif-plugged", "status": "completed", "tag": "93f589ec-140a-4193-b51f-d3e3db3a4102"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:39.881410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bb418bee-8527-4027-a0c3-ec8568fe0f80 req-7f2b9daf-ab52-4f0f-a2c7-f6b259de44c0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.881847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bb418bee-8527-4027-a0c3-ec8568fe0f80 req-7f2b9daf-ab52-4f0f-a2c7-f6b259de44c0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.897102 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-bb418bee-8527-4027-a0c3-ec8568fe0f80 req-7f2b9daf-ab52-4f0f-a2c7-f6b259de44c0 service nova] Creating event network-vif-plugged:93f589ec-140a-4193-b51f-d3e3db3a4102 for instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 on n-h1-760456-11 Jul 20 04:34:39.903370 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-bb418bee-8527-4027-a0c3-ec8568fe0f80 req-7f2b9daf-ab52-4f0f-a2c7-f6b259de44c0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050533 Jul 20 04:34:39.904187 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2383/4788] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:39.996854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c5cf2746-49f9-4952-888a-32cce2c92801 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.005767 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c5cf2746-49f9-4952-888a-32cce2c92801 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.406727 Jul 20 04:34:40.006596 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2406/4789] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:39 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:40.069540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-891bdbaa-ee05-49d3-949e-cb8ba8eedb18 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:40.070413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-891bdbaa-ee05-49d3-949e-cb8ba8eedb18 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:40.084124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-891bdbaa-ee05-49d3-949e-cb8ba8eedb18 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.084656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-891bdbaa-ee05-49d3-949e-cb8ba8eedb18 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.085628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-891bdbaa-ee05-49d3-949e-cb8ba8eedb18 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.086140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-891bdbaa-ee05-49d3-949e-cb8ba8eedb18 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.105712 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-891bdbaa-ee05-49d3-949e-cb8ba8eedb18 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-891bdbaa-ee05-49d3-949e-cb8ba8eedb18 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 HTTP/1.1 Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4'} Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:34:40.107684 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:40.111853 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:40.111853 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:40.111853 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:40.111853 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:40.111853 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:34:40.111853 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:34:40.113774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-891bdbaa-ee05-49d3-949e-cb8ba8eedb18 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:40.114818 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-891bdbaa-ee05-49d3-949e-cb8ba8eedb18 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 404 len: 111 microversion: 2.1 time: 0.051228 Jul 20 04:34:40.115855 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2384/4790] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:40 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:40.135005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c3ec19e5-70ca-456c-9d64-d8eb30b4712b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:40.135374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b91308ce-b330-46c8-afa3-9fea22cf0176 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:40.136064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b91308ce-b330-46c8-afa3-9fea22cf0176 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:40.137347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c3ec19e5-70ca-456c-9d64-d8eb30b4712b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:40.144004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b91308ce-b330-46c8-afa3-9fea22cf0176 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.145278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b91308ce-b330-46c8-afa3-9fea22cf0176 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.146318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b91308ce-b330-46c8-afa3-9fea22cf0176 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.147391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b91308ce-b330-46c8-afa3-9fea22cf0176 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.149407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3ec19e5-70ca-456c-9d64-d8eb30b4712b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.151402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3ec19e5-70ca-456c-9d64-d8eb30b4712b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.154921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3ec19e5-70ca-456c-9d64-d8eb30b4712b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.155492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c3ec19e5-70ca-456c-9d64-d8eb30b4712b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.194470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b91308ce-b330-46c8-afa3-9fea22cf0176 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:34:40.333840 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b91308ce-b330-46c8-afa3-9fea22cf0176 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 204 len: 0 microversion: 2.1 time: 0.211466 Jul 20 04:34:40.338094 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2407/4791] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:40 2022] DELETE /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:40.356436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56b54dcc-f84b-4bbb-a10f-803ffa93a069 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:40.360093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-56b54dcc-f84b-4bbb-a10f-803ffa93a069 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:40.387025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=7 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:40.391084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56b54dcc-f84b-4bbb-a10f-803ffa93a069 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.392363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56b54dcc-f84b-4bbb-a10f-803ffa93a069 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.393874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56b54dcc-f84b-4bbb-a10f-803ffa93a069 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.394488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56b54dcc-f84b-4bbb-a10f-803ffa93a069 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.399810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c3ec19e5-70ca-456c-9d64-d8eb30b4712b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.416854 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c3ec19e5-70ca-456c-9d64-d8eb30b4712b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.289366 Jul 20 04:34:40.429527 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2385/4792] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:40 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:40.495368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2198864f-ad00-41b4-9540-2e5c72af1b73 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:40.496696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2198864f-ad00-41b4-9540-2e5c72af1b73 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:40.505543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2198864f-ad00-41b4-9540-2e5c72af1b73 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.508375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2198864f-ad00-41b4-9540-2e5c72af1b73 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.509787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2198864f-ad00-41b4-9540-2e5c72af1b73 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.510904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2198864f-ad00-41b4-9540-2e5c72af1b73 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.615751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2198864f-ad00-41b4-9540-2e5c72af1b73 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.632158 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2198864f-ad00-41b4-9540-2e5c72af1b73 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1298 microversion: 2.1 time: 0.140591 Jul 20 04:34:40.646200 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2386/4793] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:40 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:40.752782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-56b54dcc-f84b-4bbb-a10f-803ffa93a069 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.762575 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-56b54dcc-f84b-4bbb-a10f-803ffa93a069 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1496 microversion: 2.1 time: 0.419033 Jul 20 04:34:40.776098 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2408/4794] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:40 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1496 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:40.859754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f0260dc-ad37-4696-beff-250853bad53f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:40.861453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9f0260dc-ad37-4696-beff-250853bad53f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:40.876296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f0260dc-ad37-4696-beff-250853bad53f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.877747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f0260dc-ad37-4696-beff-250853bad53f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.881637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f0260dc-ad37-4696-beff-250853bad53f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:40.881637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f0260dc-ad37-4696-beff-250853bad53f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.042783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-013aabd5-89a6-4597-ac68-616f55219937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:41.048974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-013aabd5-89a6-4597-ac68-616f55219937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:41.098103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-013aabd5-89a6-4597-ac68-616f55219937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.098846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-013aabd5-89a6-4597-ac68-616f55219937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.100108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-013aabd5-89a6-4597-ac68-616f55219937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.103215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-013aabd5-89a6-4597-ac68-616f55219937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.266608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9f0260dc-ad37-4696-beff-250853bad53f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:41.275432 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f0260dc-ad37-4696-beff-250853bad53f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1368 microversion: 2.1 time: 0.420360 Jul 20 04:34:41.278189 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2387/4795] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:40 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:41.435359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dda6e236-c4a3-4b35-9c58-396e20b0e65d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:41.435991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dda6e236-c4a3-4b35-9c58-396e20b0e65d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:41.443107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dda6e236-c4a3-4b35-9c58-396e20b0e65d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.443851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dda6e236-c4a3-4b35-9c58-396e20b0e65d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.446748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dda6e236-c4a3-4b35-9c58-396e20b0e65d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.447210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dda6e236-c4a3-4b35-9c58-396e20b0e65d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.492366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-013aabd5-89a6-4597-ac68-616f55219937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:41.503606 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-013aabd5-89a6-4597-ac68-616f55219937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.482533 Jul 20 04:34:41.509265 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2409/4796] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:41 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:41.660050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-46189019-cf4e-43f7-9972-a01c34a31bd9 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:41.660707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-46189019-cf4e-43f7-9972-a01c34a31bd9 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:41.667632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46189019-cf4e-43f7-9972-a01c34a31bd9 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.669242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46189019-cf4e-43f7-9972-a01c34a31bd9 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.670239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46189019-cf4e-43f7-9972-a01c34a31bd9 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.670853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46189019-cf4e-43f7-9972-a01c34a31bd9 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.763691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dda6e236-c4a3-4b35-9c58-396e20b0e65d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:41.777577 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dda6e236-c4a3-4b35-9c58-396e20b0e65d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.346154 Jul 20 04:34:41.779098 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2388/4797] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:41 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:41.793278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4203cba7-44bc-4728-9773-c364c471a919 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:41.795323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4203cba7-44bc-4728-9773-c364c471a919 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:41.811976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4203cba7-44bc-4728-9773-c364c471a919 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.812687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4203cba7-44bc-4728-9773-c364c471a919 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:41.814182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4203cba7-44bc-4728-9773-c364c471a919 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:41.814857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4203cba7-44bc-4728-9773-c364c471a919 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.021213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-46189019-cf4e-43f7-9972-a01c34a31bd9 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.043287 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-46189019-cf4e-43f7-9972-a01c34a31bd9 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1298 microversion: 2.1 time: 0.388459 Jul 20 04:34:42.046284 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2410/4798] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:41 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1298 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:42.209666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4203cba7-44bc-4728-9773-c364c471a919 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.221209 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4203cba7-44bc-4728-9773-c364c471a919 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1496 microversion: 2.1 time: 0.440148 Jul 20 04:34:42.222681 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2389/4799] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:41 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1496 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:42.255388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-166f9abd-6459-46c1-b349-df25d44f7db8 req-3fc2f226-97f1-4abb-acef-dd054747d688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8828de2f-4984-4159-b2b0-d2098074e6ee", "name": "network-vif-plugged", "status": "completed", "tag": "947993be-24ef-475e-849e-3c1c6013f41e"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:42.269985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:42.273995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-166f9abd-6459-46c1-b349-df25d44f7db8 req-3fc2f226-97f1-4abb-acef-dd054747d688 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.277677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-166f9abd-6459-46c1-b349-df25d44f7db8 req-3fc2f226-97f1-4abb-acef-dd054747d688 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.296876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fdf258f6-2e81-4124-b2eb-850df1382195 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:42.298632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fdf258f6-2e81-4124-b2eb-850df1382195 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:42.314092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fdf258f6-2e81-4124-b2eb-850df1382195 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.317513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fdf258f6-2e81-4124-b2eb-850df1382195 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.320837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fdf258f6-2e81-4124-b2eb-850df1382195 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.321309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fdf258f6-2e81-4124-b2eb-850df1382195 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.328845 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-166f9abd-6459-46c1-b349-df25d44f7db8 req-3fc2f226-97f1-4abb-acef-dd054747d688 service nova] Creating event network-vif-plugged:947993be-24ef-475e-849e-3c1c6013f41e for instance 8828de2f-4984-4159-b2b0-d2098074e6ee on n-h2-760456-11 Jul 20 04:34:42.366643 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-166f9abd-6459-46c1-b349-df25d44f7db8 req-3fc2f226-97f1-4abb-acef-dd054747d688 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114777 Jul 20 04:34:42.367738 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2411/4800] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:42.530377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0e688e87-0ccb-4456-a08d-0c6dd45dfcc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:42.530980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0e688e87-0ccb-4456-a08d-0c6dd45dfcc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:42.548640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e688e87-0ccb-4456-a08d-0c6dd45dfcc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.549921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e688e87-0ccb-4456-a08d-0c6dd45dfcc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.562237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e688e87-0ccb-4456-a08d-0c6dd45dfcc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.567028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e688e87-0ccb-4456-a08d-0c6dd45dfcc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.705755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fdf258f6-2e81-4124-b2eb-850df1382195 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:42.732381 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fdf258f6-2e81-4124-b2eb-850df1382195 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1368 microversion: 2.1 time: 0.441646 Jul 20 04:34:42.734912 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2390/4801] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:42 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1368 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:42.796626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-56807c70-7e5e-4761-b42a-84a058d9df1c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:42.797377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-56807c70-7e5e-4761-b42a-84a058d9df1c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:42.804920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56807c70-7e5e-4761-b42a-84a058d9df1c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.805533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56807c70-7e5e-4761-b42a-84a058d9df1c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:42.806502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56807c70-7e5e-4761-b42a-84a058d9df1c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:42.807089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56807c70-7e5e-4761-b42a-84a058d9df1c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.036153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-56807c70-7e5e-4761-b42a-84a058d9df1c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:43.055356 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-56807c70-7e5e-4761-b42a-84a058d9df1c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.263420 Jul 20 04:34:43.072454 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2391/4802] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:42 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:43.098565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9563dee9-14f2-46f0-9b14-66199f6a69dc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:43.099547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9563dee9-14f2-46f0-9b14-66199f6a69dc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.110163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9563dee9-14f2-46f0-9b14-66199f6a69dc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.113066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9563dee9-14f2-46f0-9b14-66199f6a69dc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.114603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9563dee9-14f2-46f0-9b14-66199f6a69dc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.115244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9563dee9-14f2-46f0-9b14-66199f6a69dc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.247988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9563dee9-14f2-46f0-9b14-66199f6a69dc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:43.258983 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9563dee9-14f2-46f0-9b14-66199f6a69dc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1298 microversion: 2.1 time: 0.184533 Jul 20 04:34:43.259773 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2392/4803] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:43 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:43.277367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4c270451-e215-498c-bffc-e15a59a2eae5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:43.278232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4c270451-e215-498c-bffc-e15a59a2eae5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.290124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c270451-e215-498c-bffc-e15a59a2eae5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.294915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c270451-e215-498c-bffc-e15a59a2eae5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.296323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c270451-e215-498c-bffc-e15a59a2eae5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.297033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c270451-e215-498c-bffc-e15a59a2eae5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.569628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4c270451-e215-498c-bffc-e15a59a2eae5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:43.578063 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4c270451-e215-498c-bffc-e15a59a2eae5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1496 microversion: 2.1 time: 0.317068 Jul 20 04:34:43.580357 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2393/4804] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:43 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1496 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:43.609768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0e688e87-0ccb-4456-a08d-0c6dd45dfcc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:43.622924 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0e688e87-0ccb-4456-a08d-0c6dd45dfcc3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 1.099621 Jul 20 04:34:43.637939 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2412/4805] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:42 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:43.753654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac59be9b-7bd5-4a03-8c08-138420214f72 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:43.754341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac59be9b-7bd5-4a03-8c08-138420214f72 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.761759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac59be9b-7bd5-4a03-8c08-138420214f72 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.762228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac59be9b-7bd5-4a03-8c08-138420214f72 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.763047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac59be9b-7bd5-4a03-8c08-138420214f72 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.763871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac59be9b-7bd5-4a03-8c08-138420214f72 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.917238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ac59be9b-7bd5-4a03-8c08-138420214f72 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:43.926559 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac59be9b-7bd5-4a03-8c08-138420214f72 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1559 microversion: 2.1 time: 0.178658 Jul 20 04:34:43.942381 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2394/4806] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:43 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:43.946432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-30ea5de5-26f4-44a2-b05c-67ad1e0af0e9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:43.948035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-30ea5de5-26f4-44a2-b05c-67ad1e0af0e9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:43.956298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30ea5de5-26f4-44a2-b05c-67ad1e0af0e9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.957258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30ea5de5-26f4-44a2-b05c-67ad1e0af0e9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.958206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30ea5de5-26f4-44a2-b05c-67ad1e0af0e9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.958811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-30ea5de5-26f4-44a2-b05c-67ad1e0af0e9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.073448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9406109d-48a2-4ddb-beb6-a69418185430 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.074196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9406109d-48a2-4ddb-beb6-a69418185430 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.085970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9406109d-48a2-4ddb-beb6-a69418185430 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.086918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9406109d-48a2-4ddb-beb6-a69418185430 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.089478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9406109d-48a2-4ddb-beb6-a69418185430 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.092808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9406109d-48a2-4ddb-beb6-a69418185430 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.271851 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-30ea5de5-26f4-44a2-b05c-67ad1e0af0e9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.330144 Jul 20 04:34:44.272482 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2413/4807] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:34:43 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4/os-interface => generated 285 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:34:44.278315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-bf0805df-80b6-4553-b404-40c04a8b65ba req-bc1f8683-8c3c-4bea-be9d-e6cb8ab3d3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260", "name": "network-vif-deleted", "tag": "fe0d3839-e8c6-440c-b7c6-8d5a42ed275a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:44.290498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bf0805df-80b6-4553-b404-40c04a8b65ba req-bc1f8683-8c3c-4bea-be9d-e6cb8ab3d3ad service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.291113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bf0805df-80b6-4553-b404-40c04a8b65ba req-bc1f8683-8c3c-4bea-be9d-e6cb8ab3d3ad service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.331733 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-bf0805df-80b6-4553-b404-40c04a8b65ba req-bc1f8683-8c3c-4bea-be9d-e6cb8ab3d3ad service nova] Creating event network-vif-deleted:fe0d3839-e8c6-440c-b7c6-8d5a42ed275a for instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 on n-h1-760456-11 Jul 20 04:34:44.340112 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-bf0805df-80b6-4553-b404-40c04a8b65ba req-bc1f8683-8c3c-4bea-be9d-e6cb8ab3d3ad service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066177 Jul 20 04:34:44.340944 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2414/4808] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:44.350056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f853b199-9b67-463b-91e7-49feaae9f9c5 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.350950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f853b199-9b67-463b-91e7-49feaae9f9c5 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.355358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9406109d-48a2-4ddb-beb6-a69418185430 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.365252 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9406109d-48a2-4ddb-beb6-a69418185430 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.296048 Jul 20 04:34:44.365955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f853b199-9b67-463b-91e7-49feaae9f9c5 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.366456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f853b199-9b67-463b-91e7-49feaae9f9c5 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.367243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f853b199-9b67-463b-91e7-49feaae9f9c5 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.367843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f853b199-9b67-463b-91e7-49feaae9f9c5 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.377533 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2395/4809] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:44.405648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ce938571-c7b8-4559-8737-e7a88f0d88af req-bf194f07-2984-4399-a709-834467064170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "name": "network-vif-plugged", "status": "completed", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}, {"server_uuid": "1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260", "name": "network-vif-unplugged", "status": "completed", "tag": "fe0d3839-e8c6-440c-b7c6-8d5a42ed275a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:44.429416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ce938571-c7b8-4559-8737-e7a88f0d88af req-bf194f07-2984-4399-a709-834467064170 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.429878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ce938571-c7b8-4559-8737-e7a88f0d88af req-bf194f07-2984-4399-a709-834467064170 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.446027 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ce938571-c7b8-4559-8737-e7a88f0d88af req-bf194f07-2984-4399-a709-834467064170 service nova] Creating event network-vif-plugged:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h1-760456-11 Jul 20 04:34:44.446809 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ce938571-c7b8-4559-8737-e7a88f0d88af req-bf194f07-2984-4399-a709-834467064170 service nova] Creating event network-vif-unplugged:fe0d3839-e8c6-440c-b7c6-8d5a42ed275a for instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 on n-h1-760456-11 Jul 20 04:34:44.459609 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ce938571-c7b8-4559-8737-e7a88f0d88af req-bf194f07-2984-4399-a709-834467064170 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.058750 Jul 20 04:34:44.460925 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2396/4810] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:44.615178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.617468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.628834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.632645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.632645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.633298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f853b199-9b67-463b-91e7-49feaae9f9c5 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.633855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.647375 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f853b199-9b67-463b-91e7-49feaae9f9c5 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1470 microversion: 2.1 time: 0.305053 Jul 20 04:34:44.648474 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2415/4811] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1470 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:44.653287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cd19ada2-4f9a-4dd3-b428-9045f0ac7559 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.654072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cd19ada2-4f9a-4dd3-b428-9045f0ac7559 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.663629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd19ada2-4f9a-4dd3-b428-9045f0ac7559 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.664933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd19ada2-4f9a-4dd3-b428-9045f0ac7559 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.666128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd19ada2-4f9a-4dd3-b428-9045f0ac7559 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.666838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd19ada2-4f9a-4dd3-b428-9045f0ac7559 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.710703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.711164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.711633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lazy-loading 'fault' on Instance uuid 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:34:44.792241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.802075 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2d694850-fb43-4b98-885f-8acc2546ad3f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 200 len: 1299 microversion: 2.1 time: 0.205195 Jul 20 04:34:44.803278 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2397/4812] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 1299 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:44.807909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be74f625-a658-4e3a-92b7-d9cc10dda5fc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.808677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-be74f625-a658-4e3a-92b7-d9cc10dda5fc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.815868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be74f625-a658-4e3a-92b7-d9cc10dda5fc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.816771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be74f625-a658-4e3a-92b7-d9cc10dda5fc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.817458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be74f625-a658-4e3a-92b7-d9cc10dda5fc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.818025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be74f625-a658-4e3a-92b7-d9cc10dda5fc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.938144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-be74f625-a658-4e3a-92b7-d9cc10dda5fc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:44.952203 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-be74f625-a658-4e3a-92b7-d9cc10dda5fc tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1470 microversion: 2.1 time: 0.147085 Jul 20 04:34:44.953828 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2398/4813] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:44.975447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-64d4d5f3-0f2a-4e4f-9869-d420e46348c3 tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.976267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-64d4d5f3-0f2a-4e4f-9869-d420e46348c3 tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.985458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64d4d5f3-0f2a-4e4f-9869-d420e46348c3 tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.986731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64d4d5f3-0f2a-4e4f-9869-d420e46348c3 tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.988011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64d4d5f3-0f2a-4e4f-9869-d420e46348c3 tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.988778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64d4d5f3-0f2a-4e4f-9869-d420e46348c3 tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.092312 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-64d4d5f3-0f2a-4e4f-9869-d420e46348c3 tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1623 microversion: 2.1 time: 0.122220 Jul 20 04:34:45.108591 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2399/4814] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1623 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:45.114568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28b2afd2-ea0f-4bfd-8905-5ff777f7abac tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.115353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-28b2afd2-ea0f-4bfd-8905-5ff777f7abac tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.122067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28b2afd2-ea0f-4bfd-8905-5ff777f7abac tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.122422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28b2afd2-ea0f-4bfd-8905-5ff777f7abac tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.123350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28b2afd2-ea0f-4bfd-8905-5ff777f7abac tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.124382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28b2afd2-ea0f-4bfd-8905-5ff777f7abac tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.132744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cd19ada2-4f9a-4dd3-b428-9045f0ac7559 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:45.145567 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cd19ada2-4f9a-4dd3-b428-9045f0ac7559 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1656 microversion: 2.1 time: 0.495874 Jul 20 04:34:45.153434 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2416/4815] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1656 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:45.161105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:45.171189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9ab2da11-596c-4278-b406-ce4fad6e0b4d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:45.183383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ab2da11-596c-4278-b406-ce4fad6e0b4d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.184017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ab2da11-596c-4278-b406-ce4fad6e0b4d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.217591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9ab2da11-596c-4278-b406-ce4fad6e0b4d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Going to try to start instance {{(pid=119605) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:34:45.266327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:45.297651 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9ab2da11-596c-4278-b406-ce4fad6e0b4d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.130455 Jul 20 04:34:45.299161 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2417/4816] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:45 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:45.313255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3da36988-ddc0-4ad7-97e5-ee3727e3aeef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.315260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3da36988-ddc0-4ad7-97e5-ee3727e3aeef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.322018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3da36988-ddc0-4ad7-97e5-ee3727e3aeef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.322739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3da36988-ddc0-4ad7-97e5-ee3727e3aeef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.323681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3da36988-ddc0-4ad7-97e5-ee3727e3aeef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.324268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3da36988-ddc0-4ad7-97e5-ee3727e3aeef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.391008 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-28b2afd2-ea0f-4bfd-8905-5ff777f7abac tempest-TestSecurityGroupsBasicOps-584174078 tempest-TestSecurityGroupsBasicOps-584174078-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1915 microversion: 2.1 time: 0.284669 Jul 20 04:34:45.392782 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2400/4817] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1915 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:45.397673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-809b2dc4-3ced-4302-9985-1f311cb948f3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.398831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-809b2dc4-3ced-4302-9985-1f311cb948f3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.422737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-809b2dc4-3ced-4302-9985-1f311cb948f3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.429299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-809b2dc4-3ced-4302-9985-1f311cb948f3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.430943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-809b2dc4-3ced-4302-9985-1f311cb948f3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.431678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-809b2dc4-3ced-4302-9985-1f311cb948f3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.608051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-809b2dc4-3ced-4302-9985-1f311cb948f3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:45.618947 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-809b2dc4-3ced-4302-9985-1f311cb948f3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1391 microversion: 2.1 time: 0.224910 Jul 20 04:34:45.619816 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2401/4818] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1391 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:45.625447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-977e4a53-e31b-4ab4-b91d-37543003be90 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.626367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-977e4a53-e31b-4ab4-b91d-37543003be90 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.634122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-977e4a53-e31b-4ab4-b91d-37543003be90 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.634809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-977e4a53-e31b-4ab4-b91d-37543003be90 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.635607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-977e4a53-e31b-4ab4-b91d-37543003be90 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.636059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-977e4a53-e31b-4ab4-b91d-37543003be90 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.666042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-977e4a53-e31b-4ab4-b91d-37543003be90 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:34:45.774384 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-977e4a53-e31b-4ab4-b91d-37543003be90 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 204 len: 0 microversion: 2.1 time: 0.147230 Jul 20 04:34:45.775388 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2402/4819] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:45 2022] DELETE /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:45.787806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-52ad189f-7430-4319-8b3f-b56017c44e45 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.789298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-52ad189f-7430-4319-8b3f-b56017c44e45 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.802077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52ad189f-7430-4319-8b3f-b56017c44e45 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.802787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52ad189f-7430-4319-8b3f-b56017c44e45 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.804204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52ad189f-7430-4319-8b3f-b56017c44e45 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.804816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52ad189f-7430-4319-8b3f-b56017c44e45 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.851906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3da36988-ddc0-4ad7-97e5-ee3727e3aeef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:45.859715 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3da36988-ddc0-4ad7-97e5-ee3727e3aeef tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1665 microversion: 2.1 time: 0.551038 Jul 20 04:34:45.860814 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2418/4820] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1665 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:45.869075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-057457a4-bca5-4303-ac9b-4c22763f1a45 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.869678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-057457a4-bca5-4303-ac9b-4c22763f1a45 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.888912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-057457a4-bca5-4303-ac9b-4c22763f1a45 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.889349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-057457a4-bca5-4303-ac9b-4c22763f1a45 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.890128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-057457a4-bca5-4303-ac9b-4c22763f1a45 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.890592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-057457a4-bca5-4303-ac9b-4c22763f1a45 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.915596 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-057457a4-bca5-4303-ac9b-4c22763f1a45 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-057457a4-bca5-4303-ac9b-4c22763f1a45 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 HTTP/1.1 Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260'} Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:45.917311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:45.921249 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:45.921249 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:45.921249 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:45.921249 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:45.921249 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:34:45.921249 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:45.921249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-057457a4-bca5-4303-ac9b-4c22763f1a45 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:45.930155 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-057457a4-bca5-4303-ac9b-4c22763f1a45 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 404 len: 111 microversion: 2.1 time: 0.053402 Jul 20 04:34:45.931295 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2419/4821] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:45.934301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-52ad189f-7430-4319-8b3f-b56017c44e45 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:45.948704 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-52ad189f-7430-4319-8b3f-b56017c44e45 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1476 microversion: 2.1 time: 0.168424 Jul 20 04:34:45.949626 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2403/4822] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:46.101440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1718506788", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "7b0934fb-ee96-446d-a65b-fee23ff74766"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:46.162748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] validate_networks() for [('7b0934fb-ee96-446d-a65b-fee23ff74766', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:46.636715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9095f8c4-8b53-450b-b0a6-69b48a469e64 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:46.637254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9095f8c4-8b53-450b-b0a6-69b48a469e64 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:46.646060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9095f8c4-8b53-450b-b0a6-69b48a469e64 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:46.646553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9095f8c4-8b53-450b-b0a6-69b48a469e64 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.647348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9095f8c4-8b53-450b-b0a6-69b48a469e64 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:46.647798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9095f8c4-8b53-450b-b0a6-69b48a469e64 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.797535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9095f8c4-8b53-450b-b0a6-69b48a469e64 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:46.808180 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9095f8c4-8b53-450b-b0a6-69b48a469e64 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1563 microversion: 2.1 time: 0.175531 Jul 20 04:34:46.809143 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2404/4823] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:46 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:46.825086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93a7ad90-b84e-4a9e-a334-3276eb6651c8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:46.825710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-93a7ad90-b84e-4a9e-a334-3276eb6651c8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:46.838183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93a7ad90-b84e-4a9e-a334-3276eb6651c8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:46.838810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93a7ad90-b84e-4a9e-a334-3276eb6651c8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.839333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93a7ad90-b84e-4a9e-a334-3276eb6651c8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:46.840004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93a7ad90-b84e-4a9e-a334-3276eb6651c8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.002458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-93a7ad90-b84e-4a9e-a334-3276eb6651c8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:47.012560 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-93a7ad90-b84e-4a9e-a334-3276eb6651c8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1563 microversion: 2.1 time: 0.191153 Jul 20 04:34:47.013427 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2405/4824] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:46 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1563 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:47.019284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-303ef38a-4bc5-4abf-8cd0-8230508abf3d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:47.019916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-303ef38a-4bc5-4abf-8cd0-8230508abf3d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:47.029367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-303ef38a-4bc5-4abf-8cd0-8230508abf3d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.029968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-303ef38a-4bc5-4abf-8cd0-8230508abf3d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.030738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-303ef38a-4bc5-4abf-8cd0-8230508abf3d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.031194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-303ef38a-4bc5-4abf-8cd0-8230508abf3d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.256391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-303ef38a-4bc5-4abf-8cd0-8230508abf3d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:47.264955 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-303ef38a-4bc5-4abf-8cd0-8230508abf3d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1665 microversion: 2.1 time: 0.250580 Jul 20 04:34:47.271491 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2406/4825] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:47 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1665 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:47.279661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5cce3975-4896-4faf-8975-214c1394d248 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:47.280533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5cce3975-4896-4faf-8975-214c1394d248 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:47.296981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5cce3975-4896-4faf-8975-214c1394d248 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.307244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5cce3975-4896-4faf-8975-214c1394d248 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.308218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5cce3975-4896-4faf-8975-214c1394d248 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.308729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5cce3975-4896-4faf-8975-214c1394d248 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.506525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5cce3975-4896-4faf-8975-214c1394d248 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:47.514541 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5cce3975-4896-4faf-8975-214c1394d248 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1476 microversion: 2.1 time: 0.241775 Jul 20 04:34:47.515331 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2407/4826] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:47 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1476 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:47.641297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-fddc648b-8704-466c-9556-8d64527eb942 req-873de401-1fa9-4aba-a238-26824d4eb608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4", "tag": "93f589ec-140a-4193-b51f-d3e3db3a4102"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:47.656811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fddc648b-8704-466c-9556-8d64527eb942 req-873de401-1fa9-4aba-a238-26824d4eb608 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.662515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fddc648b-8704-466c-9556-8d64527eb942 req-873de401-1fa9-4aba-a238-26824d4eb608 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.682013 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-fddc648b-8704-466c-9556-8d64527eb942 req-873de401-1fa9-4aba-a238-26824d4eb608 service nova] Creating event network-changed:93f589ec-140a-4193-b51f-d3e3db3a4102 for instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 on n-h1-760456-11 Jul 20 04:34:47.705224 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-fddc648b-8704-466c-9556-8d64527eb942 req-873de401-1fa9-4aba-a238-26824d4eb608 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066782 Jul 20 04:34:47.706044 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2408/4827] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:34:47.964298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:47.964739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:47.965191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:47.965638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:47.966006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:47.991881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.992351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.993168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.993615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.037307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:48.056151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for user f224517836bf403a83da9e2e7f175907 and project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:48.082943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:48.085285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:48.186407 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec22c388-abd4-473f-9ee5-334564ad11a0 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.090341 Jul 20 04:34:48.187372 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2420/4828] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:48.199454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04ced4f4-25a2-4264-ab44-04081d8935d6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:48.200398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04ced4f4-25a2-4264-ab44-04081d8935d6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:48.202586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:48.290044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-58c3c140-daba-42e6-9b29-eb9371bb0002 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:48.290725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-58c3c140-daba-42e6-9b29-eb9371bb0002 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:48.308529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58c3c140-daba-42e6-9b29-eb9371bb0002 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.312610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58c3c140-daba-42e6-9b29-eb9371bb0002 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.318925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58c3c140-daba-42e6-9b29-eb9371bb0002 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.323102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-58c3c140-daba-42e6-9b29-eb9371bb0002 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.437945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-04ced4f4-25a2-4264-ab44-04081d8935d6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.449999 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04ced4f4-25a2-4264-ab44-04081d8935d6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1209 microversion: 2.1 time: 0.252488 Jul 20 04:34:48.451198 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2409/4829] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:48 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1209 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:48.535937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6865fdb3-f109-433d-84cf-08cbef1bc019 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:48.536667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6865fdb3-f109-433d-84cf-08cbef1bc019 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:48.567443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6865fdb3-f109-433d-84cf-08cbef1bc019 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.568531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6865fdb3-f109-433d-84cf-08cbef1bc019 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.571950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6865fdb3-f109-433d-84cf-08cbef1bc019 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.573790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6865fdb3-f109-433d-84cf-08cbef1bc019 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.857735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6865fdb3-f109-433d-84cf-08cbef1bc019 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.866550 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6865fdb3-f109-433d-84cf-08cbef1bc019 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 200 len: 1325 microversion: 2.1 time: 0.337817 Jul 20 04:34:48.874595 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2410/4830] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:48 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 1325 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:48.902791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-916cbcff-6e0e-450a-abd7-58d9727086d8 req-a47c9366-88a8-4b18-b290-4287e14f1db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8828de2f-4984-4159-b2b0-d2098074e6ee", "name": "network-vif-deleted", "tag": "947993be-24ef-475e-849e-3c1c6013f41e"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:48.914496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-916cbcff-6e0e-450a-abd7-58d9727086d8 req-a47c9366-88a8-4b18-b290-4287e14f1db6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.914963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-916cbcff-6e0e-450a-abd7-58d9727086d8 req-a47c9366-88a8-4b18-b290-4287e14f1db6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.932268 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-916cbcff-6e0e-450a-abd7-58d9727086d8 req-a47c9366-88a8-4b18-b290-4287e14f1db6 service nova] Creating event network-vif-deleted:947993be-24ef-475e-849e-3c1c6013f41e for instance 8828de2f-4984-4159-b2b0-d2098074e6ee on n-h2-760456-11 Jul 20 04:34:48.939012 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-916cbcff-6e0e-450a-abd7-58d9727086d8 req-a47c9366-88a8-4b18-b290-4287e14f1db6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060740 Jul 20 04:34:48.939984 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2411/4831] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:49.046690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-58c3c140-daba-42e6-9b29-eb9371bb0002 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:49.061181 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-58c3c140-daba-42e6-9b29-eb9371bb0002 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1665 microversion: 2.1 time: 0.775123 Jul 20 04:34:49.072187 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2421/4832] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:48 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1665 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:49.473948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-306ea5a4-aaba-4640-9fdd-18fb90694be2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:49.476694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-306ea5a4-aaba-4640-9fdd-18fb90694be2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:49.485357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-306ea5a4-aaba-4640-9fdd-18fb90694be2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.486299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-306ea5a4-aaba-4640-9fdd-18fb90694be2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.487563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-306ea5a4-aaba-4640-9fdd-18fb90694be2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.488270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-306ea5a4-aaba-4640-9fdd-18fb90694be2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.823157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-306ea5a4-aaba-4640-9fdd-18fb90694be2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:49.833376 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-306ea5a4-aaba-4640-9fdd-18fb90694be2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1213 microversion: 2.1 time: 0.368362 Jul 20 04:34:49.834961 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2412/4833] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:49 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1213 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:49.884627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e3da015-53b3-4e54-82e5-54b14b611f2b tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:49.885522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e3da015-53b3-4e54-82e5-54b14b611f2b tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: 8828de2f-4984-4159-b2b0-d2098074e6ee] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:49.901240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e3da015-53b3-4e54-82e5-54b14b611f2b tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.901824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e3da015-53b3-4e54-82e5-54b14b611f2b tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.902705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e3da015-53b3-4e54-82e5-54b14b611f2b tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.903418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e3da015-53b3-4e54-82e5-54b14b611f2b tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.920645 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-2e3da015-53b3-4e54-82e5-54b14b611f2b tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] HTTP exception thrown: Instance 8828de2f-4984-4159-b2b0-d2098074e6ee could not be found. Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e3da015-53b3-4e54-82e5-54b14b611f2b tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Request method failure captured: Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee HTTP/1.1 Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VldUax7oB6ckE4SJHiLuO-5JoVsrJnFXNc0aPY8SzP8OeXdc8WZ06llJHYU_kiuNZ_AWNGqpuibEKaAof0dwZjOjS_VvR8JveONEzi5cyAdJfMtEpHsJZUj1N_8TQTfSuA5rrRDrhE7fyzNlRYDZKD1OPQ0Tlq69Byny-8IpPvNY8 Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 371a6852b8f441bfa719ab452a8c0d8a Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-714878438 Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/371a6852b8f441bfa719ab452a8c0d8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/371a6852b8f441bfa719ab452a8c0d8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/371a6852b8f441bfa719ab452a8c0d8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_371a6852b8f441bfa719ab452a8c0d8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestSecurityGroupsBasicOps-714878438 Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 371a6852b8f441bfa719ab452a8c0d8a Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-714878438 Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestSecurityGroupsBasicOps-714878438-project Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9c92ac6d960b4b76ac881b676a00744a Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestSecurityGroupsBasicOps-714878438-project Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 8828de2f-4984-4159-b2b0-d2098074e6ee could not be found. Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8828de2f-4984-4159-b2b0-d2098074e6ee'} Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8828de2f-4984-4159-b2b0-d2098074e6ee could not be found. Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8828de2f-4984-4159-b2b0-d2098074e6ee could not be found. Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:49.922125 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:49.926187 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:49.926187 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:49.926187 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:49.926187 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:49.926187 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:49.926187 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8828de2f-4984-4159-b2b0-d2098074e6ee could not be found. Jul 20 04:34:49.926187 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:34:49.928518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e3da015-53b3-4e54-82e5-54b14b611f2b tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Returning 404 to user: Instance 8828de2f-4984-4159-b2b0-d2098074e6ee could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:49.929607 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e3da015-53b3-4e54-82e5-54b14b611f2b tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee" status: 404 len: 111 microversion: 2.1 time: 0.049657 Jul 20 04:34:49.930767 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2422/4834] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:49 2022] GET /compute/v2.1/servers/8828de2f-4984-4159-b2b0-d2098074e6ee => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:50.084273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-10a81f6d-ce0a-4159-b068-1f326be50d2d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:50.086030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-10a81f6d-ce0a-4159-b068-1f326be50d2d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:50.103117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10a81f6d-ce0a-4159-b068-1f326be50d2d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.103953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10a81f6d-ce0a-4159-b068-1f326be50d2d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.105154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10a81f6d-ce0a-4159-b068-1f326be50d2d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.105853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10a81f6d-ce0a-4159-b068-1f326be50d2d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.652144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-10a81f6d-ce0a-4159-b068-1f326be50d2d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:50.667816 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-10a81f6d-ce0a-4159-b068-1f326be50d2d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.591046 Jul 20 04:34:50.679913 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2413/4835] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:50 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:50.687481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-785a8708-9124-4b0b-91cd-722cc3fa0361 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:50.689256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-785a8708-9124-4b0b-91cd-722cc3fa0361 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:50.697457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-785a8708-9124-4b0b-91cd-722cc3fa0361 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.698185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-785a8708-9124-4b0b-91cd-722cc3fa0361 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.699200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-785a8708-9124-4b0b-91cd-722cc3fa0361 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.699876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-785a8708-9124-4b0b-91cd-722cc3fa0361 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.852777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7a6b1908-3b6b-4a7f-81c8-07bbffab8ba7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:50.854001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7a6b1908-3b6b-4a7f-81c8-07bbffab8ba7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:50.863986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a6b1908-3b6b-4a7f-81c8-07bbffab8ba7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.864757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a6b1908-3b6b-4a7f-81c8-07bbffab8ba7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.865856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a6b1908-3b6b-4a7f-81c8-07bbffab8ba7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.867443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a6b1908-3b6b-4a7f-81c8-07bbffab8ba7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.899427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-785a8708-9124-4b0b-91cd-722cc3fa0361 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:50.924098 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-785a8708-9124-4b0b-91cd-722cc3fa0361 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.241057 Jul 20 04:34:50.924757 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2423/4836] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:50 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:50.946846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2c069fca-3959-4914-abd9-8a4771ad4b06 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:50.947114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2c069fca-3959-4914-abd9-8a4771ad4b06 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:50.964047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c069fca-3959-4914-abd9-8a4771ad4b06 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.964510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c069fca-3959-4914-abd9-8a4771ad4b06 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.965303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c069fca-3959-4914-abd9-8a4771ad4b06 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.965754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c069fca-3959-4914-abd9-8a4771ad4b06 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.050180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2c069fca-3959-4914-abd9-8a4771ad4b06 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Unlocking {{(pid=119605) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 20 04:34:51.072094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7a6b1908-3b6b-4a7f-81c8-07bbffab8ba7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:51.090238 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7a6b1908-3b6b-4a7f-81c8-07bbffab8ba7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1267 microversion: 2.1 time: 0.241879 Jul 20 04:34:51.092503 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2414/4837] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:50 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:51.139084 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2c069fca-3959-4914-abd9-8a4771ad4b06 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.198889 Jul 20 04:34:51.139817 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2424/4838] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:50 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:51.151229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8110264a-c5cb-4ab7-b2a2-9af766546f5d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:51.152183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8110264a-c5cb-4ab7-b2a2-9af766546f5d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:51.187772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8110264a-c5cb-4ab7-b2a2-9af766546f5d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.195323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8110264a-c5cb-4ab7-b2a2-9af766546f5d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.197239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8110264a-c5cb-4ab7-b2a2-9af766546f5d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.198721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8110264a-c5cb-4ab7-b2a2-9af766546f5d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.762667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8110264a-c5cb-4ab7-b2a2-9af766546f5d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:51.771402 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8110264a-c5cb-4ab7-b2a2-9af766546f5d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.624389 Jul 20 04:34:51.783906 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2415/4839] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:51 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:51.792812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-79c68ee4-f2b8-4b14-9b1d-1728ba1c95e4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:51.794681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-79c68ee4-f2b8-4b14-9b1d-1728ba1c95e4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:51.803444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79c68ee4-f2b8-4b14-9b1d-1728ba1c95e4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.804466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79c68ee4-f2b8-4b14-9b1d-1728ba1c95e4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.805471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79c68ee4-f2b8-4b14-9b1d-1728ba1c95e4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.806110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-79c68ee4-f2b8-4b14-9b1d-1728ba1c95e4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.097169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-79c68ee4-f2b8-4b14-9b1d-1728ba1c95e4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:52.109276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a3364ce5-d27e-4aca-9bd5-3b73ea9b02e9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:52.110338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a3364ce5-d27e-4aca-9bd5-3b73ea9b02e9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:52.120877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a3364ce5-d27e-4aca-9bd5-3b73ea9b02e9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.122281 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-79c68ee4-f2b8-4b14-9b1d-1728ba1c95e4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.336723 Jul 20 04:34:52.127365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a3364ce5-d27e-4aca-9bd5-3b73ea9b02e9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.128485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a3364ce5-d27e-4aca-9bd5-3b73ea9b02e9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.129111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a3364ce5-d27e-4aca-9bd5-3b73ea9b02e9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.135656 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2425/4840] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:51 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:52.144568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0e435323-829c-4773-9f7f-53096b093008 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:52.145924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0e435323-829c-4773-9f7f-53096b093008 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:52.152483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e435323-829c-4773-9f7f-53096b093008 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.153844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e435323-829c-4773-9f7f-53096b093008 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.154877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e435323-829c-4773-9f7f-53096b093008 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.155890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e435323-829c-4773-9f7f-53096b093008 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.383580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0e435323-829c-4773-9f7f-53096b093008 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:52.394281 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0e435323-829c-4773-9f7f-53096b093008 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.256516 Jul 20 04:34:52.395500 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2426/4841] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:52 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:52.411710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-39ef3021-bb10-4b28-b239-e0827467d284 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:52.412519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-39ef3021-bb10-4b28-b239-e0827467d284 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:52.425754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39ef3021-bb10-4b28-b239-e0827467d284 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.426550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39ef3021-bb10-4b28-b239-e0827467d284 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.427501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39ef3021-bb10-4b28-b239-e0827467d284 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.428094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39ef3021-bb10-4b28-b239-e0827467d284 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.532228 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-39ef3021-bb10-4b28-b239-e0827467d284 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.120148 Jul 20 04:34:52.535962 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2427/4842] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:52 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:34:52.545401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36ca24f9-834b-4264-8497-cb570bc7237b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:52.545978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-36ca24f9-834b-4264-8497-cb570bc7237b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:52.566933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36ca24f9-834b-4264-8497-cb570bc7237b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.567863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36ca24f9-834b-4264-8497-cb570bc7237b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.569341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36ca24f9-834b-4264-8497-cb570bc7237b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.570230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36ca24f9-834b-4264-8497-cb570bc7237b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.689449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a3364ce5-d27e-4aca-9bd5-3b73ea9b02e9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:52.699943 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a3364ce5-d27e-4aca-9bd5-3b73ea9b02e9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1267 microversion: 2.1 time: 0.594068 Jul 20 04:34:52.701121 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2416/4843] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:52 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1267 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:52.836526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-36ca24f9-834b-4264-8497-cb570bc7237b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:52.850013 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-36ca24f9-834b-4264-8497-cb570bc7237b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1674 microversion: 2.1 time: 0.312565 Jul 20 04:34:52.850650 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2428/4844] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:52 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1674 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:52.997342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ec740907-46cf-4a6f-9a65-56e17094b9f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:52.998023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ec740907-46cf-4a6f-9a65-56e17094b9f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:53.011704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec740907-46cf-4a6f-9a65-56e17094b9f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.012175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec740907-46cf-4a6f-9a65-56e17094b9f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.012986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec740907-46cf-4a6f-9a65-56e17094b9f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.013448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec740907-46cf-4a6f-9a65-56e17094b9f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.065895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c70c21b6-ba25-49e4-b9bc-f46fab267555 req-e526a989-f028-4f03-9690-a0019454cfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:53.095344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c70c21b6-ba25-49e4-b9bc-f46fab267555 req-e526a989-f028-4f03-9690-a0019454cfa7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.096081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c70c21b6-ba25-49e4-b9bc-f46fab267555 req-e526a989-f028-4f03-9690-a0019454cfa7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.156252 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c70c21b6-ba25-49e4-b9bc-f46fab267555 req-e526a989-f028-4f03-9690-a0019454cfa7 service nova] Creating event network-changed:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h1-760456-11 Jul 20 04:34:53.176257 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c70c21b6-ba25-49e4-b9bc-f46fab267555 req-e526a989-f028-4f03-9690-a0019454cfa7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115071 Jul 20 04:34:53.178219 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2429/4845] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:53.563704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ec740907-46cf-4a6f-9a65-56e17094b9f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:53.567740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:53.573350 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ec740907-46cf-4a6f-9a65-56e17094b9f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1563 microversion: 2.1 time: 0.580396 Jul 20 04:34:53.591874 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2417/4846] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:52 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1563 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:53.719133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b353ae4-333e-414f-be02-f38a07b79d2b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:53.720479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b353ae4-333e-414f-be02-f38a07b79d2b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:53.732853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b353ae4-333e-414f-be02-f38a07b79d2b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.733805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b353ae4-333e-414f-be02-f38a07b79d2b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.737043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b353ae4-333e-414f-be02-f38a07b79d2b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.737522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b353ae4-333e-414f-be02-f38a07b79d2b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.869198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-15f6e2c5-8408-42cd-8a46-0eed8e9af154 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:53.870078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-15f6e2c5-8408-42cd-8a46-0eed8e9af154 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:53.881053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f6e2c5-8408-42cd-8a46-0eed8e9af154 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.881749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f6e2c5-8408-42cd-8a46-0eed8e9af154 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.886927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f6e2c5-8408-42cd-8a46-0eed8e9af154 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.887607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f6e2c5-8408-42cd-8a46-0eed8e9af154 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.253405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-15f6e2c5-8408-42cd-8a46-0eed8e9af154 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.267585 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-15f6e2c5-8408-42cd-8a46-0eed8e9af154 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1654 microversion: 2.1 time: 0.401277 Jul 20 04:34:54.269985 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2418/4847] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:53 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1654 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:54.291764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d7a40ccc-7871-418a-bf52-127f457fc62a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:54.292593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d7a40ccc-7871-418a-bf52-127f457fc62a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:54.304825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7a40ccc-7871-418a-bf52-127f457fc62a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.307773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7a40ccc-7871-418a-bf52-127f457fc62a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.309084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7a40ccc-7871-418a-bf52-127f457fc62a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.312096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7a40ccc-7871-418a-bf52-127f457fc62a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.468544 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d7a40ccc-7871-418a-bf52-127f457fc62a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.183353 Jul 20 04:34:54.472083 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2419/4848] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:54 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:34:54.496426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7f87b0a-ca6f-4a32-800c-1c234f8ce166 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:54.497566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7f87b0a-ca6f-4a32-800c-1c234f8ce166 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:54.530638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7f87b0a-ca6f-4a32-800c-1c234f8ce166 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.531659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7f87b0a-ca6f-4a32-800c-1c234f8ce166 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.535683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7f87b0a-ca6f-4a32-800c-1c234f8ce166 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.537415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7f87b0a-ca6f-4a32-800c-1c234f8ce166 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:55.054168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e7f87b0a-ca6f-4a32-800c-1c234f8ce166 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:55.072802 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7f87b0a-ca6f-4a32-800c-1c234f8ce166 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1661 microversion: 2.1 time: 0.581715 Jul 20 04:34:55.083278 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2420/4849] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:54 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1661 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:55.184263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0b353ae4-333e-414f-be02-f38a07b79d2b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:55.199641 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b353ae4-333e-414f-be02-f38a07b79d2b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1309 microversion: 2.1 time: 1.485786 Jul 20 04:34:55.200836 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2430/4850] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:53 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1309 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:55.930181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e428ca3d-c6d2-4342-ae17-d012489950e1 req-4bd93939-94d3-43c3-9525-6f236eb534df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429983ee-b096-47a4-b048-cab7b4324849", "tag": "c0f99033-474a-4e23-ab9c-5781e73bde5c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:55.939721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e428ca3d-c6d2-4342-ae17-d012489950e1 req-4bd93939-94d3-43c3-9525-6f236eb534df service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:55.940164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e428ca3d-c6d2-4342-ae17-d012489950e1 req-4bd93939-94d3-43c3-9525-6f236eb534df service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:55.975959 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e428ca3d-c6d2-4342-ae17-d012489950e1 req-4bd93939-94d3-43c3-9525-6f236eb534df service nova] Creating event network-changed:c0f99033-474a-4e23-ab9c-5781e73bde5c for instance 429983ee-b096-47a4-b048-cab7b4324849 on n-h2-760456-11 Jul 20 04:34:55.984510 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e428ca3d-c6d2-4342-ae17-d012489950e1 req-4bd93939-94d3-43c3-9525-6f236eb534df service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058039 Jul 20 04:34:55.992520 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2421/4851] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:34:56.090760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f955383b-63bb-4b00-96bb-3929f5c93463 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:56.093412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f955383b-63bb-4b00-96bb-3929f5c93463 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:56.106087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f955383b-63bb-4b00-96bb-3929f5c93463 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.106920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f955383b-63bb-4b00-96bb-3929f5c93463 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.107435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f955383b-63bb-4b00-96bb-3929f5c93463 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.107875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f955383b-63bb-4b00-96bb-3929f5c93463 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.223048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2bda1dce-6b78-4714-8b3a-60d5bd5b2bea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:56.223808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2bda1dce-6b78-4714-8b3a-60d5bd5b2bea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:56.234067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bda1dce-6b78-4714-8b3a-60d5bd5b2bea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.234552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bda1dce-6b78-4714-8b3a-60d5bd5b2bea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.235548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bda1dce-6b78-4714-8b3a-60d5bd5b2bea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.236120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bda1dce-6b78-4714-8b3a-60d5bd5b2bea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.430942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f955383b-63bb-4b00-96bb-3929f5c93463 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:56.446971 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f955383b-63bb-4b00-96bb-3929f5c93463 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.360081 Jul 20 04:34:56.447909 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2431/4852] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:56 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:56.468465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-393e6d5e-5026-410b-aa19-307fd33d274c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:56.469083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-393e6d5e-5026-410b-aa19-307fd33d274c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:56.486240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-393e6d5e-5026-410b-aa19-307fd33d274c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.486718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-393e6d5e-5026-410b-aa19-307fd33d274c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.487515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-393e6d5e-5026-410b-aa19-307fd33d274c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.487945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-393e6d5e-5026-410b-aa19-307fd33d274c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.524728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:56.736982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-393e6d5e-5026-410b-aa19-307fd33d274c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:56.745684 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-393e6d5e-5026-410b-aa19-307fd33d274c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.281057 Jul 20 04:34:56.747505 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2432/4853] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:56 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:56.770590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fc0f1809-2da0-47d2-a2e4-84197a2d4aac tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:56.771255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fc0f1809-2da0-47d2-a2e4-84197a2d4aac tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:56.777738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc0f1809-2da0-47d2-a2e4-84197a2d4aac tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.778191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc0f1809-2da0-47d2-a2e4-84197a2d4aac tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.779008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc0f1809-2da0-47d2-a2e4-84197a2d4aac tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.779479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc0f1809-2da0-47d2-a2e4-84197a2d4aac tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.027360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2bda1dce-6b78-4714-8b3a-60d5bd5b2bea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.045785 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2bda1dce-6b78-4714-8b3a-60d5bd5b2bea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1309 microversion: 2.1 time: 0.831073 Jul 20 04:34:57.052388 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2422/4854] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:56 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1309 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:57.312432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fc0f1809-2da0-47d2-a2e4-84197a2d4aac tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.344803 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fc0f1809-2da0-47d2-a2e4-84197a2d4aac tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.581302 Jul 20 04:34:57.353082 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2433/4855] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:56 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:57.383545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1fa06ee-177f-44b1-ac36-15bc0dfe9bbb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:57.384820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1fa06ee-177f-44b1-ac36-15bc0dfe9bbb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:57.409685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1fa06ee-177f-44b1-ac36-15bc0dfe9bbb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.410344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1fa06ee-177f-44b1-ac36-15bc0dfe9bbb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.417658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1fa06ee-177f-44b1-ac36-15bc0dfe9bbb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.418735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1fa06ee-177f-44b1-ac36-15bc0dfe9bbb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.794455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a1fa06ee-177f-44b1-ac36-15bc0dfe9bbb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.831622 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1fa06ee-177f-44b1-ac36-15bc0dfe9bbb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.446389 Jul 20 04:34:57.854117 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2423/4856] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:57 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:57.887638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fa4fea27-0bee-44be-9196-634ced77324e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:57.888355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fa4fea27-0bee-44be-9196-634ced77324e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:57.933876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa4fea27-0bee-44be-9196-634ced77324e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.937697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa4fea27-0bee-44be-9196-634ced77324e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.941266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa4fea27-0bee-44be-9196-634ced77324e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.943124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fa4fea27-0bee-44be-9196-634ced77324e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.018953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:58.067159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:58.069811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1886958f-c3c4-4aed-a2af-05a6799c6c89 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:58.070636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1886958f-c3c4-4aed-a2af-05a6799c6c89 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:58.077839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1886958f-c3c4-4aed-a2af-05a6799c6c89 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.078928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1886958f-c3c4-4aed-a2af-05a6799c6c89 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.080791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1886958f-c3c4-4aed-a2af-05a6799c6c89 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.081481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1886958f-c3c4-4aed-a2af-05a6799c6c89 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.333402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1886958f-c3c4-4aed-a2af-05a6799c6c89 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.343106 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1886958f-c3c4-4aed-a2af-05a6799c6c89 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1309 microversion: 2.1 time: 0.275532 Jul 20 04:34:58.343989 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2424/4857] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:58 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:58.626802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fa4fea27-0bee-44be-9196-634ced77324e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.634550 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fa4fea27-0bee-44be-9196-634ced77324e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.754617 Jul 20 04:34:58.648509 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2434/4858] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:57 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:58.654381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b2c18ac3-2b14-4aaa-9559-7e15261ebbf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:58.655449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b2c18ac3-2b14-4aaa-9559-7e15261ebbf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:58.663907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:58.665469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2c18ac3-2b14-4aaa-9559-7e15261ebbf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.666097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2c18ac3-2b14-4aaa-9559-7e15261ebbf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.667142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2c18ac3-2b14-4aaa-9559-7e15261ebbf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:58.667671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2c18ac3-2b14-4aaa-9559-7e15261ebbf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:58.932324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b2c18ac3-2b14-4aaa-9559-7e15261ebbf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:58.946481 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b2c18ac3-2b14-4aaa-9559-7e15261ebbf2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.296247 Jul 20 04:34:58.949342 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2425/4859] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:58 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:59.361248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34ba6e46-3bfa-4839-bd44-f8d7667922f6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:59.362913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-34ba6e46-3bfa-4839-bd44-f8d7667922f6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:59.370322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34ba6e46-3bfa-4839-bd44-f8d7667922f6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.370862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34ba6e46-3bfa-4839-bd44-f8d7667922f6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.372406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34ba6e46-3bfa-4839-bd44-f8d7667922f6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.373133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34ba6e46-3bfa-4839-bd44-f8d7667922f6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.527149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-34ba6e46-3bfa-4839-bd44-f8d7667922f6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:59.536339 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-34ba6e46-3bfa-4839-bd44-f8d7667922f6 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1309 microversion: 2.1 time: 0.179139 Jul 20 04:34:59.536916 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2435/4860] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:59 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:00.553922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0b4114d-f085-4237-8ced-b62357ce63a4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.554581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d0b4114d-f085-4237-8ced-b62357ce63a4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.574020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0b4114d-f085-4237-8ced-b62357ce63a4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.574515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0b4114d-f085-4237-8ced-b62357ce63a4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.575310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0b4114d-f085-4237-8ced-b62357ce63a4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.575763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0b4114d-f085-4237-8ced-b62357ce63a4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.928314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d0b4114d-f085-4237-8ced-b62357ce63a4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:00.941581 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d0b4114d-f085-4237-8ced-b62357ce63a4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1309 microversion: 2.1 time: 0.390612 Jul 20 04:35:00.957781 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2426/4861] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:00 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1309 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:01.066555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba5c0f67-937f-47f4-a9a7-8326b79ea2ba tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:01.067109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ba5c0f67-937f-47f4-a9a7-8326b79ea2ba tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:01.070948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e8a9213d-890a-4c49-8052-faed64307a99 req-5a2febcd-44c3-4f91-bca4-09cbac16ab8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85bd8d6-2ced-4348-8d60-1a511efe1dbf", "tag": "4855b0c7-7ed8-4f67-a524-a68644b35601"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:01.081352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba5c0f67-937f-47f4-a9a7-8326b79ea2ba tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.082113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e8a9213d-890a-4c49-8052-faed64307a99 req-5a2febcd-44c3-4f91-bca4-09cbac16ab8c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.082679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e8a9213d-890a-4c49-8052-faed64307a99 req-5a2febcd-44c3-4f91-bca4-09cbac16ab8c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.082954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba5c0f67-937f-47f4-a9a7-8326b79ea2ba tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.084970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba5c0f67-937f-47f4-a9a7-8326b79ea2ba tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.085455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba5c0f67-937f-47f4-a9a7-8326b79ea2ba tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.098046 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e8a9213d-890a-4c49-8052-faed64307a99 req-5a2febcd-44c3-4f91-bca4-09cbac16ab8c service nova] Creating event network-changed:4855b0c7-7ed8-4f67-a524-a68644b35601 for instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf on n-h1-760456-11 Jul 20 04:35:01.104513 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e8a9213d-890a-4c49-8052-faed64307a99 req-5a2febcd-44c3-4f91-bca4-09cbac16ab8c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038101 Jul 20 04:35:01.112906 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2427/4862] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:35:01.140708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ba5c0f67-937f-47f4-a9a7-8326b79ea2ba tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:01.254483 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ba5c0f67-937f-47f4-a9a7-8326b79ea2ba tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 204 len: 0 microversion: 2.1 time: 0.192893 Jul 20 04:35:01.259561 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2436/4863] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:01 2022] DELETE /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:01.265931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1e2a3de3-add4-4337-a228-46a0eddc20d2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:01.267494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1e2a3de3-add4-4337-a228-46a0eddc20d2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:01.275012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e2a3de3-add4-4337-a228-46a0eddc20d2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.275732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e2a3de3-add4-4337-a228-46a0eddc20d2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.277095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e2a3de3-add4-4337-a228-46a0eddc20d2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.277729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e2a3de3-add4-4337-a228-46a0eddc20d2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.528476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1e2a3de3-add4-4337-a228-46a0eddc20d2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:01.540192 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1e2a3de3-add4-4337-a228-46a0eddc20d2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1768 microversion: 2.1 time: 0.278645 Jul 20 04:35:01.551465 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2428/4864] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:01 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1768 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:01.963973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bc579d18-7fa1-4015-844f-928ac6667ab9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:01.965268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bc579d18-7fa1-4015-844f-928ac6667ab9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:01.974166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc579d18-7fa1-4015-844f-928ac6667ab9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.975023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc579d18-7fa1-4015-844f-928ac6667ab9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.976058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc579d18-7fa1-4015-844f-928ac6667ab9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.976725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc579d18-7fa1-4015-844f-928ac6667ab9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.518406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-11ee0e0d-d148-4835-b463-3e6eb01fc810 req-f6e0c71d-17f3-418e-bcd4-739282c7e216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429983ee-b096-47a4-b048-cab7b4324849", "name": "network-vif-plugged", "status": "completed", "tag": "c0f99033-474a-4e23-ab9c-5781e73bde5c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:02.539579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-11ee0e0d-d148-4835-b463-3e6eb01fc810 req-f6e0c71d-17f3-418e-bcd4-739282c7e216 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.540357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-11ee0e0d-d148-4835-b463-3e6eb01fc810 req-f6e0c71d-17f3-418e-bcd4-739282c7e216 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.569367 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-11ee0e0d-d148-4835-b463-3e6eb01fc810 req-f6e0c71d-17f3-418e-bcd4-739282c7e216 service nova] Creating event network-vif-plugged:c0f99033-474a-4e23-ab9c-5781e73bde5c for instance 429983ee-b096-47a4-b048-cab7b4324849 on n-h2-760456-11 Jul 20 04:35:02.582373 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-11ee0e0d-d148-4835-b463-3e6eb01fc810 req-f6e0c71d-17f3-418e-bcd4-739282c7e216 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068892 Jul 20 04:35:02.588621 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2429/4865] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:02.595895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1f24a748-4b6f-4496-9019-e121d6b0c296 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:02.603008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1f24a748-4b6f-4496-9019-e121d6b0c296 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:02.627205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f24a748-4b6f-4496-9019-e121d6b0c296 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.628031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f24a748-4b6f-4496-9019-e121d6b0c296 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.629084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f24a748-4b6f-4496-9019-e121d6b0c296 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.629754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f24a748-4b6f-4496-9019-e121d6b0c296 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.012308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc579d18-7fa1-4015-844f-928ac6667ab9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:03.027396 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bc579d18-7fa1-4015-844f-928ac6667ab9 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1309 microversion: 2.1 time: 1.070322 Jul 20 04:35:03.030743 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2437/4866] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:01 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1309 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:03.088621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1f24a748-4b6f-4496-9019-e121d6b0c296 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:03.102430 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1f24a748-4b6f-4496-9019-e121d6b0c296 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1768 microversion: 2.1 time: 0.512224 Jul 20 04:35:03.103192 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2430/4867] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:02 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1768 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:03.617906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a46555cf-c22b-4bc1-9436-8969aa92159f req-ecd345b3-f5f2-4114-952c-efe9a61b9e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85bd8d6-2ced-4348-8d60-1a511efe1dbf", "name": "network-vif-deleted", "tag": "4855b0c7-7ed8-4f67-a524-a68644b35601"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:03.633784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a46555cf-c22b-4bc1-9436-8969aa92159f req-ecd345b3-f5f2-4114-952c-efe9a61b9e0e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.635227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a46555cf-c22b-4bc1-9436-8969aa92159f req-ecd345b3-f5f2-4114-952c-efe9a61b9e0e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.656544 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a46555cf-c22b-4bc1-9436-8969aa92159f req-ecd345b3-f5f2-4114-952c-efe9a61b9e0e service nova] Creating event network-vif-deleted:4855b0c7-7ed8-4f67-a524-a68644b35601 for instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf on n-h1-760456-11 Jul 20 04:35:03.663187 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a46555cf-c22b-4bc1-9436-8969aa92159f req-ecd345b3-f5f2-4114-952c-efe9a61b9e0e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054554 Jul 20 04:35:03.664345 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2438/4868] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:04.051149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8857cada-078c-4aec-8a48-c7a546a27a3b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:04.053581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8857cada-078c-4aec-8a48-c7a546a27a3b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:04.078841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8857cada-078c-4aec-8a48-c7a546a27a3b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.080302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8857cada-078c-4aec-8a48-c7a546a27a3b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.085706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8857cada-078c-4aec-8a48-c7a546a27a3b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.087580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8857cada-078c-4aec-8a48-c7a546a27a3b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.136200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:04.139838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:04.164227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.165729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.167223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.170911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.291116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.291959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.293646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lazy-loading 'fault' on Instance uuid d85bd8d6-2ced-4348-8d60-1a511efe1dbf {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:04.366149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c92ac6d960b4b76ac881b676a00744a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371a6852b8f441bfa719ab452a8c0d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:04.378886 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-09cae8ed-0d16-41c7-9abe-1c897ff29ab2 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 200 len: 1534 microversion: 2.1 time: 0.261601 Jul 20 04:35:04.380073 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2439/4869] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:04 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 1534 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:04.410344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8857cada-078c-4aec-8a48-c7a546a27a3b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:04.419741 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8857cada-078c-4aec-8a48-c7a546a27a3b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1309 microversion: 2.1 time: 0.375252 Jul 20 04:35:04.420419 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2431/4870] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:04 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1309 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:05.398080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-172c6f93-8126-413a-8edf-8e91c5200124 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:05.405309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-172c6f93-8126-413a-8edf-8e91c5200124 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] [instance: d85bd8d6-2ced-4348-8d60-1a511efe1dbf] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:05.417055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-172c6f93-8126-413a-8edf-8e91c5200124 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.417850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-172c6f93-8126-413a-8edf-8e91c5200124 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.419056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-172c6f93-8126-413a-8edf-8e91c5200124 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.419672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-172c6f93-8126-413a-8edf-8e91c5200124 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.444932 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-172c6f93-8126-413a-8edf-8e91c5200124 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] HTTP exception thrown: Instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf could not be found. Jul 20 04:35:05.445626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-465f113f-5c5c-4d33-9fda-6b9c0fd45b8a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-172c6f93-8126-413a-8edf-8e91c5200124 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Request method failure captured: Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf HTTP/1.1 Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VldUax7oB6ckE4SJHiLuO-5JoVsrJnFXNc0aPY8SzP8OeXdc8WZ06llJHYU_kiuNZ_AWNGqpuibEKaAof0dwZjOjS_VvR8JveONEzi5cyAdJfMtEpHsJZUj1N_8TQTfSuA5rrRDrhE7fyzNlRYDZKD1OPQ0Tlq69Byny-8IpPvNY8 Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 371a6852b8f441bfa719ab452a8c0d8a Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-714878438 Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/371a6852b8f441bfa719ab452a8c0d8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/371a6852b8f441bfa719ab452a8c0d8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/371a6852b8f441bfa719ab452a8c0d8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_371a6852b8f441bfa719ab452a8c0d8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestSecurityGroupsBasicOps-714878438 Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 371a6852b8f441bfa719ab452a8c0d8a Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-714878438 Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestSecurityGroupsBasicOps-714878438-project Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 9c92ac6d960b4b76ac881b676a00744a Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestSecurityGroupsBasicOps-714878438-project Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf could not be found. Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'd85bd8d6-2ced-4348-8d60-1a511efe1dbf'} Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf could not be found. Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf could not be found. Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:05.447521 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:05.451181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:05.451181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:05.451181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:05.451181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:05.451181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:05.451181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf could not be found. Jul 20 04:35:05.451181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:05.451777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-465f113f-5c5c-4d33-9fda-6b9c0fd45b8a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:05.452557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-172c6f93-8126-413a-8edf-8e91c5200124 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Returning 404 to user: Instance d85bd8d6-2ced-4348-8d60-1a511efe1dbf could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:05.458507 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-172c6f93-8126-413a-8edf-8e91c5200124 tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf" status: 404 len: 111 microversion: 2.1 time: 0.060070 Jul 20 04:35:05.458507 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2440/4871] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:05 2022] GET /compute/v2.1/servers/d85bd8d6-2ced-4348-8d60-1a511efe1dbf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:05.467041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-465f113f-5c5c-4d33-9fda-6b9c0fd45b8a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.467511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-465f113f-5c5c-4d33-9fda-6b9c0fd45b8a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.468313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-465f113f-5c5c-4d33-9fda-6b9c0fd45b8a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.468767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-465f113f-5c5c-4d33-9fda-6b9c0fd45b8a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.792667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-465f113f-5c5c-4d33-9fda-6b9c0fd45b8a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:05.812373 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-465f113f-5c5c-4d33-9fda-6b9c0fd45b8a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1490 microversion: 2.1 time: 0.378356 Jul 20 04:35:05.814728 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2432/4872] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:05 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1490 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:05.831074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a480a0cd-5ada-4d0f-a2a8-32f095789fda tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:05.832276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a480a0cd-5ada-4d0f-a2a8-32f095789fda tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:05.839616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a480a0cd-5ada-4d0f-a2a8-32f095789fda tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.840356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a480a0cd-5ada-4d0f-a2a8-32f095789fda tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.841716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a480a0cd-5ada-4d0f-a2a8-32f095789fda tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.842673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a480a0cd-5ada-4d0f-a2a8-32f095789fda tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.929736 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a480a0cd-5ada-4d0f-a2a8-32f095789fda tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "PUT /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1085 microversion: 2.1 time: 0.102671 Jul 20 04:35:05.930850 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2441/4873] 10.222.0.59 () {60 vars in 1255 bytes} [Wed Jul 20 04:35:05 2022] PUT /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1085 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:05.946589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-03012317-ec36-4b7a-bb2f-b9a00358a3b4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:05.947797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-03012317-ec36-4b7a-bb2f-b9a00358a3b4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:05.956588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03012317-ec36-4b7a-bb2f-b9a00358a3b4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.958646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03012317-ec36-4b7a-bb2f-b9a00358a3b4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.959708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03012317-ec36-4b7a-bb2f-b9a00358a3b4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.960326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03012317-ec36-4b7a-bb2f-b9a00358a3b4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.409217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-03012317-ec36-4b7a-bb2f-b9a00358a3b4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:06.420190 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-03012317-ec36-4b7a-bb2f-b9a00358a3b4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1511 microversion: 2.1 time: 0.479329 Jul 20 04:35:06.433728 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2433/4874] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:05 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1511 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:06.437281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd006075-27c3-48c8-ae49-5ed344c64339 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:06.438443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd006075-27c3-48c8-ae49-5ed344c64339 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:06.445955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd006075-27c3-48c8-ae49-5ed344c64339 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.446441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd006075-27c3-48c8-ae49-5ed344c64339 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.447404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd006075-27c3-48c8-ae49-5ed344c64339 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.447997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd006075-27c3-48c8-ae49-5ed344c64339 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.678817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd006075-27c3-48c8-ae49-5ed344c64339 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:06.689999 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd006075-27c3-48c8-ae49-5ed344c64339 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1511 microversion: 2.1 time: 0.256111 Jul 20 04:35:06.705850 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2442/4875] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:06 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:06.714442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da80bfa8-74d1-4c49-bcca-655f8b0ba583 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:06.714995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-da80bfa8-74d1-4c49-bcca-655f8b0ba583 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:06.722227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da80bfa8-74d1-4c49-bcca-655f8b0ba583 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.722940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da80bfa8-74d1-4c49-bcca-655f8b0ba583 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.723900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da80bfa8-74d1-4c49-bcca-655f8b0ba583 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.724494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da80bfa8-74d1-4c49-bcca-655f8b0ba583 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.753653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-da80bfa8-74d1-4c49-bcca-655f8b0ba583 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:06.790208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:06.842126 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-da80bfa8-74d1-4c49-bcca-655f8b0ba583 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 204 len: 0 microversion: 2.1 time: 0.130598 Jul 20 04:35:06.843487 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2434/4876] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:06 2022] DELETE /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:06.853803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0a0987a-576d-400d-9116-a6ee336e300b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:06.854850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0a0987a-576d-400d-9116-a6ee336e300b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:06.863690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0a0987a-576d-400d-9116-a6ee336e300b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.864577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0a0987a-576d-400d-9116-a6ee336e300b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.865651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0a0987a-576d-400d-9116-a6ee336e300b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.866294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0a0987a-576d-400d-9116-a6ee336e300b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:07.241930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c0a0987a-576d-400d-9116-a6ee336e300b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:07.254126 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0a0987a-576d-400d-9116-a6ee336e300b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1517 microversion: 2.1 time: 0.406185 Jul 20 04:35:07.254746 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2443/4877] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:06 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1517 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:08.272953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-255a8b54-9075-4482-8579-17b96ddde51c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:08.274227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-255a8b54-9075-4482-8579-17b96ddde51c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:08.286725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-255a8b54-9075-4482-8579-17b96ddde51c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.287422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-255a8b54-9075-4482-8579-17b96ddde51c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.295279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-255a8b54-9075-4482-8579-17b96ddde51c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.296105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-255a8b54-9075-4482-8579-17b96ddde51c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.585000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-255a8b54-9075-4482-8579-17b96ddde51c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:08.593660 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-255a8b54-9075-4482-8579-17b96ddde51c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1517 microversion: 2.1 time: 0.326436 Jul 20 04:35:08.598952 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2435/4878] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:08 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1517 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:09.145142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-19add520-7e22-4430-a76d-455115fdf1cb req-6ea1acea-d155-459b-b5c9-dc3bbc30c1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429983ee-b096-47a4-b048-cab7b4324849", "name": "network-vif-deleted", "tag": "c0f99033-474a-4e23-ab9c-5781e73bde5c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:09.166860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-19add520-7e22-4430-a76d-455115fdf1cb req-6ea1acea-d155-459b-b5c9-dc3bbc30c1ed service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.167375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-19add520-7e22-4430-a76d-455115fdf1cb req-6ea1acea-d155-459b-b5c9-dc3bbc30c1ed service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.199374 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-19add520-7e22-4430-a76d-455115fdf1cb req-6ea1acea-d155-459b-b5c9-dc3bbc30c1ed service nova] Creating event network-vif-deleted:c0f99033-474a-4e23-ab9c-5781e73bde5c for instance 429983ee-b096-47a4-b048-cab7b4324849 on n-h2-760456-11 Jul 20 04:35:09.205254 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-19add520-7e22-4430-a76d-455115fdf1cb req-6ea1acea-d155-459b-b5c9-dc3bbc30c1ed service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063768 Jul 20 04:35:09.206418 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2444/4879] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:09.616796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:09.618227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:09.637048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.637595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.638608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.639056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.685953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.686457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.687116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lazy-loading 'fault' on Instance uuid 429983ee-b096-47a4-b048-cab7b4324849 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:09.805436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:09.816625 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-64acdfe1-b18b-4562-81f6-c3c90821a65c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 200 len: 1320 microversion: 2.1 time: 0.203852 Jul 20 04:35:09.821681 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2436/4880] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:09 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:10.857613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16c2d413-0397-4d6e-bb88-2d9eaec69a8f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:10.859024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16c2d413-0397-4d6e-bb88-2d9eaec69a8f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:10.882344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16c2d413-0397-4d6e-bb88-2d9eaec69a8f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.885270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16c2d413-0397-4d6e-bb88-2d9eaec69a8f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.886435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16c2d413-0397-4d6e-bb88-2d9eaec69a8f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.887227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16c2d413-0397-4d6e-bb88-2d9eaec69a8f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.919400 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-16c2d413-0397-4d6e-bb88-2d9eaec69a8f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16c2d413-0397-4d6e-bb88-2d9eaec69a8f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 HTTP/1.1 Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '429983ee-b096-47a4-b048-cab7b4324849'} Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:10.921833 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:10.927663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:10.927663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:10.927663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:10.927663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:10.927663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:35:10.927663 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:10.930080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16c2d413-0397-4d6e-bb88-2d9eaec69a8f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:10.931233 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16c2d413-0397-4d6e-bb88-2d9eaec69a8f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 404 len: 111 microversion: 2.1 time: 0.096145 Jul 20 04:35:10.932332 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2445/4881] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:10 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:10.952640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b03a5a2-30ed-48f2-b072-1a72384b7b2d tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] Calling method '.version_select at 0x7fb842afa310>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:11.014498 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b03a5a2-30ed-48f2-b072-1a72384b7b2d tempest-TestSecurityGroupsBasicOps-714878438 tempest-TestSecurityGroupsBasicOps-714878438-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1916077816" status: 202 len: 0 microversion: 2.1 time: 0.065897 Jul 20 04:35:11.020350 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2437/4882] 10.222.0.59 () {58 vars in 1277 bytes} [Wed Jul 20 04:35:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1916077816 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:35:11.035274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-867378678", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "7b0934fb-ee96-446d-a65b-fee23ff74766"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:11.111142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] validate_networks() for [('7b0934fb-ee96-446d-a65b-fee23ff74766', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:35:12.309868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d2ffff59-22ca-41fb-923a-f461e7a99150 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:12.311703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d2ffff59-22ca-41fb-923a-f461e7a99150 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:12.318519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2ffff59-22ca-41fb-923a-f461e7a99150 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.321580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2ffff59-22ca-41fb-923a-f461e7a99150 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.322922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2ffff59-22ca-41fb-923a-f461e7a99150 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.323656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2ffff59-22ca-41fb-923a-f461e7a99150 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.390569 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d2ffff59-22ca-41fb-923a-f461e7a99150 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda/action" status: 200 len: 24567 microversion: 2.1 time: 0.087885 Jul 20 04:35:12.392119 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2438/4883] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:35:12 2022] POST /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda/action => generated 24567 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:35:12.537101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:35:12.538621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:35:12.539290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:35:12.539855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:35:12.540419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:35:12.550707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:12.566740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.567482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.578368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.580628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.630286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:12.639443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Getting quotas for user f224517836bf403a83da9e2e7f175907 and project df53fc243b9d475caab3cd428bf51d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:12.656392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:35:12.659701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:35:12.751330 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a2151fdb-c272-4b95-963f-c1bcbe5bc804 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.719294 Jul 20 04:35:12.753017 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2446/4884] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:35:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:35:12.767767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1f1eab02-f8bd-428f-b765-c739d8af4ec3 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:12.768488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1f1eab02-f8bd-428f-b765-c739d8af4ec3 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:12.904422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1f1eab02-f8bd-428f-b765-c739d8af4ec3 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:12.923364 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1f1eab02-f8bd-428f-b765-c739d8af4ec3 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1208 microversion: 2.1 time: 0.162486 Jul 20 04:35:12.934134 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2439/4885] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:12 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1208 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:13.941447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e75181c-b7f2-4b05-9ebe-6768811e313b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:13.942673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5e75181c-b7f2-4b05-9ebe-6768811e313b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:13.956025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e75181c-b7f2-4b05-9ebe-6768811e313b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.956835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e75181c-b7f2-4b05-9ebe-6768811e313b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.957782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e75181c-b7f2-4b05-9ebe-6768811e313b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.958458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e75181c-b7f2-4b05-9ebe-6768811e313b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:14.544908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5e75181c-b7f2-4b05-9ebe-6768811e313b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:14.559080 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5e75181c-b7f2-4b05-9ebe-6768811e313b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1260 microversion: 2.1 time: 0.618123 Jul 20 04:35:14.559815 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2447/4886] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:13 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1260 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:15.580490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e741f63-0cfe-4fa9-ad24-9f5f8d1f3872 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:15.581095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e741f63-0cfe-4fa9-ad24-9f5f8d1f3872 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:15.605525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e741f63-0cfe-4fa9-ad24-9f5f8d1f3872 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.605986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e741f63-0cfe-4fa9-ad24-9f5f8d1f3872 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:15.611958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e741f63-0cfe-4fa9-ad24-9f5f8d1f3872 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.612807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e741f63-0cfe-4fa9-ad24-9f5f8d1f3872 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.429089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e741f63-0cfe-4fa9-ad24-9f5f8d1f3872 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.440853 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e741f63-0cfe-4fa9-ad24-9f5f8d1f3872 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1308 microversion: 2.1 time: 0.867372 Jul 20 04:35:16.442043 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2440/4887] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:15 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1308 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:16.948592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a515e2f0-555f-4f4e-969d-762f0ffe08cc req-76669614-e8de-47c1-933d-70bf998c86aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5229e5-01ae-4896-b875-76928481b04d", "tag": "2f2a65b6-8e36-4bbf-aec8-a65e0ccc1ef5"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:16.982523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a515e2f0-555f-4f4e-969d-762f0ffe08cc req-76669614-e8de-47c1-933d-70bf998c86aa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.983153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a515e2f0-555f-4f4e-969d-762f0ffe08cc req-76669614-e8de-47c1-933d-70bf998c86aa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.007863 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a515e2f0-555f-4f4e-969d-762f0ffe08cc req-76669614-e8de-47c1-933d-70bf998c86aa service nova] Creating event network-changed:2f2a65b6-8e36-4bbf-aec8-a65e0ccc1ef5 for instance ad5229e5-01ae-4896-b875-76928481b04d on n-h2-760456-11 Jul 20 04:35:17.015555 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a515e2f0-555f-4f4e-969d-762f0ffe08cc req-76669614-e8de-47c1-933d-70bf998c86aa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070944 Jul 20 04:35:17.016192 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2448/4888] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:17.458903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-73063120-2116-424f-8344-30e127f3c286 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:17.460217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-73063120-2116-424f-8344-30e127f3c286 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:17.467561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73063120-2116-424f-8344-30e127f3c286 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.468348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73063120-2116-424f-8344-30e127f3c286 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.470076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73063120-2116-424f-8344-30e127f3c286 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.470784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73063120-2116-424f-8344-30e127f3c286 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.706068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-73063120-2116-424f-8344-30e127f3c286 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:17.723668 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-73063120-2116-424f-8344-30e127f3c286 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1308 microversion: 2.1 time: 0.262630 Jul 20 04:35:17.725020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2441/4889] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:17 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:18.744491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-534d037d-f41b-4311-8b1c-f572d39a4fed tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:18.745764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-534d037d-f41b-4311-8b1c-f572d39a4fed tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:18.762818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-534d037d-f41b-4311-8b1c-f572d39a4fed tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.767394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-534d037d-f41b-4311-8b1c-f572d39a4fed tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.768679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-534d037d-f41b-4311-8b1c-f572d39a4fed tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.769417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-534d037d-f41b-4311-8b1c-f572d39a4fed tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.073544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-534d037d-f41b-4311-8b1c-f572d39a4fed tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.087578 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-534d037d-f41b-4311-8b1c-f572d39a4fed tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1308 microversion: 2.1 time: 0.348702 Jul 20 04:35:19.089229 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2449/4890] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:18 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:20.105151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-476d5ada-5998-451e-8dce-d8a4bea94c83 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:20.106533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-476d5ada-5998-451e-8dce-d8a4bea94c83 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:20.116339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:20.127198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-476d5ada-5998-451e-8dce-d8a4bea94c83 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.128090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-476d5ada-5998-451e-8dce-d8a4bea94c83 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.131033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-476d5ada-5998-451e-8dce-d8a4bea94c83 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.131786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-476d5ada-5998-451e-8dce-d8a4bea94c83 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.463381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-476d5ada-5998-451e-8dce-d8a4bea94c83 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:20.477270 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-476d5ada-5998-451e-8dce-d8a4bea94c83 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1308 microversion: 2.1 time: 0.375999 Jul 20 04:35:20.478075 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2442/4891] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:20 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:21.498948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-367d984e-0c45-47bb-aaad-75babe49677a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:21.500196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-367d984e-0c45-47bb-aaad-75babe49677a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:21.509921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-367d984e-0c45-47bb-aaad-75babe49677a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.510631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-367d984e-0c45-47bb-aaad-75babe49677a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.511691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-367d984e-0c45-47bb-aaad-75babe49677a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.512632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-367d984e-0c45-47bb-aaad-75babe49677a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.543454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:21.882872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-367d984e-0c45-47bb-aaad-75babe49677a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:21.892886 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-367d984e-0c45-47bb-aaad-75babe49677a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1308 microversion: 2.1 time: 0.400782 Jul 20 04:35:21.903714 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2450/4892] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:21 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:22.254926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6dc0b252-0fc2-45dc-b375-29374cdc182c req-afda2c12-52f7-4b8f-bf43-2bfb78e3c27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5229e5-01ae-4896-b875-76928481b04d", "name": "network-vif-plugged", "status": "completed", "tag": "2f2a65b6-8e36-4bbf-aec8-a65e0ccc1ef5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:22.276740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6dc0b252-0fc2-45dc-b375-29374cdc182c req-afda2c12-52f7-4b8f-bf43-2bfb78e3c27d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.277366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6dc0b252-0fc2-45dc-b375-29374cdc182c req-afda2c12-52f7-4b8f-bf43-2bfb78e3c27d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.300850 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6dc0b252-0fc2-45dc-b375-29374cdc182c req-afda2c12-52f7-4b8f-bf43-2bfb78e3c27d service nova] Creating event network-vif-plugged:2f2a65b6-8e36-4bbf-aec8-a65e0ccc1ef5 for instance ad5229e5-01ae-4896-b875-76928481b04d on n-h2-760456-11 Jul 20 04:35:22.310902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6dc0b252-0fc2-45dc-b375-29374cdc182c req-afda2c12-52f7-4b8f-bf43-2bfb78e3c27d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060577 Jul 20 04:35:22.312002 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2443/4893] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:22.632425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-653e0856-7d6e-4717-abc6-80d89a8b8bc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.633851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-653e0856-7d6e-4717-abc6-80d89a8b8bc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.644104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:22.650463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:22.652935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-653e0856-7d6e-4717-abc6-80d89a8b8bc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.653914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-653e0856-7d6e-4717-abc6-80d89a8b8bc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.655231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-653e0856-7d6e-4717-abc6-80d89a8b8bc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.656491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-653e0856-7d6e-4717-abc6-80d89a8b8bc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.708311 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-653e0856-7d6e-4717-abc6-80d89a8b8bc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4/ips" status: 200 len: 150 microversion: 2.1 time: 0.089217 Jul 20 04:35:22.715962 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2451/4894] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:35:22 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4/ips => generated 150 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:22.725501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d05f38d9-4fd4-4aef-b7ea-018e1b80e1e3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:22.727330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d05f38d9-4fd4-4aef-b7ea-018e1b80e1e3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.738888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d05f38d9-4fd4-4aef-b7ea-018e1b80e1e3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.739523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d05f38d9-4fd4-4aef-b7ea-018e1b80e1e3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.740429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d05f38d9-4fd4-4aef-b7ea-018e1b80e1e3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.741616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d05f38d9-4fd4-4aef-b7ea-018e1b80e1e3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.886058 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d05f38d9-4fd4-4aef-b7ea-018e1b80e1e3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Invalid volume: volume 77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3 is already attached to instances: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d05f38d9-4fd4-4aef-b7ea-018e1b80e1e3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4/os-volume_attachments HTTP/1.1 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 74 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: {"volumeAttachment": {"volumeId": "77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3"}} Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid volume: volume 77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3 is already attached to instances: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'server_id': '1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4', 'body': {'volumeAttachment': {'volumeId': '77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3'}}} Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3 is already attached to instances: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:35:22.892233 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3 is already attached to instances: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3 is already attached to instances: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 Jul 20 04:35:22.896165 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.898283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d05f38d9-4fd4-4aef-b7ea-018e1b80e1e3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 400 to user: Invalid volume: volume 77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3 is already attached to instances: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:22.903327 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d05f38d9-4fd4-4aef-b7ea-018e1b80e1e3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.185301 Jul 20 04:35:22.908698 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2444/4895] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:35:22 2022] POST /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4/os-volume_attachments => generated 174 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:35:22.914089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ce6be21-540c-4b02-a052-47a75c2dad4c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.914734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bae95664-abb9-475c-8081-912473f6624c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.915172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8ce6be21-540c-4b02-a052-47a75c2dad4c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.915488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bae95664-abb9-475c-8081-912473f6624c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.927031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ce6be21-540c-4b02-a052-47a75c2dad4c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.928489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:22.929230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ce6be21-540c-4b02-a052-47a75c2dad4c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.930329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ce6be21-540c-4b02-a052-47a75c2dad4c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.932332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ce6be21-540c-4b02-a052-47a75c2dad4c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.941881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bae95664-abb9-475c-8081-912473f6624c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.941881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bae95664-abb9-475c-8081-912473f6624c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.943303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bae95664-abb9-475c-8081-912473f6624c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.944398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bae95664-abb9-475c-8081-912473f6624c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.026672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bae95664-abb9-475c-8081-912473f6624c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:23.226953 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bae95664-abb9-475c-8081-912473f6624c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 204 len: 0 microversion: 2.1 time: 0.316446 Jul 20 04:35:23.230054 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2445/4896] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:22 2022] DELETE /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:23.236866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-15f31b4d-0550-4dce-a6cd-e63be40fecc4 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:23.242991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-15f31b4d-0550-4dce-a6cd-e63be40fecc4 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:23.256695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f31b4d-0550-4dce-a6cd-e63be40fecc4 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.257258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f31b4d-0550-4dce-a6cd-e63be40fecc4 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.258166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f31b4d-0550-4dce-a6cd-e63be40fecc4 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.261908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15f31b4d-0550-4dce-a6cd-e63be40fecc4 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.483369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-15f31b4d-0550-4dce-a6cd-e63be40fecc4 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:23.497869 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-15f31b4d-0550-4dce-a6cd-e63be40fecc4 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1683 microversion: 2.1 time: 0.263346 Jul 20 04:35:23.503182 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2446/4897] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:23 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1683 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:23.509119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7765d90-b0e3-427c-a583-68a12628c2cd tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:23.509612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7765d90-b0e3-427c-a583-68a12628c2cd tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:23.517207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7765d90-b0e3-427c-a583-68a12628c2cd tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.517676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7765d90-b0e3-427c-a583-68a12628c2cd tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.518801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7765d90-b0e3-427c-a583-68a12628c2cd tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.519261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7765d90-b0e3-427c-a583-68a12628c2cd tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.728341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8ce6be21-540c-4b02-a052-47a75c2dad4c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:23.739496 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8ce6be21-540c-4b02-a052-47a75c2dad4c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1308 microversion: 2.1 time: 0.829236 Jul 20 04:35:23.751036 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2452/4898] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:22 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1308 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:24.293731 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7765d90-b0e3-427c-a583-68a12628c2cd tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1835 microversion: 2.1 time: 0.788836 Jul 20 04:35:24.296562 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2447/4899] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:23 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1835 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:24.314561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-98d684dc-b176-4b94-ba87-de22bdbab5b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:24.315343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-98d684dc-b176-4b94-ba87-de22bdbab5b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:24.327107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98d684dc-b176-4b94-ba87-de22bdbab5b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.328840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98d684dc-b176-4b94-ba87-de22bdbab5b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.331076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98d684dc-b176-4b94-ba87-de22bdbab5b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.335571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98d684dc-b176-4b94-ba87-de22bdbab5b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.520062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d42b2fe1-605c-4051-956f-b4db8ceb8834 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:24.520705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d42b2fe1-605c-4051-956f-b4db8ceb8834 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:24.532265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d42b2fe1-605c-4051-956f-b4db8ceb8834 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.533218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d42b2fe1-605c-4051-956f-b4db8ceb8834 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.535285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d42b2fe1-605c-4051-956f-b4db8ceb8834 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.536780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d42b2fe1-605c-4051-956f-b4db8ceb8834 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.721211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d42b2fe1-605c-4051-956f-b4db8ceb8834 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:24.730950 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d42b2fe1-605c-4051-956f-b4db8ceb8834 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1683 microversion: 2.1 time: 0.215064 Jul 20 04:35:24.737964 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2448/4900] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:24 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1683 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:24.757039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ffe303c2-002b-4697-84c2-45fe2ceb9d30 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:24.757623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ffe303c2-002b-4697-84c2-45fe2ceb9d30 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:24.764482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffe303c2-002b-4697-84c2-45fe2ceb9d30 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.764947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffe303c2-002b-4697-84c2-45fe2ceb9d30 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.766288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffe303c2-002b-4697-84c2-45fe2ceb9d30 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.766729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ffe303c2-002b-4697-84c2-45fe2ceb9d30 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.028242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ffe303c2-002b-4697-84c2-45fe2ceb9d30 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.047520 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ffe303c2-002b-4697-84c2-45fe2ceb9d30 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1490 microversion: 2.1 time: 0.290986 Jul 20 04:35:25.054417 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2449/4901] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:24 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1490 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:25.075888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7ce8ba86-62e7-4621-840a-888dbbbac480 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1052668397"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:25.077420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7ce8ba86-62e7-4621-840a-888dbbbac480 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:25.084781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ce8ba86-62e7-4621-840a-888dbbbac480 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.085474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ce8ba86-62e7-4621-840a-888dbbbac480 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.087669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ce8ba86-62e7-4621-840a-888dbbbac480 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.088283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ce8ba86-62e7-4621-840a-888dbbbac480 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.145656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-98d684dc-b176-4b94-ba87-de22bdbab5b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.155494 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-98d684dc-b176-4b94-ba87-de22bdbab5b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1682 microversion: 2.1 time: 0.847141 Jul 20 04:35:25.159088 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2453/4902] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:24 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1682 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:25.181180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:25.200185 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7ce8ba86-62e7-4621-840a-888dbbbac480 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "PUT /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1076 microversion: 2.1 time: 0.128548 Jul 20 04:35:25.216225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f24f89bc-1b09-4533-940b-7aba202dab9d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:25.217343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f24f89bc-1b09-4533-940b-7aba202dab9d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:25.221272 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2450/4903] 10.222.0.59 () {60 vars in 1255 bytes} [Wed Jul 20 04:35:25 2022] PUT /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1076 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:25.229906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f24f89bc-1b09-4533-940b-7aba202dab9d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.231653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f24f89bc-1b09-4533-940b-7aba202dab9d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.232481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f24f89bc-1b09-4533-940b-7aba202dab9d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.232945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f24f89bc-1b09-4533-940b-7aba202dab9d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.304875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0069c421-a20b-481b-a218-d9d3a2893ef1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:25.305814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0069c421-a20b-481b-a218-d9d3a2893ef1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:25.313028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0069c421-a20b-481b-a218-d9d3a2893ef1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.313734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0069c421-a20b-481b-a218-d9d3a2893ef1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.314756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0069c421-a20b-481b-a218-d9d3a2893ef1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.315362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0069c421-a20b-481b-a218-d9d3a2893ef1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.371254 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0069c421-a20b-481b-a218-d9d3a2893ef1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda/action" status: 200 len: 32636 microversion: 2.1 time: 0.070294 Jul 20 04:35:25.371929 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2451/4904] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:35:25 2022] POST /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda/action => generated 32636 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:35:25.522003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6a90990-221a-4e24-b3d0-f364e5462451 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:25.522935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6a90990-221a-4e24-b3d0-f364e5462451 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:25.560316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6a90990-221a-4e24-b3d0-f364e5462451 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.566508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6a90990-221a-4e24-b3d0-f364e5462451 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.567989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6a90990-221a-4e24-b3d0-f364e5462451 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.569711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6a90990-221a-4e24-b3d0-f364e5462451 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.652458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6a90990-221a-4e24-b3d0-f364e5462451 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0cda8f57395144619ff0d384bcc8c04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8270f3bb5234529875e0a8e5ec3771a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.653330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6a90990-221a-4e24-b3d0-f364e5462451 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] flavor_id is None. Assuming migration. {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:35:25.653966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6a90990-221a-4e24-b3d0-f364e5462451 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:35:25.660192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f24f89bc-1b09-4533-940b-7aba202dab9d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:25.674871 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f24f89bc-1b09-4533-940b-7aba202dab9d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1502 microversion: 2.1 time: 0.462232 Jul 20 04:35:25.679698 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2454/4905] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:25 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1502 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:25.697604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3a08062-807d-4c26-a023-a1e4185c238c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:25.698484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f3a08062-807d-4c26-a023-a1e4185c238c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:25.706027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3a08062-807d-4c26-a023-a1e4185c238c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.706732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3a08062-807d-4c26-a023-a1e4185c238c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.707702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3a08062-807d-4c26-a023-a1e4185c238c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.708294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3a08062-807d-4c26-a023-a1e4185c238c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.884927 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6a90990-221a-4e24-b3d0-f364e5462451 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda/action" status: 202 len: 0 microversion: 2.1 time: 0.366915 Jul 20 04:35:25.886193 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2452/4906] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:35:25 2022] POST /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:35:25.897115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d37d8b23-718e-49b5-b158-e48b2c43e042 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:25.897751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d37d8b23-718e-49b5-b158-e48b2c43e042 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:25.918387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d37d8b23-718e-49b5-b158-e48b2c43e042 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.919003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d37d8b23-718e-49b5-b158-e48b2c43e042 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.919804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d37d8b23-718e-49b5-b158-e48b2c43e042 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.920252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d37d8b23-718e-49b5-b158-e48b2c43e042 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.322143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d37d8b23-718e-49b5-b158-e48b2c43e042 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:26.332749 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d37d8b23-718e-49b5-b158-e48b2c43e042 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1683 microversion: 2.1 time: 0.443990 Jul 20 04:35:26.342833 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2453/4907] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:25 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1683 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:26.348286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5462e396-037e-4252-986c-3908a759fe38 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:26.349134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5462e396-037e-4252-986c-3908a759fe38 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:26.356552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5462e396-037e-4252-986c-3908a759fe38 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.357212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5462e396-037e-4252-986c-3908a759fe38 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.358174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5462e396-037e-4252-986c-3908a759fe38 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:26.358800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5462e396-037e-4252-986c-3908a759fe38 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:26.570530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5462e396-037e-4252-986c-3908a759fe38 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:26.586657 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5462e396-037e-4252-986c-3908a759fe38 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1691 microversion: 2.1 time: 0.242164 Jul 20 04:35:26.587317 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2454/4908] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:26 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:27.351012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-44343990-8c3e-4295-93bc-c780442d4fa8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:27.351647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-44343990-8c3e-4295-93bc-c780442d4fa8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:27.366405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44343990-8c3e-4295-93bc-c780442d4fa8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.367332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44343990-8c3e-4295-93bc-c780442d4fa8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.368299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44343990-8c3e-4295-93bc-c780442d4fa8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.368908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44343990-8c3e-4295-93bc-c780442d4fa8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.494868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-44343990-8c3e-4295-93bc-c780442d4fa8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:27.505119 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-44343990-8c3e-4295-93bc-c780442d4fa8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1615 microversion: 2.1 time: 0.158376 Jul 20 04:35:27.505704 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2455/4909] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:27 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1615 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:27.605734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d787a255-c6ee-43eb-99e1-cddd466dfe4c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:27.606362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d787a255-c6ee-43eb-99e1-cddd466dfe4c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:27.626386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d787a255-c6ee-43eb-99e1-cddd466dfe4c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.626862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d787a255-c6ee-43eb-99e1-cddd466dfe4c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.636763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d787a255-c6ee-43eb-99e1-cddd466dfe4c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.637375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d787a255-c6ee-43eb-99e1-cddd466dfe4c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.804209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f3a08062-807d-4c26-a023-a1e4185c238c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:27.839033 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f3a08062-807d-4c26-a023-a1e4185c238c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1502 microversion: 2.1 time: 2.145664 Jul 20 04:35:27.839638 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2455/4910] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:25 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1502 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:27.859569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ae28a04-654c-4c22-bfad-1169a8f85b63 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:27.892434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ae28a04-654c-4c22-bfad-1169a8f85b63 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.892918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ae28a04-654c-4c22-bfad-1169a8f85b63 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.998804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d787a255-c6ee-43eb-99e1-cddd466dfe4c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.007593 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d787a255-c6ee-43eb-99e1-cddd466dfe4c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1691 microversion: 2.1 time: 0.405764 Jul 20 04:35:28.017105 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2456/4911] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:27 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1691 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:28.049938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ae28a04-654c-4c22-bfad-1169a8f85b63 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Going to try to stop instance {{(pid=119605) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:35:28.221895 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ae28a04-654c-4c22-bfad-1169a8f85b63 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "POST /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d/action" status: 202 len: 0 microversion: 2.1 time: 0.364641 Jul 20 04:35:28.226385 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2456/4912] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:35:27 2022] POST /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:35:28.236849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5ef25d4e-94bd-4a3e-b0f3-26913e89b567 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:28.237752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5ef25d4e-94bd-4a3e-b0f3-26913e89b567 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:28.245591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ef25d4e-94bd-4a3e-b0f3-26913e89b567 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.246297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ef25d4e-94bd-4a3e-b0f3-26913e89b567 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.247106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ef25d4e-94bd-4a3e-b0f3-26913e89b567 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.247625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ef25d4e-94bd-4a3e-b0f3-26913e89b567 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.457978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5ef25d4e-94bd-4a3e-b0f3-26913e89b567 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.476468 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5ef25d4e-94bd-4a3e-b0f3-26913e89b567 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.245378 Jul 20 04:35:28.486287 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2457/4913] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:28 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:28.526320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2d99eb8-c0ad-4e1e-bb6a-70e2b3d89cb5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:28.527277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c2d99eb8-c0ad-4e1e-bb6a-70e2b3d89cb5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:28.538965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2d99eb8-c0ad-4e1e-bb6a-70e2b3d89cb5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.556262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2d99eb8-c0ad-4e1e-bb6a-70e2b3d89cb5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.557686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2d99eb8-c0ad-4e1e-bb6a-70e2b3d89cb5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.564936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2d99eb8-c0ad-4e1e-bb6a-70e2b3d89cb5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.787208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2d99eb8-c0ad-4e1e-bb6a-70e2b3d89cb5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.807131 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c2d99eb8-c0ad-4e1e-bb6a-70e2b3d89cb5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 200 len: 1615 microversion: 2.1 time: 0.286889 Jul 20 04:35:28.811009 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2457/4914] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:28 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 1615 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:28.817297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-175d5e34-fbd4-49f0-b49b-fc0a8c5fe96d req-bdfb10df-ad3c-4db9-85cd-4bd758e16b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4", "name": "network-vif-deleted", "tag": "93f589ec-140a-4193-b51f-d3e3db3a4102"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:28.838737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-175d5e34-fbd4-49f0-b49b-fc0a8c5fe96d req-bdfb10df-ad3c-4db9-85cd-4bd758e16b59 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.839201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-175d5e34-fbd4-49f0-b49b-fc0a8c5fe96d req-bdfb10df-ad3c-4db9-85cd-4bd758e16b59 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.904717 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-175d5e34-fbd4-49f0-b49b-fc0a8c5fe96d req-bdfb10df-ad3c-4db9-85cd-4bd758e16b59 service nova] Creating event network-vif-deleted:93f589ec-140a-4193-b51f-d3e3db3a4102 for instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 on n-h1-760456-11 Jul 20 04:35:28.931150 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-175d5e34-fbd4-49f0-b49b-fc0a8c5fe96d req-bdfb10df-ad3c-4db9-85cd-4bd758e16b59 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116993 Jul 20 04:35:28.932946 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2458/4915] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:35:29.034825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7c9ecdbe-413c-4dde-bf68-ae7ceff950b4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:29.035918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7c9ecdbe-413c-4dde-bf68-ae7ceff950b4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:29.067536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c9ecdbe-413c-4dde-bf68-ae7ceff950b4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.068021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c9ecdbe-413c-4dde-bf68-ae7ceff950b4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.068854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c9ecdbe-413c-4dde-bf68-ae7ceff950b4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.069310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c9ecdbe-413c-4dde-bf68-ae7ceff950b4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.500080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e4159015-455d-4643-8b2b-8635d53ea694 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:29.500780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e4159015-455d-4643-8b2b-8635d53ea694 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:29.516087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7c9ecdbe-413c-4dde-bf68-ae7ceff950b4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:29.521532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4159015-455d-4643-8b2b-8635d53ea694 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.522002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4159015-455d-4643-8b2b-8635d53ea694 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.522821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4159015-455d-4643-8b2b-8635d53ea694 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.523266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4159015-455d-4643-8b2b-8635d53ea694 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.531964 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7c9ecdbe-413c-4dde-bf68-ae7ceff950b4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1691 microversion: 2.1 time: 0.502457 Jul 20 04:35:29.540667 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2458/4916] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:29 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1691 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:29.828511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26ca10b2-0091-454a-a00f-3d770549b3b9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:29.829380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-26ca10b2-0091-454a-a00f-3d770549b3b9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:29.850829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26ca10b2-0091-454a-a00f-3d770549b3b9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.855143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26ca10b2-0091-454a-a00f-3d770549b3b9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.858164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26ca10b2-0091-454a-a00f-3d770549b3b9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.862552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-26ca10b2-0091-454a-a00f-3d770549b3b9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.899720 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-26ca10b2-0091-454a-a00f-3d770549b3b9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26ca10b2-0091-454a-a00f-3d770549b3b9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 HTTP/1.1 Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4'} Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:29.903394 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.907966 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:29.907966 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:29.907966 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:29.907966 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:29.907966 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:29.907966 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:35:29.907966 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.907966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-26ca10b2-0091-454a-a00f-3d770549b3b9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:29.911571 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-26ca10b2-0091-454a-a00f-3d770549b3b9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 404 len: 111 microversion: 2.1 time: 0.084887 Jul 20 04:35:29.916609 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2459/4917] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:29 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:35:29.924731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dd1abbe4-887d-44de-8f22-f7c5329ae751 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '.version_select at 0x7fb8411d71f0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:29.976705 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dd1abbe4-887d-44de-8f22-f7c5329ae751 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1972091813" status: 202 len: 0 microversion: 2.1 time: 0.058244 Jul 20 04:35:29.977853 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2460/4918] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:35:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1972091813 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:35:30.428909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e4159015-455d-4643-8b2b-8635d53ea694 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:30.437652 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e4159015-455d-4643-8b2b-8635d53ea694 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.942352 Jul 20 04:35:30.445123 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2459/4919] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:29 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:30.557008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2314a805-e613-473d-8ae6-24e68d24e9a0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:30.557762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2314a805-e613-473d-8ae6-24e68d24e9a0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:30.567430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2314a805-e613-473d-8ae6-24e68d24e9a0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:30.575188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2314a805-e613-473d-8ae6-24e68d24e9a0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:30.576592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2314a805-e613-473d-8ae6-24e68d24e9a0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:30.577319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2314a805-e613-473d-8ae6-24e68d24e9a0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:30.852359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2314a805-e613-473d-8ae6-24e68d24e9a0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:30.866934 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2314a805-e613-473d-8ae6-24e68d24e9a0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1691 microversion: 2.1 time: 0.313781 Jul 20 04:35:30.867531 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2461/4920] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:30 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1691 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:31.217912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a823d03-c37b-40fe-9b54-3631ae483b6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:31.219735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6a823d03-c37b-40fe-9b54-3631ae483b6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:31.245483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a823d03-c37b-40fe-9b54-3631ae483b6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.245985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a823d03-c37b-40fe-9b54-3631ae483b6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.255337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a823d03-c37b-40fe-9b54-3631ae483b6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.256767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a823d03-c37b-40fe-9b54-3631ae483b6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.360766 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6a823d03-c37b-40fe-9b54-3631ae483b6e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.148316 Jul 20 04:35:31.361446 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2460/4921] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:35:31 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:35:31.376693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2007f1dc-fc9b-4d61-a660-e740d57320b4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:31.378766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2007f1dc-fc9b-4d61-a660-e740d57320b4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:31.393459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2007f1dc-fc9b-4d61-a660-e740d57320b4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.393932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2007f1dc-fc9b-4d61-a660-e740d57320b4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.394840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2007f1dc-fc9b-4d61-a660-e740d57320b4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.397906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2007f1dc-fc9b-4d61-a660-e740d57320b4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.475307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31631aaa-3b18-4f43-9b53-6ef71e5c2413 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:31.476020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31631aaa-3b18-4f43-9b53-6ef71e5c2413 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:31.496271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31631aaa-3b18-4f43-9b53-6ef71e5c2413 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.497039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31631aaa-3b18-4f43-9b53-6ef71e5c2413 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.498034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31631aaa-3b18-4f43-9b53-6ef71e5c2413 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.498727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31631aaa-3b18-4f43-9b53-6ef71e5c2413 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.600285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2007f1dc-fc9b-4d61-a660-e740d57320b4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:31.619462 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2007f1dc-fc9b-4d61-a660-e740d57320b4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1671 microversion: 2.1 time: 0.253139 Jul 20 04:35:31.621298 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2462/4922] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:31 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1671 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:31.885656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec59801b-3c4a-431c-95cd-e39b3f92240d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:31.887558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ec59801b-3c4a-431c-95cd-e39b3f92240d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:31.896798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec59801b-3c4a-431c-95cd-e39b3f92240d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.897512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec59801b-3c4a-431c-95cd-e39b3f92240d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.899436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec59801b-3c4a-431c-95cd-e39b3f92240d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.900641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec59801b-3c4a-431c-95cd-e39b3f92240d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.996823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31631aaa-3b18-4f43-9b53-6ef71e5c2413 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:32.013478 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31631aaa-3b18-4f43-9b53-6ef71e5c2413 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.545707 Jul 20 04:35:32.016336 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2461/4923] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:31 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:32.118949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ec59801b-3c4a-431c-95cd-e39b3f92240d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:32.145163 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec59801b-3c4a-431c-95cd-e39b3f92240d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1696 microversion: 2.1 time: 0.257518 Jul 20 04:35:32.146129 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2463/4924] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:31 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1696 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:32.639769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c63c9fad-6433-418b-a65a-efd8b5430411 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:32.641963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c63c9fad-6433-418b-a65a-efd8b5430411 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:32.652708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c63c9fad-6433-418b-a65a-efd8b5430411 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:32.653520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c63c9fad-6433-418b-a65a-efd8b5430411 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:32.654851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c63c9fad-6433-418b-a65a-efd8b5430411 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:32.655549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c63c9fad-6433-418b-a65a-efd8b5430411 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:32.980956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d670facc-3590-4ab3-9545-44e46b17253b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:32.981507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d670facc-3590-4ab3-9545-44e46b17253b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:33.002646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d670facc-3590-4ab3-9545-44e46b17253b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.003232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d670facc-3590-4ab3-9545-44e46b17253b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.004132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d670facc-3590-4ab3-9545-44e46b17253b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.004995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d670facc-3590-4ab3-9545-44e46b17253b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.231324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-d670facc-3590-4ab3-9545-44e46b17253b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lazy-loading 'services' on Instance uuid 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:33.262110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c63c9fad-6433-418b-a65a-efd8b5430411 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.284428 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c63c9fad-6433-418b-a65a-efd8b5430411 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1671 microversion: 2.1 time: 0.645653 Jul 20 04:35:33.288864 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2462/4925] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:32 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1671 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:33.301551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bec03234-c9b7-4fab-b448-6ba61b7b4a42 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:33.306044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bec03234-c9b7-4fab-b448-6ba61b7b4a42 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:33.325981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bec03234-c9b7-4fab-b448-6ba61b7b4a42 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.332288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bec03234-c9b7-4fab-b448-6ba61b7b4a42 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.333149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bec03234-c9b7-4fab-b448-6ba61b7b4a42 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.334719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bec03234-c9b7-4fab-b448-6ba61b7b4a42 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.389099 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d670facc-3590-4ab3-9545-44e46b17253b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments/77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3" status: 202 len: 0 microversion: 2.1 time: 0.411733 Jul 20 04:35:33.406635 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2464/4926] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:35:32 2022] DELETE /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments/77e75411-ae4d-4ed7-9bed-aa1a8a4b69a3 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:35:33.438895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-063de1da-ae3b-4be8-9d67-367ce6fee941 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:33.439630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-063de1da-ae3b-4be8-9d67-367ce6fee941 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:33.466445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063de1da-ae3b-4be8-9d67-367ce6fee941 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.467177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063de1da-ae3b-4be8-9d67-367ce6fee941 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.469183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063de1da-ae3b-4be8-9d67-367ce6fee941 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.470141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063de1da-ae3b-4be8-9d67-367ce6fee941 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.731725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-063de1da-ae3b-4be8-9d67-367ce6fee941 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.743121 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-063de1da-ae3b-4be8-9d67-367ce6fee941 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1696 microversion: 2.1 time: 0.334627 Jul 20 04:35:33.753141 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2465/4927] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:33 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1696 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:33.758392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bb5f9771-2702-417c-81be-76bfa2b056ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:33.760128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bb5f9771-2702-417c-81be-76bfa2b056ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:33.767942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb5f9771-2702-417c-81be-76bfa2b056ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.768743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb5f9771-2702-417c-81be-76bfa2b056ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.769770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb5f9771-2702-417c-81be-76bfa2b056ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.770547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb5f9771-2702-417c-81be-76bfa2b056ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.789606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bec03234-c9b7-4fab-b448-6ba61b7b4a42 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.800707 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bec03234-c9b7-4fab-b448-6ba61b7b4a42 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.507754 Jul 20 04:35:33.801613 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2463/4928] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:33 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:33.816123 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bb5f9771-2702-417c-81be-76bfa2b056ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066827 Jul 20 04:35:33.817475 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2466/4929] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:35:33 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:34.308208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-580d16b7-e430-4cc3-8c49-596928172b19 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:34.310334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-580d16b7-e430-4cc3-8c49-596928172b19 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:34.346366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-580d16b7-e430-4cc3-8c49-596928172b19 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.347484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-580d16b7-e430-4cc3-8c49-596928172b19 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.350961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-580d16b7-e430-4cc3-8c49-596928172b19 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.352072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-580d16b7-e430-4cc3-8c49-596928172b19 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.711510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-580d16b7-e430-4cc3-8c49-596928172b19 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:34.723755 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-580d16b7-e430-4cc3-8c49-596928172b19 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1676 microversion: 2.1 time: 0.423949 Jul 20 04:35:34.724903 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2464/4930] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:34 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1676 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:34.761345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e9ad9c9-a5f1-4ba3-b8a7-7283daa51110 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:34.762222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e9ad9c9-a5f1-4ba3-b8a7-7283daa51110 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:34.784537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9ad9c9-a5f1-4ba3-b8a7-7283daa51110 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.785028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9ad9c9-a5f1-4ba3-b8a7-7283daa51110 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.791226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9ad9c9-a5f1-4ba3-b8a7-7283daa51110 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.792877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e9ad9c9-a5f1-4ba3-b8a7-7283daa51110 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.819948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-395acbad-34ba-41c3-8c86-8925d4d4378c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:34.820580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-395acbad-34ba-41c3-8c86-8925d4d4378c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:34.838577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-395acbad-34ba-41c3-8c86-8925d4d4378c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.842373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-395acbad-34ba-41c3-8c86-8925d4d4378c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.844960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-395acbad-34ba-41c3-8c86-8925d4d4378c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.847434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-395acbad-34ba-41c3-8c86-8925d4d4378c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.901627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:35.419973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-395acbad-34ba-41c3-8c86-8925d4d4378c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:35.424571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:35.430030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e9ad9c9-a5f1-4ba3-b8a7-7283daa51110 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:35.436260 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-395acbad-34ba-41c3-8c86-8925d4d4378c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.621811 Jul 20 04:35:35.437197 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2465/4931] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:34 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:35.445645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a13f993b-9e23-453a-ac1d-f46317a880a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:35.449321 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e9ad9c9-a5f1-4ba3-b8a7-7283daa51110 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1696 microversion: 2.1 time: 0.693056 Jul 20 04:35:35.452036 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2467/4932] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:34 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1696 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:35.462157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a13f993b-9e23-453a-ac1d-f46317a880a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:35.479784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a13f993b-9e23-453a-ac1d-f46317a880a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.483346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a13f993b-9e23-453a-ac1d-f46317a880a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.485758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a13f993b-9e23-453a-ac1d-f46317a880a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.487621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a13f993b-9e23-453a-ac1d-f46317a880a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.571335 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a13f993b-9e23-453a-ac1d-f46317a880a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130409 Jul 20 04:35:35.572348 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2466/4933] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:35:35 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:35.742780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-048d1d5f-b441-43eb-83cb-13b27f088e4e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:35.743636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-048d1d5f-b441-43eb-83cb-13b27f088e4e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:35.763879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-048d1d5f-b441-43eb-83cb-13b27f088e4e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.764569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-048d1d5f-b441-43eb-83cb-13b27f088e4e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.773043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-048d1d5f-b441-43eb-83cb-13b27f088e4e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.775412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-048d1d5f-b441-43eb-83cb-13b27f088e4e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.358840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-048d1d5f-b441-43eb-83cb-13b27f088e4e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:36.372904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-048d1d5f-b441-43eb-83cb-13b27f088e4e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.634631 Jul 20 04:35:36.398278 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2468/4934] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:35 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:36.456190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-644ba16a-08b4-4e90-a80c-4b86a54321aa tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:36.456849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-644ba16a-08b4-4e90-a80c-4b86a54321aa tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:36.475381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66a5c9e0-ecd5-4fe2-a126-d94f8c4cb49f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:36.476014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-66a5c9e0-ecd5-4fe2-a126-d94f8c4cb49f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:36.505986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-644ba16a-08b4-4e90-a80c-4b86a54321aa tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.509267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-644ba16a-08b4-4e90-a80c-4b86a54321aa tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.510159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-644ba16a-08b4-4e90-a80c-4b86a54321aa tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.510647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-644ba16a-08b4-4e90-a80c-4b86a54321aa tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.512854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a5c9e0-ecd5-4fe2-a126-d94f8c4cb49f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.519589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a5c9e0-ecd5-4fe2-a126-d94f8c4cb49f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.522994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a5c9e0-ecd5-4fe2-a126-d94f8c4cb49f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.531826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a5c9e0-ecd5-4fe2-a126-d94f8c4cb49f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.986327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66a5c9e0-ecd5-4fe2-a126-d94f8c4cb49f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:37.005981 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-66a5c9e0-ecd5-4fe2-a126-d94f8c4cb49f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1696 microversion: 2.1 time: 0.538834 Jul 20 04:35:37.031649 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2469/4935] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:36 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1696 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:37.050657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f58ef70e-f97b-4278-b2af-ca64cc51a923 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:37.055913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f58ef70e-f97b-4278-b2af-ca64cc51a923 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:37.071910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f58ef70e-f97b-4278-b2af-ca64cc51a923 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.072665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f58ef70e-f97b-4278-b2af-ca64cc51a923 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.073431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-644ba16a-08b4-4e90-a80c-4b86a54321aa tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:37.077069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f58ef70e-f97b-4278-b2af-ca64cc51a923 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.081359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f58ef70e-f97b-4278-b2af-ca64cc51a923 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.145939 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-644ba16a-08b4-4e90-a80c-4b86a54321aa tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.694148 Jul 20 04:35:37.158064 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2467/4936] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:36 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:37.193132 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f58ef70e-f97b-4278-b2af-ca64cc51a923 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159668 Jul 20 04:35:37.208756 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2470/4937] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:35:37 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:38.038863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86d19af1-bc4d-4320-addf-fb6a9ec5d750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:38.039917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-86d19af1-bc4d-4320-addf-fb6a9ec5d750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:38.057970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86d19af1-bc4d-4320-addf-fb6a9ec5d750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.065107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86d19af1-bc4d-4320-addf-fb6a9ec5d750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.066231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86d19af1-bc4d-4320-addf-fb6a9ec5d750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.067988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86d19af1-bc4d-4320-addf-fb6a9ec5d750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.171447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d6cc3a0-353e-4a17-9a57-f2bacaa9b7c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:38.174092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9d6cc3a0-353e-4a17-9a57-f2bacaa9b7c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:38.191403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d6cc3a0-353e-4a17-9a57-f2bacaa9b7c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.191871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d6cc3a0-353e-4a17-9a57-f2bacaa9b7c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.192675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d6cc3a0-353e-4a17-9a57-f2bacaa9b7c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.196413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d6cc3a0-353e-4a17-9a57-f2bacaa9b7c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.419565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-86d19af1-bc4d-4320-addf-fb6a9ec5d750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:38.433938 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-86d19af1-bc4d-4320-addf-fb6a9ec5d750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1696 microversion: 2.1 time: 0.400476 Jul 20 04:35:38.438404 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2468/4938] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:38 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1696 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:38.450400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94237c00-1a03-4890-a82a-2b4135c7aafc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:38.451596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-94237c00-1a03-4890-a82a-2b4135c7aafc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:38.472120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94237c00-1a03-4890-a82a-2b4135c7aafc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.472742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94237c00-1a03-4890-a82a-2b4135c7aafc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.473651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94237c00-1a03-4890-a82a-2b4135c7aafc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.474223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94237c00-1a03-4890-a82a-2b4135c7aafc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.543029 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94237c00-1a03-4890-a82a-2b4135c7aafc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102828 Jul 20 04:35:38.547268 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2469/4939] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:35:38 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:38.795379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bdc5e8a6-a8a1-41f7-90ec-51d374f29f4a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:38.796411 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:35:38.796411 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:35:38.797611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bdc5e8a6-a8a1-41f7-90ec-51d374f29f4a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.809604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bdc5e8a6-a8a1-41f7-90ec-51d374f29f4a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.812541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bdc5e8a6-a8a1-41f7-90ec-51d374f29f4a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.813395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bdc5e8a6-a8a1-41f7-90ec-51d374f29f4a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.900831 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bdc5e8a6-a8a1-41f7-90ec-51d374f29f4a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.352103 Jul 20 04:35:38.903474 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2470/4940] 10.222.0.59 () {58 vars in 1184 bytes} [Wed Jul 20 04:35:38 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:39.005472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9d6cc3a0-353e-4a17-9a57-f2bacaa9b7c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:39.019823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9d6cc3a0-353e-4a17-9a57-f2bacaa9b7c2 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.859298 Jul 20 04:35:39.039323 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2471/4941] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:38 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:39.172136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-742129886", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "availability_zone": "nova:n-h1-760456-11", "networks": [{"uuid": "b040f2fa-4733-407d-ab06-fba285abf64e"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:39.337478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] validate_networks() for [('b040f2fa-4733-407d-ab06-fba285abf64e', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:35:39.460355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-22482c97-d78f-429d-a606-25e59bd4cf79 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:39.461019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22482c97-d78f-429d-a606-25e59bd4cf79 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:39.482165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22482c97-d78f-429d-a606-25e59bd4cf79 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.483412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22482c97-d78f-429d-a606-25e59bd4cf79 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.486681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22482c97-d78f-429d-a606-25e59bd4cf79 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.494651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22482c97-d78f-429d-a606-25e59bd4cf79 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.880879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-22482c97-d78f-429d-a606-25e59bd4cf79 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:39.898672 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-22482c97-d78f-429d-a606-25e59bd4cf79 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1696 microversion: 2.1 time: 0.437413 Jul 20 04:35:39.899338 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2472/4942] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:39 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1696 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:39.911099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6ca01702-8dca-4ae0-b947-a48a71c5fa9c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:39.912096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6ca01702-8dca-4ae0-b947-a48a71c5fa9c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:39.934610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ca01702-8dca-4ae0-b947-a48a71c5fa9c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.935079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ca01702-8dca-4ae0-b947-a48a71c5fa9c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.935973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ca01702-8dca-4ae0-b947-a48a71c5fa9c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.936317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ca01702-8dca-4ae0-b947-a48a71c5fa9c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:40.039195 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6ca01702-8dca-4ae0-b947-a48a71c5fa9c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131943 Jul 20 04:35:40.047656 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2473/4943] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:35:39 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:40.054199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-010588c4-c8c7-428a-be0c-eda3254ba1c8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:40.054855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-010588c4-c8c7-428a-be0c-eda3254ba1c8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:40.088375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-010588c4-c8c7-428a-be0c-eda3254ba1c8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:40.090140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-010588c4-c8c7-428a-be0c-eda3254ba1c8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:40.090140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-010588c4-c8c7-428a-be0c-eda3254ba1c8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:40.090140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-010588c4-c8c7-428a-be0c-eda3254ba1c8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:40.480889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-010588c4-c8c7-428a-be0c-eda3254ba1c8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:40.493576 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-010588c4-c8c7-428a-be0c-eda3254ba1c8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.447751 Jul 20 04:35:40.497977 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2474/4944] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:40 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:40.917054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d375b0f5-1d83-42c5-9c41-73bd28ee8396 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:40.918842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d375b0f5-1d83-42c5-9c41-73bd28ee8396 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:40.932499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d375b0f5-1d83-42c5-9c41-73bd28ee8396 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:40.933336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d375b0f5-1d83-42c5-9c41-73bd28ee8396 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:40.937407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d375b0f5-1d83-42c5-9c41-73bd28ee8396 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:40.938524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d375b0f5-1d83-42c5-9c41-73bd28ee8396 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.033279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:35:41.035741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:35:41.037602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:35:41.038292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:35:41.038917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:35:41.050584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.051390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.052449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.053129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.098353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Getting quotas for project 807dde3249374e86829b268f5f257d59. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:41.105880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Getting quotas for user e205324b8bea47e9aa5ce2ce13fa3e94 and project 807dde3249374e86829b268f5f257d59. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:41.123178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:35:41.126575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:35:41.201618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d375b0f5-1d83-42c5-9c41-73bd28ee8396 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:41.212345 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b7d9365-d001-4043-880a-5cbff27f951a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.044618 Jul 20 04:35:41.213024 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2471/4945] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:35:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:35:41.218831 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d375b0f5-1d83-42c5-9c41-73bd28ee8396 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1696 microversion: 2.1 time: 0.304396 Jul 20 04:35:41.221087 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2475/4946] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:40 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1696 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:41.234826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ec146a7-eb70-4d95-a3a7-3305061fee16 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:41.237195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17d0aac2-6d4c-4ba1-a783-9e69243cd175 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:41.237806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ec146a7-eb70-4d95-a3a7-3305061fee16 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:41.239446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-17d0aac2-6d4c-4ba1-a783-9e69243cd175 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:41.260582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17d0aac2-6d4c-4ba1-a783-9e69243cd175 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.263233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17d0aac2-6d4c-4ba1-a783-9e69243cd175 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.265659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17d0aac2-6d4c-4ba1-a783-9e69243cd175 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.267507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17d0aac2-6d4c-4ba1-a783-9e69243cd175 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.337578 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-17d0aac2-6d4c-4ba1-a783-9e69243cd175 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106872 Jul 20 04:35:41.338166 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2472/4947] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:35:41 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:41.428599 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ec146a7-eb70-4d95-a3a7-3305061fee16 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1328 microversion: 2.1 time: 0.205432 Jul 20 04:35:41.438287 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2476/4948] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:41 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1328 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:41.513112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-280a3a38-a4c0-4037-846d-0b25be95ead5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:41.515644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-280a3a38-a4c0-4037-846d-0b25be95ead5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:41.537447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-280a3a38-a4c0-4037-846d-0b25be95ead5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.539838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-280a3a38-a4c0-4037-846d-0b25be95ead5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.540949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-280a3a38-a4c0-4037-846d-0b25be95ead5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.541516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-280a3a38-a4c0-4037-846d-0b25be95ead5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.184596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-280a3a38-a4c0-4037-846d-0b25be95ead5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:42.193937 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-280a3a38-a4c0-4037-846d-0b25be95ead5 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.684829 Jul 20 04:35:42.199918 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2473/4949] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:41 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:42.239987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3da8e750-6369-498b-bfa6-069b3ea02750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:42.240953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3da8e750-6369-498b-bfa6-069b3ea02750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:42.259538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3da8e750-6369-498b-bfa6-069b3ea02750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.262345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3da8e750-6369-498b-bfa6-069b3ea02750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.263385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3da8e750-6369-498b-bfa6-069b3ea02750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.263842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3da8e750-6369-498b-bfa6-069b3ea02750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.350174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aa121539-579e-4d82-8c4d-0de94a5f63c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:42.351696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aa121539-579e-4d82-8c4d-0de94a5f63c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:42.367027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa121539-579e-4d82-8c4d-0de94a5f63c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.367770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa121539-579e-4d82-8c4d-0de94a5f63c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.369001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa121539-579e-4d82-8c4d-0de94a5f63c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.369735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa121539-579e-4d82-8c4d-0de94a5f63c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.418920 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aa121539-579e-4d82-8c4d-0de94a5f63c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073047 Jul 20 04:35:42.419897 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2474/4950] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:35:42 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:35:42.448111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e5de1ed5-0917-465b-a3a2-565ded02df19 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:42.449086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e5de1ed5-0917-465b-a3a2-565ded02df19 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:42.460445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5de1ed5-0917-465b-a3a2-565ded02df19 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.462534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5de1ed5-0917-465b-a3a2-565ded02df19 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.464803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5de1ed5-0917-465b-a3a2-565ded02df19 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:42.466550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5de1ed5-0917-465b-a3a2-565ded02df19 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:42.685794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3da8e750-6369-498b-bfa6-069b3ea02750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:42.695275 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3da8e750-6369-498b-bfa6-069b3ea02750 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1696 microversion: 2.1 time: 0.462197 Jul 20 04:35:42.707431 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2477/4951] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:42 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1696 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:42.709545 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e5de1ed5-0917-465b-a3a2-565ded02df19 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1337 microversion: 2.1 time: 0.265284 Jul 20 04:35:42.710144 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2475/4952] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:42 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1337 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:43.215021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-59d9c436-cc61-4c96-ba1a-4557700d142f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:43.215829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-59d9c436-cc61-4c96-ba1a-4557700d142f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:43.225098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:43.249264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59d9c436-cc61-4c96-ba1a-4557700d142f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:43.250298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59d9c436-cc61-4c96-ba1a-4557700d142f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:43.255326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59d9c436-cc61-4c96-ba1a-4557700d142f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:43.256125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59d9c436-cc61-4c96-ba1a-4557700d142f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:43.431186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5f0b3736-b389-493e-aa9d-616fa7339640 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:43.433600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5f0b3736-b389-493e-aa9d-616fa7339640 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:43.444921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f0b3736-b389-493e-aa9d-616fa7339640 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:43.451392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f0b3736-b389-493e-aa9d-616fa7339640 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:43.453367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f0b3736-b389-493e-aa9d-616fa7339640 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:43.454091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f0b3736-b389-493e-aa9d-616fa7339640 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:43.513504 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5f0b3736-b389-493e-aa9d-616fa7339640 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083003 Jul 20 04:35:43.516666 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2476/4953] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:35:43 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:43.715777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c6d2503-738c-43ea-bf64-457a66e97e36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:43.716421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3c6d2503-738c-43ea-bf64-457a66e97e36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:43.727832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c6d2503-738c-43ea-bf64-457a66e97e36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:43.728374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c6d2503-738c-43ea-bf64-457a66e97e36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:43.731124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c6d2503-738c-43ea-bf64-457a66e97e36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:43.731656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c6d2503-738c-43ea-bf64-457a66e97e36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:43.848524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-59d9c436-cc61-4c96-ba1a-4557700d142f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:43.873183 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-59d9c436-cc61-4c96-ba1a-4557700d142f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.662075 Jul 20 04:35:43.876451 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2478/4954] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:43 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:43.886449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0e07bdfd-828b-44be-b278-15012b0bb494 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:43.887102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0e07bdfd-828b-44be-b278-15012b0bb494 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:43.897736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e07bdfd-828b-44be-b278-15012b0bb494 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:43.898558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e07bdfd-828b-44be-b278-15012b0bb494 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:43.900091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e07bdfd-828b-44be-b278-15012b0bb494 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:43.900763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e07bdfd-828b-44be-b278-15012b0bb494 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.024513 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0e07bdfd-828b-44be-b278-15012b0bb494 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1423 microversion: 2.1 time: 0.146343 Jul 20 04:35:44.026064 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2479/4955] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:43 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1423 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:44.120971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-9cde29f5-6255-452b-b835-1d247f477565 req-4c9ae765-0e80-4176-beff-4dffc0d45983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "name": "network-vif-unplugged", "status": "completed", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:44.141104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9cde29f5-6255-452b-b835-1d247f477565 req-4c9ae765-0e80-4176-beff-4dffc0d45983 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.141579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9cde29f5-6255-452b-b835-1d247f477565 req-4c9ae765-0e80-4176-beff-4dffc0d45983 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.182823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-9cde29f5-6255-452b-b835-1d247f477565 req-4c9ae765-0e80-4176-beff-4dffc0d45983 service nova] Creating event network-vif-unplugged:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h2-760456-11 Jul 20 04:35:44.201838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-9cde29f5-6255-452b-b835-1d247f477565 req-4c9ae765-0e80-4176-beff-4dffc0d45983 service nova] Instance bb7497e6-1395-4095-aa68-18be3a46bfda is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:35:44.236504 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-9cde29f5-6255-452b-b835-1d247f477565 req-4c9ae765-0e80-4176-beff-4dffc0d45983 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125231 Jul 20 04:35:44.238049 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2480/4956] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:44.295405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3c6d2503-738c-43ea-bf64-457a66e97e36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:44.319825 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3c6d2503-738c-43ea-bf64-457a66e97e36 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1695 microversion: 2.1 time: 0.608011 Jul 20 04:35:44.330789 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2477/4957] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:43 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1695 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:44.530500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c7ca064-43ec-4850-be44-69abd8087c5b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:44.532380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c7ca064-43ec-4850-be44-69abd8087c5b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:44.548933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c7ca064-43ec-4850-be44-69abd8087c5b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.553706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c7ca064-43ec-4850-be44-69abd8087c5b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.558843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c7ca064-43ec-4850-be44-69abd8087c5b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.568181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c7ca064-43ec-4850-be44-69abd8087c5b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.677480 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c7ca064-43ec-4850-be44-69abd8087c5b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153578 Jul 20 04:35:44.678092 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2481/4958] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:35:44 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:35:44.769314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31b24efb-12bd-4cd0-a25e-bc5f7a7839bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:44.770177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31b24efb-12bd-4cd0-a25e-bc5f7a7839bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:44.796788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31b24efb-12bd-4cd0-a25e-bc5f7a7839bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.797536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31b24efb-12bd-4cd0-a25e-bc5f7a7839bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.798539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31b24efb-12bd-4cd0-a25e-bc5f7a7839bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.806062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31b24efb-12bd-4cd0-a25e-bc5f7a7839bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.868786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31b24efb-12bd-4cd0-a25e-bc5f7a7839bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:44.891795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d4e44e8d-0209-454a-b896-9277ee5d898d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:44.892426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d4e44e8d-0209-454a-b896-9277ee5d898d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:44.918989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4e44e8d-0209-454a-b896-9277ee5d898d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.919927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4e44e8d-0209-454a-b896-9277ee5d898d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:44.921309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4e44e8d-0209-454a-b896-9277ee5d898d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:44.921938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4e44e8d-0209-454a-b896-9277ee5d898d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.001935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:45.021305 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31b24efb-12bd-4cd0-a25e-bc5f7a7839bc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 204 len: 0 microversion: 2.1 time: 0.256455 Jul 20 04:35:45.021951 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2478/4959] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:44 2022] DELETE /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:45.049818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c7e3efd-c7aa-47a9-940d-86afc66df244 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:45.050874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9c7e3efd-c7aa-47a9-940d-86afc66df244 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:45.060729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c7e3efd-c7aa-47a9-940d-86afc66df244 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.061872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c7e3efd-c7aa-47a9-940d-86afc66df244 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.063379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c7e3efd-c7aa-47a9-940d-86afc66df244 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.064115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c7e3efd-c7aa-47a9-940d-86afc66df244 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.261455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d4e44e8d-0209-454a-b896-9277ee5d898d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:45.275011 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d4e44e8d-0209-454a-b896-9277ee5d898d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.387539 Jul 20 04:35:45.277531 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2482/4960] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:44 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:45.287594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c08942a0-3405-4c1d-848c-1d91a72c3558 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:45.290049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c08942a0-3405-4c1d-848c-1d91a72c3558 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:45.300655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c08942a0-3405-4c1d-848c-1d91a72c3558 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.301302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c08942a0-3405-4c1d-848c-1d91a72c3558 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.303305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c08942a0-3405-4c1d-848c-1d91a72c3558 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.303940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c08942a0-3405-4c1d-848c-1d91a72c3558 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.439593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9c7e3efd-c7aa-47a9-940d-86afc66df244 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:45.451317 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9c7e3efd-c7aa-47a9-940d-86afc66df244 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1681 microversion: 2.1 time: 0.411459 Jul 20 04:35:45.455197 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2479/4961] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:45 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1681 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:45.463530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d3fc7c9-3955-444e-a488-f3febe7d5033 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:45.468804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7d3fc7c9-3955-444e-a488-f3febe7d5033 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:45.487201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d3fc7c9-3955-444e-a488-f3febe7d5033 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.487792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d3fc7c9-3955-444e-a488-f3febe7d5033 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.488713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d3fc7c9-3955-444e-a488-f3febe7d5033 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.489394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d3fc7c9-3955-444e-a488-f3febe7d5033 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.654897 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c08942a0-3405-4c1d-848c-1d91a72c3558 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1465 microversion: 2.1 time: 0.373787 Jul 20 04:35:45.663181 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2483/4962] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:45 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1465 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:45.671865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c77e9a5d-1918-4c74-9bff-a3365f21476a req-dc1f3a5e-8f70-43e7-866c-d107cb41e446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976749a5-7a22-4c41-b15e-6351e8496081", "tag": "2c21de82-a171-41b6-8098-a9b1f6974080"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:45.694484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c77e9a5d-1918-4c74-9bff-a3365f21476a req-dc1f3a5e-8f70-43e7-866c-d107cb41e446 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.695380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c77e9a5d-1918-4c74-9bff-a3365f21476a req-dc1f3a5e-8f70-43e7-866c-d107cb41e446 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.716561 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c77e9a5d-1918-4c74-9bff-a3365f21476a req-dc1f3a5e-8f70-43e7-866c-d107cb41e446 service nova] Creating event network-changed:2c21de82-a171-41b6-8098-a9b1f6974080 for instance 976749a5-7a22-4c41-b15e-6351e8496081 on n-h1-760456-11 Jul 20 04:35:45.724205 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c77e9a5d-1918-4c74-9bff-a3365f21476a req-dc1f3a5e-8f70-43e7-866c-d107cb41e446 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059670 Jul 20 04:35:45.725570 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2484/4963] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:45.817198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7d3fc7c9-3955-444e-a488-f3febe7d5033 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:45.825838 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d3fc7c9-3955-444e-a488-f3febe7d5033 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1695 microversion: 2.1 time: 0.369079 Jul 20 04:35:45.826777 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2480/4964] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:45 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1695 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:46.302953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ccae5655-32a9-47a0-9d3e-3722c797d2ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:46.304031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-145e522b-c457-45f3-8855-6aa044889f0e req-10750e22-ad88-4dc2-89fa-ad7e983a042e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:46.304293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ccae5655-32a9-47a0-9d3e-3722c797d2ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:46.317592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccae5655-32a9-47a0-9d3e-3722c797d2ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.319411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccae5655-32a9-47a0-9d3e-3722c797d2ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.321874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-145e522b-c457-45f3-8855-6aa044889f0e req-10750e22-ad88-4dc2-89fa-ad7e983a042e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.327612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-145e522b-c457-45f3-8855-6aa044889f0e req-10750e22-ad88-4dc2-89fa-ad7e983a042e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.330093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccae5655-32a9-47a0-9d3e-3722c797d2ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.330589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccae5655-32a9-47a0-9d3e-3722c797d2ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.360041 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-145e522b-c457-45f3-8855-6aa044889f0e req-10750e22-ad88-4dc2-89fa-ad7e983a042e service nova] Creating event network-changed:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h2-760456-11 Jul 20 04:35:46.373017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-145e522b-c457-45f3-8855-6aa044889f0e req-10750e22-ad88-4dc2-89fa-ad7e983a042e service nova] Instance bb7497e6-1395-4095-aa68-18be3a46bfda is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:35:46.424111 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-145e522b-c457-45f3-8855-6aa044889f0e req-10750e22-ad88-4dc2-89fa-ad7e983a042e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129484 Jul 20 04:35:46.425739 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2481/4965] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:46.473281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b54ed633-ac82-4a34-b6a7-3fa49d50e42c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:46.474100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b54ed633-ac82-4a34-b6a7-3fa49d50e42c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:46.497657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b54ed633-ac82-4a34-b6a7-3fa49d50e42c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.502179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b54ed633-ac82-4a34-b6a7-3fa49d50e42c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.506889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b54ed633-ac82-4a34-b6a7-3fa49d50e42c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.507560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b54ed633-ac82-4a34-b6a7-3fa49d50e42c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.584849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:46.850594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ccae5655-32a9-47a0-9d3e-3722c797d2ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:46.867952 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ccae5655-32a9-47a0-9d3e-3722c797d2ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.574558 Jul 20 04:35:46.871620 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2485/4966] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:46 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:46.898231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0961491d-eabc-4c49-983a-a522546d354f tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:46.899279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0961491d-eabc-4c49-983a-a522546d354f tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:46.908245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0961491d-eabc-4c49-983a-a522546d354f tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.909053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0961491d-eabc-4c49-983a-a522546d354f tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.910008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0961491d-eabc-4c49-983a-a522546d354f tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:46.912443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0961491d-eabc-4c49-983a-a522546d354f tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:46.962325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:47.285901 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0961491d-eabc-4c49-983a-a522546d354f tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1465 microversion: 2.1 time: 0.413106 Jul 20 04:35:47.292835 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2486/4967] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:46 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1465 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:47.304808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f65b6630-3c89-4c5e-bfee-6e036cde186d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:47.309221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f65b6630-3c89-4c5e-bfee-6e036cde186d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:47.326201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f65b6630-3c89-4c5e-bfee-6e036cde186d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.328030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f65b6630-3c89-4c5e-bfee-6e036cde186d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.332536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f65b6630-3c89-4c5e-bfee-6e036cde186d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.333278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f65b6630-3c89-4c5e-bfee-6e036cde186d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.730903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b54ed633-ac82-4a34-b6a7-3fa49d50e42c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:47.732896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f65b6630-3c89-4c5e-bfee-6e036cde186d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:47.746483 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f65b6630-3c89-4c5e-bfee-6e036cde186d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1693 microversion: 2.1 time: 0.451259 Jul 20 04:35:47.747453 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2487/4968] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:47 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1693 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:47.750576 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b54ed633-ac82-4a34-b6a7-3fa49d50e42c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1681 microversion: 2.1 time: 1.282289 Jul 20 04:35:47.760989 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2482/4969] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:46 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1681 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:47.885294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-afff51a5-f305-41f0-8a91-a5ae34b29152 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:47.885878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-afff51a5-f305-41f0-8a91-a5ae34b29152 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:47.899832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afff51a5-f305-41f0-8a91-a5ae34b29152 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.900572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afff51a5-f305-41f0-8a91-a5ae34b29152 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.901829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afff51a5-f305-41f0-8a91-a5ae34b29152 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.902550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afff51a5-f305-41f0-8a91-a5ae34b29152 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:48.309319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3242ce3-e235-4460-8586-59f648041dda tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:48.309955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d3242ce3-e235-4460-8586-59f648041dda tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:48.323524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3242ce3-e235-4460-8586-59f648041dda tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:48.323993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3242ce3-e235-4460-8586-59f648041dda tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:48.324802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3242ce3-e235-4460-8586-59f648041dda tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:48.325254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3242ce3-e235-4460-8586-59f648041dda tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:48.557257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-afff51a5-f305-41f0-8a91-a5ae34b29152 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:48.568876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-afff51a5-f305-41f0-8a91-a5ae34b29152 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.687538 Jul 20 04:35:48.583385 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2488/4970] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:47 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:48.721093 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d3242ce3-e235-4460-8586-59f648041dda tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1465 microversion: 2.1 time: 0.415681 Jul 20 04:35:48.730439 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2483/4971] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:48 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1465 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:48.774018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-059d6c8f-ac55-4bc4-b62a-e66601fa0b43 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:48.775363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-48d59553-c571-4355-b322-889bb6cb7170 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:48.777608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-48d59553-c571-4355-b322-889bb6cb7170 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:48.777869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-059d6c8f-ac55-4bc4-b62a-e66601fa0b43 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:48.801564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-48d59553-c571-4355-b322-889bb6cb7170 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:48.804060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-48d59553-c571-4355-b322-889bb6cb7170 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:48.804998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-059d6c8f-ac55-4bc4-b62a-e66601fa0b43 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:48.805511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-059d6c8f-ac55-4bc4-b62a-e66601fa0b43 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:48.806363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-059d6c8f-ac55-4bc4-b62a-e66601fa0b43 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:48.806848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-48d59553-c571-4355-b322-889bb6cb7170 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:48.808491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-48d59553-c571-4355-b322-889bb6cb7170 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:48.810745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-059d6c8f-ac55-4bc4-b62a-e66601fa0b43 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.011432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-059d6c8f-ac55-4bc4-b62a-e66601fa0b43 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:49.021495 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-059d6c8f-ac55-4bc4-b62a-e66601fa0b43 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1690 microversion: 2.1 time: 0.260973 Jul 20 04:35:49.024681 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2489/4972] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:48 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:49.047898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b48ac895-0441-421a-9ecb-28f1acc4db2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:49.048445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b48ac895-0441-421a-9ecb-28f1acc4db2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:49.066542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b48ac895-0441-421a-9ecb-28f1acc4db2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.067002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b48ac895-0441-421a-9ecb-28f1acc4db2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.072302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b48ac895-0441-421a-9ecb-28f1acc4db2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.072917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b48ac895-0441-421a-9ecb-28f1acc4db2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.079048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-48d59553-c571-4355-b322-889bb6cb7170 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:49.087827 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-48d59553-c571-4355-b322-889bb6cb7170 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1615 microversion: 2.1 time: 0.323527 Jul 20 04:35:49.090192 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2484/4973] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:48 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1615 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:49.230900 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b48ac895-0441-421a-9ecb-28f1acc4db2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda/action" status: 202 len: 0 microversion: 2.1 time: 0.191247 Jul 20 04:35:49.236561 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2490/4974] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:35:49 2022] POST /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:35:49.242804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-544b08d8-47b2-46d2-a01c-07745b713018 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:49.246982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-544b08d8-47b2-46d2-a01c-07745b713018 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:49.255745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-544b08d8-47b2-46d2-a01c-07745b713018 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.256317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-544b08d8-47b2-46d2-a01c-07745b713018 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.258140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-544b08d8-47b2-46d2-a01c-07745b713018 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.258704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-544b08d8-47b2-46d2-a01c-07745b713018 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.591737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-670a4796-bffb-4a52-968d-7b6a26e5ba95 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:49.592492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-670a4796-bffb-4a52-968d-7b6a26e5ba95 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:49.604627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-670a4796-bffb-4a52-968d-7b6a26e5ba95 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.605092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-670a4796-bffb-4a52-968d-7b6a26e5ba95 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.610457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-670a4796-bffb-4a52-968d-7b6a26e5ba95 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.611109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-670a4796-bffb-4a52-968d-7b6a26e5ba95 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.687580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-544b08d8-47b2-46d2-a01c-07745b713018 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:49.696781 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-544b08d8-47b2-46d2-a01c-07745b713018 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1689 microversion: 2.1 time: 0.457865 Jul 20 04:35:49.703011 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2485/4975] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:49 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1689 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:49.708202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-38bbc532-76cb-415f-a714-c1cb4da9b0d4 req-d2d3d7bd-fa39-45df-a9db-eb0c7ca390c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223", "name": "network-vif-deleted", "tag": "7219a53b-f8cc-4bac-a4d7-2bdb5abb1ffe"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:49.721927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-38bbc532-76cb-415f-a714-c1cb4da9b0d4 req-d2d3d7bd-fa39-45df-a9db-eb0c7ca390c9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.722697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-38bbc532-76cb-415f-a714-c1cb4da9b0d4 req-d2d3d7bd-fa39-45df-a9db-eb0c7ca390c9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.752744 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-38bbc532-76cb-415f-a714-c1cb4da9b0d4 req-d2d3d7bd-fa39-45df-a9db-eb0c7ca390c9 service nova] Creating event network-vif-deleted:7219a53b-f8cc-4bac-a4d7-2bdb5abb1ffe for instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 on n-h1-760456-11 Jul 20 04:35:49.757969 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-38bbc532-76cb-415f-a714-c1cb4da9b0d4 req-d2d3d7bd-fa39-45df-a9db-eb0c7ca390c9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053344 Jul 20 04:35:49.759209 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2486/4976] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:49.767083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c29495c9-31b9-4f91-825d-1ae33a35a3eb tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:49.768054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c29495c9-31b9-4f91-825d-1ae33a35a3eb tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:49.775832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c29495c9-31b9-4f91-825d-1ae33a35a3eb tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.777768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c29495c9-31b9-4f91-825d-1ae33a35a3eb tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.778858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c29495c9-31b9-4f91-825d-1ae33a35a3eb tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.779687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c29495c9-31b9-4f91-825d-1ae33a35a3eb tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.075934 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c29495c9-31b9-4f91-825d-1ae33a35a3eb tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1465 microversion: 2.1 time: 0.303910 Jul 20 04:35:50.077376 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2487/4977] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:49 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1465 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:50.078850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-670a4796-bffb-4a52-968d-7b6a26e5ba95 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:50.090010 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-670a4796-bffb-4a52-968d-7b6a26e5ba95 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.503973 Jul 20 04:35:50.090642 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2491/4978] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:49 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:50.127980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:50.127980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:50.137023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.137610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.138698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.139944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.234987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.235971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.236784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lazy-loading 'fault' on Instance uuid 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:50.348144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:50.359865 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-553ed9ec-a5f3-4ea5-9511-1d77eda4f73e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 200 len: 1332 microversion: 2.1 time: 0.254507 Jul 20 04:35:50.361696 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2488/4979] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:50 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 1332 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:50.453328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-40a2d563-68ab-4879-b893-fba3333cf776 req-57338ae3-4de1-4770-9774-8c7e5ef0da8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "name": "network-vif-plugged", "status": "completed", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:50.474285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-40a2d563-68ab-4879-b893-fba3333cf776 req-57338ae3-4de1-4770-9774-8c7e5ef0da8f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.475759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-40a2d563-68ab-4879-b893-fba3333cf776 req-57338ae3-4de1-4770-9774-8c7e5ef0da8f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.496796 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-40a2d563-68ab-4879-b893-fba3333cf776 req-57338ae3-4de1-4770-9774-8c7e5ef0da8f service nova] Creating event network-vif-plugged:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h2-760456-11 Jul 20 04:35:50.507644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-40a2d563-68ab-4879-b893-fba3333cf776 req-57338ae3-4de1-4770-9774-8c7e5ef0da8f service nova] Instance bb7497e6-1395-4095-aa68-18be3a46bfda is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:35:50.524809 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-40a2d563-68ab-4879-b893-fba3333cf776 req-57338ae3-4de1-4770-9774-8c7e5ef0da8f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078190 Jul 20 04:35:50.526311 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2492/4980] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:50.720736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-329b16da-2718-4368-a1e9-38eef92e9f90 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:50.721627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-329b16da-2718-4368-a1e9-38eef92e9f90 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:50.733437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329b16da-2718-4368-a1e9-38eef92e9f90 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.733907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329b16da-2718-4368-a1e9-38eef92e9f90 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:50.734766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329b16da-2718-4368-a1e9-38eef92e9f90 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:50.735214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329b16da-2718-4368-a1e9-38eef92e9f90 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.009077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-329b16da-2718-4368-a1e9-38eef92e9f90 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:51.030506 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-329b16da-2718-4368-a1e9-38eef92e9f90 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1689 microversion: 2.1 time: 0.313365 Jul 20 04:35:51.032730 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2489/4981] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:50 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1689 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:51.089287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3750f4cc-2ba8-4bd8-934a-c6aeef7ebc33 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:51.090638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3750f4cc-2ba8-4bd8-934a-c6aeef7ebc33 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:51.107529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-756f1536-d589-4e50-8599-4cea8b0756ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:51.109081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-756f1536-d589-4e50-8599-4cea8b0756ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:51.115621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3750f4cc-2ba8-4bd8-934a-c6aeef7ebc33 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.119977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3750f4cc-2ba8-4bd8-934a-c6aeef7ebc33 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.120783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:51.123088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:51.125324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3750f4cc-2ba8-4bd8-934a-c6aeef7ebc33 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.128601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3750f4cc-2ba8-4bd8-934a-c6aeef7ebc33 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.149159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-756f1536-d589-4e50-8599-4cea8b0756ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.149872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-756f1536-d589-4e50-8599-4cea8b0756ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.153452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-756f1536-d589-4e50-8599-4cea8b0756ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.153907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-756f1536-d589-4e50-8599-4cea8b0756ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.380850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-756f1536-d589-4e50-8599-4cea8b0756ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:51.397326 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-756f1536-d589-4e50-8599-4cea8b0756ea tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.293573 Jul 20 04:35:51.398638 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2490/4982] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:51 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:51.403753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ff8b4a3c-2dd1-4141-9486-2f76f9b1c573 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:51.407004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ff8b4a3c-2dd1-4141-9486-2f76f9b1c573 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:51.428079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff8b4a3c-2dd1-4141-9486-2f76f9b1c573 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.428206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:51.431037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff8b4a3c-2dd1-4141-9486-2f76f9b1c573 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.432006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff8b4a3c-2dd1-4141-9486-2f76f9b1c573 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:51.432708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff8b4a3c-2dd1-4141-9486-2f76f9b1c573 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:51.462140 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-ff8b4a3c-2dd1-4141-9486-2f76f9b1c573 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ff8b4a3c-2dd1-4141-9486-2f76f9b1c573 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 HTTP/1.1 Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223'} Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:51.464756 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:35:51.469002 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:51.469002 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:51.469002 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:51.469002 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:51.469002 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:51.469002 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:35:51.469002 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:35:51.469002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ff8b4a3c-2dd1-4141-9486-2f76f9b1c573 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:51.469002 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ff8b4a3c-2dd1-4141-9486-2f76f9b1c573 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 404 len: 111 microversion: 2.1 time: 0.066786 Jul 20 04:35:51.479882 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2491/4983] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:51 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:51.487198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cec9732c-a0a6-4913-99fd-b13b971e3e53 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '.version_select at 0x7fb841c4edc0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:51.517886 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cec9732c-a0a6-4913-99fd-b13b971e3e53 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010040000" status: 202 len: 0 microversion: 2.1 time: 0.036554 Jul 20 04:35:51.521673 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2492/4984] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:35:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010040000 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:35:51.572626 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3750f4cc-2ba8-4bd8-934a-c6aeef7ebc33 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1465 microversion: 2.1 time: 0.492436 Jul 20 04:35:51.577425 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2493/4985] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:51 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1465 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:52.049882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1b9ca3ed-0e1f-431e-b120-01355ea8a729 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:52.054617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1b9ca3ed-0e1f-431e-b120-01355ea8a729 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:52.070002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b9ca3ed-0e1f-431e-b120-01355ea8a729 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.070491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b9ca3ed-0e1f-431e-b120-01355ea8a729 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.071293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b9ca3ed-0e1f-431e-b120-01355ea8a729 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.071747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b9ca3ed-0e1f-431e-b120-01355ea8a729 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.374417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1b9ca3ed-0e1f-431e-b120-01355ea8a729 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:52.388095 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1b9ca3ed-0e1f-431e-b120-01355ea8a729 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1689 microversion: 2.1 time: 0.341253 Jul 20 04:35:52.391077 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2493/4986] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:52 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1689 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:52.415480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-761c6507-b164-4044-8da1-329707af8857 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:52.416801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-761c6507-b164-4044-8da1-329707af8857 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:52.439250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-761c6507-b164-4044-8da1-329707af8857 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.440082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-761c6507-b164-4044-8da1-329707af8857 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.441136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-761c6507-b164-4044-8da1-329707af8857 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.441798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-761c6507-b164-4044-8da1-329707af8857 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.593997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-82131d09-4f99-48f9-befd-858a86138d45 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:52.594664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-82131d09-4f99-48f9-befd-858a86138d45 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:52.601779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82131d09-4f99-48f9-befd-858a86138d45 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.603204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82131d09-4f99-48f9-befd-858a86138d45 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.607640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82131d09-4f99-48f9-befd-858a86138d45 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.609279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82131d09-4f99-48f9-befd-858a86138d45 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.896815 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-82131d09-4f99-48f9-befd-858a86138d45 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1465 microversion: 2.1 time: 0.307017 Jul 20 04:35:52.897650 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2494/4987] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:52 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1465 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:52.903370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1e0e9637-e2b4-4fbf-817d-ee5acd29fd74 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: .version_select at 0x7fb841ca1040>, body: {"keypair": {"name": "tempest-keypair-1671164215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHYWssnRwQx9jjJ/TslFikIYZkiCA4sUfvGJmx9BOkNwIrn5NDys7HECGgBDOtQ9kXb2ZYnTrVsroyn7PIyHv50PqDD4jqhgr8wwK0bXeFrR3E9qdNtPUT5UPDSqAO6FA=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:52.928514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-761c6507-b164-4044-8da1-329707af8857 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:52.940617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-1e0e9637-e2b4-4fbf-817d-ee5acd29fd74 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for project e104a7716d8549cb8b99560ac90150c6. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:52.943291 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-761c6507-b164-4044-8da1-329707af8857 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.531274 Jul 20 04:35:52.944440 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2494/4988] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:52 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:52.950715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-8e5dc01d-7036-4f5e-8961-fb0adbf94faa req-ff516292-27b1-4bf4-a8ce-19d430c9cea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976749a5-7a22-4c41-b15e-6351e8496081", "name": "network-vif-plugged", "status": "completed", "tag": "2c21de82-a171-41b6-8098-a9b1f6974080"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:52.959809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-1e0e9637-e2b4-4fbf-817d-ee5acd29fd74 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for user 4bd10ebbd2fd4ef693e15194c2d8912c and project e104a7716d8549cb8b99560ac90150c6. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:52.961872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8e5dc01d-7036-4f5e-8961-fb0adbf94faa req-ff516292-27b1-4bf4-a8ce-19d430c9cea3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.962998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8e5dc01d-7036-4f5e-8961-fb0adbf94faa req-ff516292-27b1-4bf4-a8ce-19d430c9cea3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.978564 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8e5dc01d-7036-4f5e-8961-fb0adbf94faa req-ff516292-27b1-4bf4-a8ce-19d430c9cea3 service nova] Creating event network-vif-plugged:2c21de82-a171-41b6-8098-a9b1f6974080 for instance 976749a5-7a22-4c41-b15e-6351e8496081 on n-h1-760456-11 Jul 20 04:35:52.985395 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-8e5dc01d-7036-4f5e-8961-fb0adbf94faa req-ff516292-27b1-4bf4-a8ce-19d430c9cea3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039196 Jul 20 04:35:52.986721 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2495/4989] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:53.018157 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1e0e9637-e2b4-4fbf-817d-ee5acd29fd74 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118382 Jul 20 04:35:53.027379 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2495/4990] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:35:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:53.408804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ded37a3b-49d2-4704-a52d-e950944bd99a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:53.409649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ded37a3b-49d2-4704-a52d-e950944bd99a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:53.422024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded37a3b-49d2-4704-a52d-e950944bd99a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.423341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded37a3b-49d2-4704-a52d-e950944bd99a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:53.424441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded37a3b-49d2-4704-a52d-e950944bd99a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.426887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded37a3b-49d2-4704-a52d-e950944bd99a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:53.720347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ded37a3b-49d2-4704-a52d-e950944bd99a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:53.738469 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ded37a3b-49d2-4704-a52d-e950944bd99a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1689 microversion: 2.1 time: 0.332623 Jul 20 04:35:53.739097 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2496/4991] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:53 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1689 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:53.915396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1f9d465b-7a98-4dae-a4e5-9572263d6e08 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:53.916131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1f9d465b-7a98-4dae-a4e5-9572263d6e08 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:53.932568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f9d465b-7a98-4dae-a4e5-9572263d6e08 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.935528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f9d465b-7a98-4dae-a4e5-9572263d6e08 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:53.938893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f9d465b-7a98-4dae-a4e5-9572263d6e08 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.941611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f9d465b-7a98-4dae-a4e5-9572263d6e08 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:53.961849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-afc62ea7-2d09-4e73-beb5-0d3213a1dd8c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:53.962870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-afc62ea7-2d09-4e73-beb5-0d3213a1dd8c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:53.980644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afc62ea7-2d09-4e73-beb5-0d3213a1dd8c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.985729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afc62ea7-2d09-4e73-beb5-0d3213a1dd8c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:53.987139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afc62ea7-2d09-4e73-beb5-0d3213a1dd8c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:53.994081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-afc62ea7-2d09-4e73-beb5-0d3213a1dd8c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:54.218171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-afc62ea7-2d09-4e73-beb5-0d3213a1dd8c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.231743 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-afc62ea7-2d09-4e73-beb5-0d3213a1dd8c tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.274489 Jul 20 04:35:54.233531 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2497/4992] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:53 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:54.758274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8cba5aa3-37d5-41f9-ad56-3633e2588da7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:54.758942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8cba5aa3-37d5-41f9-ad56-3633e2588da7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:54.774962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cba5aa3-37d5-41f9-ad56-3633e2588da7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:54.775246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cba5aa3-37d5-41f9-ad56-3633e2588da7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:54.776273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cba5aa3-37d5-41f9-ad56-3633e2588da7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:54.778501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cba5aa3-37d5-41f9-ad56-3633e2588da7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.151241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8cba5aa3-37d5-41f9-ad56-3633e2588da7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.160812 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8cba5aa3-37d5-41f9-ad56-3633e2588da7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1689 microversion: 2.1 time: 0.408038 Jul 20 04:35:55.171763 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2498/4993] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:54 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1689 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:55.254670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e26daea9-a5ce-44f2-9547-df856f7708b7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:55.254670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e26daea9-a5ce-44f2-9547-df856f7708b7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:55.262746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e26daea9-a5ce-44f2-9547-df856f7708b7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.264757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e26daea9-a5ce-44f2-9547-df856f7708b7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.268131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e26daea9-a5ce-44f2-9547-df856f7708b7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.268808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e26daea9-a5ce-44f2-9547-df856f7708b7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.430410 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1f9d465b-7a98-4dae-a4e5-9572263d6e08 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1465 microversion: 2.1 time: 1.518744 Jul 20 04:35:55.444944 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2496/4994] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:53 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1465 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:55.618897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e26daea9-a5ce-44f2-9547-df856f7708b7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:55.631216 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e26daea9-a5ce-44f2-9547-df856f7708b7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.383069 Jul 20 04:35:55.633084 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2499/4995] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:55 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:55.984248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-55831e7c-31eb-4221-80d2-0dec0b38e27d req-9994662b-c896-469d-943e-ab496af9ba32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "name": "network-vif-unplugged", "status": "completed", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:56.022121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-55831e7c-31eb-4221-80d2-0dec0b38e27d req-9994662b-c896-469d-943e-ab496af9ba32 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.024835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-55831e7c-31eb-4221-80d2-0dec0b38e27d req-9994662b-c896-469d-943e-ab496af9ba32 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.082980 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-55831e7c-31eb-4221-80d2-0dec0b38e27d req-9994662b-c896-469d-943e-ab496af9ba32 service nova] Creating event network-vif-unplugged:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h1-760456-11 Jul 20 04:35:56.118704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-55831e7c-31eb-4221-80d2-0dec0b38e27d req-9994662b-c896-469d-943e-ab496af9ba32 service nova] Instance bb7497e6-1395-4095-aa68-18be3a46bfda is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:35:56.166810 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-55831e7c-31eb-4221-80d2-0dec0b38e27d req-9994662b-c896-469d-943e-ab496af9ba32 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.191179 Jul 20 04:35:56.168445 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2497/4996] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:56.189570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f18ec361-d1cf-4a76-a0ef-6cdd7288eaf9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:56.190807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f18ec361-d1cf-4a76-a0ef-6cdd7288eaf9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:56.204748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f18ec361-d1cf-4a76-a0ef-6cdd7288eaf9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.205216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f18ec361-d1cf-4a76-a0ef-6cdd7288eaf9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.206024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f18ec361-d1cf-4a76-a0ef-6cdd7288eaf9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.206504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f18ec361-d1cf-4a76-a0ef-6cdd7288eaf9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.452068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04ec8851-6d5e-4596-807b-9271176c4bd5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:56.452958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04ec8851-6d5e-4596-807b-9271176c4bd5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:56.480393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04ec8851-6d5e-4596-807b-9271176c4bd5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.480868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04ec8851-6d5e-4596-807b-9271176c4bd5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.489193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04ec8851-6d5e-4596-807b-9271176c4bd5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.490191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04ec8851-6d5e-4596-807b-9271176c4bd5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.766918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f18ec361-d1cf-4a76-a0ef-6cdd7288eaf9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:56.781055 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f18ec361-d1cf-4a76-a0ef-6cdd7288eaf9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1689 microversion: 2.1 time: 0.597475 Jul 20 04:35:56.784049 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2500/4997] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:56 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1689 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:56.800541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2bc9d51f-380e-4ed1-b31a-f347ceb58291 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:56.803756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2bc9d51f-380e-4ed1-b31a-f347ceb58291 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:56.820715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2bc9d51f-380e-4ed1-b31a-f347ceb58291 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.821314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2bc9d51f-380e-4ed1-b31a-f347ceb58291 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.822503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2bc9d51f-380e-4ed1-b31a-f347ceb58291 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:56.822963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2bc9d51f-380e-4ed1-b31a-f347ceb58291 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.137376 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04ec8851-6d5e-4596-807b-9271176c4bd5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1651 microversion: 2.1 time: 0.690125 Jul 20 04:35:57.140002 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2498/4998] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:56 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1651 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:57.157052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9383f53e-1e1c-44d5-9311-952c3b5c970a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:57.158069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9383f53e-1e1c-44d5-9311-952c3b5c970a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:57.167870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2bc9d51f-380e-4ed1-b31a-f347ceb58291 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:57.174053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9383f53e-1e1c-44d5-9311-952c3b5c970a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:57.174544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9383f53e-1e1c-44d5-9311-952c3b5c970a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.176030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9383f53e-1e1c-44d5-9311-952c3b5c970a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:57.176800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9383f53e-1e1c-44d5-9311-952c3b5c970a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.180759 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2bc9d51f-380e-4ed1-b31a-f347ceb58291 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.392366 Jul 20 04:35:57.192819 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2501/4999] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:56 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:57.537638 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9383f53e-1e1c-44d5-9311-952c3b5c970a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1651 microversion: 2.1 time: 0.385903 Jul 20 04:35:57.539660 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2499/5000] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:57 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1651 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:57.557009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8196c182-9f6b-4f0c-9c70-e4f2613e3dc8 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:57.557797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8196c182-9f6b-4f0c-9c70-e4f2613e3dc8 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:57.565637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8196c182-9f6b-4f0c-9c70-e4f2613e3dc8 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:57.566773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8196c182-9f6b-4f0c-9c70-e4f2613e3dc8 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.567814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8196c182-9f6b-4f0c-9c70-e4f2613e3dc8 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:57.568478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8196c182-9f6b-4f0c-9c70-e4f2613e3dc8 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.573083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:57.801374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cf809674-5755-45fc-a1ac-c4148e992d55 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:57.802181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cf809674-5755-45fc-a1ac-c4148e992d55 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:57.817879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf809674-5755-45fc-a1ac-c4148e992d55 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:57.818600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf809674-5755-45fc-a1ac-c4148e992d55 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:57.820113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf809674-5755-45fc-a1ac-c4148e992d55 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:57.820887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf809674-5755-45fc-a1ac-c4148e992d55 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:58.376492 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8196c182-9f6b-4f0c-9c70-e4f2613e3dc8 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1651 microversion: 2.1 time: 0.824316 Jul 20 04:35:58.386622 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2502/5001] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:57 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1651 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:58.397922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-47bcf9c8-7f36-4f44-8c79-89628b007d31 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:58.398070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cf809674-5755-45fc-a1ac-c4148e992d55 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:58.401718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-47bcf9c8-7f36-4f44-8c79-89628b007d31 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:58.413692 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cf809674-5755-45fc-a1ac-c4148e992d55 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1689 microversion: 2.1 time: 0.616326 Jul 20 04:35:58.420271 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2500/5002] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:57 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1689 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:58.436834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3916908c-be83-44c9-9b60-99810c627fcc req-346a945b-779c-4065-92b8-568a871bdcc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:58.445820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47bcf9c8-7f36-4f44-8c79-89628b007d31 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:58.446309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47bcf9c8-7f36-4f44-8c79-89628b007d31 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:58.447118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47bcf9c8-7f36-4f44-8c79-89628b007d31 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:58.447565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47bcf9c8-7f36-4f44-8c79-89628b007d31 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:58.503130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3916908c-be83-44c9-9b60-99810c627fcc req-346a945b-779c-4065-92b8-568a871bdcc3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:58.503604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3916908c-be83-44c9-9b60-99810c627fcc req-346a945b-779c-4065-92b8-568a871bdcc3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:58.541844 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3916908c-be83-44c9-9b60-99810c627fcc req-346a945b-779c-4065-92b8-568a871bdcc3 service nova] Creating event network-changed:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h1-760456-11 Jul 20 04:35:58.573844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-3916908c-be83-44c9-9b60-99810c627fcc req-346a945b-779c-4065-92b8-568a871bdcc3 service nova] Instance bb7497e6-1395-4095-aa68-18be3a46bfda is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:35:58.620329 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3916908c-be83-44c9-9b60-99810c627fcc req-346a945b-779c-4065-92b8-568a871bdcc3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193392 Jul 20 04:35:58.625124 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2501/5003] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:58.633203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1396784270", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "availability_zone": "nova:n-h2-760456-11", "networks": [{"uuid": "b040f2fa-4733-407d-ab06-fba285abf64e"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:58.824631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] validate_networks() for [('b040f2fa-4733-407d-ab06-fba285abf64e', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:35:58.893303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-47bcf9c8-7f36-4f44-8c79-89628b007d31 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:58.908508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-47bcf9c8-7f36-4f44-8c79-89628b007d31 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1512 microversion: 2.1 time: 0.520093 Jul 20 04:35:58.909256 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2503/5004] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:58 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1512 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:58.923295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1822504422", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "383b582b-f62e-45d5-8b36-660b1731bf20"}], "security_groups": [{"name": "tempest-securitygroup--642675978"}], "key_name": "tempest-keypair-1671164215", "user_data": "}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:59.179153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] validate_networks() for [('383b582b-f62e-45d5-8b36-660b1731bf20', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:35:59.970044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:35:59.970531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:35:59.970995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:35:59.971469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:35:59.971831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:35:59.982893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:59.983716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:59.984769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:59.985443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:59.994118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:35:59.994680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:35:59.995051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:35:59.995468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:35:59.995886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:00.008521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Getting quotas for project 807dde3249374e86829b268f5f257d59. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:00.012996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.013452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.015428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.020295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.024080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Getting quotas for user e205324b8bea47e9aa5ce2ce13fa3e94 and project 807dde3249374e86829b268f5f257d59. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:00.041273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:00.045636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:00.053935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for project e104a7716d8549cb8b99560ac90150c6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:00.068362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for user 4bd10ebbd2fd4ef693e15194c2d8912c and project e104a7716d8549cb8b99560ac90150c6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:00.099887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:00.110733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:00.157115 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97653001-e0a3-4318-93ed-8292b81ec59a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.524276 Jul 20 04:36:00.158861 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2502/5005] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:35:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:00.166323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-326ae99a-2181-4b9f-8e20-f3d3e98ae3a7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:00.167273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-326ae99a-2181-4b9f-8e20-f3d3e98ae3a7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:00.177290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-326ae99a-2181-4b9f-8e20-f3d3e98ae3a7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.178795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-326ae99a-2181-4b9f-8e20-f3d3e98ae3a7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.180426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-326ae99a-2181-4b9f-8e20-f3d3e98ae3a7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.181266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-326ae99a-2181-4b9f-8e20-f3d3e98ae3a7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.216476 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ccb30f0-bc2f-4646-a0eb-9a8db5acd392 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.305695 Jul 20 04:36:00.222753 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2504/5006] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:35:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:00.228374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:00.255593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-11364d58-d732-43dc-b576-6f2a39fe751d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:00.256425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-11364d58-d732-43dc-b576-6f2a39fe751d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:00.281508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11364d58-d732-43dc-b576-6f2a39fe751d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.281977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11364d58-d732-43dc-b576-6f2a39fe751d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.282812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11364d58-d732-43dc-b576-6f2a39fe751d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.283259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-11364d58-d732-43dc-b576-6f2a39fe751d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.567499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-326ae99a-2181-4b9f-8e20-f3d3e98ae3a7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:00.598433 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-326ae99a-2181-4b9f-8e20-f3d3e98ae3a7 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1689 microversion: 2.1 time: 0.434608 Jul 20 04:36:00.601522 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2503/5007] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:00 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1689 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:00.610593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f12337f9-a3db-4b18-b304-53e393d25bbf tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:00.615459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f12337f9-a3db-4b18-b304-53e393d25bbf tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:00.817186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-11364d58-d732-43dc-b576-6f2a39fe751d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:00.826159 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-11364d58-d732-43dc-b576-6f2a39fe751d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1489 microversion: 2.1 time: 0.600196 Jul 20 04:36:00.842745 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2505/5008] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:00 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1489 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:00.859277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b8b16eae-04ad-4f59-ba71-241fdbe1bb4a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:00.864732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b8b16eae-04ad-4f59-ba71-241fdbe1bb4a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:00.929301 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f12337f9-a3db-4b18-b304-53e393d25bbf tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1329 microversion: 2.1 time: 0.324997 Jul 20 04:36:00.929920 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2504/5009] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:00 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1329 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:00.952382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b6399a4b-b39a-46b8-97ac-faa51a23264a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-809533794"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:00.958239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b6399a4b-b39a-46b8-97ac-faa51a23264a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:00.982190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6399a4b-b39a-46b8-97ac-faa51a23264a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.983418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6399a4b-b39a-46b8-97ac-faa51a23264a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.984270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6399a4b-b39a-46b8-97ac-faa51a23264a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.996092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6399a4b-b39a-46b8-97ac-faa51a23264a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.020224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b8b16eae-04ad-4f59-ba71-241fdbe1bb4a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.029213 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b8b16eae-04ad-4f59-ba71-241fdbe1bb4a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1242 microversion: 2.1 time: 0.185188 Jul 20 04:36:01.031008 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2506/5010] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:00 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1242 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:01.217644 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b6399a4b-b39a-46b8-97ac-faa51a23264a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "PUT /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1061 microversion: 2.1 time: 0.278610 Jul 20 04:36:01.218351 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2505/5011] 10.222.0.59 () {60 vars in 1255 bytes} [Wed Jul 20 04:36:00 2022] PUT /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1061 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:01.236117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d32978b1-97bf-4056-87c4-ba979cdac894 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:01.237156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d32978b1-97bf-4056-87c4-ba979cdac894 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:01.245683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d32978b1-97bf-4056-87c4-ba979cdac894 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.246183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d32978b1-97bf-4056-87c4-ba979cdac894 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.282116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d32978b1-97bf-4056-87c4-ba979cdac894 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.291803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d32978b1-97bf-4056-87c4-ba979cdac894 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.603346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d32978b1-97bf-4056-87c4-ba979cdac894 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.614124 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d32978b1-97bf-4056-87c4-ba979cdac894 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1488 microversion: 2.1 time: 0.380913 Jul 20 04:36:01.620159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-11234a56-cc8e-4bbf-8964-061cbb00a189 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:01.621003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-11234a56-cc8e-4bbf-8964-061cbb00a189 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:01.635335 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2507/5012] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:01 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1488 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:01.639703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11234a56-cc8e-4bbf-8964-061cbb00a189 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.640309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11234a56-cc8e-4bbf-8964-061cbb00a189 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.646144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11234a56-cc8e-4bbf-8964-061cbb00a189 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.647291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3bb18e3-b715-41a8-ade0-c11b7717641e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:01.647728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11234a56-cc8e-4bbf-8964-061cbb00a189 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.650781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e3bb18e3-b715-41a8-ade0-c11b7717641e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:01.681781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3bb18e3-b715-41a8-ade0-c11b7717641e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.682442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3bb18e3-b715-41a8-ade0-c11b7717641e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.683889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3bb18e3-b715-41a8-ade0-c11b7717641e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.684696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3bb18e3-b715-41a8-ade0-c11b7717641e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.952689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3bb18e3-b715-41a8-ade0-c11b7717641e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.962886 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e3bb18e3-b715-41a8-ade0-c11b7717641e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1488 microversion: 2.1 time: 0.326072 Jul 20 04:36:01.975866 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2508/5013] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:01 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1488 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:01.991217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a2b11761-c54a-4aaf-af9b-548becafa536 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:01.994035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a2b11761-c54a-4aaf-af9b-548becafa536 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:02.003711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2b11761-c54a-4aaf-af9b-548becafa536 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.004341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2b11761-c54a-4aaf-af9b-548becafa536 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.005439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2b11761-c54a-4aaf-af9b-548becafa536 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.005953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2b11761-c54a-4aaf-af9b-548becafa536 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.115783 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a2b11761-c54a-4aaf-af9b-548becafa536 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1418 microversion: 2.1 time: 0.138129 Jul 20 04:36:02.117299 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2509/5014] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:01 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1418 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:02.138152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1323d06c-eab0-469f-b3bc-5020e817a40a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:02.139014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1323d06c-eab0-469f-b3bc-5020e817a40a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:02.148334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1323d06c-eab0-469f-b3bc-5020e817a40a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.149140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1323d06c-eab0-469f-b3bc-5020e817a40a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.150346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1323d06c-eab0-469f-b3bc-5020e817a40a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.151013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1323d06c-eab0-469f-b3bc-5020e817a40a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.191591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1323d06c-eab0-469f-b3bc-5020e817a40a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:36:02.366358 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1323d06c-eab0-469f-b3bc-5020e817a40a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 204 len: 0 microversion: 2.1 time: 0.247486 Jul 20 04:36:02.371560 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2510/5015] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:02 2022] DELETE /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:02.380347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f875a31-ada7-43eb-93d2-b5a8c318adcb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:02.381507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f875a31-ada7-43eb-93d2-b5a8c318adcb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:02.396940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f875a31-ada7-43eb-93d2-b5a8c318adcb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.397802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f875a31-ada7-43eb-93d2-b5a8c318adcb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.401137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f875a31-ada7-43eb-93d2-b5a8c318adcb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.402079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f875a31-ada7-43eb-93d2-b5a8c318adcb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.578592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5f875a31-ada7-43eb-93d2-b5a8c318adcb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:02.589782 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f875a31-ada7-43eb-93d2-b5a8c318adcb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1302 microversion: 2.1 time: 0.216488 Jul 20 04:36:02.593041 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2511/5016] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:02 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1302 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:02.604547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-69fc8090-de49-4d83-9d9a-b9f48cdc1a15 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:02.605579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-69fc8090-de49-4d83-9d9a-b9f48cdc1a15 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:02.613802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69fc8090-de49-4d83-9d9a-b9f48cdc1a15 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.614612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69fc8090-de49-4d83-9d9a-b9f48cdc1a15 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.615686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69fc8090-de49-4d83-9d9a-b9f48cdc1a15 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:02.616351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69fc8090-de49-4d83-9d9a-b9f48cdc1a15 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:02.857268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-11234a56-cc8e-4bbf-8964-061cbb00a189 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:02.871175 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-11234a56-cc8e-4bbf-8964-061cbb00a189 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1682 microversion: 2.1 time: 1.252959 Jul 20 04:36:02.872070 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2506/5017] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:01 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1682 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:02.876118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-69fc8090-de49-4d83-9d9a-b9f48cdc1a15 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:02.893619 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-69fc8090-de49-4d83-9d9a-b9f48cdc1a15 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1494 microversion: 2.1 time: 0.298754 Jul 20 04:36:02.907601 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2512/5018] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:02 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1494 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:03.138985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db368ee0-5085-4bde-99e3-f2ab3f824158 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:03.140094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-db368ee0-5085-4bde-99e3-f2ab3f824158 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:03.154528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db368ee0-5085-4bde-99e3-f2ab3f824158 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.155887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db368ee0-5085-4bde-99e3-f2ab3f824158 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.156940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db368ee0-5085-4bde-99e3-f2ab3f824158 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.157464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db368ee0-5085-4bde-99e3-f2ab3f824158 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.305261 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-db368ee0-5085-4bde-99e3-f2ab3f824158 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1436 microversion: 2.1 time: 0.172181 Jul 20 04:36:03.306500 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2507/5019] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:03 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1436 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:03.609427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e941633a-01fc-4dcf-9d94-e63ead61df46 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:03.610864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e941633a-01fc-4dcf-9d94-e63ead61df46 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:03.620142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e941633a-01fc-4dcf-9d94-e63ead61df46 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.620895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e941633a-01fc-4dcf-9d94-e63ead61df46 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.621979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e941633a-01fc-4dcf-9d94-e63ead61df46 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.622662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e941633a-01fc-4dcf-9d94-e63ead61df46 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.783468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e941633a-01fc-4dcf-9d94-e63ead61df46 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:03.794601 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e941633a-01fc-4dcf-9d94-e63ead61df46 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1302 microversion: 2.1 time: 0.189955 Jul 20 04:36:03.810362 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2513/5020] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:03 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1302 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:03.910463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26fa8095-5984-41fa-a8f9-747ceeb261e8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:03.911107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26fa8095-5984-41fa-a8f9-747ceeb261e8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:03.923317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26fa8095-5984-41fa-a8f9-747ceeb261e8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.928049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26fa8095-5984-41fa-a8f9-747ceeb261e8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:03.929175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26fa8095-5984-41fa-a8f9-747ceeb261e8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:03.929806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26fa8095-5984-41fa-a8f9-747ceeb261e8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.325500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f749f391-536b-4e4d-befd-c077f5a849f5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:04.326123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f749f391-536b-4e4d-befd-c077f5a849f5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:04.329228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:04.345413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f749f391-536b-4e4d-befd-c077f5a849f5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.346272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f749f391-536b-4e4d-befd-c077f5a849f5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.347577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f749f391-536b-4e4d-befd-c077f5a849f5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.348716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f749f391-536b-4e4d-befd-c077f5a849f5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.487558 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f749f391-536b-4e4d-befd-c077f5a849f5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1424 microversion: 2.1 time: 0.165474 Jul 20 04:36:04.488352 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2514/5021] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:04 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1424 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:04.601075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-26fa8095-5984-41fa-a8f9-747ceeb261e8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:04.613737 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26fa8095-5984-41fa-a8f9-747ceeb261e8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1494 microversion: 2.1 time: 0.707191 Jul 20 04:36:04.631669 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2508/5022] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:03 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1494 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:04.817894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3560cbdb-3a8d-48ab-b83e-6f8480f00a34 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:04.819164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3560cbdb-3a8d-48ab-b83e-6f8480f00a34 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:04.835534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3560cbdb-3a8d-48ab-b83e-6f8480f00a34 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.838832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3560cbdb-3a8d-48ab-b83e-6f8480f00a34 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.841251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3560cbdb-3a8d-48ab-b83e-6f8480f00a34 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.845698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3560cbdb-3a8d-48ab-b83e-6f8480f00a34 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.295314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3560cbdb-3a8d-48ab-b83e-6f8480f00a34 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:05.314327 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3560cbdb-3a8d-48ab-b83e-6f8480f00a34 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1300 microversion: 2.1 time: 0.501366 Jul 20 04:36:05.322938 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2515/5023] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:04 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1300 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:05.470914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ac976380-2af1-43ef-8308-cda1f647f623 req-0647c6a4-4b77-4169-88e5-3bd1a8fc901f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5229e5-01ae-4896-b875-76928481b04d", "name": "network-vif-deleted", "tag": "2f2a65b6-8e36-4bbf-aec8-a65e0ccc1ef5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:05.493375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ac976380-2af1-43ef-8308-cda1f647f623 req-0647c6a4-4b77-4169-88e5-3bd1a8fc901f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.505510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ac976380-2af1-43ef-8308-cda1f647f623 req-0647c6a4-4b77-4169-88e5-3bd1a8fc901f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.505749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea9d0471-4033-4f83-9f26-77dc0c52f535 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:05.506311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ea9d0471-4033-4f83-9f26-77dc0c52f535 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:05.516938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea9d0471-4033-4f83-9f26-77dc0c52f535 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.517398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea9d0471-4033-4f83-9f26-77dc0c52f535 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.518283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea9d0471-4033-4f83-9f26-77dc0c52f535 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.518733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea9d0471-4033-4f83-9f26-77dc0c52f535 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.538616 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ac976380-2af1-43ef-8308-cda1f647f623 req-0647c6a4-4b77-4169-88e5-3bd1a8fc901f service nova] Creating event network-vif-deleted:2f2a65b6-8e36-4bbf-aec8-a65e0ccc1ef5 for instance ad5229e5-01ae-4896-b875-76928481b04d on n-h2-760456-11 Jul 20 04:36:05.548311 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ac976380-2af1-43ef-8308-cda1f647f623 req-0647c6a4-4b77-4169-88e5-3bd1a8fc901f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082158 Jul 20 04:36:05.554893 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2509/5024] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:05.637893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:05.640612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:05.645029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:05.665853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.670552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.672366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.674456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.771889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.775065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.783905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lazy-loading 'fault' on Instance uuid ad5229e5-01ae-4896-b875-76928481b04d {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:36:05.896753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:05.907789 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d59024e1-7932-4b26-95a2-56bc7c7df58b tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 200 len: 1309 microversion: 2.1 time: 0.276444 Jul 20 04:36:05.923256 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2510/5025] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:05 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 1309 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:06.331174 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ea9d0471-4033-4f83-9f26-77dc0c52f535 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1466 microversion: 2.1 time: 0.821606 Jul 20 04:36:06.336692 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2516/5026] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:05 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1466 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:06.354983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08986013-3920-49de-980e-dd356514d23a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:06.355918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-08986013-3920-49de-980e-dd356514d23a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:06.369281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08986013-3920-49de-980e-dd356514d23a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:06.371062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08986013-3920-49de-980e-dd356514d23a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:06.374127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08986013-3920-49de-980e-dd356514d23a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:06.375627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08986013-3920-49de-980e-dd356514d23a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:06.792694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-754178d6-9b0e-4d5f-a1fe-7e6e9759c901 req-295e73e1-c2b7-4f8e-8bda-56629a45b368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "name": "network-vif-plugged", "status": "completed", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:06.808277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-754178d6-9b0e-4d5f-a1fe-7e6e9759c901 req-295e73e1-c2b7-4f8e-8bda-56629a45b368 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:06.808739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-754178d6-9b0e-4d5f-a1fe-7e6e9759c901 req-295e73e1-c2b7-4f8e-8bda-56629a45b368 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:06.859906 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-754178d6-9b0e-4d5f-a1fe-7e6e9759c901 req-295e73e1-c2b7-4f8e-8bda-56629a45b368 service nova] Creating event network-vif-plugged:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h1-760456-11 Jul 20 04:36:06.873179 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-754178d6-9b0e-4d5f-a1fe-7e6e9759c901 req-295e73e1-c2b7-4f8e-8bda-56629a45b368 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085001 Jul 20 04:36:06.875960 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2517/5027] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:06.931995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-304ad3f4-2a31-4546-847c-30b000f76889 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:06.932903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-304ad3f4-2a31-4546-847c-30b000f76889 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:06.948839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-304ad3f4-2a31-4546-847c-30b000f76889 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:06.949570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-304ad3f4-2a31-4546-847c-30b000f76889 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:06.950981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-08986013-3920-49de-980e-dd356514d23a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:06.955732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-304ad3f4-2a31-4546-847c-30b000f76889 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:06.956749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-304ad3f4-2a31-4546-847c-30b000f76889 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:06.959994 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08986013-3920-49de-980e-dd356514d23a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1367 microversion: 2.1 time: 0.610286 Jul 20 04:36:06.965457 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2511/5028] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:06 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1367 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:07.010451 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-304ad3f4-2a31-4546-847c-30b000f76889 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-304ad3f4-2a31-4546-847c-30b000f76889 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d HTTP/1.1 Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'ad5229e5-01ae-4896-b875-76928481b04d'} Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.012864 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.018268 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.018268 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.018268 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.018268 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.018268 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.018268 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.020708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-304ad3f4-2a31-4546-847c-30b000f76889 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.021762 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-304ad3f4-2a31-4546-847c-30b000f76889 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 404 len: 111 microversion: 2.1 time: 0.094488 Jul 20 04:36:07.022619 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2518/5029] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:06 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:07.055381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32650649-a7f0-435e-9edc-dceac746e0da tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.056320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-32650649-a7f0-435e-9edc-dceac746e0da tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.072203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32650649-a7f0-435e-9edc-dceac746e0da tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.074545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32650649-a7f0-435e-9edc-dceac746e0da tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.119454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32650649-a7f0-435e-9edc-dceac746e0da tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.120679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32650649-a7f0-435e-9edc-dceac746e0da tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.151949 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-32650649-a7f0-435e-9edc-dceac746e0da tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32650649-a7f0-435e-9edc-dceac746e0da tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d HTTP/1.1 Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'ad5229e5-01ae-4896-b875-76928481b04d'} Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.153733 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.158804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.158804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.158804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.158804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.158804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.158804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.158804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.158804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.158804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.158804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.163049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32650649-a7f0-435e-9edc-dceac746e0da tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.163651 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-32650649-a7f0-435e-9edc-dceac746e0da tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 404 len: 111 microversion: 2.1 time: 0.113555 Jul 20 04:36:07.164485 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2512/5030] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:07 2022] DELETE /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:07.172995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7797acdc-016d-4e4d-be87-baf78c76ca6f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.174501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7797acdc-016d-4e4d-be87-baf78c76ca6f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ad5229e5-01ae-4896-b875-76928481b04d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.189125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7797acdc-016d-4e4d-be87-baf78c76ca6f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.189788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7797acdc-016d-4e4d-be87-baf78c76ca6f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.190838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7797acdc-016d-4e4d-be87-baf78c76ca6f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.191430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7797acdc-016d-4e4d-be87-baf78c76ca6f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.210153 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-7797acdc-016d-4e4d-be87-baf78c76ca6f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7797acdc-016d-4e4d-be87-baf78c76ca6f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d HTTP/1.1 Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'ad5229e5-01ae-4896-b875-76928481b04d'} Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.213181 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.218086 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.218086 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.218086 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.218086 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.218086 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. Jul 20 04:36:07.218086 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.219362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7797acdc-016d-4e4d-be87-baf78c76ca6f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance ad5229e5-01ae-4896-b875-76928481b04d could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.219362 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7797acdc-016d-4e4d-be87-baf78c76ca6f tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d" status: 404 len: 111 microversion: 2.1 time: 0.050839 Jul 20 04:36:07.220297 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2519/5031] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/ad5229e5-01ae-4896-b875-76928481b04d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:07.229796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c761f3c-45e0-49c7-8089-e0fbc0ce935d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.229796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2c761f3c-45e0-49c7-8089-e0fbc0ce935d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.244688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c761f3c-45e0-49c7-8089-e0fbc0ce935d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.245901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c761f3c-45e0-49c7-8089-e0fbc0ce935d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.247626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c761f3c-45e0-49c7-8089-e0fbc0ce935d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.248135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c761f3c-45e0-49c7-8089-e0fbc0ce935d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.283212 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-2c761f3c-45e0-49c7-8089-e0fbc0ce935d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c761f3c-45e0-49c7-8089-e0fbc0ce935d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 HTTP/1.1 Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '429983ee-b096-47a4-b048-cab7b4324849'} Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.286990 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.294762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c761f3c-45e0-49c7-8089-e0fbc0ce935d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.297972 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c761f3c-45e0-49c7-8089-e0fbc0ce935d tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 404 len: 111 microversion: 2.1 time: 0.072672 Jul 20 04:36:07.299292 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2513/5032] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:07 2022] DELETE /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:07.317613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f496385-a297-429a-9722-b34a28afb943 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.319173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1f496385-a297-429a-9722-b34a28afb943 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 429983ee-b096-47a4-b048-cab7b4324849] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.330221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f496385-a297-429a-9722-b34a28afb943 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.333256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f496385-a297-429a-9722-b34a28afb943 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.336200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f496385-a297-429a-9722-b34a28afb943 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.339713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f496385-a297-429a-9722-b34a28afb943 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.356848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fe85fd25-2570-4fc8-b0af-4008eef8ea8e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.358813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fe85fd25-2570-4fc8-b0af-4008eef8ea8e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.375652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe85fd25-2570-4fc8-b0af-4008eef8ea8e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.376308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe85fd25-2570-4fc8-b0af-4008eef8ea8e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.377286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe85fd25-2570-4fc8-b0af-4008eef8ea8e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.377891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe85fd25-2570-4fc8-b0af-4008eef8ea8e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.391605 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-1f496385-a297-429a-9722-b34a28afb943 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f496385-a297-429a-9722-b34a28afb943 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 HTTP/1.1 Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '429983ee-b096-47a4-b048-cab7b4324849'} Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.396805 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.405681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.405681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.405681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.405681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.405681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. Jul 20 04:36:07.405681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.405681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f496385-a297-429a-9722-b34a28afb943 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance 429983ee-b096-47a4-b048-cab7b4324849 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.405681 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1f496385-a297-429a-9722-b34a28afb943 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849" status: 404 len: 111 microversion: 2.1 time: 0.096062 Jul 20 04:36:07.405681 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2520/5033] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/429983ee-b096-47a4-b048-cab7b4324849 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:07.418282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f05c9204-81fa-45a3-a4af-0bb069773eb4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.418809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f05c9204-81fa-45a3-a4af-0bb069773eb4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.427454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f05c9204-81fa-45a3-a4af-0bb069773eb4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.428848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f05c9204-81fa-45a3-a4af-0bb069773eb4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.429741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f05c9204-81fa-45a3-a4af-0bb069773eb4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.430190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f05c9204-81fa-45a3-a4af-0bb069773eb4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.450181 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-f05c9204-81fa-45a3-a4af-0bb069773eb4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f05c9204-81fa-45a3-a4af-0bb069773eb4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 HTTP/1.1 Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4'} Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.452400 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f05c9204-81fa-45a3-a4af-0bb069773eb4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f05c9204-81fa-45a3-a4af-0bb069773eb4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 404 len: 111 microversion: 2.1 time: 0.049361 Jul 20 04:36:07.461862 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2521/5034] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:07 2022] DELETE /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:07.463608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2245227f-b435-489c-8aa2-8b77d366f170 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.464104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2245227f-b435-489c-8aa2-8b77d366f170 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.472056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2245227f-b435-489c-8aa2-8b77d366f170 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.472670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2245227f-b435-489c-8aa2-8b77d366f170 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.473592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2245227f-b435-489c-8aa2-8b77d366f170 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.474041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2245227f-b435-489c-8aa2-8b77d366f170 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.479586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:07.496274 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-2245227f-b435-489c-8aa2-8b77d366f170 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2245227f-b435-489c-8aa2-8b77d366f170 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 HTTP/1.1 Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4'} Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.498170 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.505869 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.505869 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.505869 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.505869 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.505869 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. Jul 20 04:36:07.505869 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.505869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2245227f-b435-489c-8aa2-8b77d366f170 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance 3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.505869 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2245227f-b435-489c-8aa2-8b77d366f170 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4" status: 404 len: 111 microversion: 2.1 time: 0.040858 Jul 20 04:36:07.505869 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2522/5035] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/3ee4bf48-89f7-425e-a9ad-0a87cc0f88c4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:36:07.514633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c117b3b-529c-46b4-a515-312067d67215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.516841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c117b3b-529c-46b4-a515-312067d67215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.526911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c117b3b-529c-46b4-a515-312067d67215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.528354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c117b3b-529c-46b4-a515-312067d67215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.530181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c117b3b-529c-46b4-a515-312067d67215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.531220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c117b3b-529c-46b4-a515-312067d67215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.553766 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-3c117b3b-529c-46b4-a515-312067d67215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c117b3b-529c-46b4-a515-312067d67215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 HTTP/1.1 Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260'} Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.555588 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c117b3b-529c-46b4-a515-312067d67215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c117b3b-529c-46b4-a515-312067d67215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 404 len: 111 microversion: 2.1 time: 0.052094 Jul 20 04:36:07.561087 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2523/5036] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:07 2022] DELETE /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:07.569964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f2b2024-27ef-45ad-8691-42bc0be07c2a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.570688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1f2b2024-27ef-45ad-8691-42bc0be07c2a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.579232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f2b2024-27ef-45ad-8691-42bc0be07c2a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.579986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f2b2024-27ef-45ad-8691-42bc0be07c2a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.580850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f2b2024-27ef-45ad-8691-42bc0be07c2a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.582003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f2b2024-27ef-45ad-8691-42bc0be07c2a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.621989 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-1f2b2024-27ef-45ad-8691-42bc0be07c2a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f2b2024-27ef-45ad-8691-42bc0be07c2a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 HTTP/1.1 Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260'} Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.627180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.631759 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.631759 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.631759 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.631759 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.631759 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. Jul 20 04:36:07.631759 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.633899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f2b2024-27ef-45ad-8691-42bc0be07c2a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance 1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.635321 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1f2b2024-27ef-45ad-8691-42bc0be07c2a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260" status: 404 len: 111 microversion: 2.1 time: 0.072106 Jul 20 04:36:07.636135 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2524/5037] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/1331c2cb-d290-4b0c-8c5d-c3b8c1d9e260 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:07.662700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-40b20837-0857-4fc9-9c69-f00f5f3bdf26 req-fe0d03cb-e3a0-4020-a74c-81b8ab5cb64b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d92af308-68af-45ba-8589-c0766d212f47", "tag": "99cebc8a-f45f-4ffa-80d4-14ee7904bcfa"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:07.698286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-40b20837-0857-4fc9-9c69-f00f5f3bdf26 req-fe0d03cb-e3a0-4020-a74c-81b8ab5cb64b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.698746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-40b20837-0857-4fc9-9c69-f00f5f3bdf26 req-fe0d03cb-e3a0-4020-a74c-81b8ab5cb64b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.743128 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-40b20837-0857-4fc9-9c69-f00f5f3bdf26 req-fe0d03cb-e3a0-4020-a74c-81b8ab5cb64b service nova] Creating event network-changed:99cebc8a-f45f-4ffa-80d4-14ee7904bcfa for instance d92af308-68af-45ba-8589-c0766d212f47 on n-h2-760456-11 Jul 20 04:36:07.750800 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-40b20837-0857-4fc9-9c69-f00f5f3bdf26 req-fe0d03cb-e3a0-4020-a74c-81b8ab5cb64b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113502 Jul 20 04:36:07.752019 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2525/5038] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:07.758455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d005b7d9-7eb8-4f8e-b1e5-9b4d2346b215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.759245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d005b7d9-7eb8-4f8e-b1e5-9b4d2346b215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.779722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d005b7d9-7eb8-4f8e-b1e5-9b4d2346b215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.780168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d005b7d9-7eb8-4f8e-b1e5-9b4d2346b215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.780977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d005b7d9-7eb8-4f8e-b1e5-9b4d2346b215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.781429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d005b7d9-7eb8-4f8e-b1e5-9b4d2346b215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.800122 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-d005b7d9-7eb8-4f8e-b1e5-9b4d2346b215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d005b7d9-7eb8-4f8e-b1e5-9b4d2346b215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 HTTP/1.1 Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c37f4e1e-e8c0-41ae-9bfa-e01910ea2985'} Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.815148 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d005b7d9-7eb8-4f8e-b1e5-9b4d2346b215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d005b7d9-7eb8-4f8e-b1e5-9b4d2346b215 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 404 len: 111 microversion: 2.1 time: 0.063488 Jul 20 04:36:07.819391 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2526/5039] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:07 2022] DELETE /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:07.826355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5b50b946-76a3-4e7b-822f-76324cd361a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.835880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5b50b946-76a3-4e7b-822f-76324cd361a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: c37f4e1e-e8c0-41ae-9bfa-e01910ea2985] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.863327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5b50b946-76a3-4e7b-822f-76324cd361a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.863808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5b50b946-76a3-4e7b-822f-76324cd361a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.864603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5b50b946-76a3-4e7b-822f-76324cd361a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.866169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5b50b946-76a3-4e7b-822f-76324cd361a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.921827 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-5b50b946-76a3-4e7b-822f-76324cd361a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5b50b946-76a3-4e7b-822f-76324cd361a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 HTTP/1.1 Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c37f4e1e-e8c0-41ae-9bfa-e01910ea2985'} Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.925638 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:07.930081 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:07.930081 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:07.930081 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:07.930081 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:07.930081 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. Jul 20 04:36:07.930081 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:07.933493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5b50b946-76a3-4e7b-822f-76324cd361a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:07.934620 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5b50b946-76a3-4e7b-822f-76324cd361a7 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985" status: 404 len: 111 microversion: 2.1 time: 0.112449 Jul 20 04:36:07.937389 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2527/5040] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/c37f4e1e-e8c0-41ae-9bfa-e01910ea2985 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:36:07.951965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c224f031-3987-40c7-b8e9-acd8480269ca tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.952706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c224f031-3987-40c7-b8e9-acd8480269ca tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.963306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c224f031-3987-40c7-b8e9-acd8480269ca tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.964017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c224f031-3987-40c7-b8e9-acd8480269ca tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.964985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c224f031-3987-40c7-b8e9-acd8480269ca tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.965750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c224f031-3987-40c7-b8e9-acd8480269ca tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.998923 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c224f031-3987-40c7-b8e9-acd8480269ca tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c224f031-3987-40c7-b8e9-acd8480269ca tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c HTTP/1.1 Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'ccc1ba40-3317-4f43-b0eb-f70d7b70278c'} Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:08.011448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:36:08.016559 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.016559 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:08.016559 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.016559 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.016559 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:08.016559 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:08.016559 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:08.016559 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:08.016559 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:36:08.016559 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.019193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c224f031-3987-40c7-b8e9-acd8480269ca tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:08.020290 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c224f031-3987-40c7-b8e9-acd8480269ca tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 404 len: 111 microversion: 2.1 time: 0.078963 Jul 20 04:36:08.021539 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2528/5041] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:07 2022] DELETE /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:36:08.028910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40a81c43-8e5e-4c78-af6b-eb5dda5ec89a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.030047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40a81c43-8e5e-4c78-af6b-eb5dda5ec89a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.045645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40a81c43-8e5e-4c78-af6b-eb5dda5ec89a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.046401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40a81c43-8e5e-4c78-af6b-eb5dda5ec89a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.047422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40a81c43-8e5e-4c78-af6b-eb5dda5ec89a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.048035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40a81c43-8e5e-4c78-af6b-eb5dda5ec89a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.209406 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fe85fd25-2570-4fc8-b0af-4008eef8ea8e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1466 microversion: 2.1 time: 0.856930 Jul 20 04:36:08.220849 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2514/5042] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1466 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:08.226198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-73ae4674-dfe9-4ade-8dcc-15d708b0f524 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.232293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-73ae4674-dfe9-4ade-8dcc-15d708b0f524 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: ccc1ba40-3317-4f43-b0eb-f70d7b70278c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.242531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73ae4674-dfe9-4ade-8dcc-15d708b0f524 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.246831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73ae4674-dfe9-4ade-8dcc-15d708b0f524 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.247836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73ae4674-dfe9-4ade-8dcc-15d708b0f524 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.248500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73ae4674-dfe9-4ade-8dcc-15d708b0f524 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.283631 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-73ae4674-dfe9-4ade-8dcc-15d708b0f524 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-73ae4674-dfe9-4ade-8dcc-15d708b0f524 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c HTTP/1.1 Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'ccc1ba40-3317-4f43-b0eb-f70d7b70278c'} Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.286341 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.290672 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:08.290672 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:08.290672 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:08.290672 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:08.290672 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. Jul 20 04:36:08.290672 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.292849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-73ae4674-dfe9-4ade-8dcc-15d708b0f524 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance ccc1ba40-3317-4f43-b0eb-f70d7b70278c could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:08.293744 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-73ae4674-dfe9-4ade-8dcc-15d708b0f524 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c" status: 404 len: 111 microversion: 2.1 time: 0.071562 Jul 20 04:36:08.298879 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2515/5043] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:08 2022] GET /compute/v2.1/servers/ccc1ba40-3317-4f43-b0eb-f70d7b70278c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:08.307565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c9dfef6-3c1d-4da2-879d-98df3c8f7d57 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.308195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9c9dfef6-3c1d-4da2-879d-98df3c8f7d57 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: d42c0a8b-0ae0-40f7-9019-d1e6462c532d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.319829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c9dfef6-3c1d-4da2-879d-98df3c8f7d57 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.320298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c9dfef6-3c1d-4da2-879d-98df3c8f7d57 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.321101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c9dfef6-3c1d-4da2-879d-98df3c8f7d57 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.321546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c9dfef6-3c1d-4da2-879d-98df3c8f7d57 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.365662 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-9c9dfef6-3c1d-4da2-879d-98df3c8f7d57 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c9dfef6-3c1d-4da2-879d-98df3c8f7d57 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d HTTP/1.1 Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'd42c0a8b-0ae0-40f7-9019-d1e6462c532d'} Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:08.367354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c9dfef6-3c1d-4da2-879d-98df3c8f7d57 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9c9dfef6-3c1d-4da2-879d-98df3c8f7d57 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d" status: 404 len: 111 microversion: 2.1 time: 0.069146 Jul 20 04:36:08.371596 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2516/5044] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:08 2022] DELETE /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:08.379654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-536232ca-7ffe-481f-b548-e21e25a085d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.380286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-536232ca-7ffe-481f-b548-e21e25a085d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: d42c0a8b-0ae0-40f7-9019-d1e6462c532d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.400050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-536232ca-7ffe-481f-b548-e21e25a085d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.400522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-536232ca-7ffe-481f-b548-e21e25a085d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.401325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-536232ca-7ffe-481f-b548-e21e25a085d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.401770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-536232ca-7ffe-481f-b548-e21e25a085d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.437312 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-536232ca-7ffe-481f-b548-e21e25a085d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-536232ca-7ffe-481f-b548-e21e25a085d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d HTTP/1.1 Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'd42c0a8b-0ae0-40f7-9019-d1e6462c532d'} Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.446707 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:08.451800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:08.451800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:08.451800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:08.451800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:08.451800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. Jul 20 04:36:08.451800 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:08.451800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-536232ca-7ffe-481f-b548-e21e25a085d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance d42c0a8b-0ae0-40f7-9019-d1e6462c532d could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:08.451800 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-536232ca-7ffe-481f-b548-e21e25a085d8 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d" status: 404 len: 111 microversion: 2.1 time: 0.072840 Jul 20 04:36:08.451800 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2517/5045] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:08 2022] GET /compute/v2.1/servers/d42c0a8b-0ae0-40f7-9019-d1e6462c532d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:08.465666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ebb2dda6-735e-4870-a4f6-e3b64b85066e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.466501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ebb2dda6-735e-4870-a4f6-e3b64b85066e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.475689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ebb2dda6-735e-4870-a4f6-e3b64b85066e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.476157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ebb2dda6-735e-4870-a4f6-e3b64b85066e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.476984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ebb2dda6-735e-4870-a4f6-e3b64b85066e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.477439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ebb2dda6-735e-4870-a4f6-e3b64b85066e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.512515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ebb2dda6-735e-4870-a4f6-e3b64b85066e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:36:08.542507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-40a81c43-8e5e-4c78-af6b-eb5dda5ec89a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:08.563131 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40a81c43-8e5e-4c78-af6b-eb5dda5ec89a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1367 microversion: 2.1 time: 0.540191 Jul 20 04:36:08.572853 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2529/5046] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:08 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1367 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:08.664777 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ebb2dda6-735e-4870-a4f6-e3b64b85066e tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 204 len: 0 microversion: 2.1 time: 0.205121 Jul 20 04:36:08.665887 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2518/5047] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:08 2022] DELETE /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:08.676974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-12526c6b-7103-4ce0-872c-d6594874240a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.677851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-12526c6b-7103-4ce0-872c-d6594874240a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.684596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12526c6b-7103-4ce0-872c-d6594874240a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.685210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12526c6b-7103-4ce0-872c-d6594874240a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.686377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12526c6b-7103-4ce0-872c-d6594874240a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.687185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12526c6b-7103-4ce0-872c-d6594874240a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.790601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb3c7dac-f9ad-4350-afa5-ea81e79892a4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:08.792127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb3c7dac-f9ad-4350-afa5-ea81e79892a4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.800625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb3c7dac-f9ad-4350-afa5-ea81e79892a4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.801264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb3c7dac-f9ad-4350-afa5-ea81e79892a4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.802500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb3c7dac-f9ad-4350-afa5-ea81e79892a4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.803414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb3c7dac-f9ad-4350-afa5-ea81e79892a4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.878533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-12526c6b-7103-4ce0-872c-d6594874240a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:08.887464 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-12526c6b-7103-4ce0-872c-d6594874240a tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1480 microversion: 2.1 time: 0.216267 Jul 20 04:36:08.888067 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2530/5048] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:08 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1480 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:09.227478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b792f24a-fe5f-4363-b8a2-496f1ca96ec6 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:09.228352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b792f24a-fe5f-4363-b8a2-496f1ca96ec6 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:09.244177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b792f24a-fe5f-4363-b8a2-496f1ca96ec6 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.247968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b792f24a-fe5f-4363-b8a2-496f1ca96ec6 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.249871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b792f24a-fe5f-4363-b8a2-496f1ca96ec6 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.250646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b792f24a-fe5f-4363-b8a2-496f1ca96ec6 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.523499 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b792f24a-fe5f-4363-b8a2-496f1ca96ec6 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1466 microversion: 2.1 time: 0.300097 Jul 20 04:36:09.545238 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2531/5049] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:09 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1466 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:09.599952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-49273d38-ce08-4e09-bd07-c343e3d1e5ec req-4726eaea-5856-4507-930d-b4560821a29f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f322d62d-5bc2-4095-b7f5-d298fbff201d", "tag": "0c73cf12-410e-4028-86d5-7571840bf274"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:09.619565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-49273d38-ce08-4e09-bd07-c343e3d1e5ec req-4726eaea-5856-4507-930d-b4560821a29f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.620018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-49273d38-ce08-4e09-bd07-c343e3d1e5ec req-4726eaea-5856-4507-930d-b4560821a29f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.643538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb3c7dac-f9ad-4350-afa5-ea81e79892a4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.647627 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-49273d38-ce08-4e09-bd07-c343e3d1e5ec req-4726eaea-5856-4507-930d-b4560821a29f service nova] Creating event network-changed:0c73cf12-410e-4028-86d5-7571840bf274 for instance f322d62d-5bc2-4095-b7f5-d298fbff201d on n-h2-760456-11 Jul 20 04:36:09.653011 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-49273d38-ce08-4e09-bd07-c343e3d1e5ec req-4726eaea-5856-4507-930d-b4560821a29f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106269 Jul 20 04:36:09.653847 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2532/5050] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:09.665341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd4a0a53-de2b-496d-8f09-254b5df0a695 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:09.665807 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb3c7dac-f9ad-4350-afa5-ea81e79892a4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.879112 Jul 20 04:36:09.666764 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2519/5051] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:08 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:09.668982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd4a0a53-de2b-496d-8f09-254b5df0a695 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:09.689017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fbe0e118-1edb-4705-97ba-5e27c7d27813 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:09.689669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fbe0e118-1edb-4705-97ba-5e27c7d27813 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:09.690380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd4a0a53-de2b-496d-8f09-254b5df0a695 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.690923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd4a0a53-de2b-496d-8f09-254b5df0a695 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.691801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd4a0a53-de2b-496d-8f09-254b5df0a695 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.694623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd4a0a53-de2b-496d-8f09-254b5df0a695 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.696583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe0e118-1edb-4705-97ba-5e27c7d27813 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.697395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe0e118-1edb-4705-97ba-5e27c7d27813 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.698593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe0e118-1edb-4705-97ba-5e27c7d27813 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.699256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe0e118-1edb-4705-97ba-5e27c7d27813 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.964854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbe0e118-1edb-4705-97ba-5e27c7d27813 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.976964 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fbe0e118-1edb-4705-97ba-5e27c7d27813 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.292633 Jul 20 04:36:09.988568 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2520/5052] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:09 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:10.010326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0216a2e2-3896-4d11-833a-e05d0434b908 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:10.011067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0216a2e2-3896-4d11-833a-e05d0434b908 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:10.023554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:10.031046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0216a2e2-3896-4d11-833a-e05d0434b908 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.032836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0216a2e2-3896-4d11-833a-e05d0434b908 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.033653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0216a2e2-3896-4d11-833a-e05d0434b908 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.034098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0216a2e2-3896-4d11-833a-e05d0434b908 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.041753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:10.136838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd4a0a53-de2b-496d-8f09-254b5df0a695 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:10.153347 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd4a0a53-de2b-496d-8f09-254b5df0a695 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1367 microversion: 2.1 time: 0.497232 Jul 20 04:36:10.157806 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2533/5053] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:09 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1367 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:10.169175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89142e92-e2a3-45f8-9590-6b867df426ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:10.171044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-89142e92-e2a3-45f8-9590-6b867df426ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:10.178431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89142e92-e2a3-45f8-9590-6b867df426ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.179900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89142e92-e2a3-45f8-9590-6b867df426ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.181036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89142e92-e2a3-45f8-9590-6b867df426ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.181677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89142e92-e2a3-45f8-9590-6b867df426ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.402145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89142e92-e2a3-45f8-9590-6b867df426ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:10.419216 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89142e92-e2a3-45f8-9590-6b867df426ff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.258830 Jul 20 04:36:10.420064 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2534/5054] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:10 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:10.436058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f283e40-c94f-4b4d-ad61-58710292d63d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:10.441420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f283e40-c94f-4b4d-ad61-58710292d63d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:10.458888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0216a2e2-3896-4d11-833a-e05d0434b908 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:10.462454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f283e40-c94f-4b4d-ad61-58710292d63d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.465513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f283e40-c94f-4b4d-ad61-58710292d63d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.467457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f283e40-c94f-4b4d-ad61-58710292d63d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.469874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f283e40-c94f-4b4d-ad61-58710292d63d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.471604 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0216a2e2-3896-4d11-833a-e05d0434b908 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1480 microversion: 2.1 time: 0.479926 Jul 20 04:36:10.472258 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2521/5055] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:09 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1480 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:10.541798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-620db671-6389-43de-9789-a792efde21c3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:10.543214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-620db671-6389-43de-9789-a792efde21c3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:10.550933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-620db671-6389-43de-9789-a792efde21c3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.551747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-620db671-6389-43de-9789-a792efde21c3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.553032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-620db671-6389-43de-9789-a792efde21c3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.553876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-620db671-6389-43de-9789-a792efde21c3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.577460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:10.918202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:10.962675 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-620db671-6389-43de-9789-a792efde21c3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1466 microversion: 2.1 time: 0.425301 Jul 20 04:36:10.964104 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2522/5056] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:10 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1466 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:11.025082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:11.174579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d4f9449-3bc6-4ade-a336-ddc06783362f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:11.175458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7d4f9449-3bc6-4ade-a336-ddc06783362f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:11.198117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d4f9449-3bc6-4ade-a336-ddc06783362f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.202853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d4f9449-3bc6-4ade-a336-ddc06783362f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.203836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d4f9449-3bc6-4ade-a336-ddc06783362f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.204301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d4f9449-3bc6-4ade-a336-ddc06783362f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.473536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5f283e40-c94f-4b4d-ad61-58710292d63d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:11.485448 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f283e40-c94f-4b4d-ad61-58710292d63d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 1.053900 Jul 20 04:36:11.486126 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2535/5057] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:10 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:11.522455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-64398d94-01a7-4d28-bb5a-d3e5a439c7e1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:11.523087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-64398d94-01a7-4d28-bb5a-d3e5a439c7e1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:11.530647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64398d94-01a7-4d28-bb5a-d3e5a439c7e1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.537510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64398d94-01a7-4d28-bb5a-d3e5a439c7e1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.538945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64398d94-01a7-4d28-bb5a-d3e5a439c7e1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.539603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-64398d94-01a7-4d28-bb5a-d3e5a439c7e1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.813434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7d4f9449-3bc6-4ade-a336-ddc06783362f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:11.832201 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d4f9449-3bc6-4ade-a336-ddc06783362f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1367 microversion: 2.1 time: 0.662553 Jul 20 04:36:11.843403 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2523/5058] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:11 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1367 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:11.854721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1890261442", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "4388b376-1cd5-454f-a519-55f9a04383ba"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:12.060056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] validate_networks() for [('4388b376-1cd5-454f-a519-55f9a04383ba', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:12.150320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-64398d94-01a7-4d28-bb5a-d3e5a439c7e1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:12.161564 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-64398d94-01a7-4d28-bb5a-d3e5a439c7e1 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1480 microversion: 2.1 time: 0.653135 Jul 20 04:36:12.162855 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2536/5059] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:11 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1480 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:12.167848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-070f3efe-9b90-4b0c-a097-fa55189b020e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:12.168713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-070f3efe-9b90-4b0c-a097-fa55189b020e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:12.178671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-070f3efe-9b90-4b0c-a097-fa55189b020e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.179523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-070f3efe-9b90-4b0c-a097-fa55189b020e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.181953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-070f3efe-9b90-4b0c-a097-fa55189b020e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.182686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-070f3efe-9b90-4b0c-a097-fa55189b020e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.604218 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-070f3efe-9b90-4b0c-a097-fa55189b020e tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1466 microversion: 2.1 time: 0.436733 Jul 20 04:36:12.618893 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2537/5060] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:12 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1466 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:12.869270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5a1f5ff3-a4e4-473b-8a02-06962eaf55f5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:12.870112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5a1f5ff3-a4e4-473b-8a02-06962eaf55f5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:12.895961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a1f5ff3-a4e4-473b-8a02-06962eaf55f5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.896428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a1f5ff3-a4e4-473b-8a02-06962eaf55f5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:12.897241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a1f5ff3-a4e4-473b-8a02-06962eaf55f5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:12.897988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a1f5ff3-a4e4-473b-8a02-06962eaf55f5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.378814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a1f5ff3-a4e4-473b-8a02-06962eaf55f5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:13.391249 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5a1f5ff3-a4e4-473b-8a02-06962eaf55f5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1367 microversion: 2.1 time: 0.540389 Jul 20 04:36:13.393078 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2538/5061] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:12 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:13.397803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f64f35b3-de5f-4177-8a02-87a393b33ef4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.398626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f64f35b3-de5f-4177-8a02-87a393b33ef4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:13.415666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f64f35b3-de5f-4177-8a02-87a393b33ef4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.416406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f64f35b3-de5f-4177-8a02-87a393b33ef4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.417356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f64f35b3-de5f-4177-8a02-87a393b33ef4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.417948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f64f35b3-de5f-4177-8a02-87a393b33ef4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.536326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:13.538491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:13.539567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:13.541654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:13.544513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:13.586187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.586845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f64f35b3-de5f-4177-8a02-87a393b33ef4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f224517836bf403a83da9e2e7f175907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53fc243b9d475caab3cd428bf51d2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:13.587218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.588363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.589792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.603976 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f64f35b3-de5f-4177-8a02-87a393b33ef4 tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 200 len: 1438 microversion: 2.1 time: 0.209762 Jul 20 04:36:13.604915 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2539/5062] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:13 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 1438 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:13.610954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4f96b0f5-1d0b-4e8b-8403-f5c87fa1701d req-caf5b076-2c69-4104-9033-18e58b8d16ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f", "name": "network-vif-deleted", "tag": "ccda5a64-d554-4528-8f90-8440290a063a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:13.630908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:13.633565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4f96b0f5-1d0b-4e8b-8403-f5c87fa1701d req-caf5b076-2c69-4104-9033-18e58b8d16ae service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.634038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4f96b0f5-1d0b-4e8b-8403-f5c87fa1701d req-caf5b076-2c69-4104-9033-18e58b8d16ae service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.654776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4f96b0f5-1d0b-4e8b-8403-f5c87fa1701d req-caf5b076-2c69-4104-9033-18e58b8d16ae service nova] Creating event network-vif-deleted:ccda5a64-d554-4528-8f90-8440290a063a for instance 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f on n-h2-760456-11 Jul 20 04:36:13.659939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for user a3a58233b2b044d9b1285b616c79f9b8 and project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:13.674585 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4f96b0f5-1d0b-4e8b-8403-f5c87fa1701d req-caf5b076-2c69-4104-9033-18e58b8d16ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068248 Jul 20 04:36:13.681702 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2540/5063] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:13.691365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c306c815-9c1e-477a-8426-e921b1a2ae16 req-3f610c45-8c84-44c9-b852-4c07e8664c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92af308-68af-45ba-8589-c0766d212f47", "name": "network-vif-plugged", "status": "completed", "tag": "99cebc8a-f45f-4ffa-80d4-14ee7904bcfa"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:13.699123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:13.713880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:13.714080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c306c815-9c1e-477a-8426-e921b1a2ae16 req-3f610c45-8c84-44c9-b852-4c07e8664c8c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.714472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c306c815-9c1e-477a-8426-e921b1a2ae16 req-3f610c45-8c84-44c9-b852-4c07e8664c8c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.748780 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c306c815-9c1e-477a-8426-e921b1a2ae16 req-3f610c45-8c84-44c9-b852-4c07e8664c8c service nova] Creating event network-vif-plugged:99cebc8a-f45f-4ffa-80d4-14ee7904bcfa for instance d92af308-68af-45ba-8589-c0766d212f47 on n-h2-760456-11 Jul 20 04:36:13.760349 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c306c815-9c1e-477a-8426-e921b1a2ae16 req-3f610c45-8c84-44c9-b852-4c07e8664c8c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073845 Jul 20 04:36:13.761582 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2541/5064] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:13.770033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c2d677d-604b-42ab-8b9b-8a4d2be1a5f3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.770711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8c2d677d-604b-42ab-8b9b-8a4d2be1a5f3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:13.784854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c2d677d-604b-42ab-8b9b-8a4d2be1a5f3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.787158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c2d677d-604b-42ab-8b9b-8a4d2be1a5f3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.787884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c2d677d-604b-42ab-8b9b-8a4d2be1a5f3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.788343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c2d677d-604b-42ab-8b9b-8a4d2be1a5f3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.914784 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72aef214-7e39-4410-b808-b5975150e021 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.069796 Jul 20 04:36:13.915917 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2524/5065] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:13.929726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9594b32-92f3-4c60-b23f-7a7a6adc64c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.931575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9594b32-92f3-4c60-b23f-7a7a6adc64c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:14.257606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9594b32-92f3-4c60-b23f-7a7a6adc64c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:14.272449 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9594b32-92f3-4c60-b23f-7a7a6adc64c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1215 microversion: 2.1 time: 0.347480 Jul 20 04:36:14.274796 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2525/5066] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:13 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1215 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:14.377064 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c2d677d-604b-42ab-8b9b-8a4d2be1a5f3 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1466 microversion: 2.1 time: 0.612634 Jul 20 04:36:14.381845 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2542/5067] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:13 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1466 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:14.414529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e1b76d24-849b-4446-9840-155596a3dc0b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:14.416669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e1b76d24-849b-4446-9840-155596a3dc0b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:14.436624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1b76d24-849b-4446-9840-155596a3dc0b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.437795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1b76d24-849b-4446-9840-155596a3dc0b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.439931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1b76d24-849b-4446-9840-155596a3dc0b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.441016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1b76d24-849b-4446-9840-155596a3dc0b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.629954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d3032ec-1ced-4611-91a1-06ecac5968ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:14.630928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4d3032ec-1ced-4611-91a1-06ecac5968ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] [instance: 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:14.656159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d3032ec-1ced-4611-91a1-06ecac5968ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.658819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d3032ec-1ced-4611-91a1-06ecac5968ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.660947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d3032ec-1ced-4611-91a1-06ecac5968ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.661841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d3032ec-1ced-4611-91a1-06ecac5968ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.687873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-4d3032ec-1ced-4611-91a1-06ecac5968ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] HTTP exception thrown: Instance 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f could not be found. Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d3032ec-1ced-4611-91a1-06ecac5968ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Request method failure captured: Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f HTTP/1.1 Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14VprtZdZkg1vouuz-zvU45SuDxQ5OGbnTDc8H9YJprZgdawRUQUqwpDCKRoeOtMq0kwRmpbuZG0kxtel9ivrRom6eb5wKSMGFi6fuSXSnk-pR6FMz5FW5lSHZEavJK3Wjb03AW7ZAtpgTmxsRQ0bKE3YQJK8uh7FZu8kWArmKZGUZo Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df53fc243b9d475caab3cd428bf51d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersTestJSON-1178902266 Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: df53fc243b9d475caab3cd428bf51d2f Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersTestJSON-1178902266 Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f224517836bf403a83da9e2e7f175907 Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersTestJSON-1178902266-project Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f could not be found. Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f'} Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f could not be found. Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f could not be found. Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:14.689993 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:14.693840 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:14.693840 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:14.693840 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:14.693840 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:14.693840 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f could not be found. Jul 20 04:36:14.693840 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:14.695850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d3032ec-1ced-4611-91a1-06ecac5968ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] Returning 404 to user: Instance 2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:14.697640 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4d3032ec-1ced-4611-91a1-06ecac5968ee tempest-ServersTestJSON-1178902266 tempest-ServersTestJSON-1178902266-project] 10.222.0.59 "GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f" status: 404 len: 111 microversion: 2.1 time: 0.080155 Jul 20 04:36:14.698788 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2543/5068] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:14 2022] GET /compute/v2.1/servers/2de4f6f3-27d7-4f30-b786-f6ae4ea5b30f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:36:14.972609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e1b76d24-849b-4446-9840-155596a3dc0b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:14.990909 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e1b76d24-849b-4446-9840-155596a3dc0b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1367 microversion: 2.1 time: 0.584480 Jul 20 04:36:14.992074 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2526/5069] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:14 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1367 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:15.291504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-279c3310-6e05-4e61-857b-219f37d7aa05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:15.292375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-279c3310-6e05-4e61-857b-219f37d7aa05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:15.324647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-279c3310-6e05-4e61-857b-219f37d7aa05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.328745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-279c3310-6e05-4e61-857b-219f37d7aa05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.329779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-279c3310-6e05-4e61-857b-219f37d7aa05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.331624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-279c3310-6e05-4e61-857b-219f37d7aa05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.410769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6ba0fde-d0f8-4f52-bdd2-ebc30f46cc90 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:15.411429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d6ba0fde-d0f8-4f52-bdd2-ebc30f46cc90 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:15.421806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6ba0fde-d0f8-4f52-bdd2-ebc30f46cc90 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.422290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6ba0fde-d0f8-4f52-bdd2-ebc30f46cc90 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.423082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6ba0fde-d0f8-4f52-bdd2-ebc30f46cc90 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.423535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6ba0fde-d0f8-4f52-bdd2-ebc30f46cc90 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.500310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-279c3310-6e05-4e61-857b-219f37d7aa05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:15.510430 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-279c3310-6e05-4e61-857b-219f37d7aa05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1267 microversion: 2.1 time: 0.223714 Jul 20 04:36:15.516417 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2544/5070] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:15 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:16.016721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c3198525-71fb-4346-b430-6829e83fef67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:16.019162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c3198525-71fb-4346-b430-6829e83fef67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:16.039394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3198525-71fb-4346-b430-6829e83fef67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.040042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3198525-71fb-4346-b430-6829e83fef67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.041011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3198525-71fb-4346-b430-6829e83fef67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.041543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3198525-71fb-4346-b430-6829e83fef67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.215947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c3198525-71fb-4346-b430-6829e83fef67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:16.227050 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c3198525-71fb-4346-b430-6829e83fef67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1558 microversion: 2.1 time: 0.219414 Jul 20 04:36:16.241335 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2545/5071] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:16 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1558 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:16.248393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80c9a136-3583-46c5-82c5-062429d4d54d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:16.249182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-80c9a136-3583-46c5-82c5-062429d4d54d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:16.256598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80c9a136-3583-46c5-82c5-062429d4d54d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.257331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80c9a136-3583-46c5-82c5-062429d4d54d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.258331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80c9a136-3583-46c5-82c5-062429d4d54d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.258937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80c9a136-3583-46c5-82c5-062429d4d54d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.288647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:16.368991 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-80c9a136-3583-46c5-82c5-062429d4d54d tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124412 Jul 20 04:36:16.369611 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2546/5072] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:36:16 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:16.534781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-189f9e50-1d12-432f-9ba2-bc4adf7a6bb9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:16.535417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-189f9e50-1d12-432f-9ba2-bc4adf7a6bb9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:16.548196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-189f9e50-1d12-432f-9ba2-bc4adf7a6bb9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.548921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-189f9e50-1d12-432f-9ba2-bc4adf7a6bb9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.550064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-189f9e50-1d12-432f-9ba2-bc4adf7a6bb9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.551797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-189f9e50-1d12-432f-9ba2-bc4adf7a6bb9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.668065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-189f9e50-1d12-432f-9ba2-bc4adf7a6bb9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:16.676153 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-189f9e50-1d12-432f-9ba2-bc4adf7a6bb9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1273 microversion: 2.1 time: 0.146998 Jul 20 04:36:16.684526 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2547/5073] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:16 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:16.741035 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d6ba0fde-d0f8-4f52-bdd2-ebc30f46cc90 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1466 microversion: 2.1 time: 1.345637 Jul 20 04:36:16.746574 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2527/5074] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:15 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1466 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:16.749304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-70d02e65-19e7-4458-b2d0-ef61a3ab3de3 req-4c2e5b9e-c150-4f75-88fd-00f57420563a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f322d62d-5bc2-4095-b7f5-d298fbff201d", "name": "network-vif-plugged", "status": "completed", "tag": "0c73cf12-410e-4028-86d5-7571840bf274"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:16.771639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-70d02e65-19e7-4458-b2d0-ef61a3ab3de3 req-4c2e5b9e-c150-4f75-88fd-00f57420563a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.772702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-70d02e65-19e7-4458-b2d0-ef61a3ab3de3 req-4c2e5b9e-c150-4f75-88fd-00f57420563a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.808170 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-70d02e65-19e7-4458-b2d0-ef61a3ab3de3 req-4c2e5b9e-c150-4f75-88fd-00f57420563a service nova] Creating event network-vif-plugged:0c73cf12-410e-4028-86d5-7571840bf274 for instance f322d62d-5bc2-4095-b7f5-d298fbff201d on n-h2-760456-11 Jul 20 04:36:16.819191 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-70d02e65-19e7-4458-b2d0-ef61a3ab3de3 req-4c2e5b9e-c150-4f75-88fd-00f57420563a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074293 Jul 20 04:36:16.819973 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2548/5075] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:17.694701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0141bde0-ee9d-4b39-a4cf-302658faf2f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:17.695680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0141bde0-ee9d-4b39-a4cf-302658faf2f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:17.703880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0141bde0-ee9d-4b39-a4cf-302658faf2f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:17.704646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0141bde0-ee9d-4b39-a4cf-302658faf2f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:17.705665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0141bde0-ee9d-4b39-a4cf-302658faf2f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:17.706379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0141bde0-ee9d-4b39-a4cf-302658faf2f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:17.760240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-47316d33-f049-4a48-aeda-f0ebf4c50973 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:17.760936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-47316d33-f049-4a48-aeda-f0ebf4c50973 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:17.774352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47316d33-f049-4a48-aeda-f0ebf4c50973 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:17.778977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47316d33-f049-4a48-aeda-f0ebf4c50973 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:17.781181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47316d33-f049-4a48-aeda-f0ebf4c50973 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:17.784492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47316d33-f049-4a48-aeda-f0ebf4c50973 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:17.947839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0141bde0-ee9d-4b39-a4cf-302658faf2f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:17.957208 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0141bde0-ee9d-4b39-a4cf-302658faf2f0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1273 microversion: 2.1 time: 0.267257 Jul 20 04:36:17.967411 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2528/5076] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:17 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:17.969062 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-47316d33-f049-4a48-aeda-f0ebf4c50973 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1466 microversion: 2.1 time: 0.209192 Jul 20 04:36:17.972930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f853fef4-d738-4ce0-8fa3-4b586aba6be8 req-7908f449-ddb2-435a-9383-6bdb16c9fcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d92af308-68af-45ba-8589-c0766d212f47", "tag": "99cebc8a-f45f-4ffa-80d4-14ee7904bcfa"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:17.973968 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2549/5077] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:17 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1466 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:17.995345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f853fef4-d738-4ce0-8fa3-4b586aba6be8 req-7908f449-ddb2-435a-9383-6bdb16c9fcd7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:17.996101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f853fef4-d738-4ce0-8fa3-4b586aba6be8 req-7908f449-ddb2-435a-9383-6bdb16c9fcd7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.016384 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f853fef4-d738-4ce0-8fa3-4b586aba6be8 req-7908f449-ddb2-435a-9383-6bdb16c9fcd7 service nova] Creating event network-changed:99cebc8a-f45f-4ffa-80d4-14ee7904bcfa for instance d92af308-68af-45ba-8589-c0766d212f47 on n-h2-760456-11 Jul 20 04:36:18.024236 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f853fef4-d738-4ce0-8fa3-4b586aba6be8 req-7908f449-ddb2-435a-9383-6bdb16c9fcd7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054631 Jul 20 04:36:18.026989 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2529/5078] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:18.974997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-600c04e7-2f20-4c3b-a2ff-ae54c6b52401 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:18.976274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-600c04e7-2f20-4c3b-a2ff-ae54c6b52401 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:18.985221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-600c04e7-2f20-4c3b-a2ff-ae54c6b52401 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.986403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-600c04e7-2f20-4c3b-a2ff-ae54c6b52401 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.987403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-600c04e7-2f20-4c3b-a2ff-ae54c6b52401 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.987848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-600c04e7-2f20-4c3b-a2ff-ae54c6b52401 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.991889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-10d0c7f0-75ea-4217-898d-15c581229ed5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:18.993304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-10d0c7f0-75ea-4217-898d-15c581229ed5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:19.012425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10d0c7f0-75ea-4217-898d-15c581229ed5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.013692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10d0c7f0-75ea-4217-898d-15c581229ed5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.015743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10d0c7f0-75ea-4217-898d-15c581229ed5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.016455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10d0c7f0-75ea-4217-898d-15c581229ed5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.069060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-600c04e7-2f20-4c3b-a2ff-ae54c6b52401 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:19.086720 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-600c04e7-2f20-4c3b-a2ff-ae54c6b52401 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1273 microversion: 2.1 time: 0.109386 Jul 20 04:36:19.086720 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2550/5079] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:18 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:19.465562 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-10d0c7f0-75ea-4217-898d-15c581229ed5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1651 microversion: 2.1 time: 0.474690 Jul 20 04:36:19.467941 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2530/5080] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:18 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1651 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:19.485583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e82caf20-51fa-43db-973e-080e4ad64d25 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:19.486238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e82caf20-51fa-43db-973e-080e4ad64d25 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:19.495705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e82caf20-51fa-43db-973e-080e4ad64d25 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.496345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e82caf20-51fa-43db-973e-080e4ad64d25 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.498735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e82caf20-51fa-43db-973e-080e4ad64d25 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.499876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e82caf20-51fa-43db-973e-080e4ad64d25 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:20.104852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-81325b71-0ca9-47c5-b89c-2fbf3bda0f05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:20.105483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-81325b71-0ca9-47c5-b89c-2fbf3bda0f05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:20.120322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81325b71-0ca9-47c5-b89c-2fbf3bda0f05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:20.130547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81325b71-0ca9-47c5-b89c-2fbf3bda0f05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:20.131749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81325b71-0ca9-47c5-b89c-2fbf3bda0f05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:20.132355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81325b71-0ca9-47c5-b89c-2fbf3bda0f05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:20.402936 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e82caf20-51fa-43db-973e-080e4ad64d25 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1651 microversion: 2.1 time: 0.921291 Jul 20 04:36:20.409524 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2551/5081] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:19 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1651 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:20.420992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d94e854-ae49-4dc8-9447-bc413102fa20 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:20.421867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d94e854-ae49-4dc8-9447-bc413102fa20 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:20.428857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d94e854-ae49-4dc8-9447-bc413102fa20 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:20.429541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d94e854-ae49-4dc8-9447-bc413102fa20 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:20.430528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d94e854-ae49-4dc8-9447-bc413102fa20 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:20.431133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d94e854-ae49-4dc8-9447-bc413102fa20 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:20.649086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-81325b71-0ca9-47c5-b89c-2fbf3bda0f05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:20.660817 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-81325b71-0ca9-47c5-b89c-2fbf3bda0f05 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1315 microversion: 2.1 time: 0.561820 Jul 20 04:36:20.663948 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2531/5082] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:20 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:20.947906 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d94e854-ae49-4dc8-9447-bc413102fa20 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1651 microversion: 2.1 time: 0.531239 Jul 20 04:36:20.948514 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2552/5083] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:20 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1651 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:20.972326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f62e9b52-a6f6-403f-a26d-4a4d945c2a39 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:20.974433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f62e9b52-a6f6-403f-a26d-4a4d945c2a39 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:20.996399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f62e9b52-a6f6-403f-a26d-4a4d945c2a39 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:20.996869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f62e9b52-a6f6-403f-a26d-4a4d945c2a39 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:20.997741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f62e9b52-a6f6-403f-a26d-4a4d945c2a39 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.006570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f62e9b52-a6f6-403f-a26d-4a4d945c2a39 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:21.114303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f62e9b52-a6f6-403f-a26d-4a4d945c2a39 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:36:21.366337 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f62e9b52-a6f6-403f-a26d-4a4d945c2a39 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "DELETE /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 204 len: 0 microversion: 2.1 time: 0.400012 Jul 20 04:36:21.367575 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2532/5084] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:20 2022] DELETE /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:21.381039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eeeb7809-dc59-49ef-a9c9-601f14012a66 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:21.382137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eeeb7809-dc59-49ef-a9c9-601f14012a66 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:21.413881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eeeb7809-dc59-49ef-a9c9-601f14012a66 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.414602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eeeb7809-dc59-49ef-a9c9-601f14012a66 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:21.415181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eeeb7809-dc59-49ef-a9c9-601f14012a66 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.415631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eeeb7809-dc59-49ef-a9c9-601f14012a66 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:21.681541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a9ad5b4c-4a6e-4f5a-8c7e-11fe4878215b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:21.682538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a9ad5b4c-4a6e-4f5a-8c7e-11fe4878215b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:21.696521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9ad5b4c-4a6e-4f5a-8c7e-11fe4878215b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.697419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9ad5b4c-4a6e-4f5a-8c7e-11fe4878215b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:21.698524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9ad5b4c-4a6e-4f5a-8c7e-11fe4878215b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.699192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9ad5b4c-4a6e-4f5a-8c7e-11fe4878215b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.098872 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eeeb7809-dc59-49ef-a9c9-601f14012a66 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1657 microversion: 2.1 time: 0.721318 Jul 20 04:36:22.109056 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2553/5085] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:21 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1657 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:22.109056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-6c24c2f6-c15c-49f9-999d-86391a2f2c65 req-c5002f11-7362-46c5-bd6f-2e2ded6e9284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19a30ca2-3a5c-42c2-9359-7d8553da3f33", "tag": "463b5dd6-01d7-4f84-b981-58adeeabd51c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:22.133156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6c24c2f6-c15c-49f9-999d-86391a2f2c65 req-c5002f11-7362-46c5-bd6f-2e2ded6e9284 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:22.133615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6c24c2f6-c15c-49f9-999d-86391a2f2c65 req-c5002f11-7362-46c5-bd6f-2e2ded6e9284 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.163637 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6c24c2f6-c15c-49f9-999d-86391a2f2c65 req-c5002f11-7362-46c5-bd6f-2e2ded6e9284 service nova] Creating event network-changed:463b5dd6-01d7-4f84-b981-58adeeabd51c for instance 19a30ca2-3a5c-42c2-9359-7d8553da3f33 on n-h1-760456-11 Jul 20 04:36:22.186828 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-6c24c2f6-c15c-49f9-999d-86391a2f2c65 req-c5002f11-7362-46c5-bd6f-2e2ded6e9284 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074152 Jul 20 04:36:22.187785 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2554/5086] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:22.282977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a9ad5b4c-4a6e-4f5a-8c7e-11fe4878215b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:22.292430 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a9ad5b4c-4a6e-4f5a-8c7e-11fe4878215b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1315 microversion: 2.1 time: 0.615083 Jul 20 04:36:22.303488 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2533/5087] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:21 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:23.118725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b2ccfb0d-b9a3-4241-9cad-3da49f5468c5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:23.120346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b2ccfb0d-b9a3-4241-9cad-3da49f5468c5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:23.131196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2ccfb0d-b9a3-4241-9cad-3da49f5468c5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:23.131730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2ccfb0d-b9a3-4241-9cad-3da49f5468c5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:23.132704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2ccfb0d-b9a3-4241-9cad-3da49f5468c5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:23.133339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2ccfb0d-b9a3-4241-9cad-3da49f5468c5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:23.319961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5beb50e7-6ee4-4f89-99b2-93dfe7b84693 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:23.323805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5beb50e7-6ee4-4f89-99b2-93dfe7b84693 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:23.351895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5beb50e7-6ee4-4f89-99b2-93dfe7b84693 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:23.352742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5beb50e7-6ee4-4f89-99b2-93dfe7b84693 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:23.354228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5beb50e7-6ee4-4f89-99b2-93dfe7b84693 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:23.355066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5beb50e7-6ee4-4f89-99b2-93dfe7b84693 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:23.615041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5beb50e7-6ee4-4f89-99b2-93dfe7b84693 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:23.651484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:23.658010 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5beb50e7-6ee4-4f89-99b2-93dfe7b84693 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1315 microversion: 2.1 time: 0.349883 Jul 20 04:36:23.679655 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2534/5088] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:23 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:24.206278 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b2ccfb0d-b9a3-4241-9cad-3da49f5468c5 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1657 microversion: 2.1 time: 1.093034 Jul 20 04:36:24.221240 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2555/5089] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:23 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1657 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:24.676871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0abf68de-47e7-4994-859d-a7a3abbddbbe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:24.677510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0abf68de-47e7-4994-859d-a7a3abbddbbe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:24.680045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:24.709645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0abf68de-47e7-4994-859d-a7a3abbddbbe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:24.710275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0abf68de-47e7-4994-859d-a7a3abbddbbe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.712194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0abf68de-47e7-4994-859d-a7a3abbddbbe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:24.714239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0abf68de-47e7-4994-859d-a7a3abbddbbe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.793603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c133a701-2816-488c-9314-54e48f209b40 req-928b3c54-7727-4b90-86df-19fbbdb2bd0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f322d62d-5bc2-4095-b7f5-d298fbff201d", "name": "network-vif-deleted", "tag": "0c73cf12-410e-4028-86d5-7571840bf274"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:24.804324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c133a701-2816-488c-9314-54e48f209b40 req-928b3c54-7727-4b90-86df-19fbbdb2bd0d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:24.805394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c133a701-2816-488c-9314-54e48f209b40 req-928b3c54-7727-4b90-86df-19fbbdb2bd0d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.852537 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c133a701-2816-488c-9314-54e48f209b40 req-928b3c54-7727-4b90-86df-19fbbdb2bd0d service nova] Creating event network-vif-deleted:0c73cf12-410e-4028-86d5-7571840bf274 for instance f322d62d-5bc2-4095-b7f5-d298fbff201d on n-h2-760456-11 Jul 20 04:36:24.859188 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c133a701-2816-488c-9314-54e48f209b40 req-928b3c54-7727-4b90-86df-19fbbdb2bd0d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078058 Jul 20 04:36:24.860369 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2556/5090] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:25.005648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0abf68de-47e7-4994-859d-a7a3abbddbbe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:25.014985 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0abf68de-47e7-4994-859d-a7a3abbddbbe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1315 microversion: 2.1 time: 0.342782 Jul 20 04:36:25.015821 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2535/5091] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:24 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:25.226795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66064938-7c5f-48af-950e-6623395445ce tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:25.228467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-66064938-7c5f-48af-950e-6623395445ce tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:25.248549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66064938-7c5f-48af-950e-6623395445ce tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.249014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66064938-7c5f-48af-950e-6623395445ce tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.250288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66064938-7c5f-48af-950e-6623395445ce tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.250900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66064938-7c5f-48af-950e-6623395445ce tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.383468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66064938-7c5f-48af-950e-6623395445ce tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.386175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66064938-7c5f-48af-950e-6623395445ce tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.387096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-66064938-7c5f-48af-950e-6623395445ce tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lazy-loading 'fault' on Instance uuid f322d62d-5bc2-4095-b7f5-d298fbff201d {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:36:25.537214 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-66064938-7c5f-48af-950e-6623395445ce tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 200 len: 1456 microversion: 2.1 time: 0.316240 Jul 20 04:36:25.550357 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2557/5092] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:25 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 1456 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:26.031615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b74795fd-a157-4991-a44f-f4580951b1e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:26.032251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b74795fd-a157-4991-a44f-f4580951b1e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:26.044661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b74795fd-a157-4991-a44f-f4580951b1e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.045127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b74795fd-a157-4991-a44f-f4580951b1e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.046170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b74795fd-a157-4991-a44f-f4580951b1e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.047024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b74795fd-a157-4991-a44f-f4580951b1e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.507190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b74795fd-a157-4991-a44f-f4580951b1e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:26.528790 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b74795fd-a157-4991-a44f-f4580951b1e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1315 microversion: 2.1 time: 0.501065 Jul 20 04:36:26.530915 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2536/5093] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:26 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:26.556413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f1454236-7ad5-4fd3-819b-1743cfb94c1c tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:26.558593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f1454236-7ad5-4fd3-819b-1743cfb94c1c tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: f322d62d-5bc2-4095-b7f5-d298fbff201d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:26.588685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1454236-7ad5-4fd3-819b-1743cfb94c1c tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.589412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1454236-7ad5-4fd3-819b-1743cfb94c1c tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.596351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1454236-7ad5-4fd3-819b-1743cfb94c1c tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.596846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1454236-7ad5-4fd3-819b-1743cfb94c1c tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.631215 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-f1454236-7ad5-4fd3-819b-1743cfb94c1c tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] HTTP exception thrown: Instance f322d62d-5bc2-4095-b7f5-d298fbff201d could not be found. Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f1454236-7ad5-4fd3-819b-1743cfb94c1c tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Request method failure captured: Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d HTTP/1.1 Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Ya0HS79DBVR1yz8t40AHLIowbcjTqE0m8uxNuZp57Xc2Lzrp2M-QTnQ6a2VH0p409dQWcjyICh5_sO3XUDmlpbd2bIJn9MwoVuj7YKu7gL62h3oFyTgQviAe2eo1iopJbBzm6FqIZ_bwxyxnvRZfZ7bp9DG8u_BO1bNCHgBx5yxNE Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 807dde3249374e86829b268f5f257d59 Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestServerMultinode-132603865 Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/807dde3249374e86829b268f5f257d59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/807dde3249374e86829b268f5f257d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/807dde3249374e86829b268f5f257d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_807dde3249374e86829b268f5f257d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestServerMultinode-132603865 Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 807dde3249374e86829b268f5f257d59 Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestServerMultinode-132603865 Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestServerMultinode-132603865-project-admin Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e205324b8bea47e9aa5ce2ce13fa3e94 Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestServerMultinode-132603865-project-admin Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance f322d62d-5bc2-4095-b7f5-d298fbff201d could not be found. Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'f322d62d-5bc2-4095-b7f5-d298fbff201d'} Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f322d62d-5bc2-4095-b7f5-d298fbff201d could not be found. Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f322d62d-5bc2-4095-b7f5-d298fbff201d could not be found. Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:26.633448 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:26.639274 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:26.639274 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:26.639274 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:26.639274 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:26.639274 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:26.639274 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f322d62d-5bc2-4095-b7f5-d298fbff201d could not be found. Jul 20 04:36:26.639274 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:36:26.641450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f1454236-7ad5-4fd3-819b-1743cfb94c1c tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Returning 404 to user: Instance f322d62d-5bc2-4095-b7f5-d298fbff201d could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:26.642574 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f1454236-7ad5-4fd3-819b-1743cfb94c1c tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d" status: 404 len: 111 microversion: 2.1 time: 0.091245 Jul 20 04:36:26.644751 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2558/5094] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:26 2022] GET /compute/v2.1/servers/f322d62d-5bc2-4095-b7f5-d298fbff201d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:36:26.653279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2dae2f1-a1de-4472-a9e6-318f8d5aed98 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:26.653958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f2dae2f1-a1de-4472-a9e6-318f8d5aed98 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:26.660443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2dae2f1-a1de-4472-a9e6-318f8d5aed98 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.661177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2dae2f1-a1de-4472-a9e6-318f8d5aed98 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.662351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2dae2f1-a1de-4472-a9e6-318f8d5aed98 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.663066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2dae2f1-a1de-4472-a9e6-318f8d5aed98 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.690236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f2dae2f1-a1de-4472-a9e6-318f8d5aed98 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:36:26.872242 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f2dae2f1-a1de-4472-a9e6-318f8d5aed98 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "DELETE /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 204 len: 0 microversion: 2.1 time: 0.222435 Jul 20 04:36:26.873585 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2537/5095] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:26 2022] DELETE /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:36:26.882365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-78cfbc2d-45e7-4b3f-97af-5b018aef3abd tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:26.882908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-78cfbc2d-45e7-4b3f-97af-5b018aef3abd tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:26.893124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78cfbc2d-45e7-4b3f-97af-5b018aef3abd tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.893859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78cfbc2d-45e7-4b3f-97af-5b018aef3abd tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.894902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78cfbc2d-45e7-4b3f-97af-5b018aef3abd tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.895988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78cfbc2d-45e7-4b3f-97af-5b018aef3abd tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.176410 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-78cfbc2d-45e7-4b3f-97af-5b018aef3abd tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1657 microversion: 2.1 time: 0.298054 Jul 20 04:36:27.177310 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2559/5096] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:26 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1657 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:27.547993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea11727c-bcab-4faa-9234-85047b4b7b64 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:27.549122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ea11727c-bcab-4faa-9234-85047b4b7b64 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:27.558388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea11727c-bcab-4faa-9234-85047b4b7b64 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.560418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea11727c-bcab-4faa-9234-85047b4b7b64 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.561946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea11727c-bcab-4faa-9234-85047b4b7b64 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.562588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea11727c-bcab-4faa-9234-85047b4b7b64 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.656466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7efb74e3-b9a1-4ac4-a640-09dbada73df3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:27.657561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7efb74e3-b9a1-4ac4-a640-09dbada73df3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:27.704472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7efb74e3-b9a1-4ac4-a640-09dbada73df3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.708423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7efb74e3-b9a1-4ac4-a640-09dbada73df3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.716432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7efb74e3-b9a1-4ac4-a640-09dbada73df3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.716936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7efb74e3-b9a1-4ac4-a640-09dbada73df3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.777724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:27.911846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ea11727c-bcab-4faa-9234-85047b4b7b64 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:27.922274 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ea11727c-bcab-4faa-9234-85047b4b7b64 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1315 microversion: 2.1 time: 0.379009 Jul 20 04:36:27.923228 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2560/5097] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:27 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:36:28.036873 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7efb74e3-b9a1-4ac4-a640-09dbada73df3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda/action" status: 200 len: 63172 microversion: 2.1 time: 0.903663 Jul 20 04:36:28.039526 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2538/5098] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:27 2022] POST /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda/action => generated 63172 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:36:28.195112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a88b703-c54f-46f2-af8c-4c0a811486c7 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:28.196011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0a88b703-c54f-46f2-af8c-4c0a811486c7 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:28.211742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a88b703-c54f-46f2-af8c-4c0a811486c7 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.212698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a88b703-c54f-46f2-af8c-4c0a811486c7 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.215698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a88b703-c54f-46f2-af8c-4c0a811486c7 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.216759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a88b703-c54f-46f2-af8c-4c0a811486c7 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.519466 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a88b703-c54f-46f2-af8c-4c0a811486c7 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1657 microversion: 2.1 time: 0.328564 Jul 20 04:36:28.533581 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2561/5099] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:28 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1657 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:28.771485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1550869424", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": "none"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:28.835022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:28.835624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:28.836259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:28.837166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:28.837746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:28.848847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.849534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.850515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.851269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.875287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Getting quotas for project 23b1377d689e4f94979cedd538380995. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:28.879333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:28.884477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Getting quotas for user d035d78670ed4567aa9fae24efd2e6ec and project 23b1377d689e4f94979cedd538380995. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:28.900823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:28.905140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:28.945735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d97b85ce-e1c9-4b5a-ba99-74fa73bbbe9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:28.947178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d97b85ce-e1c9-4b5a-ba99-74fa73bbbe9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:28.962777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d97b85ce-e1c9-4b5a-ba99-74fa73bbbe9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.964257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d97b85ce-e1c9-4b5a-ba99-74fa73bbbe9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:28.965468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d97b85ce-e1c9-4b5a-ba99-74fa73bbbe9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:28.966958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d97b85ce-e1c9-4b5a-ba99-74fa73bbbe9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.011127 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7b9bf52-c1c9-4f55-9433-90dcd5a47477 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.404345 Jul 20 04:36:29.012263 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2539/5100] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:36:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:36:29.023024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ecf6698a-36c9-45cf-8f33-859b901d2e08 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:29.023766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ecf6698a-36c9-45cf-8f33-859b901d2e08 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:29.238304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d97b85ce-e1c9-4b5a-ba99-74fa73bbbe9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.248300 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d97b85ce-e1c9-4b5a-ba99-74fa73bbbe9e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1315 microversion: 2.1 time: 0.310724 Jul 20 04:36:29.260279 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2562/5101] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:28 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:29.260279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1e1dc240-e3f2-4415-ad21-2b2c8807caa8 req-ff93fdf6-1a90-489d-b9b3-a9264f659804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a30ca2-3a5c-42c2-9359-7d8553da3f33", "name": "network-vif-plugged", "status": "completed", "tag": "463b5dd6-01d7-4f84-b981-58adeeabd51c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:29.284984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:29.311098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1e1dc240-e3f2-4415-ad21-2b2c8807caa8 req-ff93fdf6-1a90-489d-b9b3-a9264f659804 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.311624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1e1dc240-e3f2-4415-ad21-2b2c8807caa8 req-ff93fdf6-1a90-489d-b9b3-a9264f659804 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.316211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ecf6698a-36c9-45cf-8f33-859b901d2e08 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.327769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ecf6698a-36c9-45cf-8f33-859b901d2e08 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.333488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ecf6698a-36c9-45cf-8f33-859b901d2e08 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.334790 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ecf6698a-36c9-45cf-8f33-859b901d2e08 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1278 microversion: 2.54 time: 0.316486 Jul 20 04:36:29.346319 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2540/5102] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:29 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1278 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:29.346422 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1e1dc240-e3f2-4415-ad21-2b2c8807caa8 req-ff93fdf6-1a90-489d-b9b3-a9264f659804 service nova] Creating event network-vif-plugged:463b5dd6-01d7-4f84-b981-58adeeabd51c for instance 19a30ca2-3a5c-42c2-9359-7d8553da3f33 on n-h1-760456-11 Jul 20 04:36:29.353600 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1e1dc240-e3f2-4415-ad21-2b2c8807caa8 req-ff93fdf6-1a90-489d-b9b3-a9264f659804 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098833 Jul 20 04:36:29.354288 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2563/5103] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:29.540536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1a5bf97c-6534-4ec8-a51f-2e9417903ac9 req-f12ef066-0fb7-4f7a-bd4e-be98403542a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976749a5-7a22-4c41-b15e-6351e8496081", "name": "network-vif-deleted", "tag": "2c21de82-a171-41b6-8098-a9b1f6974080"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:29.553632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dbf37c64-5d9a-40cd-95eb-e1558a552d77 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:29.554818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dbf37c64-5d9a-40cd-95eb-e1558a552d77 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:29.571514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbf37c64-5d9a-40cd-95eb-e1558a552d77 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.573973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbf37c64-5d9a-40cd-95eb-e1558a552d77 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.578015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbf37c64-5d9a-40cd-95eb-e1558a552d77 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.578545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbf37c64-5d9a-40cd-95eb-e1558a552d77 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.585650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1a5bf97c-6534-4ec8-a51f-2e9417903ac9 req-f12ef066-0fb7-4f7a-bd4e-be98403542a5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.586274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1a5bf97c-6534-4ec8-a51f-2e9417903ac9 req-f12ef066-0fb7-4f7a-bd4e-be98403542a5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.633722 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1a5bf97c-6534-4ec8-a51f-2e9417903ac9 req-f12ef066-0fb7-4f7a-bd4e-be98403542a5 service nova] Creating event network-vif-deleted:2c21de82-a171-41b6-8098-a9b1f6974080 for instance 976749a5-7a22-4c41-b15e-6351e8496081 on n-h1-760456-11 Jul 20 04:36:29.652487 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1a5bf97c-6534-4ec8-a51f-2e9417903ac9 req-f12ef066-0fb7-4f7a-bd4e-be98403542a5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127365 Jul 20 04:36:29.655609 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2541/5104] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:29.828390 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dbf37c64-5d9a-40cd-95eb-e1558a552d77 tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 200 len: 1450 microversion: 2.1 time: 0.278804 Jul 20 04:36:29.839304 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2564/5105] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:29 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 1450 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:30.268346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-256b7d44-d6b8-4eea-82d2-15f251f05dbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:30.270096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-256b7d44-d6b8-4eea-82d2-15f251f05dbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:30.282396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-256b7d44-d6b8-4eea-82d2-15f251f05dbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.282863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-256b7d44-d6b8-4eea-82d2-15f251f05dbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.283682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-256b7d44-d6b8-4eea-82d2-15f251f05dbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.284134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-256b7d44-d6b8-4eea-82d2-15f251f05dbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.354521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a51182fe-6ed9-4420-81f4-3547dafa03cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:30.355968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a51182fe-6ed9-4420-81f4-3547dafa03cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:30.368484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a51182fe-6ed9-4420-81f4-3547dafa03cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.369185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a51182fe-6ed9-4420-81f4-3547dafa03cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.370165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a51182fe-6ed9-4420-81f4-3547dafa03cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.375473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a51182fe-6ed9-4420-81f4-3547dafa03cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.493739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-256b7d44-d6b8-4eea-82d2-15f251f05dbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:30.504002 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-256b7d44-d6b8-4eea-82d2-15f251f05dbd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1315 microversion: 2.1 time: 0.239744 Jul 20 04:36:30.511570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a51182fe-6ed9-4420-81f4-3547dafa03cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:30.515020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2542/5106] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:30 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:30.522311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a51182fe-6ed9-4420-81f4-3547dafa03cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:30.524158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a51182fe-6ed9-4420-81f4-3547dafa03cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:30.525731 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a51182fe-6ed9-4420-81f4-3547dafa03cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1330 microversion: 2.54 time: 0.176616 Jul 20 04:36:30.538227 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2565/5107] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:30 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1330 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:30.845209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-76b29376-36ad-4035-96d4-03289d7c9d7a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:30.846165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-76b29376-36ad-4035-96d4-03289d7c9d7a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] [instance: 976749a5-7a22-4c41-b15e-6351e8496081] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:30.853456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76b29376-36ad-4035-96d4-03289d7c9d7a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.853921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76b29376-36ad-4035-96d4-03289d7c9d7a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.854739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76b29376-36ad-4035-96d4-03289d7c9d7a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.855188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76b29376-36ad-4035-96d4-03289d7c9d7a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.874011 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-76b29376-36ad-4035-96d4-03289d7c9d7a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] HTTP exception thrown: Instance 976749a5-7a22-4c41-b15e-6351e8496081 could not be found. Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-76b29376-36ad-4035-96d4-03289d7c9d7a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Request method failure captured: Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 HTTP/1.1 Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Ya0HS79DBVR1yz8t40AHLIowbcjTqE0m8uxNuZp57Xc2Lzrp2M-QTnQ6a2VH0p409dQWcjyICh5_sO3XUDmlpbd2bIJn9MwoVuj7YKu7gL62h3oFyTgQviAe2eo1iopJbBzm6FqIZ_bwxyxnvRZfZ7bp9DG8u_BO1bNCHgBx5yxNE Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 807dde3249374e86829b268f5f257d59 Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestServerMultinode-132603865 Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/807dde3249374e86829b268f5f257d59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/807dde3249374e86829b268f5f257d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/807dde3249374e86829b268f5f257d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_807dde3249374e86829b268f5f257d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestServerMultinode-132603865 Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 807dde3249374e86829b268f5f257d59 Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestServerMultinode-132603865 Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestServerMultinode-132603865-project-admin Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e205324b8bea47e9aa5ce2ce13fa3e94 Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestServerMultinode-132603865-project-admin Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 976749a5-7a22-4c41-b15e-6351e8496081 could not be found. Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '976749a5-7a22-4c41-b15e-6351e8496081'} Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 976749a5-7a22-4c41-b15e-6351e8496081 could not be found. Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 976749a5-7a22-4c41-b15e-6351e8496081 could not be found. Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:30.881264 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:30.885578 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:30.885578 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:30.885578 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:30.885578 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:30.885578 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:30.885578 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 976749a5-7a22-4c41-b15e-6351e8496081 could not be found. Jul 20 04:36:30.885578 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:30.886062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-76b29376-36ad-4035-96d4-03289d7c9d7a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] Returning 404 to user: Instance 976749a5-7a22-4c41-b15e-6351e8496081 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:30.887101 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-76b29376-36ad-4035-96d4-03289d7c9d7a tempest-TestServerMultinode-132603865 tempest-TestServerMultinode-132603865-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081" status: 404 len: 111 microversion: 2.1 time: 0.045664 Jul 20 04:36:30.889530 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2543/5108] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:30 2022] GET /compute/v2.1/servers/976749a5-7a22-4c41-b15e-6351e8496081 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:31.522694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3686464-0acb-484e-b35b-7169bb844aff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:31.523337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d3686464-0acb-484e-b35b-7169bb844aff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:31.536485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3686464-0acb-484e-b35b-7169bb844aff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.540392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3686464-0acb-484e-b35b-7169bb844aff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.545221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3686464-0acb-484e-b35b-7169bb844aff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.545901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3686464-0acb-484e-b35b-7169bb844aff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.548848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-497e31a2-23a6-4dd9-8e02-b52d097f608b tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:31.550144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-497e31a2-23a6-4dd9-8e02-b52d097f608b tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:31.560486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:31.572098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-497e31a2-23a6-4dd9-8e02-b52d097f608b tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.573070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-497e31a2-23a6-4dd9-8e02-b52d097f608b tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.574667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-497e31a2-23a6-4dd9-8e02-b52d097f608b tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.575902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-497e31a2-23a6-4dd9-8e02-b52d097f608b tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.848592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-497e31a2-23a6-4dd9-8e02-b52d097f608b tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.859700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-497e31a2-23a6-4dd9-8e02-b52d097f608b tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.870721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-497e31a2-23a6-4dd9-8e02-b52d097f608b tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.872811 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-497e31a2-23a6-4dd9-8e02-b52d097f608b tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1336 microversion: 2.54 time: 0.330575 Jul 20 04:36:31.877743 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2544/5109] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:31 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1336 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:32.364982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d3686464-0acb-484e-b35b-7169bb844aff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:32.374984 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d3686464-0acb-484e-b35b-7169bb844aff tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1501 microversion: 2.1 time: 0.856304 Jul 20 04:36:32.375858 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2566/5110] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:31 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1501 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:32.396193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6569c9ef-0124-45ab-a796-fa3ae526cf98 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:32.397074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6569c9ef-0124-45ab-a796-fa3ae526cf98 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:32.406195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6569c9ef-0124-45ab-a796-fa3ae526cf98 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.408464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6569c9ef-0124-45ab-a796-fa3ae526cf98 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.411068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6569c9ef-0124-45ab-a796-fa3ae526cf98 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.412669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6569c9ef-0124-45ab-a796-fa3ae526cf98 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.629711 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.network.security_group_api [None req-6569c9ef-0124-45ab-a796-fa3ae526cf98 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Removing security group becf8e2f-4772-4571-9675-cf99405ef17a from port 463b5dd6-01d7-4f84-b981-58adeeabd51c Jul 20 04:36:32.904366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89d0ef59-3749-4e49-b5c1-f135794503dc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:32.905146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-89d0ef59-3749-4e49-b5c1-f135794503dc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:32.922921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89d0ef59-3749-4e49-b5c1-f135794503dc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.924143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89d0ef59-3749-4e49-b5c1-f135794503dc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.925743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89d0ef59-3749-4e49-b5c1-f135794503dc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.927826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89d0ef59-3749-4e49-b5c1-f135794503dc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.059197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89d0ef59-3749-4e49-b5c1-f135794503dc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.083406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89d0ef59-3749-4e49-b5c1-f135794503dc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.095277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89d0ef59-3749-4e49-b5c1-f135794503dc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.096820 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89d0ef59-3749-4e49-b5c1-f135794503dc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1336 microversion: 2.54 time: 0.203452 Jul 20 04:36:33.115204 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2567/5111] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:32 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1336 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:33.387932 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6569c9ef-0124-45ab-a796-fa3ae526cf98 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33/action" status: 202 len: 0 microversion: 2.1 time: 0.995768 Jul 20 04:36:33.389403 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2545/5112] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:32 2022] POST /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33/action => generated 0 bytes in 998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:33.398325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d9b84c61-c10f-4f88-941c-452b6ab6e19c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:33.399001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d9b84c61-c10f-4f88-941c-452b6ab6e19c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:33.409932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-309e908a-ca46-41ce-9b12-ea81d113fe01 req-f7043f44-0741-4f00-a26f-1568199fb5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19a30ca2-3a5c-42c2-9359-7d8553da3f33", "tag": "463b5dd6-01d7-4f84-b981-58adeeabd51c"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:33.413755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b84c61-c10f-4f88-941c-452b6ab6e19c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.414464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b84c61-c10f-4f88-941c-452b6ab6e19c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.415439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b84c61-c10f-4f88-941c-452b6ab6e19c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.416070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b84c61-c10f-4f88-941c-452b6ab6e19c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.426571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-309e908a-ca46-41ce-9b12-ea81d113fe01 req-f7043f44-0741-4f00-a26f-1568199fb5bc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.430470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-309e908a-ca46-41ce-9b12-ea81d113fe01 req-f7043f44-0741-4f00-a26f-1568199fb5bc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.464755 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-309e908a-ca46-41ce-9b12-ea81d113fe01 req-f7043f44-0741-4f00-a26f-1568199fb5bc service nova] Creating event network-changed:463b5dd6-01d7-4f84-b981-58adeeabd51c for instance 19a30ca2-3a5c-42c2-9359-7d8553da3f33 on n-h1-760456-11 Jul 20 04:36:33.474551 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-309e908a-ca46-41ce-9b12-ea81d113fe01 req-f7043f44-0741-4f00-a26f-1568199fb5bc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067335 Jul 20 04:36:33.478450 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2546/5113] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:33.627528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d9b84c61-c10f-4f88-941c-452b6ab6e19c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.636849 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d9b84c61-c10f-4f88-941c-452b6ab6e19c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1459 microversion: 2.1 time: 0.243419 Jul 20 04:36:33.643618 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2568/5114] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:33 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1459 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:33.671235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32192dad-da49-42e9-8430-d5bc56a89a9c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:33.672227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-32192dad-da49-42e9-8430-d5bc56a89a9c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:33.689465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32192dad-da49-42e9-8430-d5bc56a89a9c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.689926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32192dad-da49-42e9-8430-d5bc56a89a9c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.690747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32192dad-da49-42e9-8430-d5bc56a89a9c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.691333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32192dad-da49-42e9-8430-d5bc56a89a9c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.134216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e34a1cfe-40ae-4301-a2d9-55cca01287e0 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.135595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e34a1cfe-40ae-4301-a2d9-55cca01287e0 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:34.144874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e34a1cfe-40ae-4301-a2d9-55cca01287e0 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.145758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e34a1cfe-40ae-4301-a2d9-55cca01287e0 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.146892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e34a1cfe-40ae-4301-a2d9-55cca01287e0 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.147540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e34a1cfe-40ae-4301-a2d9-55cca01287e0 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.296578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e34a1cfe-40ae-4301-a2d9-55cca01287e0 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:34.311426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e34a1cfe-40ae-4301-a2d9-55cca01287e0 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:34.314700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e34a1cfe-40ae-4301-a2d9-55cca01287e0 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:34.321216 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e34a1cfe-40ae-4301-a2d9-55cca01287e0 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1357 microversion: 2.54 time: 0.190762 Jul 20 04:36:34.325508 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2569/5115] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:34.416869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-32192dad-da49-42e9-8430-d5bc56a89a9c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:34.426970 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-32192dad-da49-42e9-8430-d5bc56a89a9c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.767964 Jul 20 04:36:34.431290 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2547/5116] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:33 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:34.443319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9087ca87-84fc-4e5f-994b-d9150a3b4d1e tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Action: 'create', calling method: .version_select at 0x7fb841a719d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-542960662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/uF6sjaGQOpZyIHAUcw0OX2i+M/BjADcXnkY4/LLysa0TJ51BxYa6ZUWd8do+du6ar74j/Z/fOXrPcC6J30Wc9f+K/j1LZk8iYaCTLY8CkdJZsINdPW0n6kb+pVKN3NA=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:34.479507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9087ca87-84fc-4e5f-994b-d9150a3b4d1e tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Getting quotas for project 23b1377d689e4f94979cedd538380995. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:34.503767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9087ca87-84fc-4e5f-994b-d9150a3b4d1e tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Getting quotas for user d035d78670ed4567aa9fae24efd2e6ec and project 23b1377d689e4f94979cedd538380995. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:34.559800 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9087ca87-84fc-4e5f-994b-d9150a3b4d1e tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.126874 Jul 20 04:36:34.565718 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2548/5117] 10.222.0.59 () {62 vars in 1199 bytes} [Wed Jul 20 04:36:34 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:36:34.566854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-995d6c21-7cda-49a4-9776-83cbc302b143 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.567524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-995d6c21-7cda-49a4-9776-83cbc302b143 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:34.581368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-995d6c21-7cda-49a4-9776-83cbc302b143 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.581877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-995d6c21-7cda-49a4-9776-83cbc302b143 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.582739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-995d6c21-7cda-49a4-9776-83cbc302b143 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.583195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-995d6c21-7cda-49a4-9776-83cbc302b143 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.603993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e759fd86-4e26-4945-a67b-963a98173215 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.604613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e759fd86-4e26-4945-a67b-963a98173215 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:34.612932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e759fd86-4e26-4945-a67b-963a98173215 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.613607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e759fd86-4e26-4945-a67b-963a98173215 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.615214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e759fd86-4e26-4945-a67b-963a98173215 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.615828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e759fd86-4e26-4945-a67b-963a98173215 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.020316 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e759fd86-4e26-4945-a67b-963a98173215 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1835 microversion: 2.1 time: 0.575342 Jul 20 04:36:35.020316 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2570/5118] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1835 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:35.020316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-542960662", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:35.020316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.020316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.020316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.020316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.020316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.085941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-995d6c21-7cda-49a4-9776-83cbc302b143 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.110747 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-995d6c21-7cda-49a4-9776-83cbc302b143 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.548660 Jul 20 04:36:35.111688 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2549/5119] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:35.129068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-515a6e34-1810-42a2-973b-bc0ac92eb023 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.129699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-515a6e34-1810-42a2-973b-bc0ac92eb023 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.145361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515a6e34-1810-42a2-973b-bc0ac92eb023 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.145361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515a6e34-1810-42a2-973b-bc0ac92eb023 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.146083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515a6e34-1810-42a2-973b-bc0ac92eb023 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.146569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515a6e34-1810-42a2-973b-bc0ac92eb023 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.183860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:35.185695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:35.191530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:35.192034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:35.192531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:35.310920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.322557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.323507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.324571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.325301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.370967 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b8c0fd0-7205-4030-8667-74d5881d8697 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "POST /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe/action" status: 202 len: 1139 microversion: 2.54 time: 0.457816 Jul 20 04:36:35.380974 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2571/5120] 10.222.0.59 () {62 vars in 1319 bytes} [Wed Jul 20 04:36:34 2022] POST /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe/action => generated 1139 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:36:35.397301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fc175b94-98cd-4190-a8b3-b1514ee34c99 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.398425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fc175b94-98cd-4190-a8b3-b1514ee34c99 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.407758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc175b94-98cd-4190-a8b3-b1514ee34c99 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.408431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc175b94-98cd-4190-a8b3-b1514ee34c99 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.409657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc175b94-98cd-4190-a8b3-b1514ee34c99 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.410389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc175b94-98cd-4190-a8b3-b1514ee34c99 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.546745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-515a6e34-1810-42a2-973b-bc0ac92eb023 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.556222 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-515a6e34-1810-42a2-973b-bc0ac92eb023 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.431355 Jul 20 04:36:35.562661 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2550/5121] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:35 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:35.589134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0437556f-12f1-44f2-87f4-4ef27536fbc5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.589134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0437556f-12f1-44f2-87f4-4ef27536fbc5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.617944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0437556f-12f1-44f2-87f4-4ef27536fbc5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.618455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0437556f-12f1-44f2-87f4-4ef27536fbc5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.619401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0437556f-12f1-44f2-87f4-4ef27536fbc5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.619707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0437556f-12f1-44f2-87f4-4ef27536fbc5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.623781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fc175b94-98cd-4190-a8b3-b1514ee34c99 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.639977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fc175b94-98cd-4190-a8b3-b1514ee34c99 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.642108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fc175b94-98cd-4190-a8b3-b1514ee34c99 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.643548 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fc175b94-98cd-4190-a8b3-b1514ee34c99 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.251048 Jul 20 04:36:35.650886 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2572/5122] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:35 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:36.180014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0437556f-12f1-44f2-87f4-4ef27536fbc5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.191427 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0437556f-12f1-44f2-87f4-4ef27536fbc5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.615886 Jul 20 04:36:36.192350 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2551/5123] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:35 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:36.417957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-756820479", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "4388b376-1cd5-454f-a519-55f9a04383ba"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:36.516465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] validate_networks() for [('4388b376-1cd5-454f-a519-55f9a04383ba', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:36.670607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a6d1935-ef76-4084-9a94-f5177d53a687 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:36.671405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3a6d1935-ef76-4084-9a94-f5177d53a687 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:36.678997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a6d1935-ef76-4084-9a94-f5177d53a687 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.679463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a6d1935-ef76-4084-9a94-f5177d53a687 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.680806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a6d1935-ef76-4084-9a94-f5177d53a687 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.681420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a6d1935-ef76-4084-9a94-f5177d53a687 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.777811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3a6d1935-ef76-4084-9a94-f5177d53a687 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.790690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3a6d1935-ef76-4084-9a94-f5177d53a687 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.792689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3a6d1935-ef76-4084-9a94-f5177d53a687 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.794805 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3a6d1935-ef76-4084-9a94-f5177d53a687 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.129524 Jul 20 04:36:36.808013 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2552/5124] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:36 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:37.821345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2d2b382e-ada3-4633-b06d-9371e8fce4cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:37.828751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2d2b382e-ada3-4633-b06d-9371e8fce4cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:37.883504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d2b382e-ada3-4633-b06d-9371e8fce4cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.884316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d2b382e-ada3-4633-b06d-9371e8fce4cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.898413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d2b382e-ada3-4633-b06d-9371e8fce4cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.899519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d2b382e-ada3-4633-b06d-9371e8fce4cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.125177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d2b382e-ada3-4633-b06d-9371e8fce4cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:38.145240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d2b382e-ada3-4633-b06d-9371e8fce4cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:38.147390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d2b382e-ada3-4633-b06d-9371e8fce4cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:38.149543 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2d2b382e-ada3-4633-b06d-9371e8fce4cc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.336539 Jul 20 04:36:38.155159 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2553/5125] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:37 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:38.233188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:38.233715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:38.235095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:38.235973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:38.236406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:38.244904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f4a261d-d5cc-4d27-85e3-70a53f8c9e86 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:38.245423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8f4a261d-d5cc-4d27-85e3-70a53f8c9e86 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:38.252677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4a261d-d5cc-4d27-85e3-70a53f8c9e86 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.253149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4a261d-d5cc-4d27-85e3-70a53f8c9e86 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.253961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4a261d-d5cc-4d27-85e3-70a53f8c9e86 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.254464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f4a261d-d5cc-4d27-85e3-70a53f8c9e86 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.270109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.270806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.271970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.272583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.320616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8f4a261d-d5cc-4d27-85e3-70a53f8c9e86 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:36:38.320983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:38.335144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Getting quotas for user a3a58233b2b044d9b1285b616c79f9b8 and project cb81e78714ae4c75a581a7dfeee2b550. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:38.361231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:38.363688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:38.419960 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4962a0e2-3bb9-4534-acd0-9ea87ac08629 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.005941 Jul 20 04:36:38.421371 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2573/5126] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:38.426651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f406381c-3bc1-4e60-a612-fa67d0f2cf93 req-b32df2f2-e3ff-4acc-b29c-8e7e7e414269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:38.438326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f406381c-3bc1-4e60-a612-fa67d0f2cf93 req-b32df2f2-e3ff-4acc-b29c-8e7e7e414269 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.439050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f406381c-3bc1-4e60-a612-fa67d0f2cf93 req-b32df2f2-e3ff-4acc-b29c-8e7e7e414269 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.453717 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f406381c-3bc1-4e60-a612-fa67d0f2cf93 req-b32df2f2-e3ff-4acc-b29c-8e7e7e414269 service nova] Creating event network-changed:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h1-760456-11 Jul 20 04:36:38.507721 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f406381c-3bc1-4e60-a612-fa67d0f2cf93 req-b32df2f2-e3ff-4acc-b29c-8e7e7e414269 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084706 Jul 20 04:36:38.508388 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2574/5127] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:38.518039 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8f4a261d-d5cc-4d27-85e3-70a53f8c9e86 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 204 len: 0 microversion: 2.1 time: 0.277487 Jul 20 04:36:38.522690 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2554/5128] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:38 2022] DELETE /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:38.522851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-42150263-2497-4c93-bf04-3d57c67c9c66 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:38.523568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-42150263-2497-4c93-bf04-3d57c67c9c66 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:38.535866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d17a2c5e-c4db-46ae-8481-431e07bd3309 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:38.540234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d17a2c5e-c4db-46ae-8481-431e07bd3309 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:38.555630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d17a2c5e-c4db-46ae-8481-431e07bd3309 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.556301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d17a2c5e-c4db-46ae-8481-431e07bd3309 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.557955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d17a2c5e-c4db-46ae-8481-431e07bd3309 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:38.558753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d17a2c5e-c4db-46ae-8481-431e07bd3309 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.659770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-42150263-2497-4c93-bf04-3d57c67c9c66 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:38.668140 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-42150263-2497-4c93-bf04-3d57c67c9c66 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1214 microversion: 2.1 time: 0.157594 Jul 20 04:36:38.669814 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2575/5129] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:38 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:38.870572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:39.174294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5674a006-f98f-423d-b674-955d6f980050 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:39.175077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5674a006-f98f-423d-b674-955d6f980050 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:39.206469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5674a006-f98f-423d-b674-955d6f980050 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.209726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5674a006-f98f-423d-b674-955d6f980050 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.210848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5674a006-f98f-423d-b674-955d6f980050 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.212128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5674a006-f98f-423d-b674-955d6f980050 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.339880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5674a006-f98f-423d-b674-955d6f980050 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.350349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5674a006-f98f-423d-b674-955d6f980050 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.352137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5674a006-f98f-423d-b674-955d6f980050 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.353714 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5674a006-f98f-423d-b674-955d6f980050 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.183795 Jul 20 04:36:39.354510 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2576/5130] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:39 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:39.686030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ce185ea-8a11-4438-9788-008611d9accd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:39.686848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4ce185ea-8a11-4438-9788-008611d9accd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:39.697850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ce185ea-8a11-4438-9788-008611d9accd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.701298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ce185ea-8a11-4438-9788-008611d9accd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.707358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ce185ea-8a11-4438-9788-008611d9accd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.707987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ce185ea-8a11-4438-9788-008611d9accd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.914664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d17a2c5e-c4db-46ae-8481-431e07bd3309 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.925848 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d17a2c5e-c4db-46ae-8481-431e07bd3309 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1688 microversion: 2.1 time: 1.397831 Jul 20 04:36:39.939171 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2555/5131] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:38 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1688 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:40.375626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-adb14e81-e115-4b23-82a6-e42f88f054ea tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:40.376489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-adb14e81-e115-4b23-82a6-e42f88f054ea tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:40.388219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adb14e81-e115-4b23-82a6-e42f88f054ea tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.389693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adb14e81-e115-4b23-82a6-e42f88f054ea tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.390834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adb14e81-e115-4b23-82a6-e42f88f054ea tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.391465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adb14e81-e115-4b23-82a6-e42f88f054ea tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.571338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-adb14e81-e115-4b23-82a6-e42f88f054ea tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.584224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-adb14e81-e115-4b23-82a6-e42f88f054ea tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.589922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-adb14e81-e115-4b23-82a6-e42f88f054ea tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.592921 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-adb14e81-e115-4b23-82a6-e42f88f054ea tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.223760 Jul 20 04:36:40.605506 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2556/5132] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:40 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:40.744264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4ce185ea-8a11-4438-9788-008611d9accd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.752848 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ce185ea-8a11-4438-9788-008611d9accd tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1210 microversion: 2.1 time: 1.071714 Jul 20 04:36:40.761372 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2577/5133] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:39 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1210 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:40.945091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-29c6f28e-7565-4ebf-b36f-14a81d65a6bc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:40.947070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-29c6f28e-7565-4ebf-b36f-14a81d65a6bc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:40.957635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29c6f28e-7565-4ebf-b36f-14a81d65a6bc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.966560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29c6f28e-7565-4ebf-b36f-14a81d65a6bc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.967638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29c6f28e-7565-4ebf-b36f-14a81d65a6bc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.968217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29c6f28e-7565-4ebf-b36f-14a81d65a6bc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.492190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d17f608d-8f82-4b92-b494-38bb01eb7cc6 req-2262124b-155c-42d3-b0c4-674e3c48e0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7497e6-1395-4095-aa68-18be3a46bfda", "name": "network-vif-deleted", "tag": "56e5aaef-8031-4d31-ae89-c2a4a22e7e17"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:41.492654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-29c6f28e-7565-4ebf-b36f-14a81d65a6bc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:41.521524 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-29c6f28e-7565-4ebf-b36f-14a81d65a6bc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 200 len: 1688 microversion: 2.1 time: 0.580155 Jul 20 04:36:41.523246 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2557/5134] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:40 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 1688 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:41.525946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d17f608d-8f82-4b92-b494-38bb01eb7cc6 req-2262124b-155c-42d3-b0c4-674e3c48e0d7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.529983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d17f608d-8f82-4b92-b494-38bb01eb7cc6 req-2262124b-155c-42d3-b0c4-674e3c48e0d7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.550281 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d17f608d-8f82-4b92-b494-38bb01eb7cc6 req-2262124b-155c-42d3-b0c4-674e3c48e0d7 service nova] Creating event network-vif-deleted:56e5aaef-8031-4d31-ae89-c2a4a22e7e17 for instance bb7497e6-1395-4095-aa68-18be3a46bfda on n-h1-760456-11 Jul 20 04:36:41.555997 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d17f608d-8f82-4b92-b494-38bb01eb7cc6 req-2262124b-155c-42d3-b0c4-674e3c48e0d7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067416 Jul 20 04:36:41.557336 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2578/5135] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:36:41.625636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-27e6d6b4-084e-4212-9ac7-e217912dfedf tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:41.626306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-27e6d6b4-084e-4212-9ac7-e217912dfedf tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:41.636660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27e6d6b4-084e-4212-9ac7-e217912dfedf tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.637136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27e6d6b4-084e-4212-9ac7-e217912dfedf tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.642600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27e6d6b4-084e-4212-9ac7-e217912dfedf tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.643039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27e6d6b4-084e-4212-9ac7-e217912dfedf tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.691765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:41.779792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0829c804-8e31-42b1-aebc-d2b3ba19c10d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:41.784563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-27e6d6b4-084e-4212-9ac7-e217912dfedf tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:41.792314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0829c804-8e31-42b1-aebc-d2b3ba19c10d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:41.799692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-27e6d6b4-084e-4212-9ac7-e217912dfedf tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:41.804700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-27e6d6b4-084e-4212-9ac7-e217912dfedf tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:41.808997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0829c804-8e31-42b1-aebc-d2b3ba19c10d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.809409 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-27e6d6b4-084e-4212-9ac7-e217912dfedf tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.187594 Jul 20 04:36:41.810449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0829c804-8e31-42b1-aebc-d2b3ba19c10d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.823001 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2558/5136] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:41 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:41.824756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0829c804-8e31-42b1-aebc-d2b3ba19c10d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.825522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0829c804-8e31-42b1-aebc-d2b3ba19c10d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:42.013738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0829c804-8e31-42b1-aebc-d2b3ba19c10d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:42.040147 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0829c804-8e31-42b1-aebc-d2b3ba19c10d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1272 microversion: 2.1 time: 0.266778 Jul 20 04:36:42.045518 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2579/5137] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:41 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:42.547770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37300023-004e-4663-81fb-61d63d60cfd9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:42.549495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37300023-004e-4663-81fb-61d63d60cfd9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: bb7497e6-1395-4095-aa68-18be3a46bfda] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:42.567811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37300023-004e-4663-81fb-61d63d60cfd9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:42.571765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37300023-004e-4663-81fb-61d63d60cfd9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:42.576191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37300023-004e-4663-81fb-61d63d60cfd9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:42.577344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37300023-004e-4663-81fb-61d63d60cfd9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:42.630388 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-37300023-004e-4663-81fb-61d63d60cfd9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] HTTP exception thrown: Instance bb7497e6-1395-4095-aa68-18be3a46bfda could not be found. Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37300023-004e-4663-81fb-61d63d60cfd9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Request method failure captured: Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda HTTP/1.1 Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14UK5JrQIbQ4DeMrb4AGON-It-xq1HUlcS1_w91iY9qX9BKMuqasTROhXwJnYYXL1FDMvpvHevyFT98KP_rG1E4C2KjxwioZKHqAupgnDNOBVhKjLYq21w0dkR-FwoM0QcIMxRYXi6rjnAGtO1rszx2hLyQfwkkhBDqwPm7fq7NZS_Y Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: c92a62f7017e4b8f8bbeb960856d1e20 Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: c92a62f7017e4b8f8bbeb960856d1e20 Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestNetworkAdvancedServerOps-1362507395-project Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8f84ec28420a4cdcb88920cd86ce0160 Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1362507395-project Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance bb7497e6-1395-4095-aa68-18be3a46bfda could not be found. Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'bb7497e6-1395-4095-aa68-18be3a46bfda'} Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7497e6-1395-4095-aa68-18be3a46bfda could not be found. Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7497e6-1395-4095-aa68-18be3a46bfda could not be found. Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:42.633311 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:42.639373 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:42.639373 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:42.639373 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:42.639373 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:42.639373 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:42.639373 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:42.639373 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7497e6-1395-4095-aa68-18be3a46bfda could not be found. Jul 20 04:36:42.639373 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:36:42.647389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37300023-004e-4663-81fb-61d63d60cfd9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Returning 404 to user: Instance bb7497e6-1395-4095-aa68-18be3a46bfda could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:42.649047 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37300023-004e-4663-81fb-61d63d60cfd9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda" status: 404 len: 111 microversion: 2.1 time: 0.112003 Jul 20 04:36:42.650203 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2559/5138] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:42 2022] GET /compute/v2.1/servers/bb7497e6-1395-4095-aa68-18be3a46bfda => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:42.830344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-99862a95-d630-42a6-becb-cbcdc06f3cd1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:42.830975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-99862a95-d630-42a6-becb-cbcdc06f3cd1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:42.844109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99862a95-d630-42a6-becb-cbcdc06f3cd1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:42.855820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99862a95-d630-42a6-becb-cbcdc06f3cd1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:42.857685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99862a95-d630-42a6-becb-cbcdc06f3cd1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:42.858448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99862a95-d630-42a6-becb-cbcdc06f3cd1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.063130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b2f049c6-32cf-4e37-b8ff-1cdb9c73dc99 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:43.064003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b2f049c6-32cf-4e37-b8ff-1cdb9c73dc99 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:43.070424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2f049c6-32cf-4e37-b8ff-1cdb9c73dc99 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.071075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2f049c6-32cf-4e37-b8ff-1cdb9c73dc99 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.072018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2f049c6-32cf-4e37-b8ff-1cdb9c73dc99 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.072621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2f049c6-32cf-4e37-b8ff-1cdb9c73dc99 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.115348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-99862a95-d630-42a6-becb-cbcdc06f3cd1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.148300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-99862a95-d630-42a6-becb-cbcdc06f3cd1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.154924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-99862a95-d630-42a6-becb-cbcdc06f3cd1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.156575 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-99862a95-d630-42a6-becb-cbcdc06f3cd1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.331388 Jul 20 04:36:43.160704 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2580/5139] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:42 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:43.274601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b2f049c6-32cf-4e37-b8ff-1cdb9c73dc99 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.289886 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b2f049c6-32cf-4e37-b8ff-1cdb9c73dc99 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1314 microversion: 2.1 time: 0.230804 Jul 20 04:36:43.291540 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2560/5140] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:43 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:44.185771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e154e2c7-e128-45e9-81ba-347c754ec47a tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:44.187200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e154e2c7-e128-45e9-81ba-347c754ec47a tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:44.195057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e154e2c7-e128-45e9-81ba-347c754ec47a tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.195514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e154e2c7-e128-45e9-81ba-347c754ec47a tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.196315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e154e2c7-e128-45e9-81ba-347c754ec47a tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.196763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e154e2c7-e128-45e9-81ba-347c754ec47a tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.308490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ae6e886-9d30-422b-81a0-36d7932c26d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:44.310165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ae6e886-9d30-422b-81a0-36d7932c26d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:44.320955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ae6e886-9d30-422b-81a0-36d7932c26d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.321694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ae6e886-9d30-422b-81a0-36d7932c26d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.322561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ae6e886-9d30-422b-81a0-36d7932c26d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.323186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ae6e886-9d30-422b-81a0-36d7932c26d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.394047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e154e2c7-e128-45e9-81ba-347c754ec47a tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.410532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e154e2c7-e128-45e9-81ba-347c754ec47a tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.412784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e154e2c7-e128-45e9-81ba-347c754ec47a tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.414320 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e154e2c7-e128-45e9-81ba-347c754ec47a tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.238536 Jul 20 04:36:44.415572 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2581/5141] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:44 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:44.488834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ae6e886-9d30-422b-81a0-36d7932c26d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.497615 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ae6e886-9d30-422b-81a0-36d7932c26d1 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1314 microversion: 2.1 time: 0.193357 Jul 20 04:36:44.501017 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2561/5142] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:44 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:45.451000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bd76206-f316-488c-95b1-1d68c24d9617 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:45.453350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6bd76206-f316-488c-95b1-1d68c24d9617 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:45.502639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bd76206-f316-488c-95b1-1d68c24d9617 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.513370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bd76206-f316-488c-95b1-1d68c24d9617 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.517928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bd76206-f316-488c-95b1-1d68c24d9617 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.518502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bd76206-f316-488c-95b1-1d68c24d9617 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.528524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-219de7e8-81a4-4358-9fcc-b3a17dac449a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:45.529801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-219de7e8-81a4-4358-9fcc-b3a17dac449a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:45.533490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:45.583801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-219de7e8-81a4-4358-9fcc-b3a17dac449a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.585876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-219de7e8-81a4-4358-9fcc-b3a17dac449a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.591313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-219de7e8-81a4-4358-9fcc-b3a17dac449a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.607987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-219de7e8-81a4-4358-9fcc-b3a17dac449a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.092142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-219de7e8-81a4-4358-9fcc-b3a17dac449a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.105762 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-219de7e8-81a4-4358-9fcc-b3a17dac449a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1314 microversion: 2.1 time: 0.581668 Jul 20 04:36:46.111830 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2562/5143] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:45 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:46.118563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-bbc90e55-1864-4e16-bf74-d35ead2c1546 req-6a94dbc0-340a-40dd-9b83-f1f5f10780d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d21092-aba7-482a-befb-1093f60fb247", "tag": "483351f5-0838-4691-a2b2-8d9d0878b14f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:46.142294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6bd76206-f316-488c-95b1-1d68c24d9617 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.144400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bbc90e55-1864-4e16-bf74-d35ead2c1546 req-6a94dbc0-340a-40dd-9b83-f1f5f10780d3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.146008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bbc90e55-1864-4e16-bf74-d35ead2c1546 req-6a94dbc0-340a-40dd-9b83-f1f5f10780d3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.154841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6bd76206-f316-488c-95b1-1d68c24d9617 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.159963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6bd76206-f316-488c-95b1-1d68c24d9617 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.161667 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6bd76206-f316-488c-95b1-1d68c24d9617 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.732644 Jul 20 04:36:46.162924 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2582/5144] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:45 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:46.193036 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-bbc90e55-1864-4e16-bf74-d35ead2c1546 req-6a94dbc0-340a-40dd-9b83-f1f5f10780d3 service nova] Creating event network-changed:483351f5-0838-4691-a2b2-8d9d0878b14f for instance 85d21092-aba7-482a-befb-1093f60fb247 on n-h1-760456-11 Jul 20 04:36:46.201731 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-bbc90e55-1864-4e16-bf74-d35ead2c1546 req-6a94dbc0-340a-40dd-9b83-f1f5f10780d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088321 Jul 20 04:36:46.202848 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2563/5145] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:47.123872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b2541b6-2eae-4681-ae36-97c63437e1f3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:47.125640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6b2541b6-2eae-4681-ae36-97c63437e1f3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:47.134042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b2541b6-2eae-4681-ae36-97c63437e1f3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.134548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b2541b6-2eae-4681-ae36-97c63437e1f3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.135353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b2541b6-2eae-4681-ae36-97c63437e1f3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.135805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b2541b6-2eae-4681-ae36-97c63437e1f3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.160288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:47.182760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-14e0c30d-0683-40ab-a9cf-971897e1f4b7 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:47.184147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-14e0c30d-0683-40ab-a9cf-971897e1f4b7 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:47.193467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14e0c30d-0683-40ab-a9cf-971897e1f4b7 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.194086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14e0c30d-0683-40ab-a9cf-971897e1f4b7 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.195048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14e0c30d-0683-40ab-a9cf-971897e1f4b7 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.195663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14e0c30d-0683-40ab-a9cf-971897e1f4b7 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.412962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-14e0c30d-0683-40ab-a9cf-971897e1f4b7 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.420120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6b2541b6-2eae-4681-ae36-97c63437e1f3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.428933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-14e0c30d-0683-40ab-a9cf-971897e1f4b7 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.433192 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b2541b6-2eae-4681-ae36-97c63437e1f3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1314 microversion: 2.1 time: 0.313867 Jul 20 04:36:47.443090 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2583/5146] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:47 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:47.444806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-14e0c30d-0683-40ab-a9cf-971897e1f4b7 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.446850 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-14e0c30d-0683-40ab-a9cf-971897e1f4b7 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.269053 Jul 20 04:36:47.460294 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2564/5147] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:47 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:48.451518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-03763909-63f1-4a5c-9486-b228553ebfe3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:48.452152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-03763909-63f1-4a5c-9486-b228553ebfe3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:48.467616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bb257be7-220a-4928-9573-6ac4ce460aa1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:48.468249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bb257be7-220a-4928-9573-6ac4ce460aa1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:48.470128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:48.472569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03763909-63f1-4a5c-9486-b228553ebfe3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.473276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03763909-63f1-4a5c-9486-b228553ebfe3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.477666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03763909-63f1-4a5c-9486-b228553ebfe3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.478411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03763909-63f1-4a5c-9486-b228553ebfe3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.483087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb257be7-220a-4928-9573-6ac4ce460aa1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.483780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb257be7-220a-4928-9573-6ac4ce460aa1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.484824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb257be7-220a-4928-9573-6ac4ce460aa1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.485488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb257be7-220a-4928-9573-6ac4ce460aa1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.666563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:48.710856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bb257be7-220a-4928-9573-6ac4ce460aa1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.724205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bb257be7-220a-4928-9573-6ac4ce460aa1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.728064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bb257be7-220a-4928-9573-6ac4ce460aa1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.736088 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bb257be7-220a-4928-9573-6ac4ce460aa1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.272684 Jul 20 04:36:48.742518 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2565/5148] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:48 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:49.218690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-03763909-63f1-4a5c-9486-b228553ebfe3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.229995 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-03763909-63f1-4a5c-9486-b228553ebfe3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1314 microversion: 2.1 time: 0.783579 Jul 20 04:36:49.241802 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2584/5149] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:48 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:49.770533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b0ae8843-1c68-4226-a6bb-a5f6944ab608 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:49.774162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b0ae8843-1c68-4226-a6bb-a5f6944ab608 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:49.789946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0ae8843-1c68-4226-a6bb-a5f6944ab608 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.790857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0ae8843-1c68-4226-a6bb-a5f6944ab608 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.792872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0ae8843-1c68-4226-a6bb-a5f6944ab608 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.794516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0ae8843-1c68-4226-a6bb-a5f6944ab608 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.006494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0ae8843-1c68-4226-a6bb-a5f6944ab608 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.019459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0ae8843-1c68-4226-a6bb-a5f6944ab608 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.039126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0ae8843-1c68-4226-a6bb-a5f6944ab608 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.047964 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b0ae8843-1c68-4226-a6bb-a5f6944ab608 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.281960 Jul 20 04:36:50.049034 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2566/5150] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:49 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:50.249136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dde3d49e-2590-4880-b3d8-3809cd380470 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:50.251565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dde3d49e-2590-4880-b3d8-3809cd380470 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:50.261240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dde3d49e-2590-4880-b3d8-3809cd380470 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.261945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dde3d49e-2590-4880-b3d8-3809cd380470 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.264590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dde3d49e-2590-4880-b3d8-3809cd380470 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.265310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dde3d49e-2590-4880-b3d8-3809cd380470 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.780895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dde3d49e-2590-4880-b3d8-3809cd380470 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.795737 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dde3d49e-2590-4880-b3d8-3809cd380470 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1314 microversion: 2.1 time: 0.551002 Jul 20 04:36:50.802232 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2585/5151] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:50 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:51.070342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5f3fb96d-fb80-46fc-9925-314714d86f95 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.070971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5f3fb96d-fb80-46fc-9925-314714d86f95 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:51.083626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f3fb96d-fb80-46fc-9925-314714d86f95 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.086199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f3fb96d-fb80-46fc-9925-314714d86f95 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.087269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f3fb96d-fb80-46fc-9925-314714d86f95 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.091401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f3fb96d-fb80-46fc-9925-314714d86f95 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.294038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5f3fb96d-fb80-46fc-9925-314714d86f95 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.305885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5f3fb96d-fb80-46fc-9925-314714d86f95 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.310400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5f3fb96d-fb80-46fc-9925-314714d86f95 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.312870 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5f3fb96d-fb80-46fc-9925-314714d86f95 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.246703 Jul 20 04:36:51.339718 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2567/5152] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:51.821106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2822aa45-8d48-4a88-b2e0-af36f8ca12cc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.821766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2822aa45-8d48-4a88-b2e0-af36f8ca12cc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:51.832393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2822aa45-8d48-4a88-b2e0-af36f8ca12cc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.832973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2822aa45-8d48-4a88-b2e0-af36f8ca12cc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.833890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2822aa45-8d48-4a88-b2e0-af36f8ca12cc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.834790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2822aa45-8d48-4a88-b2e0-af36f8ca12cc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.935675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-47438ef5-1aef-4e01-85c0-6540e00a38a0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '.version_select at 0x7fb8410e51f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.961716 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-47438ef5-1aef-4e01-85c0-6540e00a38a0 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1412421735" status: 202 len: 0 microversion: 2.1 time: 0.036296 Jul 20 04:36:51.969265 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2568/5153] 10.222.0.59 () {58 vars in 1283 bytes} [Wed Jul 20 04:36:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1412421735 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:52.007157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d605e63-9846-4873-ade0-6ab69cdf77e4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'create', calling method: .version_select at 0x7fb841bfc430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2100508762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTGFIH/pF+3dlMChdKB8AATYKu25p+hqQ7sdZzMdx7xoI6GbHd8HU5NOKuyeFKQ6KKK2iVktnkdwv/X43eQWJgn6OA5/vaC0+kJbVAU0SC3VH6LJWUWnJuAOHTo1Fgdhw=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:52.025504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-5d605e63-9846-4873-ade0-6ab69cdf77e4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:52.037560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-5d605e63-9846-4873-ade0-6ab69cdf77e4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for user 8f84ec28420a4cdcb88920cd86ce0160 and project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:52.095070 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d605e63-9846-4873-ade0-6ab69cdf77e4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.094375 Jul 20 04:36:52.103500 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2569/5154] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:36:51 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:52.186616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2822aa45-8d48-4a88-b2e0-af36f8ca12cc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.195782 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2822aa45-8d48-4a88-b2e0-af36f8ca12cc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1314 microversion: 2.1 time: 0.378568 Jul 20 04:36:52.208184 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2586/5155] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:52.338222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8b3de070-bfe8-4a74-990d-3921e31f4f47 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:52.339204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8b3de070-bfe8-4a74-990d-3921e31f4f47 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:52.342281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:52.378726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b3de070-bfe8-4a74-990d-3921e31f4f47 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.379197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b3de070-bfe8-4a74-990d-3921e31f4f47 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.386827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b3de070-bfe8-4a74-990d-3921e31f4f47 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.387954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b3de070-bfe8-4a74-990d-3921e31f4f47 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.528730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8b3de070-bfe8-4a74-990d-3921e31f4f47 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.538791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8b3de070-bfe8-4a74-990d-3921e31f4f47 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.541567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8b3de070-bfe8-4a74-990d-3921e31f4f47 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.543939 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8b3de070-bfe8-4a74-990d-3921e31f4f47 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.209238 Jul 20 04:36:52.545209 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2570/5156] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:52 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:53.016978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a2da88ac-5ab6-412a-8216-c6f345e0b350 req-2adc4e30-f519-4fa6-935d-900a947dc69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d21092-aba7-482a-befb-1093f60fb247", "name": "network-vif-plugged", "status": "completed", "tag": "483351f5-0838-4691-a2b2-8d9d0878b14f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:53.032577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a2da88ac-5ab6-412a-8216-c6f345e0b350 req-2adc4e30-f519-4fa6-935d-900a947dc69c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.036872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a2da88ac-5ab6-412a-8216-c6f345e0b350 req-2adc4e30-f519-4fa6-935d-900a947dc69c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.065828 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a2da88ac-5ab6-412a-8216-c6f345e0b350 req-2adc4e30-f519-4fa6-935d-900a947dc69c service nova] Creating event network-vif-plugged:483351f5-0838-4691-a2b2-8d9d0878b14f for instance 85d21092-aba7-482a-befb-1093f60fb247 on n-h1-760456-11 Jul 20 04:36:53.083890 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a2da88ac-5ab6-412a-8216-c6f345e0b350 req-2adc4e30-f519-4fa6-935d-900a947dc69c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070985 Jul 20 04:36:53.086865 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2587/5157] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:53.215441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-24e1295a-e861-4560-88f3-b5025477b9c6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:53.216372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-24e1295a-e861-4560-88f3-b5025477b9c6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:53.227873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24e1295a-e861-4560-88f3-b5025477b9c6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.228347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24e1295a-e861-4560-88f3-b5025477b9c6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.237915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24e1295a-e861-4560-88f3-b5025477b9c6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.239273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24e1295a-e861-4560-88f3-b5025477b9c6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.556823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a93f129b-eb2a-4d6a-bda6-c7607a744986 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:53.557773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a93f129b-eb2a-4d6a-bda6-c7607a744986 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:53.562685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-24e1295a-e861-4560-88f3-b5025477b9c6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.576470 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-24e1295a-e861-4560-88f3-b5025477b9c6 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1314 microversion: 2.1 time: 0.364806 Jul 20 04:36:53.576999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a93f129b-eb2a-4d6a-bda6-c7607a744986 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.577962 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2571/5158] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:53 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:53.580113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a93f129b-eb2a-4d6a-bda6-c7607a744986 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.581041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a93f129b-eb2a-4d6a-bda6-c7607a744986 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.582757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a93f129b-eb2a-4d6a-bda6-c7607a744986 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.584464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1281947-5956-4a26-9e36-c00469416cdb tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:53.585217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1281947-5956-4a26-9e36-c00469416cdb tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:53.594891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1281947-5956-4a26-9e36-c00469416cdb tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.595576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1281947-5956-4a26-9e36-c00469416cdb tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.596859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1281947-5956-4a26-9e36-c00469416cdb tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.597492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1281947-5956-4a26-9e36-c00469416cdb tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.651313 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a93f129b-eb2a-4d6a-bda6-c7607a744986 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/ips" status: 200 len: 150 microversion: 2.1 time: 0.099890 Jul 20 04:36:53.654194 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2588/5159] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:36:53 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/ips => generated 150 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:53.740179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a1281947-5956-4a26-9e36-c00469416cdb tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.752555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a1281947-5956-4a26-9e36-c00469416cdb tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.755402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a1281947-5956-4a26-9e36-c00469416cdb tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.756983 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1281947-5956-4a26-9e36-c00469416cdb tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.177886 Jul 20 04:36:53.758639 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2572/5160] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:53 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:54.596811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1e8b9e21-debc-4b55-9dc3-fafa5413b2c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:54.598278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1e8b9e21-debc-4b55-9dc3-fafa5413b2c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:54.620385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e8b9e21-debc-4b55-9dc3-fafa5413b2c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.622468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e8b9e21-debc-4b55-9dc3-fafa5413b2c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.624949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e8b9e21-debc-4b55-9dc3-fafa5413b2c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.625800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e8b9e21-debc-4b55-9dc3-fafa5413b2c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.778288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b01d2e60-49d6-4923-868d-83643e80ad96 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:54.779302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b01d2e60-49d6-4923-868d-83643e80ad96 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:54.800894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b01d2e60-49d6-4923-868d-83643e80ad96 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.804022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b01d2e60-49d6-4923-868d-83643e80ad96 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.806460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b01d2e60-49d6-4923-868d-83643e80ad96 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.807435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b01d2e60-49d6-4923-868d-83643e80ad96 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.909662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1e8b9e21-debc-4b55-9dc3-fafa5413b2c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:54.929589 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1e8b9e21-debc-4b55-9dc3-fafa5413b2c9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1500 microversion: 2.1 time: 0.339161 Jul 20 04:36:54.934748 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2589/5161] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:54 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1500 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:54.957379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b01d2e60-49d6-4923-868d-83643e80ad96 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:54.960844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-78ef64fd-947d-4101-8a0d-42cfe9955240 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:54.961467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-78ef64fd-947d-4101-8a0d-42cfe9955240 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:54.977799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ef64fd-947d-4101-8a0d-42cfe9955240 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.978996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b01d2e60-49d6-4923-868d-83643e80ad96 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:54.982702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ef64fd-947d-4101-8a0d-42cfe9955240 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.984574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ef64fd-947d-4101-8a0d-42cfe9955240 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.985035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78ef64fd-947d-4101-8a0d-42cfe9955240 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.985493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b01d2e60-49d6-4923-868d-83643e80ad96 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:54.986827 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b01d2e60-49d6-4923-868d-83643e80ad96 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.213805 Jul 20 04:36:54.990764 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2573/5162] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:54 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:55.140649 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-78ef64fd-947d-4101-8a0d-42cfe9955240 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247/action" status: 202 len: 0 microversion: 2.1 time: 0.191496 Jul 20 04:36:55.141851 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2590/5163] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:54 2022] POST /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:55.155523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d2fcd44d-5ff4-4c87-9e9e-7dcc6f2348c7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.156408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d2fcd44d-5ff4-4c87-9e9e-7dcc6f2348c7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.176579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2fcd44d-5ff4-4c87-9e9e-7dcc6f2348c7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.178809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2fcd44d-5ff4-4c87-9e9e-7dcc6f2348c7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.181348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2fcd44d-5ff4-4c87-9e9e-7dcc6f2348c7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.183451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2fcd44d-5ff4-4c87-9e9e-7dcc6f2348c7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.944873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d2fcd44d-5ff4-4c87-9e9e-7dcc6f2348c7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.965454 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d2fcd44d-5ff4-4c87-9e9e-7dcc6f2348c7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1505 microversion: 2.1 time: 0.811017 Jul 20 04:36:55.967048 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2574/5164] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:55 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1505 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:56.010041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f70a7ef5-8614-4ca4-8aa8-5064b270db87 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:56.013390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f70a7ef5-8614-4ca4-8aa8-5064b270db87 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:56.023250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f70a7ef5-8614-4ca4-8aa8-5064b270db87 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.024076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f70a7ef5-8614-4ca4-8aa8-5064b270db87 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.025274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f70a7ef5-8614-4ca4-8aa8-5064b270db87 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.025933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f70a7ef5-8614-4ca4-8aa8-5064b270db87 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.162876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f70a7ef5-8614-4ca4-8aa8-5064b270db87 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.183283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f70a7ef5-8614-4ca4-8aa8-5064b270db87 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.188071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f70a7ef5-8614-4ca4-8aa8-5064b270db87 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.189343 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f70a7ef5-8614-4ca4-8aa8-5064b270db87 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.186712 Jul 20 04:36:56.189918 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2591/5165] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:56 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:56.397393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-70a76db8-b096-41f3-bb35-aad787a8f7c3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dd51226-8d4a-46d6-b662-e98ae3e19b3e"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:56.398778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-70a76db8-b096-41f3-bb35-aad787a8f7c3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:56.408546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70a76db8-b096-41f3-bb35-aad787a8f7c3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.409288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70a76db8-b096-41f3-bb35-aad787a8f7c3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.410426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70a76db8-b096-41f3-bb35-aad787a8f7c3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.411044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70a76db8-b096-41f3-bb35-aad787a8f7c3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.853661 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-70a76db8-b096-41f3-bb35-aad787a8f7c3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459779 Jul 20 04:36:56.862718 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2575/5166] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:36:56 2022] POST /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:56.984274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e9cf0c77-dabd-4399-a550-5c607af5ac3a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:56.984917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e9cf0c77-dabd-4399-a550-5c607af5ac3a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:57.009102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9cf0c77-dabd-4399-a550-5c607af5ac3a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.009642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9cf0c77-dabd-4399-a550-5c607af5ac3a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.010488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9cf0c77-dabd-4399-a550-5c607af5ac3a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.014688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9cf0c77-dabd-4399-a550-5c607af5ac3a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.209262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-eb3a2730-6c3f-46c0-a4c4-a581a7b14f5d tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:57.210014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-eb3a2730-6c3f-46c0-a4c4-a581a7b14f5d tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:57.230842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb3a2730-6c3f-46c0-a4c4-a581a7b14f5d tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.231531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb3a2730-6c3f-46c0-a4c4-a581a7b14f5d tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.232611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb3a2730-6c3f-46c0-a4c4-a581a7b14f5d tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.233243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb3a2730-6c3f-46c0-a4c4-a581a7b14f5d tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.437153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eb3a2730-6c3f-46c0-a4c4-a581a7b14f5d tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.446158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eb3a2730-6c3f-46c0-a4c4-a581a7b14f5d tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.459692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eb3a2730-6c3f-46c0-a4c4-a581a7b14f5d tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.461437 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-eb3a2730-6c3f-46c0-a4c4-a581a7b14f5d tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.256600 Jul 20 04:36:57.482773 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2576/5167] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:57 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:57.771745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e9cf0c77-dabd-4399-a550-5c607af5ac3a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.790544 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e9cf0c77-dabd-4399-a550-5c607af5ac3a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1485 microversion: 2.1 time: 0.804514 Jul 20 04:36:57.803364 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2592/5168] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:56 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1485 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:57.813943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4013313c-f3da-42fd-bbda-68eb600f42ec tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:57.814617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4013313c-f3da-42fd-bbda-68eb600f42ec tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:57.837365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4013313c-f3da-42fd-bbda-68eb600f42ec tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.837839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4013313c-f3da-42fd-bbda-68eb600f42ec tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.838669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4013313c-f3da-42fd-bbda-68eb600f42ec tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.839128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4013313c-f3da-42fd-bbda-68eb600f42ec tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.889150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:57.896619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-4013313c-f3da-42fd-bbda-68eb600f42ec tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lazy-loading 'flavor' on Instance uuid 85d21092-aba7-482a-befb-1093f60fb247 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:36:58.408117 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4013313c-f3da-42fd-bbda-68eb600f42ec tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247/action" status: 202 len: 0 microversion: 2.1 time: 0.598437 Jul 20 04:36:58.423891 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2577/5169] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:57 2022] POST /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:58.428676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b8bcc916-9d70-4690-b4fe-628aabc21b51 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:58.429309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b8bcc916-9d70-4690-b4fe-628aabc21b51 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:58.456396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8bcc916-9d70-4690-b4fe-628aabc21b51 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.457158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8bcc916-9d70-4690-b4fe-628aabc21b51 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.458132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8bcc916-9d70-4690-b4fe-628aabc21b51 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.458817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8bcc916-9d70-4690-b4fe-628aabc21b51 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.491274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce19b4e4-31c7-488a-a690-b1308dbd8766 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:58.491998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce19b4e4-31c7-488a-a690-b1308dbd8766 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:58.507765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce19b4e4-31c7-488a-a690-b1308dbd8766 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.508330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce19b4e4-31c7-488a-a690-b1308dbd8766 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.509155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce19b4e4-31c7-488a-a690-b1308dbd8766 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.509612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce19b4e4-31c7-488a-a690-b1308dbd8766 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.661270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce19b4e4-31c7-488a-a690-b1308dbd8766 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.673488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce19b4e4-31c7-488a-a690-b1308dbd8766 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.681691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce19b4e4-31c7-488a-a690-b1308dbd8766 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.683477 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce19b4e4-31c7-488a-a690-b1308dbd8766 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.199109 Jul 20 04:36:58.692695 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2578/5170] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:58 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:36:58.795458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b8bcc916-9d70-4690-b4fe-628aabc21b51 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.810620 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b8bcc916-9d70-4690-b4fe-628aabc21b51 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1491 microversion: 2.1 time: 0.386573 Jul 20 04:36:58.811623 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2593/5171] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:58 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1491 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:59.713454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-111e6c5a-2439-4231-b728-6e018c6b58d1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:59.714086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-111e6c5a-2439-4231-b728-6e018c6b58d1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:59.724267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-111e6c5a-2439-4231-b728-6e018c6b58d1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.724732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-111e6c5a-2439-4231-b728-6e018c6b58d1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.737572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-111e6c5a-2439-4231-b728-6e018c6b58d1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.738538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-111e6c5a-2439-4231-b728-6e018c6b58d1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.830451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d27aab6-117a-4d57-ab34-621f27144c65 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:59.831913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7d27aab6-117a-4d57-ab34-621f27144c65 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:59.844564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:59.846965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d27aab6-117a-4d57-ab34-621f27144c65 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.846965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d27aab6-117a-4d57-ab34-621f27144c65 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.852697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d27aab6-117a-4d57-ab34-621f27144c65 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.853314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7d27aab6-117a-4d57-ab34-621f27144c65 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:00.161494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7d27aab6-117a-4d57-ab34-621f27144c65 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:00.180811 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7d27aab6-117a-4d57-ab34-621f27144c65 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1512 microversion: 2.1 time: 0.351743 Jul 20 04:37:00.182347 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2594/5172] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:59 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:00.207078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-111e6c5a-2439-4231-b728-6e018c6b58d1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:00.241901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-111e6c5a-2439-4231-b728-6e018c6b58d1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:00.250595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-111e6c5a-2439-4231-b728-6e018c6b58d1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:00.255357 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-111e6c5a-2439-4231-b728-6e018c6b58d1 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.547208 Jul 20 04:37:00.258326 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2579/5173] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:59 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:01.214345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4efa097-270c-429d-a257-0e0df3c4e130 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:01.216527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b4efa097-270c-429d-a257-0e0df3c4e130 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:01.240908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4efa097-270c-429d-a257-0e0df3c4e130 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.241767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4efa097-270c-429d-a257-0e0df3c4e130 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.250592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4efa097-270c-429d-a257-0e0df3c4e130 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.251576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4efa097-270c-429d-a257-0e0df3c4e130 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.285794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0010e237-904e-4930-bae0-2b140e881342 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:01.286461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0010e237-904e-4930-bae0-2b140e881342 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:01.322574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0010e237-904e-4930-bae0-2b140e881342 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.323039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0010e237-904e-4930-bae0-2b140e881342 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.323841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0010e237-904e-4930-bae0-2b140e881342 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.324867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0010e237-904e-4930-bae0-2b140e881342 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.870027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0010e237-904e-4930-bae0-2b140e881342 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.881969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0010e237-904e-4930-bae0-2b140e881342 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.887306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0010e237-904e-4930-bae0-2b140e881342 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.891255 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0010e237-904e-4930-bae0-2b140e881342 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1408 microversion: 2.54 time: 0.617260 Jul 20 04:37:01.895008 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2580/5174] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:01 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1408 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:02.106220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b4efa097-270c-429d-a257-0e0df3c4e130 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.123804 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b4efa097-270c-429d-a257-0e0df3c4e130 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.929088 Jul 20 04:37:02.125078 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2595/5175] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:01 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:02.914043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-64e21ffb-346f-46ca-aaaf-71f8d47cd481 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:02.914719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-64e21ffb-346f-46ca-aaaf-71f8d47cd481 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:02.926747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:02.935537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64e21ffb-346f-46ca-aaaf-71f8d47cd481 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.936350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64e21ffb-346f-46ca-aaaf-71f8d47cd481 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.937393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64e21ffb-346f-46ca-aaaf-71f8d47cd481 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.938014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64e21ffb-346f-46ca-aaaf-71f8d47cd481 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.060714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-64e21ffb-346f-46ca-aaaf-71f8d47cd481 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.072265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-64e21ffb-346f-46ca-aaaf-71f8d47cd481 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.075386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-64e21ffb-346f-46ca-aaaf-71f8d47cd481 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.076971 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-64e21ffb-346f-46ca-aaaf-71f8d47cd481 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1414 microversion: 2.54 time: 0.170072 Jul 20 04:37:03.078050 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2581/5176] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:02 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1414 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:03.142653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-41ea7e3c-47e5-4e51-9bf6-b7e49790c2fe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:03.143919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-41ea7e3c-47e5-4e51-9bf6-b7e49790c2fe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:03.152572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ea7e3c-47e5-4e51-9bf6-b7e49790c2fe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.153210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ea7e3c-47e5-4e51-9bf6-b7e49790c2fe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.154169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ea7e3c-47e5-4e51-9bf6-b7e49790c2fe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.154811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-41ea7e3c-47e5-4e51-9bf6-b7e49790c2fe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.997118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-41ea7e3c-47e5-4e51-9bf6-b7e49790c2fe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.011182 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-41ea7e3c-47e5-4e51-9bf6-b7e49790c2fe tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.872654 Jul 20 04:37:04.012540 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2596/5177] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:03 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:04.096846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-90752e51-5ba2-4615-b31e-38ca7dd09949 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:04.098647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-90752e51-5ba2-4615-b31e-38ca7dd09949 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:04.119609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90752e51-5ba2-4615-b31e-38ca7dd09949 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.133302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90752e51-5ba2-4615-b31e-38ca7dd09949 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.135088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90752e51-5ba2-4615-b31e-38ca7dd09949 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.136548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90752e51-5ba2-4615-b31e-38ca7dd09949 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.393630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90752e51-5ba2-4615-b31e-38ca7dd09949 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.403647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90752e51-5ba2-4615-b31e-38ca7dd09949 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.405327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90752e51-5ba2-4615-b31e-38ca7dd09949 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.416046 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-90752e51-5ba2-4615-b31e-38ca7dd09949 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1414 microversion: 2.54 time: 0.313702 Jul 20 04:37:04.416746 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2582/5178] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:04 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1414 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:05.043415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b5a9d044-6025-445d-9a3c-972787216da3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:05.045044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b5a9d044-6025-445d-9a3c-972787216da3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:05.066672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5a9d044-6025-445d-9a3c-972787216da3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.067340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5a9d044-6025-445d-9a3c-972787216da3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.069358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5a9d044-6025-445d-9a3c-972787216da3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.070722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5a9d044-6025-445d-9a3c-972787216da3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.442197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b08b02bd-f75a-4a0f-b391-57d194389dd2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:05.445759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b08b02bd-f75a-4a0f-b391-57d194389dd2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:05.461425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b08b02bd-f75a-4a0f-b391-57d194389dd2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.464312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b08b02bd-f75a-4a0f-b391-57d194389dd2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.467650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b08b02bd-f75a-4a0f-b391-57d194389dd2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.469178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b08b02bd-f75a-4a0f-b391-57d194389dd2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.848522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b08b02bd-f75a-4a0f-b391-57d194389dd2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:05.859306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b08b02bd-f75a-4a0f-b391-57d194389dd2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:05.882597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b08b02bd-f75a-4a0f-b391-57d194389dd2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:05.904255 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b08b02bd-f75a-4a0f-b391-57d194389dd2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1399 microversion: 2.54 time: 0.446691 Jul 20 04:37:05.906192 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2583/5179] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:05 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1399 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:05.929824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c31d4591-9de3-4250-9365-adc094d66c16 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '.version_select at 0x7fb84101bd30>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:05.977372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b5a9d044-6025-445d-9a3c-972787216da3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:05.992895 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b5a9d044-6025-445d-9a3c-972787216da3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.954702 Jul 20 04:37:05.997282 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2597/5180] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:05 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:06.009645 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c31d4591-9de3-4250-9365-adc094d66c16 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-542960662" status: 204 len: 0 microversion: 2.54 time: 0.083971 Jul 20 04:37:06.017344 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2584/5181] 10.222.0.59 () {60 vars in 1315 bytes} [Wed Jul 20 04:37:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-542960662 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:37:06.029732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-073270bb-24b6-413e-95d4-97aa0a7a14aa tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:06.030748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-073270bb-24b6-413e-95d4-97aa0a7a14aa tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:06.070976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-073270bb-24b6-413e-95d4-97aa0a7a14aa tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.073036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-073270bb-24b6-413e-95d4-97aa0a7a14aa tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.077318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-073270bb-24b6-413e-95d4-97aa0a7a14aa tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.077941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-073270bb-24b6-413e-95d4-97aa0a7a14aa tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.164237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-073270bb-24b6-413e-95d4-97aa0a7a14aa tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:06.343790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:06.487016 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-073270bb-24b6-413e-95d4-97aa0a7a14aa tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 204 len: 0 microversion: 2.54 time: 0.453449 Jul 20 04:37:06.492589 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2598/5182] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:37:06 2022] DELETE /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:37:06.504804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-01922d11-27df-4775-935b-3b6918c2f9fc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:06.505553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-01922d11-27df-4775-935b-3b6918c2f9fc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:06.519077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01922d11-27df-4775-935b-3b6918c2f9fc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.521323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01922d11-27df-4775-935b-3b6918c2f9fc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.525191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01922d11-27df-4775-935b-3b6918c2f9fc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.525990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01922d11-27df-4775-935b-3b6918c2f9fc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.003636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-01922d11-27df-4775-935b-3b6918c2f9fc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.015747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9fdc9998-e6cc-48b1-8d0c-cc54ca399680 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:07.016838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9fdc9998-e6cc-48b1-8d0c-cc54ca399680 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:07.021485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-01922d11-27df-4775-935b-3b6918c2f9fc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.043448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9fdc9998-e6cc-48b1-8d0c-cc54ca399680 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.043821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-01922d11-27df-4775-935b-3b6918c2f9fc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.045366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9fdc9998-e6cc-48b1-8d0c-cc54ca399680 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.063059 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-01922d11-27df-4775-935b-3b6918c2f9fc tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1405 microversion: 2.54 time: 0.565315 Jul 20 04:37:07.067657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9fdc9998-e6cc-48b1-8d0c-cc54ca399680 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.069514 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2585/5183] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:06 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1405 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:07.070219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9fdc9998-e6cc-48b1-8d0c-cc54ca399680 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.613037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9fdc9998-e6cc-48b1-8d0c-cc54ca399680 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.635049 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9fdc9998-e6cc-48b1-8d0c-cc54ca399680 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.623321 Jul 20 04:37:07.645897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2599/5184] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:07 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:07.803576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8245e8c4-d20f-4c25-8b88-86ffe81ed6fb req-7eb6ce60-3f83-4c75-b9f4-7493eae6588d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d21092-aba7-482a-befb-1093f60fb247", "name": "network-vif-plugged", "status": "completed", "tag": "483351f5-0838-4691-a2b2-8d9d0878b14f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:07.830542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8245e8c4-d20f-4c25-8b88-86ffe81ed6fb req-7eb6ce60-3f83-4c75-b9f4-7493eae6588d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.831838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8245e8c4-d20f-4c25-8b88-86ffe81ed6fb req-7eb6ce60-3f83-4c75-b9f4-7493eae6588d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.878617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8245e8c4-d20f-4c25-8b88-86ffe81ed6fb req-7eb6ce60-3f83-4c75-b9f4-7493eae6588d service nova] Creating event network-vif-plugged:483351f5-0838-4691-a2b2-8d9d0878b14f for instance 85d21092-aba7-482a-befb-1093f60fb247 on n-h1-760456-11 Jul 20 04:37:07.901800 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8245e8c4-d20f-4c25-8b88-86ffe81ed6fb req-7eb6ce60-3f83-4c75-b9f4-7493eae6588d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104699 Jul 20 04:37:07.917362 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2586/5185] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:08.089695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-258c3461-40d6-4ff3-b2a6-b67df9f0eff2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:08.090617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-258c3461-40d6-4ff3-b2a6-b67df9f0eff2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:08.149558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-258c3461-40d6-4ff3-b2a6-b67df9f0eff2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.154907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-258c3461-40d6-4ff3-b2a6-b67df9f0eff2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.157455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-258c3461-40d6-4ff3-b2a6-b67df9f0eff2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.157932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-258c3461-40d6-4ff3-b2a6-b67df9f0eff2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.615702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-258c3461-40d6-4ff3-b2a6-b67df9f0eff2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.630176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-258c3461-40d6-4ff3-b2a6-b67df9f0eff2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.641488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-258c3461-40d6-4ff3-b2a6-b67df9f0eff2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd035d78670ed4567aa9fae24efd2e6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b1377d689e4f94979cedd538380995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.655631 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-258c3461-40d6-4ff3-b2a6-b67df9f0eff2 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 200 len: 1405 microversion: 2.54 time: 0.558308 Jul 20 04:37:08.657777 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2600/5186] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:08 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 1405 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:08.659989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59724200-0f51-4c23-bed4-3ca0980ab673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:08.660708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-59724200-0f51-4c23-bed4-3ca0980ab673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:08.688667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59724200-0f51-4c23-bed4-3ca0980ab673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.689270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59724200-0f51-4c23-bed4-3ca0980ab673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.693647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59724200-0f51-4c23-bed4-3ca0980ab673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.701797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59724200-0f51-4c23-bed4-3ca0980ab673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.720198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2108013731", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "ce93565d-b0ab-4254-ab83-6988d6eb075b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2100508762", "security_groups": [{"name": "tempest-secgroup-smoke-1883394550"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:09.161035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-59724200-0f51-4c23-bed4-3ca0980ab673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:09.177269 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-59724200-0f51-4c23-bed4-3ca0980ab673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.522289 Jul 20 04:37:09.193645 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2587/5187] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:08 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:09.216558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] validate_networks() for [('ce93565d-b0ab-4254-ab83-6988d6eb075b', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:37:09.678464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d83d9a0f-f6c8-4067-a2a2-7fba8b245335 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:09.679568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d83d9a0f-f6c8-4067-a2a2-7fba8b245335 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] [instance: 0ac3f7af-d79a-402d-9743-7130a6077dfe] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:09.703053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d83d9a0f-f6c8-4067-a2a2-7fba8b245335 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.707136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d83d9a0f-f6c8-4067-a2a2-7fba8b245335 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.708268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d83d9a0f-f6c8-4067-a2a2-7fba8b245335 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.708967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d83d9a0f-f6c8-4067-a2a2-7fba8b245335 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.742909 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d83d9a0f-f6c8-4067-a2a2-7fba8b245335 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] HTTP exception thrown: Instance 0ac3f7af-d79a-402d-9743-7130a6077dfe could not be found. Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d83d9a0f-f6c8-4067-a2a2-7fba8b245335 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Request method failure captured: Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe HTTP/1.1 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14ZMMy2P0wMUW9ybS9Apgk4nItvzZ34SNQwxNmvP3mreosBTUCE4k8Vl7qPzraEpRaQI7o93EuweaCFlNUOVrQvnYU1fJgwljobenmWciqUXcsySWciFUa4o4q9mz6boPyQYe9qXCRzS-vWTjWux30iLjaNSPTGIrQ6nT2dJvLBLKl8 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.54 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 23b1377d689e4f94979cedd538380995 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerShowV254Test-1013476228 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/23b1377d689e4f94979cedd538380995"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/23b1377d689e4f94979cedd538380995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/23b1377d689e4f94979cedd538380995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_23b1377d689e4f94979cedd538380995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerShowV254Test-1013476228 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 23b1377d689e4f94979cedd538380995 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerShowV254Test-1013476228 Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerShowV254Test-1013476228-project Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: d035d78670ed4567aa9fae24efd2e6ec Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerShowV254Test-1013476228-project Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 0ac3f7af-d79a-402d-9743-7130a6077dfe could not be found. Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '0ac3f7af-d79a-402d-9743-7130a6077dfe'} Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac3f7af-d79a-402d-9743-7130a6077dfe could not be found. Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac3f7af-d79a-402d-9743-7130a6077dfe could not be found. Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:09.745073 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:09.750306 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:09.750306 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:09.750306 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:09.750306 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:09.750306 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:09.750306 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac3f7af-d79a-402d-9743-7130a6077dfe could not be found. Jul 20 04:37:09.750306 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:09.753623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d83d9a0f-f6c8-4067-a2a2-7fba8b245335 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] Returning 404 to user: Instance 0ac3f7af-d79a-402d-9743-7130a6077dfe could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:09.754775 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d83d9a0f-f6c8-4067-a2a2-7fba8b245335 tempest-ServerShowV254Test-1013476228 tempest-ServerShowV254Test-1013476228-project] 10.222.0.59 "GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe" status: 404 len: 111 microversion: 2.54 time: 0.080935 Jul 20 04:37:09.758907 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2588/5188] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:09 2022] GET /compute/v2.1/servers/0ac3f7af-d79a-402d-9743-7130a6077dfe => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:37:10.201768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7701003c-bc63-4014-8b5d-f54c44763e75 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:10.203114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7701003c-bc63-4014-8b5d-f54c44763e75 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:10.225884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7701003c-bc63-4014-8b5d-f54c44763e75 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.226708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7701003c-bc63-4014-8b5d-f54c44763e75 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.236796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7701003c-bc63-4014-8b5d-f54c44763e75 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.239294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7701003c-bc63-4014-8b5d-f54c44763e75 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.566217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:37:10.567209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:37:10.567970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:37:10.568717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:37:10.569320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:37:10.595013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.596692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.601431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.602239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.739069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:37:10.755339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for user 8f84ec28420a4cdcb88920cd86ce0160 and project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:37:10.842955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:37:10.845516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:37:10.864139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7701003c-bc63-4014-8b5d-f54c44763e75 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.873402 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7701003c-bc63-4014-8b5d-f54c44763e75 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.677074 Jul 20 04:37:10.887596 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2589/5189] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:10 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:11.056502 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8b60d0f3-5bee-4757-8cf6-f510caf3b8f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.343147 Jul 20 04:37:11.067513 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2601/5190] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:37:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 2351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:37:11.077797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ffd18ede-310e-42e8-9e29-bbff32b4130a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.080756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ffd18ede-310e-42e8-9e29-bbff32b4130a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.206005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ffd18ede-310e-42e8-9e29-bbff32b4130a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.218226 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ffd18ede-310e-42e8-9e29-bbff32b4130a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1267 microversion: 2.1 time: 0.146792 Jul 20 04:37:11.229620 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2590/5191] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:11.892140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d1fbc5b-50fa-4ee3-b68a-d794e7f7786e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.892776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8d1fbc5b-50fa-4ee3-b68a-d794e7f7786e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.912591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d1fbc5b-50fa-4ee3-b68a-d794e7f7786e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.919162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d1fbc5b-50fa-4ee3-b68a-d794e7f7786e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.921226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d1fbc5b-50fa-4ee3-b68a-d794e7f7786e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.921856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d1fbc5b-50fa-4ee3-b68a-d794e7f7786e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.236588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce67c3b3-d2d2-4335-b088-ac3b8cff04a9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:12.237266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce67c3b3-d2d2-4335-b088-ac3b8cff04a9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:12.259768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce67c3b3-d2d2-4335-b088-ac3b8cff04a9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.263809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce67c3b3-d2d2-4335-b088-ac3b8cff04a9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.267534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce67c3b3-d2d2-4335-b088-ac3b8cff04a9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.268246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce67c3b3-d2d2-4335-b088-ac3b8cff04a9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.458903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce67c3b3-d2d2-4335-b088-ac3b8cff04a9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:12.475966 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce67c3b3-d2d2-4335-b088-ac3b8cff04a9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1271 microversion: 2.1 time: 0.242075 Jul 20 04:37:12.477449 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2591/5192] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:12 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:13.494764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-13c29021-78d8-4c78-b310-38e1a9eb542b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:13.498997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-13c29021-78d8-4c78-b310-38e1a9eb542b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:13.518326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13c29021-78d8-4c78-b310-38e1a9eb542b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.519037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13c29021-78d8-4c78-b310-38e1a9eb542b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.520179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13c29021-78d8-4c78-b310-38e1a9eb542b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.520829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13c29021-78d8-4c78-b310-38e1a9eb542b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.628686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8d1fbc5b-50fa-4ee3-b68a-d794e7f7786e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.650355 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8d1fbc5b-50fa-4ee3-b68a-d794e7f7786e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 1.762813 Jul 20 04:37:13.678074 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2602/5193] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:13.702847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-13c29021-78d8-4c78-b310-38e1a9eb542b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.726554 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-13c29021-78d8-4c78-b310-38e1a9eb542b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1337 microversion: 2.1 time: 0.236787 Jul 20 04:37:13.738700 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2592/5194] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:13 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1337 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:14.672960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f208362d-1b4d-4c11-a7ec-2a2c7afc2ba4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:14.673594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f208362d-1b4d-4c11-a7ec-2a2c7afc2ba4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:14.697588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f208362d-1b4d-4c11-a7ec-2a2c7afc2ba4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.697588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f208362d-1b4d-4c11-a7ec-2a2c7afc2ba4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.716420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f208362d-1b4d-4c11-a7ec-2a2c7afc2ba4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.717054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f208362d-1b4d-4c11-a7ec-2a2c7afc2ba4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.746790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-73fcfbca-82d8-4cc3-923c-eeca81a4d7de tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:14.748044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-73fcfbca-82d8-4cc3-923c-eeca81a4d7de tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:14.765879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73fcfbca-82d8-4cc3-923c-eeca81a4d7de tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.771909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73fcfbca-82d8-4cc3-923c-eeca81a4d7de tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.772771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73fcfbca-82d8-4cc3-923c-eeca81a4d7de tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.773225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73fcfbca-82d8-4cc3-923c-eeca81a4d7de tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:15.139708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-73fcfbca-82d8-4cc3-923c-eeca81a4d7de tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:15.154956 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-73fcfbca-82d8-4cc3-923c-eeca81a4d7de tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1325 microversion: 2.1 time: 0.409279 Jul 20 04:37:15.160046 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2593/5195] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:14 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1325 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:16.174161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-321751c5-97a7-4019-92de-f74dd646453b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:16.175077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-321751c5-97a7-4019-92de-f74dd646453b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:16.185254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-321751c5-97a7-4019-92de-f74dd646453b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.185715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-321751c5-97a7-4019-92de-f74dd646453b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.190086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-321751c5-97a7-4019-92de-f74dd646453b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.190940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-321751c5-97a7-4019-92de-f74dd646453b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.422839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-321751c5-97a7-4019-92de-f74dd646453b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:16.434733 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-321751c5-97a7-4019-92de-f74dd646453b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 0.264282 Jul 20 04:37:16.435933 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2594/5196] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:16 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:16.545415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f208362d-1b4d-4c11-a7ec-2a2c7afc2ba4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:16.571219 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f208362d-1b4d-4c11-a7ec-2a2c7afc2ba4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 1.898649 Jul 20 04:37:16.575483 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2603/5197] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:14 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:17.451774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b62b179-904a-4ee1-94cc-c59967940811 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:17.453036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b62b179-904a-4ee1-94cc-c59967940811 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:17.465129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b62b179-904a-4ee1-94cc-c59967940811 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.476749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b62b179-904a-4ee1-94cc-c59967940811 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.486180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b62b179-904a-4ee1-94cc-c59967940811 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.496796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b62b179-904a-4ee1-94cc-c59967940811 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.503844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:17.593184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b1c93ebe-2a0f-46f0-8872-b95500904f72 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:17.595296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b1c93ebe-2a0f-46f0-8872-b95500904f72 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:17.609333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1c93ebe-2a0f-46f0-8872-b95500904f72 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.617949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1c93ebe-2a0f-46f0-8872-b95500904f72 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.634983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1c93ebe-2a0f-46f0-8872-b95500904f72 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.638010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1c93ebe-2a0f-46f0-8872-b95500904f72 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.572768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b62b179-904a-4ee1-94cc-c59967940811 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:18.582913 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b62b179-904a-4ee1-94cc-c59967940811 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 1.135058 Jul 20 04:37:18.593445 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2595/5198] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:17 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:19.609775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4d896155-4102-4931-a1c9-3115c4c49c8f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:19.611949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4d896155-4102-4931-a1c9-3115c4c49c8f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:19.628849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d896155-4102-4931-a1c9-3115c4c49c8f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.629716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d896155-4102-4931-a1c9-3115c4c49c8f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.630786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d896155-4102-4931-a1c9-3115c4c49c8f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.631465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d896155-4102-4931-a1c9-3115c4c49c8f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.071583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4d896155-4102-4931-a1c9-3115c4c49c8f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:20.105648 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4d896155-4102-4931-a1c9-3115c4c49c8f tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 0.498500 Jul 20 04:37:20.110372 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2596/5199] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:19 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:20.218746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b1c93ebe-2a0f-46f0-8872-b95500904f72 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:20.238269 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b1c93ebe-2a0f-46f0-8872-b95500904f72 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 2.647150 Jul 20 04:37:20.254142 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2604/5200] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:17 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 2667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:21.129160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3fd3f582-5cd6-4e6d-b10f-93117a6426ce tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:21.129811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3fd3f582-5cd6-4e6d-b10f-93117a6426ce tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:21.141959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fd3f582-5cd6-4e6d-b10f-93117a6426ce tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:21.155610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fd3f582-5cd6-4e6d-b10f-93117a6426ce tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.157272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fd3f582-5cd6-4e6d-b10f-93117a6426ce tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:21.157887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3fd3f582-5cd6-4e6d-b10f-93117a6426ce tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.216907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:21.263986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-114d6b82-d912-4007-9ff7-69df1ca1c973 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:21.265122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-114d6b82-d912-4007-9ff7-69df1ca1c973 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:21.268213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:21.286119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:21.314468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-114d6b82-d912-4007-9ff7-69df1ca1c973 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:21.314932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-114d6b82-d912-4007-9ff7-69df1ca1c973 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.321459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-114d6b82-d912-4007-9ff7-69df1ca1c973 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:21.322036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-114d6b82-d912-4007-9ff7-69df1ca1c973 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.218225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3fd3f582-5cd6-4e6d-b10f-93117a6426ce tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.233154 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3fd3f582-5cd6-4e6d-b10f-93117a6426ce tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 1.110818 Jul 20 04:37:22.241817 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2597/5201] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:21 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:22.319870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-114d6b82-d912-4007-9ff7-69df1ca1c973 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.330565 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-114d6b82-d912-4007-9ff7-69df1ca1c973 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 1.072035 Jul 20 04:37:22.358681 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2605/5202] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:21 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:23.259346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a99f6d5b-dc8c-453b-915d-49b1b06a0acc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:23.261680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a99f6d5b-dc8c-453b-915d-49b1b06a0acc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:23.264973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:23.306512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a99f6d5b-dc8c-453b-915d-49b1b06a0acc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.307039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a99f6d5b-dc8c-453b-915d-49b1b06a0acc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.308154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a99f6d5b-dc8c-453b-915d-49b1b06a0acc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.308724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a99f6d5b-dc8c-453b-915d-49b1b06a0acc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.349553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3df88662-3a1d-46b6-975d-b2231f8e5a81 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:23.350707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3df88662-3a1d-46b6-975d-b2231f8e5a81 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:23.378551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3df88662-3a1d-46b6-975d-b2231f8e5a81 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.384817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3df88662-3a1d-46b6-975d-b2231f8e5a81 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.387980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3df88662-3a1d-46b6-975d-b2231f8e5a81 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.388639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3df88662-3a1d-46b6-975d-b2231f8e5a81 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.977062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3df88662-3a1d-46b6-975d-b2231f8e5a81 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:24.002327 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3df88662-3a1d-46b6-975d-b2231f8e5a81 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.657511 Jul 20 04:37:24.003197 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2606/5203] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:23 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:24.322520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-79505c70-f975-4eda-a3a3-aceb48372df4 req-c3976d8b-3207-4863-9149-f32dd1ddbb85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0239847b-a58e-49a6-9e26-b6d79515a480", "tag": "b4f93a24-77a4-44b6-a57a-31217f7c81d8"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:24.359235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-79505c70-f975-4eda-a3a3-aceb48372df4 req-c3976d8b-3207-4863-9149-f32dd1ddbb85 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.359944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-79505c70-f975-4eda-a3a3-aceb48372df4 req-c3976d8b-3207-4863-9149-f32dd1ddbb85 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.440951 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-79505c70-f975-4eda-a3a3-aceb48372df4 req-c3976d8b-3207-4863-9149-f32dd1ddbb85 service nova] Creating event network-changed:b4f93a24-77a4-44b6-a57a-31217f7c81d8 for instance 0239847b-a58e-49a6-9e26-b6d79515a480 on n-h2-760456-11 Jul 20 04:37:24.467057 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-79505c70-f975-4eda-a3a3-aceb48372df4 req-c3976d8b-3207-4863-9149-f32dd1ddbb85 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149238 Jul 20 04:37:24.475873 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2607/5204] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:24.695861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a99f6d5b-dc8c-453b-915d-49b1b06a0acc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:24.718499 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a99f6d5b-dc8c-453b-915d-49b1b06a0acc tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 1.457643 Jul 20 04:37:24.719455 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2598/5205] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:23 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:25.025733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e1eedaa5-3ce3-40d7-877c-87dbd1d866d7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:25.028598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e1eedaa5-3ce3-40d7-877c-87dbd1d866d7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:25.054480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1eedaa5-3ce3-40d7-877c-87dbd1d866d7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.055073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1eedaa5-3ce3-40d7-877c-87dbd1d866d7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.055906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1eedaa5-3ce3-40d7-877c-87dbd1d866d7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.056356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1eedaa5-3ce3-40d7-877c-87dbd1d866d7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.735909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e08c300e-e764-4e74-997e-deb0d8e99ec6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:25.736532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e08c300e-e764-4e74-997e-deb0d8e99ec6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:25.768608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e08c300e-e764-4e74-997e-deb0d8e99ec6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.769190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e08c300e-e764-4e74-997e-deb0d8e99ec6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.770047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e08c300e-e764-4e74-997e-deb0d8e99ec6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.770522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e08c300e-e764-4e74-997e-deb0d8e99ec6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.031122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e1eedaa5-3ce3-40d7-877c-87dbd1d866d7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.043381 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e1eedaa5-3ce3-40d7-877c-87dbd1d866d7 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 1.027371 Jul 20 04:37:26.044056 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2608/5206] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:25 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:26.804228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e08c300e-e764-4e74-997e-deb0d8e99ec6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.815233 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e08c300e-e764-4e74-997e-deb0d8e99ec6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 1.083117 Jul 20 04:37:26.825039 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2599/5207] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:25 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:27.083791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d459aaa6-e9a9-4507-ada9-b33db3f79a13 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:27.084360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d459aaa6-e9a9-4507-ada9-b33db3f79a13 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:27.111456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d459aaa6-e9a9-4507-ada9-b33db3f79a13 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.112197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d459aaa6-e9a9-4507-ada9-b33db3f79a13 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.113023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d459aaa6-e9a9-4507-ada9-b33db3f79a13 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.126685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d459aaa6-e9a9-4507-ada9-b33db3f79a13 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.597371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-207ae7ed-da10-47ea-8b9a-c40655c2adac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dd51226-8d4a-46d6-b662-e98ae3e19b3e"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:27.598587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-207ae7ed-da10-47ea-8b9a-c40655c2adac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:27.616291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-207ae7ed-da10-47ea-8b9a-c40655c2adac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.616751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-207ae7ed-da10-47ea-8b9a-c40655c2adac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.617547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-207ae7ed-da10-47ea-8b9a-c40655c2adac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.617992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-207ae7ed-da10-47ea-8b9a-c40655c2adac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.673248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d459aaa6-e9a9-4507-ada9-b33db3f79a13 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.681344 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d459aaa6-e9a9-4507-ada9-b33db3f79a13 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.623806 Jul 20 04:37:27.692528 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2609/5208] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:27 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:27.832962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c1ed024f-4f32-46f2-89ad-9de506b006cf tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:27.833835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c1ed024f-4f32-46f2-89ad-9de506b006cf tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:27.857050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1ed024f-4f32-46f2-89ad-9de506b006cf tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.857816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1ed024f-4f32-46f2-89ad-9de506b006cf tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.858852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1ed024f-4f32-46f2-89ad-9de506b006cf tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.861963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c1ed024f-4f32-46f2-89ad-9de506b006cf tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.892511 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-207ae7ed-da10-47ea-8b9a-c40655c2adac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Invalid volume: volume 7dd51226-8d4a-46d6-b662-e98ae3e19b3e is already attached to instances: d92af308-68af-45ba-8589-c0766d212f47 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-207ae7ed-da10-47ea-8b9a-c40655c2adac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments HTTP/1.1 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 74 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: {"volumeAttachment": {"volumeId": "7dd51226-8d4a-46d6-b662-e98ae3e19b3e"}} Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid volume: volume 7dd51226-8d4a-46d6-b662-e98ae3e19b3e is already attached to instances: d92af308-68af-45ba-8589-c0766d212f47 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'server_id': 'd92af308-68af-45ba-8589-c0766d212f47', 'body': {'volumeAttachment': {'volumeId': '7dd51226-8d4a-46d6-b662-e98ae3e19b3e'}}} Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7dd51226-8d4a-46d6-b662-e98ae3e19b3e is already attached to instances: d92af308-68af-45ba-8589-c0766d212f47 Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:37:27.894299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7dd51226-8d4a-46d6-b662-e98ae3e19b3e is already attached to instances: d92af308-68af-45ba-8589-c0766d212f47 Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7dd51226-8d4a-46d6-b662-e98ae3e19b3e is already attached to instances: d92af308-68af-45ba-8589-c0766d212f47 Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:27.898646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-207ae7ed-da10-47ea-8b9a-c40655c2adac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 400 to user: Invalid volume: volume 7dd51226-8d4a-46d6-b662-e98ae3e19b3e is already attached to instances: d92af308-68af-45ba-8589-c0766d212f47 {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:27.904579 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-207ae7ed-da10-47ea-8b9a-c40655c2adac tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.311556 Jul 20 04:37:27.913034 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2600/5209] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:37:27 2022] POST /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 174 bytes in 321 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:37:28.073482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd75f545-a40c-4fad-943e-83d5241554ca tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:28.074129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd75f545-a40c-4fad-943e-83d5241554ca tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:28.097867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd75f545-a40c-4fad-943e-83d5241554ca tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.098435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd75f545-a40c-4fad-943e-83d5241554ca tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.099361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd75f545-a40c-4fad-943e-83d5241554ca tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.099816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd75f545-a40c-4fad-943e-83d5241554ca tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.455482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-cd75f545-a40c-4fad-943e-83d5241554ca tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lazy-loading 'services' on Instance uuid d92af308-68af-45ba-8589-c0766d212f47 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:28.687318 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd75f545-a40c-4fad-943e-83d5241554ca tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments/7dd51226-8d4a-46d6-b662-e98ae3e19b3e" status: 202 len: 0 microversion: 2.1 time: 0.617674 Jul 20 04:37:28.709377 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2601/5210] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:37:28 2022] DELETE /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments/7dd51226-8d4a-46d6-b662-e98ae3e19b3e => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:37:28.732464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ef46d58a-0509-4375-999b-c807556ee355 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:28.733434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ef46d58a-0509-4375-999b-c807556ee355 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:28.759985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef46d58a-0509-4375-999b-c807556ee355 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.761844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef46d58a-0509-4375-999b-c807556ee355 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.763378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef46d58a-0509-4375-999b-c807556ee355 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.765161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef46d58a-0509-4375-999b-c807556ee355 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.897181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c1ed024f-4f32-46f2-89ad-9de506b006cf tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:28.906733 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c1ed024f-4f32-46f2-89ad-9de506b006cf tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 1.077952 Jul 20 04:37:28.919293 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2610/5211] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:27 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:28.935089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ef78ca3-2b56-4722-8745-e169e44a72b0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:28.948865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ef78ca3-2b56-4722-8745-e169e44a72b0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:28.984490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ef78ca3-2b56-4722-8745-e169e44a72b0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.984951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ef78ca3-2b56-4722-8745-e169e44a72b0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.987749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ef78ca3-2b56-4722-8745-e169e44a72b0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.996222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ef78ca3-2b56-4722-8745-e169e44a72b0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.076377 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ef78ca3-2b56-4722-8745-e169e44a72b0 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155671 Jul 20 04:37:29.082864 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2611/5212] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:37:28 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:29.546850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ef46d58a-0509-4375-999b-c807556ee355 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:29.557078 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ef46d58a-0509-4375-999b-c807556ee355 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.845129 Jul 20 04:37:29.564533 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2602/5213] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:28 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:29.936705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-efa0adfb-9e3b-448e-a049-56bf5f633b7b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:29.937189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-efa0adfb-9e3b-448e-a049-56bf5f633b7b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:29.947108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:29.955409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efa0adfb-9e3b-448e-a049-56bf5f633b7b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.957514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efa0adfb-9e3b-448e-a049-56bf5f633b7b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.958588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efa0adfb-9e3b-448e-a049-56bf5f633b7b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:29.974631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-efa0adfb-9e3b-448e-a049-56bf5f633b7b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.100122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea1cf73a-b90f-4884-bed9-63474a96dcda tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:30.101859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea1cf73a-b90f-4884-bed9-63474a96dcda tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:30.141525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea1cf73a-b90f-4884-bed9-63474a96dcda tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.141987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea1cf73a-b90f-4884-bed9-63474a96dcda tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.143465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea1cf73a-b90f-4884-bed9-63474a96dcda tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.144090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea1cf73a-b90f-4884-bed9-63474a96dcda tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.285518 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea1cf73a-b90f-4884-bed9-63474a96dcda tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193738 Jul 20 04:37:30.294493 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2603/5214] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:37:30 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:30.586323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f82f08ed-af5c-4e04-b387-00ed633e4f08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:30.587666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f82f08ed-af5c-4e04-b387-00ed633e4f08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:30.624023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f82f08ed-af5c-4e04-b387-00ed633e4f08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.626347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f82f08ed-af5c-4e04-b387-00ed633e4f08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.630282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f82f08ed-af5c-4e04-b387-00ed633e4f08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.631923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f82f08ed-af5c-4e04-b387-00ed633e4f08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.082661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f82f08ed-af5c-4e04-b387-00ed633e4f08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:31.094901 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f82f08ed-af5c-4e04-b387-00ed633e4f08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.513261 Jul 20 04:37:31.097940 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2604/5215] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:30 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:31.304684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-efa0adfb-9e3b-448e-a049-56bf5f633b7b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:31.306986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-856f5bf9-1693-4f66-80cd-a4ad6b8c0429 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:31.310935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-856f5bf9-1693-4f66-80cd-a4ad6b8c0429 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:31.327697 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-efa0adfb-9e3b-448e-a049-56bf5f633b7b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 1.393370 Jul 20 04:37:31.331909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-856f5bf9-1693-4f66-80cd-a4ad6b8c0429 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.332271 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2612/5216] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:29 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:31.340991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-856f5bf9-1693-4f66-80cd-a4ad6b8c0429 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.351326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-856f5bf9-1693-4f66-80cd-a4ad6b8c0429 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.352872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-856f5bf9-1693-4f66-80cd-a4ad6b8c0429 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.548942 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-856f5bf9-1693-4f66-80cd-a4ad6b8c0429 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.246482 Jul 20 04:37:31.558458 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2605/5217] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:37:31 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:32.115920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a0887fbb-4a11-4796-a0b5-3b4e597ce380 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:32.116536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a0887fbb-4a11-4796-a0b5-3b4e597ce380 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:32.157832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0887fbb-4a11-4796-a0b5-3b4e597ce380 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.163005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0887fbb-4a11-4796-a0b5-3b4e597ce380 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.165160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0887fbb-4a11-4796-a0b5-3b4e597ce380 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.169271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0887fbb-4a11-4796-a0b5-3b4e597ce380 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.353614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-33c9a6f4-e1bb-411d-8e80-c713693cfbf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:32.354759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-33c9a6f4-e1bb-411d-8e80-c713693cfbf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:32.392798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33c9a6f4-e1bb-411d-8e80-c713693cfbf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.393586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33c9a6f4-e1bb-411d-8e80-c713693cfbf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.395088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33c9a6f4-e1bb-411d-8e80-c713693cfbf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:32.400100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33c9a6f4-e1bb-411d-8e80-c713693cfbf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.009630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-33c9a6f4-e1bb-411d-8e80-c713693cfbf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.073479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a0887fbb-4a11-4796-a0b5-3b4e597ce380 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:33.087057 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-33c9a6f4-e1bb-411d-8e80-c713693cfbf8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 0.743879 Jul 20 04:37:33.092181 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a0887fbb-4a11-4796-a0b5-3b4e597ce380 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.979888 Jul 20 04:37:33.098347 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2606/5218] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:32 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:33.110296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0d6e5df5-9637-46ee-869f-e127549c2125 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:33.116457 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2613/5219] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:32 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:33.117009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0d6e5df5-9637-46ee-869f-e127549c2125 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:33.146527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d6e5df5-9637-46ee-869f-e127549c2125 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.148575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d6e5df5-9637-46ee-869f-e127549c2125 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.149643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d6e5df5-9637-46ee-869f-e127549c2125 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:33.154977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d6e5df5-9637-46ee-869f-e127549c2125 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:33.244712 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0d6e5df5-9637-46ee-869f-e127549c2125 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144900 Jul 20 04:37:33.252739 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2607/5220] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:37:33 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:34.109157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f5b0f51-c7e5-4fc7-a526-9c37b4976ed4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:34.109883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f5b0f51-c7e5-4fc7-a526-9c37b4976ed4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:34.112684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c6e93912-1275-413a-ba7b-b0b7b9969066 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:34.113823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c6e93912-1275-413a-ba7b-b0b7b9969066 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:34.124620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6e93912-1275-413a-ba7b-b0b7b9969066 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.132377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6e93912-1275-413a-ba7b-b0b7b9969066 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.133803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6e93912-1275-413a-ba7b-b0b7b9969066 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.140799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6e93912-1275-413a-ba7b-b0b7b9969066 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.141446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f5b0f51-c7e5-4fc7-a526-9c37b4976ed4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.149846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f5b0f51-c7e5-4fc7-a526-9c37b4976ed4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.155136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f5b0f51-c7e5-4fc7-a526-9c37b4976ed4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.161930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f5b0f51-c7e5-4fc7-a526-9c37b4976ed4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.717134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f5b0f51-c7e5-4fc7-a526-9c37b4976ed4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:34.725766 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f5b0f51-c7e5-4fc7-a526-9c37b4976ed4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 0.623962 Jul 20 04:37:34.737989 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2614/5221] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:34 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:34.761908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b6dd59a3-4ef4-490c-975d-1bb52168a60e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:34.769015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6e93912-1275-413a-ba7b-b0b7b9969066 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:34.779559 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c6e93912-1275-413a-ba7b-b0b7b9969066 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.671259 Jul 20 04:37:34.791028 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2608/5222] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:34 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:34.800145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b6dd59a3-4ef4-490c-975d-1bb52168a60e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:34.811972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b6dd59a3-4ef4-490c-975d-1bb52168a60e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.812809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b6dd59a3-4ef4-490c-975d-1bb52168a60e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.813862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b6dd59a3-4ef4-490c-975d-1bb52168a60e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:34.814555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b6dd59a3-4ef4-490c-975d-1bb52168a60e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:34.909872 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b6dd59a3-4ef4-490c-975d-1bb52168a60e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162489 Jul 20 04:37:34.911671 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2615/5223] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:37:34 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:35.774935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-65de67a9-5a68-4bfb-8822-78e9ea21adc2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:35.776247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-65de67a9-5a68-4bfb-8822-78e9ea21adc2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:35.804686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-05a2ba46-b511-4391-b420-568b1d6818b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:35.806106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05a2ba46-b511-4391-b420-568b1d6818b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:35.831610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65de67a9-5a68-4bfb-8822-78e9ea21adc2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.840397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05a2ba46-b511-4391-b420-568b1d6818b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.845443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65de67a9-5a68-4bfb-8822-78e9ea21adc2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.853712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05a2ba46-b511-4391-b420-568b1d6818b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.858299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65de67a9-5a68-4bfb-8822-78e9ea21adc2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.859276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05a2ba46-b511-4391-b420-568b1d6818b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:35.859903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05a2ba46-b511-4391-b420-568b1d6818b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.861213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65de67a9-5a68-4bfb-8822-78e9ea21adc2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:35.886862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:36.475551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-65de67a9-5a68-4bfb-8822-78e9ea21adc2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:36.490136 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-65de67a9-5a68-4bfb-8822-78e9ea21adc2 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 0.721449 Jul 20 04:37:36.509362 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2609/5224] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:35 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:36.793052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05a2ba46-b511-4391-b420-568b1d6818b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:36.801014 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-05a2ba46-b511-4391-b420-568b1d6818b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 1.004090 Jul 20 04:37:36.805903 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2616/5225] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:35 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:36.932250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b83067e1-c680-4620-8134-2230af65df89 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:36.933266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b83067e1-c680-4620-8134-2230af65df89 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:36.945672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b83067e1-c680-4620-8134-2230af65df89 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:36.949458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b83067e1-c680-4620-8134-2230af65df89 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:36.952213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b83067e1-c680-4620-8134-2230af65df89 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:36.955977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b83067e1-c680-4620-8134-2230af65df89 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.096201 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b83067e1-c680-4620-8134-2230af65df89 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.582741 Jul 20 04:37:37.100804 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2610/5226] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:37:36 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 197 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:37.516635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2db564c-d6e7-4318-881d-c9044b655cbe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:37.517336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e2db564c-d6e7-4318-881d-c9044b655cbe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:37.539965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2db564c-d6e7-4318-881d-c9044b655cbe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.542043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2db564c-d6e7-4318-881d-c9044b655cbe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.547126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2db564c-d6e7-4318-881d-c9044b655cbe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.547911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2db564c-d6e7-4318-881d-c9044b655cbe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.822562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26384aee-7f14-4db9-ba60-8d3cf6223295 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:37.823579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26384aee-7f14-4db9-ba60-8d3cf6223295 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:37.837361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26384aee-7f14-4db9-ba60-8d3cf6223295 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.838159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26384aee-7f14-4db9-ba60-8d3cf6223295 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.840679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26384aee-7f14-4db9-ba60-8d3cf6223295 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.843541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26384aee-7f14-4db9-ba60-8d3cf6223295 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.851355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:38.339524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-26384aee-7f14-4db9-ba60-8d3cf6223295 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:38.356560 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26384aee-7f14-4db9-ba60-8d3cf6223295 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1504 microversion: 2.1 time: 0.538368 Jul 20 04:37:38.362182 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2611/5227] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:37 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:38.381862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2d768690-1f27-4447-9ca0-145ca0937b63 req-84a4efb4-5ced-4e8c-b3d1-c2b81f6d9ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0239847b-a58e-49a6-9e26-b6d79515a480", "name": "network-vif-plugged", "status": "completed", "tag": "b4f93a24-77a4-44b6-a57a-31217f7c81d8"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:38.403442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2d768690-1f27-4447-9ca0-145ca0937b63 req-84a4efb4-5ced-4e8c-b3d1-c2b81f6d9ac9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.404232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2d768690-1f27-4447-9ca0-145ca0937b63 req-84a4efb4-5ced-4e8c-b3d1-c2b81f6d9ac9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.418241 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2d768690-1f27-4447-9ca0-145ca0937b63 req-84a4efb4-5ced-4e8c-b3d1-c2b81f6d9ac9 service nova] Creating event network-vif-plugged:b4f93a24-77a4-44b6-a57a-31217f7c81d8 for instance 0239847b-a58e-49a6-9e26-b6d79515a480 on n-h2-760456-11 Jul 20 04:37:38.424263 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2d768690-1f27-4447-9ca0-145ca0937b63 req-84a4efb4-5ced-4e8c-b3d1-c2b81f6d9ac9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060735 Jul 20 04:37:38.427562 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2612/5228] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:38.443892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97a4d9ab-6a6a-4726-9e27-e8bcd60e8942 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:38.447664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97a4d9ab-6a6a-4726-9e27-e8bcd60e8942 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:38.460674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97a4d9ab-6a6a-4726-9e27-e8bcd60e8942 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.461584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97a4d9ab-6a6a-4726-9e27-e8bcd60e8942 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.462898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97a4d9ab-6a6a-4726-9e27-e8bcd60e8942 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.465126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97a4d9ab-6a6a-4726-9e27-e8bcd60e8942 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.468514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e2db564c-d6e7-4318-881d-c9044b655cbe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:38.502804 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e2db564c-d6e7-4318-881d-c9044b655cbe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 0.985985 Jul 20 04:37:38.505245 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2617/5229] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:37 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:38.572521 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97a4d9ab-6a6a-4726-9e27-e8bcd60e8942 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143474 Jul 20 04:37:38.573725 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2613/5230] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:37:38 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:39.379862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75a84008-05a5-4e47-8e45-f9c922ab3bb8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:39.380852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-75a84008-05a5-4e47-8e45-f9c922ab3bb8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.395086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75a84008-05a5-4e47-8e45-f9c922ab3bb8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.402864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75a84008-05a5-4e47-8e45-f9c922ab3bb8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.404129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75a84008-05a5-4e47-8e45-f9c922ab3bb8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.404811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75a84008-05a5-4e47-8e45-f9c922ab3bb8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.523191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a306297-d5f5-4baf-866e-eeebc821b366 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:39.524497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5a306297-d5f5-4baf-866e-eeebc821b366 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:39.540454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a306297-d5f5-4baf-866e-eeebc821b366 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.541258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a306297-d5f5-4baf-866e-eeebc821b366 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:39.543903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a306297-d5f5-4baf-866e-eeebc821b366 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:39.544540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a306297-d5f5-4baf-866e-eeebc821b366 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.054296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a306297-d5f5-4baf-866e-eeebc821b366 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:40.069776 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5a306297-d5f5-4baf-866e-eeebc821b366 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1393 microversion: 2.1 time: 0.549545 Jul 20 04:37:40.070435 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2614/5231] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:39 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1393 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:40.099505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-af37804f-b059-4ee2-8c58-68372ba10cef tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:40.110420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-af37804f-b059-4ee2-8c58-68372ba10cef tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:40.159151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af37804f-b059-4ee2-8c58-68372ba10cef tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.159874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af37804f-b059-4ee2-8c58-68372ba10cef tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.162531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af37804f-b059-4ee2-8c58-68372ba10cef tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:40.163029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af37804f-b059-4ee2-8c58-68372ba10cef tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:40.324334 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-af37804f-b059-4ee2-8c58-68372ba10cef tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.252579 Jul 20 04:37:40.331105 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2615/5232] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:37:40 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:40.550958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-75a84008-05a5-4e47-8e45-f9c922ab3bb8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:40.563809 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75a84008-05a5-4e47-8e45-f9c922ab3bb8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1504 microversion: 2.1 time: 1.187926 Jul 20 04:37:40.572093 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2618/5233] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:39 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1504 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:41.105529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ecddf5fa-fca1-4aeb-83ce-589e26530e74 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:41.108943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ecddf5fa-fca1-4aeb-83ce-589e26530e74 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:41.137738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ecddf5fa-fca1-4aeb-83ce-589e26530e74 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.141687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ecddf5fa-fca1-4aeb-83ce-589e26530e74 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.145484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ecddf5fa-fca1-4aeb-83ce-589e26530e74 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.146807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ecddf5fa-fca1-4aeb-83ce-589e26530e74 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.295403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-56f6ffef-2258-4f3e-bc77-0b19b83bef10 req-ae0b0aa9-f0ea-4a0a-ab2b-4d3d8b573a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d21092-aba7-482a-befb-1093f60fb247", "name": "network-vif-unplugged", "status": "completed", "tag": "483351f5-0838-4691-a2b2-8d9d0878b14f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:41.325564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-56f6ffef-2258-4f3e-bc77-0b19b83bef10 req-ae0b0aa9-f0ea-4a0a-ab2b-4d3d8b573a26 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.332605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-56f6ffef-2258-4f3e-bc77-0b19b83bef10 req-ae0b0aa9-f0ea-4a0a-ab2b-4d3d8b573a26 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.373817 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-56f6ffef-2258-4f3e-bc77-0b19b83bef10 req-ae0b0aa9-f0ea-4a0a-ab2b-4d3d8b573a26 service nova] Creating event network-vif-unplugged:483351f5-0838-4691-a2b2-8d9d0878b14f for instance 85d21092-aba7-482a-befb-1093f60fb247 on n-h1-760456-11 Jul 20 04:37:41.390285 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-56f6ffef-2258-4f3e-bc77-0b19b83bef10 req-ae0b0aa9-f0ea-4a0a-ab2b-4d3d8b573a26 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099004 Jul 20 04:37:41.393478 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2619/5234] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:37:41.418030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-59521b96-3946-473c-a393-d986d0890bc9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:41.420594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-59521b96-3946-473c-a393-d986d0890bc9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:41.445478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59521b96-3946-473c-a393-d986d0890bc9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.452354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59521b96-3946-473c-a393-d986d0890bc9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.454636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59521b96-3946-473c-a393-d986d0890bc9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.455358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-59521b96-3946-473c-a393-d986d0890bc9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.532253 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-59521b96-3946-473c-a393-d986d0890bc9 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136165 Jul 20 04:37:41.533429 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2620/5235] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:37:41 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:41.593716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-847d935e-7ca4-4036-b2c9-1754dcb9e67f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:41.595162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-847d935e-7ca4-4036-b2c9-1754dcb9e67f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:41.610946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-847d935e-7ca4-4036-b2c9-1754dcb9e67f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.611802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-847d935e-7ca4-4036-b2c9-1754dcb9e67f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.614777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-847d935e-7ca4-4036-b2c9-1754dcb9e67f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.615435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-847d935e-7ca4-4036-b2c9-1754dcb9e67f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.628986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ecddf5fa-fca1-4aeb-83ce-589e26530e74 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:41.639705 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ecddf5fa-fca1-4aeb-83ce-589e26530e74 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1564 microversion: 2.1 time: 0.543899 Jul 20 04:37:41.642837 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2616/5236] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:41 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1564 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:41.663042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6f329f44-d50f-4f8b-85a0-54b1d366e37b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:41.664834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6f329f44-d50f-4f8b-85a0-54b1d366e37b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:41.685369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f329f44-d50f-4f8b-85a0-54b1d366e37b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.690398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f329f44-d50f-4f8b-85a0-54b1d366e37b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:41.693907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f329f44-d50f-4f8b-85a0-54b1d366e37b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:41.694585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6f329f44-d50f-4f8b-85a0-54b1d366e37b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.009668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6f329f44-d50f-4f8b-85a0-54b1d366e37b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:42.020261 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6f329f44-d50f-4f8b-85a0-54b1d366e37b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1564 microversion: 2.1 time: 0.363929 Jul 20 04:37:42.021222 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2617/5237] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:41 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1564 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:42.248223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-847d935e-7ca4-4036-b2c9-1754dcb9e67f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:42.294196 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-847d935e-7ca4-4036-b2c9-1754dcb9e67f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 200 len: 1507 microversion: 2.1 time: 0.708988 Jul 20 04:37:42.315002 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2621/5238] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:41 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 1507 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:42.334425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-059733e2-38d5-40ae-9f03-3bc496f328ce tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:42.335068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-059733e2-38d5-40ae-9f03-3bc496f328ce tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:42.383514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-059733e2-38d5-40ae-9f03-3bc496f328ce tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.383991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-059733e2-38d5-40ae-9f03-3bc496f328ce tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.384833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-059733e2-38d5-40ae-9f03-3bc496f328ce tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.393356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-059733e2-38d5-40ae-9f03-3bc496f328ce tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.447217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-594231638", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:42.572391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] validate_networks() for [('c3e4c87c-518b-4f6d-a7ce-a98932e29370', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:37:42.654153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-059733e2-38d5-40ae-9f03-3bc496f328ce tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:42.668809 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-059733e2-38d5-40ae-9f03-3bc496f328ce tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.351279 Jul 20 04:37:42.669741 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2622/5239] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:42 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:42.674825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f9fc6a5e-3284-4e9c-9328-7d130ac00636 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:42.676357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f9fc6a5e-3284-4e9c-9328-7d130ac00636 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:42.684154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9fc6a5e-3284-4e9c-9328-7d130ac00636 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.684863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9fc6a5e-3284-4e9c-9328-7d130ac00636 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.686165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9fc6a5e-3284-4e9c-9328-7d130ac00636 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.687291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9fc6a5e-3284-4e9c-9328-7d130ac00636 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.771552 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f9fc6a5e-3284-4e9c-9328-7d130ac00636 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100380 Jul 20 04:37:42.795890 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2623/5240] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:37:42 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:42.809734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b33fc69f-2315-4b3c-8b31-09075575b06e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:42.811161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b33fc69f-2315-4b3c-8b31-09075575b06e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:42.828981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b33fc69f-2315-4b3c-8b31-09075575b06e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.831757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b33fc69f-2315-4b3c-8b31-09075575b06e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:42.832763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b33fc69f-2315-4b3c-8b31-09075575b06e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:42.836070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b33fc69f-2315-4b3c-8b31-09075575b06e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.089298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b33fc69f-2315-4b3c-8b31-09075575b06e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:43.100498 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b33fc69f-2315-4b3c-8b31-09075575b06e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.303086 Jul 20 04:37:43.101779 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2624/5241] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:42 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:43.138110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d67caf0e-75bf-4095-8c9c-7cb359d90ba7 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:43.140311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d67caf0e-75bf-4095-8c9c-7cb359d90ba7 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:43.150589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d67caf0e-75bf-4095-8c9c-7cb359d90ba7 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.152040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d67caf0e-75bf-4095-8c9c-7cb359d90ba7 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.153319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d67caf0e-75bf-4095-8c9c-7cb359d90ba7 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.154024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d67caf0e-75bf-4095-8c9c-7cb359d90ba7 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.254745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d67caf0e-75bf-4095-8c9c-7cb359d90ba7 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:43.412656 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d67caf0e-75bf-4095-8c9c-7cb359d90ba7 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 204 len: 0 microversion: 2.1 time: 0.296418 Jul 20 04:37:43.413747 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2625/5242] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:43 2022] DELETE /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:37:43.428794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f8a10ec-698f-4a39-bdf2-135c1e2dcd26 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:43.429492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6f8a10ec-698f-4a39-bdf2-135c1e2dcd26 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:43.437768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f8a10ec-698f-4a39-bdf2-135c1e2dcd26 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.438225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f8a10ec-698f-4a39-bdf2-135c1e2dcd26 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:43.439062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f8a10ec-698f-4a39-bdf2-135c1e2dcd26 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:43.439505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f8a10ec-698f-4a39-bdf2-135c1e2dcd26 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.215678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6f8a10ec-698f-4a39-bdf2-135c1e2dcd26 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:44.226549 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f8a10ec-698f-4a39-bdf2-135c1e2dcd26 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.804689 Jul 20 04:37:44.230531 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2626/5243] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:43 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:44.241352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e29006e9-3754-4814-bc26-b56f5262ebf6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:44.242957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e29006e9-3754-4814-bc26-b56f5262ebf6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:44.263498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e29006e9-3754-4814-bc26-b56f5262ebf6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.264318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e29006e9-3754-4814-bc26-b56f5262ebf6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.265371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e29006e9-3754-4814-bc26-b56f5262ebf6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.266030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e29006e9-3754-4814-bc26-b56f5262ebf6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.575732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e29006e9-3754-4814-bc26-b56f5262ebf6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:44.590231 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e29006e9-3754-4814-bc26-b56f5262ebf6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1682 microversion: 2.1 time: 0.357622 Jul 20 04:37:44.603914 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2627/5244] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:44 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1682 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:44.609961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d81a278b-adc1-43ed-ad24-0dd400b153f2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:44.610716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d81a278b-adc1-43ed-ad24-0dd400b153f2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:44.617880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d81a278b-adc1-43ed-ad24-0dd400b153f2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.618460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d81a278b-adc1-43ed-ad24-0dd400b153f2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.619624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d81a278b-adc1-43ed-ad24-0dd400b153f2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.620339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d81a278b-adc1-43ed-ad24-0dd400b153f2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.658198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:37:44.659177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:37:44.659855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:37:44.660464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:37:44.661053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:37:44.693742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.699886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.705413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.706099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.827363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Getting quotas for project dc00806ce00e4aadace7517d5131cab2. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:37:44.863885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Getting quotas for user e80638aab82d450fb148f8d963b8747e and project dc00806ce00e4aadace7517d5131cab2. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:37:44.872502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d81a278b-adc1-43ed-ad24-0dd400b153f2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:44.898822 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d81a278b-adc1-43ed-ad24-0dd400b153f2 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.289784 Jul 20 04:37:44.905246 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2628/5245] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:44 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:44.911445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:37:44.914049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:37:44.939086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0bd2ac15-ac3a-4fba-b38f-6eb222e99498 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:44.964929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0bd2ac15-ac3a-4fba-b38f-6eb222e99498 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.967289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0bd2ac15-ac3a-4fba-b38f-6eb222e99498 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.038174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0bd2ac15-ac3a-4fba-b38f-6eb222e99498 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Going to try to stop instance {{(pid=119605) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:37:45.058638 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c5c277c4-ef92-46c4-bdb0-70a48e8fa701 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.773307 Jul 20 04:37:45.072103 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2618/5246] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:37:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:37:45.091515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97bb6d37-8a32-465f-8e43-a471491d89aa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:45.097806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97bb6d37-8a32-465f-8e43-a471491d89aa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:45.241756 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0bd2ac15-ac3a-4fba-b38f-6eb222e99498 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.310622 Jul 20 04:37:45.244216 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2629/5247] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:44 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:45.256040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ff6f7e7-fdc2-4349-b8a1-46317dfbaa47 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:45.256758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4ff6f7e7-fdc2-4349-b8a1-46317dfbaa47 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:45.284940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ff6f7e7-fdc2-4349-b8a1-46317dfbaa47 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:45.285174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ff6f7e7-fdc2-4349-b8a1-46317dfbaa47 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.303150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ff6f7e7-fdc2-4349-b8a1-46317dfbaa47 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:45.304011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ff6f7e7-fdc2-4349-b8a1-46317dfbaa47 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.462120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97bb6d37-8a32-465f-8e43-a471491d89aa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:45.513911 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97bb6d37-8a32-465f-8e43-a471491d89aa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1216 microversion: 2.1 time: 0.420936 Jul 20 04:37:45.529630 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2619/5248] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:45 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1216 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:45.610216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-70efbd7b-225d-4068-9eb9-dc4ab648a5ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:45.611395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-70efbd7b-225d-4068-9eb9-dc4ab648a5ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:45.621617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70efbd7b-225d-4068-9eb9-dc4ab648a5ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:45.624660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70efbd7b-225d-4068-9eb9-dc4ab648a5ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.626181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70efbd7b-225d-4068-9eb9-dc4ab648a5ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:45.630146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70efbd7b-225d-4068-9eb9-dc4ab648a5ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.937703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4ff6f7e7-fdc2-4349-b8a1-46317dfbaa47 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:45.953021 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ff6f7e7-fdc2-4349-b8a1-46317dfbaa47 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.701044 Jul 20 04:37:45.957107 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2630/5249] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:45 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:46.145276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-70efbd7b-225d-4068-9eb9-dc4ab648a5ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:46.175465 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-70efbd7b-225d-4068-9eb9-dc4ab648a5ee tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1682 microversion: 2.1 time: 0.569272 Jul 20 04:37:46.176733 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2620/5250] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:45 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1682 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:46.540250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2dbfddf9-1243-4e56-befc-00daf4a3131c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:46.545325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2dbfddf9-1243-4e56-befc-00daf4a3131c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:46.559029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dbfddf9-1243-4e56-befc-00daf4a3131c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.559745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dbfddf9-1243-4e56-befc-00daf4a3131c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.563946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dbfddf9-1243-4e56-befc-00daf4a3131c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.565869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dbfddf9-1243-4e56-befc-00daf4a3131c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.576615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:46.833790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2dbfddf9-1243-4e56-befc-00daf4a3131c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:46.848508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2dbfddf9-1243-4e56-befc-00daf4a3131c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1268 microversion: 2.1 time: 0.319624 Jul 20 04:37:46.851090 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2631/5251] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:46 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1268 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:46.976456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f61b6cd4-ad57-4017-9d16-812b95657c77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:46.977342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f61b6cd4-ad57-4017-9d16-812b95657c77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:47.000155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f61b6cd4-ad57-4017-9d16-812b95657c77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.000992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f61b6cd4-ad57-4017-9d16-812b95657c77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.019097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f61b6cd4-ad57-4017-9d16-812b95657c77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.021026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f61b6cd4-ad57-4017-9d16-812b95657c77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.196298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-173184c2-0f4e-4609-8a4c-97657248bd6b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:47.196929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-173184c2-0f4e-4609-8a4c-97657248bd6b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:47.213352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-173184c2-0f4e-4609-8a4c-97657248bd6b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.219247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-173184c2-0f4e-4609-8a4c-97657248bd6b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.220166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-173184c2-0f4e-4609-8a4c-97657248bd6b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.225032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-173184c2-0f4e-4609-8a4c-97657248bd6b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.613364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-173184c2-0f4e-4609-8a4c-97657248bd6b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:47.632249 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-173184c2-0f4e-4609-8a4c-97657248bd6b tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1615 microversion: 2.1 time: 0.443043 Jul 20 04:37:47.640914 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2632/5252] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:47 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1615 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:47.728300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f61b6cd4-ad57-4017-9d16-812b95657c77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:47.738426 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f61b6cd4-ad57-4017-9d16-812b95657c77 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.771648 Jul 20 04:37:47.739038 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2621/5253] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:46 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:47.869018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35055e23-56a4-4cb8-83ad-4c748eace9ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:47.870019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-35055e23-56a4-4cb8-83ad-4c748eace9ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:47.882897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35055e23-56a4-4cb8-83ad-4c748eace9ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.883365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35055e23-56a4-4cb8-83ad-4c748eace9ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.884172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35055e23-56a4-4cb8-83ad-4c748eace9ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:47.886715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35055e23-56a4-4cb8-83ad-4c748eace9ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.353431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-07fafc85-53f3-4e56-a04a-36d29295c267 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:48.355183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-07fafc85-53f3-4e56-a04a-36d29295c267 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:48.370465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07fafc85-53f3-4e56-a04a-36d29295c267 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.372207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07fafc85-53f3-4e56-a04a-36d29295c267 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.373313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07fafc85-53f3-4e56-a04a-36d29295c267 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.373943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07fafc85-53f3-4e56-a04a-36d29295c267 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.603132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-07fafc85-53f3-4e56-a04a-36d29295c267 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:48.614674 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-07fafc85-53f3-4e56-a04a-36d29295c267 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1564 microversion: 2.1 time: 0.266173 Jul 20 04:37:48.616667 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2622/5254] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:48 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1564 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:48.623682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-93764cf4-fa04-4cbd-8339-f719b205ae93 req-b2558fb6-2e98-4bb3-a36b-9594711fec3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0239847b-a58e-49a6-9e26-b6d79515a480", "tag": "b4f93a24-77a4-44b6-a57a-31217f7c81d8"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:48.641474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-35055e23-56a4-4cb8-83ad-4c748eace9ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:48.660246 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-35055e23-56a4-4cb8-83ad-4c748eace9ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1274 microversion: 2.1 time: 0.795264 Jul 20 04:37:48.662136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-93764cf4-fa04-4cbd-8339-f719b205ae93 req-b2558fb6-2e98-4bb3-a36b-9594711fec3e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.662707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-93764cf4-fa04-4cbd-8339-f719b205ae93 req-b2558fb6-2e98-4bb3-a36b-9594711fec3e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.675121 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2633/5255] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:47 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1274 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:48.678678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0aef61b-80c8-4c7f-a3c2-25b0447c83d5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:48.680656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0aef61b-80c8-4c7f-a3c2-25b0447c83d5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:48.707927 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-93764cf4-fa04-4cbd-8339-f719b205ae93 req-b2558fb6-2e98-4bb3-a36b-9594711fec3e service nova] Creating event network-changed:b4f93a24-77a4-44b6-a57a-31217f7c81d8 for instance 0239847b-a58e-49a6-9e26-b6d79515a480 on n-h2-760456-11 Jul 20 04:37:48.721411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0aef61b-80c8-4c7f-a3c2-25b0447c83d5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.722363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0aef61b-80c8-4c7f-a3c2-25b0447c83d5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.722985 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-93764cf4-fa04-4cbd-8339-f719b205ae93 req-b2558fb6-2e98-4bb3-a36b-9594711fec3e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103852 Jul 20 04:37:48.723202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0aef61b-80c8-4c7f-a3c2-25b0447c83d5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.726743 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2623/5256] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:48.727890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0aef61b-80c8-4c7f-a3c2-25b0447c83d5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.758902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f7831c1e-8e9b-4d02-bf26-52d1c2c6437e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:48.759757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f7831c1e-8e9b-4d02-bf26-52d1c2c6437e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:48.771281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7831c1e-8e9b-4d02-bf26-52d1c2c6437e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.773035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7831c1e-8e9b-4d02-bf26-52d1c2c6437e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.776656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7831c1e-8e9b-4d02-bf26-52d1c2c6437e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:48.777354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7831c1e-8e9b-4d02-bf26-52d1c2c6437e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:48.990078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c0aef61b-80c8-4c7f-a3c2-25b0447c83d5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:49.007450 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0aef61b-80c8-4c7f-a3c2-25b0447c83d5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 200 len: 1615 microversion: 2.1 time: 0.339695 Jul 20 04:37:49.021712 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2634/5257] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:48 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 1615 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:49.050231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-7ced8295-465d-4bba-b48c-a17303053b16 req-73534231-7b65-43f0-91cb-143535217d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92af308-68af-45ba-8589-c0766d212f47", "name": "network-vif-deleted", "tag": "99cebc8a-f45f-4ffa-80d4-14ee7904bcfa"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:49.115352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7ced8295-465d-4bba-b48c-a17303053b16 req-73534231-7b65-43f0-91cb-143535217d87 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:49.116108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7ced8295-465d-4bba-b48c-a17303053b16 req-73534231-7b65-43f0-91cb-143535217d87 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:49.167030 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-7ced8295-465d-4bba-b48c-a17303053b16 req-73534231-7b65-43f0-91cb-143535217d87 service nova] Creating event network-vif-deleted:99cebc8a-f45f-4ffa-80d4-14ee7904bcfa for instance d92af308-68af-45ba-8589-c0766d212f47 on n-h2-760456-11 Jul 20 04:37:49.185558 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-7ced8295-465d-4bba-b48c-a17303053b16 req-73534231-7b65-43f0-91cb-143535217d87 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157595 Jul 20 04:37:49.187051 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2635/5258] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:49.384314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f7831c1e-8e9b-4d02-bf26-52d1c2c6437e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:49.398994 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f7831c1e-8e9b-4d02-bf26-52d1c2c6437e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.643064 Jul 20 04:37:49.401215 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2624/5259] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:48 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:49.685269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-02a53199-a8c4-4c0f-a4b2-dd9a6753140d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:49.687035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-02a53199-a8c4-4c0f-a4b2-dd9a6753140d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:49.700955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02a53199-a8c4-4c0f-a4b2-dd9a6753140d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:49.703203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02a53199-a8c4-4c0f-a4b2-dd9a6753140d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:49.704829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02a53199-a8c4-4c0f-a4b2-dd9a6753140d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:49.705493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02a53199-a8c4-4c0f-a4b2-dd9a6753140d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:50.054501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f88586f7-20aa-4776-be04-8c9ed7ccc8eb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:50.055482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f88586f7-20aa-4776-be04-8c9ed7ccc8eb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:50.081871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f88586f7-20aa-4776-be04-8c9ed7ccc8eb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:50.083046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f88586f7-20aa-4776-be04-8c9ed7ccc8eb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:50.084327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f88586f7-20aa-4776-be04-8c9ed7ccc8eb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:50.085391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f88586f7-20aa-4776-be04-8c9ed7ccc8eb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:50.111637 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-f88586f7-20aa-4776-be04-8c9ed7ccc8eb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f88586f7-20aa-4776-be04-8c9ed7ccc8eb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 HTTP/1.1 Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'd92af308-68af-45ba-8589-c0766d212f47'} Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:50.139504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:50.144485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:50.144485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:50.144485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:50.144485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:50.144485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:50.144485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:37:50.144485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:37:50.147543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f88586f7-20aa-4776-be04-8c9ed7ccc8eb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:50.148909 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f88586f7-20aa-4776-be04-8c9ed7ccc8eb tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 404 len: 111 microversion: 2.1 time: 0.122696 Jul 20 04:37:50.154292 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2625/5260] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:50 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:50.164850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c73e10ac-e6e9-4dc1-80f9-cc836c6dd73f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '.version_select at 0x7fb840eb2e50>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:50.203010 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c73e10ac-e6e9-4dc1-80f9-cc836c6dd73f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671164215" status: 202 len: 0 microversion: 2.1 time: 0.045258 Jul 20 04:37:50.204089 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2626/5261] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 04:37:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671164215 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:50.420036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-85c829a7-b921-466a-b814-96dd6b1ff549 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:50.420854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-85c829a7-b921-466a-b814-96dd6b1ff549 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:50.437383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85c829a7-b921-466a-b814-96dd6b1ff549 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:50.442826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85c829a7-b921-466a-b814-96dd6b1ff549 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:50.443807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85c829a7-b921-466a-b814-96dd6b1ff549 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:50.456251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85c829a7-b921-466a-b814-96dd6b1ff549 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:50.626187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-02a53199-a8c4-4c0f-a4b2-dd9a6753140d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:50.640331 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-02a53199-a8c4-4c0f-a4b2-dd9a6753140d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1316 microversion: 2.1 time: 0.961024 Jul 20 04:37:50.643083 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2636/5262] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:49 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1316 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:50.789824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-85c829a7-b921-466a-b814-96dd6b1ff549 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:50.818316 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-85c829a7-b921-466a-b814-96dd6b1ff549 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.393413 Jul 20 04:37:50.819070 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2627/5263] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:50 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:51.660164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b5105e4-3ed7-48f0-96a2-a70801686d10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:51.661012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b5105e4-3ed7-48f0-96a2-a70801686d10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:51.675955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b5105e4-3ed7-48f0-96a2-a70801686d10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:51.676565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b5105e4-3ed7-48f0-96a2-a70801686d10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:51.677762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b5105e4-3ed7-48f0-96a2-a70801686d10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:51.678325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b5105e4-3ed7-48f0-96a2-a70801686d10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:51.837223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-44569b98-5f83-4ec0-9a42-5993e24291e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:51.838673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-44569b98-5f83-4ec0-9a42-5993e24291e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:51.862824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44569b98-5f83-4ec0-9a42-5993e24291e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:51.868001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44569b98-5f83-4ec0-9a42-5993e24291e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:51.869304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44569b98-5f83-4ec0-9a42-5993e24291e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:51.871083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44569b98-5f83-4ec0-9a42-5993e24291e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:52.191994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7b5105e4-3ed7-48f0-96a2-a70801686d10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:52.218514 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b5105e4-3ed7-48f0-96a2-a70801686d10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1316 microversion: 2.1 time: 0.563349 Jul 20 04:37:52.225902 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2637/5264] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:51 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:52.331677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-44569b98-5f83-4ec0-9a42-5993e24291e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:52.358079 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-44569b98-5f83-4ec0-9a42-5993e24291e0 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.518855 Jul 20 04:37:52.358803 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2628/5265] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:51 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:52.433116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-7761aead-1550-4217-a7e7-6aea537d8021 req-faa71b19-b3e1-480c-a2d9-50b143ffb440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02", "tag": "dbad2823-16de-4145-93a7-2756ed39d393"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:52.465110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7761aead-1550-4217-a7e7-6aea537d8021 req-faa71b19-b3e1-480c-a2d9-50b143ffb440 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:52.465561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7761aead-1550-4217-a7e7-6aea537d8021 req-faa71b19-b3e1-480c-a2d9-50b143ffb440 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:52.493837 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-7761aead-1550-4217-a7e7-6aea537d8021 req-faa71b19-b3e1-480c-a2d9-50b143ffb440 service nova] Creating event network-changed:dbad2823-16de-4145-93a7-2756ed39d393 for instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 on n-h1-760456-11 Jul 20 04:37:52.508063 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-7761aead-1550-4217-a7e7-6aea537d8021 req-faa71b19-b3e1-480c-a2d9-50b143ffb440 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078676 Jul 20 04:37:52.511437 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2638/5266] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:52.534825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ef6f8611-3b96-4f93-b6c7-936ecb04e2f2 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: .version_select at 0x7fb840f16b80>, body: {"keypair": {"name": "tempest-keypair-485717078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPShgJ6QbxcW1ajQ7kytMxh3Q3pww53GWqXWRuEElBOtDu/5PwavozzJj66sMIt60dL6txyujvCFlxk9zklDNyv2X0DtLyMv9e0PAV6JskP62pC+kmAhN1FWBF6+ZVzHKw=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:52.554971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ef6f8611-3b96-4f93-b6c7-936ecb04e2f2 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for project e104a7716d8549cb8b99560ac90150c6. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:37:52.561845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ef6f8611-3b96-4f93-b6c7-936ecb04e2f2 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for user 4bd10ebbd2fd4ef693e15194c2d8912c and project e104a7716d8549cb8b99560ac90150c6. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:37:52.621217 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ef6f8611-3b96-4f93-b6c7-936ecb04e2f2 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.090572 Jul 20 04:37:52.622617 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2629/5267] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:37:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:53.236674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d5f4e095-b608-4b12-aea7-1200b395a1ae tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:53.237614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d5f4e095-b608-4b12-aea7-1200b395a1ae tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:53.252739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5f4e095-b608-4b12-aea7-1200b395a1ae tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.255678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5f4e095-b608-4b12-aea7-1200b395a1ae tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.262922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5f4e095-b608-4b12-aea7-1200b395a1ae tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.266237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d5f4e095-b608-4b12-aea7-1200b395a1ae tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.377102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0485027e-3f54-4f3a-92a7-3913d4f8fdb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:53.378723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0485027e-3f54-4f3a-92a7-3913d4f8fdb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:53.386134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:53.400367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0485027e-3f54-4f3a-92a7-3913d4f8fdb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.403864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0485027e-3f54-4f3a-92a7-3913d4f8fdb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.404961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0485027e-3f54-4f3a-92a7-3913d4f8fdb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.406079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0485027e-3f54-4f3a-92a7-3913d4f8fdb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.667584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0485027e-3f54-4f3a-92a7-3913d4f8fdb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:53.682469 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0485027e-3f54-4f3a-92a7-3913d4f8fdb5 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.306841 Jul 20 04:37:53.684795 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2630/5268] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:53 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:53.772322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d5f4e095-b608-4b12-aea7-1200b395a1ae tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:53.783403 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d5f4e095-b608-4b12-aea7-1200b395a1ae tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1316 microversion: 2.1 time: 0.550759 Jul 20 04:37:53.785082 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2639/5269] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:53 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:54.702221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd6a249b-c9e8-4584-8840-ef6a08542545 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:54.704188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd6a249b-c9e8-4584-8840-ef6a08542545 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:54.715009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd6a249b-c9e8-4584-8840-ef6a08542545 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:54.716014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd6a249b-c9e8-4584-8840-ef6a08542545 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:54.716989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd6a249b-c9e8-4584-8840-ef6a08542545 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:54.717603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd6a249b-c9e8-4584-8840-ef6a08542545 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:54.784097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:54.817355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e1535f7d-6b8b-4a24-9e2d-184f7eb4a8c1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:54.818238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e1535f7d-6b8b-4a24-9e2d-184f7eb4a8c1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:54.832066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1535f7d-6b8b-4a24-9e2d-184f7eb4a8c1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:54.833141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1535f7d-6b8b-4a24-9e2d-184f7eb4a8c1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:54.848051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1535f7d-6b8b-4a24-9e2d-184f7eb4a8c1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:54.850082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1535f7d-6b8b-4a24-9e2d-184f7eb4a8c1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:55.022530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cd6a249b-c9e8-4584-8840-ef6a08542545 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:55.041862 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd6a249b-c9e8-4584-8840-ef6a08542545 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1679 microversion: 2.1 time: 0.341357 Jul 20 04:37:55.045061 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2631/5270] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:54 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1679 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:55.442556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e1535f7d-6b8b-4a24-9e2d-184f7eb4a8c1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:55.459315 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e1535f7d-6b8b-4a24-9e2d-184f7eb4a8c1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1316 microversion: 2.1 time: 0.655785 Jul 20 04:37:55.469573 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2640/5271] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:54 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:55.765417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-546874084", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "383b582b-f62e-45d5-8b36-660b1731bf20"}], "security_groups": [{"name": "tempest-securitygroup--280320261"}], "key_name": "tempest-keypair-485717078", "user_data": "}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:55.902599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] validate_networks() for [('383b582b-f62e-45d5-8b36-660b1731bf20', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:37:56.062108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2812239a-0f37-481d-af39-4d8f7b94a2a8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:56.062770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2812239a-0f37-481d-af39-4d8f7b94a2a8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:56.069448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2812239a-0f37-481d-af39-4d8f7b94a2a8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.069912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2812239a-0f37-481d-af39-4d8f7b94a2a8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.076783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2812239a-0f37-481d-af39-4d8f7b94a2a8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.077250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2812239a-0f37-481d-af39-4d8f7b94a2a8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.285634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2812239a-0f37-481d-af39-4d8f7b94a2a8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:56.295678 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2812239a-0f37-481d-af39-4d8f7b94a2a8 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1656 microversion: 2.1 time: 0.237933 Jul 20 04:37:56.297237 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2641/5272] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:56 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1656 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:56.313119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e44df96e-9681-4d76-8fa2-deca4ffb86ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:56.319675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e44df96e-9681-4d76-8fa2-deca4ffb86ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.320513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e44df96e-9681-4d76-8fa2-deca4ffb86ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.361110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e44df96e-9681-4d76-8fa2-deca4ffb86ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Going to try to start instance {{(pid=119605) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:37:56.429264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:37:56.429992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:37:56.430681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:37:56.431145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:37:56.431810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:37:56.435071 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e44df96e-9681-4d76-8fa2-deca4ffb86ca tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.125525 Jul 20 04:37:56.436099 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2642/5273] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:56 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:56.445517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8db85b3-b231-47f2-b698-5e6caa57ef20 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:56.446392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c8db85b3-b231-47f2-b698-5e6caa57ef20 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:56.454120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.454870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.455927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.458556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.460228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8db85b3-b231-47f2-b698-5e6caa57ef20 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.460871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8db85b3-b231-47f2-b698-5e6caa57ef20 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.461816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8db85b3-b231-47f2-b698-5e6caa57ef20 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.462284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8db85b3-b231-47f2-b698-5e6caa57ef20 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.490961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for project e104a7716d8549cb8b99560ac90150c6. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:37:56.497726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Getting quotas for user 4bd10ebbd2fd4ef693e15194c2d8912c and project e104a7716d8549cb8b99560ac90150c6. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:37:56.530102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:37:56.535383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:37:56.632794 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9d9182f-1e9d-4565-83c8-f56669c38b9e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.873599 Jul 20 04:37:56.639963 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2632/5274] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:37:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:37:56.652708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e85a53cd-7b26-444f-9c2e-c808504c01f9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:56.653353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e85a53cd-7b26-444f-9c2e-c808504c01f9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:56.683863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e85a53cd-7b26-444f-9c2e-c808504c01f9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.684359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e85a53cd-7b26-444f-9c2e-c808504c01f9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.685245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e85a53cd-7b26-444f-9c2e-c808504c01f9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:56.685699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e85a53cd-7b26-444f-9c2e-c808504c01f9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:56.696263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c8db85b3-b231-47f2-b698-5e6caa57ef20 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:56.713197 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c8db85b3-b231-47f2-b698-5e6caa57ef20 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1665 microversion: 2.1 time: 0.269742 Jul 20 04:37:56.713865 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2643/5275] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:56 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1665 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:56.738777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-70e696bb-1ef5-4640-b37a-ef14f8ee1b69 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:56.739424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-70e696bb-1ef5-4640-b37a-ef14f8ee1b69 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:56.876523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-70e696bb-1ef5-4640-b37a-ef14f8ee1b69 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:56.885485 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-70e696bb-1ef5-4640-b37a-ef14f8ee1b69 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1240 microversion: 2.1 time: 0.169542 Jul 20 04:37:56.890965 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2644/5276] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:56 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1240 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:57.423212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e85a53cd-7b26-444f-9c2e-c808504c01f9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:57.432575 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e85a53cd-7b26-444f-9c2e-c808504c01f9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1316 microversion: 2.1 time: 0.794656 Jul 20 04:37:57.435224 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2633/5277] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:56 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1316 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:57.736409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9aee5b97-e49e-4df5-85c3-24167ae7db90 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:57.738127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9aee5b97-e49e-4df5-85c3-24167ae7db90 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:57.752648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9aee5b97-e49e-4df5-85c3-24167ae7db90 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.753470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9aee5b97-e49e-4df5-85c3-24167ae7db90 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:57.758694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9aee5b97-e49e-4df5-85c3-24167ae7db90 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.759413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9aee5b97-e49e-4df5-85c3-24167ae7db90 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:57.908017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e478fcaf-c08a-4101-bdc6-f8a65591864a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:57.909042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e478fcaf-c08a-4101-bdc6-f8a65591864a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:57.929912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e478fcaf-c08a-4101-bdc6-f8a65591864a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.930333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e478fcaf-c08a-4101-bdc6-f8a65591864a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:57.931144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e478fcaf-c08a-4101-bdc6-f8a65591864a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.931653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e478fcaf-c08a-4101-bdc6-f8a65591864a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:57.942058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:58.084763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e478fcaf-c08a-4101-bdc6-f8a65591864a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:58.085826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9aee5b97-e49e-4df5-85c3-24167ae7db90 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:58.096974 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e478fcaf-c08a-4101-bdc6-f8a65591864a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1292 microversion: 2.1 time: 0.194768 Jul 20 04:37:58.118811 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2634/5278] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:57 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1292 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:58.131641 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9aee5b97-e49e-4df5-85c3-24167ae7db90 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1665 microversion: 2.1 time: 0.395162 Jul 20 04:37:58.132554 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2645/5279] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:57 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1665 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:58.455846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da680788-6d59-42c3-8aa4-4d2b6660ac6b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:58.457728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-da680788-6d59-42c3-8aa4-4d2b6660ac6b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:58.470899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da680788-6d59-42c3-8aa4-4d2b6660ac6b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:58.472179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da680788-6d59-42c3-8aa4-4d2b6660ac6b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:58.473460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da680788-6d59-42c3-8aa4-4d2b6660ac6b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:58.474400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da680788-6d59-42c3-8aa4-4d2b6660ac6b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:58.740316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-da680788-6d59-42c3-8aa4-4d2b6660ac6b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:58.763397 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-da680788-6d59-42c3-8aa4-4d2b6660ac6b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1316 microversion: 2.1 time: 0.313790 Jul 20 04:37:58.765542 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2635/5280] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:58 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:59.116153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f74bb01-5500-4cba-b116-4de83ea2fd30 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:59.116792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f74bb01-5500-4cba-b116-4de83ea2fd30 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:59.130402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f74bb01-5500-4cba-b116-4de83ea2fd30 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.133616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f74bb01-5500-4cba-b116-4de83ea2fd30 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.137728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f74bb01-5500-4cba-b116-4de83ea2fd30 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.138350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f74bb01-5500-4cba-b116-4de83ea2fd30 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.149677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-545c925d-8ab8-45cf-9818-f7dc265853c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:59.150607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-545c925d-8ab8-45cf-9818-f7dc265853c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:59.210239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-545c925d-8ab8-45cf-9818-f7dc265853c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.211033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-545c925d-8ab8-45cf-9818-f7dc265853c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.213437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-545c925d-8ab8-45cf-9818-f7dc265853c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.214129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-545c925d-8ab8-45cf-9818-f7dc265853c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.506010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-545c925d-8ab8-45cf-9818-f7dc265853c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:59.521810 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-545c925d-8ab8-45cf-9818-f7dc265853c4 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.376396 Jul 20 04:37:59.523161 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2636/5281] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:59 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:59.538553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-bf7510a0-b891-4ec9-b2e8-6f7d865a0bd5 req-1e7bfa2c-4cae-4ec0-89b0-6f740c3423f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02", "name": "network-vif-plugged", "status": "completed", "tag": "dbad2823-16de-4145-93a7-2756ed39d393"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:59.558543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bf7510a0-b891-4ec9-b2e8-6f7d865a0bd5 req-1e7bfa2c-4cae-4ec0-89b0-6f740c3423f9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.559426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bf7510a0-b891-4ec9-b2e8-6f7d865a0bd5 req-1e7bfa2c-4cae-4ec0-89b0-6f740c3423f9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.599081 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-bf7510a0-b891-4ec9-b2e8-6f7d865a0bd5 req-1e7bfa2c-4cae-4ec0-89b0-6f740c3423f9 service nova] Creating event network-vif-plugged:dbad2823-16de-4145-93a7-2756ed39d393 for instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 on n-h1-760456-11 Jul 20 04:37:59.607124 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-bf7510a0-b891-4ec9-b2e8-6f7d865a0bd5 req-1e7bfa2c-4cae-4ec0-89b0-6f740c3423f9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081908 Jul 20 04:37:59.608811 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2637/5282] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:59.609890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f74bb01-5500-4cba-b116-4de83ea2fd30 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:59.621245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-84695b18-cd9a-47d2-a4c0-71d91733c9d3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:59.622603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-84695b18-cd9a-47d2-a4c0-71d91733c9d3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:59.637553 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f74bb01-5500-4cba-b116-4de83ea2fd30 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1365 microversion: 2.1 time: 0.526312 Jul 20 04:37:59.638179 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2646/5283] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:59 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1365 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:59.652361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84695b18-cd9a-47d2-a4c0-71d91733c9d3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.653023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84695b18-cd9a-47d2-a4c0-71d91733c9d3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.659591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84695b18-cd9a-47d2-a4c0-71d91733c9d3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.661709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84695b18-cd9a-47d2-a4c0-71d91733c9d3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.784428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6a1de830-c376-492c-953a-b3442513eaf1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:59.789912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6a1de830-c376-492c-953a-b3442513eaf1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:59.801803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a1de830-c376-492c-953a-b3442513eaf1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.803025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a1de830-c376-492c-953a-b3442513eaf1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:59.804012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a1de830-c376-492c-953a-b3442513eaf1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:59.804609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6a1de830-c376-492c-953a-b3442513eaf1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.305602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6a1de830-c376-492c-953a-b3442513eaf1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:00.333475 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6a1de830-c376-492c-953a-b3442513eaf1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1316 microversion: 2.1 time: 0.555276 Jul 20 04:38:00.344414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2647/5284] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:59 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:00.639658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-84695b18-cd9a-47d2-a4c0-71d91733c9d3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:00.647792 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-84695b18-cd9a-47d2-a4c0-71d91733c9d3 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 1.036608 Jul 20 04:38:00.648390 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2638/5285] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:59 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:00.662655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3d58999-67ba-45b1-9d26-5a7316d0e849 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:00.663344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3d58999-67ba-45b1-9d26-5a7316d0e849 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:00.666690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:00.676860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8a46a6ad-6908-4ac9-afa1-074eb52b0673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:00.677530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8a46a6ad-6908-4ac9-afa1-074eb52b0673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:00.678890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3d58999-67ba-45b1-9d26-5a7316d0e849 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.679354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3d58999-67ba-45b1-9d26-5a7316d0e849 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.682863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3d58999-67ba-45b1-9d26-5a7316d0e849 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.683234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3d58999-67ba-45b1-9d26-5a7316d0e849 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.696336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a46a6ad-6908-4ac9-afa1-074eb52b0673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.698409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a46a6ad-6908-4ac9-afa1-074eb52b0673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.699578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a46a6ad-6908-4ac9-afa1-074eb52b0673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.700418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a46a6ad-6908-4ac9-afa1-074eb52b0673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.950209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8a46a6ad-6908-4ac9-afa1-074eb52b0673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:00.958721 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8a46a6ad-6908-4ac9-afa1-074eb52b0673 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.287303 Jul 20 04:38:00.963889 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2639/5286] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:00 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:00.987635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-20752ab0-cf44-4a55-8c0a-f73ac86f0a7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:00.996805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-20752ab0-cf44-4a55-8c0a-f73ac86f0a7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:01.014940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20752ab0-cf44-4a55-8c0a-f73ac86f0a7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.016269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20752ab0-cf44-4a55-8c0a-f73ac86f0a7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.017310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20752ab0-cf44-4a55-8c0a-f73ac86f0a7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.027134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20752ab0-cf44-4a55-8c0a-f73ac86f0a7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.185193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3d58999-67ba-45b1-9d26-5a7316d0e849 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:01.193780 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3d58999-67ba-45b1-9d26-5a7316d0e849 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1365 microversion: 2.1 time: 0.536705 Jul 20 04:38:01.197975 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2648/5287] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:00 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1365 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:01.288367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-20752ab0-cf44-4a55-8c0a-f73ac86f0a7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:01.304538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-228fd795-739d-4194-a41c-f67f84a13149 req-3cd25840-8897-4326-940c-e23b98c05bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38047d01-1308-49f6-8f31-61300f51932f", "tag": "15c17885-7385-4e33-b285-af310284a1a9"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:01.308197 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-20752ab0-cf44-4a55-8c0a-f73ac86f0a7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.331795 Jul 20 04:38:01.322319 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2640/5288] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:00 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:01.328514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e04a56f-1dac-4528-8f0a-476ab5e89aee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:01.329334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e04a56f-1dac-4528-8f0a-476ab5e89aee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:01.334121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-228fd795-739d-4194-a41c-f67f84a13149 req-3cd25840-8897-4326-940c-e23b98c05bdf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.336791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-228fd795-739d-4194-a41c-f67f84a13149 req-3cd25840-8897-4326-940c-e23b98c05bdf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.349708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e04a56f-1dac-4528-8f0a-476ab5e89aee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.351682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e04a56f-1dac-4528-8f0a-476ab5e89aee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.362725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e04a56f-1dac-4528-8f0a-476ab5e89aee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.365186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e04a56f-1dac-4528-8f0a-476ab5e89aee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.376877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:01.379730 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-228fd795-739d-4194-a41c-f67f84a13149 req-3cd25840-8897-4326-940c-e23b98c05bdf service nova] Creating event network-changed:15c17885-7385-4e33-b285-af310284a1a9 for instance 38047d01-1308-49f6-8f31-61300f51932f on n-h1-760456-11 Jul 20 04:38:01.387083 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-228fd795-739d-4194-a41c-f67f84a13149 req-3cd25840-8897-4326-940c-e23b98c05bdf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086945 Jul 20 04:38:01.388279 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2649/5289] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:01.394724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d66ce71-ba43-40e3-92d2-f594e7a39809 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:01.395608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d66ce71-ba43-40e3-92d2-f594e7a39809 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:01.405285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d66ce71-ba43-40e3-92d2-f594e7a39809 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.405994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d66ce71-ba43-40e3-92d2-f594e7a39809 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.407011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d66ce71-ba43-40e3-92d2-f594e7a39809 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.408996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d66ce71-ba43-40e3-92d2-f594e7a39809 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.633308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e04a56f-1dac-4528-8f0a-476ab5e89aee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:01.642209 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e04a56f-1dac-4528-8f0a-476ab5e89aee tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.318671 Jul 20 04:38:01.654387 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2641/5290] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:01 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:01.679304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ad2f5f15-4202-428d-90c4-e9c793285205 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:01.681752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ad2f5f15-4202-428d-90c4-e9c793285205 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:01.689285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad2f5f15-4202-428d-90c4-e9c793285205 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.689988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad2f5f15-4202-428d-90c4-e9c793285205 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.691817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad2f5f15-4202-428d-90c4-e9c793285205 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.692728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad2f5f15-4202-428d-90c4-e9c793285205 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.797369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d66ce71-ba43-40e3-92d2-f594e7a39809 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:01.812416 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d66ce71-ba43-40e3-92d2-f594e7a39809 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1316 microversion: 2.1 time: 0.422180 Jul 20 04:38:01.818605 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2650/5291] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:01 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:01.851832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-ad2f5f15-4202-428d-90c4-e9c793285205 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lazy-loading 'flavor' on Instance uuid 44b78332-e314-4da3-8a21-1ccfa545f11a {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:01.992662 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ad2f5f15-4202-428d-90c4-e9c793285205 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.335809 Jul 20 04:38:01.995947 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2642/5292] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:01 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:02.003335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ffd3338-cdd5-4aa6-80f9-6a29c86d323d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:02.004242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ffd3338-cdd5-4aa6-80f9-6a29c86d323d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:02.012781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ffd3338-cdd5-4aa6-80f9-6a29c86d323d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.013482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ffd3338-cdd5-4aa6-80f9-6a29c86d323d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.014559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ffd3338-cdd5-4aa6-80f9-6a29c86d323d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.015411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ffd3338-cdd5-4aa6-80f9-6a29c86d323d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.216486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d4e260f8-fcec-4ecc-8428-60de4a0b1743 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:02.216981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d4e260f8-fcec-4ecc-8428-60de4a0b1743 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:02.233495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4e260f8-fcec-4ecc-8428-60de4a0b1743 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.234090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4e260f8-fcec-4ecc-8428-60de4a0b1743 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.234929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4e260f8-fcec-4ecc-8428-60de4a0b1743 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.238124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4e260f8-fcec-4ecc-8428-60de4a0b1743 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.271683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ffd3338-cdd5-4aa6-80f9-6a29c86d323d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:02.282543 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ffd3338-cdd5-4aa6-80f9-6a29c86d323d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1677 microversion: 2.1 time: 0.283494 Jul 20 04:38:02.292499 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2651/5293] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:01 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1677 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:02.467106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d4e260f8-fcec-4ecc-8428-60de4a0b1743 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:02.479448 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d4e260f8-fcec-4ecc-8428-60de4a0b1743 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1365 microversion: 2.1 time: 0.269585 Jul 20 04:38:02.480540 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2643/5294] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:02 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:02.841541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75798bf9-4ceb-4870-9e43-257f866a75ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:02.843161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-75798bf9-4ceb-4870-9e43-257f866a75ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:02.854915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75798bf9-4ceb-4870-9e43-257f866a75ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.856722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75798bf9-4ceb-4870-9e43-257f866a75ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.858009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75798bf9-4ceb-4870-9e43-257f866a75ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.858998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75798bf9-4ceb-4870-9e43-257f866a75ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.042555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-75798bf9-4ceb-4870-9e43-257f866a75ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:03.052677 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75798bf9-4ceb-4870-9e43-257f866a75ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.219414 Jul 20 04:38:03.054137 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2652/5295] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:02 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:03.137055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1962915629", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:03.256484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] validate_networks() for [('c3e4c87c-518b-4f6d-a7ce-a98932e29370', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:38:03.302194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9bd5b9a-3140-4c86-ae63-5807806a5416 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:03.302968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b9bd5b9a-3140-4c86-ae63-5807806a5416 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:03.321021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9bd5b9a-3140-4c86-ae63-5807806a5416 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.321507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9bd5b9a-3140-4c86-ae63-5807806a5416 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.323357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9bd5b9a-3140-4c86-ae63-5807806a5416 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.323910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9bd5b9a-3140-4c86-ae63-5807806a5416 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.876451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:03.876889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:03.877374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:03.878000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:03.878451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:03.885118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b9bd5b9a-3140-4c86-ae63-5807806a5416 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:03.896421 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b9bd5b9a-3140-4c86-ae63-5807806a5416 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1660 microversion: 2.1 time: 0.599320 Jul 20 04:38:03.909781 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2653/5296] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:03 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1660 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:03.915103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c255f01f-e6ae-4e4e-92e1-98402e81ea52 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:03.920402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.921112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.921948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.922438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.930680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c255f01f-e6ae-4e4e-92e1-98402e81ea52 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:03.937292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c255f01f-e6ae-4e4e-92e1-98402e81ea52 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.937763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c255f01f-e6ae-4e4e-92e1-98402e81ea52 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.938587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c255f01f-e6ae-4e4e-92e1-98402e81ea52 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.939037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c255f01f-e6ae-4e4e-92e1-98402e81ea52 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.966858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Getting quotas for project dc00806ce00e4aadace7517d5131cab2. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:03.973153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Getting quotas for user e80638aab82d450fb148f8d963b8747e and project dc00806ce00e4aadace7517d5131cab2. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:03.988182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:38:03.990905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:38:04.060726 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-49bca82c-b2d4-4936-aedc-4807bfdc49bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941862 Jul 20 04:38:04.067554 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2644/5297] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:38:04.073152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae2f63c2-5c0f-4c99-96ae-6fc8538ef287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:04.074115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ae2f63c2-5c0f-4c99-96ae-6fc8538ef287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:04.080718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae2f63c2-5c0f-4c99-96ae-6fc8538ef287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:04.081599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae2f63c2-5c0f-4c99-96ae-6fc8538ef287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:04.082778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae2f63c2-5c0f-4c99-96ae-6fc8538ef287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:04.083381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae2f63c2-5c0f-4c99-96ae-6fc8538ef287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:04.123756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c255f01f-e6ae-4e4e-92e1-98402e81ea52 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:04.135331 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c255f01f-e6ae-4e4e-92e1-98402e81ea52 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1365 microversion: 2.1 time: 0.223387 Jul 20 04:38:04.138418 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2654/5298] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:03 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:04.148722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2bcce9d6-dacb-4364-9f50-5802ac5dc2e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:04.149565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2bcce9d6-dacb-4364-9f50-5802ac5dc2e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:04.230180 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae2f63c2-5c0f-4c99-96ae-6fc8538ef287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action" status: 202 len: 0 microversion: 2.1 time: 0.160831 Jul 20 04:38:04.234884 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2645/5299] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:04 2022] POST /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:04.241014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a2bfb807-4c63-4763-b7fa-a98c917a5794 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:04.242121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a2bfb807-4c63-4763-b7fa-a98c917a5794 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:04.252395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2bfb807-4c63-4763-b7fa-a98c917a5794 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:04.253060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2bfb807-4c63-4763-b7fa-a98c917a5794 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:04.254105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2bfb807-4c63-4763-b7fa-a98c917a5794 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:04.254768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2bfb807-4c63-4763-b7fa-a98c917a5794 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:04.259177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2bcce9d6-dacb-4364-9f50-5802ac5dc2e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:04.288871 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2bcce9d6-dacb-4364-9f50-5802ac5dc2e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1217 microversion: 2.1 time: 0.149122 Jul 20 04:38:04.289491 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2655/5300] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:04 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:04.592698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a2bfb807-4c63-4763-b7fa-a98c917a5794 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:04.601863 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a2bfb807-4c63-4763-b7fa-a98c917a5794 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1666 microversion: 2.1 time: 0.365352 Jul 20 04:38:04.606166 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2646/5301] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:04 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1666 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:05.156052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d504de2f-5e05-4ecd-a65b-5486aa182812 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:05.156885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d504de2f-5e05-4ecd-a65b-5486aa182812 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:05.166435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d504de2f-5e05-4ecd-a65b-5486aa182812 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.166688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d504de2f-5e05-4ecd-a65b-5486aa182812 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.167643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d504de2f-5e05-4ecd-a65b-5486aa182812 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.168189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d504de2f-5e05-4ecd-a65b-5486aa182812 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.314155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-24fa6792-dc32-4fe8-86fb-092624bf2acb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:05.317318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-24fa6792-dc32-4fe8-86fb-092624bf2acb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:05.331215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24fa6792-dc32-4fe8-86fb-092624bf2acb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.332450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24fa6792-dc32-4fe8-86fb-092624bf2acb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.333550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24fa6792-dc32-4fe8-86fb-092624bf2acb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.334541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24fa6792-dc32-4fe8-86fb-092624bf2acb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.367334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d504de2f-5e05-4ecd-a65b-5486aa182812 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.393038 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d504de2f-5e05-4ecd-a65b-5486aa182812 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1365 microversion: 2.1 time: 0.240985 Jul 20 04:38:05.404293 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2656/5302] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:05 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:05.430876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-24fa6792-dc32-4fe8-86fb-092624bf2acb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.442754 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-24fa6792-dc32-4fe8-86fb-092624bf2acb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1269 microversion: 2.1 time: 0.139686 Jul 20 04:38:05.443690 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2647/5303] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:05 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1269 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:05.626045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-936ac082-4812-487b-848f-ef392a4e21b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:05.626707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-936ac082-4812-487b-848f-ef392a4e21b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:05.635630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-936ac082-4812-487b-848f-ef392a4e21b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.636311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-936ac082-4812-487b-848f-ef392a4e21b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.637877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-936ac082-4812-487b-848f-ef392a4e21b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.638539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-936ac082-4812-487b-848f-ef392a4e21b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.823608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-936ac082-4812-487b-848f-ef392a4e21b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.842023 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-936ac082-4812-487b-848f-ef392a4e21b9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1666 microversion: 2.1 time: 0.220730 Jul 20 04:38:05.842713 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2657/5304] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:05 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1666 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:06.411955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f1ba5633-7690-4bdc-9a5a-256ac1506c67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:06.412685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f1ba5633-7690-4bdc-9a5a-256ac1506c67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:06.425218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1ba5633-7690-4bdc-9a5a-256ac1506c67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.426808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1ba5633-7690-4bdc-9a5a-256ac1506c67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.430100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1ba5633-7690-4bdc-9a5a-256ac1506c67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.432358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1ba5633-7690-4bdc-9a5a-256ac1506c67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.463121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c00f761-84a7-4ec0-bf99-5247b2e788e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:06.464618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c00f761-84a7-4ec0-bf99-5247b2e788e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:06.484914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c00f761-84a7-4ec0-bf99-5247b2e788e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.489224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c00f761-84a7-4ec0-bf99-5247b2e788e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.495706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c00f761-84a7-4ec0-bf99-5247b2e788e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.496716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c00f761-84a7-4ec0-bf99-5247b2e788e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.712107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c00f761-84a7-4ec0-bf99-5247b2e788e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:06.722727 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c00f761-84a7-4ec0-bf99-5247b2e788e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1317 microversion: 2.1 time: 0.264283 Jul 20 04:38:06.726755 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2658/5305] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:06 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:06.805972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f1ba5633-7690-4bdc-9a5a-256ac1506c67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:06.808852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4daee589-5742-4473-85e6-9a8b617d1c48 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:06.810188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4daee589-5742-4473-85e6-9a8b617d1c48 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:06.814642 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f1ba5633-7690-4bdc-9a5a-256ac1506c67 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1365 microversion: 2.1 time: 0.407084 Jul 20 04:38:06.817631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4daee589-5742-4473-85e6-9a8b617d1c48 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.818501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4daee589-5742-4473-85e6-9a8b617d1c48 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.819518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4daee589-5742-4473-85e6-9a8b617d1c48 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.820175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4daee589-5742-4473-85e6-9a8b617d1c48 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.823787 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2648/5306] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:06 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1365 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:06.861377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b15540e2-0143-4bae-b1e7-74ff43eebe34 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:06.862211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b15540e2-0143-4bae-b1e7-74ff43eebe34 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:06.869783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b15540e2-0143-4bae-b1e7-74ff43eebe34 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.870657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b15540e2-0143-4bae-b1e7-74ff43eebe34 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.871788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b15540e2-0143-4bae-b1e7-74ff43eebe34 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.872449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b15540e2-0143-4bae-b1e7-74ff43eebe34 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.878231 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4daee589-5742-4473-85e6-9a8b617d1c48 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480/action" status: 200 len: 24569 microversion: 2.1 time: 0.073748 Jul 20 04:38:06.885715 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2659/5307] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:06 2022] POST /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480/action => generated 24569 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:38:06.907504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:07.119604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b15540e2-0143-4bae-b1e7-74ff43eebe34 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:07.157144 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b15540e2-0143-4bae-b1e7-74ff43eebe34 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.300058 Jul 20 04:38:07.170741 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2649/5308] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:06 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:07.182148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ac68c0ba-bce9-4288-a78f-f8f02ad6c937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:07.184498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ac68c0ba-bce9-4288-a78f-f8f02ad6c937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:07.204929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac68c0ba-bce9-4288-a78f-f8f02ad6c937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.219325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac68c0ba-bce9-4288-a78f-f8f02ad6c937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.220538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac68c0ba-bce9-4288-a78f-f8f02ad6c937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.233765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac68c0ba-bce9-4288-a78f-f8f02ad6c937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.239982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-af3aa091-26ab-4e75-bde5-cba409567314 req-6582217f-5426-4771-beaf-b04979b9d852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38047d01-1308-49f6-8f31-61300f51932f", "name": "network-vif-plugged", "status": "completed", "tag": "15c17885-7385-4e33-b285-af310284a1a9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:07.268696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-af3aa091-26ab-4e75-bde5-cba409567314 req-6582217f-5426-4771-beaf-b04979b9d852 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.269162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-af3aa091-26ab-4e75-bde5-cba409567314 req-6582217f-5426-4771-beaf-b04979b9d852 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.282049 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-af3aa091-26ab-4e75-bde5-cba409567314 req-6582217f-5426-4771-beaf-b04979b9d852 service nova] Creating event network-vif-plugged:15c17885-7385-4e33-b285-af310284a1a9 for instance 38047d01-1308-49f6-8f31-61300f51932f on n-h1-760456-11 Jul 20 04:38:07.288095 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-af3aa091-26ab-4e75-bde5-cba409567314 req-6582217f-5426-4771-beaf-b04979b9d852 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051603 Jul 20 04:38:07.289087 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2650/5309] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:07.612911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b7a09424-9dc7-40c6-b623-779375881ca4 req-1539b698-b830-41ee-b1ce-a7ca915cea5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a88e64-633c-4a24-b3b6-8246ba0759d4", "tag": "39fe52ef-1df4-4915-b28e-872e5bcef532"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:07.648867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b7a09424-9dc7-40c6-b623-779375881ca4 req-1539b698-b830-41ee-b1ce-a7ca915cea5d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.649330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b7a09424-9dc7-40c6-b623-779375881ca4 req-1539b698-b830-41ee-b1ce-a7ca915cea5d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.680059 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b7a09424-9dc7-40c6-b623-779375881ca4 req-1539b698-b830-41ee-b1ce-a7ca915cea5d service nova] Creating event network-changed:39fe52ef-1df4-4915-b28e-872e5bcef532 for instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 on n-h2-760456-11 Jul 20 04:38:07.691080 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b7a09424-9dc7-40c6-b623-779375881ca4 req-1539b698-b830-41ee-b1ce-a7ca915cea5d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083941 Jul 20 04:38:07.692001 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2651/5310] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:07.747180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-00bf906d-ce8a-482b-9fc1-d76292607613 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:07.748156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-00bf906d-ce8a-482b-9fc1-d76292607613 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:07.771083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00bf906d-ce8a-482b-9fc1-d76292607613 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.779454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00bf906d-ce8a-482b-9fc1-d76292607613 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.779662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ac68c0ba-bce9-4288-a78f-f8f02ad6c937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:07.784708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00bf906d-ce8a-482b-9fc1-d76292607613 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.785306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00bf906d-ce8a-482b-9fc1-d76292607613 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.791380 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ac68c0ba-bce9-4288-a78f-f8f02ad6c937 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1669 microversion: 2.1 time: 0.617326 Jul 20 04:38:07.794079 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2660/5311] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:07 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1669 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:07.813997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:07.815674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:07.830100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.833324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.834296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.835270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.903047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:07.921622 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.compute.api [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Working on deleting snapshot 1c3882d4-1663-47f4-9c87-1323c2bc4ce2 from shelved instance... Jul 20 04:38:08.280345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-00bf906d-ce8a-482b-9fc1-d76292607613 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:08.299522 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-00bf906d-ce8a-482b-9fc1-d76292607613 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1317 microversion: 2.1 time: 0.550214 Jul 20 04:38:08.308415 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2652/5312] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:07 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:08.313563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fc4463cf-0f98-420d-bb84-09aa37ed276e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:08.314185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fc4463cf-0f98-420d-bb84-09aa37ed276e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:08.336276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc4463cf-0f98-420d-bb84-09aa37ed276e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.336880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc4463cf-0f98-420d-bb84-09aa37ed276e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.338692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc4463cf-0f98-420d-bb84-09aa37ed276e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.339043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc4463cf-0f98-420d-bb84-09aa37ed276e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.677180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fc4463cf-0f98-420d-bb84-09aa37ed276e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:08.734070 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fc4463cf-0f98-420d-bb84-09aa37ed276e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1365 microversion: 2.1 time: 0.424023 Jul 20 04:38:08.746670 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2653/5313] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:08 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:09.021426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Doing local delete in cell 0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) {{(pid=119605) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 04:38:09.022202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.022915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.023595 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.compute.api [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 04:38:09.031865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] deallocate_for_instance() {{(pid=119605) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 04:38:09.317085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-80c53d96-c378-44c2-979c-984a113f1342 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:09.317895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-80c53d96-c378-44c2-979c-984a113f1342 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:09.327438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80c53d96-c378-44c2-979c-984a113f1342 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.328277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80c53d96-c378-44c2-979c-984a113f1342 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.329065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80c53d96-c378-44c2-979c-984a113f1342 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.329507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80c53d96-c378-44c2-979c-984a113f1342 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.504132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-80c53d96-c378-44c2-979c-984a113f1342 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:09.521556 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-80c53d96-c378-44c2-979c-984a113f1342 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1317 microversion: 2.1 time: 0.200323 Jul 20 04:38:09.522234 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2654/5314] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:09 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:09.756518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b70e3d3-d094-418b-b9cb-6cac6b06c14f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:09.757143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6b70e3d3-d094-418b-b9cb-6cac6b06c14f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:09.848889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b70e3d3-d094-418b-b9cb-6cac6b06c14f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.856042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b70e3d3-d094-418b-b9cb-6cac6b06c14f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.860999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b70e3d3-d094-418b-b9cb-6cac6b06c14f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.867957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b70e3d3-d094-418b-b9cb-6cac6b06c14f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.924833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Updating instance_info_cache with network_info: [] {{(pid=119605) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:38:10.476657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6b70e3d3-d094-418b-b9cb-6cac6b06c14f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:10.490795 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6b70e3d3-d094-418b-b9cb-6cac6b06c14f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1555 microversion: 2.1 time: 0.735275 Jul 20 04:38:10.492023 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2655/5315] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:09 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1555 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:10.501442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c0228701-9481-4733-9028-6fa43beee2b4 req-a7c7086b-5c97-4dc4-80b9-79264569018a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d21092-aba7-482a-befb-1093f60fb247", "name": "network-vif-deleted", "tag": "483351f5-0838-4691-a2b2-8d9d0878b14f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:10.511160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=15,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:10.520041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c0228701-9481-4733-9028-6fa43beee2b4 req-a7c7086b-5c97-4dc4-80b9-79264569018a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.526271 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c847aa62-2003-446e-9828-5343b234ffe9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "DELETE /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 204 len: 0 microversion: 2.1 time: 2.714671 Jul 20 04:38:10.527777 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2661/5316] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:07 2022] DELETE /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 0 bytes in 2722 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:10.531028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c0228701-9481-4733-9028-6fa43beee2b4 req-a7c7086b-5c97-4dc4-80b9-79264569018a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.536003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0e00f182-93f4-4136-aad7-4afd25ca9b0a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:10.536953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0e00f182-93f4-4136-aad7-4afd25ca9b0a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:10.545482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e00f182-93f4-4136-aad7-4afd25ca9b0a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.546498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e00f182-93f4-4136-aad7-4afd25ca9b0a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.547786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e00f182-93f4-4136-aad7-4afd25ca9b0a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.548917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e00f182-93f4-4136-aad7-4afd25ca9b0a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.553834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.compute.server_external_events [req-c0228701-9481-4733-9028-6fa43beee2b4 req-a7c7086b-5c97-4dc4-80b9-79264569018a service nova] Unable to find a host for instance 85d21092-aba7-482a-befb-1093f60fb247. Dropping event network-vif-deleted {{(pid=119606) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:38:10.554996 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c0228701-9481-4733-9028-6fa43beee2b4 req-a7c7086b-5c97-4dc4-80b9-79264569018a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.061836 Jul 20 04:38:10.555760 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2656/5317] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:38:10.564592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e90889ab-5f8e-4753-99b1-bd4fcdbc7287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:10.565421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e90889ab-5f8e-4753-99b1-bd4fcdbc7287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 85d21092-aba7-482a-befb-1093f60fb247] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:10.573137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e90889ab-5f8e-4753-99b1-bd4fcdbc7287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.573898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e90889ab-5f8e-4753-99b1-bd4fcdbc7287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.574940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e90889ab-5f8e-4753-99b1-bd4fcdbc7287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.578205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e90889ab-5f8e-4753-99b1-bd4fcdbc7287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.606642 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e90889ab-5f8e-4753-99b1-bd4fcdbc7287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] HTTP exception thrown: Instance 85d21092-aba7-482a-befb-1093f60fb247 could not be found. Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e90889ab-5f8e-4753-99b1-bd4fcdbc7287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Request method failure captured: Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 HTTP/1.1 Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14SiUlkQNYk--daNjLwIoEjtsFT5_8UlpOU3P-5mDFLyXSRv-FzhEH1ynPPVEM_64IvlQlWrMD095ewIpF0tstjiya8gbRdB-HqL3UAUp669y1SWiwiBAgJe5VUCMiWH0WBVcOTUefMYnTyIure1GlP0xwZ9qJH3u8xEI1jzCtXBPfQ Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: a3a58233b2b044d9b1285b616c79f9b8 Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 85d21092-aba7-482a-befb-1093f60fb247 could not be found. Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '85d21092-aba7-482a-befb-1093f60fb247'} Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d21092-aba7-482a-befb-1093f60fb247 could not be found. Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d21092-aba7-482a-befb-1093f60fb247 could not be found. Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:10.608723 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:10.612898 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:10.612898 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:10.612898 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:10.612898 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:10.612898 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:10.612898 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d21092-aba7-482a-befb-1093f60fb247 could not be found. Jul 20 04:38:10.612898 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:10.616153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e90889ab-5f8e-4753-99b1-bd4fcdbc7287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Returning 404 to user: Instance 85d21092-aba7-482a-befb-1093f60fb247 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:10.617268 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e90889ab-5f8e-4753-99b1-bd4fcdbc7287 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247" status: 404 len: 111 microversion: 2.1 time: 0.059003 Jul 20 04:38:10.622745 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2657/5318] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:10 2022] GET /compute/v2.1/servers/85d21092-aba7-482a-befb-1093f60fb247 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:10.628272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-63afe8d4-15ba-4a6a-b028-80e1cec18a6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:10.629136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63afe8d4-15ba-4a6a-b028-80e1cec18a6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:10.636701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63afe8d4-15ba-4a6a-b028-80e1cec18a6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.637469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63afe8d4-15ba-4a6a-b028-80e1cec18a6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.638520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63afe8d4-15ba-4a6a-b028-80e1cec18a6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.641718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63afe8d4-15ba-4a6a-b028-80e1cec18a6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.719251 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0e00f182-93f4-4136-aad7-4afd25ca9b0a tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189687 Jul 20 04:38:10.720140 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2662/5319] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:38:10 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:10.725789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-86d1874f-e79e-4e7b-9361-1b0e4e6b0681 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:10.726368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-86d1874f-e79e-4e7b-9361-1b0e4e6b0681 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:10.740678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86d1874f-e79e-4e7b-9361-1b0e4e6b0681 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.742844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86d1874f-e79e-4e7b-9361-1b0e4e6b0681 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.744961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86d1874f-e79e-4e7b-9361-1b0e4e6b0681 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.758704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86d1874f-e79e-4e7b-9361-1b0e4e6b0681 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.818930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-86d1874f-e79e-4e7b-9361-1b0e4e6b0681 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:10.902490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-63afe8d4-15ba-4a6a-b028-80e1cec18a6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:10.926533 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-63afe8d4-15ba-4a6a-b028-80e1cec18a6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1317 microversion: 2.1 time: 0.302266 Jul 20 04:38:10.927584 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2658/5320] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:10 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:10.948364 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-86d1874f-e79e-4e7b-9361-1b0e4e6b0681 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "DELETE /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 204 len: 0 microversion: 2.1 time: 0.223800 Jul 20 04:38:10.950440 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2663/5321] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:10 2022] DELETE /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:10.959548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bd37c3ed-5c94-44c8-8323-0ede246a36e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:10.960660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bd37c3ed-5c94-44c8-8323-0ede246a36e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:10.969774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd37c3ed-5c94-44c8-8323-0ede246a36e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.970594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd37c3ed-5c94-44c8-8323-0ede246a36e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.972135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd37c3ed-5c94-44c8-8323-0ede246a36e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.972792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd37c3ed-5c94-44c8-8323-0ede246a36e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.106460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bd37c3ed-5c94-44c8-8323-0ede246a36e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:11.123291 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bd37c3ed-5c94-44c8-8323-0ede246a36e9 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1465 microversion: 2.1 time: 0.168410 Jul 20 04:38:11.124526 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2659/5322] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:10 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1465 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:11.945057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3109b0d5-9a54-48f8-9473-92aa3e347fdf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:11.946827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3109b0d5-9a54-48f8-9473-92aa3e347fdf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:11.956075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3109b0d5-9a54-48f8-9473-92aa3e347fdf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.966286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3109b0d5-9a54-48f8-9473-92aa3e347fdf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.967415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3109b0d5-9a54-48f8-9473-92aa3e347fdf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.971653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3109b0d5-9a54-48f8-9473-92aa3e347fdf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.141878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e97d7ec2-9f13-4ef5-a0c9-b14f5ddee4cf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:12.142809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e97d7ec2-9f13-4ef5-a0c9-b14f5ddee4cf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:12.160115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e97d7ec2-9f13-4ef5-a0c9-b14f5ddee4cf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.162022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e97d7ec2-9f13-4ef5-a0c9-b14f5ddee4cf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.165755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e97d7ec2-9f13-4ef5-a0c9-b14f5ddee4cf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.166392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e97d7ec2-9f13-4ef5-a0c9-b14f5ddee4cf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.424461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e97d7ec2-9f13-4ef5-a0c9-b14f5ddee4cf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:12.441960 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e97d7ec2-9f13-4ef5-a0c9-b14f5ddee4cf tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1465 microversion: 2.1 time: 0.304266 Jul 20 04:38:12.453677 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2660/5323] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:12 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1465 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:12.863524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3109b0d5-9a54-48f8-9473-92aa3e347fdf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:12.876445 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3109b0d5-9a54-48f8-9473-92aa3e347fdf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1317 microversion: 2.1 time: 0.935614 Jul 20 04:38:12.877303 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2664/5324] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:11 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1317 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:12.973534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-88f3e4fa-30f3-4f68-9665-022ae86e161e req-168da328-317c-4f1f-b2df-621b54157239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38047d01-1308-49f6-8f31-61300f51932f", "tag": "15c17885-7385-4e33-b285-af310284a1a9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:12.999205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-88f3e4fa-30f3-4f68-9665-022ae86e161e req-168da328-317c-4f1f-b2df-621b54157239 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.000001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-88f3e4fa-30f3-4f68-9665-022ae86e161e req-168da328-317c-4f1f-b2df-621b54157239 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.015685 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-88f3e4fa-30f3-4f68-9665-022ae86e161e req-168da328-317c-4f1f-b2df-621b54157239 service nova] Creating event network-changed:15c17885-7385-4e33-b285-af310284a1a9 for instance 38047d01-1308-49f6-8f31-61300f51932f on n-h1-760456-11 Jul 20 04:38:13.023370 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-88f3e4fa-30f3-4f68-9665-022ae86e161e req-168da328-317c-4f1f-b2df-621b54157239 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053287 Jul 20 04:38:13.025162 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2661/5325] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:13.462430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea9bad24-8f27-486d-a442-25bc067f683a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:13.463029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ea9bad24-8f27-486d-a442-25bc067f683a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.474957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea9bad24-8f27-486d-a442-25bc067f683a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.475412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea9bad24-8f27-486d-a442-25bc067f683a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.476200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea9bad24-8f27-486d-a442-25bc067f683a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.476639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea9bad24-8f27-486d-a442-25bc067f683a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.648614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ea9bad24-8f27-486d-a442-25bc067f683a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.661642 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ea9bad24-8f27-486d-a442-25bc067f683a tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 200 len: 1465 microversion: 2.1 time: 0.203089 Jul 20 04:38:13.673774 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2665/5326] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:13 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 1465 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:13.708447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-730a7ac1-1f9c-4b17-b220-b6002821a9d1 req-dca873ce-cef5-4922-9b2b-671f7cb78576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a88e64-633c-4a24-b3b6-8246ba0759d4", "name": "network-vif-plugged", "status": "completed", "tag": "39fe52ef-1df4-4915-b28e-872e5bcef532"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:13.728313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-730a7ac1-1f9c-4b17-b220-b6002821a9d1 req-dca873ce-cef5-4922-9b2b-671f7cb78576 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.729284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-730a7ac1-1f9c-4b17-b220-b6002821a9d1 req-dca873ce-cef5-4922-9b2b-671f7cb78576 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.757117 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-730a7ac1-1f9c-4b17-b220-b6002821a9d1 req-dca873ce-cef5-4922-9b2b-671f7cb78576 service nova] Creating event network-vif-plugged:39fe52ef-1df4-4915-b28e-872e5bcef532 for instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 on n-h2-760456-11 Jul 20 04:38:13.768174 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-730a7ac1-1f9c-4b17-b220-b6002821a9d1 req-dca873ce-cef5-4922-9b2b-671f7cb78576 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063964 Jul 20 04:38:13.772902 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2662/5327] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:13.895493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ffcef7b1-2f3f-4a7f-95c1-4c9a73a5f705 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:13.896324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ffcef7b1-2f3f-4a7f-95c1-4c9a73a5f705 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.906539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffcef7b1-2f3f-4a7f-95c1-4c9a73a5f705 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.909949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffcef7b1-2f3f-4a7f-95c1-4c9a73a5f705 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.917222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffcef7b1-2f3f-4a7f-95c1-4c9a73a5f705 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.918061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffcef7b1-2f3f-4a7f-95c1-4c9a73a5f705 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.276163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ffcef7b1-2f3f-4a7f-95c1-4c9a73a5f705 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:14.286706 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ffcef7b1-2f3f-4a7f-95c1-4c9a73a5f705 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1317 microversion: 2.1 time: 0.396103 Jul 20 04:38:14.295669 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2666/5328] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:13 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:14.681188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b345571c-d61f-42e3-9adb-37e01bdf53ea tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:14.682604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b345571c-d61f-42e3-9adb-37e01bdf53ea tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 19a30ca2-3a5c-42c2-9359-7d8553da3f33] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:14.692192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:14.693466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=24 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:14.695810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b345571c-d61f-42e3-9adb-37e01bdf53ea tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.700673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b345571c-d61f-42e3-9adb-37e01bdf53ea tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.701713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b345571c-d61f-42e3-9adb-37e01bdf53ea tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.702515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b345571c-d61f-42e3-9adb-37e01bdf53ea tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.728421 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-b345571c-d61f-42e3-9adb-37e01bdf53ea tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] HTTP exception thrown: Instance 19a30ca2-3a5c-42c2-9359-7d8553da3f33 could not be found. Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b345571c-d61f-42e3-9adb-37e01bdf53ea tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Request method failure captured: Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 HTTP/1.1 Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14SiUlkQNYk--daNjLwIoEjtsFT5_8UlpOU3P-5mDFLyXSRv-FzhEH1ynPPVEM_64IvlQlWrMD095ewIpF0tstjiya8gbRdB-HqL3UAUp669y1SWiwiBAgJe5VUCMiWH0WBVcOTUefMYnTyIure1GlP0xwZ9qJH3u8xEI1jzCtXBPfQ Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: a3a58233b2b044d9b1285b616c79f9b8 Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 19a30ca2-3a5c-42c2-9359-7d8553da3f33 could not be found. Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '19a30ca2-3a5c-42c2-9359-7d8553da3f33'} Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a30ca2-3a5c-42c2-9359-7d8553da3f33 could not be found. Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a30ca2-3a5c-42c2-9359-7d8553da3f33 could not be found. Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:14.731682 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:14.736411 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:14.736411 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:14.736411 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:14.736411 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:14.736411 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:14.736411 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a30ca2-3a5c-42c2-9359-7d8553da3f33 could not be found. Jul 20 04:38:14.736411 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:14.737654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b345571c-d61f-42e3-9adb-37e01bdf53ea tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Returning 404 to user: Instance 19a30ca2-3a5c-42c2-9359-7d8553da3f33 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:14.738793 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b345571c-d61f-42e3-9adb-37e01bdf53ea tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33" status: 404 len: 111 microversion: 2.1 time: 0.062474 Jul 20 04:38:14.743147 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2663/5329] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:14 2022] GET /compute/v2.1/servers/19a30ca2-3a5c-42c2-9359-7d8553da3f33 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:14.748494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a8f719f4-8546-4ce9-8fcb-adcea369d637 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:14.749334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a8f719f4-8546-4ce9-8fcb-adcea369d637 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:14.751627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:14.765188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8f719f4-8546-4ce9-8fcb-adcea369d637 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.765656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8f719f4-8546-4ce9-8fcb-adcea369d637 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.766504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8f719f4-8546-4ce9-8fcb-adcea369d637 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.766957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8f719f4-8546-4ce9-8fcb-adcea369d637 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.813787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a8f719f4-8546-4ce9-8fcb-adcea369d637 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:14.949116 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a8f719f4-8546-4ce9-8fcb-adcea369d637 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "DELETE /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 204 len: 0 microversion: 2.1 time: 0.204566 Jul 20 04:38:14.950681 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2667/5330] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:14 2022] DELETE /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:14.959576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62f74a80-a131-4f14-98a7-c3d9f84b3d22 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:14.960242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-62f74a80-a131-4f14-98a7-c3d9f84b3d22 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:14.967139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62f74a80-a131-4f14-98a7-c3d9f84b3d22 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.967839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62f74a80-a131-4f14-98a7-c3d9f84b3d22 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.968941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62f74a80-a131-4f14-98a7-c3d9f84b3d22 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.969555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62f74a80-a131-4f14-98a7-c3d9f84b3d22 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:15.190797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1565db75-62ba-45ff-8abe-2ab03e67f288 req-3f85d409-8796-4d74-a110-54f2a169ae9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a30ca2-3a5c-42c2-9359-7d8553da3f33", "name": "network-vif-deleted", "tag": "463b5dd6-01d7-4f84-b981-58adeeabd51c"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:15.200193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1565db75-62ba-45ff-8abe-2ab03e67f288 req-3f85d409-8796-4d74-a110-54f2a169ae9e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:15.200881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1565db75-62ba-45ff-8abe-2ab03e67f288 req-3f85d409-8796-4d74-a110-54f2a169ae9e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:15.216096 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1565db75-62ba-45ff-8abe-2ab03e67f288 req-3f85d409-8796-4d74-a110-54f2a169ae9e service nova] Creating event network-vif-deleted:463b5dd6-01d7-4f84-b981-58adeeabd51c for instance 19a30ca2-3a5c-42c2-9359-7d8553da3f33 on n-h1-760456-11 Jul 20 04:38:15.221539 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1565db75-62ba-45ff-8abe-2ab03e67f288 req-3f85d409-8796-4d74-a110-54f2a169ae9e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168289 Jul 20 04:38:15.223373 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2668/5331] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:15.280001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-62f74a80-a131-4f14-98a7-c3d9f84b3d22 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.289153 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62f74a80-a131-4f14-98a7-c3d9f84b3d22 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1506 microversion: 2.1 time: 0.333402 Jul 20 04:38:15.290506 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2664/5332] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:14 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:15.312436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6088feb-7bb9-4543-a343-74a0b789f9e3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:15.313142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e6088feb-7bb9-4543-a343-74a0b789f9e3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:15.332600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6088feb-7bb9-4543-a343-74a0b789f9e3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:15.332600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6088feb-7bb9-4543-a343-74a0b789f9e3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:15.332600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6088feb-7bb9-4543-a343-74a0b789f9e3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:15.333119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6088feb-7bb9-4543-a343-74a0b789f9e3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:15.541416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6088feb-7bb9-4543-a343-74a0b789f9e3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.551718 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6088feb-7bb9-4543-a343-74a0b789f9e3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1317 microversion: 2.1 time: 0.243403 Jul 20 04:38:15.552547 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2669/5333] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:15 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:16.308069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f7f016ab-989a-4b9a-a7bd-beedacbd400f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:16.308739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f7f016ab-989a-4b9a-a7bd-beedacbd400f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:16.312062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:16.317953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7f016ab-989a-4b9a-a7bd-beedacbd400f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.318459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7f016ab-989a-4b9a-a7bd-beedacbd400f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.319253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7f016ab-989a-4b9a-a7bd-beedacbd400f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.319706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7f016ab-989a-4b9a-a7bd-beedacbd400f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.584537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f7f016ab-989a-4b9a-a7bd-beedacbd400f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:16.594029 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f7f016ab-989a-4b9a-a7bd-beedacbd400f tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1506 microversion: 2.1 time: 0.290607 Jul 20 04:38:16.598284 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2665/5334] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:16 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:16.610770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec127d0d-37c5-4391-af49-100d1cfdb704 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:16.612164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ec127d0d-37c5-4391-af49-100d1cfdb704 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:16.638052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec127d0d-37c5-4391-af49-100d1cfdb704 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.638824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec127d0d-37c5-4391-af49-100d1cfdb704 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.641517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec127d0d-37c5-4391-af49-100d1cfdb704 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.642207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec127d0d-37c5-4391-af49-100d1cfdb704 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.967749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ec127d0d-37c5-4391-af49-100d1cfdb704 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:16.976433 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec127d0d-37c5-4391-af49-100d1cfdb704 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1507 microversion: 2.1 time: 0.410736 Jul 20 04:38:16.977629 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2670/5335] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:16 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:16.993920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-20935570-2378-4f4b-be30-70e806587c7c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:16.995098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-20935570-2378-4f4b-be30-70e806587c7c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:17.002349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20935570-2378-4f4b-be30-70e806587c7c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.002773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20935570-2378-4f4b-be30-70e806587c7c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.003586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20935570-2378-4f4b-be30-70e806587c7c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.004039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-20935570-2378-4f4b-be30-70e806587c7c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.035499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-20935570-2378-4f4b-be30-70e806587c7c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:17.204841 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-20935570-2378-4f4b-be30-70e806587c7c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "DELETE /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 204 len: 0 microversion: 2.1 time: 0.214566 Jul 20 04:38:17.208037 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2666/5336] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:16 2022] DELETE /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:17.217950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a5d9f0b8-9659-4704-a888-e748b161c1ab tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:17.218593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a5d9f0b8-9659-4704-a888-e748b161c1ab tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:17.225026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5d9f0b8-9659-4704-a888-e748b161c1ab tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.225926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5d9f0b8-9659-4704-a888-e748b161c1ab tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.229871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5d9f0b8-9659-4704-a888-e748b161c1ab tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.230615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5d9f0b8-9659-4704-a888-e748b161c1ab tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.522758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a5d9f0b8-9659-4704-a888-e748b161c1ab tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.539080 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a5d9f0b8-9659-4704-a888-e748b161c1ab tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1513 microversion: 2.1 time: 0.326340 Jul 20 04:38:17.541531 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2671/5337] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:17 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1513 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:17.620430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8adb3378-ec25-4e7e-963f-f63b1d058227 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:17.621719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8adb3378-ec25-4e7e-963f-f63b1d058227 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:17.644091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8adb3378-ec25-4e7e-963f-f63b1d058227 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.646976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8adb3378-ec25-4e7e-963f-f63b1d058227 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.647958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8adb3378-ec25-4e7e-963f-f63b1d058227 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.651460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8adb3378-ec25-4e7e-963f-f63b1d058227 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.784070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a5346c13-8b23-42de-b6a6-93b98bbccdd3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:17.785823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a5346c13-8b23-42de-b6a6-93b98bbccdd3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:17.796580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5346c13-8b23-42de-b6a6-93b98bbccdd3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.808795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5346c13-8b23-42de-b6a6-93b98bbccdd3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.815168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8adb3378-ec25-4e7e-963f-f63b1d058227 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.820355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5346c13-8b23-42de-b6a6-93b98bbccdd3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.821016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5346c13-8b23-42de-b6a6-93b98bbccdd3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.836820 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8adb3378-ec25-4e7e-963f-f63b1d058227 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1464 microversion: 2.1 time: 0.219591 Jul 20 04:38:17.838504 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2667/5338] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:17 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:17.859368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-bdc90c72-01ea-43b9-8f0e-61f6cecbf6c0 req-67d05f4d-2fe7-4c59-806c-6d681a3a274c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f10cf4-af8b-4e85-bb96-2df270fa0e4d", "name": "network-vif-deleted", "tag": "6485dee1-45fc-4292-9069-759307e48816"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:17.878746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bdc90c72-01ea-43b9-8f0e-61f6cecbf6c0 req-67d05f4d-2fe7-4c59-806c-6d681a3a274c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.879681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bdc90c72-01ea-43b9-8f0e-61f6cecbf6c0 req-67d05f4d-2fe7-4c59-806c-6d681a3a274c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.902577 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-bdc90c72-01ea-43b9-8f0e-61f6cecbf6c0 req-67d05f4d-2fe7-4c59-806c-6d681a3a274c service nova] Creating event network-vif-deleted:6485dee1-45fc-4292-9069-759307e48816 for instance 33f10cf4-af8b-4e85-bb96-2df270fa0e4d on n-h2-760456-11 Jul 20 04:38:17.909443 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-bdc90c72-01ea-43b9-8f0e-61f6cecbf6c0 req-67d05f4d-2fe7-4c59-806c-6d681a3a274c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059937 Jul 20 04:38:17.910710 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2668/5339] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:18.049925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a5346c13-8b23-42de-b6a6-93b98bbccdd3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.059595 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a5346c13-8b23-42de-b6a6-93b98bbccdd3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1682 microversion: 2.1 time: 0.280202 Jul 20 04:38:18.060519 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2672/5340] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:17 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1682 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:18.207094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-36021db5-b41b-4d5a-a35f-9b357b5b0bd5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:18.209170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-36021db5-b41b-4d5a-a35f-9b357b5b0bd5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.220981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36021db5-b41b-4d5a-a35f-9b357b5b0bd5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.221350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36021db5-b41b-4d5a-a35f-9b357b5b0bd5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.222155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36021db5-b41b-4d5a-a35f-9b357b5b0bd5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.222645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36021db5-b41b-4d5a-a35f-9b357b5b0bd5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.445284 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-36021db5-b41b-4d5a-a35f-9b357b5b0bd5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480/action" status: 200 len: 32640 microversion: 2.1 time: 0.243243 Jul 20 04:38:18.445966 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2669/5341] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:18 2022] POST /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480/action => generated 32640 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:18.562358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a301eb63-92ac-4f34-bb1c-0de6dd569cc5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:18.563090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a301eb63-92ac-4f34-bb1c-0de6dd569cc5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.569841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a301eb63-92ac-4f34-bb1c-0de6dd569cc5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.570446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a301eb63-92ac-4f34-bb1c-0de6dd569cc5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.571389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a301eb63-92ac-4f34-bb1c-0de6dd569cc5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.572129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a301eb63-92ac-4f34-bb1c-0de6dd569cc5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.640360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f809720-64bb-46ae-bfa0-7af4494f1fea tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:18.641627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3f809720-64bb-46ae-bfa0-7af4494f1fea tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.664506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f809720-64bb-46ae-bfa0-7af4494f1fea tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.666350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f809720-64bb-46ae-bfa0-7af4494f1fea tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.669619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f809720-64bb-46ae-bfa0-7af4494f1fea tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.677960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f809720-64bb-46ae-bfa0-7af4494f1fea tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.692591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:18.926498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a301eb63-92ac-4f34-bb1c-0de6dd569cc5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.932386 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f809720-64bb-46ae-bfa0-7af4494f1fea tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1835 microversion: 2.1 time: 0.299439 Jul 20 04:38:18.933621 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2670/5342] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:18 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1835 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:18.938781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:18.939580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.953211 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a301eb63-92ac-4f34-bb1c-0de6dd569cc5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1513 microversion: 2.1 time: 0.392952 Jul 20 04:38:18.958007 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2673/5343] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:18 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1513 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:18.964460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ffdc91c-6430-4bca-bf7f-ac05682e17db tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:18.973549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ffdc91c-6430-4bca-bf7f-ac05682e17db tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.987966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ffdc91c-6430-4bca-bf7f-ac05682e17db tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.988731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ffdc91c-6430-4bca-bf7f-ac05682e17db tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.989106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.989592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.990451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.990890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.991221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ffdc91c-6430-4bca-bf7f-ac05682e17db tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.991911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ffdc91c-6430-4bca-bf7f-ac05682e17db tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:19.122785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:19.123416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:19.124260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lazy-loading 'fault' on Instance uuid 33f10cf4-af8b-4e85-bb96-2df270fa0e4d {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:19.146333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-5ffdc91c-6430-4bca-bf7f-ac05682e17db tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lazy-loading 'flavor' on Instance uuid 0239847b-a58e-49a6-9e26-b6d79515a480 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:19.179938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ffdc91c-6430-4bca-bf7f-ac05682e17db tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Going to try to live migrate instance to another host {{(pid=119605) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:38:19.237637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:DELETE=2,nova_cell1:SELECT=92,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:19.311593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:19.322378 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-06a32d4d-1f49-48a7-8c5f-4f6556512c15 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 200 len: 1304 microversion: 2.1 time: 0.384505 Jul 20 04:38:19.326163 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2671/5344] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:18 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 1304 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:19.940247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-57a24ee2-44f8-47c7-a4a8-40dabd76da31 req-7bf575ff-425f-4f57-9a13-dd4ad76a201a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a88e64-633c-4a24-b3b6-8246ba0759d4", "name": "network-vif-deleted", "tag": "39fe52ef-1df4-4915-b28e-872e5bcef532"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:19.957136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-57a24ee2-44f8-47c7-a4a8-40dabd76da31 req-7bf575ff-425f-4f57-9a13-dd4ad76a201a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:19.960353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-57a24ee2-44f8-47c7-a4a8-40dabd76da31 req-7bf575ff-425f-4f57-9a13-dd4ad76a201a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.002121 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-57a24ee2-44f8-47c7-a4a8-40dabd76da31 req-7bf575ff-425f-4f57-9a13-dd4ad76a201a service nova] Creating event network-vif-deleted:39fe52ef-1df4-4915-b28e-872e5bcef532 for instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 on n-h2-760456-11 Jul 20 04:38:20.011362 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-57a24ee2-44f8-47c7-a4a8-40dabd76da31 req-7bf575ff-425f-4f57-9a13-dd4ad76a201a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081028 Jul 20 04:38:20.015722 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2672/5345] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:20.034112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:20.034895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:20.043070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.043296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.044098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.044550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.111752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.112698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.113333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lazy-loading 'fault' on Instance uuid 98a88e64-633c-4a24-b3b6-8246ba0759d4 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:20.186914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:20.198288 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e23bbdf8-d008-4732-a71b-8a1fd17eafd2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 200 len: 1307 microversion: 2.1 time: 0.181010 Jul 20 04:38:20.219017 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2673/5346] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:20 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:20.341192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5426c74-5a3a-4eaf-9c48-78f30c14f86b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:20.341828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5426c74-5a3a-4eaf-9c48-78f30c14f86b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 33f10cf4-af8b-4e85-bb96-2df270fa0e4d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:20.358411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5426c74-5a3a-4eaf-9c48-78f30c14f86b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.358883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5426c74-5a3a-4eaf-9c48-78f30c14f86b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.359686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5426c74-5a3a-4eaf-9c48-78f30c14f86b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.360392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5426c74-5a3a-4eaf-9c48-78f30c14f86b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.390401 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a5426c74-5a3a-4eaf-9c48-78f30c14f86b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] HTTP exception thrown: Instance 33f10cf4-af8b-4e85-bb96-2df270fa0e4d could not be found. Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5426c74-5a3a-4eaf-9c48-78f30c14f86b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Request method failure captured: Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d HTTP/1.1 Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14SiUlkQNYk--daNjLwIoEjtsFT5_8UlpOU3P-5mDFLyXSRv-FzhEH1ynPPVEM_64IvlQlWrMD095ewIpF0tstjiya8gbRdB-HqL3UAUp669y1SWiwiBAgJe5VUCMiWH0WBVcOTUefMYnTyIure1GlP0xwZ9qJH3u8xEI1jzCtXBPfQ Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: a3a58233b2b044d9b1285b616c79f9b8 Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 33f10cf4-af8b-4e85-bb96-2df270fa0e4d could not be found. Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '33f10cf4-af8b-4e85-bb96-2df270fa0e4d'} Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f10cf4-af8b-4e85-bb96-2df270fa0e4d could not be found. Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f10cf4-af8b-4e85-bb96-2df270fa0e4d could not be found. Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:20.392126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:20.401290 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:20.401290 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:20.401290 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:20.401290 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:20.401290 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:20.401290 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f10cf4-af8b-4e85-bb96-2df270fa0e4d could not be found. Jul 20 04:38:20.401290 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:20.401290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5426c74-5a3a-4eaf-9c48-78f30c14f86b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Returning 404 to user: Instance 33f10cf4-af8b-4e85-bb96-2df270fa0e4d could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:20.401290 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5426c74-5a3a-4eaf-9c48-78f30c14f86b tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d" status: 404 len: 111 microversion: 2.1 time: 0.057090 Jul 20 04:38:20.401290 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2674/5347] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:20 2022] GET /compute/v2.1/servers/33f10cf4-af8b-4e85-bb96-2df270fa0e4d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:38:20.403858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-23defb82-010f-4d39-8da2-66f99157612d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:20.404370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-23defb82-010f-4d39-8da2-66f99157612d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:20.424318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23defb82-010f-4d39-8da2-66f99157612d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.425034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23defb82-010f-4d39-8da2-66f99157612d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.427139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23defb82-010f-4d39-8da2-66f99157612d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.427756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23defb82-010f-4d39-8da2-66f99157612d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.471631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-23defb82-010f-4d39-8da2-66f99157612d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:20.614600 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-23defb82-010f-4d39-8da2-66f99157612d tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 204 len: 0 microversion: 2.1 time: 0.214792 Jul 20 04:38:20.615434 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2675/5348] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:20 2022] DELETE /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:20.631075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b9d639f-e5d4-45bf-a2b6-9aabbbef5c08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:20.633437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b9d639f-e5d4-45bf-a2b6-9aabbbef5c08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:20.646301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b9d639f-e5d4-45bf-a2b6-9aabbbef5c08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.647624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b9d639f-e5d4-45bf-a2b6-9aabbbef5c08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.648869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b9d639f-e5d4-45bf-a2b6-9aabbbef5c08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.650048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b9d639f-e5d4-45bf-a2b6-9aabbbef5c08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.825304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b9d639f-e5d4-45bf-a2b6-9aabbbef5c08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:20.834787 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b9d639f-e5d4-45bf-a2b6-9aabbbef5c08 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1494 microversion: 2.1 time: 0.210678 Jul 20 04:38:20.835385 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2676/5349] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:20 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1494 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:21.230177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d21dc29a-3461-4ab0-b482-409842bcd8dc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:21.232098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d21dc29a-3461-4ab0-b482-409842bcd8dc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:21.250167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21dc29a-3461-4ab0-b482-409842bcd8dc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:21.251896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21dc29a-3461-4ab0-b482-409842bcd8dc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:21.254663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21dc29a-3461-4ab0-b482-409842bcd8dc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:21.255242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d21dc29a-3461-4ab0-b482-409842bcd8dc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:21.288440 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d21dc29a-3461-4ab0-b482-409842bcd8dc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d21dc29a-3461-4ab0-b482-409842bcd8dc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 HTTP/1.1 Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '98a88e64-633c-4a24-b3b6-8246ba0759d4'} Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:21.291680 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:21.295757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:21.295757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:21.295757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:21.295757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:21.295757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:21.295757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:38:21.295757 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:21.299647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d21dc29a-3461-4ab0-b482-409842bcd8dc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:21.300627 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d21dc29a-3461-4ab0-b482-409842bcd8dc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 404 len: 111 microversion: 2.1 time: 0.075528 Jul 20 04:38:21.302617 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2677/5350] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:21 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:38:21.309924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04640f7a-796f-4ef4-9f6a-ceca611e9aed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:21.315857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04640f7a-796f-4ef4-9f6a-ceca611e9aed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:21.373240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04640f7a-796f-4ef4-9f6a-ceca611e9aed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:21.374370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04640f7a-796f-4ef4-9f6a-ceca611e9aed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:21.375328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04640f7a-796f-4ef4-9f6a-ceca611e9aed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:21.376685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04640f7a-796f-4ef4-9f6a-ceca611e9aed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.201792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-04640f7a-796f-4ef4-9f6a-ceca611e9aed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:22.214915 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04640f7a-796f-4ef4-9f6a-ceca611e9aed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.904615 Jul 20 04:38:22.215742 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2678/5351] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:21 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:22.221185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:22.221987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:22.231627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.232744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.233764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.234443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.319920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.320678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.322423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lazy-loading 'fault' on Instance uuid 0940158d-6b8d-43cd-b5bf-134af097880b {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:22.438919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:22.461046 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4fd1a793-ef47-41c6-8886-8853ff324499 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 200 len: 1305 microversion: 2.1 time: 0.231582 Jul 20 04:38:22.463237 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2679/5352] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:22 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 1305 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:22.473055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-bd1fe6ed-cc4a-4b70-9eb1-dc1c9d95476e req-eaf77697-3085-4040-a22b-a6620cd4db94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0940158d-6b8d-43cd-b5bf-134af097880b", "name": "network-vif-deleted", "tag": "32b43f15-4ce8-4265-bd37-9a9fd82b618e"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:22.494677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bd1fe6ed-cc4a-4b70-9eb1-dc1c9d95476e req-eaf77697-3085-4040-a22b-a6620cd4db94 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.499167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bd1fe6ed-cc4a-4b70-9eb1-dc1c9d95476e req-eaf77697-3085-4040-a22b-a6620cd4db94 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.528546 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-bd1fe6ed-cc4a-4b70-9eb1-dc1c9d95476e req-eaf77697-3085-4040-a22b-a6620cd4db94 service nova] Creating event network-vif-deleted:32b43f15-4ce8-4265-bd37-9a9fd82b618e for instance 0940158d-6b8d-43cd-b5bf-134af097880b on n-h2-760456-11 Jul 20 04:38:22.549194 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-bd1fe6ed-cc4a-4b70-9eb1-dc1c9d95476e req-eaf77697-3085-4040-a22b-a6620cd4db94 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083613 Jul 20 04:38:22.559041 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2680/5353] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:22.582949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4954485-e31a-4a1c-83a4-70140c9b87c7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4954485-e31a-4a1c-83a4-70140c9b87c7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 163 Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": 12345, "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 12345 Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:38:22.589055 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:38:22.594169 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.597319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4954485-e31a-4a1c-83a4-70140c9b87c7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:22.597516 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a4954485-e31a-4a1c-83a4-70140c9b87c7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.043111 Jul 20 04:38:22.599170 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2681/5354] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:22 2022] POST /compute/v2.1/servers => generated 127 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:38:22.609692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c8a5b5e2-0f4e-43cd-8d79-fe9090c3350f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:22.610873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c8a5b5e2-0f4e-43cd-8d79-fe9090c3350f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:22.620583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8a5b5e2-0f4e-43cd-8d79-fe9090c3350f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.621780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8a5b5e2-0f4e-43cd-8d79-fe9090c3350f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.622997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8a5b5e2-0f4e-43cd-8d79-fe9090c3350f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.623725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8a5b5e2-0f4e-43cd-8d79-fe9090c3350f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.673008 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ffdc91c-6430-4bca-bf7f-ac05682e17db tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480/action" status: 202 len: 0 microversion: 2.1 time: 3.712171 Jul 20 04:38:22.674870 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2674/5355] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:18 2022] POST /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480/action => generated 0 bytes in 3716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:22.688726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-05afb188-636f-490f-a2da-8ff7f64e8c67 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:22.691324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05afb188-636f-490f-a2da-8ff7f64e8c67 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:22.718674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05afb188-636f-490f-a2da-8ff7f64e8c67 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.719565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05afb188-636f-490f-a2da-8ff7f64e8c67 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.720930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05afb188-636f-490f-a2da-8ff7f64e8c67 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.723201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05afb188-636f-490f-a2da-8ff7f64e8c67 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.977941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05afb188-636f-490f-a2da-8ff7f64e8c67 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:22.995914 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-05afb188-636f-490f-a2da-8ff7f64e8c67 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1692 microversion: 2.1 time: 0.307703 Jul 20 04:38:23.008185 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2675/5356] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:22 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1692 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:23.011491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c8a5b5e2-0f4e-43cd-8d79-fe9090c3350f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:23.019458 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c8a5b5e2-0f4e-43cd-8d79-fe9090c3350f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.415512 Jul 20 04:38:23.020360 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2682/5357] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:22 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:23.040474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3766c462-247e-4f0e-9a5d-a206e3b679fe tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:23.041309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3766c462-247e-4f0e-9a5d-a206e3b679fe tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:23.049090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3766c462-247e-4f0e-9a5d-a206e3b679fe tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:23.049653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3766c462-247e-4f0e-9a5d-a206e3b679fe tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.054666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3766c462-247e-4f0e-9a5d-a206e3b679fe tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:23.056266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3766c462-247e-4f0e-9a5d-a206e3b679fe tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.298740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3766c462-247e-4f0e-9a5d-a206e3b679fe tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:23.308954 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3766c462-247e-4f0e-9a5d-a206e3b679fe tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.272613 Jul 20 04:38:23.329374 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2676/5358] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:23 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:23.480004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9bf753d1-54b9-41b9-8fb9-b5de061f3d53 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:23.481837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9bf753d1-54b9-41b9-8fb9-b5de061f3d53 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 0940158d-6b8d-43cd-b5bf-134af097880b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:23.493927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bf753d1-54b9-41b9-8fb9-b5de061f3d53 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:23.494631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bf753d1-54b9-41b9-8fb9-b5de061f3d53 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.495597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bf753d1-54b9-41b9-8fb9-b5de061f3d53 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:23.496211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bf753d1-54b9-41b9-8fb9-b5de061f3d53 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.517071 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-9bf753d1-54b9-41b9-8fb9-b5de061f3d53 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] HTTP exception thrown: Instance 0940158d-6b8d-43cd-b5bf-134af097880b could not be found. Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9bf753d1-54b9-41b9-8fb9-b5de061f3d53 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Request method failure captured: Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b HTTP/1.1 Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14SiUlkQNYk--daNjLwIoEjtsFT5_8UlpOU3P-5mDFLyXSRv-FzhEH1ynPPVEM_64IvlQlWrMD095ewIpF0tstjiya8gbRdB-HqL3UAUp669y1SWiwiBAgJe5VUCMiWH0WBVcOTUefMYnTyIure1GlP0xwZ9qJH3u8xEI1jzCtXBPfQ Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: a3a58233b2b044d9b1285b616c79f9b8 Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 0940158d-6b8d-43cd-b5bf-134af097880b could not be found. Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '0940158d-6b8d-43cd-b5bf-134af097880b'} Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0940158d-6b8d-43cd-b5bf-134af097880b could not be found. Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0940158d-6b8d-43cd-b5bf-134af097880b could not be found. Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:23.518943 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:23.523151 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:23.523151 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:23.523151 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:23.523151 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:23.523151 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:23.523151 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0940158d-6b8d-43cd-b5bf-134af097880b could not be found. Jul 20 04:38:23.523151 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:23.524935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9bf753d1-54b9-41b9-8fb9-b5de061f3d53 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Returning 404 to user: Instance 0940158d-6b8d-43cd-b5bf-134af097880b could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:23.526043 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9bf753d1-54b9-41b9-8fb9-b5de061f3d53 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b" status: 404 len: 111 microversion: 2.1 time: 0.050348 Jul 20 04:38:23.526831 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2683/5359] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:23 2022] GET /compute/v2.1/servers/0940158d-6b8d-43cd-b5bf-134af097880b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:23.535524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7f37706-a0d7-41e6-8e21-2d461ffaefdb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:23.536038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b7f37706-a0d7-41e6-8e21-2d461ffaefdb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:23.548854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7f37706-a0d7-41e6-8e21-2d461ffaefdb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:23.549317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7f37706-a0d7-41e6-8e21-2d461ffaefdb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.550115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7f37706-a0d7-41e6-8e21-2d461ffaefdb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:23.550593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7f37706-a0d7-41e6-8e21-2d461ffaefdb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.610112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b7f37706-a0d7-41e6-8e21-2d461ffaefdb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:23.788392 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b7f37706-a0d7-41e6-8e21-2d461ffaefdb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "DELETE /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 204 len: 0 microversion: 2.1 time: 0.254864 Jul 20 04:38:23.791659 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2677/5360] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:23 2022] DELETE /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:23.799917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7fa6d5d6-a696-4173-98f6-a581a7992c3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:23.800659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7fa6d5d6-a696-4173-98f6-a581a7992c3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:23.809416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fa6d5d6-a696-4173-98f6-a581a7992c3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:23.809877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fa6d5d6-a696-4173-98f6-a581a7992c3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.810743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fa6d5d6-a696-4173-98f6-a581a7992c3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:23.811419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fa6d5d6-a696-4173-98f6-a581a7992c3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:24.021457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-253994ca-e2f9-4162-98c6-02a77cc69144 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:24.024889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-253994ca-e2f9-4162-98c6-02a77cc69144 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:24.040381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-253994ca-e2f9-4162-98c6-02a77cc69144 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:24.041335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-253994ca-e2f9-4162-98c6-02a77cc69144 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:24.042157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-253994ca-e2f9-4162-98c6-02a77cc69144 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:24.047501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-253994ca-e2f9-4162-98c6-02a77cc69144 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:24.302757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-253994ca-e2f9-4162-98c6-02a77cc69144 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:24.318584 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-253994ca-e2f9-4162-98c6-02a77cc69144 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1692 microversion: 2.1 time: 0.304555 Jul 20 04:38:24.330408 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2678/5361] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:24 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1692 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:24.396921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7fa6d5d6-a696-4173-98f6-a581a7992c3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:24.405901 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7fa6d5d6-a696-4173-98f6-a581a7992c3e tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1675 microversion: 2.1 time: 0.610147 Jul 20 04:38:24.417917 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2684/5362] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:23 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1675 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:24.914358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b1d575a3-abbc-4321-945b-a66a4e5ad244 req-5a5aa190-7924-4213-871d-d1db0145e0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0239847b-a58e-49a6-9e26-b6d79515a480", "name": "network-vif-unplugged", "status": "completed", "tag": "b4f93a24-77a4-44b6-a57a-31217f7c81d8"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:24.926347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b1d575a3-abbc-4321-945b-a66a4e5ad244 req-5a5aa190-7924-4213-871d-d1db0145e0b6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:24.927286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b1d575a3-abbc-4321-945b-a66a4e5ad244 req-5a5aa190-7924-4213-871d-d1db0145e0b6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:24.971227 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b1d575a3-abbc-4321-945b-a66a4e5ad244 req-5a5aa190-7924-4213-871d-d1db0145e0b6 service nova] Creating event network-vif-unplugged:b4f93a24-77a4-44b6-a57a-31217f7c81d8 for instance 0239847b-a58e-49a6-9e26-b6d79515a480 on n-h2-760456-11 Jul 20 04:38:24.979183 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b1d575a3-abbc-4321-945b-a66a4e5ad244 req-5a5aa190-7924-4213-871d-d1db0145e0b6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.263270 Jul 20 04:38:24.980063 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2679/5363] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:25.337766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9610a691-9bb1-430b-9ec4-c964f5420ae4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:25.338518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9610a691-9bb1-430b-9ec4-c964f5420ae4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:25.366535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9610a691-9bb1-430b-9ec4-c964f5420ae4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:25.367197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9610a691-9bb1-430b-9ec4-c964f5420ae4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.368735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9610a691-9bb1-430b-9ec4-c964f5420ae4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:25.369206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9610a691-9bb1-430b-9ec4-c964f5420ae4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.447430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c11bbb36-f727-4848-b258-d19405c6ba7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:25.448722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c11bbb36-f727-4848-b258-d19405c6ba7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:25.497677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c11bbb36-f727-4848-b258-d19405c6ba7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:25.523649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c11bbb36-f727-4848-b258-d19405c6ba7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.524983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c11bbb36-f727-4848-b258-d19405c6ba7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:25.525727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c11bbb36-f727-4848-b258-d19405c6ba7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:25.830966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c11bbb36-f727-4848-b258-d19405c6ba7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:25.841520 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c11bbb36-f727-4848-b258-d19405c6ba7c tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1675 microversion: 2.1 time: 0.410825 Jul 20 04:38:25.842116 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2680/5364] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:25 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1675 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:26.030833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9610a691-9bb1-430b-9ec4-c964f5420ae4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:26.039198 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9610a691-9bb1-430b-9ec4-c964f5420ae4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1692 microversion: 2.1 time: 0.706096 Jul 20 04:38:26.041261 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2685/5365] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:25 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1692 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:26.682144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34dcfea5-0acf-484a-8005-cab5d3375499 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-568340073", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "aa43acee-7062-474f-94f4-3781096f8961", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:26.826772 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-34dcfea5-0acf-484a-8005-cab5d3375499 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Block Device aa43acee-7062-474f-94f4-3781096f8961 is not bootable. Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34dcfea5-0acf-484a-8005-cab5d3375499 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 357 Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-568340073", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "aa43acee-7062-474f-94f4-3781096f8961", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: exception: Block Device aa43acee-7062-474f-94f4-3781096f8961 is not bootable. Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-568340073', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'aa43acee-7062-474f-94f4-3781096f8961'}], 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device aa43acee-7062-474f-94f4-3781096f8961 is not bootable. Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:26.837237 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device aa43acee-7062-474f-94f4-3781096f8961 is not bootable. Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device aa43acee-7062-474f-94f4-3781096f8961 is not bootable. Jul 20 04:38:26.841688 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:26.843801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34dcfea5-0acf-484a-8005-cab5d3375499 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Block Device aa43acee-7062-474f-94f4-3781096f8961 is not bootable. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:26.845044 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-34dcfea5-0acf-484a-8005-cab5d3375499 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.168073 Jul 20 04:38:26.846123 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2681/5366] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:26 2022] POST /compute/v2.1/servers => generated 110 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:38:26.859465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-af6139b8-3e4d-46a2-bb26-8f23d197a76f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:26.860105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-af6139b8-3e4d-46a2-bb26-8f23d197a76f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:26.864146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bdaa7def-40c9-4e6b-9f79-53266d3552dc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:26.864975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bdaa7def-40c9-4e6b-9f79-53266d3552dc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:26.884137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af6139b8-3e4d-46a2-bb26-8f23d197a76f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:26.884607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af6139b8-3e4d-46a2-bb26-8f23d197a76f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:26.885425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af6139b8-3e4d-46a2-bb26-8f23d197a76f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:26.885878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af6139b8-3e4d-46a2-bb26-8f23d197a76f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:26.888667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdaa7def-40c9-4e6b-9f79-53266d3552dc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:26.889129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdaa7def-40c9-4e6b-9f79-53266d3552dc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:26.889929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdaa7def-40c9-4e6b-9f79-53266d3552dc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:26.894545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdaa7def-40c9-4e6b-9f79-53266d3552dc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.140861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bdaa7def-40c9-4e6b-9f79-53266d3552dc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:27.150023 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bdaa7def-40c9-4e6b-9f79-53266d3552dc tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1607 microversion: 2.1 time: 0.293963 Jul 20 04:38:27.151438 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2682/5367] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:26 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1607 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:27.166078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-bf7fc3be-9328-457f-8ca5-42bb7c71bfb4 req-554289dd-3310-4781-ad2e-7be1ba8c19af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0239847b-a58e-49a6-9e26-b6d79515a480", "tag": "b4f93a24-77a4-44b6-a57a-31217f7c81d8"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:27.198548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:27.199952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-af6139b8-3e4d-46a2-bb26-8f23d197a76f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:27.209665 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-af6139b8-3e4d-46a2-bb26-8f23d197a76f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.359271 Jul 20 04:38:27.210864 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2686/5368] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:26 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:27.211018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bf7fc3be-9328-457f-8ca5-42bb7c71bfb4 req-554289dd-3310-4781-ad2e-7be1ba8c19af service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:27.214460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-bf7fc3be-9328-457f-8ca5-42bb7c71bfb4 req-554289dd-3310-4781-ad2e-7be1ba8c19af service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.222528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4e1ad791-e9f2-45ff-8d10-3c99ee2377f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:27.224411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4e1ad791-e9f2-45ff-8d10-3c99ee2377f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:27.231798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e1ad791-e9f2-45ff-8d10-3c99ee2377f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:27.232780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e1ad791-e9f2-45ff-8d10-3c99ee2377f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.236035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e1ad791-e9f2-45ff-8d10-3c99ee2377f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:27.237317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e1ad791-e9f2-45ff-8d10-3c99ee2377f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.274751 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-bf7fc3be-9328-457f-8ca5-42bb7c71bfb4 req-554289dd-3310-4781-ad2e-7be1ba8c19af service nova] Creating event network-changed:b4f93a24-77a4-44b6-a57a-31217f7c81d8 for instance 0239847b-a58e-49a6-9e26-b6d79515a480 on n-h2-760456-11 Jul 20 04:38:27.285826 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-bf7fc3be-9328-457f-8ca5-42bb7c71bfb4 req-554289dd-3310-4781-ad2e-7be1ba8c19af service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132119 Jul 20 04:38:27.288497 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2683/5369] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:27.300178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dc635481-976b-489a-8cde-295cfa6b7941 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:27.303230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dc635481-976b-489a-8cde-295cfa6b7941 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:27.313249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc635481-976b-489a-8cde-295cfa6b7941 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:27.313972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc635481-976b-489a-8cde-295cfa6b7941 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.315089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc635481-976b-489a-8cde-295cfa6b7941 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:27.315850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc635481-976b-489a-8cde-295cfa6b7941 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.615616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dc635481-976b-489a-8cde-295cfa6b7941 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:27.627251 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dc635481-976b-489a-8cde-295cfa6b7941 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.337492 Jul 20 04:38:27.634409 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2684/5370] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:27 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:27.636388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ef734a06-b248-4478-b181-88b938b8b3b1 req-c841be3a-84e7-4116-a3cb-ef350608346a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b78332-e314-4da3-8a21-1ccfa545f11a", "name": "network-vif-deleted", "tag": "8c4c6b64-e711-449a-a899-27913ed07df2"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:27.673838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ef734a06-b248-4478-b181-88b938b8b3b1 req-c841be3a-84e7-4116-a3cb-ef350608346a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:27.677340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ef734a06-b248-4478-b181-88b938b8b3b1 req-c841be3a-84e7-4116-a3cb-ef350608346a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:27.799308 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ef734a06-b248-4478-b181-88b938b8b3b1 req-c841be3a-84e7-4116-a3cb-ef350608346a service nova] Creating event network-vif-deleted:8c4c6b64-e711-449a-a899-27913ed07df2 for instance 44b78332-e314-4da3-8a21-1ccfa545f11a on n-h2-760456-11 Jul 20 04:38:27.829083 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ef734a06-b248-4478-b181-88b938b8b3b1 req-c841be3a-84e7-4116-a3cb-ef350608346a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198501 Jul 20 04:38:27.843630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2685/5371] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:28.172433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:28.173526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:28.201909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.206686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.209565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.214452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.318532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4e1ad791-e9f2-45ff-8d10-3c99ee2377f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:28.330097 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4e1ad791-e9f2-45ff-8d10-3c99ee2377f5 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1692 microversion: 2.1 time: 1.116474 Jul 20 04:38:28.334526 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2687/5372] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:27 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1692 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:28.349573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:28.353597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:28.354294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lazy-loading 'fault' on Instance uuid 44b78332-e314-4da3-8a21-1ccfa545f11a {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:28.439618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3a58233b2b044d9b1285b616c79f9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81e78714ae4c75a581a7dfeee2b550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:28.456777 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-49daebde-0c8a-46d3-8266-acafd8bdcc41 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 200 len: 1328 microversion: 2.1 time: 0.292092 Jul 20 04:38:28.457464 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2686/5373] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:28 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 1328 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:29.350628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-01986251-8c96-4935-bb1b-3c41d5038866 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:29.351929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-01986251-8c96-4935-bb1b-3c41d5038866 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:29.365482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01986251-8c96-4935-bb1b-3c41d5038866 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:29.370982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01986251-8c96-4935-bb1b-3c41d5038866 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:29.372066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01986251-8c96-4935-bb1b-3c41d5038866 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:29.372706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01986251-8c96-4935-bb1b-3c41d5038866 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:29.418165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:29.474421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5bd2485c-5e6d-40b7-804b-171eb54783cb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:29.475886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5bd2485c-5e6d-40b7-804b-171eb54783cb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] [instance: 44b78332-e314-4da3-8a21-1ccfa545f11a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:29.494610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bd2485c-5e6d-40b7-804b-171eb54783cb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:29.495359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bd2485c-5e6d-40b7-804b-171eb54783cb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:29.496316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bd2485c-5e6d-40b7-804b-171eb54783cb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:29.496913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bd2485c-5e6d-40b7-804b-171eb54783cb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:29.537552 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-5bd2485c-5e6d-40b7-804b-171eb54783cb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] HTTP exception thrown: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a could not be found. Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5bd2485c-5e6d-40b7-804b-171eb54783cb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Request method failure captured: Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a HTTP/1.1 Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14SiUlkQNYk--daNjLwIoEjtsFT5_8UlpOU3P-5mDFLyXSRv-FzhEH1ynPPVEM_64IvlQlWrMD095ewIpF0tstjiya8gbRdB-HqL3UAUp669y1SWiwiBAgJe5VUCMiWH0WBVcOTUefMYnTyIure1GlP0xwZ9qJH3u8xEI1jzCtXBPfQ Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cb81e78714ae4c75a581a7dfeee2b550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: cb81e78714ae4c75a581a7dfeee2b550 Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerActionsTestJSON-1016855078 Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: a3a58233b2b044d9b1285b616c79f9b8 Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerActionsTestJSON-1016855078-project Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a could not be found. Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '44b78332-e314-4da3-8a21-1ccfa545f11a'} Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a could not be found. Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a could not be found. Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:29.540872 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:29.545073 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:29.545073 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:29.545073 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:29.545073 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:29.545073 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:29.545073 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a could not be found. Jul 20 04:38:29.545073 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:29.550970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5bd2485c-5e6d-40b7-804b-171eb54783cb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Returning 404 to user: Instance 44b78332-e314-4da3-8a21-1ccfa545f11a could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:29.553150 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5bd2485c-5e6d-40b7-804b-171eb54783cb tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a" status: 404 len: 111 microversion: 2.1 time: 0.082413 Jul 20 04:38:29.556957 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2687/5374] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:29 2022] GET /compute/v2.1/servers/44b78332-e314-4da3-8a21-1ccfa545f11a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:38:29.579844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0c7180ba-2dfa-4abb-bf11-c03850b44541 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] Calling method '.version_select at 0x7fb841d210d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:29.629391 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0c7180ba-2dfa-4abb-bf11-c03850b44541 tempest-ServerActionsTestJSON-1016855078 tempest-ServerActionsTestJSON-1016855078-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-358498932" status: 202 len: 0 microversion: 2.1 time: 0.055001 Jul 20 04:38:29.630429 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2688/5375] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 04:38:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-358498932 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:29.670119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-01986251-8c96-4935-bb1b-3c41d5038866 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:29.684598 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-01986251-8c96-4935-bb1b-3c41d5038866 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1692 microversion: 2.1 time: 0.337768 Jul 20 04:38:29.685917 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2688/5376] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:29 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1692 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:30.705314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ee846440-dc60-4422-8993-6436e9767e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:30.705954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ee846440-dc60-4422-8993-6436e9767e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:30.714870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee846440-dc60-4422-8993-6436e9767e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:30.715547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee846440-dc60-4422-8993-6436e9767e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:30.716649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee846440-dc60-4422-8993-6436e9767e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:30.717266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee846440-dc60-4422-8993-6436e9767e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:30.718076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1eba7860-a5f3-4e67-95ca-1f300d669aa9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1367743081", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "destination_type": "local"}, {"source_type": "volume", "uuid": "d78e7180-b432-4d19-b49e-be80f0d95956", "destination_type": "invalid"}], "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1eba7860-a5f3-4e67-95ca-1f300d669aa9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 495 Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1367743081", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "destination_type": "local"}, {"source_type": "volume", "uuid": "d78e7180-b432-4d19-b49e-be80f0d95956", "destination_type": "invalid"}], "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1367743081', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd78e7180-b432-4d19-b49e-be80f0d95956', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:30.721148 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1eba7860-a5f3-4e67-95ca-1f300d669aa9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1eba7860-a5f3-4e67-95ca-1f300d669aa9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.008397 Jul 20 04:38:30.724963 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2689/5377] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:30 2022] POST /compute/v2.1/servers => generated 155 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:38:30.733367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c57610d4-d532-4de1-83ce-f670daa52b10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:30.734190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c57610d4-d532-4de1-83ce-f670daa52b10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:30.744773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c57610d4-d532-4de1-83ce-f670daa52b10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:30.745455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c57610d4-d532-4de1-83ce-f670daa52b10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:30.746510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c57610d4-d532-4de1-83ce-f670daa52b10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:30.746951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c57610d4-d532-4de1-83ce-f670daa52b10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.010686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c57610d4-d532-4de1-83ce-f670daa52b10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:31.021339 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c57610d4-d532-4de1-83ce-f670daa52b10 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.293622 Jul 20 04:38:31.026426 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2690/5378] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:30 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:31.035244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ee846440-dc60-4422-8993-6436e9767e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:31.054893 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ee846440-dc60-4422-8993-6436e9767e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1692 microversion: 2.1 time: 0.354194 Jul 20 04:38:31.056341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-64f143eb-4ee2-491d-9578-04c33552be1e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:31.057647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-64f143eb-4ee2-491d-9578-04c33552be1e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:31.062493 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2689/5379] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:30 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1692 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:31.076171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f143eb-4ee2-491d-9578-04c33552be1e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.083585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f143eb-4ee2-491d-9578-04c33552be1e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.096427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f143eb-4ee2-491d-9578-04c33552be1e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.097169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64f143eb-4ee2-491d-9578-04c33552be1e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.446674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-64f143eb-4ee2-491d-9578-04c33552be1e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:31.460955 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-64f143eb-4ee2-491d-9578-04c33552be1e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.418075 Jul 20 04:38:31.464891 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2691/5380] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:31 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:31.570096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4cef34fd-e8ad-42d7-96d4-8ba503aa5028 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1937177581", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4cef34fd-e8ad-42d7-96d4-8ba503aa5028 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 492 Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1937177581", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1937177581', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 20 04:38:31.574725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:38:31.577737 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:31.580958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4cef34fd-e8ad-42d7-96d4-8ba503aa5028 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:31.581624 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4cef34fd-e8ad-42d7-96d4-8ba503aa5028 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.017908 Jul 20 04:38:31.582511 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2690/5381] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:31 2022] POST /compute/v2.1/servers => generated 624 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:38:31.592858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-98d68ffd-8aff-47c3-b85a-1dd1dfd34ea4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:31.593675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-98d68ffd-8aff-47c3-b85a-1dd1dfd34ea4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:31.613245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98d68ffd-8aff-47c3-b85a-1dd1dfd34ea4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.614584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98d68ffd-8aff-47c3-b85a-1dd1dfd34ea4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.616252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98d68ffd-8aff-47c3-b85a-1dd1dfd34ea4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.617096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98d68ffd-8aff-47c3-b85a-1dd1dfd34ea4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.931716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5f1cae25-6119-4c6e-a7ab-dc42a9440910 req-fc81282f-5a4e-420a-8c87-2e6f12de246d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0239847b-a58e-49a6-9e26-b6d79515a480", "name": "network-vif-unplugged", "status": "completed", "tag": "b4f93a24-77a4-44b6-a57a-31217f7c81d8"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:31.953603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5f1cae25-6119-4c6e-a7ab-dc42a9440910 req-fc81282f-5a4e-420a-8c87-2e6f12de246d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:31.954061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5f1cae25-6119-4c6e-a7ab-dc42a9440910 req-fc81282f-5a4e-420a-8c87-2e6f12de246d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:31.971886 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5f1cae25-6119-4c6e-a7ab-dc42a9440910 req-fc81282f-5a4e-420a-8c87-2e6f12de246d service nova] Creating event network-vif-unplugged:b4f93a24-77a4-44b6-a57a-31217f7c81d8 for instance 0239847b-a58e-49a6-9e26-b6d79515a480 on n-h2-760456-11 Jul 20 04:38:31.987274 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5f1cae25-6119-4c6e-a7ab-dc42a9440910 req-fc81282f-5a4e-420a-8c87-2e6f12de246d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062409 Jul 20 04:38:31.987895 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2691/5382] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:32.016243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-98d68ffd-8aff-47c3-b85a-1dd1dfd34ea4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:32.027749 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-98d68ffd-8aff-47c3-b85a-1dd1dfd34ea4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.439779 Jul 20 04:38:32.029824 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2692/5383] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:31 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:32.048294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1b6fe4a0-3427-4183-be4b-a0b969844f0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:32.049296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1b6fe4a0-3427-4183-be4b-a0b969844f0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:32.059266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b6fe4a0-3427-4183-be4b-a0b969844f0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:32.061859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b6fe4a0-3427-4183-be4b-a0b969844f0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:32.063422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b6fe4a0-3427-4183-be4b-a0b969844f0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:32.065809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b6fe4a0-3427-4183-be4b-a0b969844f0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:32.081320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ef0079e5-6d5a-4abb-9c4e-43b4e6e59846 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:32.081948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ef0079e5-6d5a-4abb-9c4e-43b4e6e59846 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:32.100713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef0079e5-6d5a-4abb-9c4e-43b4e6e59846 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:32.101174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef0079e5-6d5a-4abb-9c4e-43b4e6e59846 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:32.102002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef0079e5-6d5a-4abb-9c4e-43b4e6e59846 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:32.103020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef0079e5-6d5a-4abb-9c4e-43b4e6e59846 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:32.519914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1b6fe4a0-3427-4183-be4b-a0b969844f0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:32.529229 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1b6fe4a0-3427-4183-be4b-a0b969844f0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.485549 Jul 20 04:38:32.542998 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2692/5384] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:32 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:32.624925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1a5ad38d-53b4-4ca3-bc78-c8d8f419c66e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1a5ad38d-53b4-4ca3-bc78-c8d8f419c66e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 416 Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:32.627683 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:32.631861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1a5ad38d-53b4-4ca3-bc78-c8d8f419c66e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:32.638657 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1a5ad38d-53b4-4ca3-bc78-c8d8f419c66e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.014568 Jul 20 04:38:32.646843 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2693/5385] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:32 2022] POST /compute/v2.1/servers => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:38:32.666802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cb43e4a7-4f36-4068-9427-207d73f710d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:32.666802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cb43e4a7-4f36-4068-9427-207d73f710d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:32.695842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb43e4a7-4f36-4068-9427-207d73f710d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:32.699957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb43e4a7-4f36-4068-9427-207d73f710d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:32.704804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb43e4a7-4f36-4068-9427-207d73f710d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:32.705444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb43e4a7-4f36-4068-9427-207d73f710d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:33.028492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ef0079e5-6d5a-4abb-9c4e-43b4e6e59846 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:33.039154 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ef0079e5-6d5a-4abb-9c4e-43b4e6e59846 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1692 microversion: 2.1 time: 0.961817 Jul 20 04:38:33.040667 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2693/5386] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:32 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1692 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:33.056758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cb43e4a7-4f36-4068-9427-207d73f710d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:33.068632 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cb43e4a7-4f36-4068-9427-207d73f710d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.418113 Jul 20 04:38:33.069651 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2694/5387] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:32 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:33.087686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83296e3f-0382-4517-8899-f98f88aad4a6 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:33.088473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-83296e3f-0382-4517-8899-f98f88aad4a6 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:33.097371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83296e3f-0382-4517-8899-f98f88aad4a6 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:33.099598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83296e3f-0382-4517-8899-f98f88aad4a6 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:33.100555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83296e3f-0382-4517-8899-f98f88aad4a6 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:33.103849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83296e3f-0382-4517-8899-f98f88aad4a6 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:33.511196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-83296e3f-0382-4517-8899-f98f88aad4a6 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:33.546779 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-83296e3f-0382-4517-8899-f98f88aad4a6 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.460382 Jul 20 04:38:33.562299 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2694/5388] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:33 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:33.630404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73a80088-6235-43f8-82a6-9ed815aef052 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1949346312", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": -1, "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:33.667761 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-73a80088-6235-43f8-82a6-9ed815aef052 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Flavor -1 could not be found. Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73a80088-6235-43f8-82a6-9ed815aef052 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 206 Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1949346312", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": -1, "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: exception: Flavor -1 could not be found. Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1949346312', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': -1, 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:33.673909 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 20 04:38:33.681761 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:33.695267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73a80088-6235-43f8-82a6-9ed815aef052 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:33.696761 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-73a80088-6235-43f8-82a6-9ed815aef052 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.071693 Jul 20 04:38:33.705887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7e8a8ae1-aee6-4752-b332-fa7141540c7d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:33.708645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7e8a8ae1-aee6-4752-b332-fa7141540c7d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:33.722464 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2695/5389] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:33 2022] POST /compute/v2.1/servers => generated 73 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:38:33.724992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e8a8ae1-aee6-4752-b332-fa7141540c7d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:33.725467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e8a8ae1-aee6-4752-b332-fa7141540c7d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:33.727725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e8a8ae1-aee6-4752-b332-fa7141540c7d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:33.728447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7e8a8ae1-aee6-4752-b332-fa7141540c7d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:34.060602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-373514ae-d89a-4a0b-9452-f1ac78c0b26d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:34.063172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-373514ae-d89a-4a0b-9452-f1ac78c0b26d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:34.131208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-373514ae-d89a-4a0b-9452-f1ac78c0b26d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:34.132854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-373514ae-d89a-4a0b-9452-f1ac78c0b26d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:34.134008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-373514ae-d89a-4a0b-9452-f1ac78c0b26d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:34.135448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-373514ae-d89a-4a0b-9452-f1ac78c0b26d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:34.212137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7e8a8ae1-aee6-4752-b332-fa7141540c7d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:34.221994 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7e8a8ae1-aee6-4752-b332-fa7141540c7d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.520053 Jul 20 04:38:34.222625 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2695/5390] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:33 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:34.248596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30803141-c1cf-470c-8920-fb1921751d82 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:34.249602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-30803141-c1cf-470c-8920-fb1921751d82 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:34.271782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30803141-c1cf-470c-8920-fb1921751d82 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:34.272031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30803141-c1cf-470c-8920-fb1921751d82 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:34.275591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30803141-c1cf-470c-8920-fb1921751d82 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:34.276066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30803141-c1cf-470c-8920-fb1921751d82 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:34.476357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-373514ae-d89a-4a0b-9452-f1ac78c0b26d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:34.494417 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-373514ae-d89a-4a0b-9452-f1ac78c0b26d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1692 microversion: 2.1 time: 0.440672 Jul 20 04:38:34.496196 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2696/5391] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:34 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1692 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:34.523202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-30803141-c1cf-470c-8920-fb1921751d82 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:34.544459 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-30803141-c1cf-470c-8920-fb1921751d82 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.301280 Jul 20 04:38:34.545068 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2696/5392] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:34 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:34.634537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eaad23d3-47c4-4a14-99fb-734dce559177 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1099071917", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eaad23d3-47c4-4a14-99fb-734dce559177 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 173 Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1099071917", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1099071917', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi -1 Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:38:34.637619 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:38:34.642616 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:34.644709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eaad23d3-47c4-4a14-99fb-734dce559177 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:34.650498 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eaad23d3-47c4-4a14-99fb-734dce559177 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.021229 Jul 20 04:38:34.651683 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2697/5393] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:34 2022] POST /compute/v2.1/servers => generated 145 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:38:34.660228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7aec5f93-adce-4557-838c-2c97eb7bc21d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:34.660855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7aec5f93-adce-4557-838c-2c97eb7bc21d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:34.677837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aec5f93-adce-4557-838c-2c97eb7bc21d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:34.678588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aec5f93-adce-4557-838c-2c97eb7bc21d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:34.679560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aec5f93-adce-4557-838c-2c97eb7bc21d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:34.680278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aec5f93-adce-4557-838c-2c97eb7bc21d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:35.084176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7aec5f93-adce-4557-838c-2c97eb7bc21d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:35.104461 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7aec5f93-adce-4557-838c-2c97eb7bc21d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.448707 Jul 20 04:38:35.105582 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2697/5394] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:34 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:35.127809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a71a2a00-284d-4217-b266-aaef52dcef78 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:35.130709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a71a2a00-284d-4217-b266-aaef52dcef78 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:35.141921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a71a2a00-284d-4217-b266-aaef52dcef78 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:35.142551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a71a2a00-284d-4217-b266-aaef52dcef78 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:35.144001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a71a2a00-284d-4217-b266-aaef52dcef78 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:35.145494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a71a2a00-284d-4217-b266-aaef52dcef78 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:35.182525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:35.513221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6d1928e9-005c-4f69-94a7-b556ab325e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:35.513851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6d1928e9-005c-4f69-94a7-b556ab325e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:35.521671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d1928e9-005c-4f69-94a7-b556ab325e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:35.526377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d1928e9-005c-4f69-94a7-b556ab325e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:35.527416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d1928e9-005c-4f69-94a7-b556ab325e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:35.528122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d1928e9-005c-4f69-94a7-b556ab325e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:35.592312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a71a2a00-284d-4217-b266-aaef52dcef78 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:35.603414 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a71a2a00-284d-4217-b266-aaef52dcef78 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.483433 Jul 20 04:38:35.612354 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2698/5395] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:35 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:35.682293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-88cf3b5a-e62c-4ad4-9b5b-7a413137dd5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-407805046", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:35.686823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-88cf3b5a-e62c-4ad4-9b5b-7a413137dd5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-88cf3b5a-e62c-4ad4-9b5b-7a413137dd5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 215 Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-407805046", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-407805046', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:35.689290 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:35.693756 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:35.693756 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:35.693756 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:35.693756 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:35.693756 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:35.693756 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:38:35.693756 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:35.696456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-88cf3b5a-e62c-4ad4-9b5b-7a413137dd5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:35.697845 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-88cf3b5a-e62c-4ad4-9b5b-7a413137dd5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.022449 Jul 20 04:38:35.703254 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2699/5396] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:35 2022] POST /compute/v2.1/servers => generated 123 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:38:35.711445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e5c2655e-ad3a-4111-b118-69030b84fe98 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:35.718620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e5c2655e-ad3a-4111-b118-69030b84fe98 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:35.737607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5c2655e-ad3a-4111-b118-69030b84fe98 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:35.751579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5c2655e-ad3a-4111-b118-69030b84fe98 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:35.761983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5c2655e-ad3a-4111-b118-69030b84fe98 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:35.762710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5c2655e-ad3a-4111-b118-69030b84fe98 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:36.188704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e5c2655e-ad3a-4111-b118-69030b84fe98 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:36.203155 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e5c2655e-ad3a-4111-b118-69030b84fe98 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.498451 Jul 20 04:38:36.206280 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2700/5397] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:35 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:36.225616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-69c0581d-b240-4bee-a24a-f58ba438ebdc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:36.226241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-69c0581d-b240-4bee-a24a-f58ba438ebdc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:36.252555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69c0581d-b240-4bee-a24a-f58ba438ebdc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:36.253025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69c0581d-b240-4bee-a24a-f58ba438ebdc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:36.253829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69c0581d-b240-4bee-a24a-f58ba438ebdc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:36.254295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69c0581d-b240-4bee-a24a-f58ba438ebdc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:36.438138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6d1928e9-005c-4f69-94a7-b556ab325e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:36.452013 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6d1928e9-005c-4f69-94a7-b556ab325e34 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1682 microversion: 2.1 time: 0.943048 Jul 20 04:38:36.452946 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2698/5398] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:35 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1682 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:36.468825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a320254f-8def-4fc9-9a38-cdf8ba226822 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:36.469464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a320254f-8def-4fc9-9a38-cdf8ba226822 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:36.477711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a320254f-8def-4fc9-9a38-cdf8ba226822 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:36.477965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a320254f-8def-4fc9-9a38-cdf8ba226822 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:36.478804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a320254f-8def-4fc9-9a38-cdf8ba226822 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:36.479258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a320254f-8def-4fc9-9a38-cdf8ba226822 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:36.785452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-69c0581d-b240-4bee-a24a-f58ba438ebdc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:36.790763 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a320254f-8def-4fc9-9a38-cdf8ba226822 tempest-TestNetworkAdvancedServerOps-450905254 tempest-TestNetworkAdvancedServerOps-450905254-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1835 microversion: 2.1 time: 0.325201 Jul 20 04:38:36.801247 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-69c0581d-b240-4bee-a24a-f58ba438ebdc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.579243 Jul 20 04:38:36.821237 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2699/5400] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:36 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1835 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:36.821428 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2701/5400] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:36 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:36.829095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e21c9b22-8a98-4d22-a32c-1fa0a13f0ca8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:36.831709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e21c9b22-8a98-4d22-a32c-1fa0a13f0ca8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:36.847333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e21c9b22-8a98-4d22-a32c-1fa0a13f0ca8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:36.850977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e21c9b22-8a98-4d22-a32c-1fa0a13f0ca8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:36.852840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e21c9b22-8a98-4d22-a32c-1fa0a13f0ca8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:36.853462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e21c9b22-8a98-4d22-a32c-1fa0a13f0ca8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:36.888527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b70c4eb9-243a-45f4-a0d9-1fa48d9bf239 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2080380183", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "key_name": "tempest-key-997534239", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:37.012869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-b70c4eb9-243a-45f4-a0d9-1fa48d9bf239 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] validate_networks() for [('c3e4c87c-518b-4f6d-a7ce-a98932e29370', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:38:37.202196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e21c9b22-8a98-4d22-a32c-1fa0a13f0ca8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:37.210982 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e21c9b22-8a98-4d22-a32c-1fa0a13f0ca8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1682 microversion: 2.1 time: 0.388241 Jul 20 04:38:37.228216 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2700/5401] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:36 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1682 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:37.335336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-956bc7ce-6374-451d-aee2-c428d6390988 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:37.337210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-956bc7ce-6374-451d-aee2-c428d6390988 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:37.347188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-956bc7ce-6374-451d-aee2-c428d6390988 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:37.348135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-956bc7ce-6374-451d-aee2-c428d6390988 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:37.351222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-956bc7ce-6374-451d-aee2-c428d6390988 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:37.352571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-956bc7ce-6374-451d-aee2-c428d6390988 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:37.504935 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-956bc7ce-6374-451d-aee2-c428d6390988 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480/action" status: 200 len: 38642 microversion: 2.1 time: 0.173407 Jul 20 04:38:37.506373 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2701/5402] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:37 2022] POST /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480/action => generated 38642 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:37.785619 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-b70c4eb9-243a-45f4-a0d9-1fa48d9bf239 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Invalid key_name provided. Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b70c4eb9-243a-45f4-a0d9-1fa48d9bf239 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 246 Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2080380183", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "key_name": "tempest-key-997534239", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid key_name provided. Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2080380183', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'key_name': 'tempest-key-997534239', 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-997534239 not found for user e80638aab82d450fb148f8d963b8747e Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:37.789127 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:37.796317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b70c4eb9-243a-45f4-a0d9-1fa48d9bf239 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid key_name provided. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:37.798148 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b70c4eb9-243a-45f4-a0d9-1fa48d9bf239 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.914944 Jul 20 04:38:37.803003 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2702/5403] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:36 2022] POST /compute/v2.1/servers => generated 70 bytes in 922 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:38:37.808160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cc04971c-127e-4cda-973e-9b64492499fa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:37.808874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cc04971c-127e-4cda-973e-9b64492499fa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:37.816636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc04971c-127e-4cda-973e-9b64492499fa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:37.817092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc04971c-127e-4cda-973e-9b64492499fa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:37.818998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc04971c-127e-4cda-973e-9b64492499fa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:37.819534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc04971c-127e-4cda-973e-9b64492499fa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:38.399575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cc04971c-127e-4cda-973e-9b64492499fa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:38.410927 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cc04971c-127e-4cda-973e-9b64492499fa tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.606998 Jul 20 04:38:38.420136 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2702/5404] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:37 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:38.446928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bf4b699b-0aac-4002-90c7-41d76b1751ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:38.447583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bf4b699b-0aac-4002-90c7-41d76b1751ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:38.475522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf4b699b-0aac-4002-90c7-41d76b1751ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:38.476226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf4b699b-0aac-4002-90c7-41d76b1751ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:38.481112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf4b699b-0aac-4002-90c7-41d76b1751ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:38.482475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf4b699b-0aac-4002-90c7-41d76b1751ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:38.970183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bf4b699b-0aac-4002-90c7-41d76b1751ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:38.979111 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bf4b699b-0aac-4002-90c7-41d76b1751ef tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.544070 Jul 20 04:38:38.981410 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2703/5405] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:38 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:39.076238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c900022-32a0-42f2-870b-3ad0b3d23998 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-446665963", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:39.410580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.security_group_api [None req-9c900022-32a0-42f2-870b-3ad0b3d23998 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Neutron security group does_not_exist not found {{(pid=119606) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 20 04:38:39.411329 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-9c900022-32a0-42f2-870b-3ad0b3d23998 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c900022-32a0-42f2-870b-3ad0b3d23998 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 257 Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-446665963", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-446665963', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 20 04:38:39.419611 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:39.423518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c900022-32a0-42f2-870b-3ad0b3d23998 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:39.426970 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9c900022-32a0-42f2-870b-3ad0b3d23998 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.349568 Jul 20 04:38:39.426970 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2703/5406] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:39 2022] POST /compute/v2.1/servers => generated 106 bytes in 351 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:38:39.430397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-048a7dfd-3621-459c-8c2b-5918502c9ceb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:39.431040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-048a7dfd-3621-459c-8c2b-5918502c9ceb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:39.446070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-048a7dfd-3621-459c-8c2b-5918502c9ceb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:39.446661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-048a7dfd-3621-459c-8c2b-5918502c9ceb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:39.447517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-048a7dfd-3621-459c-8c2b-5918502c9ceb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:39.447972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-048a7dfd-3621-459c-8c2b-5918502c9ceb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:39.744496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b298ab4b-47d4-499a-9cf4-869e909dddd6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:39.745532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b298ab4b-47d4-499a-9cf4-869e909dddd6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:39.756924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b298ab4b-47d4-499a-9cf4-869e909dddd6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:39.758858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b298ab4b-47d4-499a-9cf4-869e909dddd6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:39.770876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b298ab4b-47d4-499a-9cf4-869e909dddd6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:39.774846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b298ab4b-47d4-499a-9cf4-869e909dddd6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:39.845061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b298ab4b-47d4-499a-9cf4-869e909dddd6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:39.994426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-048a7dfd-3621-459c-8c2b-5918502c9ceb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:40.006021 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-048a7dfd-3621-459c-8c2b-5918502c9ceb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.577034 Jul 20 04:38:40.006949 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2704/5407] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:39 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:40.017709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-7e00f879-0220-4167-84ad-8a11cb81545a req-5c824372-4c38-4324-a5a5-a35a44c54bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0239847b-a58e-49a6-9e26-b6d79515a480", "tag": "b4f93a24-77a4-44b6-a57a-31217f7c81d8"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:40.038340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7e00f879-0220-4167-84ad-8a11cb81545a req-5c824372-4c38-4324-a5a5-a35a44c54bbd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:40.040624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7e00f879-0220-4167-84ad-8a11cb81545a req-5c824372-4c38-4324-a5a5-a35a44c54bbd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:40.045686 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b298ab4b-47d4-499a-9cf4-869e909dddd6 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 204 len: 0 microversion: 2.1 time: 0.305650 Jul 20 04:38:40.049774 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2704/5408] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:39 2022] DELETE /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:38:40.061980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc2dc73e-30aa-4396-bd87-0062df80680c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:40.063722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc2dc73e-30aa-4396-bd87-0062df80680c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:40.072874 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-7e00f879-0220-4167-84ad-8a11cb81545a req-5c824372-4c38-4324-a5a5-a35a44c54bbd service nova] Creating event network-changed:b4f93a24-77a4-44b6-a57a-31217f7c81d8 for instance 0239847b-a58e-49a6-9e26-b6d79515a480 on n-h1-760456-11 Jul 20 04:38:40.076351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:40.082436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc2dc73e-30aa-4396-bd87-0062df80680c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:40.084287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc2dc73e-30aa-4396-bd87-0062df80680c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:40.086801 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-7e00f879-0220-4167-84ad-8a11cb81545a req-5c824372-4c38-4324-a5a5-a35a44c54bbd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073572 Jul 20 04:38:40.087259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc2dc73e-30aa-4396-bd87-0062df80680c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:40.087670 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2705/5409] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:40.088924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc2dc73e-30aa-4396-bd87-0062df80680c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:40.101375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-adee87d3-5917-477c-bd37-f29001c7b5aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:40.108345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-adee87d3-5917-477c-bd37-f29001c7b5aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:40.141651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adee87d3-5917-477c-bd37-f29001c7b5aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:40.151717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adee87d3-5917-477c-bd37-f29001c7b5aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:40.154859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adee87d3-5917-477c-bd37-f29001c7b5aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:40.155332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adee87d3-5917-477c-bd37-f29001c7b5aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:40.633636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-adee87d3-5917-477c-bd37-f29001c7b5aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:40.652231 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-adee87d3-5917-477c-bd37-f29001c7b5aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1688 microversion: 2.1 time: 0.563056 Jul 20 04:38:40.664495 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2706/5410] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:40 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1688 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:40.920196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc2dc73e-30aa-4396-bd87-0062df80680c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:40.924422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:40.936090 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc2dc73e-30aa-4396-bd87-0062df80680c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.880514 Jul 20 04:38:40.938814 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2705/5411] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:40 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:40.959551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56a284bc-c066-49ff-997e-a55baffec20d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:40.960115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-56a284bc-c066-49ff-997e-a55baffec20d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 34a9c442-33b8-40b6-9ade-e23762f19ea3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:40.969101 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-56a284bc-c066-49ff-997e-a55baffec20d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 34a9c442-33b8-40b6-9ade-e23762f19ea3 could not be found. Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56a284bc-c066-49ff-997e-a55baffec20d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/34a9c442-33b8-40b6-9ade-e23762f19ea3 HTTP/1.1 Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 34a9c442-33b8-40b6-9ade-e23762f19ea3 could not be found. Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '34a9c442-33b8-40b6-9ade-e23762f19ea3'} Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a9c442-33b8-40b6-9ade-e23762f19ea3 could not be found. Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a9c442-33b8-40b6-9ade-e23762f19ea3 could not be found. Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:40.982752 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:40.990885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:40.990885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:40.990885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:40.990885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:40.990885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:40.990885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a9c442-33b8-40b6-9ade-e23762f19ea3 could not be found. Jul 20 04:38:40.990885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:40.990885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56a284bc-c066-49ff-997e-a55baffec20d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 34a9c442-33b8-40b6-9ade-e23762f19ea3 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:40.990885 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-56a284bc-c066-49ff-997e-a55baffec20d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "DELETE /compute/v2.1/servers/34a9c442-33b8-40b6-9ade-e23762f19ea3" status: 404 len: 111 microversion: 2.1 time: 0.029965 Jul 20 04:38:40.990885 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2707/5412] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:40 2022] DELETE /compute/v2.1/servers/34a9c442-33b8-40b6-9ade-e23762f19ea3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:41.010343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-77d535ee-e2ef-404e-b0e9-7a55fd68c631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:41.012527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-77d535ee-e2ef-404e-b0e9-7a55fd68c631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:41.047479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77d535ee-e2ef-404e-b0e9-7a55fd68c631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:41.048208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77d535ee-e2ef-404e-b0e9-7a55fd68c631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:41.052017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77d535ee-e2ef-404e-b0e9-7a55fd68c631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:41.052648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77d535ee-e2ef-404e-b0e9-7a55fd68c631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:41.682663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d4b0034-4dc0-423d-b80e-f75b9db5f464 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:41.683929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d4b0034-4dc0-423d-b80e-f75b9db5f464 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:41.728031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d4b0034-4dc0-423d-b80e-f75b9db5f464 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:41.728573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d4b0034-4dc0-423d-b80e-f75b9db5f464 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:41.729412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d4b0034-4dc0-423d-b80e-f75b9db5f464 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:41.732054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d4b0034-4dc0-423d-b80e-f75b9db5f464 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:41.772815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-77d535ee-e2ef-404e-b0e9-7a55fd68c631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:41.786679 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-77d535ee-e2ef-404e-b0e9-7a55fd68c631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.791888 Jul 20 04:38:41.800311 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2706/5413] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:40 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:41.817854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6ca48ccb-7f99-48a8-9acc-40ca8a7459a7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:41.821813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6ca48ccb-7f99-48a8-9acc-40ca8a7459a7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:41.843442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ca48ccb-7f99-48a8-9acc-40ca8a7459a7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:41.853582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ca48ccb-7f99-48a8-9acc-40ca8a7459a7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:41.857112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ca48ccb-7f99-48a8-9acc-40ca8a7459a7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:41.857579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ca48ccb-7f99-48a8-9acc-40ca8a7459a7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:42.035883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d4b0034-4dc0-423d-b80e-f75b9db5f464 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:42.058467 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d4b0034-4dc0-423d-b80e-f75b9db5f464 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 200 len: 1620 microversion: 2.1 time: 0.379794 Jul 20 04:38:42.070510 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2708/5414] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:41 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 1620 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:42.111160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f9787e00-a149-4dbc-a203-27bf910ecbb9 req-4ecf2ff1-57f5-4d7a-87da-80815f1dcf1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0239847b-a58e-49a6-9e26-b6d79515a480", "name": "network-vif-deleted", "tag": "b4f93a24-77a4-44b6-a57a-31217f7c81d8"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:42.140297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f9787e00-a149-4dbc-a203-27bf910ecbb9 req-4ecf2ff1-57f5-4d7a-87da-80815f1dcf1d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:42.140781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f9787e00-a149-4dbc-a203-27bf910ecbb9 req-4ecf2ff1-57f5-4d7a-87da-80815f1dcf1d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:42.185968 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f9787e00-a149-4dbc-a203-27bf910ecbb9 req-4ecf2ff1-57f5-4d7a-87da-80815f1dcf1d service nova] Creating event network-vif-deleted:b4f93a24-77a4-44b6-a57a-31217f7c81d8 for instance 0239847b-a58e-49a6-9e26-b6d79515a480 on n-h1-760456-11 Jul 20 04:38:42.193195 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f9787e00-a149-4dbc-a203-27bf910ecbb9 req-4ecf2ff1-57f5-4d7a-87da-80815f1dcf1d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119269 Jul 20 04:38:42.193823 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2709/5415] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:42.222355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6ca48ccb-7f99-48a8-9acc-40ca8a7459a7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:42.234057 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6ca48ccb-7f99-48a8-9acc-40ca8a7459a7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.425059 Jul 20 04:38:42.235278 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2707/5416] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:41 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:42.253643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45c9841f-42d5-49cd-8054-60d1cf9f0a19 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:42.255117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-45c9841f-42d5-49cd-8054-60d1cf9f0a19 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:38:42.255875 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-45c9841f-42d5-49cd-8054-60d1cf9f0a19 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45c9841f-42d5-49cd-8054-60d1cf9f0a19 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 9223372036854775808 could not be found. Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '9223372036854775808'} Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:42.257856 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:42.262943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:42.262943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:42.262943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:42.262943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 20 04:38:42.262943 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:42.264442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45c9841f-42d5-49cd-8054-60d1cf9f0a19 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:42.265918 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-45c9841f-42d5-49cd-8054-60d1cf9f0a19 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.017722 Jul 20 04:38:42.273242 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2710/5417] 10.222.0.59 () {58 vars in 1187 bytes} [Wed Jul 20 04:38:42 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:38:42.281096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-85be6b05-5fd0-40c9-9c2d-87049d2ed674 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:42.281896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-85be6b05-5fd0-40c9-9c2d-87049d2ed674 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:42.297884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85be6b05-5fd0-40c9-9c2d-87049d2ed674 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:42.301120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85be6b05-5fd0-40c9-9c2d-87049d2ed674 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:42.302472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85be6b05-5fd0-40c9-9c2d-87049d2ed674 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:42.303054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85be6b05-5fd0-40c9-9c2d-87049d2ed674 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:42.622687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-85be6b05-5fd0-40c9-9c2d-87049d2ed674 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:42.635219 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-85be6b05-5fd0-40c9-9c2d-87049d2ed674 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.360012 Jul 20 04:38:42.642761 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2708/5418] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:42 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:42.665535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a0f1f23f-511a-4e91-8139-f2ff1535b8d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:42.666642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a0f1f23f-511a-4e91-8139-f2ff1535b8d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:42.686580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0f1f23f-511a-4e91-8139-f2ff1535b8d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:42.687737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0f1f23f-511a-4e91-8139-f2ff1535b8d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:42.688692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0f1f23f-511a-4e91-8139-f2ff1535b8d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:42.693296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a0f1f23f-511a-4e91-8139-f2ff1535b8d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:43.018477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a0f1f23f-511a-4e91-8139-f2ff1535b8d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:43.029527 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a0f1f23f-511a-4e91-8139-f2ff1535b8d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.368260 Jul 20 04:38:43.044368 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2711/5419] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:42 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:43.048648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-61196038-92a7-4351-bd64-f68a71324c93 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:43.049266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-61196038-92a7-4351-bd64-f68a71324c93 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Failed to fetch instance by id -1 {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:38:43.050300 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-61196038-92a7-4351-bd64-f68a71324c93 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance -1 could not be found. Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-61196038-92a7-4351-bd64-f68a71324c93 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance -1 could not be found. Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '-1'} Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:43.052354 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:43.057929 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:43.057929 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:43.057929 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 20 04:38:43.057929 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:43.057929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-61196038-92a7-4351-bd64-f68a71324c93 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:43.059431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-61196038-92a7-4351-bd64-f68a71324c93 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.015473 Jul 20 04:38:43.061771 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2709/5420] 10.222.0.59 () {58 vars in 1136 bytes} [Wed Jul 20 04:38:43 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:38:43.071310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-da32617d-f74a-4679-9de2-02d9e0c96a0b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:43.072698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-da32617d-f74a-4679-9de2-02d9e0c96a0b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:43.087628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6c860ce-5478-4475-923c-466fc99723b8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:43.088362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d6c860ce-5478-4475-923c-466fc99723b8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 0239847b-a58e-49a6-9e26-b6d79515a480] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:43.099730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da32617d-f74a-4679-9de2-02d9e0c96a0b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:43.100131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6c860ce-5478-4475-923c-466fc99723b8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:43.100381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da32617d-f74a-4679-9de2-02d9e0c96a0b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:43.100708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6c860ce-5478-4475-923c-466fc99723b8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:43.101683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6c860ce-5478-4475-923c-466fc99723b8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:43.102460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da32617d-f74a-4679-9de2-02d9e0c96a0b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:43.102821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6c860ce-5478-4475-923c-466fc99723b8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:43.103609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-da32617d-f74a-4679-9de2-02d9e0c96a0b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:43.174483 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d6c860ce-5478-4475-923c-466fc99723b8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] HTTP exception thrown: Instance 0239847b-a58e-49a6-9e26-b6d79515a480 could not be found. Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6c860ce-5478-4475-923c-466fc99723b8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Request method failure captured: Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 HTTP/1.1 Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14UK5JrQIbQ4DeMrb4AGON-It-xq1HUlcS1_w91iY9qX9BKMuqasTROhXwJnYYXL1FDMvpvHevyFT98KP_rG1E4C2KjxwioZKHqAupgnDNOBVhKjLYq21w0dkR-FwoM0QcIMxRYXi6rjnAGtO1rszx2hLyQfwkkhBDqwPm7fq7NZS_Y Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: c92a62f7017e4b8f8bbeb960856d1e20 Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: c92a62f7017e4b8f8bbeb960856d1e20 Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestNetworkAdvancedServerOps-1362507395-project Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 8f84ec28420a4cdcb88920cd86ce0160 Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1362507395-project Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 0239847b-a58e-49a6-9e26-b6d79515a480 could not be found. Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '0239847b-a58e-49a6-9e26-b6d79515a480'} Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0239847b-a58e-49a6-9e26-b6d79515a480 could not be found. Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0239847b-a58e-49a6-9e26-b6d79515a480 could not be found. Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:43.179126 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:43.185662 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:43.185662 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:43.185662 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:43.185662 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:43.185662 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:43.185662 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:43.185662 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0239847b-a58e-49a6-9e26-b6d79515a480 could not be found. Jul 20 04:38:43.185662 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:43.187265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6c860ce-5478-4475-923c-466fc99723b8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Returning 404 to user: Instance 0239847b-a58e-49a6-9e26-b6d79515a480 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:43.190812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d6c860ce-5478-4475-923c-466fc99723b8 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480" status: 404 len: 111 microversion: 2.1 time: 0.115022 Jul 20 04:38:43.192503 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2710/5421] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:43 2022] GET /compute/v2.1/servers/0239847b-a58e-49a6-9e26-b6d79515a480 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:43.602795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-da32617d-f74a-4679-9de2-02d9e0c96a0b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:43.611338 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-da32617d-f74a-4679-9de2-02d9e0c96a0b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.544613 Jul 20 04:38:43.630874 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2712/5422] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:43 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:43.640679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2f24eac5-1487-4a64-90da-e3c0e6f8c666 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:43.641280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f24eac5-1487-4a64-90da-e3c0e6f8c666 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:43.655555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f24eac5-1487-4a64-90da-e3c0e6f8c666 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:43.656023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f24eac5-1487-4a64-90da-e3c0e6f8c666 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:43.656827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f24eac5-1487-4a64-90da-e3c0e6f8c666 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:43.657282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f24eac5-1487-4a64-90da-e3c0e6f8c666 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:44.211112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2f24eac5-1487-4a64-90da-e3c0e6f8c666 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:44.220592 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2f24eac5-1487-4a64-90da-e3c0e6f8c666 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.588614 Jul 20 04:38:44.224010 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2711/5423] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:43 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:44.241023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b3b4a8a-e784-4e4f-be14-49be299909e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:44.242876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b3b4a8a-e784-4e4f-be14-49be299909e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 7f12da45-62bd-4d78-b8fa-993a17933220] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:44.250846 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-7b3b4a8a-e784-4e4f-be14-49be299909e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 7f12da45-62bd-4d78-b8fa-993a17933220 could not be found. Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b3b4a8a-e784-4e4f-be14-49be299909e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/7f12da45-62bd-4d78-b8fa-993a17933220/action HTTP/1.1 Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 19 Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: {"forceDelete": {}} Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 7f12da45-62bd-4d78-b8fa-993a17933220 could not be found. Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7f12da45-62bd-4d78-b8fa-993a17933220', 'body': {'forceDelete': {}}} Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f12da45-62bd-4d78-b8fa-993a17933220 could not be found. Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f12da45-62bd-4d78-b8fa-993a17933220 could not be found. Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:44.255381 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:44.260247 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:44.260247 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:44.260247 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f12da45-62bd-4d78-b8fa-993a17933220 could not be found. Jul 20 04:38:44.260247 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:44.263474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b3b4a8a-e784-4e4f-be14-49be299909e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 7f12da45-62bd-4d78-b8fa-993a17933220 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:44.266237 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b3b4a8a-e784-4e4f-be14-49be299909e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/7f12da45-62bd-4d78-b8fa-993a17933220/action" status: 404 len: 111 microversion: 2.1 time: 0.029182 Jul 20 04:38:44.282989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ed52f2c8-fc99-4de6-9941-97f146de727a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:44.283892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ed52f2c8-fc99-4de6-9941-97f146de727a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:44.304228 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2713/5424] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:44 2022] POST /compute/v2.1/servers/7f12da45-62bd-4d78-b8fa-993a17933220/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:44.310342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed52f2c8-fc99-4de6-9941-97f146de727a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:44.314099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed52f2c8-fc99-4de6-9941-97f146de727a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:44.319555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed52f2c8-fc99-4de6-9941-97f146de727a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:44.320331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed52f2c8-fc99-4de6-9941-97f146de727a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:44.909043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ed52f2c8-fc99-4de6-9941-97f146de727a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:44.925447 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ed52f2c8-fc99-4de6-9941-97f146de727a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.648881 Jul 20 04:38:44.938365 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2712/5425] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:44 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:44.948484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-18ffc3e3-4461-4a14-8dca-61ce1a41769b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:44.949339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-18ffc3e3-4461-4a14-8dca-61ce1a41769b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:44.969122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18ffc3e3-4461-4a14-8dca-61ce1a41769b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:44.972645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18ffc3e3-4461-4a14-8dca-61ce1a41769b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:44.973674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18ffc3e3-4461-4a14-8dca-61ce1a41769b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:44.975539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-18ffc3e3-4461-4a14-8dca-61ce1a41769b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:45.487179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-18ffc3e3-4461-4a14-8dca-61ce1a41769b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:45.500534 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-18ffc3e3-4461-4a14-8dca-61ce1a41769b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.553725 Jul 20 04:38:45.502942 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2714/5426] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:44 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:45.530208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cda31286-e214-4b57-86b3-53b9284cd11f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:45.533958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cda31286-e214-4b57-86b3-53b9284cd11f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 94075e8f-dbe6-4592-b539-4a2529403c2a] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:45.550359 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-cda31286-e214-4b57-86b3-53b9284cd11f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 94075e8f-dbe6-4592-b539-4a2529403c2a could not be found. Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cda31286-e214-4b57-86b3-53b9284cd11f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/94075e8f-dbe6-4592-b539-4a2529403c2a/action HTTP/1.1 Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 39 Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: {"os-getConsoleOutput": {"length": 10}} Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 94075e8f-dbe6-4592-b539-4a2529403c2a could not be found. Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '94075e8f-dbe6-4592-b539-4a2529403c2a', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94075e8f-dbe6-4592-b539-4a2529403c2a could not be found. Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94075e8f-dbe6-4592-b539-4a2529403c2a could not be found. Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:45.558065 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:45.562220 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:45.562220 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:45.562220 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:45.562220 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:45.562220 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94075e8f-dbe6-4592-b539-4a2529403c2a could not be found. Jul 20 04:38:45.562220 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:45.562220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cda31286-e214-4b57-86b3-53b9284cd11f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 94075e8f-dbe6-4592-b539-4a2529403c2a could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:45.562220 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cda31286-e214-4b57-86b3-53b9284cd11f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/94075e8f-dbe6-4592-b539-4a2529403c2a/action" status: 404 len: 111 microversion: 2.1 time: 0.042410 Jul 20 04:38:45.562220 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2713/5427] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:45 2022] POST /compute/v2.1/servers/94075e8f-dbe6-4592-b539-4a2529403c2a/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:45.571097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f165289-66ac-4765-a0c8-7a921b947ff7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:45.571729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0f165289-66ac-4765-a0c8-7a921b947ff7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:45.580535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f165289-66ac-4765-a0c8-7a921b947ff7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:45.580994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f165289-66ac-4765-a0c8-7a921b947ff7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:45.587247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f165289-66ac-4765-a0c8-7a921b947ff7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:45.587247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f165289-66ac-4765-a0c8-7a921b947ff7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.894341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0f165289-66ac-4765-a0c8-7a921b947ff7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:46.907464 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0f165289-66ac-4765-a0c8-7a921b947ff7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 1.341470 Jul 20 04:38:46.914994 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2715/5428] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:45 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:46.929179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ba130a28-b203-4826-910d-7e8a7acf21ac tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:46.930469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ba130a28-b203-4826-910d-7e8a7acf21ac tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:46.946662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba130a28-b203-4826-910d-7e8a7acf21ac tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.947140 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba130a28-b203-4826-910d-7e8a7acf21ac tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.948861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba130a28-b203-4826-910d-7e8a7acf21ac tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.950902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba130a28-b203-4826-910d-7e8a7acf21ac tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:47.257177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ba130a28-b203-4826-910d-7e8a7acf21ac tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:47.271655 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ba130a28-b203-4826-910d-7e8a7acf21ac tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.346273 Jul 20 04:38:47.272589 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2714/5429] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:46 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:47.292316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d7b73cd-0cd9-48c4-9076-3e04764eaa92 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:47.292872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d7b73cd-0cd9-48c4-9076-3e04764eaa92 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 00158dcc-3015-4972-b075-c7515df63f45] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:47.307310 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-6d7b73cd-0cd9-48c4-9076-3e04764eaa92 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 00158dcc-3015-4972-b075-c7515df63f45 could not be found. Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d7b73cd-0cd9-48c4-9076-3e04764eaa92 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/00158dcc-3015-4972-b075-c7515df63f45 HTTP/1.1 Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 00158dcc-3015-4972-b075-c7515df63f45 could not be found. Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '00158dcc-3015-4972-b075-c7515df63f45'} Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00158dcc-3015-4972-b075-c7515df63f45 could not be found. Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00158dcc-3015-4972-b075-c7515df63f45 could not be found. Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:47.311657 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:47.316538 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:47.316538 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:47.316538 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:47.316538 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00158dcc-3015-4972-b075-c7515df63f45 could not be found. Jul 20 04:38:47.316538 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:47.316538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d7b73cd-0cd9-48c4-9076-3e04764eaa92 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 00158dcc-3015-4972-b075-c7515df63f45 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:47.319434 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d7b73cd-0cd9-48c4-9076-3e04764eaa92 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/00158dcc-3015-4972-b075-c7515df63f45" status: 404 len: 111 microversion: 2.1 time: 0.029428 Jul 20 04:38:47.325327 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2716/5430] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:47 2022] GET /compute/v2.1/servers/00158dcc-3015-4972-b075-c7515df63f45 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:47.330676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-80c71850-f780-461c-9486-360e1a3fa1bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:47.331634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-80c71850-f780-461c-9486-360e1a3fa1bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:47.346702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80c71850-f780-461c-9486-360e1a3fa1bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:47.347177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80c71850-f780-461c-9486-360e1a3fa1bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:47.348689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80c71850-f780-461c-9486-360e1a3fa1bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:47.349184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80c71850-f780-461c-9486-360e1a3fa1bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:47.983434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-80c71850-f780-461c-9486-360e1a3fa1bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:47.994282 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-80c71850-f780-461c-9486-360e1a3fa1bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.667419 Jul 20 04:38:47.997797 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2715/5431] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:47 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:48.020403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e11457f3-59f0-49f1-a373-58b359121105 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:48.021700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e11457f3-59f0-49f1-a373-58b359121105 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:48.047598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e11457f3-59f0-49f1-a373-58b359121105 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.048511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e11457f3-59f0-49f1-a373-58b359121105 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.050981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e11457f3-59f0-49f1-a373-58b359121105 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.051649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e11457f3-59f0-49f1-a373-58b359121105 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.869263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e11457f3-59f0-49f1-a373-58b359121105 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.901130 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e11457f3-59f0-49f1-a373-58b359121105 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.884932 Jul 20 04:38:48.901781 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2717/5432] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:48 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:49.158526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea202a25-5bcb-43c7-81fb-d9bf0b8ec963 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1676066287", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea202a25-5bcb-43c7-81fb-d9bf0b8ec963 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 238 Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1676066287", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1676066287', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:38:49.162478 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea202a25-5bcb-43c7-81fb-d9bf0b8ec963 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea202a25-5bcb-43c7-81fb-d9bf0b8ec963 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009574 Jul 20 04:38:49.169914 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2716/5433] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:38:49.175470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf12748c-889f-458b-8fda-bd62704e7f45 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:49.176104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cf12748c-889f-458b-8fda-bd62704e7f45 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:49.184652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf12748c-889f-458b-8fda-bd62704e7f45 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.190541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf12748c-889f-458b-8fda-bd62704e7f45 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.191729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf12748c-889f-458b-8fda-bd62704e7f45 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.193360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf12748c-889f-458b-8fda-bd62704e7f45 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.701655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cf12748c-889f-458b-8fda-bd62704e7f45 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:49.715290 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf12748c-889f-458b-8fda-bd62704e7f45 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.545277 Jul 20 04:38:49.720293 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2718/5434] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:49 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:49.741389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c01218f-e88f-4f2e-9811-b580b4e851bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:49.742698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2c01218f-e88f-4f2e-9811-b580b4e851bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:49.771074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c01218f-e88f-4f2e-9811-b580b4e851bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.771549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c01218f-e88f-4f2e-9811-b580b4e851bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.772357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c01218f-e88f-4f2e-9811-b580b4e851bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.772812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c01218f-e88f-4f2e-9811-b580b4e851bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.184050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38d13ca5-ad62-4b41-870d-3435df8118fe tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:50.184672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-38d13ca5-ad62-4b41-870d-3435df8118fe tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:50.213433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38d13ca5-ad62-4b41-870d-3435df8118fe tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.214731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38d13ca5-ad62-4b41-870d-3435df8118fe tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.215635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38d13ca5-ad62-4b41-870d-3435df8118fe tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.218354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38d13ca5-ad62-4b41-870d-3435df8118fe tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.315060 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-38d13ca5-ad62-4b41-870d-3435df8118fe tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/ips" status: 200 len: 150 microversion: 2.1 time: 0.135550 Jul 20 04:38:50.323305 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2719/5435] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:38:50 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/ips => generated 150 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:50.371179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c01218f-e88f-4f2e-9811-b580b4e851bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.387620 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c01218f-e88f-4f2e-9811-b580b4e851bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.650826 Jul 20 04:38:50.388859 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2717/5436] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:49 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:50.607631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3ae3a15d-a7e7-48a0-bd50-34e3fdb3e7e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-301318676", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3ae3a15d-a7e7-48a0-bd50-34e3fdb3e7e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 234 Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-301318676", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-301318676', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:50.630416 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:38:50.636981 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:50.642049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3ae3a15d-a7e7-48a0-bd50-34e3fdb3e7e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:50.643433 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3ae3a15d-a7e7-48a0-bd50-34e3fdb3e7e8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.043635 Jul 20 04:38:50.644504 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2720/5437] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:50 2022] POST /compute/v2.1/servers => generated 133 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:38:50.653164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ba3eff3d-1623-4d52-9172-13c84285c4c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:50.654284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ba3eff3d-1623-4d52-9172-13c84285c4c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:50.680603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba3eff3d-1623-4d52-9172-13c84285c4c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.681074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba3eff3d-1623-4d52-9172-13c84285c4c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.681880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba3eff3d-1623-4d52-9172-13c84285c4c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.682364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ba3eff3d-1623-4d52-9172-13c84285c4c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:51.493124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ba3eff3d-1623-4d52-9172-13c84285c4c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:51.518355 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ba3eff3d-1623-4d52-9172-13c84285c4c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.868708 Jul 20 04:38:51.520547 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2718/5438] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:50 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:51.544798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-784e10ea-5ac8-404c-9e50-f60f9f216c49 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:51.546793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-784e10ea-5ac8-404c-9e50-f60f9f216c49 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:51.576428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-784e10ea-5ac8-404c-9e50-f60f9f216c49 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.577099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-784e10ea-5ac8-404c-9e50-f60f9f216c49 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:51.580184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-784e10ea-5ac8-404c-9e50-f60f9f216c49 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.580940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-784e10ea-5ac8-404c-9e50-f60f9f216c49 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:52.047828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-784e10ea-5ac8-404c-9e50-f60f9f216c49 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:52.067580 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-784e10ea-5ac8-404c-9e50-f60f9f216c49 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.528791 Jul 20 04:38:52.071331 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2721/5439] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:51 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:52.089047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c421679-014d-4045-9643-dfafe7d78464 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:52.089600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5c421679-014d-4045-9643-dfafe7d78464 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: f04b08b7-6737-4bd0-8b79-c2077ae67301] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:52.098888 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5c421679-014d-4045-9643-dfafe7d78464 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance f04b08b7-6737-4bd0-8b79-c2077ae67301 could not be found. Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c421679-014d-4045-9643-dfafe7d78464 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/f04b08b7-6737-4bd0-8b79-c2077ae67301/action HTTP/1.1 Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 13 Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: {"pause": {}} Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance f04b08b7-6737-4bd0-8b79-c2077ae67301 could not be found. Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'f04b08b7-6737-4bd0-8b79-c2077ae67301', 'body': {'pause': {}}} Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04b08b7-6737-4bd0-8b79-c2077ae67301 could not be found. Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04b08b7-6737-4bd0-8b79-c2077ae67301 could not be found. Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:52.106657 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:52.111196 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:52.111196 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:52.111196 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04b08b7-6737-4bd0-8b79-c2077ae67301 could not be found. Jul 20 04:38:52.111196 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:52.112635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c421679-014d-4045-9643-dfafe7d78464 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance f04b08b7-6737-4bd0-8b79-c2077ae67301 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:52.113683 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5c421679-014d-4045-9643-dfafe7d78464 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/f04b08b7-6737-4bd0-8b79-c2077ae67301/action" status: 404 len: 111 microversion: 2.1 time: 0.029679 Jul 20 04:38:52.114629 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2719/5440] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:52 2022] POST /compute/v2.1/servers/f04b08b7-6737-4bd0-8b79-c2077ae67301/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:52.126713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35701df3-c675-4138-8172-0050862aab5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:52.129448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-35701df3-c675-4138-8172-0050862aab5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:52.137214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35701df3-c675-4138-8172-0050862aab5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:52.146375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35701df3-c675-4138-8172-0050862aab5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:52.147359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35701df3-c675-4138-8172-0050862aab5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:52.147821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35701df3-c675-4138-8172-0050862aab5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:52.515320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-35701df3-c675-4138-8172-0050862aab5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:52.531096 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-35701df3-c675-4138-8172-0050862aab5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.411363 Jul 20 04:38:52.552679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3360944-4491-4663-9e23-c993622836c9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:52.553270 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2722/5441] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:52 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:52.555943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d3360944-4491-4663-9e23-c993622836c9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:52.573942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3360944-4491-4663-9e23-c993622836c9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:52.575407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3360944-4491-4663-9e23-c993622836c9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:52.576325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3360944-4491-4663-9e23-c993622836c9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:52.576882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3360944-4491-4663-9e23-c993622836c9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.233157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d3360944-4491-4663-9e23-c993622836c9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:53.252625 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d3360944-4491-4663-9e23-c993622836c9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.697242 Jul 20 04:38:53.255499 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2720/5442] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:52 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:53.275845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-250caa93-0928-4c40-ab1a-a6803420790b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:53.276397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-250caa93-0928-4c40-ab1a-a6803420790b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:53.289607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-250caa93-0928-4c40-ab1a-a6803420790b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.290387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-250caa93-0928-4c40-ab1a-a6803420790b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.298537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-250caa93-0928-4c40-ab1a-a6803420790b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.299254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-250caa93-0928-4c40-ab1a-a6803420790b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.332680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:53.358862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-505ba5ed-c4ef-41b3-97e5-74554a5727b4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '.version_select at 0x7fb840fc8b80>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:53.391628 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-505ba5ed-c4ef-41b3-97e5-74554a5727b4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2100508762" status: 202 len: 0 microversion: 2.1 time: 0.037921 Jul 20 04:38:53.392520 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2721/5443] 10.222.0.59 () {58 vars in 1283 bytes} [Wed Jul 20 04:38:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2100508762 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:53.434237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-20e75933-a20d-4c7f-a37a-10e9249cd496 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'create', calling method: .version_select at 0x7fb840e3b4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-457533471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFxyBqq7z/Hb/RzmBCHC9GdACCDrMk5Xt3mEvMXrSLDgdxcWuppBM9lBlj+38o5dwSRkwMyCYn+BW0GD1uVL1k+jpbh7KNqGHX8tlhe3Ik1F0ZuGHtDbCbK1MrahrERpA=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:53.480702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-20e75933-a20d-4c7f-a37a-10e9249cd496 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:53.512303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-20e75933-a20d-4c7f-a37a-10e9249cd496 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for user 8f84ec28420a4cdcb88920cd86ce0160 and project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:53.515921 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-250caa93-0928-4c40-ab1a-a6803420790b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 202 len: 0 microversion: 2.1 time: 0.244533 Jul 20 04:38:53.524326 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2723/5444] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:53 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:53.533754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-28974449-8630-4f27-b614-c4fc1682df7f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:53.534900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-28974449-8630-4f27-b614-c4fc1682df7f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:53.544057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28974449-8630-4f27-b614-c4fc1682df7f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.544503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28974449-8630-4f27-b614-c4fc1682df7f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.576197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28974449-8630-4f27-b614-c4fc1682df7f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.576197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28974449-8630-4f27-b614-c4fc1682df7f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.591817 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-20e75933-a20d-4c7f-a37a-10e9249cd496 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.162327 Jul 20 04:38:53.595719 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2722/5445] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:38:53 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:53.693044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8314dcea-1dee-46c9-a7e8-18862ba77658 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89de4aa7-d32f-4c39-996d-385767e28c21"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:53.694842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8314dcea-1dee-46c9-a7e8-18862ba77658 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:53.707804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8314dcea-1dee-46c9-a7e8-18862ba77658 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.708864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8314dcea-1dee-46c9-a7e8-18862ba77658 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.710511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8314dcea-1dee-46c9-a7e8-18862ba77658 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.713486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8314dcea-1dee-46c9-a7e8-18862ba77658 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.842389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-28974449-8630-4f27-b614-c4fc1682df7f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:53.859234 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-28974449-8630-4f27-b614-c4fc1682df7f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1511 microversion: 2.1 time: 0.331189 Jul 20 04:38:53.864946 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2724/5446] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:53 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:54.350919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eaf75e92-1cc2-419b-8f2c-827b418a8d29 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Action: 'create', calling method: .version_select at 0x7fb841d8e160>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-799956461", "policies": ["affinity"]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:54.395280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-eaf75e92-1cc2-419b-8f2c-827b418a8d29 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:54.412846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-eaf75e92-1cc2-419b-8f2c-827b418a8d29 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:54.501628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-eaf75e92-1cc2-419b-8f2c-827b418a8d29 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:54.509420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:54.512239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-eaf75e92-1cc2-419b-8f2c-827b418a8d29 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:54.522569 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8314dcea-1dee-46c9-a7e8-18862ba77658 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "POST /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833665 Jul 20 04:38:54.525186 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2723/5447] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:38:53 2022] POST /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:54.537826 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eaf75e92-1cc2-419b-8f2c-827b418a8d29 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.544615 Jul 20 04:38:54.539783 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2725/5448] 10.222.0.59 () {60 vars in 1173 bytes} [Wed Jul 20 04:38:53 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:54.549892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e3c28d4c-3863-498d-9d0d-0000779eae6c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Action: 'create', calling method: .version_select at 0x7fb840e3bc10>, body: {"server_group": {"name": "tempest-server-group-2079110740", "policies": ["affinity"]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:54.603348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e3c28d4c-3863-498d-9d0d-0000779eae6c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:54.613648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e3c28d4c-3863-498d-9d0d-0000779eae6c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:54.730999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e3c28d4c-3863-498d-9d0d-0000779eae6c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:54.741612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e3c28d4c-3863-498d-9d0d-0000779eae6c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:54.784865 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e3c28d4c-3863-498d-9d0d-0000779eae6c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.239571 Jul 20 04:38:54.785987 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2724/5449] 10.222.0.59 () {60 vars in 1172 bytes} [Wed Jul 20 04:38:54 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:54.798838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-af2ef03a-23a9-4860-bbdb-f424c3fdb45c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Action: 'create', calling method: .version_select at 0x7fb841b6cb80>, body: {"server_group": {"name": "tempest-server-group-2079110740", "policies": ["affinity"]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:54.839494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-af2ef03a-23a9-4860-bbdb-f424c3fdb45c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:54.871545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-af2ef03a-23a9-4860-bbdb-f424c3fdb45c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:54.882152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3ee8092b-d8c9-4aa4-8c63-c69bd0421a89 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:54.884173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3ee8092b-d8c9-4aa4-8c63-c69bd0421a89 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:54.909799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3ee8092b-d8c9-4aa4-8c63-c69bd0421a89 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.920290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3ee8092b-d8c9-4aa4-8c63-c69bd0421a89 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:54.921365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3ee8092b-d8c9-4aa4-8c63-c69bd0421a89 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.922000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3ee8092b-d8c9-4aa4-8c63-c69bd0421a89 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:55.028670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-af2ef03a-23a9-4860-bbdb-f424c3fdb45c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:55.034638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-af2ef03a-23a9-4860-bbdb-f424c3fdb45c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:55.059451 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-af2ef03a-23a9-4860-bbdb-f424c3fdb45c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.266802 Jul 20 04:38:55.060079 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2726/5450] 10.222.0.59 () {60 vars in 1172 bytes} [Wed Jul 20 04:38:54 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:55.080980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ed41db37-0593-4b05-908e-64daf1895146 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:55.115674 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ed41db37-0593-4b05-908e-64daf1895146 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/694e1b23-4f87-419f-b895-d89609398cb8" status: 204 len: 0 microversion: 2.1 time: 0.041838 Jul 20 04:38:55.118778 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2727/5451] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:38:55 2022] DELETE /compute/v2.1/os-server-groups/694e1b23-4f87-419f-b895-d89609398cb8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:55.130455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ed4e9801-1cb1-4452-ac1b-1de54158948a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:55.147561 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ed4e9801-1cb1-4452-ac1b-1de54158948a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.024515 Jul 20 04:38:55.154664 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2728/5452] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:38:55 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:55.161509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-791c67e5-6c6f-45a1-944d-1cbc89710661 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:55.199579 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-791c67e5-6c6f-45a1-944d-1cbc89710661 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/ede70c5e-755b-4d76-a93e-bfd39040e5f6" status: 204 len: 0 microversion: 2.1 time: 0.043540 Jul 20 04:38:55.207993 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2729/5453] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:38:55 2022] DELETE /compute/v2.1/os-server-groups/ede70c5e-755b-4d76-a93e-bfd39040e5f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:55.213682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d21bac4a-93c8-4c2f-8cac-bd5af2fe7e8e tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:55.223956 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d21bac4a-93c8-4c2f-8cac-bd5af2fe7e8e tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014746 Jul 20 04:38:55.224744 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2730/5454] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:38:55 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:55.239975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-68298bbf-6c8d-4652-bb02-91ec5cd00fbb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Action: 'create', calling method: .version_select at 0x7fb841c52430>, body: {"server_group": {"name": "tempest-server-group-322407485", "policies": ["affinity"]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:55.261659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-68298bbf-6c8d-4652-bb02-91ec5cd00fbb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:55.280517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3ee8092b-d8c9-4aa4-8c63-c69bd0421a89 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:55.286577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-68298bbf-6c8d-4652-bb02-91ec5cd00fbb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:55.297413 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3ee8092b-d8c9-4aa4-8c63-c69bd0421a89 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1491 microversion: 2.1 time: 0.416431 Jul 20 04:38:55.298079 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2725/5455] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:54 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1491 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:55.323069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a03dcd6b-1ed7-4512-ae29-3d2e236ec4db tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:55.323632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a03dcd6b-1ed7-4512-ae29-3d2e236ec4db tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:55.354053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a03dcd6b-1ed7-4512-ae29-3d2e236ec4db tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:55.364295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a03dcd6b-1ed7-4512-ae29-3d2e236ec4db tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:55.371799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a03dcd6b-1ed7-4512-ae29-3d2e236ec4db tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:55.372577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a03dcd6b-1ed7-4512-ae29-3d2e236ec4db tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:55.444598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-68298bbf-6c8d-4652-bb02-91ec5cd00fbb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:55.453223 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a03dcd6b-1ed7-4512-ae29-3d2e236ec4db tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Cannot 'pause' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state paused Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a03dcd6b-1ed7-4512-ae29-3d2e236ec4db tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action HTTP/1.1 Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 13 Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: {"pause": {}} Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: exception: Cannot 'pause' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state paused Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02', 'body': {'pause': {}}} Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 in vm_state paused. Cannot pause while the instance is in this state. Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state paused Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:55.459207 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:55.466516 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:55.466516 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:55.466516 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:55.466516 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state paused Jul 20 04:38:55.466516 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:55.466516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a03dcd6b-1ed7-4512-ae29-3d2e236ec4db tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 409 to user: Cannot 'pause' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state paused {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:55.467975 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a03dcd6b-1ed7-4512-ae29-3d2e236ec4db tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 409 len: 143 microversion: 2.1 time: 0.154233 Jul 20 04:38:55.468606 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2726/5456] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:55 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 143 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:38:55.472310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-68298bbf-6c8d-4652-bb02-91ec5cd00fbb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:55.480270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-783a0f7e-5dde-464c-8fcb-cc5823b1864a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:55.482391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-783a0f7e-5dde-464c-8fcb-cc5823b1864a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:55.514597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-783a0f7e-5dde-464c-8fcb-cc5823b1864a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:55.517086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-783a0f7e-5dde-464c-8fcb-cc5823b1864a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:55.519802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-783a0f7e-5dde-464c-8fcb-cc5823b1864a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:55.520795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-783a0f7e-5dde-464c-8fcb-cc5823b1864a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:55.533557 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-68298bbf-6c8d-4652-bb02-91ec5cd00fbb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.275604 Jul 20 04:38:55.534383 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2731/5457] 10.222.0.59 () {60 vars in 1172 bytes} [Wed Jul 20 04:38:55 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:55.553738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-42b998fb-b103-4f87-8efc-ab6989b65985 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:55.619557 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-42b998fb-b103-4f87-8efc-ab6989b65985 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/a9c49a7e-89de-4482-a12a-30cfa73899ad" status: 204 len: 0 microversion: 2.1 time: 0.071232 Jul 20 04:38:55.620974 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2732/5458] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:38:55 2022] DELETE /compute/v2.1/os-server-groups/a9c49a7e-89de-4482-a12a-30cfa73899ad => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:55.633284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b0b2a8ea-c113-4c33-90f0-3470f869e55b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:55.655442 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b0b2a8ea-c113-4c33-90f0-3470f869e55b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029855 Jul 20 04:38:55.659755 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2733/5459] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:38:55 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:55.670426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7d90b548-0352-4573-9e84-6831ed2156fb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Action: 'create', calling method: .version_select at 0x7fb841378ee0>, body: {"server_group": {"name": "tempest-server-group-734849036", "policies": ["anti-affinity"]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:55.710803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-7d90b548-0352-4573-9e84-6831ed2156fb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:55.725987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-7d90b548-0352-4573-9e84-6831ed2156fb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:55.747590 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-783a0f7e-5dde-464c-8fcb-cc5823b1864a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 202 len: 0 microversion: 2.1 time: 0.272784 Jul 20 04:38:55.752913 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2727/5460] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:55 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:38:55.773997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d06c74c6-e64b-48da-8b72-24a7ecbd6782 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:55.776171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d06c74c6-e64b-48da-8b72-24a7ecbd6782 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:55.783839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:55.798421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d06c74c6-e64b-48da-8b72-24a7ecbd6782 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:55.799166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d06c74c6-e64b-48da-8b72-24a7ecbd6782 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:55.814363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d06c74c6-e64b-48da-8b72-24a7ecbd6782 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:55.815498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d06c74c6-e64b-48da-8b72-24a7ecbd6782 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:55.821651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:55.856900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-7d90b548-0352-4573-9e84-6831ed2156fb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:55.866631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-7d90b548-0352-4573-9e84-6831ed2156fb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_groups'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:55.928072 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7d90b548-0352-4573-9e84-6831ed2156fb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.257902 Jul 20 04:38:55.930576 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2734/5461] 10.222.0.59 () {60 vars in 1172 bytes} [Wed Jul 20 04:38:55 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:38:55.951679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ae72b38f-315f-4127-bac7-cacba605ca57 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:56.032815 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ae72b38f-315f-4127-bac7-cacba605ca57 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/792103f0-a61e-4793-afb1-1f3a6eeb6e57" status: 204 len: 0 microversion: 2.1 time: 0.096190 Jul 20 04:38:56.039567 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2735/5462] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:38:55 2022] DELETE /compute/v2.1/os-server-groups/792103f0-a61e-4793-afb1-1f3a6eeb6e57 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:56.054828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bb44497-2e05-45d5-9dfd-ae12d06bf07a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:56.076083 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6bb44497-2e05-45d5-9dfd-ae12d06bf07a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034475 Jul 20 04:38:56.078237 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2736/5463] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:38:56 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:56.382058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1054424149", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "9c5d2e04-4353-4886-bbdf-32cc60b3792e"}]}, "os:scheduler_hints": {"group": "bd5cb975-94bb-439b-812b-cccbb2801a2e"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:56.518856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] validate_networks() for [('9c5d2e04-4353-4886-bbdf-32cc60b3792e', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:38:56.585128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d06c74c6-e64b-48da-8b72-24a7ecbd6782 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:56.599245 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d06c74c6-e64b-48da-8b72-24a7ecbd6782 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1498 microversion: 2.1 time: 0.842630 Jul 20 04:38:56.614635 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2728/5464] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:55 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1498 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:57.520438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:57.521020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:57.521330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:57.521747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:57.522166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:57.555516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.556011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.556848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.557273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.608096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:57.615499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:57.617497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ed80cec9-7d72-437b-8723-bcf809717f14 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:57.618106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ed80cec9-7d72-437b-8723-bcf809717f14 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:57.641336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed80cec9-7d72-437b-8723-bcf809717f14 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.642459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed80cec9-7d72-437b-8723-bcf809717f14 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.644430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed80cec9-7d72-437b-8723-bcf809717f14 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.645083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed80cec9-7d72-437b-8723-bcf809717f14 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.646788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:38:57.651673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:38:57.813748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:57.829206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:57.888328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ed80cec9-7d72-437b-8723-bcf809717f14 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:57.902436 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ed80cec9-7d72-437b-8723-bcf809717f14 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.289353 Jul 20 04:38:57.916066 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2729/5465] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:57 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:57.920211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:57.924317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-27ce0325-3624-4058-82e4-d13e504beb03 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:57.926177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-27ce0325-3624-4058-82e4-d13e504beb03 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:57.933249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Getting quotas for user db4c52d3efd84040a15ce7c21b03ca0b and project 175a1c6c46ff4f97879bb56fdb9d42a5. Resources: {'server_group_members'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:57.934371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27ce0325-3624-4058-82e4-d13e504beb03 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.935041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27ce0325-3624-4058-82e4-d13e504beb03 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.937077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27ce0325-3624-4058-82e4-d13e504beb03 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.937833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-27ce0325-3624-4058-82e4-d13e504beb03 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.067646 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-22e2a481-30d7-44ad-b373-1cd12054d071 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689907 Jul 20 04:38:58.069233 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2737/5466] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:38:58.092111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01111406-ba78-42b7-b3d6-2efc39fda74a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:58.092856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-01111406-ba78-42b7-b3d6-2efc39fda74a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:58.378568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-01111406-ba78-42b7-b3d6-2efc39fda74a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:58.396093 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01111406-ba78-42b7-b3d6-2efc39fda74a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1213 microversion: 2.1 time: 0.319761 Jul 20 04:38:58.404000 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2738/5467] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:58 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1213 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:58.456973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-27ce0325-3624-4058-82e4-d13e504beb03 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:58.481433 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-27ce0325-3624-4058-82e4-d13e504beb03 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.561046 Jul 20 04:38:58.484650 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2730/5468] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:57 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:58.501532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e1649af-beb0-44a3-ad79-0b1105437755 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:58.502747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6e1649af-beb0-44a3-ad79-0b1105437755 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:58.516903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e1649af-beb0-44a3-ad79-0b1105437755 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.517417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e1649af-beb0-44a3-ad79-0b1105437755 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.518236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e1649af-beb0-44a3-ad79-0b1105437755 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.522642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e1649af-beb0-44a3-ad79-0b1105437755 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.565876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-6e1649af-beb0-44a3-ad79-0b1105437755 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e1649af-beb0-44a3-ad79-0b1105437755 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4/action HTTP/1.1 Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 28 Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: {"reboot": {"type": "SOFT"}} Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '98a88e64-633c-4a24-b3b6-8246ba0759d4', 'body': {'reboot': {'type': 'SOFT'}}} Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:58.570479 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:38:58.575655 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:38:58.583803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e1649af-beb0-44a3-ad79-0b1105437755 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:58.585010 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6e1649af-beb0-44a3-ad79-0b1105437755 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4/action" status: 404 len: 111 microversion: 2.1 time: 0.087986 Jul 20 04:38:58.586571 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2739/5469] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:58 2022] POST /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:58.596066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c7639ba9-83df-4d96-bf39-2f0631871247 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:58.597298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c7639ba9-83df-4d96-bf39-2f0631871247 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:58.609856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7639ba9-83df-4d96-bf39-2f0631871247 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.612055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7639ba9-83df-4d96-bf39-2f0631871247 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.615124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7639ba9-83df-4d96-bf39-2f0631871247 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.617388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7639ba9-83df-4d96-bf39-2f0631871247 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.810471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c7639ba9-83df-4d96-bf39-2f0631871247 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:58.823406 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c7639ba9-83df-4d96-bf39-2f0631871247 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.231385 Jul 20 04:38:58.824019 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2731/5470] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:58 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:58.841410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-610f563c-d393-4372-9c00-4c9023a06d6a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:58.842185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-610f563c-d393-4372-9c00-4c9023a06d6a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:58.852734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-610f563c-d393-4372-9c00-4c9023a06d6a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.853205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-610f563c-d393-4372-9c00-4c9023a06d6a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.854010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-610f563c-d393-4372-9c00-4c9023a06d6a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.854511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-610f563c-d393-4372-9c00-4c9023a06d6a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:59.420599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17173591-0099-493a-aef9-213d5253edfa tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:59.421480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-17173591-0099-493a-aef9-213d5253edfa tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:59.532131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-17173591-0099-493a-aef9-213d5253edfa tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:59.542596 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-17173591-0099-493a-aef9-213d5253edfa tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1213 microversion: 2.1 time: 0.126277 Jul 20 04:38:59.543656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-610f563c-d393-4372-9c00-4c9023a06d6a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:59.552756 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2732/5471] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:59 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:59.553529 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-610f563c-d393-4372-9c00-4c9023a06d6a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.716111 Jul 20 04:38:59.559846 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2740/5472] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:58 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:59.579532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5aacaf31-49dd-4718-aece-82d628c6ef4b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:59.580962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5aacaf31-49dd-4718-aece-82d628c6ef4b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 13c9ddce-b08d-48eb-8d9b-60f5008012b6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:59.588580 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5aacaf31-49dd-4718-aece-82d628c6ef4b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 13c9ddce-b08d-48eb-8d9b-60f5008012b6 could not be found. Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5aacaf31-49dd-4718-aece-82d628c6ef4b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/13c9ddce-b08d-48eb-8d9b-60f5008012b6/action HTTP/1.1 Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 28 Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: {"reboot": {"type": "SOFT"}} Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 13c9ddce-b08d-48eb-8d9b-60f5008012b6 could not be found. Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '13c9ddce-b08d-48eb-8d9b-60f5008012b6', 'body': {'reboot': {'type': 'SOFT'}}} Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c9ddce-b08d-48eb-8d9b-60f5008012b6 could not be found. Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c9ddce-b08d-48eb-8d9b-60f5008012b6 could not be found. Jul 20 04:38:59.590643 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:59.596001 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:59.596001 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:59.596001 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:59.596001 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:59.596001 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:59.596001 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:59.596001 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:59.596001 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c9ddce-b08d-48eb-8d9b-60f5008012b6 could not be found. Jul 20 04:38:59.596001 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:38:59.596001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5aacaf31-49dd-4718-aece-82d628c6ef4b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 13c9ddce-b08d-48eb-8d9b-60f5008012b6 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:59.596854 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5aacaf31-49dd-4718-aece-82d628c6ef4b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/13c9ddce-b08d-48eb-8d9b-60f5008012b6/action" status: 404 len: 111 microversion: 2.1 time: 0.021889 Jul 20 04:38:59.607212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5891ed12-48fe-4286-93b3-44fb4960bdde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:59.608061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5891ed12-48fe-4286-93b3-44fb4960bdde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:59.611252 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2733/5473] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:59 2022] POST /compute/v2.1/servers/13c9ddce-b08d-48eb-8d9b-60f5008012b6/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:59.615994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5891ed12-48fe-4286-93b3-44fb4960bdde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:59.616562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5891ed12-48fe-4286-93b3-44fb4960bdde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:59.618309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5891ed12-48fe-4286-93b3-44fb4960bdde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:59.618999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5891ed12-48fe-4286-93b3-44fb4960bdde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.511553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5891ed12-48fe-4286-93b3-44fb4960bdde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:00.522345 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5891ed12-48fe-4286-93b3-44fb4960bdde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.919822 Jul 20 04:39:00.523685 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2741/5474] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:59 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:00.564101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2f00ea56-a4cb-4a09-96f8-91b73d0a2447 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:00.565528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f00ea56-a4cb-4a09-96f8-91b73d0a2447 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:00.573695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-85ea3fa6-7226-4abc-98f5-10961ed72872 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:00.578316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-85ea3fa6-7226-4abc-98f5-10961ed72872 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:00.586374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f00ea56-a4cb-4a09-96f8-91b73d0a2447 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.589663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f00ea56-a4cb-4a09-96f8-91b73d0a2447 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.592293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f00ea56-a4cb-4a09-96f8-91b73d0a2447 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.593727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f00ea56-a4cb-4a09-96f8-91b73d0a2447 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.596649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85ea3fa6-7226-4abc-98f5-10961ed72872 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.600587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85ea3fa6-7226-4abc-98f5-10961ed72872 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.603372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85ea3fa6-7226-4abc-98f5-10961ed72872 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.605019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85ea3fa6-7226-4abc-98f5-10961ed72872 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.842152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-85ea3fa6-7226-4abc-98f5-10961ed72872 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:00.852404 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-85ea3fa6-7226-4abc-98f5-10961ed72872 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1283 microversion: 2.1 time: 0.283076 Jul 20 04:39:00.865680 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2742/5475] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:00 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1283 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:01.176352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2f00ea56-a4cb-4a09-96f8-91b73d0a2447 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:01.186294 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2f00ea56-a4cb-4a09-96f8-91b73d0a2447 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.642842 Jul 20 04:39:01.187621 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2734/5476] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:00 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:01.204470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f85b7e7-5bc6-4182-90b7-54a6b787ba2c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:01.206165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8f85b7e7-5bc6-4182-90b7-54a6b787ba2c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:01.214243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f85b7e7-5bc6-4182-90b7-54a6b787ba2c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.214947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f85b7e7-5bc6-4182-90b7-54a6b787ba2c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.215904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f85b7e7-5bc6-4182-90b7-54a6b787ba2c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.216684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f85b7e7-5bc6-4182-90b7-54a6b787ba2c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.234514 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8f85b7e7-5bc6-4182-90b7-54a6b787ba2c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f85b7e7-5bc6-4182-90b7-54a6b787ba2c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4/action HTTP/1.1 Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 65 Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '98a88e64-633c-4a24-b3b6-8246ba0759d4', 'body': {'rebuild': {'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b'}}} Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:39:01.236476 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:39:01.240817 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:01.244370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f85b7e7-5bc6-4182-90b7-54a6b787ba2c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:01.245458 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8f85b7e7-5bc6-4182-90b7-54a6b787ba2c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4/action" status: 404 len: 111 microversion: 2.1 time: 0.045684 Jul 20 04:39:01.255153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-15175241-d4ab-4625-85b1-55dabf501e5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:01.256109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-15175241-d4ab-4625-85b1-55dabf501e5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:01.262471 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2743/5477] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:01 2022] POST /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:01.264684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15175241-d4ab-4625-85b1-55dabf501e5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.265346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15175241-d4ab-4625-85b1-55dabf501e5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.266427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15175241-d4ab-4625-85b1-55dabf501e5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.267176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15175241-d4ab-4625-85b1-55dabf501e5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.518069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-15175241-d4ab-4625-85b1-55dabf501e5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:01.529976 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-15175241-d4ab-4625-85b1-55dabf501e5f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.278815 Jul 20 04:39:01.531566 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2735/5478] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:01 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:01.553594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6194263-a523-4192-b344-86a663ccb1bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:01.556106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e6194263-a523-4192-b344-86a663ccb1bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:01.564740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6194263-a523-4192-b344-86a663ccb1bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.565597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6194263-a523-4192-b344-86a663ccb1bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.566708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6194263-a523-4192-b344-86a663ccb1bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.569996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6194263-a523-4192-b344-86a663ccb1bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.875440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c87534ac-b553-4f13-b2fa-f63140ff6deb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:01.884261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c87534ac-b553-4f13-b2fa-f63140ff6deb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:01.912718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c87534ac-b553-4f13-b2fa-f63140ff6deb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.913192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c87534ac-b553-4f13-b2fa-f63140ff6deb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.915264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c87534ac-b553-4f13-b2fa-f63140ff6deb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.915947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c87534ac-b553-4f13-b2fa-f63140ff6deb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.093219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6194263-a523-4192-b344-86a663ccb1bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.103118 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6194263-a523-4192-b344-86a663ccb1bc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.554273 Jul 20 04:39:02.103723 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2744/5479] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:01 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:02.130883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-be9100a7-3b5b-4432-bbae-2d8042b1ffb1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:02.135095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-be9100a7-3b5b-4432-bbae-2d8042b1ffb1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: c9621a70-e00b-46eb-9b08-88452801d3c6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:02.158991 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-be9100a7-3b5b-4432-bbae-2d8042b1ffb1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance c9621a70-e00b-46eb-9b08-88452801d3c6 could not be found. Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-be9100a7-3b5b-4432-bbae-2d8042b1ffb1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/c9621a70-e00b-46eb-9b08-88452801d3c6/action HTTP/1.1 Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 65 Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c9621a70-e00b-46eb-9b08-88452801d3c6 could not be found. Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c9621a70-e00b-46eb-9b08-88452801d3c6', 'body': {'rebuild': {'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b'}}} Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9621a70-e00b-46eb-9b08-88452801d3c6 could not be found. Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:39:02.164327 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9621a70-e00b-46eb-9b08-88452801d3c6 could not be found. Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9621a70-e00b-46eb-9b08-88452801d3c6 could not be found. Jul 20 04:39:02.168497 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:02.172312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-be9100a7-3b5b-4432-bbae-2d8042b1ffb1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance c9621a70-e00b-46eb-9b08-88452801d3c6 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:02.173593 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-be9100a7-3b5b-4432-bbae-2d8042b1ffb1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/c9621a70-e00b-46eb-9b08-88452801d3c6/action" status: 404 len: 111 microversion: 2.1 time: 0.048016 Jul 20 04:39:02.176898 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2745/5480] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:02 2022] POST /compute/v2.1/servers/c9621a70-e00b-46eb-9b08-88452801d3c6/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:39:02.189765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b78b98a9-2a3f-47ac-b6ac-785d737de921 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:02.191887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b78b98a9-2a3f-47ac-b6ac-785d737de921 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:02.210937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b78b98a9-2a3f-47ac-b6ac-785d737de921 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.213482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b78b98a9-2a3f-47ac-b6ac-785d737de921 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.215726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b78b98a9-2a3f-47ac-b6ac-785d737de921 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.216946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b78b98a9-2a3f-47ac-b6ac-785d737de921 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.292472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c87534ac-b553-4f13-b2fa-f63140ff6deb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.302313 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c87534ac-b553-4f13-b2fa-f63140ff6deb tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1313 microversion: 2.1 time: 0.432996 Jul 20 04:39:02.303111 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2736/5481] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:01 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:02.563141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b78b98a9-2a3f-47ac-b6ac-785d737de921 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.575203 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b78b98a9-2a3f-47ac-b6ac-785d737de921 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.390268 Jul 20 04:39:02.575754 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2746/5482] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:02 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:02.595233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e6ee52f9-3a69-46dc-b0e2-9e43bab89090 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:02.597427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e6ee52f9-3a69-46dc-b0e2-9e43bab89090 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:02.602600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:02.619019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6ee52f9-3a69-46dc-b0e2-9e43bab89090 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.621176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6ee52f9-3a69-46dc-b0e2-9e43bab89090 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.623457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6ee52f9-3a69-46dc-b0e2-9e43bab89090 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.624675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6ee52f9-3a69-46dc-b0e2-9e43bab89090 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.015930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e6ee52f9-3a69-46dc-b0e2-9e43bab89090 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:03.030993 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e6ee52f9-3a69-46dc-b0e2-9e43bab89090 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.440722 Jul 20 04:39:03.046013 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2737/5483] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:02 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:03.050197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9dd4ef07-fc58-42cd-ad8e-7815ef0d2b20 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:03.050879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9dd4ef07-fc58-42cd-ad8e-7815ef0d2b20 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 6c755ba5-504a-4c2d-b698-e313d945c7b9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:03.064088 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-9dd4ef07-fc58-42cd-ad8e-7815ef0d2b20 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 6c755ba5-504a-4c2d-b698-e313d945c7b9 could not be found. Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9dd4ef07-fc58-42cd-ad8e-7815ef0d2b20 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/6c755ba5-504a-4c2d-b698-e313d945c7b9/action HTTP/1.1 Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 15 Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: {"restore": {}} Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 6c755ba5-504a-4c2d-b698-e313d945c7b9 could not be found. Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '6c755ba5-504a-4c2d-b698-e313d945c7b9', 'body': {'restore': {}}} Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c755ba5-504a-4c2d-b698-e313d945c7b9 could not be found. Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c755ba5-504a-4c2d-b698-e313d945c7b9 could not be found. Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:03.074560 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:03.078892 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:03.078892 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:03.078892 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c755ba5-504a-4c2d-b698-e313d945c7b9 could not be found. Jul 20 04:39:03.078892 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:03.078892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9dd4ef07-fc58-42cd-ad8e-7815ef0d2b20 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 6c755ba5-504a-4c2d-b698-e313d945c7b9 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:03.078892 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9dd4ef07-fc58-42cd-ad8e-7815ef0d2b20 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/6c755ba5-504a-4c2d-b698-e313d945c7b9/action" status: 404 len: 111 microversion: 2.1 time: 0.032014 Jul 20 04:39:03.083551 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2747/5484] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:03 2022] POST /compute/v2.1/servers/6c755ba5-504a-4c2d-b698-e313d945c7b9/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:39:03.088995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b929e377-ed39-4c4b-81eb-2cafeb2a224b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:03.095093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b929e377-ed39-4c4b-81eb-2cafeb2a224b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:03.109153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b929e377-ed39-4c4b-81eb-2cafeb2a224b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.110037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b929e377-ed39-4c4b-81eb-2cafeb2a224b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.111086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b929e377-ed39-4c4b-81eb-2cafeb2a224b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.115278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b929e377-ed39-4c4b-81eb-2cafeb2a224b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.320145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d1e8b679-e6d6-417f-8df9-b2ad7f2e4c2a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:03.320863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d1e8b679-e6d6-417f-8df9-b2ad7f2e4c2a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:03.332665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1e8b679-e6d6-417f-8df9-b2ad7f2e4c2a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.333119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1e8b679-e6d6-417f-8df9-b2ad7f2e4c2a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.333894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1e8b679-e6d6-417f-8df9-b2ad7f2e4c2a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.334362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d1e8b679-e6d6-417f-8df9-b2ad7f2e4c2a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.602436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b929e377-ed39-4c4b-81eb-2cafeb2a224b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:03.618418 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b929e377-ed39-4c4b-81eb-2cafeb2a224b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.533596 Jul 20 04:39:03.619018 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2738/5485] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:03 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:03.641612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-70bb7bab-3e26-49e0-a3b0-5b7faa178da2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:03.642487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-70bb7bab-3e26-49e0-a3b0-5b7faa178da2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:03.652553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70bb7bab-3e26-49e0-a3b0-5b7faa178da2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.654816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70bb7bab-3e26-49e0-a3b0-5b7faa178da2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.659337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70bb7bab-3e26-49e0-a3b0-5b7faa178da2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.660536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70bb7bab-3e26-49e0-a3b0-5b7faa178da2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.663188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d1e8b679-e6d6-417f-8df9-b2ad7f2e4c2a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:03.674974 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d1e8b679-e6d6-417f-8df9-b2ad7f2e4c2a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1313 microversion: 2.1 time: 0.359044 Jul 20 04:39:03.675984 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2748/5486] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:03 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:04.100215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-70bb7bab-3e26-49e0-a3b0-5b7faa178da2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:04.112843 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-70bb7bab-3e26-49e0-a3b0-5b7faa178da2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.475280 Jul 20 04:39:04.113806 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2739/5487] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:03 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:04.130068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7da02c06-af16-4762-aa4f-1116e4f7461e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:04.130772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7da02c06-af16-4762-aa4f-1116e4f7461e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:04.142866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7da02c06-af16-4762-aa4f-1116e4f7461e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.143474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7da02c06-af16-4762-aa4f-1116e4f7461e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.145798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7da02c06-af16-4762-aa4f-1116e4f7461e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.150266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7da02c06-af16-4762-aa4f-1116e4f7461e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.202351 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-7da02c06-af16-4762-aa4f-1116e4f7461e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Cannot 'restore' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7da02c06-af16-4762-aa4f-1116e4f7461e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action HTTP/1.1 Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 15 Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: {"restore": {}} Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: exception: Cannot 'restore' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02', 'body': {'restore': {}}} Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 in vm_state active. Cannot restore while the instance is in this state. Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:04.206842 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:04.211897 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:04.211897 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:04.211897 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:04.211897 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:39:04.211897 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:04.214005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7da02c06-af16-4762-aa4f-1116e4f7461e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 409 to user: Cannot 'restore' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:04.215211 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7da02c06-af16-4762-aa4f-1116e4f7461e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 409 len: 145 microversion: 2.1 time: 0.089410 Jul 20 04:39:04.223600 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2749/5488] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:04 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 145 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:39:04.227307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-10b86c4c-f1ff-4e48-b4ed-15563ac3b433 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:04.227956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-10b86c4c-f1ff-4e48-b4ed-15563ac3b433 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:04.240267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10b86c4c-f1ff-4e48-b4ed-15563ac3b433 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.242939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10b86c4c-f1ff-4e48-b4ed-15563ac3b433 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.243969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10b86c4c-f1ff-4e48-b4ed-15563ac3b433 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.245887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10b86c4c-f1ff-4e48-b4ed-15563ac3b433 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.543506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-10b86c4c-f1ff-4e48-b4ed-15563ac3b433 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:04.556414 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-10b86c4c-f1ff-4e48-b4ed-15563ac3b433 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.335240 Jul 20 04:39:04.569050 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2740/5489] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:04 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:04.574860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-31744ec8-0fdd-4b2f-b812-69402f437aa5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:04.575486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-31744ec8-0fdd-4b2f-b812-69402f437aa5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:04.590924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31744ec8-0fdd-4b2f-b812-69402f437aa5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.591769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31744ec8-0fdd-4b2f-b812-69402f437aa5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.593866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31744ec8-0fdd-4b2f-b812-69402f437aa5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.601551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31744ec8-0fdd-4b2f-b812-69402f437aa5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.692891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-892a2f57-c876-4ae8-b724-1f019fb61811 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:04.693623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-892a2f57-c876-4ae8-b724-1f019fb61811 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:04.712566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-892a2f57-c876-4ae8-b724-1f019fb61811 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.713030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-892a2f57-c876-4ae8-b724-1f019fb61811 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.714268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-892a2f57-c876-4ae8-b724-1f019fb61811 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.714268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-892a2f57-c876-4ae8-b724-1f019fb61811 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:05.407862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-31744ec8-0fdd-4b2f-b812-69402f437aa5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:05.422023 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-31744ec8-0fdd-4b2f-b812-69402f437aa5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.848352 Jul 20 04:39:05.432650 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2750/5490] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:04 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:05.443550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b01d7c96-95c2-487e-900d-2d1d6a2b6124 req-297cc9f9-5dfb-4d84-82c9-85f2a53b2f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637bddd3-2067-4cd0-af26-68da6e56fc7c", "tag": "d156ebd7-d161-42be-923e-b5cb914daf98"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:05.472100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b01d7c96-95c2-487e-900d-2d1d6a2b6124 req-297cc9f9-5dfb-4d84-82c9-85f2a53b2f79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:05.472542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b01d7c96-95c2-487e-900d-2d1d6a2b6124 req-297cc9f9-5dfb-4d84-82c9-85f2a53b2f79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:05.496801 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b01d7c96-95c2-487e-900d-2d1d6a2b6124 req-297cc9f9-5dfb-4d84-82c9-85f2a53b2f79 service nova] Creating event network-changed:d156ebd7-d161-42be-923e-b5cb914daf98 for instance 637bddd3-2067-4cd0-af26-68da6e56fc7c on n-h2-760456-11 Jul 20 04:39:05.530519 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b01d7c96-95c2-487e-900d-2d1d6a2b6124 req-297cc9f9-5dfb-4d84-82c9-85f2a53b2f79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084616 Jul 20 04:39:05.531610 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2751/5491] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:05.538353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a17fc652-bdc3-4658-8c22-d145396d83e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:05.539116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a17fc652-bdc3-4658-8c22-d145396d83e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: fac101a8-e367-42cd-a1e5-5ea1b8a8316a] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:05.555339 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a17fc652-bdc3-4658-8c22-d145396d83e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance fac101a8-e367-42cd-a1e5-5ea1b8a8316a could not be found. Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a17fc652-bdc3-4658-8c22-d145396d83e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/fac101a8-e367-42cd-a1e5-5ea1b8a8316a/action HTTP/1.1 Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 14 Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: {"resume": {}} Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance fac101a8-e367-42cd-a1e5-5ea1b8a8316a could not be found. Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'fac101a8-e367-42cd-a1e5-5ea1b8a8316a', 'body': {'resume': {}}} Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac101a8-e367-42cd-a1e5-5ea1b8a8316a could not be found. Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac101a8-e367-42cd-a1e5-5ea1b8a8316a could not be found. Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:05.561705 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:05.566626 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:05.566626 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:05.566626 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac101a8-e367-42cd-a1e5-5ea1b8a8316a could not be found. Jul 20 04:39:05.566626 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:05.566626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a17fc652-bdc3-4658-8c22-d145396d83e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance fac101a8-e367-42cd-a1e5-5ea1b8a8316a could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:05.566626 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a17fc652-bdc3-4658-8c22-d145396d83e7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/fac101a8-e367-42cd-a1e5-5ea1b8a8316a/action" status: 404 len: 111 microversion: 2.1 time: 0.030404 Jul 20 04:39:05.566626 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2752/5492] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:05 2022] POST /compute/v2.1/servers/fac101a8-e367-42cd-a1e5-5ea1b8a8316a/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:05.581117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fad4e14b-50b6-40b3-987c-8787a12c28f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:05.584150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fad4e14b-50b6-40b3-987c-8787a12c28f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:05.594420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=91,nova_api:DELETE=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:05.608293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fad4e14b-50b6-40b3-987c-8787a12c28f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:05.611930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fad4e14b-50b6-40b3-987c-8787a12c28f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:05.613587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fad4e14b-50b6-40b3-987c-8787a12c28f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:05.614410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fad4e14b-50b6-40b3-987c-8787a12c28f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:06.093666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-892a2f57-c876-4ae8-b724-1f019fb61811 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:06.111143 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-892a2f57-c876-4ae8-b724-1f019fb61811 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1313 microversion: 2.1 time: 1.422228 Jul 20 04:39:06.118402 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2741/5493] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:04 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1313 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:06.175960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fad4e14b-50b6-40b3-987c-8787a12c28f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:06.192533 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fad4e14b-50b6-40b3-987c-8787a12c28f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.619509 Jul 20 04:39:06.223710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86086b2b-460b-40f0-bda3-1904d71ae11a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:06.224354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-86086b2b-460b-40f0-bda3-1904d71ae11a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:06.238700 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2753/5494] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:05 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:06.247787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86086b2b-460b-40f0-bda3-1904d71ae11a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:06.247787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86086b2b-460b-40f0-bda3-1904d71ae11a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:06.247787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86086b2b-460b-40f0-bda3-1904d71ae11a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:06.247787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86086b2b-460b-40f0-bda3-1904d71ae11a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.108822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-86086b2b-460b-40f0-bda3-1904d71ae11a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:07.123526 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-86086b2b-460b-40f0-bda3-1904d71ae11a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.905126 Jul 20 04:39:07.137519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eba3a2d5-ac1b-46b9-9946-988cc210bb00 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:07.137519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eba3a2d5-ac1b-46b9-9946-988cc210bb00 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:07.138758 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2742/5495] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:06 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:07.143914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b3a4c9f-297a-4a7f-baa4-4ba470ff41ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:07.144775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4b3a4c9f-297a-4a7f-baa4-4ba470ff41ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:07.152181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eba3a2d5-ac1b-46b9-9946-988cc210bb00 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.152573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eba3a2d5-ac1b-46b9-9946-988cc210bb00 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.153359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eba3a2d5-ac1b-46b9-9946-988cc210bb00 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.153797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eba3a2d5-ac1b-46b9-9946-988cc210bb00 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.154796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b3a4c9f-297a-4a7f-baa4-4ba470ff41ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.155515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b3a4c9f-297a-4a7f-baa4-4ba470ff41ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.156577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b3a4c9f-297a-4a7f-baa4-4ba470ff41ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.157280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b3a4c9f-297a-4a7f-baa4-4ba470ff41ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.200615 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-4b3a4c9f-297a-4a7f-baa4-4ba470ff41ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Cannot 'resume' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b3a4c9f-297a-4a7f-baa4-4ba470ff41ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action HTTP/1.1 Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 14 Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: {"resume": {}} Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: exception: Cannot 'resume' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02', 'body': {'resume': {}}} Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 in vm_state active. Cannot resume while the instance is in this state. Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:07.202794 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:07.206871 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:07.206871 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:07.206871 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:07.206871 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:39:07.206871 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.212656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b3a4c9f-297a-4a7f-baa4-4ba470ff41ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 409 to user: Cannot 'resume' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:07.213869 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4b3a4c9f-297a-4a7f-baa4-4ba470ff41ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 409 len: 144 microversion: 2.1 time: 0.073846 Jul 20 04:39:07.217997 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2743/5496] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:07 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 144 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:39:07.229187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-451ed1b7-4242-421a-a7e6-76c439b93f44 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:07.230407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-451ed1b7-4242-421a-a7e6-76c439b93f44 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:07.238503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-451ed1b7-4242-421a-a7e6-76c439b93f44 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.239319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-451ed1b7-4242-421a-a7e6-76c439b93f44 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.242475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-451ed1b7-4242-421a-a7e6-76c439b93f44 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.243215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-451ed1b7-4242-421a-a7e6-76c439b93f44 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.501859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-451ed1b7-4242-421a-a7e6-76c439b93f44 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:07.513983 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-451ed1b7-4242-421a-a7e6-76c439b93f44 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.293226 Jul 20 04:39:07.515330 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2744/5497] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:07 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:07.538953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-82af2ace-98d1-4cce-af64-58ad534dfe0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:07.539914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-82af2ace-98d1-4cce-af64-58ad534dfe0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:07.566966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82af2ace-98d1-4cce-af64-58ad534dfe0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.566966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82af2ace-98d1-4cce-af64-58ad534dfe0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.567617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82af2ace-98d1-4cce-af64-58ad534dfe0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.569374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82af2ace-98d1-4cce-af64-58ad534dfe0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.582858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:07.770092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-82af2ace-98d1-4cce-af64-58ad534dfe0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:07.783894 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-82af2ace-98d1-4cce-af64-58ad534dfe0d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.252153 Jul 20 04:39:07.785764 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2745/5498] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:07 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:07.941499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0d1485b-d534-404c-8316-744c69a7c699 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0d1485b-d534-404c-8316-744c69a7c699 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 160 Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "c3e4c87c-518b-4f6d-a7ce-a98932e29370"}]}} Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'body': {'server': {'name': '', 'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b', 'flavorRef': '452', 'networks': [{'uuid': 'c3e4c87c-518b-4f6d-a7ce-a98932e29370'}]}}} Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi '' Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:39:07.943907 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0d1485b-d534-404c-8316-744c69a7c699 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:07.949168 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d0d1485b-d534-404c-8316-744c69a7c699 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.009256 Jul 20 04:39:07.950643 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2746/5499] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:07 2022] POST /compute/v2.1/servers => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:39:07.965278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-745de9f0-8f86-4b50-ac17-04e8c6d2439c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:07.965918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-745de9f0-8f86-4b50-ac17-04e8c6d2439c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:07.996412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-745de9f0-8f86-4b50-ac17-04e8c6d2439c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.997330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-745de9f0-8f86-4b50-ac17-04e8c6d2439c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:07.998091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-745de9f0-8f86-4b50-ac17-04e8c6d2439c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:07.998566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-745de9f0-8f86-4b50-ac17-04e8c6d2439c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.090899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eba3a2d5-ac1b-46b9-9946-988cc210bb00 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:08.105679 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eba3a2d5-ac1b-46b9-9946-988cc210bb00 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1313 microversion: 2.1 time: 0.974962 Jul 20 04:39:08.108321 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2754/5500] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:07 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1313 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:08.833237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-745de9f0-8f86-4b50-ac17-04e8c6d2439c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:08.849419 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-745de9f0-8f86-4b50-ac17-04e8c6d2439c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.897699 Jul 20 04:39:08.858671 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2747/5501] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:07 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:08.881498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-866d95f5-8991-4d04-bf48-317dc6739a54 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:08.883148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-866d95f5-8991-4d04-bf48-317dc6739a54 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:08.886205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=48 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:08.900886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-866d95f5-8991-4d04-bf48-317dc6739a54 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:08.905438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-866d95f5-8991-4d04-bf48-317dc6739a54 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.908467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-866d95f5-8991-4d04-bf48-317dc6739a54 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:08.909057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-866d95f5-8991-4d04-bf48-317dc6739a54 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:09.125166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fbe8c29d-61a2-4251-a12a-7a45dc258586 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:09.126210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fbe8c29d-61a2-4251-a12a-7a45dc258586 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:09.152284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe8c29d-61a2-4251-a12a-7a45dc258586 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:09.158415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe8c29d-61a2-4251-a12a-7a45dc258586 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:09.167550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe8c29d-61a2-4251-a12a-7a45dc258586 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:09.169006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbe8c29d-61a2-4251-a12a-7a45dc258586 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:09.238129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:09.537960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=14 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:09.584586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbe8c29d-61a2-4251-a12a-7a45dc258586 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:09.601907 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fbe8c29d-61a2-4251-a12a-7a45dc258586 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1313 microversion: 2.1 time: 0.476862 Jul 20 04:39:09.602540 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2748/5502] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:09 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:09.626653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-866d95f5-8991-4d04-bf48-317dc6739a54 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:09.644047 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-866d95f5-8991-4d04-bf48-317dc6739a54 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.763237 Jul 20 04:39:09.645044 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2755/5503] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:08 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:09.664351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1d5a5b0-6750-4750-85e4-ec9946dd740b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:09.664971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1d5a5b0-6750-4750-85e4-ec9946dd740b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 3097d710-8a03-4df0-a239-40facf89e00e] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:09.676274 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a1d5a5b0-6750-4750-85e4-ec9946dd740b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 3097d710-8a03-4df0-a239-40facf89e00e could not be found. Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1d5a5b0-6750-4750-85e4-ec9946dd740b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/3097d710-8a03-4df0-a239-40facf89e00e/action HTTP/1.1 Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 14 Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: {"shelve": {}} Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 3097d710-8a03-4df0-a239-40facf89e00e could not be found. Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '3097d710-8a03-4df0-a239-40facf89e00e', 'body': {'shelve': {}}} Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3097d710-8a03-4df0-a239-40facf89e00e could not be found. Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3097d710-8a03-4df0-a239-40facf89e00e could not be found. Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:09.681106 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:09.686338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:09.686338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:09.686338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3097d710-8a03-4df0-a239-40facf89e00e could not be found. Jul 20 04:39:09.686338 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:09.701203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1d5a5b0-6750-4750-85e4-ec9946dd740b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 3097d710-8a03-4df0-a239-40facf89e00e could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:09.705655 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1d5a5b0-6750-4750-85e4-ec9946dd740b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/3097d710-8a03-4df0-a239-40facf89e00e/action" status: 404 len: 111 microversion: 2.1 time: 0.046784 Jul 20 04:39:09.706571 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2749/5504] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:09 2022] POST /compute/v2.1/servers/3097d710-8a03-4df0-a239-40facf89e00e/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:09.716150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4e76d416-c6da-4bc3-8b83-45e3ad8879c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:09.717015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4e76d416-c6da-4bc3-8b83-45e3ad8879c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:09.741406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e76d416-c6da-4bc3-8b83-45e3ad8879c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:09.743291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e76d416-c6da-4bc3-8b83-45e3ad8879c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:09.744517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e76d416-c6da-4bc3-8b83-45e3ad8879c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:09.745140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e76d416-c6da-4bc3-8b83-45e3ad8879c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:09.882543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-163278197", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "766ad2cf-1cc6-4049-b207-a246cad5f8a7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-457533471", "security_groups": [{"name": "tempest-secgroup-smoke-178821360"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:10.002803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4e76d416-c6da-4bc3-8b83-45e3ad8879c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:10.011503 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4e76d416-c6da-4bc3-8b83-45e3ad8879c3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.299404 Jul 20 04:39:10.012599 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2756/5505] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:09 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:10.031599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-86bb36d9-a0f0-4af1-b8e2-4e70cf649d9f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:10.032293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-86bb36d9-a0f0-4af1-b8e2-4e70cf649d9f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:10.039471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86bb36d9-a0f0-4af1-b8e2-4e70cf649d9f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:10.040223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86bb36d9-a0f0-4af1-b8e2-4e70cf649d9f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:10.041223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86bb36d9-a0f0-4af1-b8e2-4e70cf649d9f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:10.041880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86bb36d9-a0f0-4af1-b8e2-4e70cf649d9f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:10.102292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] validate_networks() for [('766ad2cf-1cc6-4049-b207-a246cad5f8a7', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:10.340783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-86bb36d9-a0f0-4af1-b8e2-4e70cf649d9f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:10.350065 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-86bb36d9-a0f0-4af1-b8e2-4e70cf649d9f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.322450 Jul 20 04:39:10.363669 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2757/5506] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:10 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:10.372499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0c95fb8d-334e-41db-94f3-b541f1c18044 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:10.375788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0c95fb8d-334e-41db-94f3-b541f1c18044 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:10.390136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c95fb8d-334e-41db-94f3-b541f1c18044 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:10.391098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c95fb8d-334e-41db-94f3-b541f1c18044 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:10.394950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c95fb8d-334e-41db-94f3-b541f1c18044 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:10.395564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c95fb8d-334e-41db-94f3-b541f1c18044 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:10.435001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:10.441639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-0c95fb8d-334e-41db-94f3-b541f1c18044 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lazy-loading 'flavor' on Instance uuid 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:10.974319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:10.975441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:10.976878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:10.977596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:10.978468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:10.993641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:10.994621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:10.995783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:10.996479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:11.024117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:11.032533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Getting quotas for user 8f84ec28420a4cdcb88920cd86ce0160 and project c92a62f7017e4b8f8bbeb960856d1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:11.041093 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0c95fb8d-334e-41db-94f3-b541f1c18044 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 202 len: 0 microversion: 2.1 time: 0.672577 Jul 20 04:39:11.049257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:11.052240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:11.058358 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2758/5507] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:10 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:39:11.073944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2981806-8bc3-4359-a8da-7c1f238eb698 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:11.075131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c2981806-8bc3-4359-a8da-7c1f238eb698 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:11.097215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2981806-8bc3-4359-a8da-7c1f238eb698 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:11.098410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2981806-8bc3-4359-a8da-7c1f238eb698 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:11.099839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2981806-8bc3-4359-a8da-7c1f238eb698 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:11.101920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2981806-8bc3-4359-a8da-7c1f238eb698 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:11.164802 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac68f7a5-9c5a-4754-a19f-e593254473fe tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.285778 Jul 20 04:39:11.181500 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2750/5508] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:39:11.222496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d9ce290b-8b62-4d2f-baa0-668e694d3628 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:11.223471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d9ce290b-8b62-4d2f-baa0-668e694d3628 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:11.240632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9ce290b-8b62-4d2f-baa0-668e694d3628 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:11.245897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9ce290b-8b62-4d2f-baa0-668e694d3628 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:11.247038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9ce290b-8b62-4d2f-baa0-668e694d3628 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:11.247736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d9ce290b-8b62-4d2f-baa0-668e694d3628 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:11.473435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d9ce290b-8b62-4d2f-baa0-668e694d3628 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:11.482847 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d9ce290b-8b62-4d2f-baa0-668e694d3628 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.298989 Jul 20 04:39:11.488876 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2751/5509] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:11 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:11.500185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8bbde3a5-d2c6-404f-ae73-89047546d803 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:11.502244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2981806-8bc3-4359-a8da-7c1f238eb698 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:11.503908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8bbde3a5-d2c6-404f-ae73-89047546d803 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:11.518812 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c2981806-8bc3-4359-a8da-7c1f238eb698 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1313 microversion: 2.1 time: 0.456058 Jul 20 04:39:11.519675 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2759/5510] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:11 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:11.616831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8bbde3a5-d2c6-404f-ae73-89047546d803 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:11.630428 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8bbde3a5-d2c6-404f-ae73-89047546d803 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1265 microversion: 2.1 time: 0.139920 Jul 20 04:39:11.631306 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2752/5511] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:11 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:12.520948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-05ebdff4-a9b0-4b60-ab64-9fcff185d631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:12.522236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05ebdff4-a9b0-4b60-ab64-9fcff185d631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:12.537751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3d04eec4-8c44-41b1-afbd-42580831486a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:12.539475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3d04eec4-8c44-41b1-afbd-42580831486a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:12.543800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05ebdff4-a9b0-4b60-ab64-9fcff185d631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:12.544442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05ebdff4-a9b0-4b60-ab64-9fcff185d631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:12.546723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05ebdff4-a9b0-4b60-ab64-9fcff185d631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:12.547608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05ebdff4-a9b0-4b60-ab64-9fcff185d631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:12.556035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d04eec4-8c44-41b1-afbd-42580831486a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:12.560299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d04eec4-8c44-41b1-afbd-42580831486a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:12.561267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d04eec4-8c44-41b1-afbd-42580831486a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:12.567151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d04eec4-8c44-41b1-afbd-42580831486a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:12.840129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3d04eec4-8c44-41b1-afbd-42580831486a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:12.850800 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3d04eec4-8c44-41b1-afbd-42580831486a tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1313 microversion: 2.1 time: 0.317162 Jul 20 04:39:12.851513 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2753/5512] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:12 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:12.877219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ff960190-e5ce-4178-afb4-8685751f469d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:12.878312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ff960190-e5ce-4178-afb4-8685751f469d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:12.895099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff960190-e5ce-4178-afb4-8685751f469d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:12.897320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff960190-e5ce-4178-afb4-8685751f469d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:12.899746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff960190-e5ce-4178-afb4-8685751f469d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:12.902437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff960190-e5ce-4178-afb4-8685751f469d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:12.981208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05ebdff4-a9b0-4b60-ab64-9fcff185d631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:12.995860 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-05ebdff4-a9b0-4b60-ab64-9fcff185d631 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.489837 Jul 20 04:39:12.997113 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2760/5513] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:12 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:13.040324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ff960190-e5ce-4178-afb4-8685751f469d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:13.056830 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ff960190-e5ce-4178-afb4-8685751f469d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1325 microversion: 2.1 time: 0.195714 Jul 20 04:39:13.057852 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2754/5514] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:12 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1325 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:13.869795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d41570e9-6ad2-495d-8a91-ee494624bc05 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:13.870763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d41570e9-6ad2-495d-8a91-ee494624bc05 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:13.887901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d41570e9-6ad2-495d-8a91-ee494624bc05 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:13.888653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d41570e9-6ad2-495d-8a91-ee494624bc05 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:13.893182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d41570e9-6ad2-495d-8a91-ee494624bc05 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:13.893926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d41570e9-6ad2-495d-8a91-ee494624bc05 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:14.023852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-915a9c75-b596-4dd9-99e7-23132c0b5906 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:14.024488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-915a9c75-b596-4dd9-99e7-23132c0b5906 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:14.043696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-915a9c75-b596-4dd9-99e7-23132c0b5906 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:14.044567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-915a9c75-b596-4dd9-99e7-23132c0b5906 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:14.046872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-915a9c75-b596-4dd9-99e7-23132c0b5906 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:14.049599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-915a9c75-b596-4dd9-99e7-23132c0b5906 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:14.376169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-915a9c75-b596-4dd9-99e7-23132c0b5906 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:14.396271 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-915a9c75-b596-4dd9-99e7-23132c0b5906 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.376626 Jul 20 04:39:14.398400 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2755/5515] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:14 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:14.405246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f9a08a2b-62ab-4922-b4e9-56e745609b1d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:14.406322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f9a08a2b-62ab-4922-b4e9-56e745609b1d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:14.413913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a08a2b-62ab-4922-b4e9-56e745609b1d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:14.414807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a08a2b-62ab-4922-b4e9-56e745609b1d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:14.415782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a08a2b-62ab-4922-b4e9-56e745609b1d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:14.416474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a08a2b-62ab-4922-b4e9-56e745609b1d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:14.728094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f9a08a2b-62ab-4922-b4e9-56e745609b1d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:14.746736 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f9a08a2b-62ab-4922-b4e9-56e745609b1d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1390 microversion: 2.1 time: 0.346241 Jul 20 04:39:14.750171 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2756/5516] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:14 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1390 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:15.126197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c28dd5b8-882c-45c7-b78c-78c2a7688eec req-912f55ee-f34c-4a7e-9501-0f290a1da06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637bddd3-2067-4cd0-af26-68da6e56fc7c", "name": "network-vif-plugged", "status": "completed", "tag": "d156ebd7-d161-42be-923e-b5cb914daf98"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:15.155755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c28dd5b8-882c-45c7-b78c-78c2a7688eec req-912f55ee-f34c-4a7e-9501-0f290a1da06c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.156749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c28dd5b8-882c-45c7-b78c-78c2a7688eec req-912f55ee-f34c-4a7e-9501-0f290a1da06c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:15.230520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d41570e9-6ad2-495d-8a91-ee494624bc05 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:15.251085 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d41570e9-6ad2-495d-8a91-ee494624bc05 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1313 microversion: 2.1 time: 1.385945 Jul 20 04:39:15.252107 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2761/5517] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:13 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1313 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:15.268708 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c28dd5b8-882c-45c7-b78c-78c2a7688eec req-912f55ee-f34c-4a7e-9501-0f290a1da06c service nova] Creating event network-vif-plugged:d156ebd7-d161-42be-923e-b5cb914daf98 for instance 637bddd3-2067-4cd0-af26-68da6e56fc7c on n-h2-760456-11 Jul 20 04:39:15.290290 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c28dd5b8-882c-45c7-b78c-78c2a7688eec req-912f55ee-f34c-4a7e-9501-0f290a1da06c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.537560 Jul 20 04:39:15.295501 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2757/5518] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:15.420560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ad2f460-2bbd-4036-a8c1-29c5470f890e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:15.422041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ad2f460-2bbd-4036-a8c1-29c5470f890e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:15.446617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ad2f460-2bbd-4036-a8c1-29c5470f890e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.447187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ad2f460-2bbd-4036-a8c1-29c5470f890e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:15.447924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ad2f460-2bbd-4036-a8c1-29c5470f890e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.448338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ad2f460-2bbd-4036-a8c1-29c5470f890e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:15.767698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb9bed73-6ee3-4223-85cd-19f1843f4aff tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:15.768465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb9bed73-6ee3-4223-85cd-19f1843f4aff tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:15.779264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb9bed73-6ee3-4223-85cd-19f1843f4aff tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.779742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb9bed73-6ee3-4223-85cd-19f1843f4aff tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:15.780549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb9bed73-6ee3-4223-85cd-19f1843f4aff tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.780999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb9bed73-6ee3-4223-85cd-19f1843f4aff tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:15.947278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb9bed73-6ee3-4223-85cd-19f1843f4aff tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:15.956810 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb9bed73-6ee3-4223-85cd-19f1843f4aff tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1390 microversion: 2.1 time: 0.193242 Jul 20 04:39:15.957821 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2758/5519] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:15 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1390 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:16.005298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5ad2f460-2bbd-4036-a8c1-29c5470f890e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:16.016268 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ad2f460-2bbd-4036-a8c1-29c5470f890e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.602999 Jul 20 04:39:16.017483 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2762/5520] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:15 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:16.271695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b10c4237-7b98-4e71-8c10-90a28b65c60b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:16.272942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b10c4237-7b98-4e71-8c10-90a28b65c60b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:16.285122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b10c4237-7b98-4e71-8c10-90a28b65c60b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:16.285850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b10c4237-7b98-4e71-8c10-90a28b65c60b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:16.286868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b10c4237-7b98-4e71-8c10-90a28b65c60b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:16.287476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b10c4237-7b98-4e71-8c10-90a28b65c60b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:16.596059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b10c4237-7b98-4e71-8c10-90a28b65c60b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:16.613380 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b10c4237-7b98-4e71-8c10-90a28b65c60b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1313 microversion: 2.1 time: 0.348048 Jul 20 04:39:16.615128 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2759/5521] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:16 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:16.802709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-fa5438c7-d0e5-4b7f-8018-105f93db1e3b req-82e6e00e-791d-4fee-9c50-144a12eff9cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a908c5-87f5-4228-9815-f47c1195c4a6", "tag": "4d0e27c2-3182-484f-abb7-ff3d69355c02"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:16.816238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fa5438c7-d0e5-4b7f-8018-105f93db1e3b req-82e6e00e-791d-4fee-9c50-144a12eff9cf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:16.816683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fa5438c7-d0e5-4b7f-8018-105f93db1e3b req-82e6e00e-791d-4fee-9c50-144a12eff9cf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:16.830171 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-fa5438c7-d0e5-4b7f-8018-105f93db1e3b req-82e6e00e-791d-4fee-9c50-144a12eff9cf service nova] Creating event network-changed:4d0e27c2-3182-484f-abb7-ff3d69355c02 for instance 70a908c5-87f5-4228-9815-f47c1195c4a6 on n-h1-760456-11 Jul 20 04:39:16.837418 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-fa5438c7-d0e5-4b7f-8018-105f93db1e3b req-82e6e00e-791d-4fee-9c50-144a12eff9cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039450 Jul 20 04:39:16.845269 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2763/5522] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:16.974727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1c9d6670-0b6e-4beb-85b5-292b8fdaf4f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:16.975746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1c9d6670-0b6e-4beb-85b5-292b8fdaf4f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:16.996468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c9d6670-0b6e-4beb-85b5-292b8fdaf4f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.003062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c9d6670-0b6e-4beb-85b5-292b8fdaf4f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.004270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c9d6670-0b6e-4beb-85b5-292b8fdaf4f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.004943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c9d6670-0b6e-4beb-85b5-292b8fdaf4f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.046047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3a7a1f9b-7953-4eb9-b5e8-54562d48fe50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:17.046845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3a7a1f9b-7953-4eb9-b5e8-54562d48fe50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:17.080282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a7a1f9b-7953-4eb9-b5e8-54562d48fe50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.080756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a7a1f9b-7953-4eb9-b5e8-54562d48fe50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.083217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a7a1f9b-7953-4eb9-b5e8-54562d48fe50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.087546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a7a1f9b-7953-4eb9-b5e8-54562d48fe50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.396346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3a7a1f9b-7953-4eb9-b5e8-54562d48fe50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:17.411970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1c9d6670-0b6e-4beb-85b5-292b8fdaf4f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:17.413514 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3a7a1f9b-7953-4eb9-b5e8-54562d48fe50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.382524 Jul 20 04:39:17.414893 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2764/5523] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:17 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:17.691297 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1c9d6670-0b6e-4beb-85b5-292b8fdaf4f9 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1390 microversion: 2.1 time: 0.504797 Jul 20 04:39:17.691297 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2760/5524] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:16 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1390 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:17.693740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8e855757-5988-49fb-bea7-5b990294bf60 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:17.693740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8e855757-5988-49fb-bea7-5b990294bf60 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:17.693740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e855757-5988-49fb-bea7-5b990294bf60 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.693740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e855757-5988-49fb-bea7-5b990294bf60 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.693740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e855757-5988-49fb-bea7-5b990294bf60 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.693740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e855757-5988-49fb-bea7-5b990294bf60 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.899142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-55d9469d-fc1c-46df-b0d7-e559c56a1d7c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:17.900262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-55d9469d-fc1c-46df-b0d7-e559c56a1d7c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:17.909506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55d9469d-fc1c-46df-b0d7-e559c56a1d7c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.909960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55d9469d-fc1c-46df-b0d7-e559c56a1d7c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.910771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55d9469d-fc1c-46df-b0d7-e559c56a1d7c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.911214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-55d9469d-fc1c-46df-b0d7-e559c56a1d7c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.020461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8e855757-5988-49fb-bea7-5b990294bf60 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:18.030404 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8e855757-5988-49fb-bea7-5b990294bf60 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1497 microversion: 2.1 time: 0.402559 Jul 20 04:39:18.034443 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2765/5525] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:17 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1497 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:18.051331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd12e1ee-8577-42c8-87fb-218be054442b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:18.066681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.compute.server_groups [None req-bd12e1ee-8577-42c8-87fb-218be054442b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Querying cell 0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) for 1 instances {{(pid=119605) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:39:18.067883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd12e1ee-8577-42c8-87fb-218be054442b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.068570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd12e1ee-8577-42c8-87fb-218be054442b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.111424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-55d9469d-fc1c-46df-b0d7-e559c56a1d7c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lazy-loading 'services' on Instance uuid 38047d01-1308-49f6-8f31-61300f51932f {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:18.226443 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-55d9469d-fc1c-46df-b0d7-e559c56a1d7c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments/89de4aa7-d32f-4c39-996d-385767e28c21" status: 202 len: 0 microversion: 2.1 time: 0.331584 Jul 20 04:39:18.230529 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2761/5526] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:39:17 2022] DELETE /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments/89de4aa7-d32f-4c39-996d-385767e28c21 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:39:18.237385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dff95801-d45c-4667-ac8d-19115ce6d5c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:18.238605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dff95801-d45c-4667-ac8d-19115ce6d5c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:18.239241 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd12e1ee-8577-42c8-87fb-218be054442b tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups/bd5cb975-94bb-439b-812b-cccbb2801a2e" status: 200 len: 221 microversion: 2.1 time: 0.191531 Jul 20 04:39:18.242348 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2766/5527] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:39:18 2022] GET /compute/v2.1/os-server-groups/bd5cb975-94bb-439b-812b-cccbb2801a2e => generated 221 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:18.253655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff95801-d45c-4667-ac8d-19115ce6d5c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.253987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6cf056de-a60e-45f0-90d7-4ec93530780c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:18.254566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6cf056de-a60e-45f0-90d7-4ec93530780c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:18.254797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff95801-d45c-4667-ac8d-19115ce6d5c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.255755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff95801-d45c-4667-ac8d-19115ce6d5c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.256361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff95801-d45c-4667-ac8d-19115ce6d5c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.286097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cf056de-a60e-45f0-90d7-4ec93530780c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.286636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cf056de-a60e-45f0-90d7-4ec93530780c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.287462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cf056de-a60e-45f0-90d7-4ec93530780c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.288742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cf056de-a60e-45f0-90d7-4ec93530780c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.336331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6cf056de-a60e-45f0-90d7-4ec93530780c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:39:18.402126 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dff95801-d45c-4667-ac8d-19115ce6d5c8 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169227 Jul 20 04:39:18.403798 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2762/5528] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:39:18 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:18.435243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-99d8e56e-b7af-4b32-a8b1-34bd04083cad tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:18.437741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-99d8e56e-b7af-4b32-a8b1-34bd04083cad tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:18.453809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99d8e56e-b7af-4b32-a8b1-34bd04083cad tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.456478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99d8e56e-b7af-4b32-a8b1-34bd04083cad tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.457503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99d8e56e-b7af-4b32-a8b1-34bd04083cad tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.458531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-99d8e56e-b7af-4b32-a8b1-34bd04083cad tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.525779 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6cf056de-a60e-45f0-90d7-4ec93530780c tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 204 len: 0 microversion: 2.1 time: 0.275343 Jul 20 04:39:18.526857 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2767/5529] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:39:18 2022] DELETE /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:39:18.533567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bfac809b-534c-42e1-b433-d1aa761aaf84 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:18.534302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bfac809b-534c-42e1-b433-d1aa761aaf84 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:18.543111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfac809b-534c-42e1-b433-d1aa761aaf84 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.543581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfac809b-534c-42e1-b433-d1aa761aaf84 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.544372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfac809b-534c-42e1-b433-d1aa761aaf84 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.544878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfac809b-534c-42e1-b433-d1aa761aaf84 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.729185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-99d8e56e-b7af-4b32-a8b1-34bd04083cad tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:18.738826 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-99d8e56e-b7af-4b32-a8b1-34bd04083cad tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.311181 Jul 20 04:39:18.740038 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2763/5530] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:18 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:18.746514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ead0c37-1152-411f-8d4f-3573f63adbe0 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:18.747501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ead0c37-1152-411f-8d4f-3573f63adbe0 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:18.770032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ead0c37-1152-411f-8d4f-3573f63adbe0 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.774556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ead0c37-1152-411f-8d4f-3573f63adbe0 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.779265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ead0c37-1152-411f-8d4f-3573f63adbe0 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.779963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ead0c37-1152-411f-8d4f-3573f63adbe0 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.794530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bfac809b-534c-42e1-b433-d1aa761aaf84 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:18.805769 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bfac809b-534c-42e1-b433-d1aa761aaf84 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1390 microversion: 2.1 time: 0.277562 Jul 20 04:39:18.810523 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2768/5531] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:18 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1390 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:19.166819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ead0c37-1152-411f-8d4f-3573f63adbe0 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:19.180641 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ead0c37-1152-411f-8d4f-3573f63adbe0 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1503 microversion: 2.1 time: 0.438864 Jul 20 04:39:19.182646 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2764/5532] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:18 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1503 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:19.417064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-33cf8dda-7c3d-4fec-bb0c-04a0c20eb704 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:19.418962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-33cf8dda-7c3d-4fec-bb0c-04a0c20eb704 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:19.433562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33cf8dda-7c3d-4fec-bb0c-04a0c20eb704 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.435139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33cf8dda-7c3d-4fec-bb0c-04a0c20eb704 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.436969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33cf8dda-7c3d-4fec-bb0c-04a0c20eb704 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.439776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33cf8dda-7c3d-4fec-bb0c-04a0c20eb704 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.541427 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-33cf8dda-7c3d-4fec-bb0c-04a0c20eb704 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130228 Jul 20 04:39:19.545450 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2769/5533] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:39:19 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:19.761311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-14b403e4-f1c7-44b9-ab38-7629ee4afefb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:19.761943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-14b403e4-f1c7-44b9-ab38-7629ee4afefb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:19.771411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14b403e4-f1c7-44b9-ab38-7629ee4afefb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.780105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14b403e4-f1c7-44b9-ab38-7629ee4afefb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.781726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14b403e4-f1c7-44b9-ab38-7629ee4afefb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.782402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14b403e4-f1c7-44b9-ab38-7629ee4afefb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.826686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d303e58-bd17-4075-9f9f-23cb0f3cc96a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:19.827585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d303e58-bd17-4075-9f9f-23cb0f3cc96a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:19.840652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d303e58-bd17-4075-9f9f-23cb0f3cc96a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.841310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d303e58-bd17-4075-9f9f-23cb0f3cc96a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.847041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d303e58-bd17-4075-9f9f-23cb0f3cc96a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.849705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d303e58-bd17-4075-9f9f-23cb0f3cc96a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:20.161386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d303e58-bd17-4075-9f9f-23cb0f3cc96a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:20.172192 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d303e58-bd17-4075-9f9f-23cb0f3cc96a tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1390 microversion: 2.1 time: 0.347332 Jul 20 04:39:20.174026 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2770/5534] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:19 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1390 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:20.198701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1933aaba-f874-4c04-86c2-0bcc7212cae7 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:20.199572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1933aaba-f874-4c04-86c2-0bcc7212cae7 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:20.210446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1933aaba-f874-4c04-86c2-0bcc7212cae7 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:20.213359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1933aaba-f874-4c04-86c2-0bcc7212cae7 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:20.217783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1933aaba-f874-4c04-86c2-0bcc7212cae7 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:20.221252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1933aaba-f874-4c04-86c2-0bcc7212cae7 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:20.540653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-14b403e4-f1c7-44b9-ab38-7629ee4afefb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:20.548438 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-14b403e4-f1c7-44b9-ab38-7629ee4afefb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.792314 Jul 20 04:39:20.569960 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2765/5535] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:19 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:20.575317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c4953bee-4ea9-4c92-9fc3-d6c44fc157d6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:20.576290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c4953bee-4ea9-4c92-9fc3-d6c44fc157d6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:20.588016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4953bee-4ea9-4c92-9fc3-d6c44fc157d6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:20.592641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4953bee-4ea9-4c92-9fc3-d6c44fc157d6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:20.593644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4953bee-4ea9-4c92-9fc3-d6c44fc157d6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:20.595106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4953bee-4ea9-4c92-9fc3-d6c44fc157d6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:20.666912 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c4953bee-4ea9-4c92-9fc3-d6c44fc157d6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095497 Jul 20 04:39:20.667822 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2766/5536] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:39:20 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:20.806700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1933aaba-f874-4c04-86c2-0bcc7212cae7 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:20.816246 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1933aaba-f874-4c04-86c2-0bcc7212cae7 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1503 microversion: 2.1 time: 0.621912 Jul 20 04:39:20.821013 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2771/5537] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:20 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1503 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:21.189125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a7a7e69-0eee-43bc-ba7f-04c8544e99db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:21.189828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6a7a7e69-0eee-43bc-ba7f-04c8544e99db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:21.202673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:21.205062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a7a7e69-0eee-43bc-ba7f-04c8544e99db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:21.205586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a7a7e69-0eee-43bc-ba7f-04c8544e99db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:21.206699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a7a7e69-0eee-43bc-ba7f-04c8544e99db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:21.208310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a7a7e69-0eee-43bc-ba7f-04c8544e99db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:21.281507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:21.567552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9dbbffb-283e-4763-8425-f34540efad8c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:21.568864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c9dbbffb-283e-4763-8425-f34540efad8c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:21.582930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9dbbffb-283e-4763-8425-f34540efad8c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:21.583748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9dbbffb-283e-4763-8425-f34540efad8c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:21.585453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9dbbffb-283e-4763-8425-f34540efad8c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:21.586160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9dbbffb-283e-4763-8425-f34540efad8c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:21.589944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:21.621262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:21.792125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6a7a7e69-0eee-43bc-ba7f-04c8544e99db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:21.806671 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6a7a7e69-0eee-43bc-ba7f-04c8544e99db tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1390 microversion: 2.1 time: 0.620179 Jul 20 04:39:21.807737 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2767/5538] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:21 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1390 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:21.828263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0abd5410-990f-4b5c-8a3c-e3ceef442224 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:21.831198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0abd5410-990f-4b5c-8a3c-e3ceef442224 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:21.863677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0abd5410-990f-4b5c-8a3c-e3ceef442224 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:21.864472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0abd5410-990f-4b5c-8a3c-e3ceef442224 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:21.865569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0abd5410-990f-4b5c-8a3c-e3ceef442224 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:21.870574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0abd5410-990f-4b5c-8a3c-e3ceef442224 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.009938 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0abd5410-990f-4b5c-8a3c-e3ceef442224 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199428 Jul 20 04:39:22.011107 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2768/5539] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:39:21 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:22.017791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc11a471-40b2-4e66-9ee1-730d928153a3 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:22.018872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc11a471-40b2-4e66-9ee1-730d928153a3 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:22.026843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc11a471-40b2-4e66-9ee1-730d928153a3 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.027576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc11a471-40b2-4e66-9ee1-730d928153a3 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.028694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc11a471-40b2-4e66-9ee1-730d928153a3 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.029332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc11a471-40b2-4e66-9ee1-730d928153a3 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.117913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc11a471-40b2-4e66-9ee1-730d928153a3 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4c52d3efd84040a15ce7c21b03ca0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '175a1c6c46ff4f97879bb56fdb9d42a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:22.127229 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc11a471-40b2-4e66-9ee1-730d928153a3 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 200 len: 1298 microversion: 2.1 time: 0.114861 Jul 20 04:39:22.130083 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2769/5540] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:22 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:22.136053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-75a30e2e-e7fd-4ee7-91d9-53c28486b3f7 req-23781068-1e59-4929-97be-bbfb3632e5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637bddd3-2067-4cd0-af26-68da6e56fc7c", "name": "network-vif-deleted", "tag": "d156ebd7-d161-42be-923e-b5cb914daf98"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:22.146030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-75a30e2e-e7fd-4ee7-91d9-53c28486b3f7 req-23781068-1e59-4929-97be-bbfb3632e5d2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.146791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-75a30e2e-e7fd-4ee7-91d9-53c28486b3f7 req-23781068-1e59-4929-97be-bbfb3632e5d2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.163948 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-75a30e2e-e7fd-4ee7-91d9-53c28486b3f7 req-23781068-1e59-4929-97be-bbfb3632e5d2 service nova] Creating event network-vif-deleted:d156ebd7-d161-42be-923e-b5cb914daf98 for instance 637bddd3-2067-4cd0-af26-68da6e56fc7c on n-h2-760456-11 Jul 20 04:39:22.169428 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-75a30e2e-e7fd-4ee7-91d9-53c28486b3f7 req-23781068-1e59-4929-97be-bbfb3632e5d2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037803 Jul 20 04:39:22.170718 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2770/5541] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:22.254952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9dbbffb-283e-4763-8425-f34540efad8c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:22.280965 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c9dbbffb-283e-4763-8425-f34540efad8c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.718010 Jul 20 04:39:22.282459 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2772/5542] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:21 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:22.825991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd5ced2a-ed6f-4e2f-888a-0d3af18a2675 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:22.826738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dd5ced2a-ed6f-4e2f-888a-0d3af18a2675 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:22.833401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd5ced2a-ed6f-4e2f-888a-0d3af18a2675 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.833870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd5ced2a-ed6f-4e2f-888a-0d3af18a2675 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.835437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd5ced2a-ed6f-4e2f-888a-0d3af18a2675 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.835896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd5ced2a-ed6f-4e2f-888a-0d3af18a2675 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.028344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ac1ff92b-c7f2-4c05-b8f3-6807c3da481f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.033907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ac1ff92b-c7f2-4c05-b8f3-6807c3da481f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:23.053529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac1ff92b-c7f2-4c05-b8f3-6807c3da481f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.053958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac1ff92b-c7f2-4c05-b8f3-6807c3da481f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.054793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac1ff92b-c7f2-4c05-b8f3-6807c3da481f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.055236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac1ff92b-c7f2-4c05-b8f3-6807c3da481f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.070535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dd5ced2a-ed6f-4e2f-888a-0d3af18a2675 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.095294 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dd5ced2a-ed6f-4e2f-888a-0d3af18a2675 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1390 microversion: 2.1 time: 0.274256 Jul 20 04:39:23.103247 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2771/5543] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:22 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1390 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:23.146416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b7c89ce-a731-441b-8164-55f42e1a9c98 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.147716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4b7c89ce-a731-441b-8164-55f42e1a9c98 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:23.160145 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ac1ff92b-c7f2-4c05-b8f3-6807c3da481f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141899 Jul 20 04:39:23.161677 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2773/5544] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:23.175569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b7c89ce-a731-441b-8164-55f42e1a9c98 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.176034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b7c89ce-a731-441b-8164-55f42e1a9c98 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.176833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b7c89ce-a731-441b-8164-55f42e1a9c98 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.177281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b7c89ce-a731-441b-8164-55f42e1a9c98 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.208841 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-4b7c89ce-a731-441b-8164-55f42e1a9c98 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] HTTP exception thrown: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b7c89ce-a731-441b-8164-55f42e1a9c98 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Request method failure captured: Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c HTTP/1.1 Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14bdWjW9XU-eGRNzbwrU3n4iOGi4n79frG9XFutEDU0c-fNlwbNFM2rqv8YItr0mXg3FV5creRMpq_V9jEOVXhFFmvdaHWSb0IioEzNCGr0cNXO-0XaT-MW8FhqXLMzbaStBdisWzakRFCi9dkDw9MftAP5ngCq-cMv1r551FXlaPhY Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: db4c52d3efd84040a15ce7c21b03ca0b Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '637bddd3-2067-4cd0-af26-68da6e56fc7c'} Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.211535 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.216371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.216371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.216371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.216371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:23.216371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:23.216371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.216371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.216371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b7c89ce-a731-441b-8164-55f42e1a9c98 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Returning 404 to user: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:23.216371 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4b7c89ce-a731-441b-8164-55f42e1a9c98 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 404 len: 111 microversion: 2.1 time: 0.070539 Jul 20 04:39:23.221649 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2772/5545] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:23.227852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2fb5d8f-f676-4ea3-9c2a-179445281357 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.252300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.compute.server_groups [None req-e2fb5d8f-f676-4ea3-9c2a-179445281357 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Querying cell 0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) for 1 instances {{(pid=119605) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:39:23.257026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2fb5d8f-f676-4ea3-9c2a-179445281357 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.257697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2fb5d8f-f676-4ea3-9c2a-179445281357 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.273509 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e2fb5d8f-f676-4ea3-9c2a-179445281357 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.049720 Jul 20 04:39:23.274697 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2774/5546] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:23.286492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-24f2fd57-a793-4dbd-9bc1-08763a26e476 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.300197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b9b687b-44b7-41ff-90bc-9e1d1d13a054 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.300840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3b9b687b-44b7-41ff-90bc-9e1d1d13a054 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:23.308743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b9b687b-44b7-41ff-90bc-9e1d1d13a054 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.309196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b9b687b-44b7-41ff-90bc-9e1d1d13a054 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.309976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b9b687b-44b7-41ff-90bc-9e1d1d13a054 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.310446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b9b687b-44b7-41ff-90bc-9e1d1d13a054 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.318197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.compute.server_groups [None req-24f2fd57-a793-4dbd-9bc1-08763a26e476 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Querying cell 0ab3dd1d-caba-46da-92a7-0cc28af64ce3(cell1) for 1 instances {{(pid=119606) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:39:23.319856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24f2fd57-a793-4dbd-9bc1-08763a26e476 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.321732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-24f2fd57-a793-4dbd-9bc1-08763a26e476 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.342311 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-24f2fd57-a793-4dbd-9bc1-08763a26e476 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups/bd5cb975-94bb-439b-812b-cccbb2801a2e" status: 200 len: 183 microversion: 2.1 time: 0.059500 Jul 20 04:39:23.343212 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2773/5547] 10.222.0.59 () {58 vars in 1262 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/os-server-groups/bd5cb975-94bb-439b-812b-cccbb2801a2e => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:23.355538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3135fad1-94be-4c06-aa44-ca2178f109d6 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.356317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3135fad1-94be-4c06-aa44-ca2178f109d6 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:23.365299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3135fad1-94be-4c06-aa44-ca2178f109d6 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.375567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3135fad1-94be-4c06-aa44-ca2178f109d6 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.376771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3135fad1-94be-4c06-aa44-ca2178f109d6 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.377394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3135fad1-94be-4c06-aa44-ca2178f109d6 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.400603 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3135fad1-94be-4c06-aa44-ca2178f109d6 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] HTTP exception thrown: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3135fad1-94be-4c06-aa44-ca2178f109d6 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Request method failure captured: Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c HTTP/1.1 Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14bdWjW9XU-eGRNzbwrU3n4iOGi4n79frG9XFutEDU0c-fNlwbNFM2rqv8YItr0mXg3FV5creRMpq_V9jEOVXhFFmvdaHWSb0IioEzNCGr0cNXO-0XaT-MW8FhqXLMzbaStBdisWzakRFCi9dkDw9MftAP5ngCq-cMv1r551FXlaPhY Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: db4c52d3efd84040a15ce7c21b03ca0b Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '637bddd3-2067-4cd0-af26-68da6e56fc7c'} Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:23.404036 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.410104 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.415393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3135fad1-94be-4c06-aa44-ca2178f109d6 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Returning 404 to user: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:23.416887 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3135fad1-94be-4c06-aa44-ca2178f109d6 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 404 len: 111 microversion: 2.1 time: 0.065234 Jul 20 04:39:23.418668 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2774/5548] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:39:23 2022] DELETE /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:23.448391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a696893c-ce52-433e-a920-29f24c73d5a4 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.449339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a696893c-ce52-433e-a920-29f24c73d5a4 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] [instance: 637bddd3-2067-4cd0-af26-68da6e56fc7c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:23.457479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a696893c-ce52-433e-a920-29f24c73d5a4 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.458286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a696893c-ce52-433e-a920-29f24c73d5a4 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.459285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a696893c-ce52-433e-a920-29f24c73d5a4 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.460101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a696893c-ce52-433e-a920-29f24c73d5a4 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.492666 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a696893c-ce52-433e-a920-29f24c73d5a4 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] HTTP exception thrown: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a696893c-ce52-433e-a920-29f24c73d5a4 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Request method failure captured: Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c HTTP/1.1 Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14bdWjW9XU-eGRNzbwrU3n4iOGi4n79frG9XFutEDU0c-fNlwbNFM2rqv8YItr0mXg3FV5creRMpq_V9jEOVXhFFmvdaHWSb0IioEzNCGr0cNXO-0XaT-MW8FhqXLMzbaStBdisWzakRFCi9dkDw9MftAP5ngCq-cMv1r551FXlaPhY Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: db4c52d3efd84040a15ce7c21b03ca0b Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '637bddd3-2067-4cd0-af26-68da6e56fc7c'} Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.495235 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.499899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.499899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.499899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.499899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:23.499899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:23.499899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. Jul 20 04:39:23.499899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.501559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a696893c-ce52-433e-a920-29f24c73d5a4 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Returning 404 to user: Instance 637bddd3-2067-4cd0-af26-68da6e56fc7c could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:23.502795 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a696893c-ce52-433e-a920-29f24c73d5a4 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c" status: 404 len: 111 microversion: 2.1 time: 0.081071 Jul 20 04:39:23.519002 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2775/5549] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/servers/637bddd3-2067-4cd0-af26-68da6e56fc7c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:39:23.526133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dbde8ff3-7a87-40b9-8b25-5ecbce15cde9 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.534212 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-dbde8ff3-7a87-40b9-8b25-5ecbce15cde9 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] HTTP exception thrown: Instance group 792103f0-a61e-4793-afb1-1f3a6eeb6e57 could not be found. Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dbde8ff3-7a87-40b9-8b25-5ecbce15cde9 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Request method failure captured: Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-server-groups/792103f0-a61e-4793-afb1-1f3a6eeb6e57 HTTP/1.1 Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14bdWjW9XU-eGRNzbwrU3n4iOGi4n79frG9XFutEDU0c-fNlwbNFM2rqv8YItr0mXg3FV5creRMpq_V9jEOVXhFFmvdaHWSb0IioEzNCGr0cNXO-0XaT-MW8FhqXLMzbaStBdisWzakRFCi9dkDw9MftAP5ngCq-cMv1r551FXlaPhY Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: db4c52d3efd84040a15ce7c21b03ca0b Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance group 792103f0-a61e-4793-afb1-1f3a6eeb6e57 could not be found. Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '792103f0-a61e-4793-afb1-1f3a6eeb6e57'} Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 792103f0-a61e-4793-afb1-1f3a6eeb6e57 could not be found. Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 792103f0-a61e-4793-afb1-1f3a6eeb6e57 could not be found. Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.536167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.541504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.541504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.541504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:23.541504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:23.541504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 792103f0-a61e-4793-afb1-1f3a6eeb6e57 could not be found. Jul 20 04:39:23.541504 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.543191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dbde8ff3-7a87-40b9-8b25-5ecbce15cde9 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Returning 404 to user: Instance group 792103f0-a61e-4793-afb1-1f3a6eeb6e57 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:23.544267 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dbde8ff3-7a87-40b9-8b25-5ecbce15cde9 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/792103f0-a61e-4793-afb1-1f3a6eeb6e57" status: 404 len: 117 microversion: 2.1 time: 0.023905 Jul 20 04:39:23.545050 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2776/5550] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:39:23 2022] DELETE /compute/v2.1/os-server-groups/792103f0-a61e-4793-afb1-1f3a6eeb6e57 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:23.556767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b6d66ef8-2855-4dea-a6c0-6e64dfb26d27 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.565938 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-b6d66ef8-2855-4dea-a6c0-6e64dfb26d27 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] HTTP exception thrown: Instance group a9c49a7e-89de-4482-a12a-30cfa73899ad could not be found. Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b6d66ef8-2855-4dea-a6c0-6e64dfb26d27 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Request method failure captured: Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-server-groups/a9c49a7e-89de-4482-a12a-30cfa73899ad HTTP/1.1 Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14bdWjW9XU-eGRNzbwrU3n4iOGi4n79frG9XFutEDU0c-fNlwbNFM2rqv8YItr0mXg3FV5creRMpq_V9jEOVXhFFmvdaHWSb0IioEzNCGr0cNXO-0XaT-MW8FhqXLMzbaStBdisWzakRFCi9dkDw9MftAP5ngCq-cMv1r551FXlaPhY Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: db4c52d3efd84040a15ce7c21b03ca0b Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance group a9c49a7e-89de-4482-a12a-30cfa73899ad could not be found. Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'a9c49a7e-89de-4482-a12a-30cfa73899ad'} Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a9c49a7e-89de-4482-a12a-30cfa73899ad could not be found. Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a9c49a7e-89de-4482-a12a-30cfa73899ad could not be found. Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.568747 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.573777 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.573777 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.573777 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:23.573777 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:23.573777 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a9c49a7e-89de-4482-a12a-30cfa73899ad could not be found. Jul 20 04:39:23.573777 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.575818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b6d66ef8-2855-4dea-a6c0-6e64dfb26d27 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Returning 404 to user: Instance group a9c49a7e-89de-4482-a12a-30cfa73899ad could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:23.589984 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b6d66ef8-2855-4dea-a6c0-6e64dfb26d27 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/a9c49a7e-89de-4482-a12a-30cfa73899ad" status: 404 len: 117 microversion: 2.1 time: 0.040746 Jul 20 04:39:23.591435 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2777/5551] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:39:23 2022] DELETE /compute/v2.1/os-server-groups/a9c49a7e-89de-4482-a12a-30cfa73899ad => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:23.602676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5057f8c7-dab8-4a5b-a743-e0d78e6b5a82 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.619950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:23.621763 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5057f8c7-dab8-4a5b-a743-e0d78e6b5a82 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] HTTP exception thrown: Instance group ede70c5e-755b-4d76-a93e-bfd39040e5f6 could not be found. Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5057f8c7-dab8-4a5b-a743-e0d78e6b5a82 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Request method failure captured: Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-server-groups/ede70c5e-755b-4d76-a93e-bfd39040e5f6 HTTP/1.1 Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14bdWjW9XU-eGRNzbwrU3n4iOGi4n79frG9XFutEDU0c-fNlwbNFM2rqv8YItr0mXg3FV5creRMpq_V9jEOVXhFFmvdaHWSb0IioEzNCGr0cNXO-0XaT-MW8FhqXLMzbaStBdisWzakRFCi9dkDw9MftAP5ngCq-cMv1r551FXlaPhY Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: db4c52d3efd84040a15ce7c21b03ca0b Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance group ede70c5e-755b-4d76-a93e-bfd39040e5f6 could not be found. Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'ede70c5e-755b-4d76-a93e-bfd39040e5f6'} Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ede70c5e-755b-4d76-a93e-bfd39040e5f6 could not be found. Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ede70c5e-755b-4d76-a93e-bfd39040e5f6 could not be found. Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.624037 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.628987 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.628987 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.628987 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:23.628987 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:23.628987 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ede70c5e-755b-4d76-a93e-bfd39040e5f6 could not be found. Jul 20 04:39:23.628987 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.630166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5057f8c7-dab8-4a5b-a743-e0d78e6b5a82 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Returning 404 to user: Instance group ede70c5e-755b-4d76-a93e-bfd39040e5f6 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:23.631218 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5057f8c7-dab8-4a5b-a743-e0d78e6b5a82 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/ede70c5e-755b-4d76-a93e-bfd39040e5f6" status: 404 len: 117 microversion: 2.1 time: 0.036268 Jul 20 04:39:23.637125 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2778/5552] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:39:23 2022] DELETE /compute/v2.1/os-server-groups/ede70c5e-755b-4d76-a93e-bfd39040e5f6 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:39:23.653761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3b9b687b-44b7-41ff-90bc-9e1d1d13a054 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.657446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-864e7432-a6f1-4d2d-a6f8-98800ab0d4a9 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.673619 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3b9b687b-44b7-41ff-90bc-9e1d1d13a054 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.377990 Jul 20 04:39:23.674823 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2775/5553] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:23.680597 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-864e7432-a6f1-4d2d-a6f8-98800ab0d4a9 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] HTTP exception thrown: Instance group 694e1b23-4f87-419f-b895-d89609398cb8 could not be found. Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-864e7432-a6f1-4d2d-a6f8-98800ab0d4a9 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Request method failure captured: Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/os-server-groups/694e1b23-4f87-419f-b895-d89609398cb8 HTTP/1.1 Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14bdWjW9XU-eGRNzbwrU3n4iOGi4n79frG9XFutEDU0c-fNlwbNFM2rqv8YItr0mXg3FV5creRMpq_V9jEOVXhFFmvdaHWSb0IioEzNCGr0cNXO-0XaT-MW8FhqXLMzbaStBdisWzakRFCi9dkDw9MftAP5ngCq-cMv1r551FXlaPhY Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_175a1c6c46ff4f97879bb56fdb9d42a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 175a1c6c46ff4f97879bb56fdb9d42a5 Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerGroupTestJSON-1992787064 Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: db4c52d3efd84040a15ce7c21b03ca0b Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerGroupTestJSON-1992787064-project Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance group 694e1b23-4f87-419f-b895-d89609398cb8 could not be found. Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '694e1b23-4f87-419f-b895-d89609398cb8'} Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 694e1b23-4f87-419f-b895-d89609398cb8 could not be found. Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 694e1b23-4f87-419f-b895-d89609398cb8 could not be found. Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.689848 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:23.698015 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:23.698015 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:23.698015 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:23.698015 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:23.698015 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 694e1b23-4f87-419f-b895-d89609398cb8 could not be found. Jul 20 04:39:23.698015 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:23.698015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-864e7432-a6f1-4d2d-a6f8-98800ab0d4a9 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Returning 404 to user: Instance group 694e1b23-4f87-419f-b895-d89609398cb8 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:23.698015 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-864e7432-a6f1-4d2d-a6f8-98800ab0d4a9 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/694e1b23-4f87-419f-b895-d89609398cb8" status: 404 len: 117 microversion: 2.1 time: 0.050382 Jul 20 04:39:23.701608 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2779/5554] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:39:23 2022] DELETE /compute/v2.1/os-server-groups/694e1b23-4f87-419f-b895-d89609398cb8 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:23.709209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8aa33fb4-f7a5-440f-84ca-5e2aa7336bf1 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.786640 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8aa33fb4-f7a5-440f-84ca-5e2aa7336bf1 tempest-ServerGroupTestJSON-1992787064 tempest-ServerGroupTestJSON-1992787064-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/bd5cb975-94bb-439b-812b-cccbb2801a2e" status: 204 len: 0 microversion: 2.1 time: 0.086696 Jul 20 04:39:23.787663 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2776/5555] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:39:23 2022] DELETE /compute/v2.1/os-server-groups/bd5cb975-94bb-439b-812b-cccbb2801a2e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:39:23.859835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e2deb655-9536-4aa3-97bf-8d0d4221dc5e req-2279cb7d-29a6-4687-9862-72f3d3812810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a908c5-87f5-4228-9815-f47c1195c4a6", "name": "network-vif-plugged", "status": "completed", "tag": "4d0e27c2-3182-484f-abb7-ff3d69355c02"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:23.875288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e2deb655-9536-4aa3-97bf-8d0d4221dc5e req-2279cb7d-29a6-4687-9862-72f3d3812810 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.876082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e2deb655-9536-4aa3-97bf-8d0d4221dc5e req-2279cb7d-29a6-4687-9862-72f3d3812810 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.941319 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e2deb655-9536-4aa3-97bf-8d0d4221dc5e req-2279cb7d-29a6-4687-9862-72f3d3812810 service nova] Creating event network-vif-plugged:4d0e27c2-3182-484f-abb7-ff3d69355c02 for instance 70a908c5-87f5-4228-9815-f47c1195c4a6 on n-h1-760456-11 Jul 20 04:39:23.960313 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e2deb655-9536-4aa3-97bf-8d0d4221dc5e req-2279cb7d-29a6-4687-9862-72f3d3812810 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103386 Jul 20 04:39:23.974620 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2780/5556] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:24.120229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a8a6c97d-65c2-4504-9c54-ea40e689c100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:24.121852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a8a6c97d-65c2-4504-9c54-ea40e689c100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:24.140667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8a6c97d-65c2-4504-9c54-ea40e689c100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.141494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8a6c97d-65c2-4504-9c54-ea40e689c100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.144814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8a6c97d-65c2-4504-9c54-ea40e689c100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.145557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8a6c97d-65c2-4504-9c54-ea40e689c100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.172866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-37b8ed95-e3d8-4ea5-9915-cc9fe0949e78 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:24.173887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-37b8ed95-e3d8-4ea5-9915-cc9fe0949e78 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:24.189278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37b8ed95-e3d8-4ea5-9915-cc9fe0949e78 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.189765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37b8ed95-e3d8-4ea5-9915-cc9fe0949e78 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.190611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37b8ed95-e3d8-4ea5-9915-cc9fe0949e78 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.195223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-37b8ed95-e3d8-4ea5-9915-cc9fe0949e78 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.317446 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-37b8ed95-e3d8-4ea5-9915-cc9fe0949e78 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148887 Jul 20 04:39:24.318062 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2781/5557] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:39:24 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:39:24.467413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a8a6c97d-65c2-4504-9c54-ea40e689c100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:24.481181 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a8a6c97d-65c2-4504-9c54-ea40e689c100 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1390 microversion: 2.1 time: 0.366688 Jul 20 04:39:24.483388 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2777/5558] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:24 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1390 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:24.693139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-900b5414-52bf-46d7-b746-156347daaf50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:24.693399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-900b5414-52bf-46d7-b746-156347daaf50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:24.704990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-900b5414-52bf-46d7-b746-156347daaf50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.705400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-900b5414-52bf-46d7-b746-156347daaf50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.706229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-900b5414-52bf-46d7-b746-156347daaf50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.706762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-900b5414-52bf-46d7-b746-156347daaf50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:25.066959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-900b5414-52bf-46d7-b746-156347daaf50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:25.077951 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-900b5414-52bf-46d7-b746-156347daaf50 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.389629 Jul 20 04:39:25.079870 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2782/5559] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:24 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:25.331597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1222e5b0-5e13-4ebe-8dd8-6d48ca2bbdf3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:25.332957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1222e5b0-5e13-4ebe-8dd8-6d48ca2bbdf3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:25.344845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1222e5b0-5e13-4ebe-8dd8-6d48ca2bbdf3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:25.349613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1222e5b0-5e13-4ebe-8dd8-6d48ca2bbdf3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:25.351471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1222e5b0-5e13-4ebe-8dd8-6d48ca2bbdf3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:25.352284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1222e5b0-5e13-4ebe-8dd8-6d48ca2bbdf3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:25.426603 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1222e5b0-5e13-4ebe-8dd8-6d48ca2bbdf3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100736 Jul 20 04:39:25.429150 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2778/5560] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:39:25 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:25.503783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3472d766-665d-4172-83a3-bd905c2c1648 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:25.504416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3472d766-665d-4172-83a3-bd905c2c1648 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:25.521797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3472d766-665d-4172-83a3-bd905c2c1648 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:25.535527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3472d766-665d-4172-83a3-bd905c2c1648 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:25.536573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3472d766-665d-4172-83a3-bd905c2c1648 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:25.542827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3472d766-665d-4172-83a3-bd905c2c1648 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.052897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3472d766-665d-4172-83a3-bd905c2c1648 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:26.062889 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3472d766-665d-4172-83a3-bd905c2c1648 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1562 microversion: 2.1 time: 0.566229 Jul 20 04:39:26.066039 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2783/5561] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:25 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1562 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:26.088322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8bce77e5-55e6-4cb7-bd16-48ed9c002271 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:26.089646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8bce77e5-55e6-4cb7-bd16-48ed9c002271 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:26.104962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5de5022c-4e2b-4b30-8808-9f9c4a9c1d24 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:26.105925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5de5022c-4e2b-4b30-8808-9f9c4a9c1d24 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:26.107520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bce77e5-55e6-4cb7-bd16-48ed9c002271 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.108105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bce77e5-55e6-4cb7-bd16-48ed9c002271 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.108927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bce77e5-55e6-4cb7-bd16-48ed9c002271 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.109518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8bce77e5-55e6-4cb7-bd16-48ed9c002271 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.120325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5de5022c-4e2b-4b30-8808-9f9c4a9c1d24 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.123992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5de5022c-4e2b-4b30-8808-9f9c4a9c1d24 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.125452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5de5022c-4e2b-4b30-8808-9f9c4a9c1d24 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.134224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5de5022c-4e2b-4b30-8808-9f9c4a9c1d24 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.436036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8bce77e5-55e6-4cb7-bd16-48ed9c002271 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:26.447019 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8bce77e5-55e6-4cb7-bd16-48ed9c002271 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1562 microversion: 2.1 time: 0.366318 Jul 20 04:39:26.462223 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2779/5562] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:26 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1562 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:26.473798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c69c4ede-46ea-450e-858a-4b47c7cc8875 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:26.475556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c69c4ede-46ea-450e-858a-4b47c7cc8875 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:26.487756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c69c4ede-46ea-450e-858a-4b47c7cc8875 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.488462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c69c4ede-46ea-450e-858a-4b47c7cc8875 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.489628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c69c4ede-46ea-450e-858a-4b47c7cc8875 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.508149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c69c4ede-46ea-450e-858a-4b47c7cc8875 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.630242 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c69c4ede-46ea-450e-858a-4b47c7cc8875 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.160977 Jul 20 04:39:26.636761 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2780/5563] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:39:26 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f/os-volume_attachments => generated 25 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:39:26.749991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-77087893-3783-4143-b676-2f4620460f11 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:26.750800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-77087893-3783-4143-b676-2f4620460f11 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:26.758966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77087893-3783-4143-b676-2f4620460f11 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.759948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77087893-3783-4143-b676-2f4620460f11 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.761002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77087893-3783-4143-b676-2f4620460f11 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.761669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77087893-3783-4143-b676-2f4620460f11 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.811062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-77087893-3783-4143-b676-2f4620460f11 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:39:27.022412 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-77087893-3783-4143-b676-2f4620460f11 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 204 len: 0 microversion: 2.1 time: 0.282333 Jul 20 04:39:27.023119 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2781/5564] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:39:26 2022] DELETE /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:39:27.032028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d04320bc-ccc1-4d46-a970-f62893d9fd47 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:27.032740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d04320bc-ccc1-4d46-a970-f62893d9fd47 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:27.046800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d04320bc-ccc1-4d46-a970-f62893d9fd47 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:27.050016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d04320bc-ccc1-4d46-a970-f62893d9fd47 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:27.051328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d04320bc-ccc1-4d46-a970-f62893d9fd47 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:27.060164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d04320bc-ccc1-4d46-a970-f62893d9fd47 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:27.247686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5de5022c-4e2b-4b30-8808-9f9c4a9c1d24 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:27.261192 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5de5022c-4e2b-4b30-8808-9f9c4a9c1d24 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 1.164924 Jul 20 04:39:27.274361 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2784/5565] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:26 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:27.352418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d04320bc-ccc1-4d46-a970-f62893d9fd47 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:27.362855 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d04320bc-ccc1-4d46-a970-f62893d9fd47 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1680 microversion: 2.1 time: 0.334453 Jul 20 04:39:27.364112 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2782/5566] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:27 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:28.288705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4e527a31-974f-4981-91c3-4092d5993183 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:28.289545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4e527a31-974f-4981-91c3-4092d5993183 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:28.299057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e527a31-974f-4981-91c3-4092d5993183 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.304813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e527a31-974f-4981-91c3-4092d5993183 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.306367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e527a31-974f-4981-91c3-4092d5993183 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.307577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4e527a31-974f-4981-91c3-4092d5993183 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.388059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca2b6078-1a44-4eac-87a8-07ece36086a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:28.388696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ca2b6078-1a44-4eac-87a8-07ece36086a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:28.402688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca2b6078-1a44-4eac-87a8-07ece36086a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.403154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca2b6078-1a44-4eac-87a8-07ece36086a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.403946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca2b6078-1a44-4eac-87a8-07ece36086a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.404396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca2b6078-1a44-4eac-87a8-07ece36086a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.823391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ca2b6078-1a44-4eac-87a8-07ece36086a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:28.831465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4e527a31-974f-4981-91c3-4092d5993183 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:28.836525 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ca2b6078-1a44-4eac-87a8-07ece36086a6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1680 microversion: 2.1 time: 0.452260 Jul 20 04:39:28.838554 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2783/5567] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:28 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1680 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:28.841944 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4e527a31-974f-4981-91c3-4092d5993183 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.557453 Jul 20 04:39:28.844898 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2785/5568] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:28 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:29.856370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-31cf571d-601a-4fa3-96b7-e350446c5359 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:29.856988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-31cf571d-601a-4fa3-96b7-e350446c5359 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:29.859862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2d99fda1-6080-4270-83fc-7b86374efcde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:29.860721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2d99fda1-6080-4270-83fc-7b86374efcde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:29.868622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d99fda1-6080-4270-83fc-7b86374efcde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.868854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31cf571d-601a-4fa3-96b7-e350446c5359 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.869074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d99fda1-6080-4270-83fc-7b86374efcde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.869869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d99fda1-6080-4270-83fc-7b86374efcde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.870462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31cf571d-601a-4fa3-96b7-e350446c5359 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.871553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31cf571d-601a-4fa3-96b7-e350446c5359 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.872981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-31cf571d-601a-4fa3-96b7-e350446c5359 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.883151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2d99fda1-6080-4270-83fc-7b86374efcde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.327090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2d99fda1-6080-4270-83fc-7b86374efcde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:30.335667 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2d99fda1-6080-4270-83fc-7b86374efcde tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.479867 Jul 20 04:39:30.336264 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2786/5569] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:29 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:30.402913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-31cf571d-601a-4fa3-96b7-e350446c5359 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:30.425116 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-31cf571d-601a-4fa3-96b7-e350446c5359 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1680 microversion: 2.1 time: 0.573438 Jul 20 04:39:30.425741 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2784/5570] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:29 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1680 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:30.640058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-05d3d954-f1c8-4316-9c83-ba862132aace tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:30.643336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-05d3d954-f1c8-4316-9c83-ba862132aace tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:30.656787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f7fd1d39-0e9b-4f08-9d32-66115268549b req-0059e38f-7844-40ea-b864-4609aca9568b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a908c5-87f5-4228-9815-f47c1195c4a6", "tag": "4d0e27c2-3182-484f-abb7-ff3d69355c02"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:30.675522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f7fd1d39-0e9b-4f08-9d32-66115268549b req-0059e38f-7844-40ea-b864-4609aca9568b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.675977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f7fd1d39-0e9b-4f08-9d32-66115268549b req-0059e38f-7844-40ea-b864-4609aca9568b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.682355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05d3d954-f1c8-4316-9c83-ba862132aace tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.682834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05d3d954-f1c8-4316-9c83-ba862132aace tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.683657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05d3d954-f1c8-4316-9c83-ba862132aace tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.684102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05d3d954-f1c8-4316-9c83-ba862132aace tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.745239 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f7fd1d39-0e9b-4f08-9d32-66115268549b req-0059e38f-7844-40ea-b864-4609aca9568b service nova] Creating event network-changed:4d0e27c2-3182-484f-abb7-ff3d69355c02 for instance 70a908c5-87f5-4228-9815-f47c1195c4a6 on n-h1-760456-11 Jul 20 04:39:30.768022 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f7fd1d39-0e9b-4f08-9d32-66115268549b req-0059e38f-7844-40ea-b864-4609aca9568b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115319 Jul 20 04:39:30.776576 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2785/5571] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:39:31.356282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d98c2b69-8f0a-4096-ad5b-0fcdcd93098f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:31.357030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d98c2b69-8f0a-4096-ad5b-0fcdcd93098f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:31.375985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d98c2b69-8f0a-4096-ad5b-0fcdcd93098f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:31.376454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d98c2b69-8f0a-4096-ad5b-0fcdcd93098f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:31.377251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d98c2b69-8f0a-4096-ad5b-0fcdcd93098f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:31.377699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d98c2b69-8f0a-4096-ad5b-0fcdcd93098f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:31.681445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-05d3d954-f1c8-4316-9c83-ba862132aace tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:31.695404 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-05d3d954-f1c8-4316-9c83-ba862132aace tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1562 microversion: 2.1 time: 1.059647 Jul 20 04:39:31.696237 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2787/5572] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:30 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1562 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:31.701586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-25ba4783-3d01-42a2-993c-98553b9293cc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:31.702432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-25ba4783-3d01-42a2-993c-98553b9293cc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:31.710493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25ba4783-3d01-42a2-993c-98553b9293cc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:31.711619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25ba4783-3d01-42a2-993c-98553b9293cc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:31.715189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25ba4783-3d01-42a2-993c-98553b9293cc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:31.715847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25ba4783-3d01-42a2-993c-98553b9293cc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:32.094707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-25ba4783-3d01-42a2-993c-98553b9293cc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:32.113046 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-25ba4783-3d01-42a2-993c-98553b9293cc tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1613 microversion: 2.1 time: 0.415379 Jul 20 04:39:32.116741 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2788/5573] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:31 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1613 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:32.396020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9c01ba96-00cf-4c6c-8c0e-f701c785c452 req-464aea62-f0db-4429-bd4c-9f90c262aeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38047d01-1308-49f6-8f31-61300f51932f", "name": "network-vif-deleted", "tag": "15c17885-7385-4e33-b285-af310284a1a9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:32.428965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9c01ba96-00cf-4c6c-8c0e-f701c785c452 req-464aea62-f0db-4429-bd4c-9f90c262aeb3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:32.432069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9c01ba96-00cf-4c6c-8c0e-f701c785c452 req-464aea62-f0db-4429-bd4c-9f90c262aeb3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:32.465869 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9c01ba96-00cf-4c6c-8c0e-f701c785c452 req-464aea62-f0db-4429-bd4c-9f90c262aeb3 service nova] Creating event network-vif-deleted:15c17885-7385-4e33-b285-af310284a1a9 for instance 38047d01-1308-49f6-8f31-61300f51932f on n-h1-760456-11 Jul 20 04:39:32.479555 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9c01ba96-00cf-4c6c-8c0e-f701c785c452 req-464aea62-f0db-4429-bd4c-9f90c262aeb3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088719 Jul 20 04:39:32.483032 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2789/5574] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:39:32.673206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d98c2b69-8f0a-4096-ad5b-0fcdcd93098f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:32.704195 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d98c2b69-8f0a-4096-ad5b-0fcdcd93098f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 1.354455 Jul 20 04:39:32.705928 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2786/5575] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:31 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:33.135024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:33.140097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:33.184801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:33.191185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:33.192924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:33.199104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:33.352583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:33.355015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:33.382372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lazy-loading 'fault' on Instance uuid 38047d01-1308-49f6-8f31-61300f51932f {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:33.509149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd10ebbd2fd4ef693e15194c2d8912c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e104a7716d8549cb8b99560ac90150c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:33.524397 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7293c8ee-55c6-4954-8b3f-cdf03c854fa6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 200 len: 1330 microversion: 2.1 time: 0.393680 Jul 20 04:39:33.526385 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2790/5576] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:33 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 1330 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:33.723390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-339b1a82-28c2-4f26-a165-765122c249b1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:33.727028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-339b1a82-28c2-4f26-a165-765122c249b1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:33.741489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-339b1a82-28c2-4f26-a165-765122c249b1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:33.750087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-339b1a82-28c2-4f26-a165-765122c249b1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:33.764631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-339b1a82-28c2-4f26-a165-765122c249b1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:33.765343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-339b1a82-28c2-4f26-a165-765122c249b1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:34.172964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-339b1a82-28c2-4f26-a165-765122c249b1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:34.198192 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-339b1a82-28c2-4f26-a165-765122c249b1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.478622 Jul 20 04:39:34.217185 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2787/5577] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:33 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:34.544257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c0ceaf8-38a8-4e54-b030-8c83084a2e4e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:34.545193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0c0ceaf8-38a8-4e54-b030-8c83084a2e4e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:34.566487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c0ceaf8-38a8-4e54-b030-8c83084a2e4e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:34.566962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c0ceaf8-38a8-4e54-b030-8c83084a2e4e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:34.577690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c0ceaf8-38a8-4e54-b030-8c83084a2e4e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:34.579318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c0ceaf8-38a8-4e54-b030-8c83084a2e4e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:34.628449 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-0c0ceaf8-38a8-4e54-b030-8c83084a2e4e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c0ceaf8-38a8-4e54-b030-8c83084a2e4e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f HTTP/1.1 Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '38047d01-1308-49f6-8f31-61300f51932f'} Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:34.636234 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:34.640812 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:34.640812 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:34.640812 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:34.640812 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:34.640812 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:34.640812 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:34.640812 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:39:34.640812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c0ceaf8-38a8-4e54-b030-8c83084a2e4e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:34.640812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0c0ceaf8-38a8-4e54-b030-8c83084a2e4e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 404 len: 111 microversion: 2.1 time: 0.098887 Jul 20 04:39:34.647877 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2791/5578] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:34 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:34.655486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56c1f87e-f152-420f-8e83-6f1e7bda5b9c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '.version_select at 0x7fb8411dc3a0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:34.692023 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-56c1f87e-f152-420f-8e83-6f1e7bda5b9c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-485717078" status: 202 len: 0 microversion: 2.1 time: 0.046097 Jul 20 04:39:34.693261 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2788/5579] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 04:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-485717078 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:39:35.227834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30f547b6-0355-4c44-9766-661cc138d42d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:35.227834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-30f547b6-0355-4c44-9766-661cc138d42d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:35.228207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30f547b6-0355-4c44-9766-661cc138d42d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.228924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30f547b6-0355-4c44-9766-661cc138d42d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.231547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30f547b6-0355-4c44-9766-661cc138d42d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.235526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30f547b6-0355-4c44-9766-661cc138d42d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.513670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-30f547b6-0355-4c44-9766-661cc138d42d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:35.536138 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-30f547b6-0355-4c44-9766-661cc138d42d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.309638 Jul 20 04:39:35.536138 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2792/5580] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:35 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:35.856080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4fa76018-dd73-46bc-9b24-4a51e373addb req-3f533e35-bbbd-4d86-b999-647ddb092a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02", "name": "network-vif-plugged", "status": "completed", "tag": "dbad2823-16de-4145-93a7-2756ed39d393"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:35.871164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:35.891795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4fa76018-dd73-46bc-9b24-4a51e373addb req-3f533e35-bbbd-4d86-b999-647ddb092a24 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.892266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4fa76018-dd73-46bc-9b24-4a51e373addb req-3f533e35-bbbd-4d86-b999-647ddb092a24 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.970097 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4fa76018-dd73-46bc-9b24-4a51e373addb req-3f533e35-bbbd-4d86-b999-647ddb092a24 service nova] Creating event network-vif-plugged:dbad2823-16de-4145-93a7-2756ed39d393 for instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 on n-h1-760456-11 Jul 20 04:39:35.981223 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4fa76018-dd73-46bc-9b24-4a51e373addb req-3f533e35-bbbd-4d86-b999-647ddb092a24 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128978 Jul 20 04:39:35.992944 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2789/5581] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:36.546670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7744bade-6316-44db-a00e-f77082509a6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:36.548365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7744bade-6316-44db-a00e-f77082509a6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:36.580707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7744bade-6316-44db-a00e-f77082509a6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:36.581505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7744bade-6316-44db-a00e-f77082509a6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:36.583288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7744bade-6316-44db-a00e-f77082509a6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:36.587006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7744bade-6316-44db-a00e-f77082509a6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:36.595321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:36.970927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7744bade-6316-44db-a00e-f77082509a6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:37.019312 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7744bade-6316-44db-a00e-f77082509a6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.478253 Jul 20 04:39:37.025546 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2793/5582] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:36 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:38.044625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aca907a8-b586-40b2-8880-83bffadd333e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:38.046550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aca907a8-b586-40b2-8880-83bffadd333e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:38.081151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aca907a8-b586-40b2-8880-83bffadd333e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:38.081641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aca907a8-b586-40b2-8880-83bffadd333e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:38.092363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aca907a8-b586-40b2-8880-83bffadd333e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:38.096177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aca907a8-b586-40b2-8880-83bffadd333e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:38.441674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aca907a8-b586-40b2-8880-83bffadd333e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:38.450821 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aca907a8-b586-40b2-8880-83bffadd333e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.411746 Jul 20 04:39:38.469922 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2790/5583] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:38 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:39.471868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b5d15a89-5102-477b-b301-294ff5a1363a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:39.473296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b5d15a89-5102-477b-b301-294ff5a1363a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:39.488759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5d15a89-5102-477b-b301-294ff5a1363a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:39.494079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5d15a89-5102-477b-b301-294ff5a1363a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:39.496607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5d15a89-5102-477b-b301-294ff5a1363a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:39.499143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5d15a89-5102-477b-b301-294ff5a1363a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.152973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b5d15a89-5102-477b-b301-294ff5a1363a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:40.161442 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b5d15a89-5102-477b-b301-294ff5a1363a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.693671 Jul 20 04:39:40.167171 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2794/5584] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:39 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:41.182658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4f5298ac-a980-4b4e-adf4-01e9cd06a97e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:41.184128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4f5298ac-a980-4b4e-adf4-01e9cd06a97e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:41.201203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f5298ac-a980-4b4e-adf4-01e9cd06a97e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:41.204164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f5298ac-a980-4b4e-adf4-01e9cd06a97e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:41.206814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f5298ac-a980-4b4e-adf4-01e9cd06a97e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:41.208891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f5298ac-a980-4b4e-adf4-01e9cd06a97e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:41.270041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:42.001096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f5298ac-a980-4b4e-adf4-01e9cd06a97e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:42.018263 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4f5298ac-a980-4b4e-adf4-01e9cd06a97e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.841962 Jul 20 04:39:42.026682 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2791/5585] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:41 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:43.050234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a36bb66f-5afc-41bb-82b8-e4b1d78cc236 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:43.053688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a36bb66f-5afc-41bb-82b8-e4b1d78cc236 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:43.074826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a36bb66f-5afc-41bb-82b8-e4b1d78cc236 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.075689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a36bb66f-5afc-41bb-82b8-e4b1d78cc236 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.078243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a36bb66f-5afc-41bb-82b8-e4b1d78cc236 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.080486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a36bb66f-5afc-41bb-82b8-e4b1d78cc236 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.209584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa754d86-d8b8-4975-9f95-483d81e8ec3e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:43.210927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aa754d86-d8b8-4975-9f95-483d81e8ec3e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:43.236795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa754d86-d8b8-4975-9f95-483d81e8ec3e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.238433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa754d86-d8b8-4975-9f95-483d81e8ec3e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.242941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa754d86-d8b8-4975-9f95-483d81e8ec3e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.246030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa754d86-d8b8-4975-9f95-483d81e8ec3e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.307543 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-aa754d86-d8b8-4975-9f95-483d81e8ec3e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa754d86-d8b8-4975-9f95-483d81e8ec3e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f HTTP/1.1 Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '38047d01-1308-49f6-8f31-61300f51932f'} Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:43.321995 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:43.326084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa754d86-d8b8-4975-9f95-483d81e8ec3e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:43.340137 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aa754d86-d8b8-4975-9f95-483d81e8ec3e tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 404 len: 111 microversion: 2.1 time: 0.142898 Jul 20 04:39:43.351652 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2792/5586] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:39:43 2022] DELETE /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:39:43.376850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f8eaf69e-6d26-4817-a2a0-4acde77f54f6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:43.380114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f8eaf69e-6d26-4817-a2a0-4acde77f54f6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 38047d01-1308-49f6-8f31-61300f51932f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:43.407532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8eaf69e-6d26-4817-a2a0-4acde77f54f6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.411407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8eaf69e-6d26-4817-a2a0-4acde77f54f6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.414608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8eaf69e-6d26-4817-a2a0-4acde77f54f6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.418131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8eaf69e-6d26-4817-a2a0-4acde77f54f6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.483630 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-f8eaf69e-6d26-4817-a2a0-4acde77f54f6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f8eaf69e-6d26-4817-a2a0-4acde77f54f6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f HTTP/1.1 Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '38047d01-1308-49f6-8f31-61300f51932f'} Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:43.488755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:43.493885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:43.493885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:43.493885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:43.493885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:43.493885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:43.493885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. Jul 20 04:39:43.493885 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:43.502954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f8eaf69e-6d26-4817-a2a0-4acde77f54f6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance 38047d01-1308-49f6-8f31-61300f51932f could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:43.510711 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f8eaf69e-6d26-4817-a2a0-4acde77f54f6 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f" status: 404 len: 111 microversion: 2.1 time: 0.157552 Jul 20 04:39:43.513122 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2793/5587] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:43 2022] GET /compute/v2.1/servers/38047d01-1308-49f6-8f31-61300f51932f => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:44.353558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a36bb66f-5afc-41bb-82b8-e4b1d78cc236 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:44.371107 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a36bb66f-5afc-41bb-82b8-e4b1d78cc236 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 1.338584 Jul 20 04:39:44.372583 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2795/5588] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:43 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:45.390861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ce66f00b-43c5-40db-8296-56b6aafc1d3f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:45.391490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ce66f00b-43c5-40db-8296-56b6aafc1d3f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:45.404949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce66f00b-43c5-40db-8296-56b6aafc1d3f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:45.405416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce66f00b-43c5-40db-8296-56b6aafc1d3f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:45.406218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce66f00b-43c5-40db-8296-56b6aafc1d3f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:45.428357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce66f00b-43c5-40db-8296-56b6aafc1d3f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:46.154158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ce66f00b-43c5-40db-8296-56b6aafc1d3f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:46.170558 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ce66f00b-43c5-40db-8296-56b6aafc1d3f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.783498 Jul 20 04:39:46.174610 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2794/5589] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:45 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:47.191965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-661f777d-990e-4bff-ad15-72ba80911bcc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:47.192659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-661f777d-990e-4bff-ad15-72ba80911bcc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:47.221172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-661f777d-990e-4bff-ad15-72ba80911bcc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.230324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-661f777d-990e-4bff-ad15-72ba80911bcc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.237203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-661f777d-990e-4bff-ad15-72ba80911bcc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.239378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-661f777d-990e-4bff-ad15-72ba80911bcc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.682725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-661f777d-990e-4bff-ad15-72ba80911bcc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:47.720175 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-661f777d-990e-4bff-ad15-72ba80911bcc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.505707 Jul 20 04:39:47.736673 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2796/5590] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:47 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:48.742455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5dc754a3-307d-4e45-a761-ecfe623ef453 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:48.743387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5dc754a3-307d-4e45-a761-ecfe623ef453 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:48.759486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5dc754a3-307d-4e45-a761-ecfe623ef453 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.759943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5dc754a3-307d-4e45-a761-ecfe623ef453 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.760738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5dc754a3-307d-4e45-a761-ecfe623ef453 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.768750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5dc754a3-307d-4e45-a761-ecfe623ef453 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.934726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5dc754a3-307d-4e45-a761-ecfe623ef453 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:49.954797 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5dc754a3-307d-4e45-a761-ecfe623ef453 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 1.216526 Jul 20 04:39:49.955665 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2795/5591] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:48 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:50.338987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-556636809", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:50.462835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] validate_networks() for [('e5d649b7-1043-4dbd-90df-444d22a1d3f0', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:50.981422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0857b30e-fb01-420d-85f4-9d2fb41abe6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:50.982843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0857b30e-fb01-420d-85f4-9d2fb41abe6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:51.003946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0857b30e-fb01-420d-85f4-9d2fb41abe6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.045833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0857b30e-fb01-420d-85f4-9d2fb41abe6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.047062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0857b30e-fb01-420d-85f4-9d2fb41abe6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.051187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0857b30e-fb01-420d-85f4-9d2fb41abe6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.356107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0857b30e-fb01-420d-85f4-9d2fb41abe6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:51.372707 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0857b30e-fb01-420d-85f4-9d2fb41abe6c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.403576 Jul 20 04:39:51.385495 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2796/5592] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:50 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:51.399505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-98dd3a08-5bc2-4044-b8c5-e0063e9b294b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:51.404998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-98dd3a08-5bc2-4044-b8c5-e0063e9b294b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:51.442996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98dd3a08-5bc2-4044-b8c5-e0063e9b294b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.449118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98dd3a08-5bc2-4044-b8c5-e0063e9b294b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.450402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98dd3a08-5bc2-4044-b8c5-e0063e9b294b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.451806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98dd3a08-5bc2-4044-b8c5-e0063e9b294b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.545501 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-98dd3a08-5bc2-4044-b8c5-e0063e9b294b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6/action" status: 200 len: 24564 microversion: 2.1 time: 0.165958 Jul 20 04:39:51.554780 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2797/5593] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:51 2022] POST /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6/action => generated 24564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:39:51.671252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:51.671828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:51.672165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:51.673221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:51.673856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:51.696903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.697713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.706289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.715222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.759549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Getting quotas for project 9138f252886e4faea3710ff7d6764683. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:51.766571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Getting quotas for user eff6843f674047fc9a8841711244bce4 and project 9138f252886e4faea3710ff7d6764683. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:51.793485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:51.796251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:51.995946 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1c4d07e-a4c7-4be3-981e-fcb86b983cfd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.123622 Jul 20 04:39:52.003872 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2797/5594] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:39:52.026543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-97fd3c00-9bcc-4d6e-a394-1b01046350d8 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:52.031896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-97fd3c00-9bcc-4d6e-a394-1b01046350d8 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:52.393529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bbfb0dbe-6394-4790-979e-2ea77bd5533b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:52.394582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bbfb0dbe-6394-4790-979e-2ea77bd5533b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:52.419411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbfb0dbe-6394-4790-979e-2ea77bd5533b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:52.423923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbfb0dbe-6394-4790-979e-2ea77bd5533b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:52.425105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbfb0dbe-6394-4790-979e-2ea77bd5533b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:52.425674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbfb0dbe-6394-4790-979e-2ea77bd5533b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:52.443321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-97fd3c00-9bcc-4d6e-a394-1b01046350d8 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.451957 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-97fd3c00-9bcc-4d6e-a394-1b01046350d8 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1221 microversion: 2.1 time: 0.445230 Jul 20 04:39:52.452551 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2798/5595] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:52 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1221 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:52.609539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-740174046", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:52.767883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] validate_networks() for [('e5d649b7-1043-4dbd-90df-444d22a1d3f0', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:53.087811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bbfb0dbe-6394-4790-979e-2ea77bd5533b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:53.101263 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bbfb0dbe-6394-4790-979e-2ea77bd5533b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.712083 Jul 20 04:39:53.139249 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2798/5596] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:52 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:39:54.135366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc1c37cf-f711-46be-9790-fe8cc0dcc6d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:54.138084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc1c37cf-f711-46be-9790-fe8cc0dcc6d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:54.145506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:54.187065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc1c37cf-f711-46be-9790-fe8cc0dcc6d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.189886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc1c37cf-f711-46be-9790-fe8cc0dcc6d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.191023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc1c37cf-f711-46be-9790-fe8cc0dcc6d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.191809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc1c37cf-f711-46be-9790-fe8cc0dcc6d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.529266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:54.529266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:54.529266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:54.529266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:54.529266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:54.554922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.555385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.556196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.557920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.608970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Getting quotas for project 9138f252886e4faea3710ff7d6764683. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:54.649218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Getting quotas for user eff6843f674047fc9a8841711244bce4 and project 9138f252886e4faea3710ff7d6764683. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:54.712317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:54.727446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:54.956857 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-13b89051-8241-4626-9736-a238f6d28299 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.349879 Jul 20 04:39:54.963214 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2799/5597] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:39:54.999275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-659adf94-ab42-4b02-af8f-c0a7a5c0a5d9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:55.004957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-659adf94-ab42-4b02-af8f-c0a7a5c0a5d9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:55.253999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc1c37cf-f711-46be-9790-fe8cc0dcc6d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:55.269669 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc1c37cf-f711-46be-9790-fe8cc0dcc6d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 1.152170 Jul 20 04:39:55.275310 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2799/5598] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:54 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:55.566057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-659adf94-ab42-4b02-af8f-c0a7a5c0a5d9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:55.579434 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-659adf94-ab42-4b02-af8f-c0a7a5c0a5d9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1221 microversion: 2.1 time: 0.597310 Jul 20 04:39:55.593558 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2800/5599] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:54 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1221 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:56.289639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-734a469d-a3d9-43f4-af71-f2615a10c1bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:56.290920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-734a469d-a3d9-43f4-af71-f2615a10c1bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:56.313998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-734a469d-a3d9-43f4-af71-f2615a10c1bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.320761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-734a469d-a3d9-43f4-af71-f2615a10c1bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.323240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-734a469d-a3d9-43f4-af71-f2615a10c1bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.329278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-734a469d-a3d9-43f4-af71-f2615a10c1bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.601210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-507ab542-839a-4bc8-8635-66f0857cb28b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:56.602726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-507ab542-839a-4bc8-8635-66f0857cb28b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:56.630338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-507ab542-839a-4bc8-8635-66f0857cb28b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.631457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-507ab542-839a-4bc8-8635-66f0857cb28b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.637997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-507ab542-839a-4bc8-8635-66f0857cb28b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.639697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-507ab542-839a-4bc8-8635-66f0857cb28b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.971817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-507ab542-839a-4bc8-8635-66f0857cb28b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:56.995743 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-507ab542-839a-4bc8-8635-66f0857cb28b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1273 microversion: 2.1 time: 0.402035 Jul 20 04:39:56.996391 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2801/5600] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:56 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1273 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:57.402032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-734a469d-a3d9-43f4-af71-f2615a10c1bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:57.422535 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-734a469d-a3d9-43f4-af71-f2615a10c1bb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 1.137197 Jul 20 04:39:57.441597 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2800/5601] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:56 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:58.013629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3f1b057-22e9-4fd6-bfe9-22ea2e41e8c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:58.014280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e3f1b057-22e9-4fd6-bfe9-22ea2e41e8c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:58.035386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3f1b057-22e9-4fd6-bfe9-22ea2e41e8c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.037197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3f1b057-22e9-4fd6-bfe9-22ea2e41e8c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.041685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3f1b057-22e9-4fd6-bfe9-22ea2e41e8c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.042765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3f1b057-22e9-4fd6-bfe9-22ea2e41e8c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.377875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3f1b057-22e9-4fd6-bfe9-22ea2e41e8c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:58.389606 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e3f1b057-22e9-4fd6-bfe9-22ea2e41e8c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1279 microversion: 2.1 time: 0.380375 Jul 20 04:39:58.395207 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2802/5602] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:58 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1279 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:58.448867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1cbe14d-7b84-478e-9c5a-291d1705eb4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:58.449647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d1cbe14d-7b84-478e-9c5a-291d1705eb4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:58.476718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1cbe14d-7b84-478e-9c5a-291d1705eb4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.481020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1cbe14d-7b84-478e-9c5a-291d1705eb4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.489294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1cbe14d-7b84-478e-9c5a-291d1705eb4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.498925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1cbe14d-7b84-478e-9c5a-291d1705eb4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.920658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-83391df7-3747-48c1-bd14-895a1381564f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:58.921169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-83391df7-3747-48c1-bd14-895a1381564f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:58.938574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83391df7-3747-48c1-bd14-895a1381564f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.939037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83391df7-3747-48c1-bd14-895a1381564f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.939844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83391df7-3747-48c1-bd14-895a1381564f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.940289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-83391df7-3747-48c1-bd14-895a1381564f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.006136 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-83391df7-3747-48c1-bd14-895a1381564f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-83391df7-3747-48c1-bd14-895a1381564f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 HTTP/1.1 Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'd92af308-68af-45ba-8589-c0766d212f47'} Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:59.008048 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:39:59.012158 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.013312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-83391df7-3747-48c1-bd14-895a1381564f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:59.016183 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-83391df7-3747-48c1-bd14-895a1381564f tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 404 len: 111 microversion: 2.1 time: 0.099473 Jul 20 04:39:59.022988 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2803/5603] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:39:58 2022] DELETE /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:59.061580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dfcdc293-c720-4b3e-b050-f20dddafebc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:59.064535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dfcdc293-c720-4b3e-b050-f20dddafebc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: d92af308-68af-45ba-8589-c0766d212f47] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:59.101748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfcdc293-c720-4b3e-b050-f20dddafebc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.110434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfcdc293-c720-4b3e-b050-f20dddafebc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.119163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfcdc293-c720-4b3e-b050-f20dddafebc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.121314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dfcdc293-c720-4b3e-b050-f20dddafebc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.228971 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-dfcdc293-c720-4b3e-b050-f20dddafebc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dfcdc293-c720-4b3e-b050-f20dddafebc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 HTTP/1.1 Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'd92af308-68af-45ba-8589-c0766d212f47'} Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:59.249776 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.254233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.254233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:59.254233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:59.254233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:59.254233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:59.254233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. Jul 20 04:39:59.254233 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.254233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dfcdc293-c720-4b3e-b050-f20dddafebc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance d92af308-68af-45ba-8589-c0766d212f47 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:59.254233 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dfcdc293-c720-4b3e-b050-f20dddafebc3 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47" status: 404 len: 111 microversion: 2.1 time: 0.222335 Jul 20 04:39:59.279918 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2804/5604] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:59 2022] GET /compute/v2.1/servers/d92af308-68af-45ba-8589-c0766d212f47 => generated 111 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:59.288419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a3cbe66-19c4-412a-9a10-3c658c39b4c5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:59.288930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2a3cbe66-19c4-412a-9a10-3c658c39b4c5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:59.349049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a3cbe66-19c4-412a-9a10-3c658c39b4c5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.349430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a3cbe66-19c4-412a-9a10-3c658c39b4c5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.350238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a3cbe66-19c4-412a-9a10-3c658c39b4c5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.350714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a3cbe66-19c4-412a-9a10-3c658c39b4c5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.402701 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-2a3cbe66-19c4-412a-9a10-3c658c39b4c5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a3cbe66-19c4-412a-9a10-3c658c39b4c5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 HTTP/1.1 Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4'} Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:59.404311 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:39:59.409248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a3cbe66-19c4-412a-9a10-3c658c39b4c5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:59.420528 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a3cbe66-19c4-412a-9a10-3c658c39b4c5 tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 404 len: 111 microversion: 2.1 time: 0.121293 Jul 20 04:39:59.424002 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2805/5605] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:39:59 2022] DELETE /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:59.436816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4afc2c05-e067-4321-aa4b-e91c83942139 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:59.454426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4afc2c05-e067-4321-aa4b-e91c83942139 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:59.486160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4afc2c05-e067-4321-aa4b-e91c83942139 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.499583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4afc2c05-e067-4321-aa4b-e91c83942139 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.500451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4afc2c05-e067-4321-aa4b-e91c83942139 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.500909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4afc2c05-e067-4321-aa4b-e91c83942139 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.298837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4afc2c05-e067-4321-aa4b-e91c83942139 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:00.314704 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4afc2c05-e067-4321-aa4b-e91c83942139 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1321 microversion: 2.1 time: 0.890943 Jul 20 04:40:00.320228 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2806/5606] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:59 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1321 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:00.350795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ffa97718-9ea5-4e6d-ae41-4fc4ca7414bf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:00.361734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ffa97718-9ea5-4e6d-ae41-4fc4ca7414bf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:00.383874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffa97718-9ea5-4e6d-ae41-4fc4ca7414bf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.384341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffa97718-9ea5-4e6d-ae41-4fc4ca7414bf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.393214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffa97718-9ea5-4e6d-ae41-4fc4ca7414bf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.393716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffa97718-9ea5-4e6d-ae41-4fc4ca7414bf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.454683 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-ffa97718-9ea5-4e6d-ae41-4fc4ca7414bf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ffa97718-9ea5-4e6d-ae41-4fc4ca7414bf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 HTTP/1.1 Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4'} Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:00.461947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.467461 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:00.467461 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:00.467461 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:00.467461 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:00.467461 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:00.467461 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. Jul 20 04:40:00.467461 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:00.467461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ffa97718-9ea5-4e6d-ae41-4fc4ca7414bf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance 1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:00.478620 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ffa97718-9ea5-4e6d-ae41-4fc4ca7414bf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4" status: 404 len: 111 microversion: 2.1 time: 0.142080 Jul 20 04:40:00.506746 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2807/5607] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:00 2022] GET /compute/v2.1/servers/1e1b87a3-9db5-4ee7-b198-1bd85c9ae4c4 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:01.335806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f2655fa3-ca4c-45a6-ad1f-dd7055bdeb47 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:01.336556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f2655fa3-ca4c-45a6-ad1f-dd7055bdeb47 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:01.370942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1cbe14d-7b84-478e-9c5a-291d1705eb4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:01.374147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2655fa3-ca4c-45a6-ad1f-dd7055bdeb47 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:01.374763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2655fa3-ca4c-45a6-ad1f-dd7055bdeb47 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:01.375661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2655fa3-ca4c-45a6-ad1f-dd7055bdeb47 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:01.382505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2655fa3-ca4c-45a6-ad1f-dd7055bdeb47 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:01.401928 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1cbe14d-7b84-478e-9c5a-291d1705eb4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 2.952825 Jul 20 04:40:01.413583 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2801/5608] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:58 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 2972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:02.269355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f2655fa3-ca4c-45a6-ad1f-dd7055bdeb47 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.301978 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f2655fa3-ca4c-45a6-ad1f-dd7055bdeb47 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1321 microversion: 2.1 time: 0.969996 Jul 20 04:40:02.303722 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2808/5609] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:01 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1321 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:02.419970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b6dd1f5e-e914-4092-bec6-573488f07345 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:02.421269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b6dd1f5e-e914-4092-bec6-573488f07345 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:02.424268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:02.429595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:02.449876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6dd1f5e-e914-4092-bec6-573488f07345 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.450373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6dd1f5e-e914-4092-bec6-573488f07345 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.460326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6dd1f5e-e914-4092-bec6-573488f07345 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.461063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b6dd1f5e-e914-4092-bec6-573488f07345 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.632691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:02.636921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:02.655913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.662449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.663663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.679667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.996345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:40:03.008642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:40:03.009544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:40:03.010220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:40:03.011440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:40:03.284314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:03.306889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.322702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.328273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.328905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.468473 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e0fc7e02-322c-4776-ac0c-d49e15429c3b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6/action" status: 202 len: 1136 microversion: 2.1 time: 0.840734 Jul 20 04:40:03.469134 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2809/5610] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:02 2022] POST /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6/action => generated 1136 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:40:03.506927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5a426473-6d73-4006-b6e9-53ccdb6adda0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:03.507623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5a426473-6d73-4006-b6e9-53ccdb6adda0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:03.535266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b6dd1f5e-e914-4092-bec6-573488f07345 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:03.545008 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b6dd1f5e-e914-4092-bec6-573488f07345 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 1.129076 Jul 20 04:40:03.545724 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2802/5611] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:02 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:03.582687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a426473-6d73-4006-b6e9-53ccdb6adda0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.583275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a426473-6d73-4006-b6e9-53ccdb6adda0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.589908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-71d08004-d2d0-48cf-be95-ac3daf25c5ae tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:03.590587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-71d08004-d2d0-48cf-be95-ac3daf25c5ae tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:03.601096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a426473-6d73-4006-b6e9-53ccdb6adda0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.601565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5a426473-6d73-4006-b6e9-53ccdb6adda0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.636817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-71d08004-d2d0-48cf-be95-ac3daf25c5ae tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.640583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-71d08004-d2d0-48cf-be95-ac3daf25c5ae tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.652387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-71d08004-d2d0-48cf-be95-ac3daf25c5ae tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.652983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-71d08004-d2d0-48cf-be95-ac3daf25c5ae tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.465827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-71d08004-d2d0-48cf-be95-ac3daf25c5ae tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:04.483184 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-71d08004-d2d0-48cf-be95-ac3daf25c5ae tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1689 microversion: 2.1 time: 0.911236 Jul 20 04:40:04.487815 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2803/5612] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:03 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1689 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:04.569558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b0789a0-8cd4-463a-a3e6-e6320ce834b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:04.570407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b0789a0-8cd4-463a-a3e6-e6320ce834b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:04.575005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:04.588357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b0789a0-8cd4-463a-a3e6-e6320ce834b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.596908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b0789a0-8cd4-463a-a3e6-e6320ce834b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.599027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b0789a0-8cd4-463a-a3e6-e6320ce834b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.602310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b0789a0-8cd4-463a-a3e6-e6320ce834b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.405423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b0789a0-8cd4-463a-a3e6-e6320ce834b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:05.471280 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b0789a0-8cd4-463a-a3e6-e6320ce834b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.911719 Jul 20 04:40:05.474754 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2804/5613] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:04 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:05.497404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-437ed2da-16d4-4d4e-912e-a15a30c49846 req-4cdda939-18d8-4cff-be8d-fdc99194db83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068784e2-fe5a-49a2-a481-0bea8a21c0f4", "tag": "f79effc2-f3cc-41c9-80f0-05c8fa1edb20"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:05.529733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-437ed2da-16d4-4d4e-912e-a15a30c49846 req-4cdda939-18d8-4cff-be8d-fdc99194db83 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.530638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-437ed2da-16d4-4d4e-912e-a15a30c49846 req-4cdda939-18d8-4cff-be8d-fdc99194db83 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.576614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=10 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:05.613621 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-437ed2da-16d4-4d4e-912e-a15a30c49846 req-4cdda939-18d8-4cff-be8d-fdc99194db83 service nova] Creating event network-changed:f79effc2-f3cc-41c9-80f0-05c8fa1edb20 for instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 on n-h2-760456-11 Jul 20 04:40:05.632959 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-437ed2da-16d4-4d4e-912e-a15a30c49846 req-4cdda939-18d8-4cff-be8d-fdc99194db83 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155964 Jul 20 04:40:05.647626 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2805/5614] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:05.658241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-92ce8f6b-49df-4904-8f1a-638dc186fbd6 req-dbcd0b13-ccf5-4185-a84a-e21f722334da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a68a62b9-e978-4872-8c85-1b81c0f7341b", "tag": "f33f6c80-fd33-4fed-8dd8-ca4a81e7d646"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:05.686038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-92ce8f6b-49df-4904-8f1a-638dc186fbd6 req-dbcd0b13-ccf5-4185-a84a-e21f722334da service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.690581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-92ce8f6b-49df-4904-8f1a-638dc186fbd6 req-dbcd0b13-ccf5-4185-a84a-e21f722334da service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.725475 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-92ce8f6b-49df-4904-8f1a-638dc186fbd6 req-dbcd0b13-ccf5-4185-a84a-e21f722334da service nova] Creating event network-changed:f33f6c80-fd33-4fed-8dd8-ca4a81e7d646 for instance a68a62b9-e978-4872-8c85-1b81c0f7341b on n-h2-760456-11 Jul 20 04:40:05.738952 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-92ce8f6b-49df-4904-8f1a-638dc186fbd6 req-dbcd0b13-ccf5-4185-a84a-e21f722334da service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087208 Jul 20 04:40:05.742721 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2806/5615] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:05.765641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-77855a04-6c51-442c-9457-fdf1961f65b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:05.775031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-77855a04-6c51-442c-9457-fdf1961f65b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:05.814511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77855a04-6c51-442c-9457-fdf1961f65b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.815088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77855a04-6c51-442c-9457-fdf1961f65b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.822027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77855a04-6c51-442c-9457-fdf1961f65b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.830468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77855a04-6c51-442c-9457-fdf1961f65b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.242464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a426473-6d73-4006-b6e9-53ccdb6adda0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.268404 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5a426473-6d73-4006-b6e9-53ccdb6adda0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1321 microversion: 2.1 time: 2.791690 Jul 20 04:40:06.282711 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2810/5616] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:03 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1321 bytes in 2813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:06.501068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-063cf33c-9aa1-4a36-930d-47e00c2951f7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:06.503563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-063cf33c-9aa1-4a36-930d-47e00c2951f7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:06.507417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:06.547368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063cf33c-9aa1-4a36-930d-47e00c2951f7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.549322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063cf33c-9aa1-4a36-930d-47e00c2951f7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.553629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063cf33c-9aa1-4a36-930d-47e00c2951f7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.554119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-063cf33c-9aa1-4a36-930d-47e00c2951f7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.692538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-77855a04-6c51-442c-9457-fdf1961f65b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.696634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=75 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:06.707164 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-77855a04-6c51-442c-9457-fdf1961f65b3 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1689 microversion: 2.1 time: 0.962864 Jul 20 04:40:06.708072 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2807/5617] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:05 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1689 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:07.020997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-063cf33c-9aa1-4a36-930d-47e00c2951f7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.050767 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-063cf33c-9aa1-4a36-930d-47e00c2951f7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.552347 Jul 20 04:40:07.052202 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2811/5618] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:06 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:07.289943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1f779026-6fc9-4c19-b4b8-89fdfae51ffd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:07.290940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1f779026-6fc9-4c19-b4b8-89fdfae51ffd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:07.310559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f779026-6fc9-4c19-b4b8-89fdfae51ffd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.317528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f779026-6fc9-4c19-b4b8-89fdfae51ffd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.317528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f779026-6fc9-4c19-b4b8-89fdfae51ffd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.317528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f779026-6fc9-4c19-b4b8-89fdfae51ffd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.723184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1f779026-6fc9-4c19-b4b8-89fdfae51ffd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.728143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07c716cd-6ece-4591-86f1-ba71b197859c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:07.729034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-07c716cd-6ece-4591-86f1-ba71b197859c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:07.758240 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1f779026-6fc9-4c19-b4b8-89fdfae51ffd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1321 microversion: 2.1 time: 0.469671 Jul 20 04:40:07.761788 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2808/5619] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:07 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1321 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:07.771830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07c716cd-6ece-4591-86f1-ba71b197859c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.772056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07c716cd-6ece-4591-86f1-ba71b197859c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.772905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07c716cd-6ece-4591-86f1-ba71b197859c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.773353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07c716cd-6ece-4591-86f1-ba71b197859c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.069556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0210e4eb-f570-477c-9c35-35270271fe6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:08.070748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0210e4eb-f570-477c-9c35-35270271fe6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:08.088493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0210e4eb-f570-477c-9c35-35270271fe6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.093432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0210e4eb-f570-477c-9c35-35270271fe6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.098891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0210e4eb-f570-477c-9c35-35270271fe6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.099927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0210e4eb-f570-477c-9c35-35270271fe6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.105154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0210e4eb-f570-477c-9c35-35270271fe6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.155599 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0210e4eb-f570-477c-9c35-35270271fe6e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 1.090468 Jul 20 04:40:09.180957 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2809/5620] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:08 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:09.199644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cc16208b-db69-4720-805f-5a37ce694d9f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:09.202911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cc16208b-db69-4720-805f-5a37ce694d9f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:09.237948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc16208b-db69-4720-805f-5a37ce694d9f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:09.240563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc16208b-db69-4720-805f-5a37ce694d9f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.243381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc16208b-db69-4720-805f-5a37ce694d9f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:09.246001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cc16208b-db69-4720-805f-5a37ce694d9f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.513148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-07c716cd-6ece-4591-86f1-ba71b197859c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.515773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:09.535818 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-07c716cd-6ece-4591-86f1-ba71b197859c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1689 microversion: 2.1 time: 1.814653 Jul 20 04:40:09.554642 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2812/5621] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:07 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1689 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:09.608083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cc16208b-db69-4720-805f-5a37ce694d9f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.624467 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cc16208b-db69-4720-805f-5a37ce694d9f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1321 microversion: 2.1 time: 0.442102 Jul 20 04:40:09.643808 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2810/5622] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:09 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:10.175216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7d8b173-6cf3-46d8-aac6-fcd6253270dd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:10.177191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b7d8b173-6cf3-46d8-aac6-fcd6253270dd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:10.187507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7d8b173-6cf3-46d8-aac6-fcd6253270dd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.188242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7d8b173-6cf3-46d8-aac6-fcd6253270dd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.189782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7d8b173-6cf3-46d8-aac6-fcd6253270dd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.191078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7d8b173-6cf3-46d8-aac6-fcd6253270dd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.559639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7d121a5d-d798-485f-8fb2-8c2d741c92ab tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:10.564359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7d121a5d-d798-485f-8fb2-8c2d741c92ab tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:10.577315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d121a5d-d798-485f-8fb2-8c2d741c92ab tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.584879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d121a5d-d798-485f-8fb2-8c2d741c92ab tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.585976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d121a5d-d798-485f-8fb2-8c2d741c92ab tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.588355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7d121a5d-d798-485f-8fb2-8c2d741c92ab tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.910483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7d121a5d-d798-485f-8fb2-8c2d741c92ab tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:10.937341 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7d121a5d-d798-485f-8fb2-8c2d741c92ab tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1689 microversion: 2.1 time: 0.379301 Jul 20 04:40:10.938014 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2811/5623] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:10 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1689 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:10.945636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b7d8b173-6cf3-46d8-aac6-fcd6253270dd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:10.951475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-52019fb8-0295-4b5c-992c-00acb1d75079 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:10.952106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-52019fb8-0295-4b5c-992c-00acb1d75079 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:10.960239 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b7d8b173-6cf3-46d8-aac6-fcd6253270dd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1528 microversion: 2.1 time: 0.790246 Jul 20 04:40:10.970469 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2813/5624] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:10 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1528 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:10.978017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52019fb8-0295-4b5c-992c-00acb1d75079 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.978572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52019fb8-0295-4b5c-992c-00acb1d75079 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.979835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52019fb8-0295-4b5c-992c-00acb1d75079 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.980577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52019fb8-0295-4b5c-992c-00acb1d75079 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.285106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-52019fb8-0295-4b5c-992c-00acb1d75079 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.285353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2e6a055-cc9f-4c08-aa38-7e7a1faf209c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:11.286376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e2e6a055-cc9f-4c08-aa38-7e7a1faf209c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:11.301525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2e6a055-cc9f-4c08-aa38-7e7a1faf209c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.303081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2e6a055-cc9f-4c08-aa38-7e7a1faf209c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.308015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2e6a055-cc9f-4c08-aa38-7e7a1faf209c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.308732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2e6a055-cc9f-4c08-aa38-7e7a1faf209c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.310197 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-52019fb8-0295-4b5c-992c-00acb1d75079 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1321 microversion: 2.1 time: 0.359188 Jul 20 04:40:11.317972 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2812/5625] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:10 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:11.370055 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-e2e6a055-cc9f-4c08-aa38-7e7a1faf209c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2e6a055-cc9f-4c08-aa38-7e7a1faf209c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 HTTP/1.1 Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223'} Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:11.373015 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:40:11.377755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:11.384847 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2e6a055-cc9f-4c08-aa38-7e7a1faf209c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:11.386524 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e2e6a055-cc9f-4c08-aa38-7e7a1faf209c tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 404 len: 111 microversion: 2.1 time: 0.104601 Jul 20 04:40:11.390013 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2814/5626] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:40:11 2022] DELETE /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:11.400354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-453a554a-13a4-42ef-a372-d0c81cca5acf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:11.401841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-453a554a-13a4-42ef-a372-d0c81cca5acf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] [instance: 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:11.420279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-453a554a-13a4-42ef-a372-d0c81cca5acf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.420747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-453a554a-13a4-42ef-a372-d0c81cca5acf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.421555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-453a554a-13a4-42ef-a372-d0c81cca5acf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.422186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-453a554a-13a4-42ef-a372-d0c81cca5acf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.442088 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-453a554a-13a4-42ef-a372-d0c81cca5acf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] HTTP exception thrown: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-453a554a-13a4-42ef-a372-d0c81cca5acf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Request method failure captured: Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 HTTP/1.1 Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14Vj6j1FYA8EiUqDGdFQd8x19FQkVUABICXxynw_96MivzqGckSSbPEFp2PAihUOAgoJudKP6cmfCEoF-Bx1qBGolu9k0ylZig1qfeyyVYAPiOr78rmHtkY21bY2809jSRwexZPAVS_2ZOTwRz80ul6uZKf9zC8xbnH1zqNhw9ibxYs Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e104a7716d8549cb8b99560ac90150c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e104a7716d8549cb8b99560ac90150c6 Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-307866547 Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 4bd10ebbd2fd4ef693e15194c2d8912c Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachVolumeNegativeTest-307866547-project Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223'} Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:11.444963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:11.450242 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:11.450242 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:11.450242 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:11.450242 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:11.450242 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:11.450242 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. Jul 20 04:40:11.450242 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:11.454193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-453a554a-13a4-42ef-a372-d0c81cca5acf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] Returning 404 to user: Instance 7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:11.454193 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-453a554a-13a4-42ef-a372-d0c81cca5acf tempest-AttachVolumeNegativeTest-307866547 tempest-AttachVolumeNegativeTest-307866547-project] 10.222.0.59 "GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223" status: 404 len: 111 microversion: 2.1 time: 0.058852 Jul 20 04:40:11.454193 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2813/5627] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:11 2022] GET /compute/v2.1/servers/7ee8dd55-7af0-4ad6-b4ae-d1b4e0455223 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:11.972941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c4affaa-b335-4009-b975-20276e34bc78 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:11.975466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8c4affaa-b335-4009-b975-20276e34bc78 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:11.980360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-70f8b929-9559-4052-b6f5-7dd00fdfaa35 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:11.981246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-70f8b929-9559-4052-b6f5-7dd00fdfaa35 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:11.987239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c4affaa-b335-4009-b975-20276e34bc78 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.988236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c4affaa-b335-4009-b975-20276e34bc78 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.989894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c4affaa-b335-4009-b975-20276e34bc78 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.990940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c4affaa-b335-4009-b975-20276e34bc78 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.004850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70f8b929-9559-4052-b6f5-7dd00fdfaa35 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.007607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70f8b929-9559-4052-b6f5-7dd00fdfaa35 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.018817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70f8b929-9559-4052-b6f5-7dd00fdfaa35 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.028605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70f8b929-9559-4052-b6f5-7dd00fdfaa35 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.665526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-70f8b929-9559-4052-b6f5-7dd00fdfaa35 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:12.685002 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-70f8b929-9559-4052-b6f5-7dd00fdfaa35 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1510 microversion: 2.1 time: 0.711465 Jul 20 04:40:12.700483 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2814/5628] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:11 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1510 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:12.716319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ef61c01c-ef59-4e95-951d-5fa1349172b0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:12.719355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ef61c01c-ef59-4e95-951d-5fa1349172b0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:12.732386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef61c01c-ef59-4e95-951d-5fa1349172b0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.733146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef61c01c-ef59-4e95-951d-5fa1349172b0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.735265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef61c01c-ef59-4e95-951d-5fa1349172b0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.739918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef61c01c-ef59-4e95-951d-5fa1349172b0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.770540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8c4affaa-b335-4009-b975-20276e34bc78 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:12.783820 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c4affaa-b335-4009-b975-20276e34bc78 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1689 microversion: 2.1 time: 0.832386 Jul 20 04:40:12.785038 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2815/5629] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:11 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1689 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:12.799037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b1331c0f-c50b-4e71-8203-64f0fc3fe287 req-35988c97-c690-4108-9b75-d8fb1438f513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068784e2-fe5a-49a2-a481-0bea8a21c0f4", "name": "network-vif-plugged", "status": "completed", "tag": "f79effc2-f3cc-41c9-80f0-05c8fa1edb20"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:12.817223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b1331c0f-c50b-4e71-8203-64f0fc3fe287 req-35988c97-c690-4108-9b75-d8fb1438f513 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.820000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b1331c0f-c50b-4e71-8203-64f0fc3fe287 req-35988c97-c690-4108-9b75-d8fb1438f513 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.850030 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b1331c0f-c50b-4e71-8203-64f0fc3fe287 req-35988c97-c690-4108-9b75-d8fb1438f513 service nova] Creating event network-vif-plugged:f79effc2-f3cc-41c9-80f0-05c8fa1edb20 for instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 on n-h2-760456-11 Jul 20 04:40:12.867534 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b1331c0f-c50b-4e71-8203-64f0fc3fe287 req-35988c97-c690-4108-9b75-d8fb1438f513 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078862 Jul 20 04:40:12.868875 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2816/5630] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:13.242225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ef61c01c-ef59-4e95-951d-5fa1349172b0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:13.251452 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ef61c01c-ef59-4e95-951d-5fa1349172b0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1321 microversion: 2.1 time: 0.549558 Jul 20 04:40:13.254673 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2815/5631] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:12 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:13.709301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-750c7db0-5b73-4a72-ba42-cd91b868632d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:13.710222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-750c7db0-5b73-4a72-ba42-cd91b868632d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:13.724671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-750c7db0-5b73-4a72-ba42-cd91b868632d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.725143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-750c7db0-5b73-4a72-ba42-cd91b868632d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.728173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-750c7db0-5b73-4a72-ba42-cd91b868632d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.728651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-750c7db0-5b73-4a72-ba42-cd91b868632d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.802398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-71e734c5-acac-4d2b-834b-d6c1db3c7a2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:13.803220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-71e734c5-acac-4d2b-834b-d6c1db3c7a2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:13.813540 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-71e734c5-acac-4d2b-834b-d6c1db3c7a2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.814350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-71e734c5-acac-4d2b-834b-d6c1db3c7a2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.818331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-71e734c5-acac-4d2b-834b-d6c1db3c7a2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.819228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-71e734c5-acac-4d2b-834b-d6c1db3c7a2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.315835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-71e734c5-acac-4d2b-834b-d6c1db3c7a2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.334026 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-71e734c5-acac-4d2b-834b-d6c1db3c7a2c tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1689 microversion: 2.1 time: 0.535645 Jul 20 04:40:14.342440 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2816/5632] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:13 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1689 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:14.364922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c90776e-b906-47a7-97cc-23ef1f902fdf tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:14.365799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5c90776e-b906-47a7-97cc-23ef1f902fdf tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:14.388983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c90776e-b906-47a7-97cc-23ef1f902fdf tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:14.398473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c90776e-b906-47a7-97cc-23ef1f902fdf tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.401416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c90776e-b906-47a7-97cc-23ef1f902fdf tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:14.404730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c90776e-b906-47a7-97cc-23ef1f902fdf tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.431399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-750c7db0-5b73-4a72-ba42-cd91b868632d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.467960 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-750c7db0-5b73-4a72-ba42-cd91b868632d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1510 microversion: 2.1 time: 0.766286 Jul 20 04:40:14.481960 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2817/5633] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:13 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1510 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:15.037680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5c90776e-b906-47a7-97cc-23ef1f902fdf tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:15.049656 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5c90776e-b906-47a7-97cc-23ef1f902fdf tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1321 microversion: 2.1 time: 0.705786 Jul 20 04:40:15.053787 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2817/5634] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:14 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1321 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:15.355708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f040c2d5-3ad2-43d8-a352-337a106067dd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:15.357154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f040c2d5-3ad2-43d8-a352-337a106067dd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:15.372542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f040c2d5-3ad2-43d8-a352-337a106067dd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.376140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f040c2d5-3ad2-43d8-a352-337a106067dd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.377009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f040c2d5-3ad2-43d8-a352-337a106067dd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.386244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f040c2d5-3ad2-43d8-a352-337a106067dd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.509535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e3c45e0-cc25-4a2a-9790-e47b80c0079a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:15.512210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e3c45e0-cc25-4a2a-9790-e47b80c0079a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:15.525584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e3c45e0-cc25-4a2a-9790-e47b80c0079a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.527634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e3c45e0-cc25-4a2a-9790-e47b80c0079a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.529701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e3c45e0-cc25-4a2a-9790-e47b80c0079a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.530705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e3c45e0-cc25-4a2a-9790-e47b80c0079a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.987852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e3c45e0-cc25-4a2a-9790-e47b80c0079a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:16.006395 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e3c45e0-cc25-4a2a-9790-e47b80c0079a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1510 microversion: 2.1 time: 0.506815 Jul 20 04:40:16.018488 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2818/5635] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:15 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1510 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:16.025856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ad695b7a-d6ac-4b4b-b38d-e4e480fffc6c req-94ccf55e-bc19-404e-9560-ac82409817ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02", "name": "network-vif-unplugged", "status": "completed", "tag": "dbad2823-16de-4145-93a7-2756ed39d393"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:16.055736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ad695b7a-d6ac-4b4b-b38d-e4e480fffc6c req-94ccf55e-bc19-404e-9560-ac82409817ba service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.056198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ad695b7a-d6ac-4b4b-b38d-e4e480fffc6c req-94ccf55e-bc19-404e-9560-ac82409817ba service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.087348 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ad695b7a-d6ac-4b4b-b38d-e4e480fffc6c req-94ccf55e-bc19-404e-9560-ac82409817ba service nova] Creating event network-vif-unplugged:dbad2823-16de-4145-93a7-2756ed39d393 for instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 on n-h1-760456-11 Jul 20 04:40:16.104653 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ad695b7a-d6ac-4b4b-b38d-e4e480fffc6c req-94ccf55e-bc19-404e-9560-ac82409817ba service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084600 Jul 20 04:40:16.105872 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2819/5636] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:16.120425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31023b44-4779-43da-b4ad-fa0056f049ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:16.135077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31023b44-4779-43da-b4ad-fa0056f049ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:16.168772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31023b44-4779-43da-b4ad-fa0056f049ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.175026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31023b44-4779-43da-b4ad-fa0056f049ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.177304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31023b44-4779-43da-b4ad-fa0056f049ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.179081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31023b44-4779-43da-b4ad-fa0056f049ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.206960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f040c2d5-3ad2-43d8-a352-337a106067dd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:16.229795 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f040c2d5-3ad2-43d8-a352-337a106067dd tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1689 microversion: 2.1 time: 0.877822 Jul 20 04:40:16.232173 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2818/5637] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:15 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1689 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:16.766376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31023b44-4779-43da-b4ad-fa0056f049ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:16.784608 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31023b44-4779-43da-b4ad-fa0056f049ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1514 microversion: 2.1 time: 0.675600 Jul 20 04:40:16.785520 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2820/5638] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:16 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1514 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:16.803030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fe4320f0-e3b4-409f-ad68-ce64e1f29430 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:16.804230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fe4320f0-e3b4-409f-ad68-ce64e1f29430 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:16.830806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe4320f0-e3b4-409f-ad68-ce64e1f29430 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.831245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe4320f0-e3b4-409f-ad68-ce64e1f29430 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.833981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe4320f0-e3b4-409f-ad68-ce64e1f29430 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.844545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe4320f0-e3b4-409f-ad68-ce64e1f29430 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.933150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-fe4320f0-e3b4-409f-ad68-ce64e1f29430 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lazy-loading 'flavor' on Instance uuid 068784e2-fe5a-49a2-a481-0bea8a21c0f4 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:17.036711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-80677706-4650-4685-9cf5-9d16657d03d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:17.037419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-80677706-4650-4685-9cf5-9d16657d03d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:17.047875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80677706-4650-4685-9cf5-9d16657d03d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.059128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80677706-4650-4685-9cf5-9d16657d03d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.060073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80677706-4650-4685-9cf5-9d16657d03d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.060539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80677706-4650-4685-9cf5-9d16657d03d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.208872 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fe4320f0-e3b4-409f-ad68-ce64e1f29430 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4/action" status: 200 len: 32 microversion: 2.1 time: 0.364334 Jul 20 04:40:17.214787 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2819/5639] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:16 2022] POST /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:40:17.239770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-929cc5e0-28d0-4865-b418-d9a28ce2bb0c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:17.241942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-929cc5e0-28d0-4865-b418-d9a28ce2bb0c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:17.273034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-929cc5e0-28d0-4865-b418-d9a28ce2bb0c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.274907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-929cc5e0-28d0-4865-b418-d9a28ce2bb0c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.281859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-929cc5e0-28d0-4865-b418-d9a28ce2bb0c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.282806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-929cc5e0-28d0-4865-b418-d9a28ce2bb0c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.851582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-929cc5e0-28d0-4865-b418-d9a28ce2bb0c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:17.869425 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-929cc5e0-28d0-4865-b418-d9a28ce2bb0c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.651397 Jul 20 04:40:17.883343 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2820/5640] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:17 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:17.885399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-80677706-4650-4685-9cf5-9d16657d03d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:17.893879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a4e65ccd-ad4a-4990-9bdc-9d032a774275 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:17.894551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a4e65ccd-ad4a-4990-9bdc-9d032a774275 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:17.901045 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-80677706-4650-4685-9cf5-9d16657d03d4 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1510 microversion: 2.1 time: 0.872324 Jul 20 04:40:17.913776 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2821/5641] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:17 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1510 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:17.924769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4e65ccd-ad4a-4990-9bdc-9d032a774275 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.934326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4e65ccd-ad4a-4990-9bdc-9d032a774275 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.935314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4e65ccd-ad4a-4990-9bdc-9d032a774275 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.935771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4e65ccd-ad4a-4990-9bdc-9d032a774275 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.245584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-aa8ceed8-2229-4c3c-a79c-f5b3688ec322 req-450606ed-4778-41e6-8c64-821623392f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68a62b9-e978-4872-8c85-1b81c0f7341b", "name": "network-vif-plugged", "status": "completed", "tag": "f33f6c80-fd33-4fed-8dd8-ca4a81e7d646"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:18.267867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-aa8ceed8-2229-4c3c-a79c-f5b3688ec322 req-450606ed-4778-41e6-8c64-821623392f90 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.269218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-aa8ceed8-2229-4c3c-a79c-f5b3688ec322 req-450606ed-4778-41e6-8c64-821623392f90 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.304725 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-aa8ceed8-2229-4c3c-a79c-f5b3688ec322 req-450606ed-4778-41e6-8c64-821623392f90 service nova] Creating event network-vif-plugged:f33f6c80-fd33-4fed-8dd8-ca4a81e7d646 for instance a68a62b9-e978-4872-8c85-1b81c0f7341b on n-h2-760456-11 Jul 20 04:40:18.317747 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-aa8ceed8-2229-4c3c-a79c-f5b3688ec322 req-450606ed-4778-41e6-8c64-821623392f90 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075365 Jul 20 04:40:18.321493 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2822/5642] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:18.455916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a4e65ccd-ad4a-4990-9bdc-9d032a774275 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.481791 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a4e65ccd-ad4a-4990-9bdc-9d032a774275 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1689 microversion: 2.1 time: 0.597239 Jul 20 04:40:18.483150 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2821/5643] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:17 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1689 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:18.889697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d7f31a19-189a-4e79-a404-0eac7bb04b72 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:18.890616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d7f31a19-189a-4e79-a404-0eac7bb04b72 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:18.906092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7f31a19-189a-4e79-a404-0eac7bb04b72 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.906584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7f31a19-189a-4e79-a404-0eac7bb04b72 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.907385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7f31a19-189a-4e79-a404-0eac7bb04b72 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.907843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7f31a19-189a-4e79-a404-0eac7bb04b72 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.932178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7c93636e-61fb-4ff8-91ef-9e9c60fde20f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:18.933386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7c93636e-61fb-4ff8-91ef-9e9c60fde20f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:18.971357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c93636e-61fb-4ff8-91ef-9e9c60fde20f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.971829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c93636e-61fb-4ff8-91ef-9e9c60fde20f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.973740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c93636e-61fb-4ff8-91ef-9e9c60fde20f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.977858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c93636e-61fb-4ff8-91ef-9e9c60fde20f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:19.328967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d7f31a19-189a-4e79-a404-0eac7bb04b72 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:19.340839 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d7f31a19-189a-4e79-a404-0eac7bb04b72 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.455330 Jul 20 04:40:19.342962 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2823/5644] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:18 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:19.476096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7c93636e-61fb-4ff8-91ef-9e9c60fde20f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:19.491178 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7c93636e-61fb-4ff8-91ef-9e9c60fde20f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1453 microversion: 2.1 time: 0.560206 Jul 20 04:40:19.493798 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2822/5645] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:18 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1453 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:19.500049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-82a3f069-87ae-4c7c-acc0-473b674b8182 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:19.500677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-82a3f069-87ae-4c7c-acc0-473b674b8182 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:19.514045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-954e0bc6-7992-491f-a369-7350dd64f7ed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:19.515784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-954e0bc6-7992-491f-a369-7350dd64f7ed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:19.525234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-954e0bc6-7992-491f-a369-7350dd64f7ed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.525926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-954e0bc6-7992-491f-a369-7350dd64f7ed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:19.527218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-954e0bc6-7992-491f-a369-7350dd64f7ed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.527964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-954e0bc6-7992-491f-a369-7350dd64f7ed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:19.535134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82a3f069-87ae-4c7c-acc0-473b674b8182 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.542889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82a3f069-87ae-4c7c-acc0-473b674b8182 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:19.548350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82a3f069-87ae-4c7c-acc0-473b674b8182 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.548827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82a3f069-87ae-4c7c-acc0-473b674b8182 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.240126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-82a3f069-87ae-4c7c-acc0-473b674b8182 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:20.266904 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-82a3f069-87ae-4c7c-acc0-473b674b8182 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1689 microversion: 2.1 time: 0.770821 Jul 20 04:40:20.287981 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2824/5646] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:19 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1689 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:20.366137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8814370d-1402-4f2e-9c3d-00713cff8148 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:20.367197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8814370d-1402-4f2e-9c3d-00713cff8148 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:20.407331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8814370d-1402-4f2e-9c3d-00713cff8148 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.407802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8814370d-1402-4f2e-9c3d-00713cff8148 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.415567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-954e0bc6-7992-491f-a369-7350dd64f7ed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:20.416171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8814370d-1402-4f2e-9c3d-00713cff8148 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.416743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8814370d-1402-4f2e-9c3d-00713cff8148 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.432246 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-954e0bc6-7992-491f-a369-7350dd64f7ed tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1453 microversion: 2.1 time: 0.917816 Jul 20 04:40:20.432677 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2823/5647] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:19 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1453 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:20.528529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:20.529084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:20.551503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.551972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.552769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.553219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.607659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lazy-loading 'flavor' on Instance uuid 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:20.636458 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Cannot 'shelve' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state shelved_offloaded Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action HTTP/1.1 Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 14 Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: {"shelve": {}} Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: exception: Cannot 'shelve' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state shelved_offloaded Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02', 'body': {'shelve': {}}} Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 20 04:40:20.638781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state shelved_offloaded Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state shelved_offloaded Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 409 to user: Cannot 'shelve' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state shelved_offloaded {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a33d678-c393-40a6-ad47-f0602efe70b3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 409 len: 155 microversion: 2.1 time: 0.116003 Jul 20 04:40:20.644314 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2824/5648] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:20 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 155 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:40:20.649464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7d3dca6-77b3-4f98-9d15-3dbde3e28a23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:20.650053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b7d3dca6-77b3-4f98-9d15-3dbde3e28a23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:20.674297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7d3dca6-77b3-4f98-9d15-3dbde3e28a23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.675286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7d3dca6-77b3-4f98-9d15-3dbde3e28a23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.676135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7d3dca6-77b3-4f98-9d15-3dbde3e28a23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.676594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7d3dca6-77b3-4f98-9d15-3dbde3e28a23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.839400 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b7d3dca6-77b3-4f98-9d15-3dbde3e28a23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 202 len: 0 microversion: 2.1 time: 0.194223 Jul 20 04:40:20.840735 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2825/5649] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:20 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:20.854161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7a5d4095-dc35-487c-b309-3bc1bbd41cbb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:20.855177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7a5d4095-dc35-487c-b309-3bc1bbd41cbb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:20.864532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a5d4095-dc35-487c-b309-3bc1bbd41cbb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.865329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a5d4095-dc35-487c-b309-3bc1bbd41cbb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.866755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a5d4095-dc35-487c-b309-3bc1bbd41cbb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.867443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a5d4095-dc35-487c-b309-3bc1bbd41cbb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.939507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8814370d-1402-4f2e-9c3d-00713cff8148 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:20.948725 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8814370d-1402-4f2e-9c3d-00713cff8148 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.591905 Jul 20 04:40:20.956674 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2825/5650] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:20 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:21.187308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7a5d4095-dc35-487c-b309-3bc1bbd41cbb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:21.200892 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7a5d4095-dc35-487c-b309-3bc1bbd41cbb tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1461 microversion: 2.1 time: 0.355801 Jul 20 04:40:21.202356 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2826/5651] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:20 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1461 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:21.287968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b39e373b-0da9-446e-96c2-d06764aa75be tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:21.288614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b39e373b-0da9-446e-96c2-d06764aa75be tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:21.305186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b39e373b-0da9-446e-96c2-d06764aa75be tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:21.305655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b39e373b-0da9-446e-96c2-d06764aa75be tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:21.306496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b39e373b-0da9-446e-96c2-d06764aa75be tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:21.306944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b39e373b-0da9-446e-96c2-d06764aa75be tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:21.352870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:21.563010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b39e373b-0da9-446e-96c2-d06764aa75be tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:21.572160 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b39e373b-0da9-446e-96c2-d06764aa75be tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1695 microversion: 2.1 time: 0.290742 Jul 20 04:40:21.574963 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2826/5652] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:21 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1695 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:21.787185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1441212839", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fdb2927b-8290-427b-a2d1-f31a32049ebf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff98390c-0468-4cc8-9649-ee7fac3db692"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:21.909746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] validate_networks() for [('ff98390c-0468-4cc8-9649-ee7fac3db692', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:40:21.965365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4ee8bd52-a22c-4afd-a07e-467aec30d0c3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:21.966484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4ee8bd52-a22c-4afd-a07e-467aec30d0c3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:21.986025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ee8bd52-a22c-4afd-a07e-467aec30d0c3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:21.992428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ee8bd52-a22c-4afd-a07e-467aec30d0c3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:21.997957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ee8bd52-a22c-4afd-a07e-467aec30d0c3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:21.998790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4ee8bd52-a22c-4afd-a07e-467aec30d0c3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.364819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4ee8bd52-a22c-4afd-a07e-467aec30d0c3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:22.375125 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4ee8bd52-a22c-4afd-a07e-467aec30d0c3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.413711 Jul 20 04:40:22.386778 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2827/5653] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:21 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:22.399029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d5878fb-aaa9-4c86-bc5f-4b2ac0f1e630 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:22.399836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d5878fb-aaa9-4c86-bc5f-4b2ac0f1e630 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:22.414316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d5878fb-aaa9-4c86-bc5f-4b2ac0f1e630 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.414877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d5878fb-aaa9-4c86-bc5f-4b2ac0f1e630 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.415835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d5878fb-aaa9-4c86-bc5f-4b2ac0f1e630 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.416818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d5878fb-aaa9-4c86-bc5f-4b2ac0f1e630 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.611007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d5878fb-aaa9-4c86-bc5f-4b2ac0f1e630 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:22.621911 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d5878fb-aaa9-4c86-bc5f-4b2ac0f1e630 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1461 microversion: 2.1 time: 0.233948 Jul 20 04:40:22.632694 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2828/5654] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:22 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1461 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:22.638806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-85a98324-f826-435a-8e13-6095aac619b1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:22.639642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-85a98324-f826-435a-8e13-6095aac619b1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:22.648448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85a98324-f826-435a-8e13-6095aac619b1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.649189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85a98324-f826-435a-8e13-6095aac619b1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.650766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85a98324-f826-435a-8e13-6095aac619b1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.651383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85a98324-f826-435a-8e13-6095aac619b1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.829077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:40:22.829734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:40:22.830767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:40:22.831221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:40:22.831722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:40:22.845178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.845691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.846553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.847004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.897564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:22.905927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for user f1067c18d4074c78a512d89e07141915 and project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:23.017188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:40:23.019464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fdb2927b-8290-427b-a2d1-f31a32049ebf',volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:40:23.420818 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40f3cba0-5cba-4208-a9a2-9d93924ddc09 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639032 Jul 20 04:40:23.421497 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2827/5655] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:40:23.448583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cfc8f0da-8fb4-4542-9223-941257954619 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:23.449227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cfc8f0da-8fb4-4542-9223-941257954619 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:23.466607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-85a98324-f826-435a-8e13-6095aac619b1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:23.472487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cfc8f0da-8fb4-4542-9223-941257954619 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.473562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cfc8f0da-8fb4-4542-9223-941257954619 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.475371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cfc8f0da-8fb4-4542-9223-941257954619 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.476155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cfc8f0da-8fb4-4542-9223-941257954619 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.479259 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-85a98324-f826-435a-8e13-6095aac619b1 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1695 microversion: 2.1 time: 0.844565 Jul 20 04:40:23.481025 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2829/5656] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:22 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1695 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:23.486571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72ca58e2-5f38-43d3-8022-a72e8d2bcb7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:23.487671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-72ca58e2-5f38-43d3-8022-a72e8d2bcb7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:23.516588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:23.569520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72ca58e2-5f38-43d3-8022-a72e8d2bcb7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:23.578181 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72ca58e2-5f38-43d3-8022-a72e8d2bcb7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1057 microversion: 2.1 time: 0.094947 Jul 20 04:40:23.578804 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2830/5657] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:23 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1057 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:23.640776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1cfe1474-1e69-4865-80cb-2eaaf31acc4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:23.641916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1cfe1474-1e69-4865-80cb-2eaaf31acc4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:23.666948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1cfe1474-1e69-4865-80cb-2eaaf31acc4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.669667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1cfe1474-1e69-4865-80cb-2eaaf31acc4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.670841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1cfe1474-1e69-4865-80cb-2eaaf31acc4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.674545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1cfe1474-1e69-4865-80cb-2eaaf31acc4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.799808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cfc8f0da-8fb4-4542-9223-941257954619 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:23.809416 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cfc8f0da-8fb4-4542-9223-941257954619 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.386675 Jul 20 04:40:23.809856 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2828/5658] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:23 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:24.104742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3f450b7c-ea63-4ffc-b9ae-01062ff547c1 req-b63d1889-a252-4b97-8722-621605e99129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a908c5-87f5-4228-9815-f47c1195c4a6", "name": "network-vif-unplugged", "status": "completed", "tag": "4d0e27c2-3182-484f-abb7-ff3d69355c02"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:24.121160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3f450b7c-ea63-4ffc-b9ae-01062ff547c1 req-b63d1889-a252-4b97-8722-621605e99129 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.124654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3f450b7c-ea63-4ffc-b9ae-01062ff547c1 req-b63d1889-a252-4b97-8722-621605e99129 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.149266 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3f450b7c-ea63-4ffc-b9ae-01062ff547c1 req-b63d1889-a252-4b97-8722-621605e99129 service nova] Creating event network-vif-unplugged:4d0e27c2-3182-484f-abb7-ff3d69355c02 for instance 70a908c5-87f5-4228-9815-f47c1195c4a6 on n-h1-760456-11 Jul 20 04:40:24.165140 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3f450b7c-ea63-4ffc-b9ae-01062ff547c1 req-b63d1889-a252-4b97-8722-621605e99129 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066823 Jul 20 04:40:24.168749 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2829/5659] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:40:24.205365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1cfe1474-1e69-4865-80cb-2eaaf31acc4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.221770 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1cfe1474-1e69-4865-80cb-2eaaf31acc4e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.585562 Jul 20 04:40:24.239900 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2831/5660] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:23 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:24.499598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80129b29-5ebc-46c8-9361-86cb41747fa4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:24.500332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-80129b29-5ebc-46c8-9361-86cb41747fa4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:24.512876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80129b29-5ebc-46c8-9361-86cb41747fa4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.515976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80129b29-5ebc-46c8-9361-86cb41747fa4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.521662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80129b29-5ebc-46c8-9361-86cb41747fa4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.521662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80129b29-5ebc-46c8-9361-86cb41747fa4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.596858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-025baa10-a874-462a-ad63-1ded32d418f5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:24.597657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-025baa10-a874-462a-ad63-1ded32d418f5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:24.606921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=68 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:24.613642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-025baa10-a874-462a-ad63-1ded32d418f5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.617596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-025baa10-a874-462a-ad63-1ded32d418f5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.620421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-025baa10-a874-462a-ad63-1ded32d418f5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.622952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-025baa10-a874-462a-ad63-1ded32d418f5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.828011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-025baa10-a874-462a-ad63-1ded32d418f5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.837732 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-025baa10-a874-462a-ad63-1ded32d418f5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1099 microversion: 2.1 time: 0.245290 Jul 20 04:40:24.842634 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2832/5661] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:24 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1099 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:24.856036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2be620a5-5d9f-4ab7-937c-0e54bdf9e40a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:24.858571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2be620a5-5d9f-4ab7-937c-0e54bdf9e40a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:24.877716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2be620a5-5d9f-4ab7-937c-0e54bdf9e40a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.880436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2be620a5-5d9f-4ab7-937c-0e54bdf9e40a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.881271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2be620a5-5d9f-4ab7-937c-0e54bdf9e40a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.881730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2be620a5-5d9f-4ab7-937c-0e54bdf9e40a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.942950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-80129b29-5ebc-46c8-9361-86cb41747fa4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.961372 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-80129b29-5ebc-46c8-9361-86cb41747fa4 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1680 microversion: 2.1 time: 0.466717 Jul 20 04:40:24.963777 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2830/5662] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:24 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1680 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:25.195697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2be620a5-5d9f-4ab7-937c-0e54bdf9e40a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:25.211169 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2be620a5-5d9f-4ab7-937c-0e54bdf9e40a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.365426 Jul 20 04:40:25.213722 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2833/5663] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:24 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:25.246745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-69f3f856-bf2a-46cc-8b0d-8e2cc6360ac8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:25.247538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-69f3f856-bf2a-46cc-8b0d-8e2cc6360ac8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:25.268682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69f3f856-bf2a-46cc-8b0d-8e2cc6360ac8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.271408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69f3f856-bf2a-46cc-8b0d-8e2cc6360ac8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.273095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69f3f856-bf2a-46cc-8b0d-8e2cc6360ac8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.277816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69f3f856-bf2a-46cc-8b0d-8e2cc6360ac8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.864793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cb66a198-7774-4f12-873c-1783f92494f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:25.866919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cb66a198-7774-4f12-873c-1783f92494f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:25.885866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb66a198-7774-4f12-873c-1783f92494f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.892308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb66a198-7774-4f12-873c-1783f92494f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.893513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb66a198-7774-4f12-873c-1783f92494f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.899597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb66a198-7774-4f12-873c-1783f92494f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.148569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cb66a198-7774-4f12-873c-1783f92494f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.159118 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cb66a198-7774-4f12-873c-1783f92494f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1173 microversion: 2.1 time: 0.304939 Jul 20 04:40:26.172193 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2834/5664] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:25 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1173 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:26.229901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1890dcf-afd4-4123-b699-6a11f0021637 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:26.231193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1890dcf-afd4-4123-b699-6a11f0021637 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:26.241592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1890dcf-afd4-4123-b699-6a11f0021637 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.243371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1890dcf-afd4-4123-b699-6a11f0021637 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.244399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1890dcf-afd4-4123-b699-6a11f0021637 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.246666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1890dcf-afd4-4123-b699-6a11f0021637 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.634782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a1890dcf-afd4-4123-b699-6a11f0021637 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.647362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-69f3f856-bf2a-46cc-8b0d-8e2cc6360ac8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.654965 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1890dcf-afd4-4123-b699-6a11f0021637 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.418656 Jul 20 04:40:26.656988 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2835/5665] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:26 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:26.666671 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-69f3f856-bf2a-46cc-8b0d-8e2cc6360ac8 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 1.421367 Jul 20 04:40:26.669895 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2831/5666] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:25 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:27.179785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b21c786-ef7a-493d-aaed-c20a15a9ae93 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:27.190090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b21c786-ef7a-493d-aaed-c20a15a9ae93 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:27.211086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b21c786-ef7a-493d-aaed-c20a15a9ae93 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.213894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b21c786-ef7a-493d-aaed-c20a15a9ae93 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.217267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b21c786-ef7a-493d-aaed-c20a15a9ae93 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.226100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b21c786-ef7a-493d-aaed-c20a15a9ae93 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.673819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6cbf785b-4968-4271-9e1d-34a9f6b2beb4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:27.675176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6cbf785b-4968-4271-9e1d-34a9f6b2beb4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:27.704694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cbf785b-4968-4271-9e1d-34a9f6b2beb4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.713791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cbf785b-4968-4271-9e1d-34a9f6b2beb4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.714793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cbf785b-4968-4271-9e1d-34a9f6b2beb4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.734981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cbf785b-4968-4271-9e1d-34a9f6b2beb4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.043477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b21c786-ef7a-493d-aaed-c20a15a9ae93 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:28.062750 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b21c786-ef7a-493d-aaed-c20a15a9ae93 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1215 microversion: 2.1 time: 0.889994 Jul 20 04:40:28.065568 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2836/5667] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:27 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1215 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:28.091746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cb56df8d-41ef-43ae-9e9f-61a21ba8c626 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:28.094190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cb56df8d-41ef-43ae-9e9f-61a21ba8c626 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:28.132697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb56df8d-41ef-43ae-9e9f-61a21ba8c626 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.133181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb56df8d-41ef-43ae-9e9f-61a21ba8c626 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.134007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb56df8d-41ef-43ae-9e9f-61a21ba8c626 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.137448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb56df8d-41ef-43ae-9e9f-61a21ba8c626 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.402648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6cbf785b-4968-4271-9e1d-34a9f6b2beb4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:28.418086 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6cbf785b-4968-4271-9e1d-34a9f6b2beb4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.748272 Jul 20 04:40:28.420470 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2832/5668] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:27 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:28.438179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ee080abd-ccec-4e94-b964-bad578940323 req-117e56f6-954f-4589-9326-8233be21d5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a908c5-87f5-4228-9815-f47c1195c4a6", "name": "network-vif-plugged", "status": "completed", "tag": "4d0e27c2-3182-484f-abb7-ff3d69355c02"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:28.474025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ee080abd-ccec-4e94-b964-bad578940323 req-117e56f6-954f-4589-9326-8233be21d5e8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.476421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ee080abd-ccec-4e94-b964-bad578940323 req-117e56f6-954f-4589-9326-8233be21d5e8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.505636 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ee080abd-ccec-4e94-b964-bad578940323 req-117e56f6-954f-4589-9326-8233be21d5e8 service nova] Creating event network-vif-plugged:4d0e27c2-3182-484f-abb7-ff3d69355c02 for instance 70a908c5-87f5-4228-9815-f47c1195c4a6 on n-h1-760456-11 Jul 20 04:40:28.515787 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ee080abd-ccec-4e94-b964-bad578940323 req-117e56f6-954f-4589-9326-8233be21d5e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093218 Jul 20 04:40:28.518526 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2833/5669] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:28.753142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cb56df8d-41ef-43ae-9e9f-61a21ba8c626 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:28.766077 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cb56df8d-41ef-43ae-9e9f-61a21ba8c626 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.686567 Jul 20 04:40:28.770675 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2837/5670] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:28 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:28.837658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2645dbc1-8a02-4b0a-b720-c24882fc9dae req-005195b4-15a0-478b-9d9e-59402bd5b96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55eeaa2b-516f-49c6-a2a6-74ac8bec9785", "tag": "04bbc1ee-6c54-493c-929f-3f98d3de8754"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:28.867477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2645dbc1-8a02-4b0a-b720-c24882fc9dae req-005195b4-15a0-478b-9d9e-59402bd5b96f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.868243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2645dbc1-8a02-4b0a-b720-c24882fc9dae req-005195b4-15a0-478b-9d9e-59402bd5b96f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.927792 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2645dbc1-8a02-4b0a-b720-c24882fc9dae req-005195b4-15a0-478b-9d9e-59402bd5b96f service nova] Creating event network-changed:04bbc1ee-6c54-493c-929f-3f98d3de8754 for instance 55eeaa2b-516f-49c6-a2a6-74ac8bec9785 on n-h1-760456-11 Jul 20 04:40:28.958224 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2645dbc1-8a02-4b0a-b720-c24882fc9dae req-005195b4-15a0-478b-9d9e-59402bd5b96f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116901 Jul 20 04:40:28.959334 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2834/5671] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:40:29.083701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8575176d-b6c1-40d0-82aa-bf3db9a4a072 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:29.084711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8575176d-b6c1-40d0-82aa-bf3db9a4a072 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:29.131982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8575176d-b6c1-40d0-82aa-bf3db9a4a072 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.132627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8575176d-b6c1-40d0-82aa-bf3db9a4a072 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.133490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8575176d-b6c1-40d0-82aa-bf3db9a4a072 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.133944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8575176d-b6c1-40d0-82aa-bf3db9a4a072 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.439035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ac57424-81b3-439e-994a-0f99d7f4bc24 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:29.439912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ac57424-81b3-439e-994a-0f99d7f4bc24 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:29.464197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ac57424-81b3-439e-994a-0f99d7f4bc24 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.464705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ac57424-81b3-439e-994a-0f99d7f4bc24 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.465718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ac57424-81b3-439e-994a-0f99d7f4bc24 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.474031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ac57424-81b3-439e-994a-0f99d7f4bc24 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.975796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8575176d-b6c1-40d0-82aa-bf3db9a4a072 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.001707 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8575176d-b6c1-40d0-82aa-bf3db9a4a072 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1215 microversion: 2.1 time: 0.922598 Jul 20 04:40:30.014332 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2838/5672] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:29 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1215 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:30.030269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a1281e4-4896-42be-8155-13263c7e95b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:30.033072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6a1281e4-4896-42be-8155-13263c7e95b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:30.048744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a1281e4-4896-42be-8155-13263c7e95b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.055059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a1281e4-4896-42be-8155-13263c7e95b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.055059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a1281e4-4896-42be-8155-13263c7e95b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.055059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a1281e4-4896-42be-8155-13263c7e95b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.074224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ac57424-81b3-439e-994a-0f99d7f4bc24 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.083727 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ac57424-81b3-439e-994a-0f99d7f4bc24 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.650194 Jul 20 04:40:30.094611 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2835/5673] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:29 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:30.549316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6a1281e4-4896-42be-8155-13263c7e95b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.576357 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6a1281e4-4896-42be-8155-13263c7e95b2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.557569 Jul 20 04:40:30.579381 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2839/5674] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:30 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:31.020411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80f2b9e3-8d22-4c51-bc33-558c0cee8cbb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:31.021046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-80f2b9e3-8d22-4c51-bc33-558c0cee8cbb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:31.039078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80f2b9e3-8d22-4c51-bc33-558c0cee8cbb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.039540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80f2b9e3-8d22-4c51-bc33-558c0cee8cbb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.040327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80f2b9e3-8d22-4c51-bc33-558c0cee8cbb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.040767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80f2b9e3-8d22-4c51-bc33-558c0cee8cbb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.106479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-effc0a77-c3f9-4d46-a55b-3e9c1e4493d6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:31.110438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-effc0a77-c3f9-4d46-a55b-3e9c1e4493d6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:31.131416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-effc0a77-c3f9-4d46-a55b-3e9c1e4493d6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.135083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-effc0a77-c3f9-4d46-a55b-3e9c1e4493d6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.141989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-effc0a77-c3f9-4d46-a55b-3e9c1e4493d6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.142589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-effc0a77-c3f9-4d46-a55b-3e9c1e4493d6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.474752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-80f2b9e3-8d22-4c51-bc33-558c0cee8cbb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:31.486560 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-80f2b9e3-8d22-4c51-bc33-558c0cee8cbb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1215 microversion: 2.1 time: 0.470748 Jul 20 04:40:31.487190 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2836/5675] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:31 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1215 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:31.597379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-19cafd74-c2ba-4fa9-84fd-84ce52b5ec2e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:31.598561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-19cafd74-c2ba-4fa9-84fd-84ce52b5ec2e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:31.616599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19cafd74-c2ba-4fa9-84fd-84ce52b5ec2e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.616988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19cafd74-c2ba-4fa9-84fd-84ce52b5ec2e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.626193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19cafd74-c2ba-4fa9-84fd-84ce52b5ec2e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.627545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-19cafd74-c2ba-4fa9-84fd-84ce52b5ec2e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.051954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-effc0a77-c3f9-4d46-a55b-3e9c1e4493d6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.066536 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-effc0a77-c3f9-4d46-a55b-3e9c1e4493d6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.964999 Jul 20 04:40:32.076368 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2840/5676] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:31 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:32.177341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-19cafd74-c2ba-4fa9-84fd-84ce52b5ec2e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.187773 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-19cafd74-c2ba-4fa9-84fd-84ce52b5ec2e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.594374 Jul 20 04:40:32.189441 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2837/5677] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:31 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:32.507487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1b4f1c36-681d-43e6-8930-b62045e453cb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:32.508107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1b4f1c36-681d-43e6-8930-b62045e453cb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:32.538668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b4f1c36-681d-43e6-8930-b62045e453cb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.539152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b4f1c36-681d-43e6-8930-b62045e453cb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.540017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b4f1c36-681d-43e6-8930-b62045e453cb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.540439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b4f1c36-681d-43e6-8930-b62045e453cb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.014536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1b4f1c36-681d-43e6-8930-b62045e453cb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.039944 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1b4f1c36-681d-43e6-8930-b62045e453cb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1215 microversion: 2.1 time: 0.537112 Jul 20 04:40:33.054499 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2841/5678] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:32 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1215 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:33.093927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-de43222e-b936-47df-8255-22b81db5c0ff tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:33.094661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-de43222e-b936-47df-8255-22b81db5c0ff tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:33.107468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:33.108793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:33.111964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de43222e-b936-47df-8255-22b81db5c0ff tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.123419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de43222e-b936-47df-8255-22b81db5c0ff tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.124679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de43222e-b936-47df-8255-22b81db5c0ff tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.125402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-de43222e-b936-47df-8255-22b81db5c0ff tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.210605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2a27229-cc68-4a37-b7f5-4db52ac5c5b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:33.211250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f2a27229-cc68-4a37-b7f5-4db52ac5c5b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:33.224227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2a27229-cc68-4a37-b7f5-4db52ac5c5b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.224692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2a27229-cc68-4a37-b7f5-4db52ac5c5b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.225504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2a27229-cc68-4a37-b7f5-4db52ac5c5b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.225961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2a27229-cc68-4a37-b7f5-4db52ac5c5b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.425646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-de43222e-b936-47df-8255-22b81db5c0ff tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.440651 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-de43222e-b936-47df-8255-22b81db5c0ff tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.351238 Jul 20 04:40:33.456782 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2838/5679] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:33 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:33.578893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:33.614102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f2a27229-cc68-4a37-b7f5-4db52ac5c5b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.631618 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f2a27229-cc68-4a37-b7f5-4db52ac5c5b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.424932 Jul 20 04:40:33.637965 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2842/5680] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:33 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:34.059200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b772baf-b399-4f5c-b50e-d2915e3d74de tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:34.060073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9b772baf-b399-4f5c-b50e-d2915e3d74de tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:34.077041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b772baf-b399-4f5c-b50e-d2915e3d74de tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.079018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b772baf-b399-4f5c-b50e-d2915e3d74de tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.082654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b772baf-b399-4f5c-b50e-d2915e3d74de tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.083212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b772baf-b399-4f5c-b50e-d2915e3d74de tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.464344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae6286bf-b151-4552-928e-19e0cf444bb5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:34.464695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b772baf-b399-4f5c-b50e-d2915e3d74de tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:34.466793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ae6286bf-b151-4552-928e-19e0cf444bb5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:34.482051 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9b772baf-b399-4f5c-b50e-d2915e3d74de tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1215 microversion: 2.1 time: 0.428384 Jul 20 04:40:34.486035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae6286bf-b151-4552-928e-19e0cf444bb5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.490383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae6286bf-b151-4552-928e-19e0cf444bb5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.491572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae6286bf-b151-4552-928e-19e0cf444bb5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.492377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae6286bf-b151-4552-928e-19e0cf444bb5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.493816 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2839/5681] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:34 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1215 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:34.667919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c252c358-f702-46a4-83bf-146426bc1894 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:34.668696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c252c358-f702-46a4-83bf-146426bc1894 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:34.695352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c252c358-f702-46a4-83bf-146426bc1894 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.697584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c252c358-f702-46a4-83bf-146426bc1894 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.702067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c252c358-f702-46a4-83bf-146426bc1894 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.702791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c252c358-f702-46a4-83bf-146426bc1894 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.877376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae6286bf-b151-4552-928e-19e0cf444bb5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:34.907841 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae6286bf-b151-4552-928e-19e0cf444bb5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.444507 Jul 20 04:40:34.927149 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2843/5682] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:34 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:35.213827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c252c358-f702-46a4-83bf-146426bc1894 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:35.227010 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c252c358-f702-46a4-83bf-146426bc1894 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.571407 Jul 20 04:40:35.228080 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2840/5683] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:34 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:35.502089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f60eb93-c18e-46ee-a322-16826d4376fe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:35.503147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3f60eb93-c18e-46ee-a322-16826d4376fe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:35.521966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f60eb93-c18e-46ee-a322-16826d4376fe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.522603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f60eb93-c18e-46ee-a322-16826d4376fe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.525723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f60eb93-c18e-46ee-a322-16826d4376fe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.527399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f60eb93-c18e-46ee-a322-16826d4376fe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.584027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:35.842116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3f60eb93-c18e-46ee-a322-16826d4376fe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:35.856883 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f60eb93-c18e-46ee-a322-16826d4376fe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1215 microversion: 2.1 time: 0.359907 Jul 20 04:40:35.857674 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2844/5684] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:35 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1215 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:35.932694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-711956d4-3669-416f-ba3d-9ee6cb0525ad tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:35.934193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-711956d4-3669-416f-ba3d-9ee6cb0525ad tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:35.945172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-711956d4-3669-416f-ba3d-9ee6cb0525ad tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.951469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-711956d4-3669-416f-ba3d-9ee6cb0525ad tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.958387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-711956d4-3669-416f-ba3d-9ee6cb0525ad tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.959175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-711956d4-3669-416f-ba3d-9ee6cb0525ad tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.245056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8fd4efd9-d20e-440c-a5aa-2212dad7521d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:36.246316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8fd4efd9-d20e-440c-a5aa-2212dad7521d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:36.257787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fd4efd9-d20e-440c-a5aa-2212dad7521d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.258611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fd4efd9-d20e-440c-a5aa-2212dad7521d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.259683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fd4efd9-d20e-440c-a5aa-2212dad7521d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.261372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fd4efd9-d20e-440c-a5aa-2212dad7521d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.268535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-711956d4-3669-416f-ba3d-9ee6cb0525ad tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.280664 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-711956d4-3669-416f-ba3d-9ee6cb0525ad tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.351900 Jul 20 04:40:36.285914 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2841/5685] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:35 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:36.492887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8fd4efd9-d20e-440c-a5aa-2212dad7521d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.507919 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8fd4efd9-d20e-440c-a5aa-2212dad7521d tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.267034 Jul 20 04:40:36.509590 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2845/5686] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:36 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:36.878537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea0b1a0d-ec95-49cf-921d-6cfa51df1a59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:36.879670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ea0b1a0d-ec95-49cf-921d-6cfa51df1a59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:36.884514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:36.904805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea0b1a0d-ec95-49cf-921d-6cfa51df1a59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.905375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea0b1a0d-ec95-49cf-921d-6cfa51df1a59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.906461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea0b1a0d-ec95-49cf-921d-6cfa51df1a59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.906999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea0b1a0d-ec95-49cf-921d-6cfa51df1a59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.245180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ea0b1a0d-ec95-49cf-921d-6cfa51df1a59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.258579 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ea0b1a0d-ec95-49cf-921d-6cfa51df1a59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1215 microversion: 2.1 time: 0.388421 Jul 20 04:40:37.271063 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2842/5687] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:36 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1215 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:37.303130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a51c265d-989a-425e-813a-8ed4d2fe153c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:37.304121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a51c265d-989a-425e-813a-8ed4d2fe153c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:37.317340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51c265d-989a-425e-813a-8ed4d2fe153c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.323212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51c265d-989a-425e-813a-8ed4d2fe153c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.325894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51c265d-989a-425e-813a-8ed4d2fe153c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.328751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51c265d-989a-425e-813a-8ed4d2fe153c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.527151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-037968c0-3d79-497a-9828-d79581555065 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:37.528236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-037968c0-3d79-497a-9828-d79581555065 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:37.543579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-037968c0-3d79-497a-9828-d79581555065 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.544398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-037968c0-3d79-497a-9828-d79581555065 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.545527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-037968c0-3d79-497a-9828-d79581555065 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.546226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-037968c0-3d79-497a-9828-d79581555065 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.854681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-037968c0-3d79-497a-9828-d79581555065 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.906136 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-037968c0-3d79-497a-9828-d79581555065 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.382557 Jul 20 04:40:37.908031 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2843/5688] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:37 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:38.258330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a51c265d-989a-425e-813a-8ed4d2fe153c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:38.268653 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a51c265d-989a-425e-813a-8ed4d2fe153c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.971616 Jul 20 04:40:38.269845 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2846/5689] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:37 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:38.287774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-204836f9-ad63-4132-acd2-c3970338850b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:38.288777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-204836f9-ad63-4132-acd2-c3970338850b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:38.302555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-204836f9-ad63-4132-acd2-c3970338850b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:38.303444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-204836f9-ad63-4132-acd2-c3970338850b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.304836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-204836f9-ad63-4132-acd2-c3970338850b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:38.305524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-204836f9-ad63-4132-acd2-c3970338850b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.711370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-204836f9-ad63-4132-acd2-c3970338850b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:38.723437 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-204836f9-ad63-4132-acd2-c3970338850b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1215 microversion: 2.1 time: 0.442015 Jul 20 04:40:38.732739 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2844/5690] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:38 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1215 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:38.931202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e32cae3-f53e-42a5-acc0-715e1ce03942 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:38.935136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e32cae3-f53e-42a5-acc0-715e1ce03942 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:38.962597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e32cae3-f53e-42a5-acc0-715e1ce03942 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:38.963132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e32cae3-f53e-42a5-acc0-715e1ce03942 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.964150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e32cae3-f53e-42a5-acc0-715e1ce03942 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:38.964602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e32cae3-f53e-42a5-acc0-715e1ce03942 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.287759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cd09e8a7-dcf5-404b-8f36-4dfc0bddc885 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:39.289199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cd09e8a7-dcf5-404b-8f36-4dfc0bddc885 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:39.292739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e32cae3-f53e-42a5-acc0-715e1ce03942 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.320991 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e32cae3-f53e-42a5-acc0-715e1ce03942 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.393451 Jul 20 04:40:39.321543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd09e8a7-dcf5-404b-8f36-4dfc0bddc885 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.323425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd09e8a7-dcf5-404b-8f36-4dfc0bddc885 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.323839 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2847/5691] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:38 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:39.325138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd09e8a7-dcf5-404b-8f36-4dfc0bddc885 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.326333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd09e8a7-dcf5-404b-8f36-4dfc0bddc885 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.709658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cd09e8a7-dcf5-404b-8f36-4dfc0bddc885 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.738575 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cd09e8a7-dcf5-404b-8f36-4dfc0bddc885 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.438149 Jul 20 04:40:39.738575 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2845/5692] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:39 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:39.744349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50a89bdd-262b-4064-a775-c9f40a41d7d0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:39.747245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-50a89bdd-262b-4064-a775-c9f40a41d7d0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:39.773294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50a89bdd-262b-4064-a775-c9f40a41d7d0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.773857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50a89bdd-262b-4064-a775-c9f40a41d7d0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.776084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50a89bdd-262b-4064-a775-c9f40a41d7d0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.776552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50a89bdd-262b-4064-a775-c9f40a41d7d0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.136853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-50a89bdd-262b-4064-a775-c9f40a41d7d0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:40.145708 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-50a89bdd-262b-4064-a775-c9f40a41d7d0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1215 microversion: 2.1 time: 0.405153 Jul 20 04:40:40.146915 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2848/5693] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:39 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1215 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:40.342157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6375208-fdf2-4eb3-aa93-e5331922fafc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:40.345998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a6375208-fdf2-4eb3-aa93-e5331922fafc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:40.357187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6375208-fdf2-4eb3-aa93-e5331922fafc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.358040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6375208-fdf2-4eb3-aa93-e5331922fafc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.359533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6375208-fdf2-4eb3-aa93-e5331922fafc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.360300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6375208-fdf2-4eb3-aa93-e5331922fafc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.554881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a6375208-fdf2-4eb3-aa93-e5331922fafc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:40.567829 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a6375208-fdf2-4eb3-aa93-e5331922fafc tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.230148 Jul 20 04:40:40.577839 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2846/5694] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:40 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:40.745609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cea48ee0-d4fe-4c09-9fce-180fc8f3f39a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:40.746160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cea48ee0-d4fe-4c09-9fce-180fc8f3f39a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:40.752918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cea48ee0-d4fe-4c09-9fce-180fc8f3f39a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.753394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cea48ee0-d4fe-4c09-9fce-180fc8f3f39a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.754621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cea48ee0-d4fe-4c09-9fce-180fc8f3f39a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.755080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cea48ee0-d4fe-4c09-9fce-180fc8f3f39a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.908158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cea48ee0-d4fe-4c09-9fce-180fc8f3f39a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:40.917129 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cea48ee0-d4fe-4c09-9fce-180fc8f3f39a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.175633 Jul 20 04:40:40.917970 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2849/5695] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:40 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:41.162596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-14501b1b-b921-43d0-bc7b-c84e4e678b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:41.163397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-14501b1b-b921-43d0-bc7b-c84e4e678b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:41.171046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14501b1b-b921-43d0-bc7b-c84e4e678b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.171846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14501b1b-b921-43d0-bc7b-c84e4e678b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.172910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14501b1b-b921-43d0-bc7b-c84e4e678b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.173504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14501b1b-b921-43d0-bc7b-c84e4e678b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.179853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:41.317362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-14501b1b-b921-43d0-bc7b-c84e4e678b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.325674 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-14501b1b-b921-43d0-bc7b-c84e4e678b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1203 microversion: 2.1 time: 0.167352 Jul 20 04:40:41.330752 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2847/5696] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:41 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:41.585412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6c06d876-4083-416e-98b8-677201871b2a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:41.586157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6c06d876-4083-416e-98b8-677201871b2a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:41.594301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c06d876-4083-416e-98b8-677201871b2a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.594854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c06d876-4083-416e-98b8-677201871b2a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.595725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c06d876-4083-416e-98b8-677201871b2a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.597233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c06d876-4083-416e-98b8-677201871b2a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.745453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6c06d876-4083-416e-98b8-677201871b2a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.753481 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6c06d876-4083-416e-98b8-677201871b2a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.172245 Jul 20 04:40:41.755089 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2850/5697] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:41 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:41.934349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7fb3be30-3bd0-4378-a77b-b8d66f4b17c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:41.934972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7fb3be30-3bd0-4378-a77b-b8d66f4b17c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:41.943055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7fb3be30-3bd0-4378-a77b-b8d66f4b17c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.943759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7fb3be30-3bd0-4378-a77b-b8d66f4b17c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.944730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7fb3be30-3bd0-4378-a77b-b8d66f4b17c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.945343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7fb3be30-3bd0-4378-a77b-b8d66f4b17c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.100334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7fb3be30-3bd0-4378-a77b-b8d66f4b17c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:42.112364 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7fb3be30-3bd0-4378-a77b-b8d66f4b17c6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.181813 Jul 20 04:40:42.119028 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2848/5698] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:41 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:42.344996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-106f290b-b3a1-4ec4-8f36-4d667589a24f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:42.345940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-106f290b-b3a1-4ec4-8f36-4d667589a24f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:42.353925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-106f290b-b3a1-4ec4-8f36-4d667589a24f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:42.354472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-106f290b-b3a1-4ec4-8f36-4d667589a24f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.355447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-106f290b-b3a1-4ec4-8f36-4d667589a24f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:42.356095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-106f290b-b3a1-4ec4-8f36-4d667589a24f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.509362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-106f290b-b3a1-4ec4-8f36-4d667589a24f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:42.518585 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-106f290b-b3a1-4ec4-8f36-4d667589a24f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1203 microversion: 2.1 time: 0.177051 Jul 20 04:40:42.520031 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2851/5699] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:42 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:42.772234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bca8382c-05f3-4d01-9a75-e0839cac67be tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:42.773362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bca8382c-05f3-4d01-9a75-e0839cac67be tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:42.780322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bca8382c-05f3-4d01-9a75-e0839cac67be tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:42.780853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bca8382c-05f3-4d01-9a75-e0839cac67be tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.781674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bca8382c-05f3-4d01-9a75-e0839cac67be tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:42.782095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bca8382c-05f3-4d01-9a75-e0839cac67be tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:42.951596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bca8382c-05f3-4d01-9a75-e0839cac67be tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:42.962276 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bca8382c-05f3-4d01-9a75-e0839cac67be tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.194310 Jul 20 04:40:42.962965 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2849/5700] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:42 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:43.135315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-22774cf1-7289-4bed-b1f0-8ed0de6f08fd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:43.135938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-22774cf1-7289-4bed-b1f0-8ed0de6f08fd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:43.145818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22774cf1-7289-4bed-b1f0-8ed0de6f08fd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.146333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22774cf1-7289-4bed-b1f0-8ed0de6f08fd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.147099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22774cf1-7289-4bed-b1f0-8ed0de6f08fd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.147554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-22774cf1-7289-4bed-b1f0-8ed0de6f08fd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.304101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-22774cf1-7289-4bed-b1f0-8ed0de6f08fd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:43.312904 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-22774cf1-7289-4bed-b1f0-8ed0de6f08fd tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.181488 Jul 20 04:40:43.313755 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2852/5701] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:43 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:43.536767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5959449e-0306-4b22-8e71-91a2e76669e8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:43.537641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5959449e-0306-4b22-8e71-91a2e76669e8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:43.544281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5959449e-0306-4b22-8e71-91a2e76669e8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.544808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5959449e-0306-4b22-8e71-91a2e76669e8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.545547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5959449e-0306-4b22-8e71-91a2e76669e8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.546181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5959449e-0306-4b22-8e71-91a2e76669e8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.740707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5959449e-0306-4b22-8e71-91a2e76669e8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:43.749789 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5959449e-0306-4b22-8e71-91a2e76669e8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1203 microversion: 2.1 time: 0.217041 Jul 20 04:40:43.751535 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2850/5702] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:43 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1203 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:43.979274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-51f7ea18-6541-4fc7-a378-c68bd5e0df23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:43.980218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-51f7ea18-6541-4fc7-a378-c68bd5e0df23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:43.987482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51f7ea18-6541-4fc7-a378-c68bd5e0df23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.988712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51f7ea18-6541-4fc7-a378-c68bd5e0df23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.989819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51f7ea18-6541-4fc7-a378-c68bd5e0df23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.990306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51f7ea18-6541-4fc7-a378-c68bd5e0df23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.187060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-51f7ea18-6541-4fc7-a378-c68bd5e0df23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:44.196642 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-51f7ea18-6541-4fc7-a378-c68bd5e0df23 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.221277 Jul 20 04:40:44.197997 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2853/5703] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:43 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:44.334344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e658ad1a-09e0-47cb-870e-e52879fae99f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.335936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e658ad1a-09e0-47cb-870e-e52879fae99f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:44.352458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e658ad1a-09e0-47cb-870e-e52879fae99f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.353506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e658ad1a-09e0-47cb-870e-e52879fae99f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.354519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e658ad1a-09e0-47cb-870e-e52879fae99f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.355124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e658ad1a-09e0-47cb-870e-e52879fae99f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.550387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e658ad1a-09e0-47cb-870e-e52879fae99f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:44.558090 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e658ad1a-09e0-47cb-870e-e52879fae99f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.230614 Jul 20 04:40:44.558983 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2851/5704] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:44.768611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8fabbd45-db8c-4b32-b566-18c96a9d6f9a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.768775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8fabbd45-db8c-4b32-b566-18c96a9d6f9a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:44.776555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fabbd45-db8c-4b32-b566-18c96a9d6f9a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.777018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fabbd45-db8c-4b32-b566-18c96a9d6f9a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.777846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fabbd45-db8c-4b32-b566-18c96a9d6f9a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.778319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8fabbd45-db8c-4b32-b566-18c96a9d6f9a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.951049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8fabbd45-db8c-4b32-b566-18c96a9d6f9a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:44.960456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8fabbd45-db8c-4b32-b566-18c96a9d6f9a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1203 microversion: 2.1 time: 0.196093 Jul 20 04:40:44.971555 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2854/5705] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1203 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:45.214824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4e1901a2-c1fd-4fa2-994b-bdeab1261aa3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.215558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4e1901a2-c1fd-4fa2-994b-bdeab1261aa3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:45.221873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e1901a2-c1fd-4fa2-994b-bdeab1261aa3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.222849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e1901a2-c1fd-4fa2-994b-bdeab1261aa3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.224029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e1901a2-c1fd-4fa2-994b-bdeab1261aa3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.224725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4e1901a2-c1fd-4fa2-994b-bdeab1261aa3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.435023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4e1901a2-c1fd-4fa2-994b-bdeab1261aa3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:45.444374 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4e1901a2-c1fd-4fa2-994b-bdeab1261aa3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.233674 Jul 20 04:40:45.445044 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2852/5706] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:45 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:45.575357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a777aa6-a595-40aa-a881-3e7d246e1a2f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.575975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5a777aa6-a595-40aa-a881-3e7d246e1a2f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:45.584053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a777aa6-a595-40aa-a881-3e7d246e1a2f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.584839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a777aa6-a595-40aa-a881-3e7d246e1a2f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.586437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a777aa6-a595-40aa-a881-3e7d246e1a2f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.587083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5a777aa6-a595-40aa-a881-3e7d246e1a2f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.752588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a777aa6-a595-40aa-a881-3e7d246e1a2f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:45.761708 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5a777aa6-a595-40aa-a881-3e7d246e1a2f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.189569 Jul 20 04:40:45.762570 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2855/5707] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:45 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:45.958392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5763ab45-49cf-4e69-895e-2f1c3f1604d8 req-faf18ebe-0afe-494b-be12-baa98454f7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02", "name": "network-vif-plugged", "status": "completed", "tag": "dbad2823-16de-4145-93a7-2756ed39d393"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:45.974005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5763ab45-49cf-4e69-895e-2f1c3f1604d8 req-faf18ebe-0afe-494b-be12-baa98454f7d2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.974957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5763ab45-49cf-4e69-895e-2f1c3f1604d8 req-faf18ebe-0afe-494b-be12-baa98454f7d2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.982160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3586ccf3-0b9d-4e5f-b286-053c72ff2531 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.983135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3586ccf3-0b9d-4e5f-b286-053c72ff2531 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:45.997973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3586ccf3-0b9d-4e5f-b286-053c72ff2531 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.998725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3586ccf3-0b9d-4e5f-b286-053c72ff2531 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.999530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3586ccf3-0b9d-4e5f-b286-053c72ff2531 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.999980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3586ccf3-0b9d-4e5f-b286-053c72ff2531 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.030057 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5763ab45-49cf-4e69-895e-2f1c3f1604d8 req-faf18ebe-0afe-494b-be12-baa98454f7d2 service nova] Creating event network-vif-plugged:dbad2823-16de-4145-93a7-2756ed39d393 for instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 on n-h1-760456-11 Jul 20 04:40:46.045293 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5763ab45-49cf-4e69-895e-2f1c3f1604d8 req-faf18ebe-0afe-494b-be12-baa98454f7d2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094659 Jul 20 04:40:46.047020 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2853/5708] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:46.250292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3586ccf3-0b9d-4e5f-b286-053c72ff2531 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.259014 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3586ccf3-0b9d-4e5f-b286-053c72ff2531 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1203 microversion: 2.1 time: 0.282544 Jul 20 04:40:46.260122 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2856/5709] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:45 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1203 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:46.465021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e571a6c-e59b-41fe-8721-2629ac87d979 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:46.465855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e571a6c-e59b-41fe-8721-2629ac87d979 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:46.476308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e571a6c-e59b-41fe-8721-2629ac87d979 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.478625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e571a6c-e59b-41fe-8721-2629ac87d979 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.480263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e571a6c-e59b-41fe-8721-2629ac87d979 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.480886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e571a6c-e59b-41fe-8721-2629ac87d979 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.635019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e571a6c-e59b-41fe-8721-2629ac87d979 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.643354 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e571a6c-e59b-41fe-8721-2629ac87d979 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.183465 Jul 20 04:40:46.644026 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2854/5710] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:46 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:46.782217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5c80ab70-61c0-43cf-acaa-2a4eed7e732f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:46.783488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5c80ab70-61c0-43cf-acaa-2a4eed7e732f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:46.792688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c80ab70-61c0-43cf-acaa-2a4eed7e732f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.793468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c80ab70-61c0-43cf-acaa-2a4eed7e732f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.794502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c80ab70-61c0-43cf-acaa-2a4eed7e732f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.798371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5c80ab70-61c0-43cf-acaa-2a4eed7e732f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.969980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5c80ab70-61c0-43cf-acaa-2a4eed7e732f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.979515 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5c80ab70-61c0-43cf-acaa-2a4eed7e732f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.204229 Jul 20 04:40:46.987563 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2857/5711] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:46 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:47.276869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e8bc481-b6c7-41c0-8274-49a7607dbf2f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:47.277587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5e8bc481-b6c7-41c0-8274-49a7607dbf2f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:47.285750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e8bc481-b6c7-41c0-8274-49a7607dbf2f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.286242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e8bc481-b6c7-41c0-8274-49a7607dbf2f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.287276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e8bc481-b6c7-41c0-8274-49a7607dbf2f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.287939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e8bc481-b6c7-41c0-8274-49a7607dbf2f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.474008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5e8bc481-b6c7-41c0-8274-49a7607dbf2f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:47.483009 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5e8bc481-b6c7-41c0-8274-49a7607dbf2f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1203 microversion: 2.1 time: 0.210448 Jul 20 04:40:47.494475 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2855/5712] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:47 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1203 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:47.669976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-094a3920-9d18-483c-b22e-d82a4f11d6b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:47.670961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-094a3920-9d18-483c-b22e-d82a4f11d6b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:47.679161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-094a3920-9d18-483c-b22e-d82a4f11d6b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.681381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-094a3920-9d18-483c-b22e-d82a4f11d6b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.687353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-094a3920-9d18-483c-b22e-d82a4f11d6b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.688018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-094a3920-9d18-483c-b22e-d82a4f11d6b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.912725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-094a3920-9d18-483c-b22e-d82a4f11d6b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:47.924750 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-094a3920-9d18-483c-b22e-d82a4f11d6b7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1519 microversion: 2.1 time: 0.267246 Jul 20 04:40:47.935621 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2858/5713] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:47 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:47.997039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-adf1a10f-3032-4d1d-8a27-65c062d3da41 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:47.997469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-adf1a10f-3032-4d1d-8a27-65c062d3da41 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:48.004376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adf1a10f-3032-4d1d-8a27-65c062d3da41 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.005350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adf1a10f-3032-4d1d-8a27-65c062d3da41 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.006372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adf1a10f-3032-4d1d-8a27-65c062d3da41 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.007042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adf1a10f-3032-4d1d-8a27-65c062d3da41 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.281510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-adf1a10f-3032-4d1d-8a27-65c062d3da41 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.291319 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-adf1a10f-3032-4d1d-8a27-65c062d3da41 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.298168 Jul 20 04:40:48.298437 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2856/5714] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:47 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:48.502720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7ecf29cc-31a8-4d32-bb44-0ce1ae43b79c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:48.503392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7ecf29cc-31a8-4d32-bb44-0ce1ae43b79c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:48.515518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ecf29cc-31a8-4d32-bb44-0ce1ae43b79c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.515991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ecf29cc-31a8-4d32-bb44-0ce1ae43b79c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.516891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ecf29cc-31a8-4d32-bb44-0ce1ae43b79c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.520596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ecf29cc-31a8-4d32-bb44-0ce1ae43b79c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.808856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7ecf29cc-31a8-4d32-bb44-0ce1ae43b79c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.934227 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7ecf29cc-31a8-4d32-bb44-0ce1ae43b79c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1203 microversion: 2.1 time: 0.321955 Jul 20 04:40:48.934227 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2859/5715] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:48 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1203 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:49.050345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f83a7e3-c1d7-465e-9410-3d9a46da7a72 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:49.050345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1f83a7e3-c1d7-465e-9410-3d9a46da7a72 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:49.050345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f83a7e3-c1d7-465e-9410-3d9a46da7a72 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.050345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f83a7e3-c1d7-465e-9410-3d9a46da7a72 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.050345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f83a7e3-c1d7-465e-9410-3d9a46da7a72 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.050345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f83a7e3-c1d7-465e-9410-3d9a46da7a72 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.219307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f83a7e3-c1d7-465e-9410-3d9a46da7a72 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:49.228959 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1f83a7e3-c1d7-465e-9410-3d9a46da7a72 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.289317 Jul 20 04:40:49.230190 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2857/5716] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:48 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:49.249815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e69b6b85-4169-42e1-838a-4357b1e1d254 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:49.251161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e69b6b85-4169-42e1-838a-4357b1e1d254 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:49.258471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e69b6b85-4169-42e1-838a-4357b1e1d254 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.259297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e69b6b85-4169-42e1-838a-4357b1e1d254 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.260111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e69b6b85-4169-42e1-838a-4357b1e1d254 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.260558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e69b6b85-4169-42e1-838a-4357b1e1d254 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.315006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ed7ba88b-f9f4-41f7-a495-b6a8bda8f9df tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:49.316495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ed7ba88b-f9f4-41f7-a495-b6a8bda8f9df tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:49.324936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed7ba88b-f9f4-41f7-a495-b6a8bda8f9df tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.325717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed7ba88b-f9f4-41f7-a495-b6a8bda8f9df tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.326771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed7ba88b-f9f4-41f7-a495-b6a8bda8f9df tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.327421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed7ba88b-f9f4-41f7-a495-b6a8bda8f9df tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.433680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e69b6b85-4169-42e1-838a-4357b1e1d254 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:49.443847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:49.468796 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e69b6b85-4169-42e1-838a-4357b1e1d254 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.226359 Jul 20 04:40:49.470097 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2860/5717] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:49 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:49.496765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-09bbd667-741a-49ab-9771-56160b4d29a2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:49.497410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-09bbd667-741a-49ab-9771-56160b4d29a2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:49.510663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09bbd667-741a-49ab-9771-56160b4d29a2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.511484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09bbd667-741a-49ab-9771-56160b4d29a2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.513004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09bbd667-741a-49ab-9771-56160b4d29a2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.513671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09bbd667-741a-49ab-9771-56160b4d29a2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.654369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ed7ba88b-f9f4-41f7-a495-b6a8bda8f9df tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:49.670529 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ed7ba88b-f9f4-41f7-a495-b6a8bda8f9df tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.359351 Jul 20 04:40:49.671524 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2858/5718] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:49 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:49.686815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cbc03ba6-9a65-4527-be6f-55f0958bd80d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:49.700344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cbc03ba6-9a65-4527-be6f-55f0958bd80d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:49.713137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbc03ba6-9a65-4527-be6f-55f0958bd80d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.713869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbc03ba6-9a65-4527-be6f-55f0958bd80d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.714888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbc03ba6-9a65-4527-be6f-55f0958bd80d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.715333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cbc03ba6-9a65-4527-be6f-55f0958bd80d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.727762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09bbd667-741a-49ab-9771-56160b4d29a2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:49.739936 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-09bbd667-741a-49ab-9771-56160b4d29a2 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.248996 Jul 20 04:40:49.740536 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2861/5719] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:49 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:49.763161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f5794c23-0158-4e84-b633-da405c171d53 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:49.774686 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-f5794c23-0158-4e84-b633-da405c171d53 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 1287dac7-4cdc-4924-94f6-7c7fb2003cea has no mapping to a cell. Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f5794c23-0158-4e84-b633-da405c171d53 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/1287dac7-4cdc-4924-94f6-7c7fb2003cea/action HTTP/1.1 Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 15 Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: {"os-stop": {}} Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 1287dac7-4cdc-4924-94f6-7c7fb2003cea has no mapping to a cell. Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '1287dac7-4cdc-4924-94f6-7c7fb2003cea', 'body': {'os-stop': {}}} Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 1287dac7-4cdc-4924-94f6-7c7fb2003cea has no mapping to a cell. Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:49.779785 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1287dac7-4cdc-4924-94f6-7c7fb2003cea has no mapping to a cell. Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1287dac7-4cdc-4924-94f6-7c7fb2003cea has no mapping to a cell. Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f5794c23-0158-4e84-b633-da405c171d53 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 1287dac7-4cdc-4924-94f6-7c7fb2003cea has no mapping to a cell. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f5794c23-0158-4e84-b633-da405c171d53 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/1287dac7-4cdc-4924-94f6-7c7fb2003cea/action" status: 404 len: 117 microversion: 2.1 time: 0.028507 Jul 20 04:40:49.784915 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2862/5720] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:49 2022] POST /compute/v2.1/servers/1287dac7-4cdc-4924-94f6-7c7fb2003cea/action => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:49.795989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-519d3f51-60c8-4e08-a4d1-8b1b8cc062d3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:49.797707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-519d3f51-60c8-4e08-a4d1-8b1b8cc062d3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:49.809991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-519d3f51-60c8-4e08-a4d1-8b1b8cc062d3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.810794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-519d3f51-60c8-4e08-a4d1-8b1b8cc062d3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.811922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-519d3f51-60c8-4e08-a4d1-8b1b8cc062d3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.812771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-519d3f51-60c8-4e08-a4d1-8b1b8cc062d3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.829815 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cbc03ba6-9a65-4527-be6f-55f0958bd80d tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "POST /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6/action" status: 200 len: 24562 microversion: 2.1 time: 0.152770 Jul 20 04:40:49.838927 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2859/5721] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:49 2022] POST /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6/action => generated 24562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:40:49.845988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8e244412-f7be-4056-af51-58d877a8ca89 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:49.854024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8e244412-f7be-4056-af51-58d877a8ca89 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:49.864848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e244412-f7be-4056-af51-58d877a8ca89 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.865316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e244412-f7be-4056-af51-58d877a8ca89 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.867733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e244412-f7be-4056-af51-58d877a8ca89 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.868198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e244412-f7be-4056-af51-58d877a8ca89 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.024454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-519d3f51-60c8-4e08-a4d1-8b1b8cc062d3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:50.032732 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-519d3f51-60c8-4e08-a4d1-8b1b8cc062d3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.245615 Jul 20 04:40:50.034484 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2863/5722] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:49 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:50.054002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9a34d719-bb76-4370-b10c-01de9921e0f3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:50.056233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9a34d719-bb76-4370-b10c-01de9921e0f3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:50.062997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a34d719-bb76-4370-b10c-01de9921e0f3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.063459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a34d719-bb76-4370-b10c-01de9921e0f3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.064247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a34d719-bb76-4370-b10c-01de9921e0f3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.064872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a34d719-bb76-4370-b10c-01de9921e0f3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.254685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8e244412-f7be-4056-af51-58d877a8ca89 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:50.266223 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8e244412-f7be-4056-af51-58d877a8ca89 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1203 microversion: 2.1 time: 0.425349 Jul 20 04:40:50.269366 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2860/5723] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:49 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1203 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:50.355216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9a34d719-bb76-4370-b10c-01de9921e0f3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:50.366696 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9a34d719-bb76-4370-b10c-01de9921e0f3 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.317192 Jul 20 04:40:50.379023 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2864/5724] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:50 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:50.385564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-357a3f5d-5bdb-4ea6-b811-c6985ec26709 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:50.386192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-357a3f5d-5bdb-4ea6-b811-c6985ec26709 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8f1f7151-6382-4c8b-bf31-cec3b9255af0] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:50.414355 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-357a3f5d-5bdb-4ea6-b811-c6985ec26709 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 8f1f7151-6382-4c8b-bf31-cec3b9255af0 could not be found. Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-357a3f5d-5bdb-4ea6-b811-c6985ec26709 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/8f1f7151-6382-4c8b-bf31-cec3b9255af0/action HTTP/1.1 Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 15 Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: {"suspend": {}} Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 8f1f7151-6382-4c8b-bf31-cec3b9255af0 could not be found. Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8f1f7151-6382-4c8b-bf31-cec3b9255af0', 'body': {'suspend': {}}} Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1f7151-6382-4c8b-bf31-cec3b9255af0 could not be found. Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1f7151-6382-4c8b-bf31-cec3b9255af0 could not be found. Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:50.421439 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:50.426725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:50.426725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:50.426725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1f7151-6382-4c8b-bf31-cec3b9255af0 could not be found. Jul 20 04:40:50.426725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:50.429913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-357a3f5d-5bdb-4ea6-b811-c6985ec26709 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 8f1f7151-6382-4c8b-bf31-cec3b9255af0 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:50.431054 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-357a3f5d-5bdb-4ea6-b811-c6985ec26709 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8f1f7151-6382-4c8b-bf31-cec3b9255af0/action" status: 404 len: 111 microversion: 2.1 time: 0.049649 Jul 20 04:40:50.432252 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2861/5725] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:50 2022] POST /compute/v2.1/servers/8f1f7151-6382-4c8b-bf31-cec3b9255af0/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:50.440269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2f2a1aa9-6ad7-4c68-8321-219eccc4c6bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:50.442104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f2a1aa9-6ad7-4c68-8321-219eccc4c6bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:50.463971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f2a1aa9-6ad7-4c68-8321-219eccc4c6bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.464455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f2a1aa9-6ad7-4c68-8321-219eccc4c6bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.465316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f2a1aa9-6ad7-4c68-8321-219eccc4c6bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.465770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f2a1aa9-6ad7-4c68-8321-219eccc4c6bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.688062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-71be8d73-d9b9-418b-b044-9ba348099ed2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:50.688680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-71be8d73-d9b9-418b-b044-9ba348099ed2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:50.708776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71be8d73-d9b9-418b-b044-9ba348099ed2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.709244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71be8d73-d9b9-418b-b044-9ba348099ed2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.710053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71be8d73-d9b9-418b-b044-9ba348099ed2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.710511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71be8d73-d9b9-418b-b044-9ba348099ed2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.752957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2f2a1aa9-6ad7-4c68-8321-219eccc4c6bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:50.765481 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2f2a1aa9-6ad7-4c68-8321-219eccc4c6bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.328622 Jul 20 04:40:50.765859 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2865/5726] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:50 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:50.784886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97e4b957-f2d8-4de8-8295-c757b5598124 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:50.785811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97e4b957-f2d8-4de8-8295-c757b5598124 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:50.794211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97e4b957-f2d8-4de8-8295-c757b5598124 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.795055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97e4b957-f2d8-4de8-8295-c757b5598124 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.796319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97e4b957-f2d8-4de8-8295-c757b5598124 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.796990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97e4b957-f2d8-4de8-8295-c757b5598124 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.025490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97e4b957-f2d8-4de8-8295-c757b5598124 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:51.035677 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97e4b957-f2d8-4de8-8295-c757b5598124 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.254426 Jul 20 04:40:51.036745 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2866/5727] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:50 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:51.066768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f665a753-7f05-4322-a8a0-5b8e3e4fc0e1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:51.067779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f665a753-7f05-4322-a8a0-5b8e3e4fc0e1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:51.075893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f665a753-7f05-4322-a8a0-5b8e3e4fc0e1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.076555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f665a753-7f05-4322-a8a0-5b8e3e4fc0e1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.078243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f665a753-7f05-4322-a8a0-5b8e3e4fc0e1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.078975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f665a753-7f05-4322-a8a0-5b8e3e4fc0e1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.123613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-f665a753-7f05-4322-a8a0-5b8e3e4fc0e1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lazy-loading 'flavor' on Instance uuid 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:51.150300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-71be8d73-d9b9-418b-b044-9ba348099ed2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:51.180004 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-71be8d73-d9b9-418b-b044-9ba348099ed2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.482072 Jul 20 04:40:51.180709 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2862/5728] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:50 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:51.286299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1746bab8-25b6-4445-9abc-7bc2cebfe979 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:51.287232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1746bab8-25b6-4445-9abc-7bc2cebfe979 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:51.296133 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f665a753-7f05-4322-a8a0-5b8e3e4fc0e1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 202 len: 0 microversion: 2.1 time: 0.241691 Jul 20 04:40:51.297907 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2867/5729] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:51 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:51.307880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1746bab8-25b6-4445-9abc-7bc2cebfe979 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.308348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1746bab8-25b6-4445-9abc-7bc2cebfe979 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.309159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1746bab8-25b6-4445-9abc-7bc2cebfe979 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.312412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1746bab8-25b6-4445-9abc-7bc2cebfe979 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.321595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6d6902a9-ad5e-49a7-9698-551fa0722cc9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:51.322410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6d6902a9-ad5e-49a7-9698-551fa0722cc9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:51.336125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d6902a9-ad5e-49a7-9698-551fa0722cc9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.380346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d6902a9-ad5e-49a7-9698-551fa0722cc9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.388074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d6902a9-ad5e-49a7-9698-551fa0722cc9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.388711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6d6902a9-ad5e-49a7-9698-551fa0722cc9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.664246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6d6902a9-ad5e-49a7-9698-551fa0722cc9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:51.675184 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6d6902a9-ad5e-49a7-9698-551fa0722cc9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1514 microversion: 2.1 time: 0.360449 Jul 20 04:40:51.684798 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2868/5730] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:51 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:51.785305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1746bab8-25b6-4445-9abc-7bc2cebfe979 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:51.799486 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1746bab8-25b6-4445-9abc-7bc2cebfe979 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1203 microversion: 2.1 time: 0.518472 Jul 20 04:40:51.800632 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2863/5731] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:51 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1203 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:52.177623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-20484b04-c74d-455c-8656-7efed994aeb8 req-d6e4771c-905c-4e13-88f4-207a4e849113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55eeaa2b-516f-49c6-a2a6-74ac8bec9785", "name": "network-vif-plugged", "status": "completed", "tag": "04bbc1ee-6c54-493c-929f-3f98d3de8754"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:52.197524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-92705825-b243-4ef5-9938-bedbdb8be4bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:52.198268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-92705825-b243-4ef5-9938-bedbdb8be4bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:52.201285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-20484b04-c74d-455c-8656-7efed994aeb8 req-d6e4771c-905c-4e13-88f4-207a4e849113 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.201754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-20484b04-c74d-455c-8656-7efed994aeb8 req-d6e4771c-905c-4e13-88f4-207a4e849113 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.214990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92705825-b243-4ef5-9938-bedbdb8be4bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.215550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92705825-b243-4ef5-9938-bedbdb8be4bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.216418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92705825-b243-4ef5-9938-bedbdb8be4bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.216937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92705825-b243-4ef5-9938-bedbdb8be4bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.237254 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-20484b04-c74d-455c-8656-7efed994aeb8 req-d6e4771c-905c-4e13-88f4-207a4e849113 service nova] Creating event network-vif-plugged:04bbc1ee-6c54-493c-929f-3f98d3de8754 for instance 55eeaa2b-516f-49c6-a2a6-74ac8bec9785 on n-h1-760456-11 Jul 20 04:40:52.245120 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-20484b04-c74d-455c-8656-7efed994aeb8 req-d6e4771c-905c-4e13-88f4-207a4e849113 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072067 Jul 20 04:40:52.248560 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2869/5732] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:52.624149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-92705825-b243-4ef5-9938-bedbdb8be4bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:52.657195 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-92705825-b243-4ef5-9938-bedbdb8be4bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1520 microversion: 2.1 time: 0.456886 Jul 20 04:40:52.666233 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2864/5733] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:52 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1520 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:52.693166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7fcd89e2-49a1-44d4-9d5d-530abb7209ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:52.693886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7fcd89e2-49a1-44d4-9d5d-530abb7209ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:52.727155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fcd89e2-49a1-44d4-9d5d-530abb7209ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.727629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fcd89e2-49a1-44d4-9d5d-530abb7209ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.728440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fcd89e2-49a1-44d4-9d5d-530abb7209ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.728894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fcd89e2-49a1-44d4-9d5d-530abb7209ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.820043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-761dd3b7-a8cd-491c-a2af-f8b544128dee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:52.823048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-761dd3b7-a8cd-491c-a2af-f8b544128dee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:52.842323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-761dd3b7-a8cd-491c-a2af-f8b544128dee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.842792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-761dd3b7-a8cd-491c-a2af-f8b544128dee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.843585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-761dd3b7-a8cd-491c-a2af-f8b544128dee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.844041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-761dd3b7-a8cd-491c-a2af-f8b544128dee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.007160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7fcd89e2-49a1-44d4-9d5d-530abb7209ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:53.015746 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7fcd89e2-49a1-44d4-9d5d-530abb7209ec tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1497 microversion: 2.1 time: 0.327538 Jul 20 04:40:53.036160 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2870/5734] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:52 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1497 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:53.048444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:53.051055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:53.082750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.083259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.084400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.085166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.146598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lazy-loading 'flavor' on Instance uuid 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:53.157054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-761dd3b7-a8cd-491c-a2af-f8b544128dee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:53.160308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:53.186781 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-761dd3b7-a8cd-491c-a2af-f8b544128dee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1203 microversion: 2.1 time: 0.372929 Jul 20 04:40:53.192045 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2865/5735] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:52 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1203 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:53.198010 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Cannot 'suspend' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state suspended Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action HTTP/1.1 Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 15 Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: {"suspend": {}} Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: exception: Cannot 'suspend' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state suspended Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02', 'body': {'suspend': {}}} Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 20 04:40:53.213974 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state suspended Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state suspended Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:53.219767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 409 to user: Cannot 'suspend' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state suspended {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:53.223289 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-07546739-e312-45da-8897-466aa705b41e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 409 len: 148 microversion: 2.1 time: 0.185715 Jul 20 04:40:53.226065 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2871/5736] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:53 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 148 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:40:53.236161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f0e4f098-ee63-4844-b3a1-0f732a24f72b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:53.237150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f0e4f098-ee63-4844-b3a1-0f732a24f72b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:53.254788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0e4f098-ee63-4844-b3a1-0f732a24f72b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.255406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0e4f098-ee63-4844-b3a1-0f732a24f72b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.257221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0e4f098-ee63-4844-b3a1-0f732a24f72b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.257897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0e4f098-ee63-4844-b3a1-0f732a24f72b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.408029 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f0e4f098-ee63-4844-b3a1-0f732a24f72b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 202 len: 0 microversion: 2.1 time: 0.177160 Jul 20 04:40:53.408803 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2866/5737] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:53 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:53.421142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f16f15d3-d459-43f3-9601-461fca6534bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:53.422084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f16f15d3-d459-43f3-9601-461fca6534bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:53.432110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f16f15d3-d459-43f3-9601-461fca6534bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.432689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f16f15d3-d459-43f3-9601-461fca6534bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.434007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f16f15d3-d459-43f3-9601-461fca6534bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.434757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f16f15d3-d459-43f3-9601-461fca6534bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.677281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-88b89a06-a932-46c1-9e76-3fcf4e4b2523 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:53.678767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-88b89a06-a932-46c1-9e76-3fcf4e4b2523 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:53.700518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88b89a06-a932-46c1-9e76-3fcf4e4b2523 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.701245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88b89a06-a932-46c1-9e76-3fcf4e4b2523 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.702303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88b89a06-a932-46c1-9e76-3fcf4e4b2523 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.703146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88b89a06-a932-46c1-9e76-3fcf4e4b2523 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.755792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f16f15d3-d459-43f3-9601-461fca6534bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:53.769406 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f16f15d3-d459-43f3-9601-461fca6534bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1503 microversion: 2.1 time: 0.354206 Jul 20 04:40:53.773150 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2872/5738] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:53 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1503 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:53.990782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-88b89a06-a932-46c1-9e76-3fcf4e4b2523 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.005518 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-88b89a06-a932-46c1-9e76-3fcf4e4b2523 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1500 microversion: 2.1 time: 0.331267 Jul 20 04:40:54.007203 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2867/5739] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:53 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1500 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:54.025203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-53bb73d6-f1c9-4cde-aeba-311325913059 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:54.026314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-53bb73d6-f1c9-4cde-aeba-311325913059 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.033520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53bb73d6-f1c9-4cde-aeba-311325913059 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.034728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53bb73d6-f1c9-4cde-aeba-311325913059 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.035643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53bb73d6-f1c9-4cde-aeba-311325913059 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.036801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53bb73d6-f1c9-4cde-aeba-311325913059 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.208929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c84f5b8-4918-4b38-8177-9127a8dbe134 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:54.209460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c84f5b8-4918-4b38-8177-9127a8dbe134 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.226152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c84f5b8-4918-4b38-8177-9127a8dbe134 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.226643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c84f5b8-4918-4b38-8177-9127a8dbe134 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.227445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c84f5b8-4918-4b38-8177-9127a8dbe134 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.227895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c84f5b8-4918-4b38-8177-9127a8dbe134 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.395366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c84f5b8-4918-4b38-8177-9127a8dbe134 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.404055 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c84f5b8-4918-4b38-8177-9127a8dbe134 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1390 microversion: 2.1 time: 0.199176 Jul 20 04:40:54.405256 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2868/5740] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:54 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1390 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:54.422705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d3cb77e-4632-4c84-bc85-1e5417f5f05c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:54.423636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d3cb77e-4632-4c84-bc85-1e5417f5f05c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.431072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d3cb77e-4632-4c84-bc85-1e5417f5f05c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.431833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d3cb77e-4632-4c84-bc85-1e5417f5f05c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.432797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d3cb77e-4632-4c84-bc85-1e5417f5f05c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.433409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d3cb77e-4632-4c84-bc85-1e5417f5f05c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.647353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d3cb77e-4632-4c84-bc85-1e5417f5f05c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.658739 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d3cb77e-4632-4c84-bc85-1e5417f5f05c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1390 microversion: 2.1 time: 0.239772 Jul 20 04:40:54.671057 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2869/5741] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:54 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1390 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:54.676773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-921f9217-3924-463d-a91d-1083f0786c06 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:54.692294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-921f9217-3924-463d-a91d-1083f0786c06 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.708180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-921f9217-3924-463d-a91d-1083f0786c06 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.709041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-921f9217-3924-463d-a91d-1083f0786c06 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.709860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-921f9217-3924-463d-a91d-1083f0786c06 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.710336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-921f9217-3924-463d-a91d-1083f0786c06 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.884692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-53bb73d6-f1c9-4cde-aeba-311325913059 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.894446 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-53bb73d6-f1c9-4cde-aeba-311325913059 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1514 microversion: 2.1 time: 0.872890 Jul 20 04:40:54.905354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-921f9217-3924-463d-a91d-1083f0786c06 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.910533 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2873/5742] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:54 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1514 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:54.918399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd67a965-9f5b-42d4-9848-1ba7f96f403b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:54.919209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd67a965-9f5b-42d4-9848-1ba7f96f403b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.921419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=84 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:54.929568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd67a965-9f5b-42d4-9848-1ba7f96f403b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.930205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd67a965-9f5b-42d4-9848-1ba7f96f403b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.931205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd67a965-9f5b-42d4-9848-1ba7f96f403b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.931815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd67a965-9f5b-42d4-9848-1ba7f96f403b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.933393 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-921f9217-3924-463d-a91d-1083f0786c06 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1390 microversion: 2.1 time: 0.260609 Jul 20 04:40:54.934009 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2870/5743] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:54 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1390 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:54.947705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84c30792-a2b4-4197-9780-8935f25473da tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:54.949205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-84c30792-a2b4-4197-9780-8935f25473da tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: d6bccc05-72bf-460e-9cdc-63b751d20dd1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.969222 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-84c30792-a2b4-4197-9780-8935f25473da tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] HTTP exception thrown: Instance d6bccc05-72bf-460e-9cdc-63b751d20dd1 could not be found. Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84c30792-a2b4-4197-9780-8935f25473da tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Request method failure captured: Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/d6bccc05-72bf-460e-9cdc-63b751d20dd1/action HTTP/1.1 Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 14 Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14cVvlyFQK0Hky763YtJNZmga-seuiHv50lzr8c708UaBjY5LhinFPM_QzRPumN7lebUV8SaN9g5W8Pjefaa4UE9X-ySIx3izX52Mcn-dmW_45ztV_oVGdlJV1fLy4MHx9SEfL5owl8e_frcmqcUAJfCEXDSfh8n8iumlmvk569aBtU Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9138f252886e4faea3710ff7d6764683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9138f252886e4faea3710ff7d6764683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: eff6843f674047fc9a8841711244bce4 Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: {"rescue": {}} Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance d6bccc05-72bf-460e-9cdc-63b751d20dd1 could not be found. Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'd6bccc05-72bf-460e-9cdc-63b751d20dd1', 'body': {'rescue': {}}} Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6bccc05-72bf-460e-9cdc-63b751d20dd1 could not be found. Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6bccc05-72bf-460e-9cdc-63b751d20dd1 could not be found. Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:54.979665 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:54.989899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:54.989899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:54.989899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:54.989899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:54.989899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6bccc05-72bf-460e-9cdc-63b751d20dd1 could not be found. Jul 20 04:40:54.989899 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:54.989899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84c30792-a2b4-4197-9780-8935f25473da tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Returning 404 to user: Instance d6bccc05-72bf-460e-9cdc-63b751d20dd1 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:54.989899 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-84c30792-a2b4-4197-9780-8935f25473da tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/d6bccc05-72bf-460e-9cdc-63b751d20dd1/action" status: 404 len: 111 microversion: 2.1 time: 0.039097 Jul 20 04:40:54.989899 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2871/5744] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:54 2022] POST /compute/v2.1/servers/d6bccc05-72bf-460e-9cdc-63b751d20dd1/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:54.999389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7233cbfb-9c66-4a66-b1c9-98aa9fc7702a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:55.000518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7233cbfb-9c66-4a66-b1c9-98aa9fc7702a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.009503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7233cbfb-9c66-4a66-b1c9-98aa9fc7702a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.009959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7233cbfb-9c66-4a66-b1c9-98aa9fc7702a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.010771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7233cbfb-9c66-4a66-b1c9-98aa9fc7702a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.011212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7233cbfb-9c66-4a66-b1c9-98aa9fc7702a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.039823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7233cbfb-9c66-4a66-b1c9-98aa9fc7702a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:40:55.176782 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7233cbfb-9c66-4a66-b1c9-98aa9fc7702a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 204 len: 0 microversion: 2.1 time: 0.192485 Jul 20 04:40:55.180507 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2872/5745] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:40:54 2022] DELETE /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:40:55.184199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-221593b0-8e6c-498c-b4f1-0103cabf1249 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:55.184841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-221593b0-8e6c-498c-b4f1-0103cabf1249 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.192841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-221593b0-8e6c-498c-b4f1-0103cabf1249 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.193309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-221593b0-8e6c-498c-b4f1-0103cabf1249 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.194164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-221593b0-8e6c-498c-b4f1-0103cabf1249 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.194700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-221593b0-8e6c-498c-b4f1-0103cabf1249 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.285962 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-221593b0-8e6c-498c-b4f1-0103cabf1249 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action" status: 202 len: 0 microversion: 2.1 time: 0.105580 Jul 20 04:40:55.287044 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2873/5746] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:55 2022] POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:55.295221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-489ce4fa-2fc5-483b-bff5-d9329084122e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:55.295950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-489ce4fa-2fc5-483b-bff5-d9329084122e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.305830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-489ce4fa-2fc5-483b-bff5-d9329084122e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.306330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-489ce4fa-2fc5-483b-bff5-d9329084122e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.307372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cd67a965-9f5b-42d4-9848-1ba7f96f403b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:55.307541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-489ce4fa-2fc5-483b-bff5-d9329084122e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.308038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-489ce4fa-2fc5-483b-bff5-d9329084122e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.325153 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd67a965-9f5b-42d4-9848-1ba7f96f403b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1503 microversion: 2.1 time: 0.413167 Jul 20 04:40:55.325875 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2874/5747] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:54 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1503 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:55.331929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17580b3a-1460-4203-b9b5-0c16776fdc5d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:55.333320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-17580b3a-1460-4203-b9b5-0c16776fdc5d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.344308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17580b3a-1460-4203-b9b5-0c16776fdc5d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.345041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17580b3a-1460-4203-b9b5-0c16776fdc5d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.346221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17580b3a-1460-4203-b9b5-0c16776fdc5d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.348350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17580b3a-1460-4203-b9b5-0c16776fdc5d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.882669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-17580b3a-1460-4203-b9b5-0c16776fdc5d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:55.914671 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-17580b3a-1460-4203-b9b5-0c16776fdc5d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1519 microversion: 2.1 time: 0.584321 Jul 20 04:40:55.917466 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2875/5748] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:55 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1519 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:56.009248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-489ce4fa-2fc5-483b-bff5-d9329084122e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.021371 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-489ce4fa-2fc5-483b-bff5-d9329084122e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1396 microversion: 2.1 time: 0.732912 Jul 20 04:40:56.022850 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2874/5749] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:55 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1396 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:56.343320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5be01abb-9545-4cb1-bc81-58470ca9a470 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:56.345110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5be01abb-9545-4cb1-bc81-58470ca9a470 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:56.354531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5be01abb-9545-4cb1-bc81-58470ca9a470 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.355658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5be01abb-9545-4cb1-bc81-58470ca9a470 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.357149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5be01abb-9545-4cb1-bc81-58470ca9a470 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.357803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5be01abb-9545-4cb1-bc81-58470ca9a470 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.610853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5be01abb-9545-4cb1-bc81-58470ca9a470 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.620051 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5be01abb-9545-4cb1-bc81-58470ca9a470 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1503 microversion: 2.1 time: 0.280684 Jul 20 04:40:56.642437 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2876/5750] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:56 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1503 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:56.934929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e02af846-a124-4bfb-8695-ff1037c6b369 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:56.935559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e02af846-a124-4bfb-8695-ff1037c6b369 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:56.959048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e02af846-a124-4bfb-8695-ff1037c6b369 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.959843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e02af846-a124-4bfb-8695-ff1037c6b369 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.960839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e02af846-a124-4bfb-8695-ff1037c6b369 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.961458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e02af846-a124-4bfb-8695-ff1037c6b369 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.041297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8965f3b1-cad4-44cc-8702-e21a8f681d69 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:57.041926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8965f3b1-cad4-44cc-8702-e21a8f681d69 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:57.056848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8965f3b1-cad4-44cc-8702-e21a8f681d69 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.057699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8965f3b1-cad4-44cc-8702-e21a8f681d69 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.074095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8965f3b1-cad4-44cc-8702-e21a8f681d69 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.074876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8965f3b1-cad4-44cc-8702-e21a8f681d69 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.095654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:57.185662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e02af846-a124-4bfb-8695-ff1037c6b369 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:57.196441 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e02af846-a124-4bfb-8695-ff1037c6b369 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1499 microversion: 2.1 time: 0.265127 Jul 20 04:40:57.198302 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2875/5751] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:56 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1499 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:57.216478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:57.217734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:57.224754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.225218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.226008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.226485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.256652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lazy-loading 'flavor' on Instance uuid a68a62b9-e978-4872-8c85-1b81c0f7341b {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:57.272318 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] HTTP exception thrown: Cannot 'rescue' instance a68a62b9-e978-4872-8c85-1b81c0f7341b while it is in vm_state paused Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Request method failure captured: Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action HTTP/1.1 Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 14 Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14cVvlyFQK0Hky763YtJNZmga-seuiHv50lzr8c708UaBjY5LhinFPM_QzRPumN7lebUV8SaN9g5W8Pjefaa4UE9X-ySIx3izX52Mcn-dmW_45ztV_oVGdlJV1fLy4MHx9SEfL5owl8e_frcmqcUAJfCEXDSfh8n8iumlmvk569aBtU Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9138f252886e4faea3710ff7d6764683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9138f252886e4faea3710ff7d6764683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: eff6843f674047fc9a8841711244bce4 Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: {"rescue": {}} Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: exception: Cannot 'rescue' instance a68a62b9-e978-4872-8c85-1b81c0f7341b while it is in vm_state paused Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'a68a62b9-e978-4872-8c85-1b81c0f7341b', 'body': {'rescue': {}}} Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a68a62b9-e978-4872-8c85-1b81c0f7341b in vm_state paused. Cannot rescue while the instance is in this state. Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance a68a62b9-e978-4872-8c85-1b81c0f7341b while it is in vm_state paused Jul 20 04:40:57.274431 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance a68a62b9-e978-4872-8c85-1b81c0f7341b while it is in vm_state paused Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Returning 409 to user: Cannot 'rescue' instance a68a62b9-e978-4872-8c85-1b81c0f7341b while it is in vm_state paused {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0ab2fb30-bbf5-4642-a0b6-3b030ad2d394 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action" status: 409 len: 144 microversion: 2.1 time: 0.064165 Jul 20 04:40:57.279527 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2876/5752] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:57 2022] POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action => generated 144 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:40:57.286118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-17b5b71e-0ec6-4715-adfd-713e4a355333 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:57.298980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-17b5b71e-0ec6-4715-adfd-713e4a355333 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:57.305791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17b5b71e-0ec6-4715-adfd-713e4a355333 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.306292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17b5b71e-0ec6-4715-adfd-713e4a355333 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.307069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17b5b71e-0ec6-4715-adfd-713e4a355333 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.307585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17b5b71e-0ec6-4715-adfd-713e4a355333 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.406454 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-17b5b71e-0ec6-4715-adfd-713e4a355333 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action" status: 202 len: 0 microversion: 2.1 time: 0.124728 Jul 20 04:40:57.414328 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2877/5753] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:57 2022] POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:57.420729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f596449-be4b-45e8-a7a1-273fff1d4d3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:57.421671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f596449-be4b-45e8-a7a1-273fff1d4d3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:57.430428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f596449-be4b-45e8-a7a1-273fff1d4d3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.431174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f596449-be4b-45e8-a7a1-273fff1d4d3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.432233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f596449-be4b-45e8-a7a1-273fff1d4d3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.432903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f596449-be4b-45e8-a7a1-273fff1d4d3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.526791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8965f3b1-cad4-44cc-8702-e21a8f681d69 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:57.544679 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8965f3b1-cad4-44cc-8702-e21a8f681d69 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1396 microversion: 2.1 time: 0.507946 Jul 20 04:40:57.554327 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2877/5754] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:57 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1396 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:57.648993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ed6ed896-90ff-4438-995e-6850446c91d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:57.649916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ed6ed896-90ff-4438-995e-6850446c91d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:57.664729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed6ed896-90ff-4438-995e-6850446c91d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.665768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed6ed896-90ff-4438-995e-6850446c91d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.667062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed6ed896-90ff-4438-995e-6850446c91d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.667864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed6ed896-90ff-4438-995e-6850446c91d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.812425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f596449-be4b-45e8-a7a1-273fff1d4d3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:57.820221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:57.824480 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f596449-be4b-45e8-a7a1-273fff1d4d3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1506 microversion: 2.1 time: 0.408478 Jul 20 04:40:57.825074 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2878/5755] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:57 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:57.936681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f823a464-e93f-46c4-b402-8c9fb0a6ee9e req-87a26f0a-6034-4e33-a65c-e43e89fb37cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55eeaa2b-516f-49c6-a2a6-74ac8bec9785", "name": "network-vif-deleted", "tag": "04bbc1ee-6c54-493c-929f-3f98d3de8754"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:57.969664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f823a464-e93f-46c4-b402-8c9fb0a6ee9e req-87a26f0a-6034-4e33-a65c-e43e89fb37cc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.973535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f823a464-e93f-46c4-b402-8c9fb0a6ee9e req-87a26f0a-6034-4e33-a65c-e43e89fb37cc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.024578 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f823a464-e93f-46c4-b402-8c9fb0a6ee9e req-87a26f0a-6034-4e33-a65c-e43e89fb37cc service nova] Creating event network-vif-deleted:04bbc1ee-6c54-493c-929f-3f98d3de8754 for instance 55eeaa2b-516f-49c6-a2a6-74ac8bec9785 on n-h1-760456-11 Jul 20 04:40:58.036761 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f823a464-e93f-46c4-b402-8c9fb0a6ee9e req-87a26f0a-6034-4e33-a65c-e43e89fb37cc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107701 Jul 20 04:40:58.038613 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2879/5756] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:58.140877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ed6ed896-90ff-4438-995e-6850446c91d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:58.154091 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ed6ed896-90ff-4438-995e-6850446c91d5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.509177 Jul 20 04:40:58.156432 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2878/5757] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:57 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:58.174618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-260c3aca-ed44-4e0b-9507-086687e893da tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:58.175411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-260c3aca-ed44-4e0b-9507-086687e893da tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:58.182108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-260c3aca-ed44-4e0b-9507-086687e893da tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.182588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-260c3aca-ed44-4e0b-9507-086687e893da tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.183361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-260c3aca-ed44-4e0b-9507-086687e893da tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.183804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-260c3aca-ed44-4e0b-9507-086687e893da tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.485273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-260c3aca-ed44-4e0b-9507-086687e893da tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:58.516113 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-260c3aca-ed44-4e0b-9507-086687e893da tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.345125 Jul 20 04:40:58.519690 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2880/5758] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:58 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:58.537116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e521b4d2-545e-48a0-a666-7ed52a907462 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:58.537641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e521b4d2-545e-48a0-a666-7ed52a907462 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 9537e87a-23e2-48a5-83c4-e95b4d2d2e85] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:58.549140 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e521b4d2-545e-48a0-a666-7ed52a907462 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 9537e87a-23e2-48a5-83c4-e95b4d2d2e85 could not be found. Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e521b4d2-545e-48a0-a666-7ed52a907462 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/9537e87a-23e2-48a5-83c4-e95b4d2d2e85/action HTTP/1.1 Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 15 Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: {"unpause": {}} Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 9537e87a-23e2-48a5-83c4-e95b4d2d2e85 could not be found. Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '9537e87a-23e2-48a5-83c4-e95b4d2d2e85', 'body': {'unpause': {}}} Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9537e87a-23e2-48a5-83c4-e95b4d2d2e85 could not be found. Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9537e87a-23e2-48a5-83c4-e95b4d2d2e85 could not be found. Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:58.555628 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:58.562389 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:58.562389 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:58.562389 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9537e87a-23e2-48a5-83c4-e95b4d2d2e85 could not be found. Jul 20 04:40:58.562389 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:40:58.577864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ab5182b6-efa5-4ae4-9ab1-75898535d86d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:58.580119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ab5182b6-efa5-4ae4-9ab1-75898535d86d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:58.589794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e521b4d2-545e-48a0-a666-7ed52a907462 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 9537e87a-23e2-48a5-83c4-e95b4d2d2e85 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:58.593597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5182b6-efa5-4ae4-9ab1-75898535d86d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.603272 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e521b4d2-545e-48a0-a666-7ed52a907462 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/9537e87a-23e2-48a5-83c4-e95b4d2d2e85/action" status: 404 len: 111 microversion: 2.1 time: 0.063662 Jul 20 04:40:58.604808 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2879/5759] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:58 2022] POST /compute/v2.1/servers/9537e87a-23e2-48a5-83c4-e95b4d2d2e85/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:58.606068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5182b6-efa5-4ae4-9ab1-75898535d86d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.607862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5182b6-efa5-4ae4-9ab1-75898535d86d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.608601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5182b6-efa5-4ae4-9ab1-75898535d86d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.616711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d5c6249-a3d2-4188-9039-79dec89ed2ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:58.620464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5d5c6249-a3d2-4188-9039-79dec89ed2ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:58.657018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d5c6249-a3d2-4188-9039-79dec89ed2ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.657634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d5c6249-a3d2-4188-9039-79dec89ed2ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.662339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d5c6249-a3d2-4188-9039-79dec89ed2ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.663025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d5c6249-a3d2-4188-9039-79dec89ed2ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.818098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ab5182b6-efa5-4ae4-9ab1-75898535d86d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:58.828706 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ab5182b6-efa5-4ae4-9ab1-75898535d86d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1188 microversion: 2.1 time: 0.263164 Jul 20 04:40:58.829680 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2881/5760] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:58 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1188 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:58.843122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c0e15832-2c22-4cb2-a227-a8fc4727d4ca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:58.844110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c0e15832-2c22-4cb2-a227-a8fc4727d4ca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:58.876798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0e15832-2c22-4cb2-a227-a8fc4727d4ca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.877680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0e15832-2c22-4cb2-a227-a8fc4727d4ca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.879619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0e15832-2c22-4cb2-a227-a8fc4727d4ca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.880186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c0e15832-2c22-4cb2-a227-a8fc4727d4ca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.124958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5d5c6249-a3d2-4188-9039-79dec89ed2ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:59.133596 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d5c6249-a3d2-4188-9039-79dec89ed2ee tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.523583 Jul 20 04:40:59.136565 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2880/5761] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:58 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:59.153547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aba5b150-6b44-4e8c-b8f5-81c39ddd0e70 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:59.155621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aba5b150-6b44-4e8c-b8f5-81c39ddd0e70 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:59.162884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aba5b150-6b44-4e8c-b8f5-81c39ddd0e70 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.163678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aba5b150-6b44-4e8c-b8f5-81c39ddd0e70 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.164745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aba5b150-6b44-4e8c-b8f5-81c39ddd0e70 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.165436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aba5b150-6b44-4e8c-b8f5-81c39ddd0e70 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.205588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c0e15832-2c22-4cb2-a227-a8fc4727d4ca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:59.219397 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c0e15832-2c22-4cb2-a227-a8fc4727d4ca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1514 microversion: 2.1 time: 0.380339 Jul 20 04:40:59.222148 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2882/5762] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:58 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1514 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:59.607489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aba5b150-6b44-4e8c-b8f5-81c39ddd0e70 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:59.620852 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aba5b150-6b44-4e8c-b8f5-81c39ddd0e70 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.471215 Jul 20 04:40:59.621782 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2881/5763] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:59 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:59.642947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-416839e1-9f74-4742-bd3d-c670c682bc1b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:59.643935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-416839e1-9f74-4742-bd3d-c670c682bc1b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:59.660414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-416839e1-9f74-4742-bd3d-c670c682bc1b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.661415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-416839e1-9f74-4742-bd3d-c670c682bc1b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.664494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-416839e1-9f74-4742-bd3d-c670c682bc1b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.664972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-416839e1-9f74-4742-bd3d-c670c682bc1b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.740769 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-416839e1-9f74-4742-bd3d-c670c682bc1b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Cannot 'unpause' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-416839e1-9f74-4742-bd3d-c670c682bc1b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action HTTP/1.1 Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 15 Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: {"unpause": {}} Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: exception: Cannot 'unpause' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02', 'body': {'unpause': {}}} Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 in vm_state active. Cannot unpause while the instance is in this state. Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:59.744344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:59.749520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:59.749520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:59.749520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:59.749520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:40:59.749520 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:40:59.757503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-416839e1-9f74-4742-bd3d-c670c682bc1b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 409 to user: Cannot 'unpause' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:59.759177 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-416839e1-9f74-4742-bd3d-c670c682bc1b tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 409 len: 145 microversion: 2.1 time: 0.121606 Jul 20 04:40:59.759954 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2883/5764] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:59 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 145 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:40:59.769139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-05e4d97f-295e-439a-8a45-582f4dfe37bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:59.769784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-05e4d97f-295e-439a-8a45-582f4dfe37bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:59.776251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05e4d97f-295e-439a-8a45-582f4dfe37bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.776932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05e4d97f-295e-439a-8a45-582f4dfe37bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.778308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05e4d97f-295e-439a-8a45-582f4dfe37bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.778954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-05e4d97f-295e-439a-8a45-582f4dfe37bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.849961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1a2dbcd0-fb1e-4432-a287-d22989d12e36 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:59.850633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1a2dbcd0-fb1e-4432-a287-d22989d12e36 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:59.863453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a2dbcd0-fb1e-4432-a287-d22989d12e36 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.863920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a2dbcd0-fb1e-4432-a287-d22989d12e36 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.864716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a2dbcd0-fb1e-4432-a287-d22989d12e36 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.865161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a2dbcd0-fb1e-4432-a287-d22989d12e36 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.964381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1a2dbcd0-fb1e-4432-a287-d22989d12e36 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:59.975815 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1a2dbcd0-fb1e-4432-a287-d22989d12e36 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1188 microversion: 2.1 time: 0.131729 Jul 20 04:40:59.977492 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2884/5765] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:59 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1188 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:00.219370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-05e4d97f-295e-439a-8a45-582f4dfe37bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:00.242023 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-05e4d97f-295e-439a-8a45-582f4dfe37bf tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.477367 Jul 20 04:41:00.245118 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2882/5766] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:59 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:00.263038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-27116d62-cd57-4704-9a23-e7e48ba699bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:00.263992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-27116d62-cd57-4704-9a23-e7e48ba699bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:00.290860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27116d62-cd57-4704-9a23-e7e48ba699bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:00.308716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27116d62-cd57-4704-9a23-e7e48ba699bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:00.309965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27116d62-cd57-4704-9a23-e7e48ba699bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:00.311797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27116d62-cd57-4704-9a23-e7e48ba699bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:00.583343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-27116d62-cd57-4704-9a23-e7e48ba699bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:00.597264 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-27116d62-cd57-4704-9a23-e7e48ba699bd tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.336570 Jul 20 04:41:00.604874 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2885/5767] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:00 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:00.614039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b7fb4279-9adf-494c-b67a-d0e5c259985c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:00.614812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b7fb4279-9adf-494c-b67a-d0e5c259985c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 5298f2f3-0b07-4eda-aced-4cb6762262dd] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:00.622460 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-b7fb4279-9adf-494c-b67a-d0e5c259985c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 5298f2f3-0b07-4eda-aced-4cb6762262dd could not be found. Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b7fb4279-9adf-494c-b67a-d0e5c259985c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/5298f2f3-0b07-4eda-aced-4cb6762262dd/action HTTP/1.1 Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 18 Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: {"unshelve": null} Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 5298f2f3-0b07-4eda-aced-4cb6762262dd could not be found. Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '5298f2f3-0b07-4eda-aced-4cb6762262dd', 'body': {'unshelve': None}} Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5298f2f3-0b07-4eda-aced-4cb6762262dd could not be found. Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5298f2f3-0b07-4eda-aced-4cb6762262dd could not be found. Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:00.625407 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:00.632387 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:00.632387 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:00.632387 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:00.632387 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5298f2f3-0b07-4eda-aced-4cb6762262dd could not be found. Jul 20 04:41:00.632387 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:00.635087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b7fb4279-9adf-494c-b67a-d0e5c259985c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 5298f2f3-0b07-4eda-aced-4cb6762262dd could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:00.636306 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b7fb4279-9adf-494c-b67a-d0e5c259985c tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/5298f2f3-0b07-4eda-aced-4cb6762262dd/action" status: 404 len: 111 microversion: 2.1 time: 0.026511 Jul 20 04:41:00.641384 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2883/5768] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:41:00 2022] POST /compute/v2.1/servers/5298f2f3-0b07-4eda-aced-4cb6762262dd/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:00.663058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a7cb2fd0-9bd5-4205-ab62-166fedf561ea tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:00.663692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7cb2fd0-9bd5-4205-ab62-166fedf561ea tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:00.703355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7cb2fd0-9bd5-4205-ab62-166fedf561ea tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:00.703828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7cb2fd0-9bd5-4205-ab62-166fedf561ea tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:00.704641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7cb2fd0-9bd5-4205-ab62-166fedf561ea tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:00.709160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7cb2fd0-9bd5-4205-ab62-166fedf561ea tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:00.995086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3c07a91-8837-431e-a8a4-792d13f5ca35 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:00.995969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d3c07a91-8837-431e-a8a4-792d13f5ca35 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:01.010357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3c07a91-8837-431e-a8a4-792d13f5ca35 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.017688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3c07a91-8837-431e-a8a4-792d13f5ca35 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:01.024026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3c07a91-8837-431e-a8a4-792d13f5ca35 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.024506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3c07a91-8837-431e-a8a4-792d13f5ca35 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:01.335948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d3c07a91-8837-431e-a8a4-792d13f5ca35 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:01.386564 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d3c07a91-8837-431e-a8a4-792d13f5ca35 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1188 microversion: 2.1 time: 0.376196 Jul 20 04:41:01.398933 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2884/5769] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:00 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1188 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:01.563027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a7cb2fd0-9bd5-4205-ab62-166fedf561ea tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:01.572449 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a7cb2fd0-9bd5-4205-ab62-166fedf561ea tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.930349 Jul 20 04:41:01.577377 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2886/5770] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:00 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:01.595739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-750a3e54-bab7-47f8-81b1-9c5d8b5ab658 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:01.596740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-750a3e54-bab7-47f8-81b1-9c5d8b5ab658 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:01.616728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-750a3e54-bab7-47f8-81b1-9c5d8b5ab658 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.618110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-750a3e54-bab7-47f8-81b1-9c5d8b5ab658 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:01.619627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-750a3e54-bab7-47f8-81b1-9c5d8b5ab658 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.621810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-750a3e54-bab7-47f8-81b1-9c5d8b5ab658 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:01.935532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-750a3e54-bab7-47f8-81b1-9c5d8b5ab658 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:01.945385 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-750a3e54-bab7-47f8-81b1-9c5d8b5ab658 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.354691 Jul 20 04:41:01.950012 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2885/5771] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:01 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:01.964575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c27000e-8267-4b94-9e31-04b78ecfa602 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:01.965146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8c27000e-8267-4b94-9e31-04b78ecfa602 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:01.976467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c27000e-8267-4b94-9e31-04b78ecfa602 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.976922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c27000e-8267-4b94-9e31-04b78ecfa602 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:01.977716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c27000e-8267-4b94-9e31-04b78ecfa602 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:01.978155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c27000e-8267-4b94-9e31-04b78ecfa602 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.026339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bb7a8eb8-0843-415b-a63e-c7df60a21c07 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:02.034702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bb7a8eb8-0843-415b-a63e-c7df60a21c07 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:02.099921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb7a8eb8-0843-415b-a63e-c7df60a21c07 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.100401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb7a8eb8-0843-415b-a63e-c7df60a21c07 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.101232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb7a8eb8-0843-415b-a63e-c7df60a21c07 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.101683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bb7a8eb8-0843-415b-a63e-c7df60a21c07 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.151352 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8c27000e-8267-4b94-9e31-04b78ecfa602 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Cannot 'unshelve' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c27000e-8267-4b94-9e31-04b78ecfa602 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action HTTP/1.1 Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 18 Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: {"unshelve": null} Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: exception: Cannot 'unshelve' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02', 'body': {'unshelve': None}} Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 in vm_state active. Cannot unshelve while the instance is in this state. Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:41:02.159715 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c27000e-8267-4b94-9e31-04b78ecfa602 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 409 to user: Cannot 'unshelve' instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 while it is in vm_state active {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:02.167083 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c27000e-8267-4b94-9e31-04b78ecfa602 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action" status: 409 len: 146 microversion: 2.1 time: 0.200462 Jul 20 04:41:02.168424 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2887/5772] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:41:01 2022] POST /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02/action => generated 146 bytes in 208 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:41:02.179750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d2958cda-ab67-4f29-91ba-ceaa18c8b684 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:02.180338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d2958cda-ab67-4f29-91ba-ceaa18c8b684 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:02.183752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-bb7a8eb8-0843-415b-a63e-c7df60a21c07 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lazy-loading 'flavor' on Instance uuid a68a62b9-e978-4872-8c85-1b81c0f7341b {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:41:02.192974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2958cda-ab67-4f29-91ba-ceaa18c8b684 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.196533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2958cda-ab67-4f29-91ba-ceaa18c8b684 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.198473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2958cda-ab67-4f29-91ba-ceaa18c8b684 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.199433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2958cda-ab67-4f29-91ba-ceaa18c8b684 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.328638 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bb7a8eb8-0843-415b-a63e-c7df60a21c07 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action" status: 200 len: 32 microversion: 2.1 time: 0.305924 Jul 20 04:41:02.329814 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2886/5773] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:41:02 2022] POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action => generated 32 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:41:02.364354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e8c77c2-fa6f-4e75-9a9b-b3708cdd340d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:02.366665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e8c77c2-fa6f-4e75-9a9b-b3708cdd340d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:02.376327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e8c77c2-fa6f-4e75-9a9b-b3708cdd340d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.377141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e8c77c2-fa6f-4e75-9a9b-b3708cdd340d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.386383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e8c77c2-fa6f-4e75-9a9b-b3708cdd340d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.389405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e8c77c2-fa6f-4e75-9a9b-b3708cdd340d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.930888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d2958cda-ab67-4f29-91ba-ceaa18c8b684 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:02.943261 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d2958cda-ab67-4f29-91ba-ceaa18c8b684 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.773691 Jul 20 04:41:02.970328 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2888/5774] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:02 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:02.999449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d300ef0d-06d4-4b93-858c-29be363da107 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:03.000086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d300ef0d-06d4-4b93-858c-29be363da107 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.010982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:03.017659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d300ef0d-06d4-4b93-858c-29be363da107 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.018127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d300ef0d-06d4-4b93-858c-29be363da107 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.019328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d300ef0d-06d4-4b93-858c-29be363da107 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.019854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d300ef0d-06d4-4b93-858c-29be363da107 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.204295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d300ef0d-06d4-4b93-858c-29be363da107 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:03.215542 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d300ef0d-06d4-4b93-858c-29be363da107 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1188 microversion: 2.1 time: 0.242330 Jul 20 04:41:03.218367 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2889/5775] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:02 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1188 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:03.238071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-269dfee8-a74a-4984-a63e-1fa0b7b9b04b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:03.239218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-269dfee8-a74a-4984-a63e-1fa0b7b9b04b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.264554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-269dfee8-a74a-4984-a63e-1fa0b7b9b04b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.265415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-269dfee8-a74a-4984-a63e-1fa0b7b9b04b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.266527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-269dfee8-a74a-4984-a63e-1fa0b7b9b04b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.267214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-269dfee8-a74a-4984-a63e-1fa0b7b9b04b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.328938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-269dfee8-a74a-4984-a63e-1fa0b7b9b04b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:03.476084 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-269dfee8-a74a-4984-a63e-1fa0b7b9b04b tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "DELETE /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 204 len: 0 microversion: 2.1 time: 0.243847 Jul 20 04:41:03.480473 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2890/5776] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:03 2022] DELETE /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:03.483026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-9a498cc5-2050-465f-b1c4-775054bdbac6 req-e8a1473f-960b-42c9-9801-1fc4a03f5608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a908c5-87f5-4228-9815-f47c1195c4a6", "tag": "4d0e27c2-3182-484f-abb7-ff3d69355c02"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:03.502525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9a498cc5-2050-465f-b1c4-775054bdbac6 req-e8a1473f-960b-42c9-9801-1fc4a03f5608 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.504201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9a498cc5-2050-465f-b1c4-775054bdbac6 req-e8a1473f-960b-42c9-9801-1fc4a03f5608 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.527154 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-9a498cc5-2050-465f-b1c4-775054bdbac6 req-e8a1473f-960b-42c9-9801-1fc4a03f5608 service nova] Creating event network-changed:4d0e27c2-3182-484f-abb7-ff3d69355c02 for instance 70a908c5-87f5-4228-9815-f47c1195c4a6 on n-h1-760456-11 Jul 20 04:41:03.541329 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-9a498cc5-2050-465f-b1c4-775054bdbac6 req-e8a1473f-960b-42c9-9801-1fc4a03f5608 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062317 Jul 20 04:41:03.543563 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2891/5777] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:03.617153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e4194306-bf88-49de-8ce9-456ac643dcb5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:03.635219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e4194306-bf88-49de-8ce9-456ac643dcb5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.669704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4194306-bf88-49de-8ce9-456ac643dcb5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.670591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4194306-bf88-49de-8ce9-456ac643dcb5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.671553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4194306-bf88-49de-8ce9-456ac643dcb5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.677064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4194306-bf88-49de-8ce9-456ac643dcb5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.725949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e8c77c2-fa6f-4e75-9a9b-b3708cdd340d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:03.734859 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e8c77c2-fa6f-4e75-9a9b-b3708cdd340d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 1.397837 Jul 20 04:41:03.736798 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2887/5778] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:02 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:03.755317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c6e16d20-76cf-4b01-896e-0de3a17dd507 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:03.756273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c6e16d20-76cf-4b01-896e-0de3a17dd507 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.767457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6e16d20-76cf-4b01-896e-0de3a17dd507 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.778725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6e16d20-76cf-4b01-896e-0de3a17dd507 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.783027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6e16d20-76cf-4b01-896e-0de3a17dd507 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.784008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6e16d20-76cf-4b01-896e-0de3a17dd507 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.114944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6e16d20-76cf-4b01-896e-0de3a17dd507 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:04.124390 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c6e16d20-76cf-4b01-896e-0de3a17dd507 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1686 microversion: 2.1 time: 0.385130 Jul 20 04:41:04.125412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e4194306-bf88-49de-8ce9-456ac643dcb5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:04.127141 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2888/5779] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:03 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1686 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:04.144854 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e4194306-bf88-49de-8ce9-456ac643dcb5 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.591686 Jul 20 04:41:04.145517 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2892/5780] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:03 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:04.167105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b5f87d0-47d1-4529-a0d7-3089534e9f41 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-399959099_updated"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:04.169576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6b5f87d0-47d1-4529-a0d7-3089534e9f41 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: b0887400-61dc-4541-91c4-3be591406fc0] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:04.176639 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-6b5f87d0-47d1-4529-a0d7-3089534e9f41 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance b0887400-61dc-4541-91c4-3be591406fc0 could not be found. Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b5f87d0-47d1-4529-a0d7-3089534e9f41 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/servers/b0887400-61dc-4541-91c4-3be591406fc0 HTTP/1.1 Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 80 Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-399959099_updated"}} Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance b0887400-61dc-4541-91c4-3be591406fc0 could not be found. Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'b0887400-61dc-4541-91c4-3be591406fc0', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-399959099_updated'}}} Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0887400-61dc-4541-91c4-3be591406fc0 could not be found. Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 20 04:41:04.181522 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0887400-61dc-4541-91c4-3be591406fc0 could not be found. Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0887400-61dc-4541-91c4-3be591406fc0 could not be found. Jul 20 04:41:04.188592 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:04.191954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b5f87d0-47d1-4529-a0d7-3089534e9f41 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance b0887400-61dc-4541-91c4-3be591406fc0 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:04.193366 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6b5f87d0-47d1-4529-a0d7-3089534e9f41 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "PUT /compute/v2.1/servers/b0887400-61dc-4541-91c4-3be591406fc0" status: 404 len: 111 microversion: 2.1 time: 0.034572 Jul 20 04:41:04.194483 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2889/5781] 10.222.0.59 () {60 vars in 1255 bytes} [Wed Jul 20 04:41:04 2022] PUT /compute/v2.1/servers/b0887400-61dc-4541-91c4-3be591406fc0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:04.202857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8af3acb1-baaa-4f4c-a642-cecba247c7f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:04.203493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8af3acb1-baaa-4f4c-a642-cecba247c7f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:04.210192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8af3acb1-baaa-4f4c-a642-cecba247c7f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.210806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8af3acb1-baaa-4f4c-a642-cecba247c7f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.211927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8af3acb1-baaa-4f4c-a642-cecba247c7f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.212626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8af3acb1-baaa-4f4c-a642-cecba247c7f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.235814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-098cf678-64f5-46ab-baf8-0a8ffa45aab4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:04.236743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-098cf678-64f5-46ab-baf8-0a8ffa45aab4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:04.247038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-098cf678-64f5-46ab-baf8-0a8ffa45aab4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.247824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-098cf678-64f5-46ab-baf8-0a8ffa45aab4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.251515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-098cf678-64f5-46ab-baf8-0a8ffa45aab4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.254875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-098cf678-64f5-46ab-baf8-0a8ffa45aab4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.386627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-098cf678-64f5-46ab-baf8-0a8ffa45aab4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:04.428048 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-098cf678-64f5-46ab-baf8-0a8ffa45aab4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1188 microversion: 2.1 time: 0.196095 Jul 20 04:41:04.429447 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2890/5782] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:04 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1188 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:04.685542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8af3acb1-baaa-4f4c-a642-cecba247c7f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:04.695691 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8af3acb1-baaa-4f4c-a642-cecba247c7f1 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.496648 Jul 20 04:41:04.714401 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2893/5783] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:04 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:04.719318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3da31c8c-8bb9-4d59-abee-306b922d6376 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:04.720271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3da31c8c-8bb9-4d59-abee-306b922d6376 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:04.735383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3da31c8c-8bb9-4d59-abee-306b922d6376 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.736787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3da31c8c-8bb9-4d59-abee-306b922d6376 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.738498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3da31c8c-8bb9-4d59-abee-306b922d6376 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.739196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3da31c8c-8bb9-4d59-abee-306b922d6376 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.756582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f27c43b3-ac86-4172-aa91-efad3c8afc2b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:04.757281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f27c43b3-ac86-4172-aa91-efad3c8afc2b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:04.772297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f27c43b3-ac86-4172-aa91-efad3c8afc2b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.773665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f27c43b3-ac86-4172-aa91-efad3c8afc2b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.774678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f27c43b3-ac86-4172-aa91-efad3c8afc2b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.776139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f27c43b3-ac86-4172-aa91-efad3c8afc2b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.189212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3da31c8c-8bb9-4d59-abee-306b922d6376 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:05.211212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f27c43b3-ac86-4172-aa91-efad3c8afc2b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:05.219999 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f27c43b3-ac86-4172-aa91-efad3c8afc2b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.468879 Jul 20 04:41:05.222790 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2894/5784] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:04 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:05.230934 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3da31c8c-8bb9-4d59-abee-306b922d6376 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.515269 Jul 20 04:41:05.233958 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2891/5785] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:04 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:05.240252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-961a93d3-187d-4160-824d-1153e853b1aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:05.240252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-961a93d3-187d-4160-824d-1153e853b1aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:05.250574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-961a93d3-187d-4160-824d-1153e853b1aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.251102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-961a93d3-187d-4160-824d-1153e853b1aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.251911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-961a93d3-187d-4160-824d-1153e853b1aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.252468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-961a93d3-187d-4160-824d-1153e853b1aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.267874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e571f7c4-6256-4345-8769-b85e642b7c5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e571f7c4-6256-4345-8769-b85e642b7c5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: request: PUT /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 HTTP/1.1 Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 280 Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:05.272779 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:41:05.277347 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:05.281714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e571f7c4-6256-4345-8769-b85e642b7c5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:05.282874 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e571f7c4-6256-4345-8769-b85e642b7c5e tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "PUT /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 400 len: 619 microversion: 2.1 time: 0.032801 Jul 20 04:41:05.284048 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2892/5786] 10.222.0.59 () {60 vars in 1256 bytes} [Wed Jul 20 04:41:05 2022] PUT /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:41:05.295341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b3556f58-af75-4c65-9d93-394af5ea1ae9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:05.296207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b3556f58-af75-4c65-9d93-394af5ea1ae9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:05.306730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3556f58-af75-4c65-9d93-394af5ea1ae9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.307624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3556f58-af75-4c65-9d93-394af5ea1ae9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.308582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3556f58-af75-4c65-9d93-394af5ea1ae9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.309194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b3556f58-af75-4c65-9d93-394af5ea1ae9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.713940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b3556f58-af75-4c65-9d93-394af5ea1ae9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:05.727032 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b3556f58-af75-4c65-9d93-394af5ea1ae9 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.438210 Jul 20 04:41:05.728523 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2893/5787] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:05 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:05.733177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-41449831-38c8-427a-8e06-5b92fa2b96a2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:05.733807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-41449831-38c8-427a-8e06-5b92fa2b96a2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:05.754563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41449831-38c8-427a-8e06-5b92fa2b96a2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.755970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41449831-38c8-427a-8e06-5b92fa2b96a2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.757245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41449831-38c8-427a-8e06-5b92fa2b96a2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.757963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41449831-38c8-427a-8e06-5b92fa2b96a2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.874575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-41449831-38c8-427a-8e06-5b92fa2b96a2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:05.890110 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-41449831-38c8-427a-8e06-5b92fa2b96a2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 200 len: 1188 microversion: 2.1 time: 0.160419 Jul 20 04:41:05.890964 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2894/5788] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:05 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 1188 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:05.894886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-961a93d3-187d-4160-824d-1153e853b1aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:05.897809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:05.915566 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-961a93d3-187d-4160-824d-1153e853b1aa tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1686 microversion: 2.1 time: 0.690495 Jul 20 04:41:05.915865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4d1d3b6b-71bb-4851-84ff-6959e442bd2f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:05.916810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4d1d3b6b-71bb-4851-84ff-6959e442bd2f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:05.926917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d1d3b6b-71bb-4851-84ff-6959e442bd2f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.928196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d1d3b6b-71bb-4851-84ff-6959e442bd2f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.929292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d1d3b6b-71bb-4851-84ff-6959e442bd2f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.930057 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2895/5789] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:05 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1686 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:05.930433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d1d3b6b-71bb-4851-84ff-6959e442bd2f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.167522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4d1d3b6b-71bb-4851-84ff-6959e442bd2f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:06.181234 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4d1d3b6b-71bb-4851-84ff-6959e442bd2f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.289425 Jul 20 04:41:06.182365 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2895/5790] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:05 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:06.200925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-64091af0-b5c9-4459-ad33-a50eaa2a6cb7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-64091af0-b5c9-4459-ad33-a50eaa2a6cb7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: request: PUT /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 HTTP/1.1 Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 24 Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: {"server": {"name": ""}} Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02', 'body': {'server': {'name': ''}}} Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi '' Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:41:06.203592 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-64091af0-b5c9-4459-ad33-a50eaa2a6cb7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-64091af0-b5c9-4459-ad33-a50eaa2a6cb7 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "PUT /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 400 len: 108 microversion: 2.1 time: 0.010150 Jul 20 04:41:06.209692 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2896/5791] 10.222.0.59 () {60 vars in 1255 bytes} [Wed Jul 20 04:41:06 2022] PUT /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:41:06.228079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-65771357-a207-49e4-9e80-630d05f7f785 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:06.229067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-65771357-a207-49e4-9e80-630d05f7f785 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:06.242451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-72528a46-2004-4197-8607-100a2fe30392 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:06.243273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-72528a46-2004-4197-8607-100a2fe30392 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:06.258559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65771357-a207-49e4-9e80-630d05f7f785 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.259299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65771357-a207-49e4-9e80-630d05f7f785 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.260324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65771357-a207-49e4-9e80-630d05f7f785 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.269342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65771357-a207-49e4-9e80-630d05f7f785 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.277124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72528a46-2004-4197-8607-100a2fe30392 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.282583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72528a46-2004-4197-8607-100a2fe30392 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.285391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72528a46-2004-4197-8607-100a2fe30392 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.289921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72528a46-2004-4197-8607-100a2fe30392 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.315362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:06.608211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-65771357-a207-49e4-9e80-630d05f7f785 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:06.617176 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-65771357-a207-49e4-9e80-630d05f7f785 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1506 microversion: 2.1 time: 0.396631 Jul 20 04:41:06.624425 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2896/5792] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:06 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:06.632154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3a0f8c7a-a495-43a3-ac5b-96e8d037bb37 req-d616664b-027e-4037-9dd2-811ece505b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a908c5-87f5-4228-9815-f47c1195c4a6", "name": "network-vif-deleted", "tag": "4d0e27c2-3182-484f-abb7-ff3d69355c02"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:06.671243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3a0f8c7a-a495-43a3-ac5b-96e8d037bb37 req-d616664b-027e-4037-9dd2-811ece505b82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.672355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3a0f8c7a-a495-43a3-ac5b-96e8d037bb37 req-d616664b-027e-4037-9dd2-811ece505b82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.692371 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3a0f8c7a-a495-43a3-ac5b-96e8d037bb37 req-d616664b-027e-4037-9dd2-811ece505b82 service nova] Creating event network-vif-deleted:4d0e27c2-3182-484f-abb7-ff3d69355c02 for instance 70a908c5-87f5-4228-9815-f47c1195c4a6 on n-h1-760456-11 Jul 20 04:41:06.703238 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3a0f8c7a-a495-43a3-ac5b-96e8d037bb37 req-d616664b-027e-4037-9dd2-811ece505b82 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076201 Jul 20 04:41:06.708889 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2897/5793] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:06.769510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-72528a46-2004-4197-8607-100a2fe30392 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:06.786715 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-72528a46-2004-4197-8607-100a2fe30392 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.548007 Jul 20 04:41:06.788380 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2897/5794] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:06 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:06.907843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50962636-12b0-411c-a784-54776a884115 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:06.910464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-50962636-12b0-411c-a784-54776a884115 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 55eeaa2b-516f-49c6-a2a6-74ac8bec9785] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:06.917211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50962636-12b0-411c-a784-54776a884115 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.930802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50962636-12b0-411c-a784-54776a884115 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.931664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50962636-12b0-411c-a784-54776a884115 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.932118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50962636-12b0-411c-a784-54776a884115 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.946977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:06.947930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:06.957943 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-50962636-12b0-411c-a784-54776a884115 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 55eeaa2b-516f-49c6-a2a6-74ac8bec9785 could not be found. Jul 20 04:41:06.959977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50962636-12b0-411c-a784-54776a884115 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 HTTP/1.1 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 55eeaa2b-516f-49c6-a2a6-74ac8bec9785 could not be found. Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '55eeaa2b-516f-49c6-a2a6-74ac8bec9785'} Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55eeaa2b-516f-49c6-a2a6-74ac8bec9785 could not be found. Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55eeaa2b-516f-49c6-a2a6-74ac8bec9785 could not be found. Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:06.961361 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.970881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:06.970881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:06.970881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:06.970881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:06.970881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:06.970881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55eeaa2b-516f-49c6-a2a6-74ac8bec9785 could not be found. Jul 20 04:41:06.970881 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:06.970881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50962636-12b0-411c-a784-54776a884115 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 55eeaa2b-516f-49c6-a2a6-74ac8bec9785 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:06.970881 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-50962636-12b0-411c-a784-54776a884115 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785" status: 404 len: 111 microversion: 2.1 time: 0.059630 Jul 20 04:41:06.970881 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2898/5795] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:06 2022] GET /compute/v2.1/servers/55eeaa2b-516f-49c6-a2a6-74ac8bec9785 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:06.975195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.975195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.975195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:07.167189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:07.169305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:07.170087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lazy-loading 'fault' on Instance uuid 70a908c5-87f5-4228-9815-f47c1195c4a6 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:41:07.308972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f84ec28420a4cdcb88920cd86ce0160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a62f7017e4b8f8bbeb960856d1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:07.322174 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c7ecb758-996d-4d94-aec1-fd93bff85f75 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 200 len: 1355 microversion: 2.1 time: 0.381284 Jul 20 04:41:07.324374 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2898/5796] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:06 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 1355 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:07.804243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0a32f6e8-19d3-43b5-926b-2127da209778 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:07.804868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0a32f6e8-19d3-43b5-926b-2127da209778 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:07.831775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a32f6e8-19d3-43b5-926b-2127da209778 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:07.832258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a32f6e8-19d3-43b5-926b-2127da209778 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:07.833270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a32f6e8-19d3-43b5-926b-2127da209778 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:07.833892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a32f6e8-19d3-43b5-926b-2127da209778 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:08.216602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0a32f6e8-19d3-43b5-926b-2127da209778 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:08.228504 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0a32f6e8-19d3-43b5-926b-2127da209778 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.428173 Jul 20 04:41:08.229756 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2899/5797] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:07 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:08.343018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-278ea33b-2e90-4b15-863e-bafbaa335761 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:08.344531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-278ea33b-2e90-4b15-863e-bafbaa335761 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] [instance: 70a908c5-87f5-4228-9815-f47c1195c4a6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:08.368790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-278ea33b-2e90-4b15-863e-bafbaa335761 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:08.369583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-278ea33b-2e90-4b15-863e-bafbaa335761 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:08.372855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-278ea33b-2e90-4b15-863e-bafbaa335761 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:08.376380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-278ea33b-2e90-4b15-863e-bafbaa335761 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:08.445870 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-278ea33b-2e90-4b15-863e-bafbaa335761 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] HTTP exception thrown: Instance 70a908c5-87f5-4228-9815-f47c1195c4a6 could not be found. Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-278ea33b-2e90-4b15-863e-bafbaa335761 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Request method failure captured: Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 HTTP/1.1 Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14UK5JrQIbQ4DeMrb4AGON-It-xq1HUlcS1_w91iY9qX9BKMuqasTROhXwJnYYXL1FDMvpvHevyFT98KP_rG1E4C2KjxwioZKHqAupgnDNOBVhKjLYq21w0dkR-FwoM0QcIMxRYXi6rjnAGtO1rszx2hLyQfwkkhBDqwPm7fq7NZS_Y Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: c92a62f7017e4b8f8bbeb960856d1e20 Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c92a62f7017e4b8f8bbeb960856d1e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: c92a62f7017e4b8f8bbeb960856d1e20 Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1362507395 Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestNetworkAdvancedServerOps-1362507395-project Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8f84ec28420a4cdcb88920cd86ce0160 Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1362507395-project Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 70a908c5-87f5-4228-9815-f47c1195c4a6 could not be found. Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '70a908c5-87f5-4228-9815-f47c1195c4a6'} Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a908c5-87f5-4228-9815-f47c1195c4a6 could not be found. Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a908c5-87f5-4228-9815-f47c1195c4a6 could not be found. Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:08.461945 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:08.467798 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:08.467798 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:08.467798 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:08.467798 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:08.467798 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:08.467798 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:08.467798 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a908c5-87f5-4228-9815-f47c1195c4a6 could not be found. Jul 20 04:41:08.467798 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:08.470022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-278ea33b-2e90-4b15-863e-bafbaa335761 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Returning 404 to user: Instance 70a908c5-87f5-4228-9815-f47c1195c4a6 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:08.471152 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-278ea33b-2e90-4b15-863e-bafbaa335761 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6" status: 404 len: 111 microversion: 2.1 time: 0.132987 Jul 20 04:41:08.479126 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2899/5798] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:08 2022] GET /compute/v2.1/servers/70a908c5-87f5-4228-9815-f47c1195c4a6 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:09.248585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce9feb9c-001d-4522-a8ea-5d8f135e37e5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:09.250932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce9feb9c-001d-4522-a8ea-5d8f135e37e5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:09.269863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce9feb9c-001d-4522-a8ea-5d8f135e37e5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.270633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce9feb9c-001d-4522-a8ea-5d8f135e37e5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.276375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce9feb9c-001d-4522-a8ea-5d8f135e37e5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.277045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce9feb9c-001d-4522-a8ea-5d8f135e37e5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.759708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce9feb9c-001d-4522-a8ea-5d8f135e37e5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:09.770000 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce9feb9c-001d-4522-a8ea-5d8f135e37e5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.528089 Jul 20 04:41:09.773593 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2900/5799] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:09 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:10.792089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-95c1c864-0791-4d81-817d-e16b006b7525 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:10.793895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-95c1c864-0791-4d81-817d-e16b006b7525 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:10.812962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95c1c864-0791-4d81-817d-e16b006b7525 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:10.813754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95c1c864-0791-4d81-817d-e16b006b7525 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:10.816947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95c1c864-0791-4d81-817d-e16b006b7525 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:10.817794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-95c1c864-0791-4d81-817d-e16b006b7525 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.281443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-95c1c864-0791-4d81-817d-e16b006b7525 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:11.321079 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-95c1c864-0791-4d81-817d-e16b006b7525 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.535107 Jul 20 04:41:11.331371 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2900/5800] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:10 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:12.339402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08dd24b4-4ace-4a30-9215-f722164487b1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:12.340034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-08dd24b4-4ace-4a30-9215-f722164487b1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:12.353991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08dd24b4-4ace-4a30-9215-f722164487b1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.354503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08dd24b4-4ace-4a30-9215-f722164487b1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.355278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08dd24b4-4ace-4a30-9215-f722164487b1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.355722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08dd24b4-4ace-4a30-9215-f722164487b1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.816231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-08dd24b4-4ace-4a30-9215-f722164487b1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:12.824108 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08dd24b4-4ace-4a30-9215-f722164487b1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.488922 Jul 20 04:41:12.833832 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2901/5801] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:12 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:13.841425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-540ae0b0-3fb6-46c5-bb8f-b73447999fa2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:13.842757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-540ae0b0-3fb6-46c5-bb8f-b73447999fa2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:13.857636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-540ae0b0-3fb6-46c5-bb8f-b73447999fa2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:13.862466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-540ae0b0-3fb6-46c5-bb8f-b73447999fa2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.863539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-540ae0b0-3fb6-46c5-bb8f-b73447999fa2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:13.864174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-540ae0b0-3fb6-46c5-bb8f-b73447999fa2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.516530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-540ae0b0-3fb6-46c5-bb8f-b73447999fa2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:14.531111 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-540ae0b0-3fb6-46c5-bb8f-b73447999fa2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.693141 Jul 20 04:41:14.532512 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2901/5802] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:13 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:15.553417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-01273d3f-c9c3-4aed-9a5a-50af621ae682 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:15.554611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-01273d3f-c9c3-4aed-9a5a-50af621ae682 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:15.578369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01273d3f-c9c3-4aed-9a5a-50af621ae682 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.582052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01273d3f-c9c3-4aed-9a5a-50af621ae682 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.583162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01273d3f-c9c3-4aed-9a5a-50af621ae682 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.584927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-01273d3f-c9c3-4aed-9a5a-50af621ae682 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.966876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-01273d3f-c9c3-4aed-9a5a-50af621ae682 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:15.976171 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-01273d3f-c9c3-4aed-9a5a-50af621ae682 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.430641 Jul 20 04:41:15.977940 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2902/5803] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:15 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:16.997086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-af0cc10e-d961-4a7d-80e5-6dd0d3ef918d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:16.998800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-af0cc10e-d961-4a7d-80e5-6dd0d3ef918d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.015577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af0cc10e-d961-4a7d-80e5-6dd0d3ef918d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.016048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af0cc10e-d961-4a7d-80e5-6dd0d3ef918d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.021343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af0cc10e-d961-4a7d-80e5-6dd0d3ef918d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.021800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-af0cc10e-d961-4a7d-80e5-6dd0d3ef918d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.186402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-733f0ce2-dfa6-4d26-be94-2369d6684360 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:17.187067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-733f0ce2-dfa6-4d26-be94-2369d6684360 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.202531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-733f0ce2-dfa6-4d26-be94-2369d6684360 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.203442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-733f0ce2-dfa6-4d26-be94-2369d6684360 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.204259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-733f0ce2-dfa6-4d26-be94-2369d6684360 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.204716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-733f0ce2-dfa6-4d26-be94-2369d6684360 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.262469 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-733f0ce2-dfa6-4d26-be94-2369d6684360 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-733f0ce2-dfa6-4d26-be94-2369d6684360 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 HTTP/1.1 Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '98a88e64-633c-4a24-b3b6-8246ba0759d4'} Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:17.264103 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-733f0ce2-dfa6-4d26-be94-2369d6684360 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:17.270163 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-733f0ce2-dfa6-4d26-be94-2369d6684360 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "DELETE /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 404 len: 111 microversion: 2.1 time: 0.083738 Jul 20 04:41:17.277774 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2903/5804] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:17 2022] DELETE /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:17.295114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6748ad84-ef59-48f7-b90e-971fac016067 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:17.304717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6748ad84-ef59-48f7-b90e-971fac016067 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 98a88e64-633c-4a24-b3b6-8246ba0759d4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.316840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6748ad84-ef59-48f7-b90e-971fac016067 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.317307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6748ad84-ef59-48f7-b90e-971fac016067 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.318106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6748ad84-ef59-48f7-b90e-971fac016067 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.329111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6748ad84-ef59-48f7-b90e-971fac016067 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.374513 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-6748ad84-ef59-48f7-b90e-971fac016067 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6748ad84-ef59-48f7-b90e-971fac016067 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 HTTP/1.1 Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '98a88e64-633c-4a24-b3b6-8246ba0759d4'} Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:17.376939 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.386614 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.386614 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:17.386614 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:17.386614 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:17.386614 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:17.386614 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. Jul 20 04:41:17.386614 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.394919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6748ad84-ef59-48f7-b90e-971fac016067 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 98a88e64-633c-4a24-b3b6-8246ba0759d4 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:17.396358 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6748ad84-ef59-48f7-b90e-971fac016067 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4" status: 404 len: 111 microversion: 2.1 time: 0.117085 Jul 20 04:41:17.402732 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2904/5805] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:17 2022] GET /compute/v2.1/servers/98a88e64-633c-4a24-b3b6-8246ba0759d4 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:17.408892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-74dc44bb-7a77-4792-af69-01da9a7f1784 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:17.409883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-74dc44bb-7a77-4792-af69-01da9a7f1784 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.417194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74dc44bb-7a77-4792-af69-01da9a7f1784 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.418700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74dc44bb-7a77-4792-af69-01da9a7f1784 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.419756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74dc44bb-7a77-4792-af69-01da9a7f1784 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.420466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74dc44bb-7a77-4792-af69-01da9a7f1784 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.462439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-74dc44bb-7a77-4792-af69-01da9a7f1784 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:17.494920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-af0cc10e-d961-4a7d-80e5-6dd0d3ef918d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:17.509769 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-af0cc10e-d961-4a7d-80e5-6dd0d3ef918d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1500 microversion: 2.1 time: 0.515554 Jul 20 04:41:17.529088 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2902/5806] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:16 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1500 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:17.536458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-269c0960-640c-4fc4-a00d-5868aee054c7 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c6f4add-0212-4274-8465-d8fb9562b071"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:17.539692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-269c0960-640c-4fc4-a00d-5868aee054c7 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.551783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-269c0960-640c-4fc4-a00d-5868aee054c7 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.552768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-269c0960-640c-4fc4-a00d-5868aee054c7 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.554155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-269c0960-640c-4fc4-a00d-5868aee054c7 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.554983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-269c0960-640c-4fc4-a00d-5868aee054c7 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.600396 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-269c0960-640c-4fc4-a00d-5868aee054c7 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] HTTP exception thrown: Cannot 'attach_volume' instance a68a62b9-e978-4872-8c85-1b81c0f7341b while it is in vm_state rescued Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-269c0960-640c-4fc4-a00d-5868aee054c7 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Request method failure captured: Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/os-volume_attachments HTTP/1.1 Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 74 Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14cVvlyFQK0Hky763YtJNZmga-seuiHv50lzr8c708UaBjY5LhinFPM_QzRPumN7lebUV8SaN9g5W8Pjefaa4UE9X-ySIx3izX52Mcn-dmW_45ztV_oVGdlJV1fLy4MHx9SEfL5owl8e_frcmqcUAJfCEXDSfh8n8iumlmvk569aBtU Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9138f252886e4faea3710ff7d6764683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9138f252886e4faea3710ff7d6764683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: eff6843f674047fc9a8841711244bce4 Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: {"volumeAttachment": {"volumeId": "3c6f4add-0212-4274-8465-d8fb9562b071"}} Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: exception: Cannot 'attach_volume' instance a68a62b9-e978-4872-8c85-1b81c0f7341b while it is in vm_state rescued Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'server_id': 'a68a62b9-e978-4872-8c85-1b81c0f7341b', 'body': {'volumeAttachment': {'volumeId': '3c6f4add-0212-4274-8465-d8fb9562b071'}}} Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a68a62b9-e978-4872-8c85-1b81c0f7341b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 04:41:17.603308 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a68a62b9-e978-4872-8c85-1b81c0f7341b while it is in vm_state rescued Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a68a62b9-e978-4872-8c85-1b81c0f7341b while it is in vm_state rescued Jul 20 04:41:17.619901 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.636010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-269c0960-640c-4fc4-a00d-5868aee054c7 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Returning 409 to user: Cannot 'attach_volume' instance a68a62b9-e978-4872-8c85-1b81c0f7341b while it is in vm_state rescued {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:17.639110 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-269c0960-640c-4fc4-a00d-5868aee054c7 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.107907 Jul 20 04:41:17.640449 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2903/5807] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:41:17 2022] POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/os-volume_attachments => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:41:17.672122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-06cfb018-6e90-4674-9cbe-ac11c5f4638a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:17.677425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-06cfb018-6e90-4674-9cbe-ac11c5f4638a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.695014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06cfb018-6e90-4674-9cbe-ac11c5f4638a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.710088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06cfb018-6e90-4674-9cbe-ac11c5f4638a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.711316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06cfb018-6e90-4674-9cbe-ac11c5f4638a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.713251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06cfb018-6e90-4674-9cbe-ac11c5f4638a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.734563 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-74dc44bb-7a77-4792-af69-01da9a7f1784 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 204 len: 0 microversion: 2.1 time: 0.326814 Jul 20 04:41:17.735440 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2905/5808] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:17 2022] DELETE /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:17.747495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2724061b-9de2-47ed-832f-d46b3ce29d8f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:17.755852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2724061b-9de2-47ed-832f-d46b3ce29d8f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.764194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2724061b-9de2-47ed-832f-d46b3ce29d8f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.767852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2724061b-9de2-47ed-832f-d46b3ce29d8f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.774755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2724061b-9de2-47ed-832f-d46b3ce29d8f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.778420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2724061b-9de2-47ed-832f-d46b3ce29d8f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.939766 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-06cfb018-6e90-4674-9cbe-ac11c5f4638a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action" status: 202 len: 0 microversion: 2.1 time: 0.293934 Jul 20 04:41:17.947947 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2904/5809] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:41:17 2022] POST /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:41:17.983341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-09e443d5-3aad-4da9-afe8-17ec98f1a4a5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:17.984087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-09e443d5-3aad-4da9-afe8-17ec98f1a4a5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:18.038340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09e443d5-3aad-4da9-afe8-17ec98f1a4a5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.043532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09e443d5-3aad-4da9-afe8-17ec98f1a4a5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.048401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09e443d5-3aad-4da9-afe8-17ec98f1a4a5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.052701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-09e443d5-3aad-4da9-afe8-17ec98f1a4a5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.635515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2724061b-9de2-47ed-832f-d46b3ce29d8f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:18.650039 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2724061b-9de2-47ed-832f-d46b3ce29d8f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.907619 Jul 20 04:41:18.650913 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2906/5810] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:17 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:19.020138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-09e443d5-3aad-4da9-afe8-17ec98f1a4a5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:19.029271 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-09e443d5-3aad-4da9-afe8-17ec98f1a4a5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1508 microversion: 2.1 time: 1.072793 Jul 20 04:41:19.030115 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2905/5811] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:17 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1508 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:19.353799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e14ac49a-1d19-4c67-8a8b-0128acc0d863 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] Calling method '.version_select at 0x7fb840e4c940>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:19.416750 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e14ac49a-1d19-4c67-8a8b-0128acc0d863 tempest-TestNetworkAdvancedServerOps-1362507395 tempest-TestNetworkAdvancedServerOps-1362507395-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-457533471" status: 202 len: 0 microversion: 2.1 time: 0.063246 Jul 20 04:41:19.423309 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2907/5812] 10.222.0.59 () {58 vars in 1280 bytes} [Wed Jul 20 04:41:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-457533471 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:41:19.668956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc1add7d-f241-4245-8ac1-6067da7e884f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:19.669705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cc1add7d-f241-4245-8ac1-6067da7e884f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:19.677643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc1add7d-f241-4245-8ac1-6067da7e884f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:19.678336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc1add7d-f241-4245-8ac1-6067da7e884f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:19.679514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc1add7d-f241-4245-8ac1-6067da7e884f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:19.680121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc1add7d-f241-4245-8ac1-6067da7e884f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.056937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b972b560-88a4-4d3b-b28e-585f17bba415 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:20.058220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b972b560-88a4-4d3b-b28e-585f17bba415 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:20.072581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b972b560-88a4-4d3b-b28e-585f17bba415 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:20.073416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b972b560-88a4-4d3b-b28e-585f17bba415 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.074561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b972b560-88a4-4d3b-b28e-585f17bba415 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:20.075319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b972b560-88a4-4d3b-b28e-585f17bba415 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.281352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cc1add7d-f241-4245-8ac1-6067da7e884f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:20.298492 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cc1add7d-f241-4245-8ac1-6067da7e884f tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1512 microversion: 2.1 time: 0.633459 Jul 20 04:41:20.303147 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2906/5813] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:19 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1512 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:20.615255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b972b560-88a4-4d3b-b28e-585f17bba415 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:20.628371 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b972b560-88a4-4d3b-b28e-585f17bba415 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1508 microversion: 2.1 time: 0.584159 Jul 20 04:41:20.637926 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2908/5814] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:20 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1508 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:21.328471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f2ee853-cb4b-472c-b88c-0761dec3c982 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:21.329103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f2ee853-cb4b-472c-b88c-0761dec3c982 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:21.359715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f2ee853-cb4b-472c-b88c-0761dec3c982 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.360521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f2ee853-cb4b-472c-b88c-0761dec3c982 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.362324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f2ee853-cb4b-472c-b88c-0761dec3c982 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.363419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f2ee853-cb4b-472c-b88c-0761dec3c982 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.647462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e4fc1af3-8bcd-47d0-876e-1b3dd35fe974 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:21.648313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e4fc1af3-8bcd-47d0-876e-1b3dd35fe974 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:21.659811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4fc1af3-8bcd-47d0-876e-1b3dd35fe974 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.660730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4fc1af3-8bcd-47d0-876e-1b3dd35fe974 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.661932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4fc1af3-8bcd-47d0-876e-1b3dd35fe974 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.662612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4fc1af3-8bcd-47d0-876e-1b3dd35fe974 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.679081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f2ee853-cb4b-472c-b88c-0761dec3c982 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80638aab82d450fb148f8d963b8747e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00806ce00e4aadace7517d5131cab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:21.697173 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f2ee853-cb4b-472c-b88c-0761dec3c982 tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 200 len: 1470 microversion: 2.1 time: 0.376087 Jul 20 04:41:21.720840 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2907/5815] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:21 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 1470 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:21.743486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-460be00e-22ef-4811-b832-7dc7c60e4a8c req-11696ccd-f691-4738-986a-f5803423f453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02", "name": "network-vif-deleted", "tag": "dbad2823-16de-4145-93a7-2756ed39d393"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:21.780881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-460be00e-22ef-4811-b832-7dc7c60e4a8c req-11696ccd-f691-4738-986a-f5803423f453 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.781333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-460be00e-22ef-4811-b832-7dc7c60e4a8c req-11696ccd-f691-4738-986a-f5803423f453 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.841404 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-460be00e-22ef-4811-b832-7dc7c60e4a8c req-11696ccd-f691-4738-986a-f5803423f453 service nova] Creating event network-vif-deleted:dbad2823-16de-4145-93a7-2756ed39d393 for instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 on n-h1-760456-11 Jul 20 04:41:21.857458 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-460be00e-22ef-4811-b832-7dc7c60e4a8c req-11696ccd-f691-4738-986a-f5803423f453 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135272 Jul 20 04:41:21.858075 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2908/5816] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:22.733640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b6702a1-ab55-4d27-9c09-1d0236550a1a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:22.735495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b6702a1-ab55-4d27-9c09-1d0236550a1a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] [instance: 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:22.743285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b6702a1-ab55-4d27-9c09-1d0236550a1a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.743738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b6702a1-ab55-4d27-9c09-1d0236550a1a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.751435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b6702a1-ab55-4d27-9c09-1d0236550a1a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.751938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b6702a1-ab55-4d27-9c09-1d0236550a1a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.783900 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-0b6702a1-ab55-4d27-9c09-1d0236550a1a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] HTTP exception thrown: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 could not be found. Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b6702a1-ab55-4d27-9c09-1d0236550a1a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Request method failure captured: Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 HTTP/1.1 Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14aV0lOjT3ia_6_3SsKaSIaTzxdgs_6bW2FyBGm5tBX290zVNKQa3FPJ5TxPHBNmMgXtF9tza4K4FQNG75nn3cQUnt3VNujqzwXGAtIzonhHW1uleVzue26eubEvctSoFtn0cyjyZaSqxhj8qnUyE7Z3O2k4O4qM8ifGyO6358oXDas Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc00806ce00e4aadace7517d5131cab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: dc00806ce00e4aadace7517d5131cab2 Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-418701601 Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e80638aab82d450fb148f8d963b8747e Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-418701601-project Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 could not be found. Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02'} Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 could not be found. Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 could not be found. Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:22.792070 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:22.797924 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:22.797924 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:22.797924 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:22.797924 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:22.797924 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:22.797924 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 could not be found. Jul 20 04:41:22.797924 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:41:22.803892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b6702a1-ab55-4d27-9c09-1d0236550a1a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] Returning 404 to user: Instance 8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:22.809017 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b6702a1-ab55-4d27-9c09-1d0236550a1a tempest-ServersNegativeTestJSON-418701601 tempest-ServersNegativeTestJSON-418701601-project] 10.222.0.59 "GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02" status: 404 len: 111 microversion: 2.1 time: 0.080905 Jul 20 04:41:22.811228 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2909/5817] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:22 2022] GET /compute/v2.1/servers/8b6c75a0-a782-4ec6-9afd-6e2ea4c15a02 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:41:22.925428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e4fc1af3-8bcd-47d0-876e-1b3dd35fe974 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:22.946117 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e4fc1af3-8bcd-47d0-876e-1b3dd35fe974 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1508 microversion: 2.1 time: 1.300303 Jul 20 04:41:22.950288 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2909/5818] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:21 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1508 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:23.975915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f123b8a-6fcb-4621-8491-2e22acccc362 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:23.978274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f123b8a-6fcb-4621-8491-2e22acccc362 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:23.994691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f123b8a-6fcb-4621-8491-2e22acccc362 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:23.995142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f123b8a-6fcb-4621-8491-2e22acccc362 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:23.995920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f123b8a-6fcb-4621-8491-2e22acccc362 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:23.996355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f123b8a-6fcb-4621-8491-2e22acccc362 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:24.319705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3f123b8a-6fcb-4621-8491-2e22acccc362 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:24.341957 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f123b8a-6fcb-4621-8491-2e22acccc362 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1514 microversion: 2.1 time: 0.369766 Jul 20 04:41:24.343966 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2910/5819] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:23 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1514 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:24.684392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-022eacee-4b10-4536-8f22-eabf1222e3a5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Action: 'create', calling method: .version_select at 0x7fb840f6dee0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-783922454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOILeEIWxq8U3x+S+tlktVcg2HS2HaYGay2gUJ3H+IR+PQ2BSRT4AAdhRZWrCcdyEVdMS5EXtT8i6jclQwXUZ7ASyt0aetqnJqnp1rf928VecHj1jSfGic/PCsbxGayDw=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:24.726328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-022eacee-4b10-4536-8f22-eabf1222e3a5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Getting quotas for project 66a33d3b51854654bae6889ed2891b4c. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:24.737740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-022eacee-4b10-4536-8f22-eabf1222e3a5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Getting quotas for user 06e47ca5f7f64b71b659170ca6f5ca20 and project 66a33d3b51854654bae6889ed2891b4c. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:24.799215 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-022eacee-4b10-4536-8f22-eabf1222e3a5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.118590 Jul 20 04:41:24.802496 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2910/5820] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:41:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:27.085292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b162bd99-8807-40cc-98fc-b15dd4d9eb82 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'create', calling method: .version_select at 0x7fb840f6f1f0>, body: {"keypair": {"name": "tempest-keypair-856948137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1pzExZY/p9W0C3WJvdBENRyrcEKtuQMp7JaicJK9Y6KRYM41ar81ow8T1EhLEvMuVsC56GEjkUoWQJPOP3qwcoqt5n+fkJNuG+hmgKPAB1rncXLUjUujzboaUWxXq9tA=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:27.122457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b162bd99-8807-40cc-98fc-b15dd4d9eb82 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Getting quotas for project 9138f252886e4faea3710ff7d6764683. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:27.137574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b162bd99-8807-40cc-98fc-b15dd4d9eb82 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Getting quotas for user eff6843f674047fc9a8841711244bce4 and project 9138f252886e4faea3710ff7d6764683. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:27.196229 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b162bd99-8807-40cc-98fc-b15dd4d9eb82 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118575 Jul 20 04:41:27.199040 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2911/5821] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:41:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:27.796337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1447339003", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f8baf046-5e0d-48a3-a650-bddda22e2323", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-783922454", "security_groups": [{"name": "tempest-secgroup-smoke-1574117097"}], "networks": [{"uuid": "fcc27d13-0c9b-4515-af1e-b862686805c0"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:27.831620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:28.241698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] validate_networks() for [('fcc27d13-0c9b-4515-af1e-b862686805c0', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:41:29.676724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:41:29.677545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:41:29.677940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:41:29.678590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:41:29.679876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:41:29.698733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.701401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.704695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.705968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.734876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Getting quotas for project 66a33d3b51854654bae6889ed2891b4c. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:29.745462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Getting quotas for user 06e47ca5f7f64b71b659170ca6f5ca20 and project 66a33d3b51854654bae6889ed2891b4c. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:29.955108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:41:29.957158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8baf046-5e0d-48a3-a650-bddda22e2323',volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:41:30.301787 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-80aae629-7067-4f49-937c-d620aa5e460a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.516090 Jul 20 04:41:30.309811 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2911/5822] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:41:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:41:30.319806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-545e6448-d67c-4192-9714-634051514926 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:30.324220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-545e6448-d67c-4192-9714-634051514926 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:30.641709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-545e6448-d67c-4192-9714-634051514926 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:30.652481 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-545e6448-d67c-4192-9714-634051514926 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1098 microversion: 2.1 time: 0.339505 Jul 20 04:41:30.655893 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2912/5823] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:30 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1098 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:31.163090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1502800168", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5d649b7-1043-4dbd-90df-444d22a1d3f0"}], "security_groups": [{"name": "tempest-securitygroup--118404305"}], "key_name": "tempest-keypair-856948137", "user_data": "}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:31.437475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] validate_networks() for [('e5d649b7-1043-4dbd-90df-444d22a1d3f0', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:41:31.675802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5627efac-1953-4caf-9065-dd8cc3b32733 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:31.676994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5627efac-1953-4caf-9065-dd8cc3b32733 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:31.691432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5627efac-1953-4caf-9065-dd8cc3b32733 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:31.691902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5627efac-1953-4caf-9065-dd8cc3b32733 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:31.692718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5627efac-1953-4caf-9065-dd8cc3b32733 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:31.693166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5627efac-1953-4caf-9065-dd8cc3b32733 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:31.821256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5627efac-1953-4caf-9065-dd8cc3b32733 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:31.851746 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5627efac-1953-4caf-9065-dd8cc3b32733 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1196 microversion: 2.1 time: 0.182707 Jul 20 04:41:31.859344 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2913/5824] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:31 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1196 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:32.507250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:41:32.508359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:41:32.509026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:41:32.510079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:41:32.510719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:41:32.546384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.549788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.551553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.555860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.651992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Getting quotas for project 9138f252886e4faea3710ff7d6764683. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:32.674089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Getting quotas for user eff6843f674047fc9a8841711244bce4 and project 9138f252886e4faea3710ff7d6764683. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:32.703302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:41:32.708291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:41:32.808884 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a2a079aa-ab2e-4a68-b238-0e6d46754e2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.651376 Jul 20 04:41:32.822928 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2912/5825] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:41:31 2022] POST /compute/v2.1/servers => generated 408 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:41:32.834020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-87ec543b-5e20-4ce6-917f-ced41dd65640 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:32.834613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-87ec543b-5e20-4ce6-917f-ced41dd65640 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:32.872237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-82dcae3a-1b5f-417a-8b6d-03a6c4b2d4f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:32.873327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-82dcae3a-1b5f-417a-8b6d-03a6c4b2d4f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:32.904326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82dcae3a-1b5f-417a-8b6d-03a6c4b2d4f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.907304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82dcae3a-1b5f-417a-8b6d-03a6c4b2d4f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.909616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82dcae3a-1b5f-417a-8b6d-03a6c4b2d4f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.912681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-82dcae3a-1b5f-417a-8b6d-03a6c4b2d4f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.070740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-82dcae3a-1b5f-417a-8b6d-03a6c4b2d4f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:33.080130 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-82dcae3a-1b5f-417a-8b6d-03a6c4b2d4f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1214 microversion: 2.1 time: 0.212185 Jul 20 04:41:33.081874 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2913/5826] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:32 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:33.663004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-87ec543b-5e20-4ce6-917f-ced41dd65640 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:33.681568 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-87ec543b-5e20-4ce6-917f-ced41dd65640 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1245 microversion: 2.1 time: 0.853954 Jul 20 04:41:33.682577 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2914/5827] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:32 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1245 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:34.103660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a424d975-8828-4ad4-a0f8-b40924910191 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:34.106947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a424d975-8828-4ad4-a0f8-b40924910191 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:34.131889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a424d975-8828-4ad4-a0f8-b40924910191 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.132855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a424d975-8828-4ad4-a0f8-b40924910191 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.133838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a424d975-8828-4ad4-a0f8-b40924910191 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.134389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a424d975-8828-4ad4-a0f8-b40924910191 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.494202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a424d975-8828-4ad4-a0f8-b40924910191 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:34.507625 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a424d975-8828-4ad4-a0f8-b40924910191 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1282 microversion: 2.1 time: 0.413564 Jul 20 04:41:34.509258 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2914/5828] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:34 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1282 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:34.700064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ce3cffc-ba53-472b-b34b-1bae0f38127e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:34.701544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ce3cffc-ba53-472b-b34b-1bae0f38127e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:34.705775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:34.732686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ce3cffc-ba53-472b-b34b-1bae0f38127e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.733200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ce3cffc-ba53-472b-b34b-1bae0f38127e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.734033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ce3cffc-ba53-472b-b34b-1bae0f38127e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.734517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ce3cffc-ba53-472b-b34b-1bae0f38127e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.975262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5ce3cffc-ba53-472b-b34b-1bae0f38127e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:34.986034 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ce3cffc-ba53-472b-b34b-1bae0f38127e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1315 microversion: 2.1 time: 0.290115 Jul 20 04:41:35.050721 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2915/5829] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:34 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:35.525131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b02e70a-bc17-45af-abc6-cfbfd49738b4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:35.525719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b02e70a-bc17-45af-abc6-cfbfd49738b4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:35.545808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b02e70a-bc17-45af-abc6-cfbfd49738b4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.546626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b02e70a-bc17-45af-abc6-cfbfd49738b4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.547650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b02e70a-bc17-45af-abc6-cfbfd49738b4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.548373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b02e70a-bc17-45af-abc6-cfbfd49738b4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.044937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-12628850-139b-4347-ae9d-b88c31edc2bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:36.045553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-12628850-139b-4347-ae9d-b88c31edc2bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:36.076533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12628850-139b-4347-ae9d-b88c31edc2bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:36.077032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12628850-139b-4347-ae9d-b88c31edc2bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.078138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12628850-139b-4347-ae9d-b88c31edc2bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:36.078852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12628850-139b-4347-ae9d-b88c31edc2bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.278418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b02e70a-bc17-45af-abc6-cfbfd49738b4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:36.293215 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b02e70a-bc17-45af-abc6-cfbfd49738b4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1282 microversion: 2.1 time: 0.770707 Jul 20 04:41:36.294358 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2915/5830] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:35 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1282 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:36.502174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-12628850-139b-4347-ae9d-b88c31edc2bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:36.511065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:36.546708 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-12628850-139b-4347-ae9d-b88c31edc2bc tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1303 microversion: 2.1 time: 0.505264 Jul 20 04:41:36.547262 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2916/5831] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:36 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1303 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:37.311235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-21a2f6f7-874d-4843-b208-6c87eb83f597 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:37.314599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-21a2f6f7-874d-4843-b208-6c87eb83f597 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:37.330139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-21a2f6f7-874d-4843-b208-6c87eb83f597 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.331160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-21a2f6f7-874d-4843-b208-6c87eb83f597 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:37.332429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-21a2f6f7-874d-4843-b208-6c87eb83f597 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.335666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-21a2f6f7-874d-4843-b208-6c87eb83f597 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:37.353959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:37.583152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3aa53d3-df39-4bc5-836c-6d8aabf174f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:37.584737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3aa53d3-df39-4bc5-836c-6d8aabf174f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:37.609528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3aa53d3-df39-4bc5-836c-6d8aabf174f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.629221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3aa53d3-df39-4bc5-836c-6d8aabf174f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:37.635240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3aa53d3-df39-4bc5-836c-6d8aabf174f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.637729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3aa53d3-df39-4bc5-836c-6d8aabf174f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:38.598642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-21a2f6f7-874d-4843-b208-6c87eb83f597 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:38.625811 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-21a2f6f7-874d-4843-b208-6c87eb83f597 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1282 microversion: 2.1 time: 1.318401 Jul 20 04:41:38.633364 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2916/5832] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:37 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1282 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:38.996210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b13bcbcf-200d-43c2-86bc-c77d2890e71f req-0fe971aa-8424-4865-b450-c26cd97462a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e18f39-0d53-4bce-ac11-d565e7c0d2e1", "tag": "0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:39.015783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b13bcbcf-200d-43c2-86bc-c77d2890e71f req-0fe971aa-8424-4865-b450-c26cd97462a7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.022657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b13bcbcf-200d-43c2-86bc-c77d2890e71f req-0fe971aa-8424-4865-b450-c26cd97462a7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.099219 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b13bcbcf-200d-43c2-86bc-c77d2890e71f req-0fe971aa-8424-4865-b450-c26cd97462a7 service nova] Creating event network-changed:0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33 for instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 on n-h1-760456-11 Jul 20 04:41:39.120881 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b13bcbcf-200d-43c2-86bc-c77d2890e71f req-0fe971aa-8424-4865-b450-c26cd97462a7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128252 Jul 20 04:41:39.137843 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2917/5833] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:41:39.193743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3aa53d3-df39-4bc5-836c-6d8aabf174f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:39.211950 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3aa53d3-df39-4bc5-836c-6d8aabf174f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1370 microversion: 2.1 time: 1.643527 Jul 20 04:41:39.215918 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2917/5834] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:37 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1370 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:39.658800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-90c99678-2c11-4dd7-a4bf-93c48fc52168 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:39.659722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-90c99678-2c11-4dd7-a4bf-93c48fc52168 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:39.668470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90c99678-2c11-4dd7-a4bf-93c48fc52168 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.687950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90c99678-2c11-4dd7-a4bf-93c48fc52168 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.689792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90c99678-2c11-4dd7-a4bf-93c48fc52168 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.690456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90c99678-2c11-4dd7-a4bf-93c48fc52168 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:40.114897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90c99678-2c11-4dd7-a4bf-93c48fc52168 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:40.145787 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-90c99678-2c11-4dd7-a4bf-93c48fc52168 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1282 microversion: 2.1 time: 0.489882 Jul 20 04:41:40.147547 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2918/5835] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:39 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1282 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:40.233286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0411a309-f180-4a99-80f1-2c3a434968f4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:40.235360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0411a309-f180-4a99-80f1-2c3a434968f4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:40.247186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0411a309-f180-4a99-80f1-2c3a434968f4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.248289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0411a309-f180-4a99-80f1-2c3a434968f4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:40.249356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0411a309-f180-4a99-80f1-2c3a434968f4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:40.250120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0411a309-f180-4a99-80f1-2c3a434968f4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:41.164177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e02ea2f-937d-4597-ac6a-5099be6e828c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:41.164818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e02ea2f-937d-4597-ac6a-5099be6e828c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:41.184892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0411a309-f180-4a99-80f1-2c3a434968f4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:41.191451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e02ea2f-937d-4597-ac6a-5099be6e828c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:41.196726 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0411a309-f180-4a99-80f1-2c3a434968f4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1370 microversion: 2.1 time: 0.968061 Jul 20 04:41:41.203037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e02ea2f-937d-4597-ac6a-5099be6e828c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:41.215499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e02ea2f-937d-4597-ac6a-5099be6e828c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:41.215972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e02ea2f-937d-4597-ac6a-5099be6e828c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:41.218805 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2918/5836] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:40 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1370 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:41.667876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-792df359-18c8-41e2-a9bb-59e1df7b6ed1 req-caa7c38f-2f0b-4a76-ba54-bda28f8b894b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e8ea2f-7c9f-4424-b7af-065fc4225a98", "tag": "5d69a64b-5903-4704-a9e9-e1d78733d282"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:41.687370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-792df359-18c8-41e2-a9bb-59e1df7b6ed1 req-caa7c38f-2f0b-4a76-ba54-bda28f8b894b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:41.688262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-792df359-18c8-41e2-a9bb-59e1df7b6ed1 req-caa7c38f-2f0b-4a76-ba54-bda28f8b894b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:41.704116 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-792df359-18c8-41e2-a9bb-59e1df7b6ed1 req-caa7c38f-2f0b-4a76-ba54-bda28f8b894b service nova] Creating event network-changed:5d69a64b-5903-4704-a9e9-e1d78733d282 for instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 on n-h2-760456-11 Jul 20 04:41:41.712543 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-792df359-18c8-41e2-a9bb-59e1df7b6ed1 req-caa7c38f-2f0b-4a76-ba54-bda28f8b894b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055347 Jul 20 04:41:41.713798 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2919/5837] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:41.961415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e02ea2f-937d-4597-ac6a-5099be6e828c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:41.969593 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e02ea2f-937d-4597-ac6a-5099be6e828c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1282 microversion: 2.1 time: 0.809221 Jul 20 04:41:41.979039 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2919/5838] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:41 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1282 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:42.221889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c0c9f40-c986-4471-8834-19bd5356d367 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:42.222657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c0c9f40-c986-4471-8834-19bd5356d367 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:42.233385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f40-c986-4471-8834-19bd5356d367 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:42.235027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f40-c986-4471-8834-19bd5356d367 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.238768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f40-c986-4471-8834-19bd5356d367 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:42.239257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0c9f40-c986-4471-8834-19bd5356d367 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.750061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c0c9f40-c986-4471-8834-19bd5356d367 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:42.763674 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c0c9f40-c986-4471-8834-19bd5356d367 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1370 microversion: 2.1 time: 0.546171 Jul 20 04:41:42.772026 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2920/5839] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:42 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1370 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:42.995539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-65b0ee14-00f9-4ed8-b511-8262209cfbb2 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:42.996867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-65b0ee14-00f9-4ed8-b511-8262209cfbb2 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:43.007183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:43.011400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=16 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:43.013479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65b0ee14-00f9-4ed8-b511-8262209cfbb2 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:43.027099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65b0ee14-00f9-4ed8-b511-8262209cfbb2 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:43.027980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65b0ee14-00f9-4ed8-b511-8262209cfbb2 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:43.028638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65b0ee14-00f9-4ed8-b511-8262209cfbb2 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:43.710219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-65b0ee14-00f9-4ed8-b511-8262209cfbb2 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:43.719211 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-65b0ee14-00f9-4ed8-b511-8262209cfbb2 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1282 microversion: 2.1 time: 0.727025 Jul 20 04:41:43.722602 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2920/5840] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:42 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1282 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:43.788176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b2562e6-89ea-45c1-ac66-f81411681722 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:43.789632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9b2562e6-89ea-45c1-ac66-f81411681722 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:43.793190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:43.818535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b2562e6-89ea-45c1-ac66-f81411681722 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:43.819063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b2562e6-89ea-45c1-ac66-f81411681722 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:43.819864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b2562e6-89ea-45c1-ac66-f81411681722 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:43.820254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b2562e6-89ea-45c1-ac66-f81411681722 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.221259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b2562e6-89ea-45c1-ac66-f81411681722 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:44.230930 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9b2562e6-89ea-45c1-ac66-f81411681722 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1370 microversion: 2.1 time: 0.446313 Jul 20 04:41:44.232054 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2921/5841] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:43 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1370 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:44.738872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dee5180c-c804-41ad-a364-22d692108b0b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:44.740134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dee5180c-c804-41ad-a364-22d692108b0b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:44.757590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dee5180c-c804-41ad-a364-22d692108b0b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.760516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dee5180c-c804-41ad-a364-22d692108b0b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.761693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dee5180c-c804-41ad-a364-22d692108b0b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.763169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dee5180c-c804-41ad-a364-22d692108b0b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.251612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-185b080b-1a15-4daa-8649-6a017df8172c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:45.252933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-185b080b-1a15-4daa-8649-6a017df8172c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:45.259720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dee5180c-c804-41ad-a364-22d692108b0b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:45.264487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-185b080b-1a15-4daa-8649-6a017df8172c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.265685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-185b080b-1a15-4daa-8649-6a017df8172c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.268168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-185b080b-1a15-4daa-8649-6a017df8172c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:45.269351 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dee5180c-c804-41ad-a364-22d692108b0b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1270 microversion: 2.1 time: 0.534487 Jul 20 04:41:45.269692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-185b080b-1a15-4daa-8649-6a017df8172c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.277186 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2921/5842] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:44 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1270 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:45.452698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-185b080b-1a15-4daa-8649-6a017df8172c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:45.461841 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-185b080b-1a15-4daa-8649-6a017df8172c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1370 microversion: 2.1 time: 0.216922 Jul 20 04:41:45.472680 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2922/5843] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:45 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:46.298607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-612a2a93-50a7-470f-b952-7f7a1abd74a8 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:46.299984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-612a2a93-50a7-470f-b952-7f7a1abd74a8 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:46.316222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-612a2a93-50a7-470f-b952-7f7a1abd74a8 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.317290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-612a2a93-50a7-470f-b952-7f7a1abd74a8 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.318367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-612a2a93-50a7-470f-b952-7f7a1abd74a8 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.319050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-612a2a93-50a7-470f-b952-7f7a1abd74a8 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.480423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3aec9ea4-1c49-42da-bad7-a7f80d5213cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:46.481974 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3aec9ea4-1c49-42da-bad7-a7f80d5213cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:46.497258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3aec9ea4-1c49-42da-bad7-a7f80d5213cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.498440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3aec9ea4-1c49-42da-bad7-a7f80d5213cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.499639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3aec9ea4-1c49-42da-bad7-a7f80d5213cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.500369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3aec9ea4-1c49-42da-bad7-a7f80d5213cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.602657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-612a2a93-50a7-470f-b952-7f7a1abd74a8 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:46.616124 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-612a2a93-50a7-470f-b952-7f7a1abd74a8 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1270 microversion: 2.1 time: 0.324913 Jul 20 04:41:46.618121 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2922/5844] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:46 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1270 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:46.620519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-612a2a93-50a7-470f-b952-7f7a1abd74a8 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:46.624056 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-612a2a93-50a7-470f-b952-7f7a1abd74a8 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004279 Jul 20 04:41:46.624680 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2923/5845] 10.222.0.59 () {56 vars in 885 bytes} [Wed Jul 20 04:41:46 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:41:47.171032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3aec9ea4-1c49-42da-bad7-a7f80d5213cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:47.182242 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3aec9ea4-1c49-42da-bad7-a7f80d5213cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1370 microversion: 2.1 time: 0.706034 Jul 20 04:41:47.185708 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2923/5846] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:46 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1370 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:47.637386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-439a8dbc-30a7-4d1b-9c99-d8b2c206b83e tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:47.638730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-439a8dbc-30a7-4d1b-9c99-d8b2c206b83e tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:47.653915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-439a8dbc-30a7-4d1b-9c99-d8b2c206b83e tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.656054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-439a8dbc-30a7-4d1b-9c99-d8b2c206b83e tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.660424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-439a8dbc-30a7-4d1b-9c99-d8b2c206b83e tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.662486 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-439a8dbc-30a7-4d1b-9c99-d8b2c206b83e tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.203023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a49cea14-aaef-4a0b-99b6-7c7c401a2c3d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:48.203983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a49cea14-aaef-4a0b-99b6-7c7c401a2c3d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:48.224303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a49cea14-aaef-4a0b-99b6-7c7c401a2c3d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:48.224948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a49cea14-aaef-4a0b-99b6-7c7c401a2c3d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.225777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a49cea14-aaef-4a0b-99b6-7c7c401a2c3d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:48.226228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a49cea14-aaef-4a0b-99b6-7c7c401a2c3d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.560135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-439a8dbc-30a7-4d1b-9c99-d8b2c206b83e tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:48.602024 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-439a8dbc-30a7-4d1b-9c99-d8b2c206b83e tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1270 microversion: 2.1 time: 0.963825 Jul 20 04:41:48.603168 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2924/5847] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:47 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1270 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:49.142549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a49cea14-aaef-4a0b-99b6-7c7c401a2c3d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:49.174814 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a49cea14-aaef-4a0b-99b6-7c7c401a2c3d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1370 microversion: 2.1 time: 0.976314 Jul 20 04:41:49.176278 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2924/5848] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:48 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1370 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:49.619730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-91a89da1-b171-4b69-a32c-9670f8ad1c33 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:49.621198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-91a89da1-b171-4b69-a32c-9670f8ad1c33 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:49.631729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a89da1-b171-4b69-a32c-9670f8ad1c33 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.632656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a89da1-b171-4b69-a32c-9670f8ad1c33 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.633792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a89da1-b171-4b69-a32c-9670f8ad1c33 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.634523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-91a89da1-b171-4b69-a32c-9670f8ad1c33 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.962686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-91a89da1-b171-4b69-a32c-9670f8ad1c33 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:49.975314 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-91a89da1-b171-4b69-a32c-9670f8ad1c33 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1270 microversion: 2.1 time: 0.359493 Jul 20 04:41:49.985081 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2925/5849] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:49 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1270 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:50.201426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-97f74648-73b9-4582-8e10-a7740cc93fbe tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:50.202798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-97f74648-73b9-4582-8e10-a7740cc93fbe tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:50.227143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97f74648-73b9-4582-8e10-a7740cc93fbe tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.227803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97f74648-73b9-4582-8e10-a7740cc93fbe tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.229110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97f74648-73b9-4582-8e10-a7740cc93fbe tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.229737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-97f74648-73b9-4582-8e10-a7740cc93fbe tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.503293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b492dadd-eb83-4a92-9eab-257f7d8122c9 req-e1c7ee3d-8c52-4ac7-be2c-0474bd28ce25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e8ea2f-7c9f-4424-b7af-065fc4225a98", "name": "network-vif-plugged", "status": "completed", "tag": "5d69a64b-5903-4704-a9e9-e1d78733d282"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:50.521472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b492dadd-eb83-4a92-9eab-257f7d8122c9 req-e1c7ee3d-8c52-4ac7-be2c-0474bd28ce25 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:50.521955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b492dadd-eb83-4a92-9eab-257f7d8122c9 req-e1c7ee3d-8c52-4ac7-be2c-0474bd28ce25 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:50.548268 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b492dadd-eb83-4a92-9eab-257f7d8122c9 req-e1c7ee3d-8c52-4ac7-be2c-0474bd28ce25 service nova] Creating event network-vif-plugged:5d69a64b-5903-4704-a9e9-e1d78733d282 for instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 on n-h2-760456-11 Jul 20 04:41:50.561037 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b492dadd-eb83-4a92-9eab-257f7d8122c9 req-e1c7ee3d-8c52-4ac7-be2c-0474bd28ce25 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062822 Jul 20 04:41:50.563043 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2926/5850] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:50.657125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-97f74648-73b9-4582-8e10-a7740cc93fbe tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:50.668981 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-97f74648-73b9-4582-8e10-a7740cc93fbe tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1370 microversion: 2.1 time: 0.480218 Jul 20 04:41:50.669592 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2925/5851] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:50 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1370 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:50.994229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-76ed0c3f-3527-4f7e-a919-e55483028d97 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:50.994992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-76ed0c3f-3527-4f7e-a919-e55483028d97 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:51.015402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76ed0c3f-3527-4f7e-a919-e55483028d97 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.015981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76ed0c3f-3527-4f7e-a919-e55483028d97 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:51.017086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76ed0c3f-3527-4f7e-a919-e55483028d97 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.017747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76ed0c3f-3527-4f7e-a919-e55483028d97 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:51.340272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-76ed0c3f-3527-4f7e-a919-e55483028d97 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:51.363443 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-76ed0c3f-3527-4f7e-a919-e55483028d97 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1270 microversion: 2.1 time: 0.373864 Jul 20 04:41:51.365283 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2927/5852] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:50 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1270 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:51.687074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3591fde1-60d8-4976-a743-e3938e9d359a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:51.689134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3591fde1-60d8-4976-a743-e3938e9d359a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:51.699183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3591fde1-60d8-4976-a743-e3938e9d359a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.699827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3591fde1-60d8-4976-a743-e3938e9d359a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:51.701425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3591fde1-60d8-4976-a743-e3938e9d359a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.702005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3591fde1-60d8-4976-a743-e3938e9d359a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.170605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3591fde1-60d8-4976-a743-e3938e9d359a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:52.185547 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3591fde1-60d8-4976-a743-e3938e9d359a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1370 microversion: 2.1 time: 0.500993 Jul 20 04:41:52.187209 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2926/5853] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:51 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1370 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:52.383135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-329141cf-392f-4ba9-90fd-99812cd1c491 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:52.384383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-329141cf-392f-4ba9-90fd-99812cd1c491 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:52.402629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329141cf-392f-4ba9-90fd-99812cd1c491 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.405412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329141cf-392f-4ba9-90fd-99812cd1c491 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.406461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329141cf-392f-4ba9-90fd-99812cd1c491 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.407219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-329141cf-392f-4ba9-90fd-99812cd1c491 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.833998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-329141cf-392f-4ba9-90fd-99812cd1c491 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:52.842093 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-329141cf-392f-4ba9-90fd-99812cd1c491 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1270 microversion: 2.1 time: 0.463349 Jul 20 04:41:52.842717 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2928/5854] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:52 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1270 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:53.204817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2d126d6-9917-41bf-a939-3db6ca5b0069 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:53.206305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e2d126d6-9917-41bf-a939-3db6ca5b0069 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:53.218352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2d126d6-9917-41bf-a939-3db6ca5b0069 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:53.222509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2d126d6-9917-41bf-a939-3db6ca5b0069 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:53.223560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2d126d6-9917-41bf-a939-3db6ca5b0069 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:53.224092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2d126d6-9917-41bf-a939-3db6ca5b0069 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:53.527184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e2d126d6-9917-41bf-a939-3db6ca5b0069 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:53.536279 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e2d126d6-9917-41bf-a939-3db6ca5b0069 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1564 microversion: 2.1 time: 0.337461 Jul 20 04:41:53.540577 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2927/5855] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:53 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1564 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:53.556436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93c1cb03-5074-4015-9737-9b2a3dae4677 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:53.557013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-93c1cb03-5074-4015-9737-9b2a3dae4677 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:53.565103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93c1cb03-5074-4015-9737-9b2a3dae4677 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:53.566276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93c1cb03-5074-4015-9737-9b2a3dae4677 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:53.567270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93c1cb03-5074-4015-9737-9b2a3dae4677 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:53.567897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93c1cb03-5074-4015-9737-9b2a3dae4677 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:53.869077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-997e9ee9-0cf5-4e55-9dd1-18c52498bf6b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:53.882146 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-93c1cb03-5074-4015-9737-9b2a3dae4677 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.329849 Jul 20 04:41:53.883619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-997e9ee9-0cf5-4e55-9dd1-18c52498bf6b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:53.884224 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2929/5856] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:41:53 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-interface => generated 285 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:53.904540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-997e9ee9-0cf5-4e55-9dd1-18c52498bf6b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:53.905247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-997e9ee9-0cf5-4e55-9dd1-18c52498bf6b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:53.906403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-997e9ee9-0cf5-4e55-9dd1-18c52498bf6b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:53.907726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-997e9ee9-0cf5-4e55-9dd1-18c52498bf6b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.406437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e18f39-0d53-4bce-ac11-d565e7c0d2e1", "name": "network-vif-plugged", "status": "completed", "tag": "0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:54.431943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:54.434616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.461938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-997e9ee9-0cf5-4e55-9dd1-18c52498bf6b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:54.470192 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] Creating event network-vif-plugged:0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33 for instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 on n-h1-760456-11 Jul 20 04:41:54.480280 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-997e9ee9-0cf5-4e55-9dd1-18c52498bf6b tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1270 microversion: 2.1 time: 0.624418 Jul 20 04:41:54.485917 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2928/5857] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:53 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1270 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:54.486435 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086622 Jul 20 04:41:54.487374 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2930/5858] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:55.061221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2110504204", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "63efcde1-e35c-4394-96fc-9c49a40f8299", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ff98390c-0468-4cc8-9649-ee7fac3db692"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:55.231708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] validate_networks() for [('ff98390c-0468-4cc8-9649-ee7fac3db692', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:41:55.320310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:55.321808 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] 10.222.0.59 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001701 Jul 20 04:41:55.328299 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2931/5859] 10.222.0.59 () {56 vars in 885 bytes} [Wed Jul 20 04:41:55 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 20 04:41:55.331126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:55.332016 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] 10.222.0.59 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001767 Jul 20 04:41:55.332666 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2932/5860] 10.222.0.59 () {54 vars in 1034 bytes} [Wed Jul 20 04:41:55 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 20 04:41:55.339707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:55.340836 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001657 Jul 20 04:41:55.348896 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2933/5861] 10.222.0.59 () {54 vars in 1040 bytes} [Wed Jul 20 04:41:55 2022] GET /compute/v2.1/ => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:55.350603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:55.351699 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-34f97690-c8f5-4d0b-93ea-80ec0229400a req-2cd825d4-d6a7-4e9a-aad2-c37c3eb79329 service nova] 10.222.0.59 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001850 Jul 20 04:41:55.352131 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2934/5862] 10.222.0.59 () {56 vars in 885 bytes} [Wed Jul 20 04:41:55 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:41:55.508420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0933d7b8-32c6-4626-a906-a1df7e527812 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:55.510059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0933d7b8-32c6-4626-a906-a1df7e527812 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:55.521299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0933d7b8-32c6-4626-a906-a1df7e527812 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:55.522020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0933d7b8-32c6-4626-a906-a1df7e527812 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:55.523502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0933d7b8-32c6-4626-a906-a1df7e527812 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:55.524226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0933d7b8-32c6-4626-a906-a1df7e527812 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.092095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:41:56.092805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:41:56.093291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:41:56.093754 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:41:56.094272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:41:56.118140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.120996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.122034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.122539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.164391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:56.176435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for user f1067c18d4074c78a512d89e07141915 and project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:56.194719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:41:56.198750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='63efcde1-e35c-4394-96fc-9c49a40f8299',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:41:56.240096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0933d7b8-32c6-4626-a906-a1df7e527812 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:56.254101 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0933d7b8-32c6-4626-a906-a1df7e527812 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1270 microversion: 2.1 time: 0.754805 Jul 20 04:41:56.264156 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2935/5863] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:55 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1270 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:56.270831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f2054a62-1a98-44a3-9d66-0cbc701ec41b req-3fe778e6-f6c5-462e-a77d-f1fb8bc958fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e8ea2f-7c9f-4424-b7af-065fc4225a98", "tag": "5d69a64b-5903-4704-a9e9-e1d78733d282"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:56.280461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f2054a62-1a98-44a3-9d66-0cbc701ec41b req-3fe778e6-f6c5-462e-a77d-f1fb8bc958fd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.281076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f2054a62-1a98-44a3-9d66-0cbc701ec41b req-3fe778e6-f6c5-462e-a77d-f1fb8bc958fd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.298627 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ded66fda-46aa-429e-b7e1-78cb1cc1eda9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239263 Jul 20 04:41:56.306339 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2929/5864] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:41:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:41:56.308859 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f2054a62-1a98-44a3-9d66-0cbc701ec41b req-3fe778e6-f6c5-462e-a77d-f1fb8bc958fd service nova] Creating event network-changed:5d69a64b-5903-4704-a9e9-e1d78733d282 for instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 on n-h2-760456-11 Jul 20 04:41:56.318873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-493d37e3-f725-4af8-85e8-744867eeaf39 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:56.324811 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f2054a62-1a98-44a3-9d66-0cbc701ec41b req-3fe778e6-f6c5-462e-a77d-f1fb8bc958fd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058500 Jul 20 04:41:56.337344 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2936/5865] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:56.340732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-493d37e3-f725-4af8-85e8-744867eeaf39 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:56.543995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-493d37e3-f725-4af8-85e8-744867eeaf39 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:56.562879 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-493d37e3-f725-4af8-85e8-744867eeaf39 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1057 microversion: 2.1 time: 0.252571 Jul 20 04:41:56.565561 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2930/5866] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:56 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1057 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:57.274177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4126ed74-5527-4e69-a434-4965e44d3999 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:57.275080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4126ed74-5527-4e69-a434-4965e44d3999 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:57.300167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4126ed74-5527-4e69-a434-4965e44d3999 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.301976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4126ed74-5527-4e69-a434-4965e44d3999 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:57.304204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4126ed74-5527-4e69-a434-4965e44d3999 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.309084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4126ed74-5527-4e69-a434-4965e44d3999 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:57.582748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f0be153-8c91-48f4-adf4-5e9e4efd3184 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:57.583376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6f0be153-8c91-48f4-adf4-5e9e4efd3184 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:57.608412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f0be153-8c91-48f4-adf4-5e9e4efd3184 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.608883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f0be153-8c91-48f4-adf4-5e9e4efd3184 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:57.609703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f0be153-8c91-48f4-adf4-5e9e4efd3184 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.610339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f0be153-8c91-48f4-adf4-5e9e4efd3184 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:57.694482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4126ed74-5527-4e69-a434-4965e44d3999 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:57.705644 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4126ed74-5527-4e69-a434-4965e44d3999 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1458 microversion: 2.1 time: 0.437398 Jul 20 04:41:57.707189 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2937/5867] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:57 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1458 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:57.730943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4bbca1a4-8c81-4c76-86ab-ff090793c02a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:57.732168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4bbca1a4-8c81-4c76-86ab-ff090793c02a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:57.754516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bbca1a4-8c81-4c76-86ab-ff090793c02a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.755738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bbca1a4-8c81-4c76-86ab-ff090793c02a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:57.757829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bbca1a4-8c81-4c76-86ab-ff090793c02a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.760269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bbca1a4-8c81-4c76-86ab-ff090793c02a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:57.774515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6f0be153-8c91-48f4-adf4-5e9e4efd3184 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:57.793273 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f0be153-8c91-48f4-adf4-5e9e4efd3184 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1109 microversion: 2.1 time: 0.216266 Jul 20 04:41:57.795584 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2931/5868] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:57 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1109 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:58.199339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4bbca1a4-8c81-4c76-86ab-ff090793c02a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:58.213414 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4bbca1a4-8c81-4c76-86ab-ff090793c02a tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1458 microversion: 2.1 time: 0.493129 Jul 20 04:41:58.214712 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2938/5869] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:57 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1458 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:58.812324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b10f1b5-8796-4d0c-84bf-a88b0de165f4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:58.812952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b10f1b5-8796-4d0c-84bf-a88b0de165f4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:58.824926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b10f1b5-8796-4d0c-84bf-a88b0de165f4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:58.829987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b10f1b5-8796-4d0c-84bf-a88b0de165f4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:58.831288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b10f1b5-8796-4d0c-84bf-a88b0de165f4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:58.831964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b10f1b5-8796-4d0c-84bf-a88b0de165f4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.025788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7b10f1b5-8796-4d0c-84bf-a88b0de165f4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:59.042111 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b10f1b5-8796-4d0c-84bf-a88b0de165f4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1127 microversion: 2.1 time: 0.233403 Jul 20 04:41:59.044105 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2932/5870] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:58 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1127 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:00.063957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a19b7c4e-7832-4ce1-84c8-f36c2bf66ca2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:00.064775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a19b7c4e-7832-4ce1-84c8-f36c2bf66ca2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:00.071055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:00.101169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a19b7c4e-7832-4ce1-84c8-f36c2bf66ca2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:00.102951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a19b7c4e-7832-4ce1-84c8-f36c2bf66ca2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:00.107596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a19b7c4e-7832-4ce1-84c8-f36c2bf66ca2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:00.108057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a19b7c4e-7832-4ce1-84c8-f36c2bf66ca2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:01.151602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3fb1d805-25f7-489f-964d-dc313a1b3fb1 req-5480b1ef-3bbe-4a4d-94d4-4e9522ba813d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c82c28f-fe29-4596-86dc-f9f23daf37b7", "tag": "17f155c4-5448-4e24-98c5-e8465523f729"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:01.172665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3fb1d805-25f7-489f-964d-dc313a1b3fb1 req-5480b1ef-3bbe-4a4d-94d4-4e9522ba813d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:01.173265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3fb1d805-25f7-489f-964d-dc313a1b3fb1 req-5480b1ef-3bbe-4a4d-94d4-4e9522ba813d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:01.207114 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3fb1d805-25f7-489f-964d-dc313a1b3fb1 req-5480b1ef-3bbe-4a4d-94d4-4e9522ba813d service nova] Creating event network-changed:17f155c4-5448-4e24-98c5-e8465523f729 for instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 on n-h1-760456-11 Jul 20 04:42:01.212879 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3fb1d805-25f7-489f-964d-dc313a1b3fb1 req-5480b1ef-3bbe-4a4d-94d4-4e9522ba813d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064959 Jul 20 04:42:01.214047 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2933/5871] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:01.337277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a19b7c4e-7832-4ce1-84c8-f36c2bf66ca2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:01.350555 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a19b7c4e-7832-4ce1-84c8-f36c2bf66ca2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 1.291615 Jul 20 04:42:01.351190 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2939/5872] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:00 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:02.369530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66810dec-80a3-4426-88a6-65f39f019e7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:02.371770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-66810dec-80a3-4426-88a6-65f39f019e7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:02.384180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66810dec-80a3-4426-88a6-65f39f019e7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:02.384645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66810dec-80a3-4426-88a6-65f39f019e7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:02.385451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66810dec-80a3-4426-88a6-65f39f019e7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:02.385900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66810dec-80a3-4426-88a6-65f39f019e7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:03.036887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2dc113ad-594b-467c-8bb9-43dc3c006e00 req-6df069f0-0e8a-4292-93fb-610044f566c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e18f39-0d53-4bce-ac11-d565e7c0d2e1", "tag": "0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:03.061706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2dc113ad-594b-467c-8bb9-43dc3c006e00 req-6df069f0-0e8a-4292-93fb-610044f566c0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:03.062674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2dc113ad-594b-467c-8bb9-43dc3c006e00 req-6df069f0-0e8a-4292-93fb-610044f566c0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:03.103180 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2dc113ad-594b-467c-8bb9-43dc3c006e00 req-6df069f0-0e8a-4292-93fb-610044f566c0 service nova] Creating event network-changed:0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33 for instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 on n-h1-760456-11 Jul 20 04:42:03.128963 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2dc113ad-594b-467c-8bb9-43dc3c006e00 req-6df069f0-0e8a-4292-93fb-610044f566c0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082141 Jul 20 04:42:03.132425 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2940/5873] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:03.745194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66810dec-80a3-4426-88a6-65f39f019e7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:03.758168 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-66810dec-80a3-4426-88a6-65f39f019e7a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 1.393772 Jul 20 04:42:03.769148 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2934/5874] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:02 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:04.777574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c697746-1238-474f-96af-44ccf8eab2b5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:04.779063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0c697746-1238-474f-96af-44ccf8eab2b5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:04.798858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c697746-1238-474f-96af-44ccf8eab2b5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:04.799691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c697746-1238-474f-96af-44ccf8eab2b5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:04.801084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c697746-1238-474f-96af-44ccf8eab2b5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:04.801774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c697746-1238-474f-96af-44ccf8eab2b5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:04.861812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:05.561624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0c697746-1238-474f-96af-44ccf8eab2b5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:05.590423 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0c697746-1238-474f-96af-44ccf8eab2b5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 0.803825 Jul 20 04:42:05.612313 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2941/5875] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:04 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:06.624010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6ef51140-fd37-4f59-8832-a6d20a6b86cc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:06.624993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6ef51140-fd37-4f59-8832-a6d20a6b86cc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:06.644060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:06.645255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:06.646858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:06.649900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ef51140-fd37-4f59-8832-a6d20a6b86cc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:06.654479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ef51140-fd37-4f59-8832-a6d20a6b86cc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:06.656425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ef51140-fd37-4f59-8832-a6d20a6b86cc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:06.657123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ef51140-fd37-4f59-8832-a6d20a6b86cc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:06.684718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f4336267-43ca-4dcb-9120-3ffd0205754a req-de48d79e-5887-4507-a3a5-8e8ff8282966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e18f39-0d53-4bce-ac11-d565e7c0d2e1", "tag": "0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:06.700425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f4336267-43ca-4dcb-9120-3ffd0205754a req-de48d79e-5887-4507-a3a5-8e8ff8282966 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:06.701148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f4336267-43ca-4dcb-9120-3ffd0205754a req-de48d79e-5887-4507-a3a5-8e8ff8282966 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:06.741913 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f4336267-43ca-4dcb-9120-3ffd0205754a req-de48d79e-5887-4507-a3a5-8e8ff8282966 service nova] Creating event network-changed:0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33 for instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 on n-h1-760456-11 Jul 20 04:42:06.749341 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f4336267-43ca-4dcb-9120-3ffd0205754a req-de48d79e-5887-4507-a3a5-8e8ff8282966 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071383 Jul 20 04:42:06.751134 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2942/5876] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:07.679653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6ef51140-fd37-4f59-8832-a6d20a6b86cc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:07.683725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:07.717594 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6ef51140-fd37-4f59-8832-a6d20a6b86cc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 1.090664 Jul 20 04:42:07.720912 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2935/5877] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:06 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:08.740451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-beaa0ef3-e3fb-44de-9987-5ddc5728a312 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:08.741716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-beaa0ef3-e3fb-44de-9987-5ddc5728a312 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:08.754844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-beaa0ef3-e3fb-44de-9987-5ddc5728a312 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:08.755602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-beaa0ef3-e3fb-44de-9987-5ddc5728a312 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:08.758367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-beaa0ef3-e3fb-44de-9987-5ddc5728a312 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:08.759593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-beaa0ef3-e3fb-44de-9987-5ddc5728a312 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:08.779587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-be251243-2de0-44a1-9204-08e2e59e9cbd req-b01b7489-9188-4780-89bd-22fe71a22235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e18f39-0d53-4bce-ac11-d565e7c0d2e1", "tag": "0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:08.793344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-be251243-2de0-44a1-9204-08e2e59e9cbd req-b01b7489-9188-4780-89bd-22fe71a22235 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:08.795138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-be251243-2de0-44a1-9204-08e2e59e9cbd req-b01b7489-9188-4780-89bd-22fe71a22235 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:08.847423 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-be251243-2de0-44a1-9204-08e2e59e9cbd req-b01b7489-9188-4780-89bd-22fe71a22235 service nova] Creating event network-changed:0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33 for instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 on n-h1-760456-11 Jul 20 04:42:08.863573 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-be251243-2de0-44a1-9204-08e2e59e9cbd req-b01b7489-9188-4780-89bd-22fe71a22235 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087360 Jul 20 04:42:08.868065 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2936/5878] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:09.750921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-beaa0ef3-e3fb-44de-9987-5ddc5728a312 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:09.784934 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-beaa0ef3-e3fb-44de-9987-5ddc5728a312 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 1.044764 Jul 20 04:42:09.803348 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2943/5879] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:08 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:10.814036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ad074820-2505-4842-b65a-d247b703cfa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:10.816513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ad074820-2505-4842-b65a-d247b703cfa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:10.835213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad074820-2505-4842-b65a-d247b703cfa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:10.840450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad074820-2505-4842-b65a-d247b703cfa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:10.842194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad074820-2505-4842-b65a-d247b703cfa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:10.848083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ad074820-2505-4842-b65a-d247b703cfa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:11.379682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ad074820-2505-4842-b65a-d247b703cfa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:11.393227 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ad074820-2505-4842-b65a-d247b703cfa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 0.587228 Jul 20 04:42:11.409067 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2937/5880] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:10 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:12.414947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-98e87855-aa98-477a-9e40-913509a8566c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:12.417660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-98e87855-aa98-477a-9e40-913509a8566c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:12.434782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98e87855-aa98-477a-9e40-913509a8566c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:12.435544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98e87855-aa98-477a-9e40-913509a8566c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:12.436590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98e87855-aa98-477a-9e40-913509a8566c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:12.437252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98e87855-aa98-477a-9e40-913509a8566c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:12.826780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-98e87855-aa98-477a-9e40-913509a8566c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:12.847655 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-98e87855-aa98-477a-9e40-913509a8566c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 0.436548 Jul 20 04:42:12.848266 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2944/5881] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:12 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:13.695345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5b0aba0b-371d-4ec5-b15e-7a1c44553cf3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Action: 'create', calling method: .version_select at 0x7fb840f28af0>, body: {"keypair": {"name": "tempest-keypair-267800987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbu8026NhIWTDn71qaF+JQ+H+HJWkQ6cJo6b94nAPS2yHuZoXNnCWB2P01GqDlpfBkLEs6xlf4wtsoU+plprAEXGbeK+sHgrBsJKf40vFxiHupXLB4pF5kmyoS298U3tg=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:13.712211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-5b0aba0b-371d-4ec5-b15e-7a1c44553cf3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Getting quotas for project 0e78752a239344cba02a2e6ed3e088f7. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:13.725055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-5b0aba0b-371d-4ec5-b15e-7a1c44553cf3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Getting quotas for user 3d81b221d0764da793a85facc04b48f0 and project 0e78752a239344cba02a2e6ed3e088f7. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:13.770837 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5b0aba0b-371d-4ec5-b15e-7a1c44553cf3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.317680 Jul 20 04:42:13.788254 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2938/5882] 10.222.0.59 () {62 vars in 1199 bytes} [Wed Jul 20 04:42:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 335 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 20 04:42:13.865771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5875acfd-172a-471e-9999-4cd28b7c506c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:13.867069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5875acfd-172a-471e-9999-4cd28b7c506c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:13.888316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5875acfd-172a-471e-9999-4cd28b7c506c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:13.888801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5875acfd-172a-471e-9999-4cd28b7c506c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:13.889807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5875acfd-172a-471e-9999-4cd28b7c506c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:13.890064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5875acfd-172a-471e-9999-4cd28b7c506c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:14.312361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5875acfd-172a-471e-9999-4cd28b7c506c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:14.343032 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5875acfd-172a-471e-9999-4cd28b7c506c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 0.472981 Jul 20 04:42:14.344327 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2945/5883] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:13 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:15.364687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cb3f48b4-c976-42d3-99ec-02e4a2d44efe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:15.366082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cb3f48b4-c976-42d3-99ec-02e4a2d44efe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:15.380237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb3f48b4-c976-42d3-99ec-02e4a2d44efe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:15.381887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb3f48b4-c976-42d3-99ec-02e4a2d44efe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:15.383983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb3f48b4-c976-42d3-99ec-02e4a2d44efe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:15.385587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb3f48b4-c976-42d3-99ec-02e4a2d44efe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:15.886850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cb3f48b4-c976-42d3-99ec-02e4a2d44efe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:15.910640 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cb3f48b4-c976-42d3-99ec-02e4a2d44efe tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 0.547969 Jul 20 04:42:15.912088 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2939/5884] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:15 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:16.473043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2136914681", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94c27959-ad93-4b8c-bd1d-184ec2f86d1a"}], "security_groups": [{"name": "tempest-securitygroup--1444352088"}], "key_name": "tempest-keypair-267800987", "user_data": "}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:16.880200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] validate_networks() for [('94c27959-ad93-4b8c-bd1d-184ec2f86d1a', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:42:16.928680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0c89d270-7aa3-4b57-8dbb-21e68a3be64a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:16.930029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0c89d270-7aa3-4b57-8dbb-21e68a3be64a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:16.946820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c89d270-7aa3-4b57-8dbb-21e68a3be64a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.947566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c89d270-7aa3-4b57-8dbb-21e68a3be64a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:16.951376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c89d270-7aa3-4b57-8dbb-21e68a3be64a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.952034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c89d270-7aa3-4b57-8dbb-21e68a3be64a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:17.395600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0c89d270-7aa3-4b57-8dbb-21e68a3be64a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:17.403824 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0c89d270-7aa3-4b57-8dbb-21e68a3be64a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 0.479375 Jul 20 04:42:17.416337 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2940/5885] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:16 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:17.631781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:42:17.632306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:42:17.633021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:42:17.633505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:42:17.633995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:42:17.658702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:17.659596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:17.661055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:17.664519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:17.714700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Getting quotas for project 0e78752a239344cba02a2e6ed3e088f7. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:17.724388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Getting quotas for user 3d81b221d0764da793a85facc04b48f0 and project 0e78752a239344cba02a2e6ed3e088f7. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:17.772819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:42:17.775787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:42:17.848839 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d8563412-f358-417f-a510-67e1df69600f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.381442 Jul 20 04:42:17.854617 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2946/5886] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:42:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:42:17.871684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-02ca4b66-7974-4f14-8c40-318e65ec25c5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:17.872421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-02ca4b66-7974-4f14-8c40-318e65ec25c5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:18.425704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9b5b8dd3-0117-468f-8075-3e49fa48f7ad tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:18.426408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9b5b8dd3-0117-468f-8075-3e49fa48f7ad tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:18.444635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b5b8dd3-0117-468f-8075-3e49fa48f7ad tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:18.445679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b5b8dd3-0117-468f-8075-3e49fa48f7ad tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:18.449028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b5b8dd3-0117-468f-8075-3e49fa48f7ad tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:18.449837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9b5b8dd3-0117-468f-8075-3e49fa48f7ad tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:18.590712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-02ca4b66-7974-4f14-8c40-318e65ec25c5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:18.599466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-02ca4b66-7974-4f14-8c40-318e65ec25c5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:18.603992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-02ca4b66-7974-4f14-8c40-318e65ec25c5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:18.611046 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-02ca4b66-7974-4f14-8c40-318e65ec25c5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1281 microversion: 2.20 time: 0.754721 Jul 20 04:42:18.613393 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2941/5887] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:17 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1281 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:18.734886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9b5b8dd3-0117-468f-8075-3e49fa48f7ad tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:18.762041 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9b5b8dd3-0117-468f-8075-3e49fa48f7ad tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 0.342274 Jul 20 04:42:18.764630 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2947/5888] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:18 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:19.632855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd7372bb-c188-458b-827b-2f7ba57640cf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:19.633477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd7372bb-c188-458b-827b-2f7ba57640cf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:19.650215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd7372bb-c188-458b-827b-2f7ba57640cf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:19.650706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd7372bb-c188-458b-827b-2f7ba57640cf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:19.651513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd7372bb-c188-458b-827b-2f7ba57640cf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:19.652097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd7372bb-c188-458b-827b-2f7ba57640cf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:19.782714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b81144f3-11bb-4df0-8664-f6ea28215e13 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:19.784122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b81144f3-11bb-4df0-8664-f6ea28215e13 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:19.799450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b81144f3-11bb-4df0-8664-f6ea28215e13 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:19.805625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b81144f3-11bb-4df0-8664-f6ea28215e13 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:19.806945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b81144f3-11bb-4df0-8664-f6ea28215e13 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:19.807599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b81144f3-11bb-4df0-8664-f6ea28215e13 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:19.846597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd7372bb-c188-458b-827b-2f7ba57640cf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:19.856391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd7372bb-c188-458b-827b-2f7ba57640cf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:19.857906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd7372bb-c188-458b-827b-2f7ba57640cf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:19.859045 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd7372bb-c188-458b-827b-2f7ba57640cf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1351 microversion: 2.20 time: 0.230332 Jul 20 04:42:19.862589 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2942/5889] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:19 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:20.150011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b81144f3-11bb-4df0-8664-f6ea28215e13 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:20.162528 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b81144f3-11bb-4df0-8664-f6ea28215e13 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 0.383585 Jul 20 04:42:20.164995 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2948/5890] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:19 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:20.885018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d29dd83-0020-4137-83a9-8fc2d04a5132 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:20.886561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9d29dd83-0020-4137-83a9-8fc2d04a5132 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:20.904373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d29dd83-0020-4137-83a9-8fc2d04a5132 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:20.904733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d29dd83-0020-4137-83a9-8fc2d04a5132 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:20.905570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d29dd83-0020-4137-83a9-8fc2d04a5132 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:20.911792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d29dd83-0020-4137-83a9-8fc2d04a5132 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.181457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7ad32051-94b9-40fd-b245-809b794074f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:21.182225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7ad32051-94b9-40fd-b245-809b794074f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:21.186963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9d29dd83-0020-4137-83a9-8fc2d04a5132 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:21.193262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ad32051-94b9-40fd-b245-809b794074f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.197734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9d29dd83-0020-4137-83a9-8fc2d04a5132 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:21.198564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ad32051-94b9-40fd-b245-809b794074f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.199741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ad32051-94b9-40fd-b245-809b794074f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.200208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ad32051-94b9-40fd-b245-809b794074f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.210548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9d29dd83-0020-4137-83a9-8fc2d04a5132 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:21.212002 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9d29dd83-0020-4137-83a9-8fc2d04a5132 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1407 microversion: 2.20 time: 0.338261 Jul 20 04:42:21.219272 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2943/5891] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:20 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:21.929243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7ad32051-94b9-40fd-b245-809b794074f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:21.947086 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7ad32051-94b9-40fd-b245-809b794074f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1169 microversion: 2.1 time: 0.768962 Jul 20 04:42:21.950170 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2949/5892] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:21 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1169 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:22.239946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-811e6efa-e541-47a7-95f4-788183df33db tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:22.240664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-811e6efa-e541-47a7-95f4-788183df33db tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:22.256300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-811e6efa-e541-47a7-95f4-788183df33db tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:22.258220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-811e6efa-e541-47a7-95f4-788183df33db tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:22.259611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-811e6efa-e541-47a7-95f4-788183df33db tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:22.260983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-811e6efa-e541-47a7-95f4-788183df33db tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:22.697074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4fd997d0-d4ba-4991-810e-eba63994c419 req-7b935ebe-1c41-4940-8099-10999ef61087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3973340-115d-4612-a266-e4403274d648", "tag": "d14f90e5-dbf1-405a-80b2-d712f8275251"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:22.718188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-811e6efa-e541-47a7-95f4-788183df33db tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:22.737298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-811e6efa-e541-47a7-95f4-788183df33db tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:22.748970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4fd997d0-d4ba-4991-810e-eba63994c419 req-7b935ebe-1c41-4940-8099-10999ef61087 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:22.749203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-811e6efa-e541-47a7-95f4-788183df33db tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:22.749434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4fd997d0-d4ba-4991-810e-eba63994c419 req-7b935ebe-1c41-4940-8099-10999ef61087 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:22.757758 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-811e6efa-e541-47a7-95f4-788183df33db tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1407 microversion: 2.20 time: 0.523981 Jul 20 04:42:22.776342 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2944/5893] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:22 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:22.816252 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4fd997d0-d4ba-4991-810e-eba63994c419 req-7b935ebe-1c41-4940-8099-10999ef61087 service nova] Creating event network-changed:d14f90e5-dbf1-405a-80b2-d712f8275251 for instance f3973340-115d-4612-a266-e4403274d648 on n-h2-760456-11 Jul 20 04:42:22.849565 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4fd997d0-d4ba-4991-810e-eba63994c419 req-7b935ebe-1c41-4940-8099-10999ef61087 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158956 Jul 20 04:42:22.855730 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2950/5894] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:22.965534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-924ba0a7-2626-4231-8131-fce0b59f6e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:22.966171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-924ba0a7-2626-4231-8131-fce0b59f6e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:22.981124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-924ba0a7-2626-4231-8131-fce0b59f6e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:22.982000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-924ba0a7-2626-4231-8131-fce0b59f6e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:22.983038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-924ba0a7-2626-4231-8131-fce0b59f6e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:22.988007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-924ba0a7-2626-4231-8131-fce0b59f6e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:23.440257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-924ba0a7-2626-4231-8131-fce0b59f6e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:23.448092 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-924ba0a7-2626-4231-8131-fce0b59f6e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1215 microversion: 2.1 time: 0.486883 Jul 20 04:42:23.448789 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2945/5895] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:22 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1215 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:23.798137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4bad9d65-325a-4027-a074-9675f2c74fbb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:23.798912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4bad9d65-325a-4027-a074-9675f2c74fbb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:23.806790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bad9d65-325a-4027-a074-9675f2c74fbb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:23.807260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bad9d65-325a-4027-a074-9675f2c74fbb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:23.808051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bad9d65-325a-4027-a074-9675f2c74fbb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:23.808500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4bad9d65-325a-4027-a074-9675f2c74fbb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:23.958929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4bad9d65-325a-4027-a074-9675f2c74fbb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:23.969972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4bad9d65-325a-4027-a074-9675f2c74fbb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:23.971954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4bad9d65-325a-4027-a074-9675f2c74fbb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:23.973365 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4bad9d65-325a-4027-a074-9675f2c74fbb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1407 microversion: 2.20 time: 0.181056 Jul 20 04:42:23.974057 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2951/5896] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:23 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:24.470187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6ea6c3b-2020-4f36-af8f-b513320cf658 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:24.471035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e6ea6c3b-2020-4f36-af8f-b513320cf658 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:24.479104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6ea6c3b-2020-4f36-af8f-b513320cf658 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:24.480515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6ea6c3b-2020-4f36-af8f-b513320cf658 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:24.481383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6ea6c3b-2020-4f36-af8f-b513320cf658 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:24.482058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6ea6c3b-2020-4f36-af8f-b513320cf658 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:24.652153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6ea6c3b-2020-4f36-af8f-b513320cf658 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:24.661676 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6ea6c3b-2020-4f36-af8f-b513320cf658 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1203 microversion: 2.1 time: 0.196858 Jul 20 04:42:24.662402 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2946/5897] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:24 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1203 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:24.993424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c882d5c2-0387-40e9-aa9e-633657b7bb6b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:24.994145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c882d5c2-0387-40e9-aa9e-633657b7bb6b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:25.002622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c882d5c2-0387-40e9-aa9e-633657b7bb6b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:25.003079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c882d5c2-0387-40e9-aa9e-633657b7bb6b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:25.004053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c882d5c2-0387-40e9-aa9e-633657b7bb6b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:25.004694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c882d5c2-0387-40e9-aa9e-633657b7bb6b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:25.172666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c882d5c2-0387-40e9-aa9e-633657b7bb6b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:25.201738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c882d5c2-0387-40e9-aa9e-633657b7bb6b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:25.206999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c882d5c2-0387-40e9-aa9e-633657b7bb6b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:25.210139 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c882d5c2-0387-40e9-aa9e-633657b7bb6b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1407 microversion: 2.20 time: 0.219734 Jul 20 04:42:25.213556 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2952/5898] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:24 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:25.679105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3695df28-97dc-4809-bece-a3029fa6b10b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:25.680497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3695df28-97dc-4809-bece-a3029fa6b10b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:25.691043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3695df28-97dc-4809-bece-a3029fa6b10b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:25.691659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3695df28-97dc-4809-bece-a3029fa6b10b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:25.699967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3695df28-97dc-4809-bece-a3029fa6b10b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:25.700379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3695df28-97dc-4809-bece-a3029fa6b10b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:26.078362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3695df28-97dc-4809-bece-a3029fa6b10b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:26.086873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3695df28-97dc-4809-bece-a3029fa6b10b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1203 microversion: 2.1 time: 0.411650 Jul 20 04:42:26.087463 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2947/5899] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:25 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1203 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:26.232327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1e476ed5-6e32-4177-be2a-af6c03775aaf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:26.233031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1e476ed5-6e32-4177-be2a-af6c03775aaf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:26.242005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e476ed5-6e32-4177-be2a-af6c03775aaf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:26.242857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e476ed5-6e32-4177-be2a-af6c03775aaf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:26.243872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e476ed5-6e32-4177-be2a-af6c03775aaf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:26.244527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e476ed5-6e32-4177-be2a-af6c03775aaf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:26.446775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1e476ed5-6e32-4177-be2a-af6c03775aaf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:26.459917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1e476ed5-6e32-4177-be2a-af6c03775aaf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:26.462448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1e476ed5-6e32-4177-be2a-af6c03775aaf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:26.464009 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1e476ed5-6e32-4177-be2a-af6c03775aaf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1407 microversion: 2.20 time: 0.236441 Jul 20 04:42:26.476262 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2953/5900] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:26 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:27.108085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2188c5bb-f48c-479d-bc08-18bf73b7282a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:27.109455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2188c5bb-f48c-479d-bc08-18bf73b7282a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:27.120020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2188c5bb-f48c-479d-bc08-18bf73b7282a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.121187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2188c5bb-f48c-479d-bc08-18bf73b7282a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.124036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2188c5bb-f48c-479d-bc08-18bf73b7282a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.125878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2188c5bb-f48c-479d-bc08-18bf73b7282a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.346579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2188c5bb-f48c-479d-bc08-18bf73b7282a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:27.365478 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2188c5bb-f48c-479d-bc08-18bf73b7282a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1203 microversion: 2.1 time: 0.264089 Jul 20 04:42:27.366453 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2948/5901] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:27 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1203 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:27.487993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3298732c-7b4c-4778-97a4-4e9c01ffb405 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:27.488621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3298732c-7b4c-4778-97a4-4e9c01ffb405 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:27.497258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3298732c-7b4c-4778-97a4-4e9c01ffb405 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.498205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3298732c-7b4c-4778-97a4-4e9c01ffb405 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.499051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3298732c-7b4c-4778-97a4-4e9c01ffb405 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.499709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3298732c-7b4c-4778-97a4-4e9c01ffb405 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.681707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3298732c-7b4c-4778-97a4-4e9c01ffb405 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:27.689177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:27.700428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3298732c-7b4c-4778-97a4-4e9c01ffb405 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:27.703931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3298732c-7b4c-4778-97a4-4e9c01ffb405 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:27.707058 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3298732c-7b4c-4778-97a4-4e9c01ffb405 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1407 microversion: 2.20 time: 0.225255 Jul 20 04:42:27.708687 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2954/5902] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:27 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:28.391445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6508e282-0f3d-4844-b337-19915546ffd0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:28.393550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6508e282-0f3d-4844-b337-19915546ffd0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:28.402911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6508e282-0f3d-4844-b337-19915546ffd0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.403862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6508e282-0f3d-4844-b337-19915546ffd0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.404376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6508e282-0f3d-4844-b337-19915546ffd0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.404985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6508e282-0f3d-4844-b337-19915546ffd0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.553506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-074f3055-899b-4f32-8ab8-63836b64a193 req-b1cdad2e-9044-4424-b472-4957f5a33db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3973340-115d-4612-a266-e4403274d648", "name": "network-vif-plugged", "status": "completed", "tag": "d14f90e5-dbf1-405a-80b2-d712f8275251"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:28.572858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:28.577610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-074f3055-899b-4f32-8ab8-63836b64a193 req-b1cdad2e-9044-4424-b472-4957f5a33db1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.583607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-074f3055-899b-4f32-8ab8-63836b64a193 req-b1cdad2e-9044-4424-b472-4957f5a33db1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.598479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:28.613692 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-074f3055-899b-4f32-8ab8-63836b64a193 req-b1cdad2e-9044-4424-b472-4957f5a33db1 service nova] Creating event network-vif-plugged:d14f90e5-dbf1-405a-80b2-d712f8275251 for instance f3973340-115d-4612-a266-e4403274d648 on n-h2-760456-11 Jul 20 04:42:28.621244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6508e282-0f3d-4844-b337-19915546ffd0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:28.632844 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-074f3055-899b-4f32-8ab8-63836b64a193 req-b1cdad2e-9044-4424-b472-4957f5a33db1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083774 Jul 20 04:42:28.634817 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2955/5903] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:28.651804 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6508e282-0f3d-4844-b337-19915546ffd0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1203 microversion: 2.1 time: 0.267321 Jul 20 04:42:28.657552 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2949/5904] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:28 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1203 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:28.727517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6250cb65-a8c6-4923-9bfe-5e5068587c30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:28.728307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6250cb65-a8c6-4923-9bfe-5e5068587c30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:28.740299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6250cb65-a8c6-4923-9bfe-5e5068587c30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.740768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6250cb65-a8c6-4923-9bfe-5e5068587c30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.741622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6250cb65-a8c6-4923-9bfe-5e5068587c30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.742022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6250cb65-a8c6-4923-9bfe-5e5068587c30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.310996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6250cb65-a8c6-4923-9bfe-5e5068587c30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:29.320066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6250cb65-a8c6-4923-9bfe-5e5068587c30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:29.321874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6250cb65-a8c6-4923-9bfe-5e5068587c30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:29.323145 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6250cb65-a8c6-4923-9bfe-5e5068587c30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1407 microversion: 2.20 time: 0.600070 Jul 20 04:42:29.324103 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2956/5905] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:28 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1407 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:29.456000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75bff9c0-992a-4e3f-976f-4cf6689a49f5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f176cb0-064a-44fa-8084-13c4bc960f07"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:29.457482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-75bff9c0-992a-4e3f-976f-4cf6689a49f5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.465915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75bff9c0-992a-4e3f-976f-4cf6689a49f5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.467741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75bff9c0-992a-4e3f-976f-4cf6689a49f5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.469225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75bff9c0-992a-4e3f-976f-4cf6689a49f5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.469959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75bff9c0-992a-4e3f-976f-4cf6689a49f5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.676728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0fca5486-7cbb-4731-856d-79243c97d49f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:29.678461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0fca5486-7cbb-4731-856d-79243c97d49f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.689679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fca5486-7cbb-4731-856d-79243c97d49f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.690593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fca5486-7cbb-4731-856d-79243c97d49f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.691676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fca5486-7cbb-4731-856d-79243c97d49f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.693286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0fca5486-7cbb-4731-856d-79243c97d49f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.799147 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75bff9c0-992a-4e3f-976f-4cf6689a49f5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349027 Jul 20 04:42:29.800193 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2950/5906] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:42:29 2022] POST /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:29.883387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0fca5486-7cbb-4731-856d-79243c97d49f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:29.891154 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0fca5486-7cbb-4731-856d-79243c97d49f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1203 microversion: 2.1 time: 0.222840 Jul 20 04:42:29.891860 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2957/5907] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:29 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1203 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:30.345078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-415fa02e-1010-4698-9528-ee3fda2dd6cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:30.346056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-415fa02e-1010-4698-9528-ee3fda2dd6cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:30.366702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-415fa02e-1010-4698-9528-ee3fda2dd6cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.370319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-415fa02e-1010-4698-9528-ee3fda2dd6cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.379836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-415fa02e-1010-4698-9528-ee3fda2dd6cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.380482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-415fa02e-1010-4698-9528-ee3fda2dd6cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.784495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-415fa02e-1010-4698-9528-ee3fda2dd6cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:30.798985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-415fa02e-1010-4698-9528-ee3fda2dd6cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:30.800554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-415fa02e-1010-4698-9528-ee3fda2dd6cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:30.801713 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-415fa02e-1010-4698-9528-ee3fda2dd6cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1407 microversion: 2.20 time: 0.463175 Jul 20 04:42:30.802309 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2951/5908] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:30 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:30.909253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0057194-4340-4c00-9402-8aa20daa8faa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:30.909950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0057194-4340-4c00-9402-8aa20daa8faa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:30.920135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:30.924147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0057194-4340-4c00-9402-8aa20daa8faa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.925549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0057194-4340-4c00-9402-8aa20daa8faa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.929446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0057194-4340-4c00-9402-8aa20daa8faa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.930193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0057194-4340-4c00-9402-8aa20daa8faa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:31.118241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a0057194-4340-4c00-9402-8aa20daa8faa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:31.134839 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0057194-4340-4c00-9402-8aa20daa8faa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1203 microversion: 2.1 time: 0.227331 Jul 20 04:42:31.146106 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2958/5909] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:30 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1203 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:31.821261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e2a18cfe-b057-4fe6-b843-59e578d9a3ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:31.822655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e2a18cfe-b057-4fe6-b843-59e578d9a3ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:31.831434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2a18cfe-b057-4fe6-b843-59e578d9a3ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:31.832267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2a18cfe-b057-4fe6-b843-59e578d9a3ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:31.833313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2a18cfe-b057-4fe6-b843-59e578d9a3ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:31.834012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e2a18cfe-b057-4fe6-b843-59e578d9a3ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.154159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f99b48fe-04a1-450c-ad4f-48681d21e077 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:32.156509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f99b48fe-04a1-450c-ad4f-48681d21e077 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:32.167475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f99b48fe-04a1-450c-ad4f-48681d21e077 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.168492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f99b48fe-04a1-450c-ad4f-48681d21e077 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.170390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f99b48fe-04a1-450c-ad4f-48681d21e077 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.172100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f99b48fe-04a1-450c-ad4f-48681d21e077 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.341950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e2a18cfe-b057-4fe6-b843-59e578d9a3ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:32.355561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e2a18cfe-b057-4fe6-b843-59e578d9a3ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:32.367960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e2a18cfe-b057-4fe6-b843-59e578d9a3ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:32.373183 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e2a18cfe-b057-4fe6-b843-59e578d9a3ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1599 microversion: 2.20 time: 0.557306 Jul 20 04:42:32.388411 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2952/5910] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:42:31 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1599 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:42:32.399759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-694e3ca9-e660-4700-91ec-78e37d2a4d81 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:32.401758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-694e3ca9-e660-4700-91ec-78e37d2a4d81 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:32.407861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f99b48fe-04a1-450c-ad4f-48681d21e077 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:32.411184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-694e3ca9-e660-4700-91ec-78e37d2a4d81 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.412374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-694e3ca9-e660-4700-91ec-78e37d2a4d81 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.414068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-694e3ca9-e660-4700-91ec-78e37d2a4d81 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.414868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-694e3ca9-e660-4700-91ec-78e37d2a4d81 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.416151 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f99b48fe-04a1-450c-ad4f-48681d21e077 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1203 microversion: 2.1 time: 0.267480 Jul 20 04:42:32.416751 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2959/5911] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:32 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1203 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:32.538188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9e93ed47-ae38-4169-b82b-3563ae8648fa req-dc98f4ba-4fa9-43be-bd4a-7f28dee00ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c82c28f-fe29-4596-86dc-f9f23daf37b7", "name": "network-vif-plugged", "status": "completed", "tag": "17f155c4-5448-4e24-98c5-e8465523f729"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:32.564064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9e93ed47-ae38-4169-b82b-3563ae8648fa req-dc98f4ba-4fa9-43be-bd4a-7f28dee00ba0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.564536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9e93ed47-ae38-4169-b82b-3563ae8648fa req-dc98f4ba-4fa9-43be-bd4a-7f28dee00ba0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.572506 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-694e3ca9-e660-4700-91ec-78e37d2a4d81 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.181053 Jul 20 04:42:32.573591 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2953/5912] 10.222.0.59 () {60 vars in 1315 bytes} [Wed Jul 20 04:42:32 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:42:32.607022 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9e93ed47-ae38-4169-b82b-3563ae8648fa req-dc98f4ba-4fa9-43be-bd4a-7f28dee00ba0 service nova] Creating event network-vif-plugged:17f155c4-5448-4e24-98c5-e8465523f729 for instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 on n-h1-760456-11 Jul 20 04:42:32.615790 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9e93ed47-ae38-4169-b82b-3563ae8648fa req-dc98f4ba-4fa9-43be-bd4a-7f28dee00ba0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081355 Jul 20 04:42:32.619095 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2960/5913] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:33.435692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c32e5782-0585-49bc-b50a-a9c87b78e496 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:33.436513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c32e5782-0585-49bc-b50a-a9c87b78e496 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:33.450928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c32e5782-0585-49bc-b50a-a9c87b78e496 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.451907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c32e5782-0585-49bc-b50a-a9c87b78e496 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.454322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c32e5782-0585-49bc-b50a-a9c87b78e496 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:33.456553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c32e5782-0585-49bc-b50a-a9c87b78e496 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.463844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:33.800646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c32e5782-0585-49bc-b50a-a9c87b78e496 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:33.809231 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c32e5782-0585-49bc-b50a-a9c87b78e496 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1203 microversion: 2.1 time: 0.379302 Jul 20 04:42:33.815127 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2954/5914] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:33 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1203 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:34.169095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f439a513-d628-402b-bd68-09f704d96911 req-e778b625-b49e-401c-bec7-f2cb2cf34c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3973340-115d-4612-a266-e4403274d648", "tag": "d14f90e5-dbf1-405a-80b2-d712f8275251"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:34.191686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f439a513-d628-402b-bd68-09f704d96911 req-e778b625-b49e-401c-bec7-f2cb2cf34c77 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.192462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f439a513-d628-402b-bd68-09f704d96911 req-e778b625-b49e-401c-bec7-f2cb2cf34c77 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.212647 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f439a513-d628-402b-bd68-09f704d96911 req-e778b625-b49e-401c-bec7-f2cb2cf34c77 service nova] Creating event network-changed:d14f90e5-dbf1-405a-80b2-d712f8275251 for instance f3973340-115d-4612-a266-e4403274d648 on n-h2-760456-11 Jul 20 04:42:34.225490 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f439a513-d628-402b-bd68-09f704d96911 req-e778b625-b49e-401c-bec7-f2cb2cf34c77 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075050 Jul 20 04:42:34.234364 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2961/5915] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:34.830130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b3b89d46-2dbd-476d-88dd-ecf12606a36e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:34.831040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b3b89d46-2dbd-476d-88dd-ecf12606a36e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:34.848008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3b89d46-2dbd-476d-88dd-ecf12606a36e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.848773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3b89d46-2dbd-476d-88dd-ecf12606a36e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.849822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3b89d46-2dbd-476d-88dd-ecf12606a36e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.850538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b3b89d46-2dbd-476d-88dd-ecf12606a36e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.268642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b3b89d46-2dbd-476d-88dd-ecf12606a36e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:35.276332 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b3b89d46-2dbd-476d-88dd-ecf12606a36e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1390 microversion: 2.1 time: 0.450945 Jul 20 04:42:35.277657 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2955/5916] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:34 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1390 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:35.295842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bea4d77a-aace-48a1-8e9c-b792be1035c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.297588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bea4d77a-aace-48a1-8e9c-b792be1035c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:35.320776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bea4d77a-aace-48a1-8e9c-b792be1035c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.321519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bea4d77a-aace-48a1-8e9c-b792be1035c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.322685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bea4d77a-aace-48a1-8e9c-b792be1035c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.323448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bea4d77a-aace-48a1-8e9c-b792be1035c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.330218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:35.508607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bea4d77a-aace-48a1-8e9c-b792be1035c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:35.520756 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bea4d77a-aace-48a1-8e9c-b792be1035c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1390 microversion: 2.1 time: 0.230805 Jul 20 04:42:35.522064 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2962/5917] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1390 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:35.538294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3a4ad67-cb93-4bf7-b5ca-dfbf0bd4776a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.538920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d3a4ad67-cb93-4bf7-b5ca-dfbf0bd4776a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:35.548387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3a4ad67-cb93-4bf7-b5ca-dfbf0bd4776a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.549162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3a4ad67-cb93-4bf7-b5ca-dfbf0bd4776a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.550365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3a4ad67-cb93-4bf7-b5ca-dfbf0bd4776a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.551645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3a4ad67-cb93-4bf7-b5ca-dfbf0bd4776a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.822483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d3a4ad67-cb93-4bf7-b5ca-dfbf0bd4776a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:35.837236 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d3a4ad67-cb93-4bf7-b5ca-dfbf0bd4776a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1390 microversion: 2.1 time: 0.302569 Jul 20 04:42:35.838302 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2956/5918] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1390 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:35.920534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3671b303-969f-4350-8f7a-f1db354ada63 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.921412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3671b303-969f-4350-8f7a-f1db354ada63 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:35.928843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3671b303-969f-4350-8f7a-f1db354ada63 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.929480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3671b303-969f-4350-8f7a-f1db354ada63 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.930462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3671b303-969f-4350-8f7a-f1db354ada63 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.931077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3671b303-969f-4350-8f7a-f1db354ada63 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.963562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3671b303-969f-4350-8f7a-f1db354ada63 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:42:36.086859 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3671b303-969f-4350-8f7a-f1db354ada63 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 204 len: 0 microversion: 2.1 time: 0.169799 Jul 20 04:42:36.092342 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2963/5919] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:35 2022] DELETE /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:42:36.099400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a9d5ae5e-6c7e-4247-b2e5-00b040c27b0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.100727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a9d5ae5e-6c7e-4247-b2e5-00b040c27b0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.115523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9d5ae5e-6c7e-4247-b2e5-00b040c27b0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.116083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9d5ae5e-6c7e-4247-b2e5-00b040c27b0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.119424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9d5ae5e-6c7e-4247-b2e5-00b040c27b0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.126359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9d5ae5e-6c7e-4247-b2e5-00b040c27b0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.419128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a9d5ae5e-6c7e-4247-b2e5-00b040c27b0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:36.430222 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a9d5ae5e-6c7e-4247-b2e5-00b040c27b0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1396 microversion: 2.1 time: 0.336236 Jul 20 04:42:36.431918 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2957/5920] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:36 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1396 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:37.235737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f1e1d665-ec93-493b-bda1-eadc040ff729 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:37.236334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f1e1d665-ec93-493b-bda1-eadc040ff729 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.243915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a9a94ffc-7e05-42d8-8e5d-dd5d878fef74 req-e1b57710-0fe2-4f82-a0c6-e25f5cc8a41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e18f39-0d53-4bce-ac11-d565e7c0d2e1", "tag": "0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:37.245521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1e1d665-ec93-493b-bda1-eadc040ff729 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.246217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1e1d665-ec93-493b-bda1-eadc040ff729 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.247154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1e1d665-ec93-493b-bda1-eadc040ff729 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.247876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1e1d665-ec93-493b-bda1-eadc040ff729 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.253437 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:37.271136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a9a94ffc-7e05-42d8-8e5d-dd5d878fef74 req-e1b57710-0fe2-4f82-a0c6-e25f5cc8a41c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.271992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a9a94ffc-7e05-42d8-8e5d-dd5d878fef74 req-e1b57710-0fe2-4f82-a0c6-e25f5cc8a41c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.286867 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a9a94ffc-7e05-42d8-8e5d-dd5d878fef74 req-e1b57710-0fe2-4f82-a0c6-e25f5cc8a41c service nova] Creating event network-changed:0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33 for instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 on n-h1-760456-11 Jul 20 04:42:37.293877 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a9a94ffc-7e05-42d8-8e5d-dd5d878fef74 req-e1b57710-0fe2-4f82-a0c6-e25f5cc8a41c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055272 Jul 20 04:42:37.294832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f1e1d665-ec93-493b-bda1-eadc040ff729 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:42:37.295208 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2958/5921] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:37.430311 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f1e1d665-ec93-493b-bda1-eadc040ff729 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 204 len: 0 microversion: 2.1 time: 0.199004 Jul 20 04:42:37.430311 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2964/5922] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:37 2022] DELETE /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:42:37.443151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-893a32bf-c1a4-4954-bce1-9d27760050c1 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:37.443151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-893a32bf-c1a4-4954-bce1-9d27760050c1 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.450186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28226788-e7ff-46de-b162-4b5ca2374ceb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:37.451037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-28226788-e7ff-46de-b162-4b5ca2374ceb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.452396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-893a32bf-c1a4-4954-bce1-9d27760050c1 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.453026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-893a32bf-c1a4-4954-bce1-9d27760050c1 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.456064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-893a32bf-c1a4-4954-bce1-9d27760050c1 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.459182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28226788-e7ff-46de-b162-4b5ca2374ceb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.459314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-893a32bf-c1a4-4954-bce1-9d27760050c1 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.459664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28226788-e7ff-46de-b162-4b5ca2374ceb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.460471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28226788-e7ff-46de-b162-4b5ca2374ceb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.460927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28226788-e7ff-46de-b162-4b5ca2374ceb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.743735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-28226788-e7ff-46de-b162-4b5ca2374ceb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:37.753389 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-28226788-e7ff-46de-b162-4b5ca2374ceb tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1396 microversion: 2.1 time: 0.307614 Jul 20 04:42:37.757418 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2965/5923] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:37 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1396 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:37.798705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-893a32bf-c1a4-4954-bce1-9d27760050c1 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:37.807823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-893a32bf-c1a4-4954-bce1-9d27760050c1 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1583 microversion: 2.1 time: 0.370737 Jul 20 04:42:37.809045 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2959/5924] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:37 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1583 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:38.775394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9ae00740-4660-42de-82ab-946f4307ba0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:38.775940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9ae00740-4660-42de-82ab-946f4307ba0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:38.785213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ae00740-4660-42de-82ab-946f4307ba0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:38.790065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ae00740-4660-42de-82ab-946f4307ba0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:38.790964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ae00740-4660-42de-82ab-946f4307ba0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:38.797183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9ae00740-4660-42de-82ab-946f4307ba0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:38.828156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-47d1534b-692f-4514-bbb2-0d645a1c1e12 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:38.829025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-47d1534b-692f-4514-bbb2-0d645a1c1e12 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:38.838562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47d1534b-692f-4514-bbb2-0d645a1c1e12 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:38.841278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47d1534b-692f-4514-bbb2-0d645a1c1e12 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:38.844449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47d1534b-692f-4514-bbb2-0d645a1c1e12 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:38.845144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47d1534b-692f-4514-bbb2-0d645a1c1e12 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.088765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9ae00740-4660-42de-82ab-946f4307ba0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:39.099648 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9ae00740-4660-42de-82ab-946f4307ba0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1396 microversion: 2.1 time: 0.327996 Jul 20 04:42:39.102321 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2966/5925] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:38 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1396 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:39.197516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-47d1534b-692f-4514-bbb2-0d645a1c1e12 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:39.212398 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-47d1534b-692f-4514-bbb2-0d645a1c1e12 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1583 microversion: 2.1 time: 0.389391 Jul 20 04:42:39.213036 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2960/5926] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:38 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1583 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:39.410716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-fd85d3c2-4467-449b-a09b-c0f6e2f090c4 req-d996084a-c7f4-4054-86ce-2dac2fbb9680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c82c28f-fe29-4596-86dc-f9f23daf37b7", "name": "network-vif-deleted", "tag": "17f155c4-5448-4e24-98c5-e8465523f729"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:39.422666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fd85d3c2-4467-449b-a09b-c0f6e2f090c4 req-d996084a-c7f4-4054-86ce-2dac2fbb9680 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.423127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fd85d3c2-4467-449b-a09b-c0f6e2f090c4 req-d996084a-c7f4-4054-86ce-2dac2fbb9680 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.439133 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-fd85d3c2-4467-449b-a09b-c0f6e2f090c4 req-d996084a-c7f4-4054-86ce-2dac2fbb9680 service nova] Creating event network-vif-deleted:17f155c4-5448-4e24-98c5-e8465523f729 for instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 on n-h1-760456-11 Jul 20 04:42:39.446440 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-fd85d3c2-4467-449b-a09b-c0f6e2f090c4 req-d996084a-c7f4-4054-86ce-2dac2fbb9680 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040982 Jul 20 04:42:39.451371 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2967/5927] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:39.865834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-49fb8edc-0a2d-4705-ab3c-349487bb91e1 req-da22c96e-eea7-4303-9a63-aeb4c21d05ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e18f39-0d53-4bce-ac11-d565e7c0d2e1", "name": "network-vif-deleted", "tag": "0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:39.897014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-49fb8edc-0a2d-4705-ab3c-349487bb91e1 req-da22c96e-eea7-4303-9a63-aeb4c21d05ea service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.897844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-49fb8edc-0a2d-4705-ab3c-349487bb91e1 req-da22c96e-eea7-4303-9a63-aeb4c21d05ea service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.915187 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-49fb8edc-0a2d-4705-ab3c-349487bb91e1 req-da22c96e-eea7-4303-9a63-aeb4c21d05ea service nova] Creating event network-vif-deleted:0a1357aa-e85f-4a28-a5fa-f5d6fd4d8b33 for instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 on n-h1-760456-11 Jul 20 04:42:39.931979 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-49fb8edc-0a2d-4705-ab3c-349487bb91e1 req-da22c96e-eea7-4303-9a63-aeb4c21d05ea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060483 Jul 20 04:42:39.942197 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2961/5928] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:40.120136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bfbcdd92-1405-4eca-85ec-22d0733018c0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:40.121492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bfbcdd92-1405-4eca-85ec-22d0733018c0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:40.136634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfbcdd92-1405-4eca-85ec-22d0733018c0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.137380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfbcdd92-1405-4eca-85ec-22d0733018c0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.138474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfbcdd92-1405-4eca-85ec-22d0733018c0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.139101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfbcdd92-1405-4eca-85ec-22d0733018c0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.231024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bfbcdd92-1405-4eca-85ec-22d0733018c0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:40.231679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-60654a91-8151-4faf-9b0e-725a10358a00 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:40.232472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-60654a91-8151-4faf-9b0e-725a10358a00 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:40.241902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bfbcdd92-1405-4eca-85ec-22d0733018c0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1188 microversion: 2.1 time: 0.126399 Jul 20 04:42:40.243879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60654a91-8151-4faf-9b0e-725a10358a00 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.245246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60654a91-8151-4faf-9b0e-725a10358a00 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.246793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60654a91-8151-4faf-9b0e-725a10358a00 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.247767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60654a91-8151-4faf-9b0e-725a10358a00 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.253340 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2968/5929] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:40 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1188 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:40.335993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-60654a91-8151-4faf-9b0e-725a10358a00 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:40.345591 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-60654a91-8151-4faf-9b0e-725a10358a00 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1229 microversion: 2.1 time: 0.118278 Jul 20 04:42:40.346911 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2962/5930] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:40 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1229 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:41.261596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5bd9cad4-ae2d-4b53-8308-5ecb2049d7bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:41.263523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5bd9cad4-ae2d-4b53-8308-5ecb2049d7bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:41.271838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5bd9cad4-ae2d-4b53-8308-5ecb2049d7bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.272867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5bd9cad4-ae2d-4b53-8308-5ecb2049d7bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:41.274122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5bd9cad4-ae2d-4b53-8308-5ecb2049d7bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.274733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5bd9cad4-ae2d-4b53-8308-5ecb2049d7bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:41.347373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5bd9cad4-ae2d-4b53-8308-5ecb2049d7bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:41.355911 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5bd9cad4-ae2d-4b53-8308-5ecb2049d7bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1188 microversion: 2.1 time: 0.099808 Jul 20 04:42:41.356599 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2969/5931] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:41 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1188 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:41.363513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5c09c2fc-a0c4-45e5-8e4a-33f851589873 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:41.364843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5c09c2fc-a0c4-45e5-8e4a-33f851589873 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:41.372307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c09c2fc-a0c4-45e5-8e4a-33f851589873 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.373132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c09c2fc-a0c4-45e5-8e4a-33f851589873 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:41.374300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c09c2fc-a0c4-45e5-8e4a-33f851589873 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:41.375193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c09c2fc-a0c4-45e5-8e4a-33f851589873 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:41.446878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5c09c2fc-a0c4-45e5-8e4a-33f851589873 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:41.455715 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5c09c2fc-a0c4-45e5-8e4a-33f851589873 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1229 microversion: 2.1 time: 0.096627 Jul 20 04:42:41.456310 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2963/5932] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:41 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:42.374883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bfa169e1-396b-461f-952e-5f57e4575ebd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:42.375519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bfa169e1-396b-461f-952e-5f57e4575ebd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:42.384047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfa169e1-396b-461f-952e-5f57e4575ebd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.384751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfa169e1-396b-461f-952e-5f57e4575ebd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.385702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfa169e1-396b-461f-952e-5f57e4575ebd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.386345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bfa169e1-396b-461f-952e-5f57e4575ebd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.472412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4716ecfe-60e9-4c4b-9aef-0337e93b9e75 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:42.473036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4716ecfe-60e9-4c4b-9aef-0337e93b9e75 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:42.481470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4716ecfe-60e9-4c4b-9aef-0337e93b9e75 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.482093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4716ecfe-60e9-4c4b-9aef-0337e93b9e75 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.483074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4716ecfe-60e9-4c4b-9aef-0337e93b9e75 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.483926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4716ecfe-60e9-4c4b-9aef-0337e93b9e75 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.485514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bfa169e1-396b-461f-952e-5f57e4575ebd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:42.498140 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bfa169e1-396b-461f-952e-5f57e4575ebd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1188 microversion: 2.1 time: 0.128123 Jul 20 04:42:42.499547 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2970/5933] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:42 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1188 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:42.852627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4716ecfe-60e9-4c4b-9aef-0337e93b9e75 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:42.865399 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4716ecfe-60e9-4c4b-9aef-0337e93b9e75 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1229 microversion: 2.1 time: 0.397489 Jul 20 04:42:42.865991 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2964/5934] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:42 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1229 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:43.517500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-781454d5-687a-456f-a280-28fe105f571d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:43.518170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-781454d5-687a-456f-a280-28fe105f571d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:43.524952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-781454d5-687a-456f-a280-28fe105f571d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:43.525411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-781454d5-687a-456f-a280-28fe105f571d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:43.526408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-781454d5-687a-456f-a280-28fe105f571d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:43.527030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-781454d5-687a-456f-a280-28fe105f571d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:43.596103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-781454d5-687a-456f-a280-28fe105f571d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:43.605609 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-781454d5-687a-456f-a280-28fe105f571d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1188 microversion: 2.1 time: 0.093359 Jul 20 04:42:43.606206 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2971/5935] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:43 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:43.883471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01ed4cbc-f3c7-46aa-8d99-ab43d580fa04 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:43.884234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-01ed4cbc-f3c7-46aa-8d99-ab43d580fa04 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:43.894682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01ed4cbc-f3c7-46aa-8d99-ab43d580fa04 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:43.895291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01ed4cbc-f3c7-46aa-8d99-ab43d580fa04 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:43.896205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01ed4cbc-f3c7-46aa-8d99-ab43d580fa04 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:43.896738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01ed4cbc-f3c7-46aa-8d99-ab43d580fa04 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:43.966467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-01ed4cbc-f3c7-46aa-8d99-ab43d580fa04 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:43.974960 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01ed4cbc-f3c7-46aa-8d99-ab43d580fa04 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1229 microversion: 2.1 time: 0.095582 Jul 20 04:42:43.975540 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2965/5936] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:43 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:44.626447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:44.627719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:44.637326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:44.638093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:44.639112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:44.641868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:44.702985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:44.703498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:44.703977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lazy-loading 'fault' on Instance uuid 2c82c28f-fe29-4596-86dc-f9f23daf37b7 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:42:44.766473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:44.774973 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fe018d4f-d0f7-4aeb-9631-334802ca6123 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 200 len: 1147 microversion: 2.1 time: 0.155313 Jul 20 04:42:44.775699 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2972/5937] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:44 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 1147 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:44.992148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-14905faf-e583-4ad3-b0f7-915e738de67c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:44.992909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-14905faf-e583-4ad3-b0f7-915e738de67c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:45.000664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14905faf-e583-4ad3-b0f7-915e738de67c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.001248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14905faf-e583-4ad3-b0f7-915e738de67c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.002131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14905faf-e583-4ad3-b0f7-915e738de67c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.002718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14905faf-e583-4ad3-b0f7-915e738de67c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.101200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-14905faf-e583-4ad3-b0f7-915e738de67c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:45.110415 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-14905faf-e583-4ad3-b0f7-915e738de67c tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1229 microversion: 2.1 time: 0.122213 Jul 20 04:42:45.111307 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2966/5938] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:44 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1229 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:45.267896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6315245d-73b1-4302-a4ba-08c405015638 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:45.269026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6315245d-73b1-4302-a4ba-08c405015638 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:45.276686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6315245d-73b1-4302-a4ba-08c405015638 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.277238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6315245d-73b1-4302-a4ba-08c405015638 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.278045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6315245d-73b1-4302-a4ba-08c405015638 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.278519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6315245d-73b1-4302-a4ba-08c405015638 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.304226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-6315245d-73b1-4302-a4ba-08c405015638 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lazy-loading 'flavor' on Instance uuid 24e8ea2f-7c9f-4424-b7af-065fc4225a98 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:42:45.439208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:45.451132 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6315245d-73b1-4302-a4ba-08c405015638 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/action" status: 200 len: 32 microversion: 2.1 time: 0.187863 Jul 20 04:42:45.451757 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2973/5939] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:42:45 2022] POST /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:42:45.462305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1666bef9-a5dc-4e7d-9bf7-106ce2fce63c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:45.462751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1666bef9-a5dc-4e7d-9bf7-106ce2fce63c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:45.472437 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1666bef9-a5dc-4e7d-9bf7-106ce2fce63c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.473610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1666bef9-a5dc-4e7d-9bf7-106ce2fce63c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.474788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1666bef9-a5dc-4e7d-9bf7-106ce2fce63c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.475701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1666bef9-a5dc-4e7d-9bf7-106ce2fce63c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.641352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1666bef9-a5dc-4e7d-9bf7-106ce2fce63c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:45.657015 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1666bef9-a5dc-4e7d-9bf7-106ce2fce63c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1734 microversion: 2.1 time: 0.199080 Jul 20 04:42:45.662322 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2967/5940] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:45 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:45.796970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aa7ccbaf-8b7d-4522-a8da-8b710be9527f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:45.797940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aa7ccbaf-8b7d-4522-a8da-8b710be9527f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:45.807132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa7ccbaf-8b7d-4522-a8da-8b710be9527f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.808068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa7ccbaf-8b7d-4522-a8da-8b710be9527f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.808960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa7ccbaf-8b7d-4522-a8da-8b710be9527f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:45.809718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa7ccbaf-8b7d-4522-a8da-8b710be9527f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:45.841422 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-aa7ccbaf-8b7d-4522-a8da-8b710be9527f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aa7ccbaf-8b7d-4522-a8da-8b710be9527f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 HTTP/1.1 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '2c82c28f-fe29-4596-86dc-f9f23daf37b7'} Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:45.844804 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:45.852444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:45.852444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:45.852444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:45.852444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:45.852444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:45.852444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:45.852444 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:45.857508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aa7ccbaf-8b7d-4522-a8da-8b710be9527f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:45.857508 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aa7ccbaf-8b7d-4522-a8da-8b710be9527f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 404 len: 111 microversion: 2.1 time: 0.066732 Jul 20 04:42:45.858007 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2974/5941] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:45 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:46.133696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c1b8ee1-34d3-4de2-b795-0ddb1a5b2fe6 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:46.134351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c1b8ee1-34d3-4de2-b795-0ddb1a5b2fe6 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:46.142741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c1b8ee1-34d3-4de2-b795-0ddb1a5b2fe6 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.144839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c1b8ee1-34d3-4de2-b795-0ddb1a5b2fe6 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.146906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c1b8ee1-34d3-4de2-b795-0ddb1a5b2fe6 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.147640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c1b8ee1-34d3-4de2-b795-0ddb1a5b2fe6 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.241443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c1b8ee1-34d3-4de2-b795-0ddb1a5b2fe6 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:46.252428 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c1b8ee1-34d3-4de2-b795-0ddb1a5b2fe6 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1229 microversion: 2.1 time: 0.127924 Jul 20 04:42:46.262686 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2968/5942] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:46 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1229 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:46.676077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d96ef051-9409-4ffc-b4d7-46a291db031f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:46.676708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d96ef051-9409-4ffc-b4d7-46a291db031f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:46.684010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d96ef051-9409-4ffc-b4d7-46a291db031f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.684621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d96ef051-9409-4ffc-b4d7-46a291db031f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:46.685563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d96ef051-9409-4ffc-b4d7-46a291db031f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:46.686797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d96ef051-9409-4ffc-b4d7-46a291db031f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:47.139686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d96ef051-9409-4ffc-b4d7-46a291db031f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:47.171854 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d96ef051-9409-4ffc-b4d7-46a291db031f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1734 microversion: 2.1 time: 0.500186 Jul 20 04:42:47.180744 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2975/5943] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:46 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1734 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:47.273092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e51331c-8dfe-4bd0-b2aa-0af0927d04f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:47.275880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6e51331c-8dfe-4bd0-b2aa-0af0927d04f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:47.289678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e51331c-8dfe-4bd0-b2aa-0af0927d04f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:47.290540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e51331c-8dfe-4bd0-b2aa-0af0927d04f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:47.291835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e51331c-8dfe-4bd0-b2aa-0af0927d04f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:47.292674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e51331c-8dfe-4bd0-b2aa-0af0927d04f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:47.380889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6e51331c-8dfe-4bd0-b2aa-0af0927d04f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:47.393198 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6e51331c-8dfe-4bd0-b2aa-0af0927d04f5 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1229 microversion: 2.1 time: 0.127619 Jul 20 04:42:47.394142 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2969/5944] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:47 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:48.214428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5e66f71-908c-426f-af12-cd4a14ac7d98 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:48.215775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5e66f71-908c-426f-af12-cd4a14ac7d98 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:48.227821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5e66f71-908c-426f-af12-cd4a14ac7d98 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.228289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5e66f71-908c-426f-af12-cd4a14ac7d98 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.229094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5e66f71-908c-426f-af12-cd4a14ac7d98 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.229546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5e66f71-908c-426f-af12-cd4a14ac7d98 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.411931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-12865a80-5996-41e0-a870-c3236907063f tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:48.413603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-12865a80-5996-41e0-a870-c3236907063f tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:48.425940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12865a80-5996-41e0-a870-c3236907063f tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.426756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12865a80-5996-41e0-a870-c3236907063f tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.427734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12865a80-5996-41e0-a870-c3236907063f tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:48.429118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12865a80-5996-41e0-a870-c3236907063f tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:48.493249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a5e66f71-908c-426f-af12-cd4a14ac7d98 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:48.504288 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5e66f71-908c-426f-af12-cd4a14ac7d98 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1734 microversion: 2.1 time: 0.310472 Jul 20 04:42:48.505643 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2976/5945] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:48 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1734 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:48.519724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-12865a80-5996-41e0-a870-c3236907063f tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e47ca5f7f64b71b659170ca6f5ca20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33d3b51854654bae6889ed2891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:48.530654 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-12865a80-5996-41e0-a870-c3236907063f tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 200 len: 1229 microversion: 2.1 time: 0.122446 Jul 20 04:42:48.531612 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2970/5946] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:48 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 1229 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:49.521737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9dd0ed67-e9e3-43a8-98f4-510742b338c4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:49.522336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9dd0ed67-e9e3-43a8-98f4-510742b338c4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:49.533828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9dd0ed67-e9e3-43a8-98f4-510742b338c4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.534709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9dd0ed67-e9e3-43a8-98f4-510742b338c4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.535743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9dd0ed67-e9e3-43a8-98f4-510742b338c4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.536415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9dd0ed67-e9e3-43a8-98f4-510742b338c4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.549679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c8fc1f2-bbd3-45c1-9fb1-11ff9fa440e4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:49.550425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c8fc1f2-bbd3-45c1-9fb1-11ff9fa440e4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] [instance: e0e18f39-0d53-4bce-ac11-d565e7c0d2e1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:49.565080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c8fc1f2-bbd3-45c1-9fb1-11ff9fa440e4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.572893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c8fc1f2-bbd3-45c1-9fb1-11ff9fa440e4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.574101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c8fc1f2-bbd3-45c1-9fb1-11ff9fa440e4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:49.574770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c8fc1f2-bbd3-45c1-9fb1-11ff9fa440e4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:49.604098 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-3c8fc1f2-bbd3-45c1-9fb1-11ff9fa440e4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] HTTP exception thrown: Instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 could not be found. Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c8fc1f2-bbd3-45c1-9fb1-11ff9fa440e4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Request method failure captured: Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 HTTP/1.1 Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14ZxkFq9QxYPOrich4rZXBcVFDB--7n3eSqqPLdOwa8JeTcE0xdYWH0OVV6emo3MAgzK2hF_oykMc3TIWLlmBI64FQ1KUe8hdalNdAfaYlNbGy7dARNXRsMA2NnAzLJfuP42-_7XtRP5seAX5SoiOB5Gi9cnnoC6KtCMHX4zq4vP4SY Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 66a33d3b51854654bae6889ed2891b4c Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestVolumeBackupRestore-860314413 Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/66a33d3b51854654bae6889ed2891b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66a33d3b51854654bae6889ed2891b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66a33d3b51854654bae6889ed2891b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_66a33d3b51854654bae6889ed2891b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestVolumeBackupRestore-860314413 Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 66a33d3b51854654bae6889ed2891b4c Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestVolumeBackupRestore-860314413 Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestVolumeBackupRestore-860314413-project Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 06e47ca5f7f64b71b659170ca6f5ca20 Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestVolumeBackupRestore-860314413-project Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 could not be found. Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'e0e18f39-0d53-4bce-ac11-d565e7c0d2e1'} Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 could not be found. Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 could not be found. Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:49.606099 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:42:49.614155 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:49.614155 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:49.614155 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:49.614155 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:49.614155 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:49.614155 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 could not be found. Jul 20 04:42:49.614155 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:42:49.621230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c8fc1f2-bbd3-45c1-9fb1-11ff9fa440e4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Returning 404 to user: Instance e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:49.623044 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c8fc1f2-bbd3-45c1-9fb1-11ff9fa440e4 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1" status: 404 len: 111 microversion: 2.1 time: 0.077036 Jul 20 04:42:49.627648 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2971/5947] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:49 2022] GET /compute/v2.1/servers/e0e18f39-0d53-4bce-ac11-d565e7c0d2e1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:49.933636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9dd0ed67-e9e3-43a8-98f4-510742b338c4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:49.937303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-247c1d72-a769-4a00-906a-9b9f75d346d7 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] Calling method '.version_select at 0x7fb840ff1ca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:49.954447 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9dd0ed67-e9e3-43a8-98f4-510742b338c4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1734 microversion: 2.1 time: 0.433478 Jul 20 04:42:49.955701 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2977/5948] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:49 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1734 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:49.976253 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-247c1d72-a769-4a00-906a-9b9f75d346d7 tempest-TestVolumeBackupRestore-860314413 tempest-TestVolumeBackupRestore-860314413-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-783922454" status: 202 len: 0 microversion: 2.1 time: 0.050667 Jul 20 04:42:49.980349 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2972/5949] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 04:42:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-783922454 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:42:50.975718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-682d7061-124d-4188-84aa-a6215ed90288 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:50.976478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-682d7061-124d-4188-84aa-a6215ed90288 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:50.993262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-682d7061-124d-4188-84aa-a6215ed90288 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:50.994541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-682d7061-124d-4188-84aa-a6215ed90288 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:50.996406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-682d7061-124d-4188-84aa-a6215ed90288 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:50.997273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-682d7061-124d-4188-84aa-a6215ed90288 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:51.290552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-682d7061-124d-4188-84aa-a6215ed90288 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:51.311976 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-682d7061-124d-4188-84aa-a6215ed90288 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1734 microversion: 2.1 time: 0.343626 Jul 20 04:42:51.312594 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2978/5950] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:50 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1734 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:52.332074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d25006d1-645f-46bf-a7e7-e285188fe8c0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:52.333298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d25006d1-645f-46bf-a7e7-e285188fe8c0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:52.349839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25006d1-645f-46bf-a7e7-e285188fe8c0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.350806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25006d1-645f-46bf-a7e7-e285188fe8c0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.353135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25006d1-645f-46bf-a7e7-e285188fe8c0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.356693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d25006d1-645f-46bf-a7e7-e285188fe8c0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.509738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-10cf8b73-8f5b-48c4-837d-f623a30c03f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:52.511041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-10cf8b73-8f5b-48c4-837d-f623a30c03f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:52.529827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10cf8b73-8f5b-48c4-837d-f623a30c03f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.530584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10cf8b73-8f5b-48c4-837d-f623a30c03f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.543945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10cf8b73-8f5b-48c4-837d-f623a30c03f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.545741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-10cf8b73-8f5b-48c4-837d-f623a30c03f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.569744 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-10cf8b73-8f5b-48c4-837d-f623a30c03f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-10cf8b73-8f5b-48c4-837d-f623a30c03f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 HTTP/1.1 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '2c82c28f-fe29-4596-86dc-f9f23daf37b7'} Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:52.572027 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:52.578608 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.582532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-10cf8b73-8f5b-48c4-837d-f623a30c03f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:52.583658 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-10cf8b73-8f5b-48c4-837d-f623a30c03f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 404 len: 111 microversion: 2.1 time: 0.079162 Jul 20 04:42:52.585010 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2979/5951] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:52 2022] DELETE /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:52.607326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cbaae6e2-37dd-48a2-b205-543f4b43b250 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:52.608070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cbaae6e2-37dd-48a2-b205-543f4b43b250 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 2c82c28f-fe29-4596-86dc-f9f23daf37b7] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:52.625160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbaae6e2-37dd-48a2-b205-543f4b43b250 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.625636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbaae6e2-37dd-48a2-b205-543f4b43b250 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.626485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbaae6e2-37dd-48a2-b205-543f4b43b250 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:52.626946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbaae6e2-37dd-48a2-b205-543f4b43b250 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:52.635046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d25006d1-645f-46bf-a7e7-e285188fe8c0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:52.645625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:52.655562 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d25006d1-645f-46bf-a7e7-e285188fe8c0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1734 microversion: 2.1 time: 0.330210 Jul 20 04:42:52.665936 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2973/5952] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:52 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1734 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:52.666459 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-cbaae6e2-37dd-48a2-b205-543f4b43b250 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cbaae6e2-37dd-48a2-b205-543f4b43b250 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 HTTP/1.1 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '2c82c28f-fe29-4596-86dc-f9f23daf37b7'} Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:52.668283 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.674552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:52.674552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:52.674552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:52.674552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:52.674552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:52.674552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. Jul 20 04:42:52.674552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:52.674552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cbaae6e2-37dd-48a2-b205-543f4b43b250 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 2c82c28f-fe29-4596-86dc-f9f23daf37b7 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:52.674552 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cbaae6e2-37dd-48a2-b205-543f4b43b250 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7" status: 404 len: 111 microversion: 2.1 time: 0.072535 Jul 20 04:42:52.674552 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2980/5953] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:52 2022] GET /compute/v2.1/servers/2c82c28f-fe29-4596-86dc-f9f23daf37b7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:53.678308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01a02bd3-01e1-4e0c-9022-62efe065d070 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:53.681568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-01a02bd3-01e1-4e0c-9022-62efe065d070 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:53.710081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01a02bd3-01e1-4e0c-9022-62efe065d070 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:53.718296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01a02bd3-01e1-4e0c-9022-62efe065d070 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:53.723654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01a02bd3-01e1-4e0c-9022-62efe065d070 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:53.724373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01a02bd3-01e1-4e0c-9022-62efe065d070 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:54.143101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-01a02bd3-01e1-4e0c-9022-62efe065d070 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:54.152182 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01a02bd3-01e1-4e0c-9022-62efe065d070 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1734 microversion: 2.1 time: 0.480757 Jul 20 04:42:54.167808 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2974/5954] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:53 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1734 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:55.192095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-23479fd6-96cc-4b51-a720-02ebe1417ed1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:55.195338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-23479fd6-96cc-4b51-a720-02ebe1417ed1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:55.238716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23479fd6-96cc-4b51-a720-02ebe1417ed1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:55.238716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23479fd6-96cc-4b51-a720-02ebe1417ed1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:55.239809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23479fd6-96cc-4b51-a720-02ebe1417ed1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:55.240438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23479fd6-96cc-4b51-a720-02ebe1417ed1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:55.425809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-23479fd6-96cc-4b51-a720-02ebe1417ed1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:55.440948 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-23479fd6-96cc-4b51-a720-02ebe1417ed1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1734 microversion: 2.1 time: 0.271113 Jul 20 04:42:55.442224 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2981/5955] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:55 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1734 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:56.459107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-47ff6034-56c0-4e56-a563-2704c287222b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:56.460854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-47ff6034-56c0-4e56-a563-2704c287222b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:56.478239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47ff6034-56c0-4e56-a563-2704c287222b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:56.479170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47ff6034-56c0-4e56-a563-2704c287222b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:56.480175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47ff6034-56c0-4e56-a563-2704c287222b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:56.480846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47ff6034-56c0-4e56-a563-2704c287222b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:56.740205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-47ff6034-56c0-4e56-a563-2704c287222b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:56.752788 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-47ff6034-56c0-4e56-a563-2704c287222b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1734 microversion: 2.1 time: 0.298194 Jul 20 04:42:56.753693 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2975/5956] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:56 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1734 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:57.770711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cdaeb90b-0bd0-4701-a501-1a4bd5980df6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:57.772915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cdaeb90b-0bd0-4701-a501-1a4bd5980df6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:57.783176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cdaeb90b-0bd0-4701-a501-1a4bd5980df6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.785884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cdaeb90b-0bd0-4701-a501-1a4bd5980df6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:57.787285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cdaeb90b-0bd0-4701-a501-1a4bd5980df6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:57.787921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cdaeb90b-0bd0-4701-a501-1a4bd5980df6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:58.041720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cdaeb90b-0bd0-4701-a501-1a4bd5980df6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:58.052358 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cdaeb90b-0bd0-4701-a501-1a4bd5980df6 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1734 microversion: 2.1 time: 0.285577 Jul 20 04:42:58.053348 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2982/5957] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:57 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1734 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:59.071457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bcf75a07-cb82-4690-984e-dbdccaef21e1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:59.072087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bcf75a07-cb82-4690-984e-dbdccaef21e1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:59.087131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bcf75a07-cb82-4690-984e-dbdccaef21e1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.087607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bcf75a07-cb82-4690-984e-dbdccaef21e1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.088408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bcf75a07-cb82-4690-984e-dbdccaef21e1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.096564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bcf75a07-cb82-4690-984e-dbdccaef21e1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.295012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bcf75a07-cb82-4690-984e-dbdccaef21e1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:59.306049 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bcf75a07-cb82-4690-984e-dbdccaef21e1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1714 microversion: 2.1 time: 0.237880 Jul 20 04:42:59.306571 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2976/5958] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:59 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1714 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:59.462285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-79458e66-5cb8-4a6e-962b-e52a852cc9cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:59.463364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-79458e66-5cb8-4a6e-962b-e52a852cc9cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:59.478125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79458e66-5cb8-4a6e-962b-e52a852cc9cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.478634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79458e66-5cb8-4a6e-962b-e52a852cc9cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.480668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79458e66-5cb8-4a6e-962b-e52a852cc9cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.481129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79458e66-5cb8-4a6e-962b-e52a852cc9cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.663284 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-79458e66-5cb8-4a6e-962b-e52a852cc9cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] HTTP exception thrown: Cannot 'detach_volume' instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 while it is in vm_state rescued Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-79458e66-5cb8-4a6e-962b-e52a852cc9cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Request method failure captured: Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments/0f176cb0-064a-44fa-8084-13c4bc960f07 HTTP/1.1 Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cVvlyFQK0Hky763YtJNZmga-seuiHv50lzr8c708UaBjY5LhinFPM_QzRPumN7lebUV8SaN9g5W8Pjefaa4UE9X-ySIx3izX52Mcn-dmW_45ztV_oVGdlJV1fLy4MHx9SEfL5owl8e_frcmqcUAJfCEXDSfh8n8iumlmvk569aBtU Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9138f252886e4faea3710ff7d6764683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9138f252886e4faea3710ff7d6764683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: eff6843f674047fc9a8841711244bce4 Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: exception: Cannot 'detach_volume' instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 while it is in vm_state rescued Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'server_id': '24e8ea2f-7c9f-4424-b7af-065fc4225a98', 'id': '0f176cb0-064a-44fa-8084-13c4bc960f07'} Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 while it is in vm_state rescued Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:59.664994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:59.668004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:59.668004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:59.668004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:59.668004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:59.668004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 while it is in vm_state rescued Jul 20 04:42:59.668004 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:42:59.668004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-79458e66-5cb8-4a6e-962b-e52a852cc9cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Returning 409 to user: Cannot 'detach_volume' instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 while it is in vm_state rescued {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:59.668004 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-79458e66-5cb8-4a6e-962b-e52a852cc9cb tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "DELETE /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments/0f176cb0-064a-44fa-8084-13c4bc960f07" status: 409 len: 152 microversion: 2.1 time: 0.208942 Jul 20 04:42:59.673482 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2983/5959] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:42:59 2022] DELETE /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments/0f176cb0-064a-44fa-8084-13c4bc960f07 => generated 152 bytes in 216 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:42:59.677148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7161fa1-3c57-490b-9cda-1dc11be2914b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:59.677738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b7161fa1-3c57-490b-9cda-1dc11be2914b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:59.689747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7161fa1-3c57-490b-9cda-1dc11be2914b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.691007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7161fa1-3c57-490b-9cda-1dc11be2914b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.691814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7161fa1-3c57-490b-9cda-1dc11be2914b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.692260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7161fa1-3c57-490b-9cda-1dc11be2914b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.789397 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b7161fa1-3c57-490b-9cda-1dc11be2914b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/action" status: 202 len: 0 microversion: 2.1 time: 0.116957 Jul 20 04:42:59.790281 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2977/5960] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:42:59 2022] POST /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:42:59.800334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6e9fae9f-7811-4638-880b-b10f1b8c1c14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:59.801214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6e9fae9f-7811-4638-880b-b10f1b8c1c14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:59.813461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e9fae9f-7811-4638-880b-b10f1b8c1c14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.814924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e9fae9f-7811-4638-880b-b10f1b8c1c14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:59.817911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e9fae9f-7811-4638-880b-b10f1b8c1c14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:59.830933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e9fae9f-7811-4638-880b-b10f1b8c1c14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:00.359522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6e9fae9f-7811-4638-880b-b10f1b8c1c14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:00.368958 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6e9fae9f-7811-4638-880b-b10f1b8c1c14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1722 microversion: 2.1 time: 0.572614 Jul 20 04:43:00.369555 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2984/5961] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:59 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1722 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:01.388394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d52bb5f-b7a8-4ee1-a544-2ca90ffa5411 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:01.389836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d52bb5f-b7a8-4ee1-a544-2ca90ffa5411 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:01.397771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d52bb5f-b7a8-4ee1-a544-2ca90ffa5411 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:01.398491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d52bb5f-b7a8-4ee1-a544-2ca90ffa5411 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:01.399496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d52bb5f-b7a8-4ee1-a544-2ca90ffa5411 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:01.400144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d52bb5f-b7a8-4ee1-a544-2ca90ffa5411 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:01.655923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d52bb5f-b7a8-4ee1-a544-2ca90ffa5411 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:01.665720 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d52bb5f-b7a8-4ee1-a544-2ca90ffa5411 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1722 microversion: 2.1 time: 0.283203 Jul 20 04:43:01.680479 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2978/5962] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:01 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:02.684335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ede4d4d3-d641-47c8-8cd8-f400c8e98b2e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:02.685713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ede4d4d3-d641-47c8-8cd8-f400c8e98b2e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:02.694038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:02.696418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ede4d4d3-d641-47c8-8cd8-f400c8e98b2e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:02.697169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ede4d4d3-d641-47c8-8cd8-f400c8e98b2e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:02.699177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ede4d4d3-d641-47c8-8cd8-f400c8e98b2e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:02.699944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ede4d4d3-d641-47c8-8cd8-f400c8e98b2e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:02.941236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ede4d4d3-d641-47c8-8cd8-f400c8e98b2e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:02.951239 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ede4d4d3-d641-47c8-8cd8-f400c8e98b2e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1728 microversion: 2.1 time: 0.271105 Jul 20 04:43:02.952658 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2985/5963] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:02 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1728 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:02.970001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a2f619c1-ee45-4072-86fd-b2cd23e29082 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:02.970792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a2f619c1-ee45-4072-86fd-b2cd23e29082 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:02.978030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2f619c1-ee45-4072-86fd-b2cd23e29082 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:02.978521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2f619c1-ee45-4072-86fd-b2cd23e29082 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:02.979308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2f619c1-ee45-4072-86fd-b2cd23e29082 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:02.979925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2f619c1-ee45-4072-86fd-b2cd23e29082 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:03.105597 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a2f619c1-ee45-4072-86fd-b2cd23e29082 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137713 Jul 20 04:43:03.112965 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2979/5964] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 04:43:02 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:04.879618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4d4e41b8-8110-464a-8dbb-2f8fd91c8856 req-f60a2299-fd75-4de2-a092-efa90c11dd91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e8ea2f-7c9f-4424-b7af-065fc4225a98", "tag": "5d69a64b-5903-4704-a9e9-e1d78733d282"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:04.899454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4d4e41b8-8110-464a-8dbb-2f8fd91c8856 req-f60a2299-fd75-4de2-a092-efa90c11dd91 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:04.901982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4d4e41b8-8110-464a-8dbb-2f8fd91c8856 req-f60a2299-fd75-4de2-a092-efa90c11dd91 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:04.930639 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4d4e41b8-8110-464a-8dbb-2f8fd91c8856 req-f60a2299-fd75-4de2-a092-efa90c11dd91 service nova] Creating event network-changed:5d69a64b-5903-4704-a9e9-e1d78733d282 for instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 on n-h2-760456-11 Jul 20 04:43:04.948213 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4d4e41b8-8110-464a-8dbb-2f8fd91c8856 req-f60a2299-fd75-4de2-a092-efa90c11dd91 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073546 Jul 20 04:43:04.949025 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2986/5965] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:06.970530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f6be33be-60eb-4d0c-a548-e5f7292aee43 req-aa203453-8398-42f9-824b-e8bd7654c4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e8ea2f-7c9f-4424-b7af-065fc4225a98", "tag": "5d69a64b-5903-4704-a9e9-e1d78733d282"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:06.986344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f6be33be-60eb-4d0c-a548-e5f7292aee43 req-aa203453-8398-42f9-824b-e8bd7654c4b5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:06.986580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f6be33be-60eb-4d0c-a548-e5f7292aee43 req-aa203453-8398-42f9-824b-e8bd7654c4b5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:07.020682 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f6be33be-60eb-4d0c-a548-e5f7292aee43 req-aa203453-8398-42f9-824b-e8bd7654c4b5 service nova] Creating event network-changed:5d69a64b-5903-4704-a9e9-e1d78733d282 for instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 on n-h2-760456-11 Jul 20 04:43:07.028995 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f6be33be-60eb-4d0c-a548-e5f7292aee43 req-aa203453-8398-42f9-824b-e8bd7654c4b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063254 Jul 20 04:43:07.032620 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2980/5966] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:08.345528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d7546816-5fd4-4c26-bad0-0e73fc4b84ab tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:08.346883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d7546816-5fd4-4c26-bad0-0e73fc4b84ab tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:08.354980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7546816-5fd4-4c26-bad0-0e73fc4b84ab tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.355753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7546816-5fd4-4c26-bad0-0e73fc4b84ab tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.356770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7546816-5fd4-4c26-bad0-0e73fc4b84ab tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.357374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7546816-5fd4-4c26-bad0-0e73fc4b84ab tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.389635 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d7546816-5fd4-4c26-bad0-0e73fc4b84ab tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/ips" status: 200 len: 152 microversion: 2.20 time: 0.049329 Jul 20 04:43:08.396030 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2987/5967] 10.222.0.59 () {60 vars in 1288 bytes} [Wed Jul 20 04:43:08 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/ips => generated 152 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:43:11.397531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6444babb-554c-4e6f-95ad-33cd599ce7c4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:11.398272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6444babb-554c-4e6f-95ad-33cd599ce7c4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:11.405029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:11.407887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6444babb-554c-4e6f-95ad-33cd599ce7c4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:11.408483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6444babb-554c-4e6f-95ad-33cd599ce7c4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:11.409576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6444babb-554c-4e6f-95ad-33cd599ce7c4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:11.410069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6444babb-554c-4e6f-95ad-33cd599ce7c4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:11.436621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-6444babb-554c-4e6f-95ad-33cd599ce7c4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lazy-loading 'flavor' on Instance uuid f3973340-115d-4612-a266-e4403274d648 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:43:11.728876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6444babb-554c-4e6f-95ad-33cd599ce7c4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "POST /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/action" status: 202 len: 0 microversion: 2.20 time: 0.337062 Jul 20 04:43:11.732559 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2981/5968] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:43:11 2022] POST /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:43:11.738711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a0580d7-ab6f-4920-ab97-edab7af4db29 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:11.739343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6a0580d7-ab6f-4920-ab97-edab7af4db29 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:11.752215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a0580d7-ab6f-4920-ab97-edab7af4db29 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:11.753086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a0580d7-ab6f-4920-ab97-edab7af4db29 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:11.754300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a0580d7-ab6f-4920-ab97-edab7af4db29 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:11.755671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a0580d7-ab6f-4920-ab97-edab7af4db29 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:11.958462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6a0580d7-ab6f-4920-ab97-edab7af4db29 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:11.967594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6a0580d7-ab6f-4920-ab97-edab7af4db29 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:11.969441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6a0580d7-ab6f-4920-ab97-edab7af4db29 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:11.970932 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6a0580d7-ab6f-4920-ab97-edab7af4db29 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.236496 Jul 20 04:43:11.972013 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2988/5969] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:11 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:12.991344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df96ef6a-7553-4faf-b088-2bad3a2a8873 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:12.992067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-df96ef6a-7553-4faf-b088-2bad3a2a8873 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:12.999702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df96ef6a-7553-4faf-b088-2bad3a2a8873 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.000170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df96ef6a-7553-4faf-b088-2bad3a2a8873 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.000961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df96ef6a-7553-4faf-b088-2bad3a2a8873 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.001408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df96ef6a-7553-4faf-b088-2bad3a2a8873 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.171984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df96ef6a-7553-4faf-b088-2bad3a2a8873 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:13.181362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df96ef6a-7553-4faf-b088-2bad3a2a8873 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:13.183245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df96ef6a-7553-4faf-b088-2bad3a2a8873 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:13.184589 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-df96ef6a-7553-4faf-b088-2bad3a2a8873 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.198343 Jul 20 04:43:13.194286 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2982/5970] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:12 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:14.214887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-adad117f-dd05-4cc7-b5b3-b0bd864037ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:14.215672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-adad117f-dd05-4cc7-b5b3-b0bd864037ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:14.225243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adad117f-dd05-4cc7-b5b3-b0bd864037ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:14.225702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adad117f-dd05-4cc7-b5b3-b0bd864037ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.226982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adad117f-dd05-4cc7-b5b3-b0bd864037ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:14.227679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-adad117f-dd05-4cc7-b5b3-b0bd864037ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.436196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-adad117f-dd05-4cc7-b5b3-b0bd864037ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:14.446144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-adad117f-dd05-4cc7-b5b3-b0bd864037ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:14.448159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-adad117f-dd05-4cc7-b5b3-b0bd864037ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:14.449381 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-adad117f-dd05-4cc7-b5b3-b0bd864037ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.243862 Jul 20 04:43:14.449950 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2989/5971] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:14 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:43:15.471107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1bb00169-4314-4a6b-b854-c310a129c72a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:15.471732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1bb00169-4314-4a6b-b854-c310a129c72a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:15.479052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1bb00169-4314-4a6b-b854-c310a129c72a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.479651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1bb00169-4314-4a6b-b854-c310a129c72a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.480430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1bb00169-4314-4a6b-b854-c310a129c72a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.480875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1bb00169-4314-4a6b-b854-c310a129c72a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.622020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1bb00169-4314-4a6b-b854-c310a129c72a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:15.632314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1bb00169-4314-4a6b-b854-c310a129c72a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:15.634001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1bb00169-4314-4a6b-b854-c310a129c72a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:15.635410 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1bb00169-4314-4a6b-b854-c310a129c72a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.169105 Jul 20 04:43:15.636139 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2983/5972] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:15 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:16.654920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a986dc52-e211-4dc1-be5a-fc8c81d7486a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:16.655515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a986dc52-e211-4dc1-be5a-fc8c81d7486a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:16.663288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a986dc52-e211-4dc1-be5a-fc8c81d7486a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.663748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a986dc52-e211-4dc1-be5a-fc8c81d7486a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.664527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a986dc52-e211-4dc1-be5a-fc8c81d7486a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.665090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a986dc52-e211-4dc1-be5a-fc8c81d7486a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.686301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=81 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:16.825079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a986dc52-e211-4dc1-be5a-fc8c81d7486a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:16.835299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a986dc52-e211-4dc1-be5a-fc8c81d7486a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:16.837022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a986dc52-e211-4dc1-be5a-fc8c81d7486a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:16.838230 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a986dc52-e211-4dc1-be5a-fc8c81d7486a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.188180 Jul 20 04:43:16.838825 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2990/5973] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:16 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:17.857924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7abb156e-56de-4dd4-8ec5-ec767c0c6104 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:17.858886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7abb156e-56de-4dd4-8ec5-ec767c0c6104 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:17.866688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7abb156e-56de-4dd4-8ec5-ec767c0c6104 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:17.867257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7abb156e-56de-4dd4-8ec5-ec767c0c6104 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:17.868133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7abb156e-56de-4dd4-8ec5-ec767c0c6104 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:17.868832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7abb156e-56de-4dd4-8ec5-ec767c0c6104 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.018416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7abb156e-56de-4dd4-8ec5-ec767c0c6104 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:18.028645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7abb156e-56de-4dd4-8ec5-ec767c0c6104 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:18.032460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7abb156e-56de-4dd4-8ec5-ec767c0c6104 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:18.034939 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7abb156e-56de-4dd4-8ec5-ec767c0c6104 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.181580 Jul 20 04:43:18.036724 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2984/5974] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:17 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:19.056872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1f5e35cc-1dec-46a2-a117-90a11054b115 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:19.057778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1f5e35cc-1dec-46a2-a117-90a11054b115 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:19.065129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f5e35cc-1dec-46a2-a117-90a11054b115 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.065834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f5e35cc-1dec-46a2-a117-90a11054b115 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.066932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f5e35cc-1dec-46a2-a117-90a11054b115 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.067825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f5e35cc-1dec-46a2-a117-90a11054b115 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.244724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1f5e35cc-1dec-46a2-a117-90a11054b115 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:19.254826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1f5e35cc-1dec-46a2-a117-90a11054b115 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:19.256574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1f5e35cc-1dec-46a2-a117-90a11054b115 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:19.257884 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1f5e35cc-1dec-46a2-a117-90a11054b115 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.207052 Jul 20 04:43:19.258712 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2991/5975] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:19 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:20.280336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e9e3d767-4bf3-43c6-b468-4c6873a91ed7 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:20.280971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e9e3d767-4bf3-43c6-b468-4c6873a91ed7 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:20.288254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9e3d767-4bf3-43c6-b468-4c6873a91ed7 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.288954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9e3d767-4bf3-43c6-b468-4c6873a91ed7 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:20.290181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9e3d767-4bf3-43c6-b468-4c6873a91ed7 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.290806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9e3d767-4bf3-43c6-b468-4c6873a91ed7 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:20.464017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e9e3d767-4bf3-43c6-b468-4c6873a91ed7 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:20.473330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e9e3d767-4bf3-43c6-b468-4c6873a91ed7 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:20.474909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e9e3d767-4bf3-43c6-b468-4c6873a91ed7 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:20.476118 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e9e3d767-4bf3-43c6-b468-4c6873a91ed7 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.201337 Jul 20 04:43:20.476880 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2985/5976] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:20 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:21.497471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-66f14006-8c75-4352-a95c-08e27fe482b8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:21.498239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-66f14006-8c75-4352-a95c-08e27fe482b8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:21.506065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-66f14006-8c75-4352-a95c-08e27fe482b8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.506727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-66f14006-8c75-4352-a95c-08e27fe482b8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.507729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-66f14006-8c75-4352-a95c-08e27fe482b8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.508356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-66f14006-8c75-4352-a95c-08e27fe482b8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.623545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-667453970", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1113e2fb-aa6d-433e-afa1-614207d645b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ff98390c-0468-4cc8-9649-ee7fac3db692"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:21.657167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-66f14006-8c75-4352-a95c-08e27fe482b8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:21.666058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-66f14006-8c75-4352-a95c-08e27fe482b8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:21.667757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-66f14006-8c75-4352-a95c-08e27fe482b8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:21.668975 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-66f14006-8c75-4352-a95c-08e27fe482b8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.177600 Jul 20 04:43:21.669756 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2992/5977] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:21 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:21.686713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] validate_networks() for [('ff98390c-0468-4cc8-9649-ee7fac3db692', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:43:22.063619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:43:22.064051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:43:22.064533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:43:22.064953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:43:22.065534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:43:22.074769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.075257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.076818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.077270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.096171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:22.101686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for user f1067c18d4074c78a512d89e07141915 and project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:22.166106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:43:22.168236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1113e2fb-aa6d-433e-afa1-614207d645b1',volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:43:22.306047 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-69a5e074-7ca5-4ec8-9072-682a98280b6b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687123 Jul 20 04:43:22.306676 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2986/5978] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:43:22.318496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72aa4d13-ea38-4780-bb2d-bcc71d9c67f7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:22.319220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-72aa4d13-ea38-4780-bb2d-bcc71d9c67f7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:22.378118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72aa4d13-ea38-4780-bb2d-bcc71d9c67f7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:22.385140 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72aa4d13-ea38-4780-bb2d-bcc71d9c67f7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1070 microversion: 2.1 time: 0.071318 Jul 20 04:43:22.389383 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2993/5979] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:22 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1070 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:22.692287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9ed90b11-6087-4c69-8d73-fe7358dde2a9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:22.695173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9ed90b11-6087-4c69-8d73-fe7358dde2a9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:22.703624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ed90b11-6087-4c69-8d73-fe7358dde2a9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.704262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ed90b11-6087-4c69-8d73-fe7358dde2a9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.705294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ed90b11-6087-4c69-8d73-fe7358dde2a9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.705752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ed90b11-6087-4c69-8d73-fe7358dde2a9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.862944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9ed90b11-6087-4c69-8d73-fe7358dde2a9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:22.874241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9ed90b11-6087-4c69-8d73-fe7358dde2a9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:22.876134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9ed90b11-6087-4c69-8d73-fe7358dde2a9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:22.877963 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9ed90b11-6087-4c69-8d73-fe7358dde2a9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.190360 Jul 20 04:43:22.878945 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2987/5980] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:22 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:23.402974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c7f177cc-6040-4916-bcd8-9515023e5340 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:23.404258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c7f177cc-6040-4916-bcd8-9515023e5340 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:23.411816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7f177cc-6040-4916-bcd8-9515023e5340 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.412281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7f177cc-6040-4916-bcd8-9515023e5340 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.413059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7f177cc-6040-4916-bcd8-9515023e5340 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.413510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7f177cc-6040-4916-bcd8-9515023e5340 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.481410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c7f177cc-6040-4916-bcd8-9515023e5340 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:23.489879 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c7f177cc-6040-4916-bcd8-9515023e5340 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1168 microversion: 2.1 time: 0.090710 Jul 20 04:43:23.490517 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2994/5981] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:23 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1168 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:23.897329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f2502361-b943-4b52-a817-bdeab32212b3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:23.898526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f2502361-b943-4b52-a817-bdeab32212b3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:23.906455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2502361-b943-4b52-a817-bdeab32212b3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.907192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2502361-b943-4b52-a817-bdeab32212b3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.908240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2502361-b943-4b52-a817-bdeab32212b3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.908805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f2502361-b943-4b52-a817-bdeab32212b3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.913240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:24.052175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f2502361-b943-4b52-a817-bdeab32212b3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:24.063417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f2502361-b943-4b52-a817-bdeab32212b3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:24.066044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f2502361-b943-4b52-a817-bdeab32212b3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:24.067575 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f2502361-b943-4b52-a817-bdeab32212b3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.174396 Jul 20 04:43:24.078865 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2988/5982] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:23 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:24.507600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8c87be7f-fb33-4f1a-b91e-589715da277a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:24.508238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8c87be7f-fb33-4f1a-b91e-589715da277a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:24.520843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c87be7f-fb33-4f1a-b91e-589715da277a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:24.521319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c87be7f-fb33-4f1a-b91e-589715da277a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:24.526308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c87be7f-fb33-4f1a-b91e-589715da277a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:24.527065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c87be7f-fb33-4f1a-b91e-589715da277a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:24.812593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c87be7f-fb33-4f1a-b91e-589715da277a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:24.828443 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8c87be7f-fb33-4f1a-b91e-589715da277a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1228 microversion: 2.1 time: 0.324311 Jul 20 04:43:24.829628 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2995/5983] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:24 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1228 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:25.086395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6e77a6f-0f21-42ad-b05b-332e43e42830 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:25.087324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e6e77a6f-0f21-42ad-b05b-332e43e42830 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:25.107860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6e77a6f-0f21-42ad-b05b-332e43e42830 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.108706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6e77a6f-0f21-42ad-b05b-332e43e42830 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.109980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6e77a6f-0f21-42ad-b05b-332e43e42830 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.110671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6e77a6f-0f21-42ad-b05b-332e43e42830 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.347116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6e77a6f-0f21-42ad-b05b-332e43e42830 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:25.358339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6e77a6f-0f21-42ad-b05b-332e43e42830 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:25.359928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6e77a6f-0f21-42ad-b05b-332e43e42830 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:25.367868 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6e77a6f-0f21-42ad-b05b-332e43e42830 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.285397 Jul 20 04:43:25.368710 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2989/5984] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:25 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:25.465936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-7e668cd8-3360-40cc-94f7-a0a8e65ad73a req-ec3ced38-7833-41e9-a0e9-296609b25bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4701d59a-a341-4429-940a-503c0f49bbb8", "tag": "c91054e7-36ad-4022-ace1-1d2e1ce11b8b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:25.474819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7e668cd8-3360-40cc-94f7-a0a8e65ad73a req-ec3ced38-7833-41e9-a0e9-296609b25bba service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.475364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7e668cd8-3360-40cc-94f7-a0a8e65ad73a req-ec3ced38-7833-41e9-a0e9-296609b25bba service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.489962 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-7e668cd8-3360-40cc-94f7-a0a8e65ad73a req-ec3ced38-7833-41e9-a0e9-296609b25bba service nova] Creating event network-changed:c91054e7-36ad-4022-ace1-1d2e1ce11b8b for instance 4701d59a-a341-4429-940a-503c0f49bbb8 on n-h1-760456-11 Jul 20 04:43:25.495643 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-7e668cd8-3360-40cc-94f7-a0a8e65ad73a req-ec3ced38-7833-41e9-a0e9-296609b25bba service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299505 Jul 20 04:43:25.496906 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2996/5985] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:25.847684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0c72a860-6a83-48a9-beda-1ef9d045692e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:25.848496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0c72a860-6a83-48a9-beda-1ef9d045692e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:25.866848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c72a860-6a83-48a9-beda-1ef9d045692e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.871137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c72a860-6a83-48a9-beda-1ef9d045692e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.872675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c72a860-6a83-48a9-beda-1ef9d045692e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.873440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c72a860-6a83-48a9-beda-1ef9d045692e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.106065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0c72a860-6a83-48a9-beda-1ef9d045692e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:26.117751 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0c72a860-6a83-48a9-beda-1ef9d045692e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1228 microversion: 2.1 time: 0.276428 Jul 20 04:43:26.129018 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2990/5986] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:25 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1228 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:26.388866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e97f6c03-5a5e-4693-9cf6-26b636566d34 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:26.389581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e97f6c03-5a5e-4693-9cf6-26b636566d34 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:26.397788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e97f6c03-5a5e-4693-9cf6-26b636566d34 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.398261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e97f6c03-5a5e-4693-9cf6-26b636566d34 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.399057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e97f6c03-5a5e-4693-9cf6-26b636566d34 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.399501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e97f6c03-5a5e-4693-9cf6-26b636566d34 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.543995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e97f6c03-5a5e-4693-9cf6-26b636566d34 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:26.553095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e97f6c03-5a5e-4693-9cf6-26b636566d34 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:26.554727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e97f6c03-5a5e-4693-9cf6-26b636566d34 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:26.555997 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e97f6c03-5a5e-4693-9cf6-26b636566d34 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.171934 Jul 20 04:43:26.556573 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2997/5987] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:26 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:27.135608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cee3f7b5-4313-46ba-af20-e45874dd8933 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:27.136219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cee3f7b5-4313-46ba-af20-e45874dd8933 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:27.145301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cee3f7b5-4313-46ba-af20-e45874dd8933 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.146119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cee3f7b5-4313-46ba-af20-e45874dd8933 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.147207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cee3f7b5-4313-46ba-af20-e45874dd8933 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.147909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cee3f7b5-4313-46ba-af20-e45874dd8933 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.307078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cee3f7b5-4313-46ba-af20-e45874dd8933 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:27.316686 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cee3f7b5-4313-46ba-af20-e45874dd8933 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1228 microversion: 2.1 time: 0.184945 Jul 20 04:43:27.317283 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2991/5988] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:27 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1228 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:27.575181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-231001b7-e33d-4aa7-8a03-272632ec28e0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:27.575814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-231001b7-e33d-4aa7-8a03-272632ec28e0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:27.583128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-231001b7-e33d-4aa7-8a03-272632ec28e0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.583896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-231001b7-e33d-4aa7-8a03-272632ec28e0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.584743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-231001b7-e33d-4aa7-8a03-272632ec28e0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.585256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-231001b7-e33d-4aa7-8a03-272632ec28e0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.722484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-231001b7-e33d-4aa7-8a03-272632ec28e0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:27.730713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-231001b7-e33d-4aa7-8a03-272632ec28e0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:27.733016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-231001b7-e33d-4aa7-8a03-272632ec28e0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:27.734356 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-231001b7-e33d-4aa7-8a03-272632ec28e0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1745 microversion: 2.20 time: 0.163342 Jul 20 04:43:27.735058 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2998/5989] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:27 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:28.334793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7ac7a45b-b8f0-493a-8b8e-ec5fbde6d2f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:28.336212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7ac7a45b-b8f0-493a-8b8e-ec5fbde6d2f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:28.349489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ac7a45b-b8f0-493a-8b8e-ec5fbde6d2f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:28.350149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ac7a45b-b8f0-493a-8b8e-ec5fbde6d2f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:28.351194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ac7a45b-b8f0-493a-8b8e-ec5fbde6d2f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:28.351946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7ac7a45b-b8f0-493a-8b8e-ec5fbde6d2f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:28.495045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7ac7a45b-b8f0-493a-8b8e-ec5fbde6d2f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:28.505558 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7ac7a45b-b8f0-493a-8b8e-ec5fbde6d2f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1228 microversion: 2.1 time: 0.175121 Jul 20 04:43:28.506225 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2992/5990] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:28 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1228 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:28.753521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-51a0909e-f698-4d0b-9de8-7462b80ebfb6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:28.754189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-51a0909e-f698-4d0b-9de8-7462b80ebfb6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:28.761318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51a0909e-f698-4d0b-9de8-7462b80ebfb6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:28.761780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51a0909e-f698-4d0b-9de8-7462b80ebfb6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:28.762584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51a0909e-f698-4d0b-9de8-7462b80ebfb6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:28.763902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51a0909e-f698-4d0b-9de8-7462b80ebfb6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:28.917137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-51a0909e-f698-4d0b-9de8-7462b80ebfb6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:28.928198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-51a0909e-f698-4d0b-9de8-7462b80ebfb6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:28.930469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-51a0909e-f698-4d0b-9de8-7462b80ebfb6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:28.932523 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-51a0909e-f698-4d0b-9de8-7462b80ebfb6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1745 microversion: 2.20 time: 0.182821 Jul 20 04:43:28.933304 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 2999/5991] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:28 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:29.523383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fe8e6e9c-d692-4461-87f6-5e7fa498b0e3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:29.524912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fe8e6e9c-d692-4461-87f6-5e7fa498b0e3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:29.533312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe8e6e9c-d692-4461-87f6-5e7fa498b0e3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:29.533995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe8e6e9c-d692-4461-87f6-5e7fa498b0e3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:29.535726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe8e6e9c-d692-4461-87f6-5e7fa498b0e3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:29.536332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fe8e6e9c-d692-4461-87f6-5e7fa498b0e3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:29.698510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fe8e6e9c-d692-4461-87f6-5e7fa498b0e3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:29.708677 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fe8e6e9c-d692-4461-87f6-5e7fa498b0e3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1216 microversion: 2.1 time: 0.189609 Jul 20 04:43:29.709332 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2993/5992] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:29 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:29.951596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-09ef96ce-c437-4ab0-b5a1-613962761e48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:29.953096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-09ef96ce-c437-4ab0-b5a1-613962761e48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:29.963801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09ef96ce-c437-4ab0-b5a1-613962761e48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:29.964556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09ef96ce-c437-4ab0-b5a1-613962761e48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:29.965529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09ef96ce-c437-4ab0-b5a1-613962761e48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:29.966826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09ef96ce-c437-4ab0-b5a1-613962761e48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:30.138278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09ef96ce-c437-4ab0-b5a1-613962761e48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:30.147732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09ef96ce-c437-4ab0-b5a1-613962761e48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:30.149480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09ef96ce-c437-4ab0-b5a1-613962761e48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:30.151683 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-09ef96ce-c437-4ab0-b5a1-613962761e48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1740 microversion: 2.20 time: 0.203463 Jul 20 04:43:30.154459 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3000/5993] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:29 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:30.728668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-adadc086-8130-4ac2-9204-f847a0bb7a4f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:30.730096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-adadc086-8130-4ac2-9204-f847a0bb7a4f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:30.739235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adadc086-8130-4ac2-9204-f847a0bb7a4f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:30.740107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adadc086-8130-4ac2-9204-f847a0bb7a4f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:30.741097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adadc086-8130-4ac2-9204-f847a0bb7a4f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:30.741737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adadc086-8130-4ac2-9204-f847a0bb7a4f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:30.908341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-adadc086-8130-4ac2-9204-f847a0bb7a4f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:30.916468 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-adadc086-8130-4ac2-9204-f847a0bb7a4f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1216 microversion: 2.1 time: 0.192429 Jul 20 04:43:30.917370 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2994/5994] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:30 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:31.174746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5eb88c81-b3bc-4d49-b349-258eddffe9c0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:31.176073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5eb88c81-b3bc-4d49-b349-258eddffe9c0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:31.184045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5eb88c81-b3bc-4d49-b349-258eddffe9c0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:31.185383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5eb88c81-b3bc-4d49-b349-258eddffe9c0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:31.186375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5eb88c81-b3bc-4d49-b349-258eddffe9c0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:31.186994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5eb88c81-b3bc-4d49-b349-258eddffe9c0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:31.354209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5eb88c81-b3bc-4d49-b349-258eddffe9c0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:31.364293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5eb88c81-b3bc-4d49-b349-258eddffe9c0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:31.366070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5eb88c81-b3bc-4d49-b349-258eddffe9c0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:31.367688 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5eb88c81-b3bc-4d49-b349-258eddffe9c0 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1740 microversion: 2.20 time: 0.199508 Jul 20 04:43:31.368412 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3001/5995] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:31 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:31.932978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a879d176-0522-4c09-b112-1f99b7c78b5c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:31.933795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a879d176-0522-4c09-b112-1f99b7c78b5c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:31.942179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a879d176-0522-4c09-b112-1f99b7c78b5c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:31.942998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a879d176-0522-4c09-b112-1f99b7c78b5c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:31.943989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a879d176-0522-4c09-b112-1f99b7c78b5c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:31.944745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a879d176-0522-4c09-b112-1f99b7c78b5c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.084674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:32.113971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:32.117631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a879d176-0522-4c09-b112-1f99b7c78b5c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:32.132796 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a879d176-0522-4c09-b112-1f99b7c78b5c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1216 microversion: 2.1 time: 0.203688 Jul 20 04:43:32.133499 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2995/5996] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:31 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:32.391760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dfac2146-b3f0-4de0-bef3-444f812aa858 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:32.392387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dfac2146-b3f0-4de0-bef3-444f812aa858 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:32.400067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:32.405313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfac2146-b3f0-4de0-bef3-444f812aa858 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.411981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfac2146-b3f0-4de0-bef3-444f812aa858 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.412865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfac2146-b3f0-4de0-bef3-444f812aa858 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.413318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dfac2146-b3f0-4de0-bef3-444f812aa858 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.629783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dfac2146-b3f0-4de0-bef3-444f812aa858 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:32.642969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dfac2146-b3f0-4de0-bef3-444f812aa858 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:32.645807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dfac2146-b3f0-4de0-bef3-444f812aa858 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:32.647238 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dfac2146-b3f0-4de0-bef3-444f812aa858 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1740 microversion: 2.20 time: 0.263474 Jul 20 04:43:32.648885 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3002/5997] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:32 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:32.816691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a77bfb39-3896-4a9e-ad66-82ee9cdaddc0 req-a0b0557a-1bab-46f8-a04a-d790ef499085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3973340-115d-4612-a266-e4403274d648", "name": "network-vif-plugged", "status": "completed", "tag": "d14f90e5-dbf1-405a-80b2-d712f8275251"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:32.838360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a77bfb39-3896-4a9e-ad66-82ee9cdaddc0 req-a0b0557a-1bab-46f8-a04a-d790ef499085 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.839029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a77bfb39-3896-4a9e-ad66-82ee9cdaddc0 req-a0b0557a-1bab-46f8-a04a-d790ef499085 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.855641 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a77bfb39-3896-4a9e-ad66-82ee9cdaddc0 req-a0b0557a-1bab-46f8-a04a-d790ef499085 service nova] Creating event network-vif-plugged:d14f90e5-dbf1-405a-80b2-d712f8275251 for instance f3973340-115d-4612-a266-e4403274d648 on n-h2-760456-11 Jul 20 04:43:32.863008 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a77bfb39-3896-4a9e-ad66-82ee9cdaddc0 req-a0b0557a-1bab-46f8-a04a-d790ef499085 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050227 Jul 20 04:43:32.864199 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2996/5998] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:33.150828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c4e628f0-aacf-450c-8344-b1b125de2f5b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:33.152387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c4e628f0-aacf-450c-8344-b1b125de2f5b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:33.156047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=38 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:33.160808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4e628f0-aacf-450c-8344-b1b125de2f5b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.161273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4e628f0-aacf-450c-8344-b1b125de2f5b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:33.162438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4e628f0-aacf-450c-8344-b1b125de2f5b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.163031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4e628f0-aacf-450c-8344-b1b125de2f5b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:33.322674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c4e628f0-aacf-450c-8344-b1b125de2f5b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:33.339930 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c4e628f0-aacf-450c-8344-b1b125de2f5b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1216 microversion: 2.1 time: 0.193127 Jul 20 04:43:33.349512 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3003/5999] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:33 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1216 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:33.670721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b0fae595-39a2-4cb3-a645-5720dffeddf5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:33.673127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b0fae595-39a2-4cb3-a645-5720dffeddf5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:33.682321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0fae595-39a2-4cb3-a645-5720dffeddf5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.683038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0fae595-39a2-4cb3-a645-5720dffeddf5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:33.684038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0fae595-39a2-4cb3-a645-5720dffeddf5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.684712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0fae595-39a2-4cb3-a645-5720dffeddf5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:33.857038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0fae595-39a2-4cb3-a645-5720dffeddf5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:33.867001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0fae595-39a2-4cb3-a645-5720dffeddf5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:33.871395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0fae595-39a2-4cb3-a645-5720dffeddf5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:33.874212 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b0fae595-39a2-4cb3-a645-5720dffeddf5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1740 microversion: 2.20 time: 0.210117 Jul 20 04:43:33.875387 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2997/6000] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:33 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:34.356687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-45395ace-e846-4574-b0d0-25e74a4ef12b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:34.358046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-45395ace-e846-4574-b0d0-25e74a4ef12b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:34.371424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-45395ace-e846-4574-b0d0-25e74a4ef12b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:34.371808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-45395ace-e846-4574-b0d0-25e74a4ef12b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:34.373269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-45395ace-e846-4574-b0d0-25e74a4ef12b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:34.373617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-45395ace-e846-4574-b0d0-25e74a4ef12b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:34.576073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-45395ace-e846-4574-b0d0-25e74a4ef12b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:34.587254 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-45395ace-e846-4574-b0d0-25e74a4ef12b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1216 microversion: 2.1 time: 0.234690 Jul 20 04:43:34.597854 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3004/6001] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:34 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1216 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:34.897213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b590a3f-6c0c-4359-82c8-8f0ad56a6b71 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:34.898019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b590a3f-6c0c-4359-82c8-8f0ad56a6b71 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:34.906115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b590a3f-6c0c-4359-82c8-8f0ad56a6b71 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:34.906809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b590a3f-6c0c-4359-82c8-8f0ad56a6b71 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:34.907947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b590a3f-6c0c-4359-82c8-8f0ad56a6b71 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:34.908395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b590a3f-6c0c-4359-82c8-8f0ad56a6b71 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:35.093225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7b590a3f-6c0c-4359-82c8-8f0ad56a6b71 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:35.110673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7b590a3f-6c0c-4359-82c8-8f0ad56a6b71 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:35.112733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7b590a3f-6c0c-4359-82c8-8f0ad56a6b71 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:35.114165 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b590a3f-6c0c-4359-82c8-8f0ad56a6b71 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1740 microversion: 2.20 time: 0.224554 Jul 20 04:43:35.114905 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2998/6002] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:34 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:35.605154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b4d1cfdf-732c-4796-818b-39e108051a0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:35.607079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b4d1cfdf-732c-4796-818b-39e108051a0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:35.614433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4d1cfdf-732c-4796-818b-39e108051a0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:35.614897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4d1cfdf-732c-4796-818b-39e108051a0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:35.615688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4d1cfdf-732c-4796-818b-39e108051a0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:35.616142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b4d1cfdf-732c-4796-818b-39e108051a0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:35.808138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b4d1cfdf-732c-4796-818b-39e108051a0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:35.817702 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b4d1cfdf-732c-4796-818b-39e108051a0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1216 microversion: 2.1 time: 0.216577 Jul 20 04:43:35.830169 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3005/6003] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:35 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1216 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:36.134720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a97c135d-6316-4de0-b1e4-93f7dd7f1d40 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:36.135578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a97c135d-6316-4de0-b1e4-93f7dd7f1d40 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:36.149876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a97c135d-6316-4de0-b1e4-93f7dd7f1d40 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.150726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a97c135d-6316-4de0-b1e4-93f7dd7f1d40 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.151677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a97c135d-6316-4de0-b1e4-93f7dd7f1d40 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.152344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a97c135d-6316-4de0-b1e4-93f7dd7f1d40 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.359852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a97c135d-6316-4de0-b1e4-93f7dd7f1d40 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:36.370664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a97c135d-6316-4de0-b1e4-93f7dd7f1d40 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:36.372523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a97c135d-6316-4de0-b1e4-93f7dd7f1d40 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:36.373976 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a97c135d-6316-4de0-b1e4-93f7dd7f1d40 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1740 microversion: 2.20 time: 0.243476 Jul 20 04:43:36.374599 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 2999/6004] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:36 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:36.610541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ee12314f-7328-4512-b693-18caea219c8a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:36.611063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ee12314f-7328-4512-b693-18caea219c8a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:36.618605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee12314f-7328-4512-b693-18caea219c8a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.619255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee12314f-7328-4512-b693-18caea219c8a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.620215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee12314f-7328-4512-b693-18caea219c8a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.620657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee12314f-7328-4512-b693-18caea219c8a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.734632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-ee12314f-7328-4512-b693-18caea219c8a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lazy-loading 'services' on Instance uuid 24e8ea2f-7c9f-4424-b7af-065fc4225a98 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:43:36.835574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1b0767cb-3dd3-4b1a-9324-1a393027faea tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:36.836200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1b0767cb-3dd3-4b1a-9324-1a393027faea tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:36.847893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b0767cb-3dd3-4b1a-9324-1a393027faea tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.848721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b0767cb-3dd3-4b1a-9324-1a393027faea tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.849755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b0767cb-3dd3-4b1a-9324-1a393027faea tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.850518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b0767cb-3dd3-4b1a-9324-1a393027faea tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.877666 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ee12314f-7328-4512-b693-18caea219c8a tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "DELETE /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments/0f176cb0-064a-44fa-8084-13c4bc960f07" status: 202 len: 0 microversion: 2.1 time: 0.271068 Jul 20 04:43:36.878300 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3006/6005] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:43:36 2022] DELETE /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments/0f176cb0-064a-44fa-8084-13c4bc960f07 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:36.927217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3346772a-8939-4fb0-8ff2-4a81ebdb9d21 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:36.930859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3346772a-8939-4fb0-8ff2-4a81ebdb9d21 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:36.948660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3346772a-8939-4fb0-8ff2-4a81ebdb9d21 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.949206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3346772a-8939-4fb0-8ff2-4a81ebdb9d21 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.950086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3346772a-8939-4fb0-8ff2-4a81ebdb9d21 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.950561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3346772a-8939-4fb0-8ff2-4a81ebdb9d21 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:37.021276 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3346772a-8939-4fb0-8ff2-4a81ebdb9d21 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122157 Jul 20 04:43:37.024347 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3007/6006] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:36 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:37.396063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ef3af54-4bd3-44fb-954d-7a1efe26a5cb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:37.397128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2ef3af54-4bd3-44fb-954d-7a1efe26a5cb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:37.407021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef3af54-4bd3-44fb-954d-7a1efe26a5cb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:37.408044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef3af54-4bd3-44fb-954d-7a1efe26a5cb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:37.409001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef3af54-4bd3-44fb-954d-7a1efe26a5cb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:37.409747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef3af54-4bd3-44fb-954d-7a1efe26a5cb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:37.413851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:37.592905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2ef3af54-4bd3-44fb-954d-7a1efe26a5cb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:37.605056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2ef3af54-4bd3-44fb-954d-7a1efe26a5cb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:37.608338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2ef3af54-4bd3-44fb-954d-7a1efe26a5cb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:37.611600 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ef3af54-4bd3-44fb-954d-7a1efe26a5cb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1740 microversion: 2.20 time: 0.221707 Jul 20 04:43:37.616920 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3008/6007] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:37 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:37.626245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1b0767cb-3dd3-4b1a-9324-1a393027faea tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:37.634059 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1b0767cb-3dd3-4b1a-9324-1a393027faea tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1216 microversion: 2.1 time: 0.802303 Jul 20 04:43:37.634736 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3000/6008] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:36 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1216 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:38.033762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-197296b9-4d95-4332-a97d-ff26c2f8bc6d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:38.034680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-197296b9-4d95-4332-a97d-ff26c2f8bc6d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:38.041931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-197296b9-4d95-4332-a97d-ff26c2f8bc6d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.042655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-197296b9-4d95-4332-a97d-ff26c2f8bc6d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.043582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-197296b9-4d95-4332-a97d-ff26c2f8bc6d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.044296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-197296b9-4d95-4332-a97d-ff26c2f8bc6d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.081327 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-197296b9-4d95-4332-a97d-ff26c2f8bc6d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051566 Jul 20 04:43:38.085586 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3009/6009] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:38 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:38.631866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ef305112-87e9-40b9-be9d-17a564d39a3c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:38.633192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ef305112-87e9-40b9-be9d-17a564d39a3c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:38.652532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1d7e249a-994f-45a1-8bbf-c49ec7cea7e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:38.654485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1d7e249a-994f-45a1-8bbf-c49ec7cea7e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:38.662153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d7e249a-994f-45a1-8bbf-c49ec7cea7e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.667379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef305112-87e9-40b9-be9d-17a564d39a3c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.676016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d7e249a-994f-45a1-8bbf-c49ec7cea7e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.677243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef305112-87e9-40b9-be9d-17a564d39a3c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.680026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d7e249a-994f-45a1-8bbf-c49ec7cea7e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.681082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef305112-87e9-40b9-be9d-17a564d39a3c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.681686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d7e249a-994f-45a1-8bbf-c49ec7cea7e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.687868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef305112-87e9-40b9-be9d-17a564d39a3c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:39.070277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ef305112-87e9-40b9-be9d-17a564d39a3c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:39.082095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ef305112-87e9-40b9-be9d-17a564d39a3c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:39.084434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ef305112-87e9-40b9-be9d-17a564d39a3c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:39.086206 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ef305112-87e9-40b9-be9d-17a564d39a3c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1740 microversion: 2.20 time: 0.458894 Jul 20 04:43:39.087371 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3001/6010] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:38 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1740 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:39.094220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-04d30cab-8a69-4a6b-8016-97e2304e8463 req-4944472e-8f15-4488-afaf-7dae0f8f8c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4701d59a-a341-4429-940a-503c0f49bbb8", "name": "network-vif-plugged", "status": "completed", "tag": "c91054e7-36ad-4022-ace1-1d2e1ce11b8b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:39.108499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-04d30cab-8a69-4a6b-8016-97e2304e8463 req-4944472e-8f15-4488-afaf-7dae0f8f8c79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:39.109329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-04d30cab-8a69-4a6b-8016-97e2304e8463 req-4944472e-8f15-4488-afaf-7dae0f8f8c79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:39.112766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d7e249a-994f-45a1-8bbf-c49ec7cea7e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:39.128830 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-04d30cab-8a69-4a6b-8016-97e2304e8463 req-4944472e-8f15-4488-afaf-7dae0f8f8c79 service nova] Creating event network-vif-plugged:c91054e7-36ad-4022-ace1-1d2e1ce11b8b for instance 4701d59a-a341-4429-940a-503c0f49bbb8 on n-h1-760456-11 Jul 20 04:43:39.130889 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1d7e249a-994f-45a1-8bbf-c49ec7cea7e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1216 microversion: 2.1 time: 0.473430 Jul 20 04:43:39.132193 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3010/6011] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:38 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1216 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:39.139042 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-04d30cab-8a69-4a6b-8016-97e2304e8463 req-4944472e-8f15-4488-afaf-7dae0f8f8c79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050070 Jul 20 04:43:39.140456 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3002/6012] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:39.146024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-43d2bd4b-4425-4479-ab4f-8badbdd41f1d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:39.158112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-43d2bd4b-4425-4479-ab4f-8badbdd41f1d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:39.171739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43d2bd4b-4425-4479-ab4f-8badbdd41f1d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:39.172243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43d2bd4b-4425-4479-ab4f-8badbdd41f1d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:39.174154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43d2bd4b-4425-4479-ab4f-8badbdd41f1d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:39.174643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-43d2bd4b-4425-4479-ab4f-8badbdd41f1d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:39.261624 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-43d2bd4b-4425-4479-ab4f-8badbdd41f1d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126038 Jul 20 04:43:39.267405 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3011/6013] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:39 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:40.116797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b770d20b-a4dc-4833-8122-948e1c046519 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:40.117516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b770d20b-a4dc-4833-8122-948e1c046519 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:40.137137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b770d20b-a4dc-4833-8122-948e1c046519 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.140663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b770d20b-a4dc-4833-8122-948e1c046519 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.141942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b770d20b-a4dc-4833-8122-948e1c046519 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.145670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b770d20b-a4dc-4833-8122-948e1c046519 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.151221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-125b8f16-2f8f-436f-9f9d-1ecff8d73515 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:40.151866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-125b8f16-2f8f-436f-9f9d-1ecff8d73515 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:40.172714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-125b8f16-2f8f-436f-9f9d-1ecff8d73515 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.172714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-125b8f16-2f8f-436f-9f9d-1ecff8d73515 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.178017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-125b8f16-2f8f-436f-9f9d-1ecff8d73515 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.178626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-125b8f16-2f8f-436f-9f9d-1ecff8d73515 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.467453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b770d20b-a4dc-4833-8122-948e1c046519 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:40.477133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b770d20b-a4dc-4833-8122-948e1c046519 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:40.480106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b770d20b-a4dc-4833-8122-948e1c046519 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:40.484528 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b770d20b-a4dc-4833-8122-948e1c046519 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1740 microversion: 2.20 time: 0.373475 Jul 20 04:43:40.486846 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3003/6014] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:40 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1740 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:40.513240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d38578ef-1593-42e1-a614-571f3fae082e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:40.515085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d38578ef-1593-42e1-a614-571f3fae082e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:40.523606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-125b8f16-2f8f-436f-9f9d-1ecff8d73515 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:40.532494 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-125b8f16-2f8f-436f-9f9d-1ecff8d73515 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1216 microversion: 2.1 time: 0.385395 Jul 20 04:43:40.549540 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3012/6015] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:40 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1216 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:40.551981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d38578ef-1593-42e1-a614-571f3fae082e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.553663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d38578ef-1593-42e1-a614-571f3fae082e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.554708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d38578ef-1593-42e1-a614-571f3fae082e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:40.558042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d38578ef-1593-42e1-a614-571f3fae082e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:40.634847 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d38578ef-1593-42e1-a614-571f3fae082e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133971 Jul 20 04:43:40.636028 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3004/6016] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:40 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:41.508721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e87b29f6-bbed-437b-86ca-b8d0d0ab2ef8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:41.508721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e87b29f6-bbed-437b-86ca-b8d0d0ab2ef8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:41.517142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e87b29f6-bbed-437b-86ca-b8d0d0ab2ef8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.517816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e87b29f6-bbed-437b-86ca-b8d0d0ab2ef8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.518802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e87b29f6-bbed-437b-86ca-b8d0d0ab2ef8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.519337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e87b29f6-bbed-437b-86ca-b8d0d0ab2ef8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.559376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a93064ed-d367-448a-b02a-2f6550add8a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:41.560200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a93064ed-d367-448a-b02a-2f6550add8a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:41.573206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:41.576324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a93064ed-d367-448a-b02a-2f6550add8a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.577024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a93064ed-d367-448a-b02a-2f6550add8a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.578336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a93064ed-d367-448a-b02a-2f6550add8a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.579173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a93064ed-d367-448a-b02a-2f6550add8a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.753467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a93064ed-d367-448a-b02a-2f6550add8a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:41.766283 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a93064ed-d367-448a-b02a-2f6550add8a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1403 microversion: 2.1 time: 0.214070 Jul 20 04:43:41.778733 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3005/6017] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:41 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1403 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:41.784050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8ba3b36e-08b0-4f15-9725-24046110846e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:41.785304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8ba3b36e-08b0-4f15-9725-24046110846e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:41.792134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ba3b36e-08b0-4f15-9725-24046110846e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.792767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ba3b36e-08b0-4f15-9725-24046110846e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.794394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ba3b36e-08b0-4f15-9725-24046110846e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.795008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8ba3b36e-08b0-4f15-9725-24046110846e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.807870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e87b29f6-bbed-437b-86ca-b8d0d0ab2ef8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:41.817944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:41.819133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e87b29f6-bbed-437b-86ca-b8d0d0ab2ef8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:41.825655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e87b29f6-bbed-437b-86ca-b8d0d0ab2ef8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:41.826955 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e87b29f6-bbed-437b-86ca-b8d0d0ab2ef8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1722 microversion: 2.20 time: 0.325635 Jul 20 04:43:41.827547 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3013/6018] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:41 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:41.832511 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8ba3b36e-08b0-4f15-9725-24046110846e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052297 Jul 20 04:43:41.833291 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3006/6019] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:41 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:41.842539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d58f1603-9f9c-4420-b694-54b2a3b1006c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:41.843164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d58f1603-9f9c-4420-b694-54b2a3b1006c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:41.849307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d58f1603-9f9c-4420-b694-54b2a3b1006c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.849775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d58f1603-9f9c-4420-b694-54b2a3b1006c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.850761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d58f1603-9f9c-4420-b694-54b2a3b1006c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.851212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d58f1603-9f9c-4420-b694-54b2a3b1006c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.062004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d58f1603-9f9c-4420-b694-54b2a3b1006c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:42.084617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d58f1603-9f9c-4420-b694-54b2a3b1006c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1403 microversion: 2.1 time: 0.255885 Jul 20 04:43:42.085607 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3014/6020] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:41 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1403 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:42.103682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-03b683ee-63d5-4201-9379-d97a15b82847 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-565267204"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:42.104735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-03b683ee-63d5-4201-9379-d97a15b82847 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:42.126631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03b683ee-63d5-4201-9379-d97a15b82847 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.127579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03b683ee-63d5-4201-9379-d97a15b82847 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.128679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03b683ee-63d5-4201-9379-d97a15b82847 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.129469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03b683ee-63d5-4201-9379-d97a15b82847 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.253535 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.compute.api [None req-03b683ee-63d5-4201-9379-d97a15b82847 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Attempting to quiesce instance before volume snapshot. Jul 20 04:43:42.308523 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.compute.api [None req-03b683ee-63d5-4201-9379-d97a15b82847 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 20 04:43:42.413353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-03b683ee-63d5-4201-9379-d97a15b82847 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Creating snapshot from volume 1113e2fb-aa6d-433e-afa1-614207d645b1. {{(pid=119605) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 20 04:43:42.844967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3f2bf082-5e03-4747-8f88-829ed50a67a1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:42.846473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3f2bf082-5e03-4747-8f88-829ed50a67a1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:42.853830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f2bf082-5e03-4747-8f88-829ed50a67a1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.854560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f2bf082-5e03-4747-8f88-829ed50a67a1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.855476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f2bf082-5e03-4747-8f88-829ed50a67a1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.856594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3f2bf082-5e03-4747-8f88-829ed50a67a1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.889811 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3f2bf082-5e03-4747-8f88-829ed50a67a1 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048731 Jul 20 04:43:42.894350 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3015/6021] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:42 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:43:42.899512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a28eb39f-cb5a-4c71-ac43-618a5e96341b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:42.900322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a28eb39f-cb5a-4c71-ac43-618a5e96341b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:42.907526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a28eb39f-cb5a-4c71-ac43-618a5e96341b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.908200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a28eb39f-cb5a-4c71-ac43-618a5e96341b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.909162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a28eb39f-cb5a-4c71-ac43-618a5e96341b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.909763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a28eb39f-cb5a-4c71-ac43-618a5e96341b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.093536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a28eb39f-cb5a-4c71-ac43-618a5e96341b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:43.115522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a28eb39f-cb5a-4c71-ac43-618a5e96341b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:43.120020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a28eb39f-cb5a-4c71-ac43-618a5e96341b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:43.133717 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a28eb39f-cb5a-4c71-ac43-618a5e96341b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1722 microversion: 2.20 time: 0.237899 Jul 20 04:43:43.134480 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3016/6022] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:42 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:43.617271 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-03b683ee-63d5-4201-9379-d97a15b82847 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "POST /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8/action" status: 202 len: 0 microversion: 2.1 time: 1.517637 Jul 20 04:43:43.617916 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3007/6023] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:42 2022] POST /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8/action => generated 0 bytes in 1519 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:43:43.901705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1f704ae-354b-427e-afd8-4fc53dd7ab2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:43.902945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1f704ae-354b-427e-afd8-4fc53dd7ab2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:43.910584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1f704ae-354b-427e-afd8-4fc53dd7ab2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.911044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1f704ae-354b-427e-afd8-4fc53dd7ab2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.911897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1f704ae-354b-427e-afd8-4fc53dd7ab2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.917686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1f704ae-354b-427e-afd8-4fc53dd7ab2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.956121 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1f704ae-354b-427e-afd8-4fc53dd7ab2d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058547 Jul 20 04:43:43.960121 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3017/6024] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 04:43:43 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:43:44.035973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1840aadf-bd6e-433f-88cc-6d219ac03a3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:44.037095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1840aadf-bd6e-433f-88cc-6d219ac03a3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.046990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1840aadf-bd6e-433f-88cc-6d219ac03a3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.047461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1840aadf-bd6e-433f-88cc-6d219ac03a3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.048264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1840aadf-bd6e-433f-88cc-6d219ac03a3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.049141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1840aadf-bd6e-433f-88cc-6d219ac03a3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.087089 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-1840aadf-bd6e-433f-88cc-6d219ac03a3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] HTTP exception thrown: Cannot 'reboot' instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 while it is in vm_state rescued Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1840aadf-bd6e-433f-88cc-6d219ac03a3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Request method failure captured: Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4/action HTTP/1.1 Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 28 Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14cVvlyFQK0Hky763YtJNZmga-seuiHv50lzr8c708UaBjY5LhinFPM_QzRPumN7lebUV8SaN9g5W8Pjefaa4UE9X-ySIx3izX52Mcn-dmW_45ztV_oVGdlJV1fLy4MHx9SEfL5owl8e_frcmqcUAJfCEXDSfh8n8iumlmvk569aBtU Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9138f252886e4faea3710ff7d6764683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9138f252886e4faea3710ff7d6764683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: eff6843f674047fc9a8841711244bce4 Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: {"reboot": {"type": "HARD"}} Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: exception: Cannot 'reboot' instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 while it is in vm_state rescued Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '068784e2-fe5a-49a2-a481-0bea8a21c0f4', 'body': {'reboot': {'type': 'HARD'}}} Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:43:44.089057 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 while it is in vm_state rescued Jul 20 04:43:44.094313 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:43:44.094313 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:44.094313 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:43:44.094313 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:44.094313 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:44.094313 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:44.094313 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:44.094313 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:44.094313 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 while it is in vm_state rescued Jul 20 04:43:44.094313 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:43:44.095268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1840aadf-bd6e-433f-88cc-6d219ac03a3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Returning 409 to user: Cannot 'reboot' instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 while it is in vm_state rescued {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:44.101864 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1840aadf-bd6e-433f-88cc-6d219ac03a3c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4/action" status: 409 len: 145 microversion: 2.1 time: 0.064694 Jul 20 04:43:44.101864 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3008/6025] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:44 2022] POST /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4/action => generated 145 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:43:44.107711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-81736154-42a9-415a-b74f-3574f7dac7ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:44.109185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-81736154-42a9-415a-b74f-3574f7dac7ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.117255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81736154-42a9-415a-b74f-3574f7dac7ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.117715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81736154-42a9-415a-b74f-3574f7dac7ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.118590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81736154-42a9-415a-b74f-3574f7dac7ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.119040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81736154-42a9-415a-b74f-3574f7dac7ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.155059 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-81736154-42a9-415a-b74f-3574f7dac7ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] HTTP exception thrown: Cannot 'rebuild' instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 while it is in vm_state rescued Jul 20 04:43:44.156351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b0e1698a-679d-4b8b-ad76-1114e4db2b10 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:44.156990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b0e1698a-679d-4b8b-ad76-1114e4db2b10 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-81736154-42a9-415a-b74f-3574f7dac7ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Request method failure captured: Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4/action HTTP/1.1 Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 65 Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cVvlyFQK0Hky763YtJNZmga-seuiHv50lzr8c708UaBjY5LhinFPM_QzRPumN7lebUV8SaN9g5W8Pjefaa4UE9X-ySIx3izX52Mcn-dmW_45ztV_oVGdlJV1fLy4MHx9SEfL5owl8e_frcmqcUAJfCEXDSfh8n8iumlmvk569aBtU Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9138f252886e4faea3710ff7d6764683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9138f252886e4faea3710ff7d6764683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: eff6843f674047fc9a8841711244bce4 Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: {"rebuild": {"imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b"}} Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: exception: Cannot 'rebuild' instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 while it is in vm_state rescued Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '068784e2-fe5a-49a2-a481-0bea8a21c0f4', 'body': {'rebuild': {'imageRef': 'e42aeec8-ce44-4145-9a4d-e614edbe956b'}}} Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:43:44.157299 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 while it is in vm_state rescued Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 while it is in vm_state rescued Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-81736154-42a9-415a-b74f-3574f7dac7ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Returning 409 to user: Cannot 'rebuild' instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 while it is in vm_state rescued {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-81736154-42a9-415a-b74f-3574f7dac7ce tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "POST /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4/action" status: 409 len: 146 microversion: 2.1 time: 0.057013 Jul 20 04:43:44.161558 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3018/6026] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:43:44 2022] POST /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4/action => generated 146 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:43:44.180245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17ef7294-66b0-4dda-b78b-c7a755da337b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:44.180775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-17ef7294-66b0-4dda-b78b-c7a755da337b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.182302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0e1698a-679d-4b8b-ad76-1114e4db2b10 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.182853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0e1698a-679d-4b8b-ad76-1114e4db2b10 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.183790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0e1698a-679d-4b8b-ad76-1114e4db2b10 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.184271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0e1698a-679d-4b8b-ad76-1114e4db2b10 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.190331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17ef7294-66b0-4dda-b78b-c7a755da337b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.195038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17ef7294-66b0-4dda-b78b-c7a755da337b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.195948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17ef7294-66b0-4dda-b78b-c7a755da337b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.196452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17ef7294-66b0-4dda-b78b-c7a755da337b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.291167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-17ef7294-66b0-4dda-b78b-c7a755da337b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:43:44.415392 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-17ef7294-66b0-4dda-b78b-c7a755da337b tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "DELETE /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 204 len: 0 microversion: 2.1 time: 0.249143 Jul 20 04:43:44.416544 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3019/6027] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:43:44 2022] DELETE /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:43:44.425335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-15bc6e61-e900-410a-9b1b-35b397d8cec3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:44.426198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-15bc6e61-e900-410a-9b1b-35b397d8cec3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.433291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15bc6e61-e900-410a-9b1b-35b397d8cec3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.435676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15bc6e61-e900-410a-9b1b-35b397d8cec3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.436650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15bc6e61-e900-410a-9b1b-35b397d8cec3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.437247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15bc6e61-e900-410a-9b1b-35b397d8cec3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.460691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0e1698a-679d-4b8b-ad76-1114e4db2b10 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:44.469928 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0e1698a-679d-4b8b-ad76-1114e4db2b10 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:44.471592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0e1698a-679d-4b8b-ad76-1114e4db2b10 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:44.472821 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b0e1698a-679d-4b8b-ad76-1114e4db2b10 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1725 microversion: 2.20 time: 0.323449 Jul 20 04:43:44.473564 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3009/6028] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:44 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:44.493102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-200b3459-bbeb-47ee-9210-e461216deb2d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f4fc6a7-5dfb-46d4-ba0b-5ca5c101e9a9"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:44.494183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-200b3459-bbeb-47ee-9210-e461216deb2d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.501776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-200b3459-bbeb-47ee-9210-e461216deb2d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.502344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-200b3459-bbeb-47ee-9210-e461216deb2d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.503162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-200b3459-bbeb-47ee-9210-e461216deb2d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.503624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-200b3459-bbeb-47ee-9210-e461216deb2d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.600539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-15bc6e61-e900-410a-9b1b-35b397d8cec3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:44.608873 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-15bc6e61-e900-410a-9b1b-35b397d8cec3 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1688 microversion: 2.1 time: 0.187742 Jul 20 04:43:44.609459 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3020/6029] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:44 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:44.785080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-32a8f82c-5476-4ef7-ac4a-6a8fdbb16b95 req-db0d74ab-b12a-4aca-8184-2150d30304b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3973340-115d-4612-a266-e4403274d648", "name": "network-vif-unplugged", "status": "completed", "tag": "d14f90e5-dbf1-405a-80b2-d712f8275251"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:44.800798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-32a8f82c-5476-4ef7-ac4a-6a8fdbb16b95 req-db0d74ab-b12a-4aca-8184-2150d30304b5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.801448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-32a8f82c-5476-4ef7-ac4a-6a8fdbb16b95 req-db0d74ab-b12a-4aca-8184-2150d30304b5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.802276 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-200b3459-bbeb-47ee-9210-e461216deb2d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "POST /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312903 Jul 20 04:43:44.810277 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3010/6030] 10.222.0.59 () {62 vars in 1363 bytes} [Wed Jul 20 04:43:44 2022] POST /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments => generated 188 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:43:44.822050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.compute.server_external_events [req-32a8f82c-5476-4ef7-ac4a-6a8fdbb16b95 req-db0d74ab-b12a-4aca-8184-2150d30304b5 service nova] Unable to find a host for instance f3973340-115d-4612-a266-e4403274d648. Dropping event network-vif-unplugged {{(pid=119606) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:43:44.823246 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-32a8f82c-5476-4ef7-ac4a-6a8fdbb16b95 req-db0d74ab-b12a-4aca-8184-2150d30304b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042693 Jul 20 04:43:44.824472 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3021/6031] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 04:43:44.844360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1705254596", "imageRef": "9f5688aa-051e-4876-99d4-099acf999063", "flavorRef": "452", "networks": [{"uuid": "ff98390c-0468-4cc8-9649-ee7fac3db692"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:44.901305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] validate_networks() for [('ff98390c-0468-4cc8-9649-ee7fac3db692', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:43:44.932957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9f6ee5e-bb5d-4b29-87b1-a200dd5c4173 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:44.933641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c9f6ee5e-bb5d-4b29-87b1-a200dd5c4173 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.940824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9f6ee5e-bb5d-4b29-87b1-a200dd5c4173 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.941369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9f6ee5e-bb5d-4b29-87b1-a200dd5c4173 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.942164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9f6ee5e-bb5d-4b29-87b1-a200dd5c4173 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.942650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9f6ee5e-bb5d-4b29-87b1-a200dd5c4173 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.146677 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c9f6ee5e-bb5d-4b29-87b1-a200dd5c4173 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "POST /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/action" status: 202 len: 0 microversion: 2.20 time: 0.217662 Jul 20 04:43:45.147467 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3022/6032] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:43:44 2022] POST /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:43:45.156018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8eb69c44-a7db-44cf-81f3-e13c3292400f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:45.156646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8eb69c44-a7db-44cf-81f3-e13c3292400f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:45.162790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb69c44-a7db-44cf-81f3-e13c3292400f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.163253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb69c44-a7db-44cf-81f3-e13c3292400f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.164153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb69c44-a7db-44cf-81f3-e13c3292400f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.164592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8eb69c44-a7db-44cf-81f3-e13c3292400f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.169155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:45.309670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:43:45.310289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:43:45.310828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:43:45.311272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:43:45.311708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:43:45.323312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.323794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.325523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.326117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.327659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8eb69c44-a7db-44cf-81f3-e13c3292400f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.336373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8eb69c44-a7db-44cf-81f3-e13c3292400f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.338902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8eb69c44-a7db-44cf-81f3-e13c3292400f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.340896 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8eb69c44-a7db-44cf-81f3-e13c3292400f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1751 microversion: 2.20 time: 0.188917 Jul 20 04:43:45.341704 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3023/6033] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:45 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:43:45.354727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:45.360989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for user f1067c18d4074c78a512d89e07141915 and project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:45.381766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:43:45.381766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b930de11-8b64-4ce4-8419-92b41da8316c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:43:45.470989 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c388f771-785e-4138-a9be-e6957bb10657 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629523 Jul 20 04:43:45.472069 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3011/6034] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:43:45.483529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c2f6cac9-82c5-4fc1-8cc5-f067607af9d7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:45.484374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c2f6cac9-82c5-4fc1-8cc5-f067607af9d7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:45.581196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c2f6cac9-82c5-4fc1-8cc5-f067607af9d7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.588530 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c2f6cac9-82c5-4fc1-8cc5-f067607af9d7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1230 microversion: 2.1 time: 0.110438 Jul 20 04:43:45.589388 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3024/6035] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:45 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:45.628997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f1d17902-6023-4e2e-bc15-db7f03a2871f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:45.629647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f1d17902-6023-4e2e-bc15-db7f03a2871f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:45.640507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1d17902-6023-4e2e-bc15-db7f03a2871f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.641330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1d17902-6023-4e2e-bc15-db7f03a2871f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.642916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1d17902-6023-4e2e-bc15-db7f03a2871f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.644639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f1d17902-6023-4e2e-bc15-db7f03a2871f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.861801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f1d17902-6023-4e2e-bc15-db7f03a2871f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.873154 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f1d17902-6023-4e2e-bc15-db7f03a2871f tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1688 microversion: 2.1 time: 0.249749 Jul 20 04:43:45.873813 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3012/6036] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:45 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1688 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:46.360575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea0c94f0-7165-4d0f-b35d-06786fc6412c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:46.361197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea0c94f0-7165-4d0f-b35d-06786fc6412c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:46.369405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea0c94f0-7165-4d0f-b35d-06786fc6412c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.369884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea0c94f0-7165-4d0f-b35d-06786fc6412c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.370727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea0c94f0-7165-4d0f-b35d-06786fc6412c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.371184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea0c94f0-7165-4d0f-b35d-06786fc6412c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.506997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ea0c94f0-7165-4d0f-b35d-06786fc6412c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:46.516008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ea0c94f0-7165-4d0f-b35d-06786fc6412c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:46.517648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ea0c94f0-7165-4d0f-b35d-06786fc6412c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:46.518982 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea0c94f0-7165-4d0f-b35d-06786fc6412c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1751 microversion: 2.20 time: 0.163107 Jul 20 04:43:46.519647 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3025/6037] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:46 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:46.606780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b0e6e2a7-20b4-4b43-af16-37d43d2f8b8d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:46.607916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b0e6e2a7-20b4-4b43-af16-37d43d2f8b8d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:46.614536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0e6e2a7-20b4-4b43-af16-37d43d2f8b8d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.614943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0e6e2a7-20b4-4b43-af16-37d43d2f8b8d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.615741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0e6e2a7-20b4-4b43-af16-37d43d2f8b8d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.616199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0e6e2a7-20b4-4b43-af16-37d43d2f8b8d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.681160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0e6e2a7-20b4-4b43-af16-37d43d2f8b8d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:46.688910 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b0e6e2a7-20b4-4b43-af16-37d43d2f8b8d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1234 microversion: 2.1 time: 0.086845 Jul 20 04:43:46.689486 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3013/6038] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:46 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:46.891868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-704ce312-3779-4dbe-9749-3e0c5f8f58a0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:46.892547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-704ce312-3779-4dbe-9749-3e0c5f8f58a0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:46.899327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-704ce312-3779-4dbe-9749-3e0c5f8f58a0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.899866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-704ce312-3779-4dbe-9749-3e0c5f8f58a0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.900683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-704ce312-3779-4dbe-9749-3e0c5f8f58a0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.901423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-704ce312-3779-4dbe-9749-3e0c5f8f58a0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.067387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-704ce312-3779-4dbe-9749-3e0c5f8f58a0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.076189 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-704ce312-3779-4dbe-9749-3e0c5f8f58a0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1688 microversion: 2.1 time: 0.189287 Jul 20 04:43:47.076953 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3026/6039] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:46 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:47.538291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-74f8e555-a7e0-423d-a4cc-96fca86595d6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:47.539069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-74f8e555-a7e0-423d-a4cc-96fca86595d6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:47.546855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74f8e555-a7e0-423d-a4cc-96fca86595d6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.547625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74f8e555-a7e0-423d-a4cc-96fca86595d6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.548562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74f8e555-a7e0-423d-a4cc-96fca86595d6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.549093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74f8e555-a7e0-423d-a4cc-96fca86595d6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.696049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-74f8e555-a7e0-423d-a4cc-96fca86595d6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.706175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59ca8781-ab52-4262-9735-971ca73c41c2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:47.707640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-74f8e555-a7e0-423d-a4cc-96fca86595d6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.709958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-74f8e555-a7e0-423d-a4cc-96fca86595d6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.711790 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-74f8e555-a7e0-423d-a4cc-96fca86595d6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1753 microversion: 2.20 time: 0.177517 Jul 20 04:43:47.712944 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3014/6040] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:47 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:47.716893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-59ca8781-ab52-4262-9735-971ca73c41c2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:47.724686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59ca8781-ab52-4262-9735-971ca73c41c2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.725156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59ca8781-ab52-4262-9735-971ca73c41c2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.725959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59ca8781-ab52-4262-9735-971ca73c41c2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.726442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59ca8781-ab52-4262-9735-971ca73c41c2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.896202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-59ca8781-ab52-4262-9735-971ca73c41c2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.906901 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-59ca8781-ab52-4262-9735-971ca73c41c2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1282 microversion: 2.1 time: 0.204960 Jul 20 04:43:47.920164 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3027/6041] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:47 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1282 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:48.094027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6dc6e84c-db85-407b-9041-0c29bab9642e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:48.094944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6dc6e84c-db85-407b-9041-0c29bab9642e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:48.103646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc6e84c-db85-407b-9041-0c29bab9642e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.104478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc6e84c-db85-407b-9041-0c29bab9642e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.105543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc6e84c-db85-407b-9041-0c29bab9642e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.107042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc6e84c-db85-407b-9041-0c29bab9642e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.559883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6dc6e84c-db85-407b-9041-0c29bab9642e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:48.571454 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6dc6e84c-db85-407b-9041-0c29bab9642e tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1688 microversion: 2.1 time: 0.481916 Jul 20 04:43:48.572685 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3015/6042] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:48 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1688 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:48.730370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd8b6a2b-10ab-46ec-aa2e-1a9a77ab5cb5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:48.731590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dd8b6a2b-10ab-46ec-aa2e-1a9a77ab5cb5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:48.754609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd8b6a2b-10ab-46ec-aa2e-1a9a77ab5cb5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.763329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd8b6a2b-10ab-46ec-aa2e-1a9a77ab5cb5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.764753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd8b6a2b-10ab-46ec-aa2e-1a9a77ab5cb5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.768543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dd8b6a2b-10ab-46ec-aa2e-1a9a77ab5cb5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.927641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-57152e43-87a0-4344-878b-aa9340054317 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:48.928563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-57152e43-87a0-4344-878b-aa9340054317 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:48.945775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57152e43-87a0-4344-878b-aa9340054317 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.946595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57152e43-87a0-4344-878b-aa9340054317 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.954044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57152e43-87a0-4344-878b-aa9340054317 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.957808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57152e43-87a0-4344-878b-aa9340054317 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.333114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dd8b6a2b-10ab-46ec-aa2e-1a9a77ab5cb5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.346606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dd8b6a2b-10ab-46ec-aa2e-1a9a77ab5cb5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.350713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dd8b6a2b-10ab-46ec-aa2e-1a9a77ab5cb5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.352467 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dd8b6a2b-10ab-46ec-aa2e-1a9a77ab5cb5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1753 microversion: 2.20 time: 0.626889 Jul 20 04:43:49.365184 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3028/6043] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:48 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1753 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:49.414601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-57152e43-87a0-4344-878b-aa9340054317 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.428750 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-57152e43-87a0-4344-878b-aa9340054317 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.505469 Jul 20 04:43:49.432744 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3016/6044] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:48 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:49.597260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-718ff821-2b19-4d86-a37f-7b9351fa4681 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:49.598008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-718ff821-2b19-4d86-a37f-7b9351fa4681 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:49.617200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-718ff821-2b19-4d86-a37f-7b9351fa4681 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.620010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-718ff821-2b19-4d86-a37f-7b9351fa4681 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.628012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b5e012ec-7c94-43f1-8b0c-2e525a953097 req-8e8992b7-1abc-48cb-9191-ef244acd65c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e8ea2f-7c9f-4424-b7af-065fc4225a98", "name": "network-vif-deleted", "tag": "5d69a64b-5903-4704-a9e9-e1d78733d282"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:49.635351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-718ff821-2b19-4d86-a37f-7b9351fa4681 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.645882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-718ff821-2b19-4d86-a37f-7b9351fa4681 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.657487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b5e012ec-7c94-43f1-8b0c-2e525a953097 req-8e8992b7-1abc-48cb-9191-ef244acd65c2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.659246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b5e012ec-7c94-43f1-8b0c-2e525a953097 req-8e8992b7-1abc-48cb-9191-ef244acd65c2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.706444 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b5e012ec-7c94-43f1-8b0c-2e525a953097 req-8e8992b7-1abc-48cb-9191-ef244acd65c2 service nova] Creating event network-vif-deleted:5d69a64b-5903-4704-a9e9-e1d78733d282 for instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 on n-h2-760456-11 Jul 20 04:43:49.718703 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b5e012ec-7c94-43f1-8b0c-2e525a953097 req-8e8992b7-1abc-48cb-9191-ef244acd65c2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094342 Jul 20 04:43:49.723509 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3017/6045] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:49.834599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-718ff821-2b19-4d86-a37f-7b9351fa4681 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.849242 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-718ff821-2b19-4d86-a37f-7b9351fa4681 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 200 len: 1330 microversion: 2.1 time: 0.256662 Jul 20 04:43:49.855020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3029/6046] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:49 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 1330 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:50.376376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e3237bf-1cc5-4b13-8ec9-d0d3bb4241d1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:50.377384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e3237bf-1cc5-4b13-8ec9-d0d3bb4241d1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:50.397198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e3237bf-1cc5-4b13-8ec9-d0d3bb4241d1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.398553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e3237bf-1cc5-4b13-8ec9-d0d3bb4241d1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.399540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e3237bf-1cc5-4b13-8ec9-d0d3bb4241d1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.400699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e3237bf-1cc5-4b13-8ec9-d0d3bb4241d1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.448556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-311cb6d2-8e22-4807-a686-09e9831d10fa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:50.450334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-311cb6d2-8e22-4807-a686-09e9831d10fa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:50.466792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-311cb6d2-8e22-4807-a686-09e9831d10fa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.469984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-311cb6d2-8e22-4807-a686-09e9831d10fa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.471047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-311cb6d2-8e22-4807-a686-09e9831d10fa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.475090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-311cb6d2-8e22-4807-a686-09e9831d10fa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.692463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e3237bf-1cc5-4b13-8ec9-d0d3bb4241d1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.707550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e3237bf-1cc5-4b13-8ec9-d0d3bb4241d1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.723643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e3237bf-1cc5-4b13-8ec9-d0d3bb4241d1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.728514 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e3237bf-1cc5-4b13-8ec9-d0d3bb4241d1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1753 microversion: 2.20 time: 0.359900 Jul 20 04:43:50.731924 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3018/6047] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:50 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1753 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:50.885116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-61063f9f-a030-474a-b1f5-b58b9af24e83 req-fb62c017-8b13-4fbb-ad1d-c60e1b6fd451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5569e35e-e42c-4139-a787-986331f1c751", "tag": "25cec934-537c-4c46-8935-4cbfd3693aff"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:50.908791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-61063f9f-a030-474a-b1f5-b58b9af24e83 req-fb62c017-8b13-4fbb-ad1d-c60e1b6fd451 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.909673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-61063f9f-a030-474a-b1f5-b58b9af24e83 req-fb62c017-8b13-4fbb-ad1d-c60e1b6fd451 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.946863 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-61063f9f-a030-474a-b1f5-b58b9af24e83 req-fb62c017-8b13-4fbb-ad1d-c60e1b6fd451 service nova] Creating event network-changed:25cec934-537c-4c46-8935-4cbfd3693aff for instance 5569e35e-e42c-4139-a787-986331f1c751 on n-h2-760456-11 Jul 20 04:43:50.962555 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-61063f9f-a030-474a-b1f5-b58b9af24e83 req-fb62c017-8b13-4fbb-ad1d-c60e1b6fd451 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227205 Jul 20 04:43:50.967620 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3019/6048] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:50.969792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-311cb6d2-8e22-4807-a686-09e9831d10fa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.977525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7f667e0-4763-4404-93e6-239218607c09 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:50.979070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b7f667e0-4763-4404-93e6-239218607c09 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 24e8ea2f-7c9f-4424-b7af-065fc4225a98] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:50.985167 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-311cb6d2-8e22-4807-a686-09e9831d10fa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.541992 Jul 20 04:43:50.985777 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3030/6049] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:50 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:50.988539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7f667e0-4763-4404-93e6-239218607c09 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.990091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7f667e0-4763-4404-93e6-239218607c09 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.991137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7f667e0-4763-4404-93e6-239218607c09 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.991805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7f667e0-4763-4404-93e6-239218607c09 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.997619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:51.012071 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-b7f667e0-4763-4404-93e6-239218607c09 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] HTTP exception thrown: Instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 could not be found. Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7f667e0-4763-4404-93e6-239218607c09 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Request method failure captured: Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 HTTP/1.1 Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14cVvlyFQK0Hky763YtJNZmga-seuiHv50lzr8c708UaBjY5LhinFPM_QzRPumN7lebUV8SaN9g5W8Pjefaa4UE9X-ySIx3izX52Mcn-dmW_45ztV_oVGdlJV1fLy4MHx9SEfL5owl8e_frcmqcUAJfCEXDSfh8n8iumlmvk569aBtU Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9138f252886e4faea3710ff7d6764683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9138f252886e4faea3710ff7d6764683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: eff6843f674047fc9a8841711244bce4 Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 could not be found. Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '24e8ea2f-7c9f-4424-b7af-065fc4225a98'} Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 could not be found. Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 could not be found. Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:51.014514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:43:51.020696 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:51.020696 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:51.020696 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:51.020696 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:51.020696 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:51.020696 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 could not be found. Jul 20 04:43:51.020696 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:43:51.022901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7f667e0-4763-4404-93e6-239218607c09 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Returning 404 to user: Instance 24e8ea2f-7c9f-4424-b7af-065fc4225a98 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:51.024520 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b7f667e0-4763-4404-93e6-239218607c09 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98" status: 404 len: 111 microversion: 2.1 time: 0.055376 Jul 20 04:43:51.026084 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3020/6050] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:50 2022] GET /compute/v2.1/servers/24e8ea2f-7c9f-4424-b7af-065fc4225a98 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:43:51.035597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-445125da-7b8c-414f-8e24-18bce162b8a0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '.version_select at 0x7fb841b0aaf0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:51.059929 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-445125da-7b8c-414f-8e24-18bce162b8a0 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-856948137" status: 202 len: 0 microversion: 2.1 time: 0.028465 Jul 20 04:43:51.061029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3031/6051] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 04:43:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-856948137 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:43:51.756413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-39a8fe8d-1119-420e-a4e2-34ebc97de641 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:51.757352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-39a8fe8d-1119-420e-a4e2-34ebc97de641 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:51.785786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39a8fe8d-1119-420e-a4e2-34ebc97de641 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.786986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39a8fe8d-1119-420e-a4e2-34ebc97de641 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.789942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39a8fe8d-1119-420e-a4e2-34ebc97de641 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.790484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39a8fe8d-1119-420e-a4e2-34ebc97de641 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.006322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be6d44d9-9c65-4ac0-8649-4a068489ef5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:52.007551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-be6d44d9-9c65-4ac0-8649-4a068489ef5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:52.027401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be6d44d9-9c65-4ac0-8649-4a068489ef5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.028225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be6d44d9-9c65-4ac0-8649-4a068489ef5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.029386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be6d44d9-9c65-4ac0-8649-4a068489ef5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.030529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be6d44d9-9c65-4ac0-8649-4a068489ef5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.347493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-be6d44d9-9c65-4ac0-8649-4a068489ef5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.360981 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-be6d44d9-9c65-4ac0-8649-4a068489ef5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.358816 Jul 20 04:43:52.361937 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3032/6052] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:51 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:52.403761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-39a8fe8d-1119-420e-a4e2-34ebc97de641 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.424644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-39a8fe8d-1119-420e-a4e2-34ebc97de641 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.427136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-39a8fe8d-1119-420e-a4e2-34ebc97de641 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.433174 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-39a8fe8d-1119-420e-a4e2-34ebc97de641 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1753 microversion: 2.20 time: 0.687624 Jul 20 04:43:52.435267 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3021/6053] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:51 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1753 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:53.379750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-619d8c80-c953-46e3-b7c8-751718315044 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:53.380880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-619d8c80-c953-46e3-b7c8-751718315044 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:53.388665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-619d8c80-c953-46e3-b7c8-751718315044 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.389343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-619d8c80-c953-46e3-b7c8-751718315044 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.390308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-619d8c80-c953-46e3-b7c8-751718315044 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.390897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-619d8c80-c953-46e3-b7c8-751718315044 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.453252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5bab1f1b-981d-4c3f-a24e-e278dc2b7b8b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:53.456164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5bab1f1b-981d-4c3f-a24e-e278dc2b7b8b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:53.464221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bab1f1b-981d-4c3f-a24e-e278dc2b7b8b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.464887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bab1f1b-981d-4c3f-a24e-e278dc2b7b8b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.467330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bab1f1b-981d-4c3f-a24e-e278dc2b7b8b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.468658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bab1f1b-981d-4c3f-a24e-e278dc2b7b8b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.667221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5bab1f1b-981d-4c3f-a24e-e278dc2b7b8b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:53.697023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5bab1f1b-981d-4c3f-a24e-e278dc2b7b8b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:53.704607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5bab1f1b-981d-4c3f-a24e-e278dc2b7b8b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:53.709456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-619d8c80-c953-46e3-b7c8-751718315044 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:53.721353 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-619d8c80-c953-46e3-b7c8-751718315044 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.345758 Jul 20 04:43:53.722090 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3033/6054] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:53 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:53.722568 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5bab1f1b-981d-4c3f-a24e-e278dc2b7b8b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1753 microversion: 2.20 time: 0.271924 Jul 20 04:43:53.735597 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3022/6055] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:53 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1753 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:43:54.743984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b24b7be8-93a4-498f-a392-fdd9853cfc41 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:54.747409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e7039aef-9ce6-42c0-9f17-3ee691fcb1d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:54.751177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b24b7be8-93a4-498f-a392-fdd9853cfc41 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:54.752532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e7039aef-9ce6-42c0-9f17-3ee691fcb1d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:54.772805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b24b7be8-93a4-498f-a392-fdd9853cfc41 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.773618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b24b7be8-93a4-498f-a392-fdd9853cfc41 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.775733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b24b7be8-93a4-498f-a392-fdd9853cfc41 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.776387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b24b7be8-93a4-498f-a392-fdd9853cfc41 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.795757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7039aef-9ce6-42c0-9f17-3ee691fcb1d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.796675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7039aef-9ce6-42c0-9f17-3ee691fcb1d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.800979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7039aef-9ce6-42c0-9f17-3ee691fcb1d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.801657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7039aef-9ce6-42c0-9f17-3ee691fcb1d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.139230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7039aef-9ce6-42c0-9f17-3ee691fcb1d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:55.149525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7039aef-9ce6-42c0-9f17-3ee691fcb1d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:55.150342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b24b7be8-93a4-498f-a392-fdd9853cfc41 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:55.157314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7039aef-9ce6-42c0-9f17-3ee691fcb1d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:55.159159 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e7039aef-9ce6-42c0-9f17-3ee691fcb1d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1753 microversion: 2.20 time: 0.422328 Jul 20 04:43:55.166854 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b24b7be8-93a4-498f-a392-fdd9853cfc41 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.428298 Jul 20 04:43:55.168576 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3034/6056] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:54 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:55.170402 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3023/6057] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:54 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1753 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:56.206409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-901f3b41-8960-4894-9eab-50eafba52110 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:56.209561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-901f3b41-8960-4894-9eab-50eafba52110 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:56.209700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9a870c9b-41d5-4df2-b317-b1ec0d02157d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:56.213299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9a870c9b-41d5-4df2-b317-b1ec0d02157d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:56.216337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:56.217815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:56.220932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-901f3b41-8960-4894-9eab-50eafba52110 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.222038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-901f3b41-8960-4894-9eab-50eafba52110 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.223159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-901f3b41-8960-4894-9eab-50eafba52110 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.223856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-901f3b41-8960-4894-9eab-50eafba52110 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.231408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:56.265675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a870c9b-41d5-4df2-b317-b1ec0d02157d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.272986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a870c9b-41d5-4df2-b317-b1ec0d02157d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.281800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a870c9b-41d5-4df2-b317-b1ec0d02157d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.284558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a870c9b-41d5-4df2-b317-b1ec0d02157d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.465559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-901f3b41-8960-4894-9eab-50eafba52110 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:56.477656 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-901f3b41-8960-4894-9eab-50eafba52110 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.295020 Jul 20 04:43:56.478783 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3024/6058] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:56 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:56.606362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9a870c9b-41d5-4df2-b317-b1ec0d02157d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:56.626872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9a870c9b-41d5-4df2-b317-b1ec0d02157d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:56.640880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9a870c9b-41d5-4df2-b317-b1ec0d02157d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:56.642627 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9a870c9b-41d5-4df2-b317-b1ec0d02157d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1753 microversion: 2.20 time: 0.453715 Jul 20 04:43:56.643210 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3035/6059] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:56 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1753 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:57.497713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-735744cf-c276-43e2-94da-8b5e4b37cb3d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:57.501720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-735744cf-c276-43e2-94da-8b5e4b37cb3d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:57.509213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-735744cf-c276-43e2-94da-8b5e4b37cb3d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.519680 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-735744cf-c276-43e2-94da-8b5e4b37cb3d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.521548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-735744cf-c276-43e2-94da-8b5e4b37cb3d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.531651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-735744cf-c276-43e2-94da-8b5e4b37cb3d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.664807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-572605f2-2c54-4391-af3c-de2a9dc44e4f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:57.667524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-572605f2-2c54-4391-af3c-de2a9dc44e4f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:57.682726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-572605f2-2c54-4391-af3c-de2a9dc44e4f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.683904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-572605f2-2c54-4391-af3c-de2a9dc44e4f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.685548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-572605f2-2c54-4391-af3c-de2a9dc44e4f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.686335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-572605f2-2c54-4391-af3c-de2a9dc44e4f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.992975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-735744cf-c276-43e2-94da-8b5e4b37cb3d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:58.013686 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-735744cf-c276-43e2-94da-8b5e4b37cb3d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.520673 Jul 20 04:43:58.014703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-572605f2-2c54-4391-af3c-de2a9dc44e4f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:58.018622 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3025/6060] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:57 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:58.037504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-572605f2-2c54-4391-af3c-de2a9dc44e4f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:58.039453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-572605f2-2c54-4391-af3c-de2a9dc44e4f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:58.041051 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-572605f2-2c54-4391-af3c-de2a9dc44e4f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.383275 Jul 20 04:43:58.041866 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3036/6061] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:57 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:59.051671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d7475c7-4460-4a37-8fbf-114c3a0a984a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:59.055017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d7475c7-4460-4a37-8fbf-114c3a0a984a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:59.070349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d7475c7-4460-4a37-8fbf-114c3a0a984a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.072094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d7475c7-4460-4a37-8fbf-114c3a0a984a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:59.073860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d7475c7-4460-4a37-8fbf-114c3a0a984a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.075803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d7475c7-4460-4a37-8fbf-114c3a0a984a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:59.080796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a262f7a2-a013-4fff-8d4b-4d5b645fca05 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:59.081562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a262f7a2-a013-4fff-8d4b-4d5b645fca05 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:59.098595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a262f7a2-a013-4fff-8d4b-4d5b645fca05 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.099511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a262f7a2-a013-4fff-8d4b-4d5b645fca05 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:59.100482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a262f7a2-a013-4fff-8d4b-4d5b645fca05 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.101435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a262f7a2-a013-4fff-8d4b-4d5b645fca05 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:59.458999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a262f7a2-a013-4fff-8d4b-4d5b645fca05 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:59.493823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a262f7a2-a013-4fff-8d4b-4d5b645fca05 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:59.495978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a262f7a2-a013-4fff-8d4b-4d5b645fca05 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:59.498374 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a262f7a2-a013-4fff-8d4b-4d5b645fca05 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.434116 Jul 20 04:43:59.498523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d7475c7-4460-4a37-8fbf-114c3a0a984a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:59.499578 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3037/6062] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:59 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:59.526384 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d7475c7-4460-4a37-8fbf-114c3a0a984a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.488057 Jul 20 04:43:59.530228 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3026/6063] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:59 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:00.521555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f395e378-723d-4e5f-a729-5ff5bfb02520 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:00.522349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f395e378-723d-4e5f-a729-5ff5bfb02520 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:00.544734 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f395e378-723d-4e5f-a729-5ff5bfb02520 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.549045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f395e378-723d-4e5f-a729-5ff5bfb02520 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.554697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f395e378-723d-4e5f-a729-5ff5bfb02520 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.555092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f395e378-723d-4e5f-a729-5ff5bfb02520 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.564828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c74d9d47-52a2-48a2-bbe2-04442b841bf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:00.577631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c74d9d47-52a2-48a2-bbe2-04442b841bf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:00.625208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c74d9d47-52a2-48a2-bbe2-04442b841bf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.626469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c74d9d47-52a2-48a2-bbe2-04442b841bf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.631391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c74d9d47-52a2-48a2-bbe2-04442b841bf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.632906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c74d9d47-52a2-48a2-bbe2-04442b841bf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.044604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f395e378-723d-4e5f-a729-5ff5bfb02520 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:01.049447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c74d9d47-52a2-48a2-bbe2-04442b841bf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:01.055607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f395e378-723d-4e5f-a729-5ff5bfb02520 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:01.057446 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c74d9d47-52a2-48a2-bbe2-04442b841bf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.507131 Jul 20 04:44:01.058050 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3027/6064] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:00 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:01.076193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f395e378-723d-4e5f-a729-5ff5bfb02520 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:01.078161 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f395e378-723d-4e5f-a729-5ff5bfb02520 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.563346 Jul 20 04:44:01.080373 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3038/6065] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:00 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:01.741298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6ebac63-8561-4f9c-abca-b75931ece437 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:01.742950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6ebac63-8561-4f9c-abca-b75931ece437 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:01.754956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6ebac63-8561-4f9c-abca-b75931ece437 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.755720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6ebac63-8561-4f9c-abca-b75931ece437 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.756831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6ebac63-8561-4f9c-abca-b75931ece437 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.757577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6ebac63-8561-4f9c-abca-b75931ece437 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.794032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6ebac63-8561-4f9c-abca-b75931ece437 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:01.952961 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6ebac63-8561-4f9c-abca-b75931ece437 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "DELETE /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 204 len: 0 microversion: 2.1 time: 0.217558 Jul 20 04:44:01.953883 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3028/6066] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:01 2022] DELETE /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:01.962077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5cacc174-7c42-48d6-8ae6-5ae6d6ed7766 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:01.962704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5cacc174-7c42-48d6-8ae6-5ae6d6ed7766 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:01.974911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5cacc174-7c42-48d6-8ae6-5ae6d6ed7766 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.975387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5cacc174-7c42-48d6-8ae6-5ae6d6ed7766 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.980558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5cacc174-7c42-48d6-8ae6-5ae6d6ed7766 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.981345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5cacc174-7c42-48d6-8ae6-5ae6d6ed7766 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.076910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-78c9c191-81a3-487b-8978-ba12f9889062 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:02.077504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-78c9c191-81a3-487b-8978-ba12f9889062 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:02.084335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78c9c191-81a3-487b-8978-ba12f9889062 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.085067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78c9c191-81a3-487b-8978-ba12f9889062 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.085529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78c9c191-81a3-487b-8978-ba12f9889062 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.085997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-78c9c191-81a3-487b-8978-ba12f9889062 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.304777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5cacc174-7c42-48d6-8ae6-5ae6d6ed7766 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:02.318207 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5cacc174-7c42-48d6-8ae6-5ae6d6ed7766 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1506 microversion: 2.1 time: 0.357754 Jul 20 04:44:02.319864 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3039/6067] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:01 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:02.331001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8e3e74f-2eaa-4ece-a77b-8074f3199fef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:02.334920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f8e3e74f-2eaa-4ece-a77b-8074f3199fef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:02.353002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8e3e74f-2eaa-4ece-a77b-8074f3199fef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.353752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8e3e74f-2eaa-4ece-a77b-8074f3199fef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.354779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8e3e74f-2eaa-4ece-a77b-8074f3199fef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.356050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8e3e74f-2eaa-4ece-a77b-8074f3199fef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.388462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-78c9c191-81a3-487b-8978-ba12f9889062 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:02.398031 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-78c9c191-81a3-487b-8978-ba12f9889062 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.326433 Jul 20 04:44:02.409717 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3029/6068] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:02 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:02.573821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f8e3e74f-2eaa-4ece-a77b-8074f3199fef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:02.583923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f8e3e74f-2eaa-4ece-a77b-8074f3199fef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:02.585441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f8e3e74f-2eaa-4ece-a77b-8074f3199fef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:02.586776 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f8e3e74f-2eaa-4ece-a77b-8074f3199fef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.265765 Jul 20 04:44:02.587724 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3040/6069] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:02 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:03.337862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3036ae6-e1d6-492c-953a-acd818086d12 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:03.338849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e3036ae6-e1d6-492c-953a-acd818086d12 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:03.347162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3036ae6-e1d6-492c-953a-acd818086d12 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.347991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3036ae6-e1d6-492c-953a-acd818086d12 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.348809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3036ae6-e1d6-492c-953a-acd818086d12 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.349269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e3036ae6-e1d6-492c-953a-acd818086d12 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.417334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-631c6340-e96a-484c-bda9-3b75d6bbc6c4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:03.420052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-631c6340-e96a-484c-bda9-3b75d6bbc6c4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:03.423655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:03.429704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-631c6340-e96a-484c-bda9-3b75d6bbc6c4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.430384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-631c6340-e96a-484c-bda9-3b75d6bbc6c4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.431206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-631c6340-e96a-484c-bda9-3b75d6bbc6c4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.431692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-631c6340-e96a-484c-bda9-3b75d6bbc6c4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.506549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e3036ae6-e1d6-492c-953a-acd818086d12 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:03.514908 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e3036ae6-e1d6-492c-953a-acd818086d12 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1506 microversion: 2.1 time: 0.182744 Jul 20 04:44:03.515540 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3030/6070] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:03 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:03.575251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-631c6340-e96a-484c-bda9-3b75d6bbc6c4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:03.577748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:03.584716 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-631c6340-e96a-484c-bda9-3b75d6bbc6c4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.171767 Jul 20 04:44:03.585328 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3041/6071] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:03 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:03.605625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3fce1fb1-3478-4e9d-9caf-56e1850c63ba tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:03.606459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3fce1fb1-3478-4e9d-9caf-56e1850c63ba tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:03.620545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3fce1fb1-3478-4e9d-9caf-56e1850c63ba tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.620545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3fce1fb1-3478-4e9d-9caf-56e1850c63ba tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.620545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3fce1fb1-3478-4e9d-9caf-56e1850c63ba tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.620545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3fce1fb1-3478-4e9d-9caf-56e1850c63ba tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.781784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3fce1fb1-3478-4e9d-9caf-56e1850c63ba tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:03.791761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3fce1fb1-3478-4e9d-9caf-56e1850c63ba tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:03.794292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3fce1fb1-3478-4e9d-9caf-56e1850c63ba tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:03.795655 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3fce1fb1-3478-4e9d-9caf-56e1850c63ba tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.194233 Jul 20 04:44:03.796242 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3031/6072] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:03 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:04.533313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d57656a9-87e5-4be9-ade7-4ceb4ac66ec9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:04.533939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d57656a9-87e5-4be9-ade7-4ceb4ac66ec9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:04.548044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d57656a9-87e5-4be9-ade7-4ceb4ac66ec9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.548532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d57656a9-87e5-4be9-ade7-4ceb4ac66ec9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.554407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d57656a9-87e5-4be9-ade7-4ceb4ac66ec9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.556355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d57656a9-87e5-4be9-ade7-4ceb4ac66ec9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.601796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f9d59bbe-4dac-4577-88c9-6963bba613a3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:04.603895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f9d59bbe-4dac-4577-88c9-6963bba613a3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:04.632985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9d59bbe-4dac-4577-88c9-6963bba613a3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.634075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9d59bbe-4dac-4577-88c9-6963bba613a3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.638070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9d59bbe-4dac-4577-88c9-6963bba613a3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.639805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f9d59bbe-4dac-4577-88c9-6963bba613a3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.726823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d57656a9-87e5-4be9-ade7-4ceb4ac66ec9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:04.736667 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d57656a9-87e5-4be9-ade7-4ceb4ac66ec9 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1506 microversion: 2.1 time: 0.207172 Jul 20 04:44:04.738849 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3042/6073] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:04 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:04.816012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e3f43185-2d00-49b0-9133-37f68c90c4cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:04.817629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e3f43185-2d00-49b0-9133-37f68c90c4cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:04.829326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3f43185-2d00-49b0-9133-37f68c90c4cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.829800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3f43185-2d00-49b0-9133-37f68c90c4cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.831021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3f43185-2d00-49b0-9133-37f68c90c4cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.831561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3f43185-2d00-49b0-9133-37f68c90c4cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.918906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f9d59bbe-4dac-4577-88c9-6963bba613a3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:04.922128 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f9d59bbe-4dac-4577-88c9-6963bba613a3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.324534 Jul 20 04:44:04.934597 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3032/6074] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:04 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:05.092611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e3f43185-2d00-49b0-9133-37f68c90c4cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:05.103460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e3f43185-2d00-49b0-9133-37f68c90c4cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:05.106084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e3f43185-2d00-49b0-9133-37f68c90c4cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:05.107885 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e3f43185-2d00-49b0-9133-37f68c90c4cc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.296529 Jul 20 04:44:05.119410 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3043/6075] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:04 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:05.759957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b98d8db1-d22a-43f7-ba31-e4e75fbd8ed5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:05.762295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b98d8db1-d22a-43f7-ba31-e4e75fbd8ed5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:05.772394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b98d8db1-d22a-43f7-ba31-e4e75fbd8ed5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.773234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b98d8db1-d22a-43f7-ba31-e4e75fbd8ed5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.774284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b98d8db1-d22a-43f7-ba31-e4e75fbd8ed5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.775001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b98d8db1-d22a-43f7-ba31-e4e75fbd8ed5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.942333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1c365be6-933b-447d-80da-ec569da9388b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:05.943038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1c365be6-933b-447d-80da-ec569da9388b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:05.964134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c365be6-933b-447d-80da-ec569da9388b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.965360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c365be6-933b-447d-80da-ec569da9388b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.967823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c365be6-933b-447d-80da-ec569da9388b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.968365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1c365be6-933b-447d-80da-ec569da9388b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.029388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b98d8db1-d22a-43f7-ba31-e4e75fbd8ed5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.042080 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b98d8db1-d22a-43f7-ba31-e4e75fbd8ed5 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1506 microversion: 2.1 time: 0.288443 Jul 20 04:44:06.044220 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3033/6076] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:05 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:06.130474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a9541123-c3e2-44ae-9192-d38be3e06ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:06.131251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a9541123-c3e2-44ae-9192-d38be3e06ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:06.145864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9541123-c3e2-44ae-9192-d38be3e06ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:06.151426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9541123-c3e2-44ae-9192-d38be3e06ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.152592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9541123-c3e2-44ae-9192-d38be3e06ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:06.153211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a9541123-c3e2-44ae-9192-d38be3e06ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.171105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1c365be6-933b-447d-80da-ec569da9388b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.181122 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1c365be6-933b-447d-80da-ec569da9388b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.242742 Jul 20 04:44:06.193111 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3044/6077] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:05 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:06.342217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a9541123-c3e2-44ae-9192-d38be3e06ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.351907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a9541123-c3e2-44ae-9192-d38be3e06ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.353652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a9541123-c3e2-44ae-9192-d38be3e06ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.355130 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a9541123-c3e2-44ae-9192-d38be3e06ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.230185 Jul 20 04:44:06.366621 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3034/6078] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:06 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:07.062912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-56a336dd-ec8a-4bfc-a1a1-afa7fda54dca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:07.064159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-56a336dd-ec8a-4bfc-a1a1-afa7fda54dca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:07.072818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56a336dd-ec8a-4bfc-a1a1-afa7fda54dca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.076036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56a336dd-ec8a-4bfc-a1a1-afa7fda54dca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.079832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56a336dd-ec8a-4bfc-a1a1-afa7fda54dca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.084655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-56a336dd-ec8a-4bfc-a1a1-afa7fda54dca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.200319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ef3a369b-a3fe-42be-8721-e9736ffb50f8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:07.200958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ef3a369b-a3fe-42be-8721-e9736ffb50f8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:07.207960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef3a369b-a3fe-42be-8721-e9736ffb50f8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.212908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef3a369b-a3fe-42be-8721-e9736ffb50f8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.214996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef3a369b-a3fe-42be-8721-e9736ffb50f8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.215553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef3a369b-a3fe-42be-8721-e9736ffb50f8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.349720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-56a336dd-ec8a-4bfc-a1a1-afa7fda54dca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.362153 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-56a336dd-ec8a-4bfc-a1a1-afa7fda54dca tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1506 microversion: 2.1 time: 0.303073 Jul 20 04:44:07.362886 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3045/6079] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:07 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:07.375821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c9826aab-f6cc-40c2-aac1-90fb2fbe8f95 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:07.377383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c9826aab-f6cc-40c2-aac1-90fb2fbe8f95 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:07.387922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9826aab-f6cc-40c2-aac1-90fb2fbe8f95 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.388823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9826aab-f6cc-40c2-aac1-90fb2fbe8f95 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.390125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9826aab-f6cc-40c2-aac1-90fb2fbe8f95 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.391172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c9826aab-f6cc-40c2-aac1-90fb2fbe8f95 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.491035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ef3a369b-a3fe-42be-8721-e9736ffb50f8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.494743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:07.515459 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ef3a369b-a3fe-42be-8721-e9736ffb50f8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.319158 Jul 20 04:44:07.516058 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3035/6080] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:07 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:07.614374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c9826aab-f6cc-40c2-aac1-90fb2fbe8f95 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.625291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c9826aab-f6cc-40c2-aac1-90fb2fbe8f95 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.627474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c9826aab-f6cc-40c2-aac1-90fb2fbe8f95 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.628920 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c9826aab-f6cc-40c2-aac1-90fb2fbe8f95 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.259563 Jul 20 04:44:07.629682 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3046/6081] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:07 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:08.385443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7b88394d-1bf4-4884-a09a-5f2c4054a0f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:08.387108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7b88394d-1bf4-4884-a09a-5f2c4054a0f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.407545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b88394d-1bf4-4884-a09a-5f2c4054a0f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.408083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b88394d-1bf4-4884-a09a-5f2c4054a0f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.409149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b88394d-1bf4-4884-a09a-5f2c4054a0f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.409645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7b88394d-1bf4-4884-a09a-5f2c4054a0f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.534582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5f7c0028-44e2-493d-8ee7-277c1a2dfca1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:08.535288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5f7c0028-44e2-493d-8ee7-277c1a2dfca1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.560362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f7c0028-44e2-493d-8ee7-277c1a2dfca1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.562036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f7c0028-44e2-493d-8ee7-277c1a2dfca1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.570457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f7c0028-44e2-493d-8ee7-277c1a2dfca1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.578063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5f7c0028-44e2-493d-8ee7-277c1a2dfca1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.638585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7b88394d-1bf4-4884-a09a-5f2c4054a0f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:08.646454 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7b88394d-1bf4-4884-a09a-5f2c4054a0f2 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1506 microversion: 2.1 time: 0.268754 Jul 20 04:44:08.647349 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3036/6082] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:08 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:08.653013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7e7340e8-6456-42ac-957f-a277028dce7d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:08.653703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7e7340e8-6456-42ac-957f-a277028dce7d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.676040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e7340e8-6456-42ac-957f-a277028dce7d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.677273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e7340e8-6456-42ac-957f-a277028dce7d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.679231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e7340e8-6456-42ac-957f-a277028dce7d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.683381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e7340e8-6456-42ac-957f-a277028dce7d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.844563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5f7c0028-44e2-493d-8ee7-277c1a2dfca1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:08.856285 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5f7c0028-44e2-493d-8ee7-277c1a2dfca1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.326699 Jul 20 04:44:08.857464 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3047/6083] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:08 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:08.894444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7e7340e8-6456-42ac-957f-a277028dce7d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:08.906052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7e7340e8-6456-42ac-957f-a277028dce7d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:08.908600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7e7340e8-6456-42ac-957f-a277028dce7d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:08.910310 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7e7340e8-6456-42ac-957f-a277028dce7d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.261738 Jul 20 04:44:08.922932 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3037/6084] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:08 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:09.666691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7bb4e853-44da-4e40-b71e-87f1e0791b66 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:09.669836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7bb4e853-44da-4e40-b71e-87f1e0791b66 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:09.681293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bb4e853-44da-4e40-b71e-87f1e0791b66 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.682711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bb4e853-44da-4e40-b71e-87f1e0791b66 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.684124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bb4e853-44da-4e40-b71e-87f1e0791b66 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.685110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bb4e853-44da-4e40-b71e-87f1e0791b66 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.877395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c78adb3d-220d-4bf8-9c60-eba4fe7de421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:09.878296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c78adb3d-220d-4bf8-9c60-eba4fe7de421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:09.895449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c78adb3d-220d-4bf8-9c60-eba4fe7de421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.896192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c78adb3d-220d-4bf8-9c60-eba4fe7de421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.897116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c78adb3d-220d-4bf8-9c60-eba4fe7de421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.897670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c78adb3d-220d-4bf8-9c60-eba4fe7de421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.914448 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7bb4e853-44da-4e40-b71e-87f1e0791b66 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.942834 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7bb4e853-44da-4e40-b71e-87f1e0791b66 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1506 microversion: 2.1 time: 0.281250 Jul 20 04:44:09.949450 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3048/6085] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:09 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:09.955208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fbd84dd8-7016-4ee6-ac83-d46b49da3898 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:09.960909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fbd84dd8-7016-4ee6-ac83-d46b49da3898 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:09.967797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbd84dd8-7016-4ee6-ac83-d46b49da3898 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.968373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbd84dd8-7016-4ee6-ac83-d46b49da3898 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.969274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbd84dd8-7016-4ee6-ac83-d46b49da3898 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.970097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbd84dd8-7016-4ee6-ac83-d46b49da3898 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:10.138304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c78adb3d-220d-4bf8-9c60-eba4fe7de421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:10.152642 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c78adb3d-220d-4bf8-9c60-eba4fe7de421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.281654 Jul 20 04:44:10.153211 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3038/6086] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:09 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:10.175624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbd84dd8-7016-4ee6-ac83-d46b49da3898 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:10.186174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbd84dd8-7016-4ee6-ac83-d46b49da3898 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:10.187748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbd84dd8-7016-4ee6-ac83-d46b49da3898 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:10.188981 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fbd84dd8-7016-4ee6-ac83-d46b49da3898 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.237693 Jul 20 04:44:10.189556 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3049/6087] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:09 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:10.965359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c537c2e1-ef28-4270-9ecd-89b41d33b372 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:10.966695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c537c2e1-ef28-4270-9ecd-89b41d33b372 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:10.976588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c537c2e1-ef28-4270-9ecd-89b41d33b372 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:10.977546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c537c2e1-ef28-4270-9ecd-89b41d33b372 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:10.978658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c537c2e1-ef28-4270-9ecd-89b41d33b372 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:10.979389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c537c2e1-ef28-4270-9ecd-89b41d33b372 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.134551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c537c2e1-ef28-4270-9ecd-89b41d33b372 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.143896 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c537c2e1-ef28-4270-9ecd-89b41d33b372 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1506 microversion: 2.1 time: 0.182445 Jul 20 04:44:11.144640 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3039/6088] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:10 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:11.170929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ed0ba713-a095-4d89-94b9-1bf7cb7e103d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:11.171838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ed0ba713-a095-4d89-94b9-1bf7cb7e103d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:11.179533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed0ba713-a095-4d89-94b9-1bf7cb7e103d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.180537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed0ba713-a095-4d89-94b9-1bf7cb7e103d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.180910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed0ba713-a095-4d89-94b9-1bf7cb7e103d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.181387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed0ba713-a095-4d89-94b9-1bf7cb7e103d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.209481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48b3b641-aa0a-473a-b01c-29a2eb01b6ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:11.209481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-48b3b641-aa0a-473a-b01c-29a2eb01b6ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:11.217801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48b3b641-aa0a-473a-b01c-29a2eb01b6ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.218431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48b3b641-aa0a-473a-b01c-29a2eb01b6ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.219239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48b3b641-aa0a-473a-b01c-29a2eb01b6ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.219698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48b3b641-aa0a-473a-b01c-29a2eb01b6ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.357638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ed0ba713-a095-4d89-94b9-1bf7cb7e103d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.368924 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ed0ba713-a095-4d89-94b9-1bf7cb7e103d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.202972 Jul 20 04:44:11.369858 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3050/6089] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:11 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:11.398085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-48b3b641-aa0a-473a-b01c-29a2eb01b6ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.407587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-48b3b641-aa0a-473a-b01c-29a2eb01b6ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.409328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-48b3b641-aa0a-473a-b01c-29a2eb01b6ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.410695 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48b3b641-aa0a-473a-b01c-29a2eb01b6ef tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.206339 Jul 20 04:44:11.416511 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3040/6090] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:11 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:12.164286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0d6b4382-6dbe-4717-9f58-8313747b5bda tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:12.165163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0d6b4382-6dbe-4717-9f58-8313747b5bda tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:12.169661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8507807e-e7bd-458c-a9f2-c1cc17510bb3 req-358b213b-b6e5-4e43-8959-39596a7a6fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068784e2-fe5a-49a2-a481-0bea8a21c0f4", "name": "network-vif-deleted", "tag": "f79effc2-f3cc-41c9-80f0-05c8fa1edb20"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:12.182076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:12.195235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d6b4382-6dbe-4717-9f58-8313747b5bda tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.195706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d6b4382-6dbe-4717-9f58-8313747b5bda tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.196656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d6b4382-6dbe-4717-9f58-8313747b5bda tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.201196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8507807e-e7bd-458c-a9f2-c1cc17510bb3 req-358b213b-b6e5-4e43-8959-39596a7a6fbe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.202204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d6b4382-6dbe-4717-9f58-8313747b5bda tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.204190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8507807e-e7bd-458c-a9f2-c1cc17510bb3 req-358b213b-b6e5-4e43-8959-39596a7a6fbe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.235721 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8507807e-e7bd-458c-a9f2-c1cc17510bb3 req-358b213b-b6e5-4e43-8959-39596a7a6fbe service nova] Creating event network-vif-deleted:f79effc2-f3cc-41c9-80f0-05c8fa1edb20 for instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 on n-h2-760456-11 Jul 20 04:44:12.260264 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8507807e-e7bd-458c-a9f2-c1cc17510bb3 req-358b213b-b6e5-4e43-8959-39596a7a6fbe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106769 Jul 20 04:44:12.260926 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3051/6091] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:12.336640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0d6b4382-6dbe-4717-9f58-8313747b5bda tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.348382 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0d6b4382-6dbe-4717-9f58-8313747b5bda tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 200 len: 1292 microversion: 2.1 time: 0.190811 Jul 20 04:44:12.350898 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3041/6092] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:12 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 1292 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:12.391899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e825e611-b9b4-46d3-a40c-786e87210206 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:12.392842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e825e611-b9b4-46d3-a40c-786e87210206 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:12.401610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e825e611-b9b4-46d3-a40c-786e87210206 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.402231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e825e611-b9b4-46d3-a40c-786e87210206 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.403325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e825e611-b9b4-46d3-a40c-786e87210206 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.404160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e825e611-b9b4-46d3-a40c-786e87210206 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.435989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f240fdc7-74bd-41de-a325-0ffd86776cc4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:12.436679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f240fdc7-74bd-41de-a325-0ffd86776cc4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:12.453042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f240fdc7-74bd-41de-a325-0ffd86776cc4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.455852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f240fdc7-74bd-41de-a325-0ffd86776cc4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.456972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f240fdc7-74bd-41de-a325-0ffd86776cc4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.457712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f240fdc7-74bd-41de-a325-0ffd86776cc4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.629983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e825e611-b9b4-46d3-a40c-786e87210206 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.644813 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e825e611-b9b4-46d3-a40c-786e87210206 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.258239 Jul 20 04:44:12.646683 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3052/6093] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:12 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:12.775300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f240fdc7-74bd-41de-a325-0ffd86776cc4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.788012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f240fdc7-74bd-41de-a325-0ffd86776cc4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.789916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f240fdc7-74bd-41de-a325-0ffd86776cc4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.791286 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f240fdc7-74bd-41de-a325-0ffd86776cc4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.364313 Jul 20 04:44:12.791978 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3042/6094] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:12 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:13.368253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e646f4f4-c04d-4a19-886b-e07642f94ef4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:13.368874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e646f4f4-c04d-4a19-886b-e07642f94ef4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: 068784e2-fe5a-49a2-a481-0bea8a21c0f4] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:13.377543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e646f4f4-c04d-4a19-886b-e07642f94ef4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.378017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e646f4f4-c04d-4a19-886b-e07642f94ef4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.378838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e646f4f4-c04d-4a19-886b-e07642f94ef4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.379308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e646f4f4-c04d-4a19-886b-e07642f94ef4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.403617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-e646f4f4-c04d-4a19-886b-e07642f94ef4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] HTTP exception thrown: Instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 could not be found. Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e646f4f4-c04d-4a19-886b-e07642f94ef4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Request method failure captured: Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 HTTP/1.1 Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cVvlyFQK0Hky763YtJNZmga-seuiHv50lzr8c708UaBjY5LhinFPM_QzRPumN7lebUV8SaN9g5W8Pjefaa4UE9X-ySIx3izX52Mcn-dmW_45ztV_oVGdlJV1fLy4MHx9SEfL5owl8e_frcmqcUAJfCEXDSfh8n8iumlmvk569aBtU Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9138f252886e4faea3710ff7d6764683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9138f252886e4faea3710ff7d6764683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: eff6843f674047fc9a8841711244bce4 Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 could not be found. Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '068784e2-fe5a-49a2-a481-0bea8a21c0f4'} Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 could not be found. Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 could not be found. Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:13.407118 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:13.412485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:13.412485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:13.412485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:13.412485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:13.412485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:13.412485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 could not be found. Jul 20 04:44:13.412485 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:13.412485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e646f4f4-c04d-4a19-886b-e07642f94ef4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Returning 404 to user: Instance 068784e2-fe5a-49a2-a481-0bea8a21c0f4 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:13.414126 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e646f4f4-c04d-4a19-886b-e07642f94ef4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4" status: 404 len: 111 microversion: 2.1 time: 0.049392 Jul 20 04:44:13.415059 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3053/6095] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:13 2022] GET /compute/v2.1/servers/068784e2-fe5a-49a2-a481-0bea8a21c0f4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:13.423789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dc4c2db5-d9d9-4908-8756-54a60e62f720 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:13.424308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dc4c2db5-d9d9-4908-8756-54a60e62f720 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:13.432010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc4c2db5-d9d9-4908-8756-54a60e62f720 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.432729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc4c2db5-d9d9-4908-8756-54a60e62f720 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.434812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc4c2db5-d9d9-4908-8756-54a60e62f720 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.435342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc4c2db5-d9d9-4908-8756-54a60e62f720 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.468428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dc4c2db5-d9d9-4908-8756-54a60e62f720 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:13.571956 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dc4c2db5-d9d9-4908-8756-54a60e62f720 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 204 len: 0 microversion: 2.1 time: 0.151621 Jul 20 04:44:13.577579 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3043/6096] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:13 2022] DELETE /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:13.586541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5118cdb-35e2-419b-9ef5-92dc3354e2d4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:13.587885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5118cdb-35e2-419b-9ef5-92dc3354e2d4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:13.596330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5118cdb-35e2-419b-9ef5-92dc3354e2d4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.597177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5118cdb-35e2-419b-9ef5-92dc3354e2d4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.598735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5118cdb-35e2-419b-9ef5-92dc3354e2d4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.599465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5118cdb-35e2-419b-9ef5-92dc3354e2d4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.666117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2f43be09-4fe1-48d3-89d3-2031919fe495 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:13.666968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2f43be09-4fe1-48d3-89d3-2031919fe495 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:13.675415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f43be09-4fe1-48d3-89d3-2031919fe495 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.675973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f43be09-4fe1-48d3-89d3-2031919fe495 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.676923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f43be09-4fe1-48d3-89d3-2031919fe495 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.677483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f43be09-4fe1-48d3-89d3-2031919fe495 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.780620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a5118cdb-35e2-419b-9ef5-92dc3354e2d4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.793607 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5118cdb-35e2-419b-9ef5-92dc3354e2d4 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.213918 Jul 20 04:44:13.794686 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3054/6097] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:13 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:13.812304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-eaab2538-ad46-4741-b2b0-51a737a99122 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:13.813244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-eaab2538-ad46-4741-b2b0-51a737a99122 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:13.819753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eaab2538-ad46-4741-b2b0-51a737a99122 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.820437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eaab2538-ad46-4741-b2b0-51a737a99122 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.821379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eaab2538-ad46-4741-b2b0-51a737a99122 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.821978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eaab2538-ad46-4741-b2b0-51a737a99122 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.852017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2f43be09-4fe1-48d3-89d3-2031919fe495 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.861181 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2f43be09-4fe1-48d3-89d3-2031919fe495 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.200605 Jul 20 04:44:13.862304 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3044/6098] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:13 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:13.978027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eaab2538-ad46-4741-b2b0-51a737a99122 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.988419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eaab2538-ad46-4741-b2b0-51a737a99122 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.990061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eaab2538-ad46-4741-b2b0-51a737a99122 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.991478 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-eaab2538-ad46-4741-b2b0-51a737a99122 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.184382 Jul 20 04:44:13.992052 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3055/6099] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:13 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:14.811095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b8abca4c-c12a-4890-8d30-260036a96a14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:14.812386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b8abca4c-c12a-4890-8d30-260036a96a14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:14.819667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8abca4c-c12a-4890-8d30-260036a96a14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.820150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8abca4c-c12a-4890-8d30-260036a96a14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.820961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8abca4c-c12a-4890-8d30-260036a96a14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.821457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8abca4c-c12a-4890-8d30-260036a96a14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.881228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-33079a94-9fb5-4d59-a9b9-3e025bb039bf tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:14.881801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-33079a94-9fb5-4d59-a9b9-3e025bb039bf tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:14.889025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33079a94-9fb5-4d59-a9b9-3e025bb039bf tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.889478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33079a94-9fb5-4d59-a9b9-3e025bb039bf tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.890278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33079a94-9fb5-4d59-a9b9-3e025bb039bf tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.890716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33079a94-9fb5-4d59-a9b9-3e025bb039bf tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.072468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-33079a94-9fb5-4d59-a9b9-3e025bb039bf tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.082468 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-33079a94-9fb5-4d59-a9b9-3e025bb039bf tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.205145 Jul 20 04:44:15.083415 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3056/6100] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:14 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:15.088623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4aa308d4-0269-400b-a2de-fd8ce046832b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:15.089970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4aa308d4-0269-400b-a2de-fd8ce046832b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:15.102114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4aa308d4-0269-400b-a2de-fd8ce046832b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.112196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4aa308d4-0269-400b-a2de-fd8ce046832b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.112196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4aa308d4-0269-400b-a2de-fd8ce046832b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.112196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4aa308d4-0269-400b-a2de-fd8ce046832b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.141217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b8abca4c-c12a-4890-8d30-260036a96a14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.151155 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b8abca4c-c12a-4890-8d30-260036a96a14 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.344046 Jul 20 04:44:15.153964 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3045/6101] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:14 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:15.288024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4aa308d4-0269-400b-a2de-fd8ce046832b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.298922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4aa308d4-0269-400b-a2de-fd8ce046832b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.300613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4aa308d4-0269-400b-a2de-fd8ce046832b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.301900 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4aa308d4-0269-400b-a2de-fd8ce046832b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.217125 Jul 20 04:44:15.313381 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3057/6102] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:15 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:16.107634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d861f8e-cd34-4d31-8b18-ff290c10b176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:16.108514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d861f8e-cd34-4d31-8b18-ff290c10b176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:16.117294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d861f8e-cd34-4d31-8b18-ff290c10b176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.117797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d861f8e-cd34-4d31-8b18-ff290c10b176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.118868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d861f8e-cd34-4d31-8b18-ff290c10b176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.119291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d861f8e-cd34-4d31-8b18-ff290c10b176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.171017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-47191614-150c-41f1-a90d-d2cb024abe18 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:16.172286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-47191614-150c-41f1-a90d-d2cb024abe18 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:16.179980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47191614-150c-41f1-a90d-d2cb024abe18 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.180693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47191614-150c-41f1-a90d-d2cb024abe18 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.181668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47191614-150c-41f1-a90d-d2cb024abe18 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.182120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47191614-150c-41f1-a90d-d2cb024abe18 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.295294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d861f8e-cd34-4d31-8b18-ff290c10b176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.304876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d861f8e-cd34-4d31-8b18-ff290c10b176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1342 microversion: 2.1 time: 0.207540 Jul 20 04:44:16.316550 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3046/6103] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:16 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:16.322314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-24d54e0a-2b31-4aad-87d3-3ff8c7d040d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:16.323222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-24d54e0a-2b31-4aad-87d3-3ff8c7d040d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:16.330906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24d54e0a-2b31-4aad-87d3-3ff8c7d040d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.331630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24d54e0a-2b31-4aad-87d3-3ff8c7d040d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.332619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24d54e0a-2b31-4aad-87d3-3ff8c7d040d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.333259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24d54e0a-2b31-4aad-87d3-3ff8c7d040d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.344224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-47191614-150c-41f1-a90d-d2cb024abe18 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.359657 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-47191614-150c-41f1-a90d-d2cb024abe18 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.193285 Jul 20 04:44:16.368764 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3058/6104] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:16 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:16.533626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24d54e0a-2b31-4aad-87d3-3ff8c7d040d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.544515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24d54e0a-2b31-4aad-87d3-3ff8c7d040d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.546070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24d54e0a-2b31-4aad-87d3-3ff8c7d040d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.547665 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-24d54e0a-2b31-4aad-87d3-3ff8c7d040d5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.229665 Jul 20 04:44:16.548239 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3047/6105] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:16 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:17.324579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5a29d10-3753-4ded-80fa-079acdfd6a7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:17.325203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5a29d10-3753-4ded-80fa-079acdfd6a7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:17.331984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5a29d10-3753-4ded-80fa-079acdfd6a7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.332545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5a29d10-3753-4ded-80fa-079acdfd6a7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.333208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5a29d10-3753-4ded-80fa-079acdfd6a7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.333651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5a29d10-3753-4ded-80fa-079acdfd6a7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.382520 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0973ed1d-631a-4144-a201-1ca78164449c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:17.384381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0973ed1d-631a-4144-a201-1ca78164449c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:17.392536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0973ed1d-631a-4144-a201-1ca78164449c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.393360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0973ed1d-631a-4144-a201-1ca78164449c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.398815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0973ed1d-631a-4144-a201-1ca78164449c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.399600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0973ed1d-631a-4144-a201-1ca78164449c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.544173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a5a29d10-3753-4ded-80fa-079acdfd6a7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.548238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:17.554005 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5a29d10-3753-4ded-80fa-079acdfd6a7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1388 microversion: 2.1 time: 0.233678 Jul 20 04:44:17.554844 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3059/6106] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:17 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1388 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:17.570904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ee48a81f-4bcc-4936-a798-900c2db9b40d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:17.571996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ee48a81f-4bcc-4936-a798-900c2db9b40d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:17.581394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee48a81f-4bcc-4936-a798-900c2db9b40d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.582118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee48a81f-4bcc-4936-a798-900c2db9b40d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.583183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee48a81f-4bcc-4936-a798-900c2db9b40d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.583823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee48a81f-4bcc-4936-a798-900c2db9b40d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.657085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0973ed1d-631a-4144-a201-1ca78164449c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.665544 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0973ed1d-631a-4144-a201-1ca78164449c tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1520 microversion: 2.1 time: 0.291525 Jul 20 04:44:17.676364 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3048/6107] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:17 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:17.748519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ee48a81f-4bcc-4936-a798-900c2db9b40d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.759661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ee48a81f-4bcc-4936-a798-900c2db9b40d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.762752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ee48a81f-4bcc-4936-a798-900c2db9b40d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.764256 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ee48a81f-4bcc-4936-a798-900c2db9b40d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.199357 Jul 20 04:44:17.765362 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3060/6108] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:17 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:18.248513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-8cbe4be2-c20b-41b4-b595-c3f1e918fe98 req-3696230c-0050-4937-b1cf-dcf596748398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68a62b9-e978-4872-8c85-1b81c0f7341b", "name": "network-vif-deleted", "tag": "f33f6c80-fd33-4fed-8dd8-ca4a81e7d646"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:18.259152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8cbe4be2-c20b-41b4-b595-c3f1e918fe98 req-3696230c-0050-4937-b1cf-dcf596748398 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.260006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8cbe4be2-c20b-41b4-b595-c3f1e918fe98 req-3696230c-0050-4937-b1cf-dcf596748398 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.273833 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8cbe4be2-c20b-41b4-b595-c3f1e918fe98 req-3696230c-0050-4937-b1cf-dcf596748398 service nova] Creating event network-vif-deleted:f33f6c80-fd33-4fed-8dd8-ca4a81e7d646 for instance a68a62b9-e978-4872-8c85-1b81c0f7341b on n-h2-760456-11 Jul 20 04:44:18.279610 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-8cbe4be2-c20b-41b4-b595-c3f1e918fe98 req-3696230c-0050-4937-b1cf-dcf596748398 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035388 Jul 20 04:44:18.282478 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3049/6109] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:18.572487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e24971a0-b02a-4f0b-916f-512ebc1f3f51 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.574582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e24971a0-b02a-4f0b-916f-512ebc1f3f51 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:18.587278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e24971a0-b02a-4f0b-916f-512ebc1f3f51 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.587757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e24971a0-b02a-4f0b-916f-512ebc1f3f51 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.588545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e24971a0-b02a-4f0b-916f-512ebc1f3f51 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.589034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e24971a0-b02a-4f0b-916f-512ebc1f3f51 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.685057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.686588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:18.696829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.697570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.699482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.700184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.762446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.763861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.764359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lazy-loading 'fault' on Instance uuid a68a62b9-e978-4872-8c85-1b81c0f7341b {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:44:18.764583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e24971a0-b02a-4f0b-916f-512ebc1f3f51 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.775700 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e24971a0-b02a-4f0b-916f-512ebc1f3f51 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1376 microversion: 2.1 time: 0.207167 Jul 20 04:44:18.786665 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3061/6110] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:18 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1376 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:18.793436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e5972cdf-33be-42d5-b262-1963db5ad47f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.798106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e5972cdf-33be-42d5-b262-1963db5ad47f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:18.805036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5972cdf-33be-42d5-b262-1963db5ad47f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.805710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5972cdf-33be-42d5-b262-1963db5ad47f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.806605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5972cdf-33be-42d5-b262-1963db5ad47f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.807203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5972cdf-33be-42d5-b262-1963db5ad47f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.821241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eff6843f674047fc9a8841711244bce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138f252886e4faea3710ff7d6764683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.829089 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4761a318-b4d9-40d1-a56c-6399da23e65d tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 200 len: 1311 microversion: 2.1 time: 0.149499 Jul 20 04:44:18.830428 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3050/6111] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:18 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 1311 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:18.965141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e5972cdf-33be-42d5-b262-1963db5ad47f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.974979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e5972cdf-33be-42d5-b262-1963db5ad47f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.976968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e5972cdf-33be-42d5-b262-1963db5ad47f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.978225 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e5972cdf-33be-42d5-b262-1963db5ad47f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.190230 Jul 20 04:44:18.978840 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3062/6112] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:18 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:19.793849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c152edf-f84c-46be-ab7b-1adf766d60f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:19.794524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c152edf-f84c-46be-ab7b-1adf766d60f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:19.801485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c152edf-f84c-46be-ab7b-1adf766d60f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.802030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c152edf-f84c-46be-ab7b-1adf766d60f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.802839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c152edf-f84c-46be-ab7b-1adf766d60f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.803304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c152edf-f84c-46be-ab7b-1adf766d60f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.807595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:19.846363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0b257d00-aa0e-4a76-9959-bcdc5cc2cf06 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:19.847110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0b257d00-aa0e-4a76-9959-bcdc5cc2cf06 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] [instance: a68a62b9-e978-4872-8c85-1b81c0f7341b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:19.869736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b257d00-aa0e-4a76-9959-bcdc5cc2cf06 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.873350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b257d00-aa0e-4a76-9959-bcdc5cc2cf06 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.874427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b257d00-aa0e-4a76-9959-bcdc5cc2cf06 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.874943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b257d00-aa0e-4a76-9959-bcdc5cc2cf06 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.892302 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-0b257d00-aa0e-4a76-9959-bcdc5cc2cf06 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] HTTP exception thrown: Instance a68a62b9-e978-4872-8c85-1b81c0f7341b could not be found. Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0b257d00-aa0e-4a76-9959-bcdc5cc2cf06 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Request method failure captured: Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b HTTP/1.1 Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cVvlyFQK0Hky763YtJNZmga-seuiHv50lzr8c708UaBjY5LhinFPM_QzRPumN7lebUV8SaN9g5W8Pjefaa4UE9X-ySIx3izX52Mcn-dmW_45ztV_oVGdlJV1fLy4MHx9SEfL5owl8e_frcmqcUAJfCEXDSfh8n8iumlmvk569aBtU Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9138f252886e4faea3710ff7d6764683"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9138f252886e4faea3710ff7d6764683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9138f252886e4faea3710ff7d6764683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 9138f252886e4faea3710ff7d6764683 Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6703423 Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: eff6843f674047fc9a8841711244bce4 Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6703423-project Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance a68a62b9-e978-4872-8c85-1b81c0f7341b could not be found. Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'a68a62b9-e978-4872-8c85-1b81c0f7341b'} Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68a62b9-e978-4872-8c85-1b81c0f7341b could not be found. Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68a62b9-e978-4872-8c85-1b81c0f7341b could not be found. Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:19.894820 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:19.898226 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:19.898226 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:19.898226 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:19.898226 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:19.898226 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:19.898226 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68a62b9-e978-4872-8c85-1b81c0f7341b could not be found. Jul 20 04:44:19.898226 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:19.900267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0b257d00-aa0e-4a76-9959-bcdc5cc2cf06 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] Returning 404 to user: Instance a68a62b9-e978-4872-8c85-1b81c0f7341b could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:19.901254 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0b257d00-aa0e-4a76-9959-bcdc5cc2cf06 tempest-ServerRescueNegativeTestJSON-6703423 tempest-ServerRescueNegativeTestJSON-6703423-project] 10.222.0.59 "GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b" status: 404 len: 111 microversion: 2.1 time: 0.059283 Jul 20 04:44:19.902753 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3063/6113] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:19 2022] GET /compute/v2.1/servers/a68a62b9-e978-4872-8c85-1b81c0f7341b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:19.958883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c152edf-f84c-46be-ab7b-1adf766d60f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:19.967155 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c152edf-f84c-46be-ab7b-1adf766d60f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1376 microversion: 2.1 time: 0.177835 Jul 20 04:44:19.967756 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3051/6114] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:19 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1376 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:19.998030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-30b0d3e9-590f-4f07-a101-3a3dd3639a37 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:19.998695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-30b0d3e9-590f-4f07-a101-3a3dd3639a37 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:20.005015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30b0d3e9-590f-4f07-a101-3a3dd3639a37 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.005475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30b0d3e9-590f-4f07-a101-3a3dd3639a37 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.006281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30b0d3e9-590f-4f07-a101-3a3dd3639a37 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.006760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-30b0d3e9-590f-4f07-a101-3a3dd3639a37 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.313724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-30b0d3e9-590f-4f07-a101-3a3dd3639a37 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.324092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-30b0d3e9-590f-4f07-a101-3a3dd3639a37 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.325853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-30b0d3e9-590f-4f07-a101-3a3dd3639a37 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.327233 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-30b0d3e9-590f-4f07-a101-3a3dd3639a37 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.334313 Jul 20 04:44:20.327900 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3064/6115] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:19 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:20.985659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c4fdff2-cac5-4c02-bcfb-74a60d0261be tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:20.987198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c4fdff2-cac5-4c02-bcfb-74a60d0261be tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:20.995344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c4fdff2-cac5-4c02-bcfb-74a60d0261be tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.996097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c4fdff2-cac5-4c02-bcfb-74a60d0261be tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.997483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c4fdff2-cac5-4c02-bcfb-74a60d0261be tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.998142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c4fdff2-cac5-4c02-bcfb-74a60d0261be tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.223104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c4fdff2-cac5-4c02-bcfb-74a60d0261be tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:21.239489 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c4fdff2-cac5-4c02-bcfb-74a60d0261be tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1376 microversion: 2.1 time: 0.256845 Jul 20 04:44:21.241319 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3052/6116] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:20 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1376 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:21.351756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-06862817-f954-4355-8740-926a9b39f496 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:21.353817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-06862817-f954-4355-8740-926a9b39f496 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:21.374513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06862817-f954-4355-8740-926a9b39f496 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.375401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06862817-f954-4355-8740-926a9b39f496 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.376690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06862817-f954-4355-8740-926a9b39f496 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.378315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-06862817-f954-4355-8740-926a9b39f496 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.495161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-53df338d-b02f-4164-adb7-7d3383e09310 req-b1e7d6ce-a0b3-4384-9615-fc08a1ee30d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3973340-115d-4612-a266-e4403274d648", "name": "network-vif-plugged", "status": "completed", "tag": "d14f90e5-dbf1-405a-80b2-d712f8275251"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:21.504599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-53df338d-b02f-4164-adb7-7d3383e09310 req-b1e7d6ce-a0b3-4384-9615-fc08a1ee30d8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.505361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-53df338d-b02f-4164-adb7-7d3383e09310 req-b1e7d6ce-a0b3-4384-9615-fc08a1ee30d8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.518829 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-53df338d-b02f-4164-adb7-7d3383e09310 req-b1e7d6ce-a0b3-4384-9615-fc08a1ee30d8 service nova] Creating event network-vif-plugged:d14f90e5-dbf1-405a-80b2-d712f8275251 for instance f3973340-115d-4612-a266-e4403274d648 on n-h2-760456-11 Jul 20 04:44:21.524819 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-53df338d-b02f-4164-adb7-7d3383e09310 req-b1e7d6ce-a0b3-4384-9615-fc08a1ee30d8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.414882 Jul 20 04:44:21.525442 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3065/6117] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:44:21.573679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-06862817-f954-4355-8740-926a9b39f496 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:21.586297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-06862817-f954-4355-8740-926a9b39f496 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:21.588161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-06862817-f954-4355-8740-926a9b39f496 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:21.590620 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-06862817-f954-4355-8740-926a9b39f496 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.247353 Jul 20 04:44:21.591777 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3053/6118] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:21 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:22.259669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0aab65a-935e-4ee3-bc5b-30731c3683b0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:22.260480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0aab65a-935e-4ee3-bc5b-30731c3683b0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:22.273784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0aab65a-935e-4ee3-bc5b-30731c3683b0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:22.274218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0aab65a-935e-4ee3-bc5b-30731c3683b0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:22.279336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0aab65a-935e-4ee3-bc5b-30731c3683b0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:22.279873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0aab65a-935e-4ee3-bc5b-30731c3683b0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:22.612874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-480963bc-e4e6-4e46-8661-1e9403dafcdb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:22.614048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-480963bc-e4e6-4e46-8661-1e9403dafcdb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:22.622908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-480963bc-e4e6-4e46-8661-1e9403dafcdb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:22.623536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-480963bc-e4e6-4e46-8661-1e9403dafcdb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:22.624311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-480963bc-e4e6-4e46-8661-1e9403dafcdb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:22.624767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-480963bc-e4e6-4e46-8661-1e9403dafcdb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:22.781019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-480963bc-e4e6-4e46-8661-1e9403dafcdb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:22.790857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-480963bc-e4e6-4e46-8661-1e9403dafcdb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:22.793342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-480963bc-e4e6-4e46-8661-1e9403dafcdb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:22.794873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-480963bc-e4e6-4e46-8661-1e9403dafcdb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.187769 Jul 20 04:44:22.795571 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3054/6119] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:22 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:22.834559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a0aab65a-935e-4ee3-bc5b-30731c3683b0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:22.844610 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0aab65a-935e-4ee3-bc5b-30731c3683b0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1376 microversion: 2.1 time: 0.589736 Jul 20 04:44:22.845213 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3066/6120] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:22 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1376 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:23.818695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-87c78ef2-e2d7-435c-b3bf-5c16a3a0e813 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:23.821721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-87c78ef2-e2d7-435c-b3bf-5c16a3a0e813 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:23.838743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87c78ef2-e2d7-435c-b3bf-5c16a3a0e813 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.841009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87c78ef2-e2d7-435c-b3bf-5c16a3a0e813 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.841953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87c78ef2-e2d7-435c-b3bf-5c16a3a0e813 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.846977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-87c78ef2-e2d7-435c-b3bf-5c16a3a0e813 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.862413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a6e8870-a559-4355-89ad-31d5e48b251a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:23.863660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6a6e8870-a559-4355-89ad-31d5e48b251a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:23.872370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a6e8870-a559-4355-89ad-31d5e48b251a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.873030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a6e8870-a559-4355-89ad-31d5e48b251a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.873971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a6e8870-a559-4355-89ad-31d5e48b251a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.874520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a6e8870-a559-4355-89ad-31d5e48b251a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.081605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-87c78ef2-e2d7-435c-b3bf-5c16a3a0e813 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.093623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-87c78ef2-e2d7-435c-b3bf-5c16a3a0e813 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.095189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-87c78ef2-e2d7-435c-b3bf-5c16a3a0e813 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.096567 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-87c78ef2-e2d7-435c-b3bf-5c16a3a0e813 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1809 microversion: 2.20 time: 0.286766 Jul 20 04:44:24.097677 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3055/6121] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:23 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1809 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:24.221624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6a6e8870-a559-4355-89ad-31d5e48b251a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.231594 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6a6e8870-a559-4355-89ad-31d5e48b251a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1376 microversion: 2.1 time: 0.373388 Jul 20 04:44:24.232208 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3067/6122] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:23 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1376 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:25.130740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e7baf97-53ea-4a0a-acd1-fb0015e7b823 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:25.131927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e7baf97-53ea-4a0a-acd1-fb0015e7b823 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:25.142931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e7baf97-53ea-4a0a-acd1-fb0015e7b823 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.143683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e7baf97-53ea-4a0a-acd1-fb0015e7b823 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.144678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e7baf97-53ea-4a0a-acd1-fb0015e7b823 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.145149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e7baf97-53ea-4a0a-acd1-fb0015e7b823 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.253418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4fdd78f9-3835-4b2a-a033-f9660e755aa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:25.255379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4fdd78f9-3835-4b2a-a033-f9660e755aa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:25.264809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fdd78f9-3835-4b2a-a033-f9660e755aa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.265619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fdd78f9-3835-4b2a-a033-f9660e755aa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.266578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fdd78f9-3835-4b2a-a033-f9660e755aa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.267162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4fdd78f9-3835-4b2a-a033-f9660e755aa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.371353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e7baf97-53ea-4a0a-acd1-fb0015e7b823 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:25.384106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e7baf97-53ea-4a0a-acd1-fb0015e7b823 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:25.391182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e7baf97-53ea-4a0a-acd1-fb0015e7b823 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:25.392656 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e7baf97-53ea-4a0a-acd1-fb0015e7b823 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1796 microversion: 2.20 time: 0.269686 Jul 20 04:44:25.393686 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3056/6123] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:25 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1796 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:25.507915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4fdd78f9-3835-4b2a-a033-f9660e755aa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:25.522244 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4fdd78f9-3835-4b2a-a033-f9660e755aa7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1376 microversion: 2.1 time: 0.276565 Jul 20 04:44:25.523864 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3068/6124] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:25 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1376 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:26.540519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3c7c8b5-88ca-42e6-b106-75893099981f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:26.541312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3c7c8b5-88ca-42e6-b106-75893099981f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:26.549379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3c7c8b5-88ca-42e6-b106-75893099981f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:26.549876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3c7c8b5-88ca-42e6-b106-75893099981f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.550794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3c7c8b5-88ca-42e6-b106-75893099981f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:26.551561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3c7c8b5-88ca-42e6-b106-75893099981f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.728920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3c7c8b5-88ca-42e6-b106-75893099981f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:26.738536 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3c7c8b5-88ca-42e6-b106-75893099981f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1376 microversion: 2.1 time: 0.202232 Jul 20 04:44:26.739136 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3057/6125] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:26 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1376 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:27.115539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-aaefc7e6-9f73-4048-8272-bf8250a8a6cd req-dc1acdcb-db55-41af-9649-4cc060b9de38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5569e35e-e42c-4139-a787-986331f1c751", "name": "network-vif-plugged", "status": "completed", "tag": "25cec934-537c-4c46-8935-4cbfd3693aff"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:27.136153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-aaefc7e6-9f73-4048-8272-bf8250a8a6cd req-dc1acdcb-db55-41af-9649-4cc060b9de38 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.136658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-aaefc7e6-9f73-4048-8272-bf8250a8a6cd req-dc1acdcb-db55-41af-9649-4cc060b9de38 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.148760 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-aaefc7e6-9f73-4048-8272-bf8250a8a6cd req-dc1acdcb-db55-41af-9649-4cc060b9de38 service nova] Creating event network-vif-plugged:25cec934-537c-4c46-8935-4cbfd3693aff for instance 5569e35e-e42c-4139-a787-986331f1c751 on n-h2-760456-11 Jul 20 04:44:27.156010 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-aaefc7e6-9f73-4048-8272-bf8250a8a6cd req-dc1acdcb-db55-41af-9649-4cc060b9de38 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056375 Jul 20 04:44:27.156873 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3069/6126] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:27.760467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a223c171-e104-43bf-80dd-870cdb94afee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:27.761399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a223c171-e104-43bf-80dd-870cdb94afee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:27.768835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a223c171-e104-43bf-80dd-870cdb94afee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.769392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a223c171-e104-43bf-80dd-870cdb94afee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.770327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a223c171-e104-43bf-80dd-870cdb94afee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.770885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a223c171-e104-43bf-80dd-870cdb94afee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.941707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a223c171-e104-43bf-80dd-870cdb94afee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:27.951245 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a223c171-e104-43bf-80dd-870cdb94afee tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1376 microversion: 2.1 time: 0.198066 Jul 20 04:44:27.951984 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3058/6127] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:27 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1376 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:28.969306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6bc56587-f080-4c88-9ced-124999e40444 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:28.970041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6bc56587-f080-4c88-9ced-124999e40444 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:28.976737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc56587-f080-4c88-9ced-124999e40444 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.977216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc56587-f080-4c88-9ced-124999e40444 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.978004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc56587-f080-4c88-9ced-124999e40444 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.978507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6bc56587-f080-4c88-9ced-124999e40444 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.137337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6bc56587-f080-4c88-9ced-124999e40444 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:29.145095 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6bc56587-f080-4c88-9ced-124999e40444 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1563 microversion: 2.1 time: 0.181453 Jul 20 04:44:29.145657 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3070/6128] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:28 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:29.162297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7f31a8fa-c7de-4a01-9e64-71f8090b01c7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:29.163623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7f31a8fa-c7de-4a01-9e64-71f8090b01c7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:29.171418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f31a8fa-c7de-4a01-9e64-71f8090b01c7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.171902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f31a8fa-c7de-4a01-9e64-71f8090b01c7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.172747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f31a8fa-c7de-4a01-9e64-71f8090b01c7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.173189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7f31a8fa-c7de-4a01-9e64-71f8090b01c7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.349037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7f31a8fa-c7de-4a01-9e64-71f8090b01c7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:29.359501 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7f31a8fa-c7de-4a01-9e64-71f8090b01c7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1563 microversion: 2.1 time: 0.201503 Jul 20 04:44:29.360344 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3059/6129] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:29 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1563 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:29.435150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8c48e792-0d2c-446f-a0d0-940926fcc135 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:29.435749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8c48e792-0d2c-446f-a0d0-940926fcc135 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:29.442612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c48e792-0d2c-446f-a0d0-940926fcc135 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.443072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c48e792-0d2c-446f-a0d0-940926fcc135 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.443857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c48e792-0d2c-446f-a0d0-940926fcc135 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.444302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c48e792-0d2c-446f-a0d0-940926fcc135 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.476672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8c48e792-0d2c-446f-a0d0-940926fcc135 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:29.569983 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8c48e792-0d2c-446f-a0d0-940926fcc135 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 204 len: 0 microversion: 2.1 time: 0.138498 Jul 20 04:44:29.574475 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3071/6130] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:29 2022] DELETE /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:29.582774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8f7f2f8d-8dc4-4cbe-a3c6-ef8d3063f927 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:29.584553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8f7f2f8d-8dc4-4cbe-a3c6-ef8d3063f927 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:29.592146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f7f2f8d-8dc4-4cbe-a3c6-ef8d3063f927 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.592755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f7f2f8d-8dc4-4cbe-a3c6-ef8d3063f927 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.593561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f7f2f8d-8dc4-4cbe-a3c6-ef8d3063f927 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.594166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8f7f2f8d-8dc4-4cbe-a3c6-ef8d3063f927 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.790391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8f7f2f8d-8dc4-4cbe-a3c6-ef8d3063f927 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:29.799626 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8f7f2f8d-8dc4-4cbe-a3c6-ef8d3063f927 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1569 microversion: 2.1 time: 0.221016 Jul 20 04:44:29.800355 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3060/6131] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:29 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:30.819060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2bc8b14a-6ad3-4cea-8da6-51ef7e2f6489 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:30.819775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2bc8b14a-6ad3-4cea-8da6-51ef7e2f6489 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:30.828511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bc8b14a-6ad3-4cea-8da6-51ef7e2f6489 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.829297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bc8b14a-6ad3-4cea-8da6-51ef7e2f6489 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.830183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bc8b14a-6ad3-4cea-8da6-51ef7e2f6489 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.830799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2bc8b14a-6ad3-4cea-8da6-51ef7e2f6489 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.993214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2bc8b14a-6ad3-4cea-8da6-51ef7e2f6489 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:31.003797 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2bc8b14a-6ad3-4cea-8da6-51ef7e2f6489 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1569 microversion: 2.1 time: 0.190509 Jul 20 04:44:31.004382 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3072/6132] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:30 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:31.600965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-cd547c0d-2204-4715-b3a0-520d2e17f0b1 req-2197dd36-7816-4542-b9b3-029b8c2f3517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5569e35e-e42c-4139-a787-986331f1c751", "name": "network-vif-deleted", "tag": "25cec934-537c-4c46-8935-4cbfd3693aff"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:31.614276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cd547c0d-2204-4715-b3a0-520d2e17f0b1 req-2197dd36-7816-4542-b9b3-029b8c2f3517 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.614749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cd547c0d-2204-4715-b3a0-520d2e17f0b1 req-2197dd36-7816-4542-b9b3-029b8c2f3517 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.653152 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-cd547c0d-2204-4715-b3a0-520d2e17f0b1 req-2197dd36-7816-4542-b9b3-029b8c2f3517 service nova] Creating event network-vif-deleted:25cec934-537c-4c46-8935-4cbfd3693aff for instance 5569e35e-e42c-4139-a787-986331f1c751 on n-h2-760456-11 Jul 20 04:44:31.665277 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-cd547c0d-2204-4715-b3a0-520d2e17f0b1 req-2197dd36-7816-4542-b9b3-029b8c2f3517 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067906 Jul 20 04:44:31.665901 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3061/6133] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:32.022169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f25df1ab-590f-494a-9dea-cc9a94d97242 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:32.022169 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f25df1ab-590f-494a-9dea-cc9a94d97242 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:32.038972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f25df1ab-590f-494a-9dea-cc9a94d97242 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.039431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f25df1ab-590f-494a-9dea-cc9a94d97242 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.040583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f25df1ab-590f-494a-9dea-cc9a94d97242 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.041041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f25df1ab-590f-494a-9dea-cc9a94d97242 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.132791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f25df1ab-590f-494a-9dea-cc9a94d97242 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:32.142760 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f25df1ab-590f-494a-9dea-cc9a94d97242 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1361 microversion: 2.1 time: 0.125834 Jul 20 04:44:32.143467 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3073/6134] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:32 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1361 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:33.161667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dd644781-a2e4-4c2f-a21f-b9893dc89ca9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:33.163027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dd644781-a2e4-4c2f-a21f-b9893dc89ca9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:33.170036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd644781-a2e4-4c2f-a21f-b9893dc89ca9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.170549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd644781-a2e4-4c2f-a21f-b9893dc89ca9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.171541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd644781-a2e4-4c2f-a21f-b9893dc89ca9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.172160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dd644781-a2e4-4c2f-a21f-b9893dc89ca9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.258985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dd644781-a2e4-4c2f-a21f-b9893dc89ca9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:33.270638 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dd644781-a2e4-4c2f-a21f-b9893dc89ca9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1361 microversion: 2.1 time: 0.113533 Jul 20 04:44:33.271786 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3062/6135] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:33 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1361 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:34.289191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8362c77f-f9cc-43e1-917b-439a02c75423 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:34.289855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8362c77f-f9cc-43e1-917b-439a02c75423 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:34.293567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:34.300117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8362c77f-f9cc-43e1-917b-439a02c75423 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.300415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8362c77f-f9cc-43e1-917b-439a02c75423 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.302537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8362c77f-f9cc-43e1-917b-439a02c75423 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.303037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8362c77f-f9cc-43e1-917b-439a02c75423 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.377314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8362c77f-f9cc-43e1-917b-439a02c75423 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:34.390906 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8362c77f-f9cc-43e1-917b-439a02c75423 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1361 microversion: 2.1 time: 0.105664 Jul 20 04:44:34.392383 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3074/6136] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:34 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1361 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:35.409535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-983d8459-4a5b-4584-a92a-d3ff6922a70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:35.411135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-983d8459-4a5b-4584-a92a-d3ff6922a70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:35.423565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-983d8459-4a5b-4584-a92a-d3ff6922a70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.424347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-983d8459-4a5b-4584-a92a-d3ff6922a70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.425748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-983d8459-4a5b-4584-a92a-d3ff6922a70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.426452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-983d8459-4a5b-4584-a92a-d3ff6922a70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.554720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-983d8459-4a5b-4584-a92a-d3ff6922a70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:35.568603 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-983d8459-4a5b-4584-a92a-d3ff6922a70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1361 microversion: 2.1 time: 0.163826 Jul 20 04:44:35.570832 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3063/6137] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:35 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:36.587132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-79c88ce4-237d-4f80-bac9-10ec18c45959 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:36.587756 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-79c88ce4-237d-4f80-bac9-10ec18c45959 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.601908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79c88ce4-237d-4f80-bac9-10ec18c45959 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.602409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79c88ce4-237d-4f80-bac9-10ec18c45959 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.603227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79c88ce4-237d-4f80-bac9-10ec18c45959 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.603687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-79c88ce4-237d-4f80-bac9-10ec18c45959 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.680867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-79c88ce4-237d-4f80-bac9-10ec18c45959 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:36.689880 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-79c88ce4-237d-4f80-bac9-10ec18c45959 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1361 microversion: 2.1 time: 0.107299 Jul 20 04:44:36.691345 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3075/6138] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:36 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1361 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:37.709284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-230294f0-0f22-4ea1-b89e-f9f5175aad0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:37.709972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-230294f0-0f22-4ea1-b89e-f9f5175aad0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:37.719683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-230294f0-0f22-4ea1-b89e-f9f5175aad0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.720408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-230294f0-0f22-4ea1-b89e-f9f5175aad0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.721455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-230294f0-0f22-4ea1-b89e-f9f5175aad0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.722091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-230294f0-0f22-4ea1-b89e-f9f5175aad0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.812194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-230294f0-0f22-4ea1-b89e-f9f5175aad0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:37.821100 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-230294f0-0f22-4ea1-b89e-f9f5175aad0f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 200 len: 1361 microversion: 2.1 time: 0.116524 Jul 20 04:44:37.821707 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3064/6139] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:37 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 1361 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:38.839973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-75071715-f071-40c6-872b-4543939cfa88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:38.841271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-75071715-f071-40c6-872b-4543939cfa88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:38.857009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75071715-f071-40c6-872b-4543939cfa88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.857480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75071715-f071-40c6-872b-4543939cfa88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.858524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75071715-f071-40c6-872b-4543939cfa88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.858979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-75071715-f071-40c6-872b-4543939cfa88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.891330 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-75071715-f071-40c6-872b-4543939cfa88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-75071715-f071-40c6-872b-4543939cfa88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 HTTP/1.1 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '5569e35e-e42c-4139-a787-986331f1c751'} Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:38.893007 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:38.897499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:38.897499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:38.897499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:38.897499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:38.897499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:38.897499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:38.897499 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:38.897499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-75071715-f071-40c6-872b-4543939cfa88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:38.897499 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-75071715-f071-40c6-872b-4543939cfa88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 404 len: 111 microversion: 2.1 time: 0.060030 Jul 20 04:44:38.897499 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3076/6140] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:38 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:44.327131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0651cd4c-83c2-4c48-9eaa-9b4d3a415301 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:44.327662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0651cd4c-83c2-4c48-9eaa-9b4d3a415301 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:44.334071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:44.336248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0651cd4c-83c2-4c48-9eaa-9b4d3a415301 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.336730 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0651cd4c-83c2-4c48-9eaa-9b4d3a415301 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.337547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0651cd4c-83c2-4c48-9eaa-9b4d3a415301 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.338097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0651cd4c-83c2-4c48-9eaa-9b4d3a415301 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.366684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0651cd4c-83c2-4c48-9eaa-9b4d3a415301 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:44.464899 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0651cd4c-83c2-4c48-9eaa-9b4d3a415301 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 204 len: 0 microversion: 2.1 time: 0.141181 Jul 20 04:44:44.465623 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3065/6141] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:44 2022] DELETE /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:44.475908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e3a798b-f4d5-4dd5-850b-9e4e59b0ca0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:44.476564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e3a798b-f4d5-4dd5-850b-9e4e59b0ca0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:44.486301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e3a798b-f4d5-4dd5-850b-9e4e59b0ca0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.486902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e3a798b-f4d5-4dd5-850b-9e4e59b0ca0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.488248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e3a798b-f4d5-4dd5-850b-9e4e59b0ca0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.489052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e3a798b-f4d5-4dd5-850b-9e4e59b0ca0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.509131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:44.642044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e3a798b-f4d5-4dd5-850b-9e4e59b0ca0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:44.651465 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e3a798b-f4d5-4dd5-850b-9e4e59b0ca0a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1409 microversion: 2.1 time: 0.179099 Jul 20 04:44:44.652471 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3077/6142] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:44 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1409 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:45.670880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d6862704-25ba-49ca-90a0-0e7bd272e988 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:45.671885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d6862704-25ba-49ca-90a0-0e7bd272e988 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:45.678685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6862704-25ba-49ca-90a0-0e7bd272e988 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:45.679163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6862704-25ba-49ca-90a0-0e7bd272e988 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.679945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6862704-25ba-49ca-90a0-0e7bd272e988 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:45.680401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6862704-25ba-49ca-90a0-0e7bd272e988 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.838718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d6862704-25ba-49ca-90a0-0e7bd272e988 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:45.842318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:45.848120 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d6862704-25ba-49ca-90a0-0e7bd272e988 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1409 microversion: 2.1 time: 0.181761 Jul 20 04:44:45.849228 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3066/6143] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:45 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1409 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:46.721166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-eeb6f090-a07a-40a1-a7e1-beb331058b82 req-73c334ae-61a6-4a77-bf0b-d44c9aad215a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4701d59a-a341-4429-940a-503c0f49bbb8", "name": "network-vif-deleted", "tag": "c91054e7-36ad-4022-ace1-1d2e1ce11b8b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:46.731911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-eeb6f090-a07a-40a1-a7e1-beb331058b82 req-73c334ae-61a6-4a77-bf0b-d44c9aad215a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.732591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-eeb6f090-a07a-40a1-a7e1-beb331058b82 req-73c334ae-61a6-4a77-bf0b-d44c9aad215a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.744698 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-eeb6f090-a07a-40a1-a7e1-beb331058b82 req-73c334ae-61a6-4a77-bf0b-d44c9aad215a service nova] Creating event network-vif-deleted:c91054e7-36ad-4022-ace1-1d2e1ce11b8b for instance 4701d59a-a341-4429-940a-503c0f49bbb8 on n-h1-760456-11 Jul 20 04:44:46.750966 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-eeb6f090-a07a-40a1-a7e1-beb331058b82 req-73c334ae-61a6-4a77-bf0b-d44c9aad215a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033509 Jul 20 04:44:46.752514 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3078/6144] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:46.867934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ab5a1994-1c82-4670-902d-2db22b9246a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:46.868733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ab5a1994-1c82-4670-902d-2db22b9246a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:46.880396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5a1994-1c82-4670-902d-2db22b9246a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.880868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5a1994-1c82-4670-902d-2db22b9246a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.881839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5a1994-1c82-4670-902d-2db22b9246a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.882733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab5a1994-1c82-4670-902d-2db22b9246a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.985297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ab5a1994-1c82-4670-902d-2db22b9246a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:46.993904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ab5a1994-1c82-4670-902d-2db22b9246a8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1201 microversion: 2.1 time: 0.131409 Jul 20 04:44:46.996269 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3067/6145] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:46 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1201 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:48.017900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-42b2af09-8fc8-435f-b1ab-e9a34cebd70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:48.018900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-42b2af09-8fc8-435f-b1ab-e9a34cebd70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:48.029740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42b2af09-8fc8-435f-b1ab-e9a34cebd70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.030366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42b2af09-8fc8-435f-b1ab-e9a34cebd70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.031388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42b2af09-8fc8-435f-b1ab-e9a34cebd70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.032049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42b2af09-8fc8-435f-b1ab-e9a34cebd70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.108474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-42b2af09-8fc8-435f-b1ab-e9a34cebd70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:48.129274 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-42b2af09-8fc8-435f-b1ab-e9a34cebd70b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1201 microversion: 2.1 time: 0.120166 Jul 20 04:44:48.139442 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3079/6146] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:48 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1201 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:49.148352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b8683a64-d828-4ee4-8ca6-54ab712e631d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:49.151032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b8683a64-d828-4ee4-8ca6-54ab712e631d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:49.161981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8683a64-d828-4ee4-8ca6-54ab712e631d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:49.162846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8683a64-d828-4ee4-8ca6-54ab712e631d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:49.164041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8683a64-d828-4ee4-8ca6-54ab712e631d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:49.164656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b8683a64-d828-4ee4-8ca6-54ab712e631d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:49.259815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b8683a64-d828-4ee4-8ca6-54ab712e631d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:49.275699 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b8683a64-d828-4ee4-8ca6-54ab712e631d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1201 microversion: 2.1 time: 0.132472 Jul 20 04:44:49.276852 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3068/6147] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:49 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1201 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:50.292644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f7fb14c0-6443-452f-be9f-15738d2e6203 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:50.293872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f7fb14c0-6443-452f-be9f-15738d2e6203 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:50.301867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7fb14c0-6443-452f-be9f-15738d2e6203 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:50.302547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7fb14c0-6443-452f-be9f-15738d2e6203 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:50.303578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7fb14c0-6443-452f-be9f-15738d2e6203 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:50.304189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f7fb14c0-6443-452f-be9f-15738d2e6203 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:50.431078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f7fb14c0-6443-452f-be9f-15738d2e6203 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:50.439794 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f7fb14c0-6443-452f-be9f-15738d2e6203 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1201 microversion: 2.1 time: 0.151482 Jul 20 04:44:50.450446 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3080/6148] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:50 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:51.457335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c743a29a-584a-48cc-8e28-bd055cb0af5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:51.458038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c743a29a-584a-48cc-8e28-bd055cb0af5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:51.471960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c743a29a-584a-48cc-8e28-bd055cb0af5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:51.472515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c743a29a-584a-48cc-8e28-bd055cb0af5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:51.473389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c743a29a-584a-48cc-8e28-bd055cb0af5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:51.477029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c743a29a-584a-48cc-8e28-bd055cb0af5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:51.593055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c743a29a-584a-48cc-8e28-bd055cb0af5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:51.613017 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c743a29a-584a-48cc-8e28-bd055cb0af5a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 200 len: 1201 microversion: 2.1 time: 0.159817 Jul 20 04:44:51.613626 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3069/6149] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:51 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 1201 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:52.629692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd6487c6-d51b-40e0-a09f-963b72a86331 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:52.630239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd6487c6-d51b-40e0-a09f-963b72a86331 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:52.639902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd6487c6-d51b-40e0-a09f-963b72a86331 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.640373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd6487c6-d51b-40e0-a09f-963b72a86331 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.641249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd6487c6-d51b-40e0-a09f-963b72a86331 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.641710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd6487c6-d51b-40e0-a09f-963b72a86331 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.708809 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-cd6487c6-d51b-40e0-a09f-963b72a86331 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd6487c6-d51b-40e0-a09f-963b72a86331 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 HTTP/1.1 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4701d59a-a341-4429-940a-503c0f49bbb8'} Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:52.711868 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.716963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:52.716963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:52.716963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:52.716963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:52.716963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:52.716963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:52.716963 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:52.716963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd6487c6-d51b-40e0-a09f-963b72a86331 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:52.716963 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd6487c6-d51b-40e0-a09f-963b72a86331 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 404 len: 111 microversion: 2.1 time: 0.088521 Jul 20 04:44:52.718722 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3081/6150] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:52 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:56.039146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4005ba40-0b36-4d45-a9dd-a20fefdf58a7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:56.040414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4005ba40-0b36-4d45-a9dd-a20fefdf58a7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:56.051636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4005ba40-0b36-4d45-a9dd-a20fefdf58a7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.053275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4005ba40-0b36-4d45-a9dd-a20fefdf58a7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.055647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4005ba40-0b36-4d45-a9dd-a20fefdf58a7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.059493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4005ba40-0b36-4d45-a9dd-a20fefdf58a7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.089446 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-4005ba40-0b36-4d45-a9dd-a20fefdf58a7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4005ba40-0b36-4d45-a9dd-a20fefdf58a7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 HTTP/1.1 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '5569e35e-e42c-4139-a787-986331f1c751'} Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:56.091740 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4005ba40-0b36-4d45-a9dd-a20fefdf58a7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4005ba40-0b36-4d45-a9dd-a20fefdf58a7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 404 len: 111 microversion: 2.1 time: 0.057995 Jul 20 04:44:56.095419 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3070/6151] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:56 2022] DELETE /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:56.104829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06164565-0a23-4cc3-a0c4-4eb47bf1b22a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:56.105463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-06164565-0a23-4cc3-a0c4-4eb47bf1b22a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 5569e35e-e42c-4139-a787-986331f1c751] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:56.140480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06164565-0a23-4cc3-a0c4-4eb47bf1b22a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.140952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06164565-0a23-4cc3-a0c4-4eb47bf1b22a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.141762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06164565-0a23-4cc3-a0c4-4eb47bf1b22a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.142220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-06164565-0a23-4cc3-a0c4-4eb47bf1b22a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.182375 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-06164565-0a23-4cc3-a0c4-4eb47bf1b22a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06164565-0a23-4cc3-a0c4-4eb47bf1b22a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 HTTP/1.1 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '5569e35e-e42c-4139-a787-986331f1c751'} Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:56.184442 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.188864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:56.188864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:56.188864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:56.188864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:56.188864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:56.188864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. Jul 20 04:44:56.188864 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:56.190390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-06164565-0a23-4cc3-a0c4-4eb47bf1b22a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 5569e35e-e42c-4139-a787-986331f1c751 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:56.191449 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-06164565-0a23-4cc3-a0c4-4eb47bf1b22a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751" status: 404 len: 111 microversion: 2.1 time: 0.091298 Jul 20 04:44:56.192397 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3082/6152] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:56 2022] GET /compute/v2.1/servers/5569e35e-e42c-4139-a787-986331f1c751 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:57.040234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c3cbf8cd-87bf-46b3-b819-853d3b38e50f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.041380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c3cbf8cd-87bf-46b3-b819-853d3b38e50f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.048223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3cbf8cd-87bf-46b3-b819-853d3b38e50f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.048703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3cbf8cd-87bf-46b3-b819-853d3b38e50f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.049515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3cbf8cd-87bf-46b3-b819-853d3b38e50f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.049980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c3cbf8cd-87bf-46b3-b819-853d3b38e50f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.066687 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c3cbf8cd-87bf-46b3-b819-853d3b38e50f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c3cbf8cd-87bf-46b3-b819-853d3b38e50f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 HTTP/1.1 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4701d59a-a341-4429-940a-503c0f49bbb8'} Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:57.068372 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c3cbf8cd-87bf-46b3-b819-853d3b38e50f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:57.071750 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c3cbf8cd-87bf-46b3-b819-853d3b38e50f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 404 len: 111 microversion: 2.1 time: 0.033662 Jul 20 04:44:57.074288 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3071/6153] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:57 2022] DELETE /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:57.079762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-69244b8a-23f9-4599-af72-57123e10acb1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.080706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-69244b8a-23f9-4599-af72-57123e10acb1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4701d59a-a341-4429-940a-503c0f49bbb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.088606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69244b8a-23f9-4599-af72-57123e10acb1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.089193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69244b8a-23f9-4599-af72-57123e10acb1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.091424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69244b8a-23f9-4599-af72-57123e10acb1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.092146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69244b8a-23f9-4599-af72-57123e10acb1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.108406 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-69244b8a-23f9-4599-af72-57123e10acb1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-69244b8a-23f9-4599-af72-57123e10acb1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 HTTP/1.1 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4701d59a-a341-4429-940a-503c0f49bbb8'} Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:57.110897 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:57.114508 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:57.114508 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:57.114508 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:57.114508 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:57.114508 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:57.114508 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. Jul 20 04:44:57.114508 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:44:57.116385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-69244b8a-23f9-4599-af72-57123e10acb1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 4701d59a-a341-4429-940a-503c0f49bbb8 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:57.117467 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-69244b8a-23f9-4599-af72-57123e10acb1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8" status: 404 len: 111 microversion: 2.1 time: 0.041870 Jul 20 04:44:57.118579 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3083/6154] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:57 2022] GET /compute/v2.1/servers/4701d59a-a341-4429-940a-503c0f49bbb8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:57.210570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ef5123df-8a68-41b5-830c-20869bc04207 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Action: 'create', calling method: .version_select at 0x7fb841b07ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-834958577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4Bz9hELru54Vad7eJLvenL7PAnsbybKTfmkJK/QscvTJn9osjZ6HQzaPd5TJ/Qq71r0liFlQ9fNdVtx9tZD5zFil9MZY0mZL5SzlqCY+C49HnoHdY1p7gAuIMWBObM2w=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:57.240670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ef5123df-8a68-41b5-830c-20869bc04207 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for project ddf178a8537f486682d29fa0d175b943. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:44:57.253017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3737d05-ef6a-45ef-b92f-11a6ed7a5d27 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.253532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d3737d05-ef6a-45ef-b92f-11a6ed7a5d27 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.265196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-ef5123df-8a68-41b5-830c-20869bc04207 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for user f1067c18d4074c78a512d89e07141915 and project ddf178a8537f486682d29fa0d175b943. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:44:57.267833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3737d05-ef6a-45ef-b92f-11a6ed7a5d27 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.268576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3737d05-ef6a-45ef-b92f-11a6ed7a5d27 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.269417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3737d05-ef6a-45ef-b92f-11a6ed7a5d27 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.269874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3737d05-ef6a-45ef-b92f-11a6ed7a5d27 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.316688 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d3737d05-ef6a-45ef-b92f-11a6ed7a5d27 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments/9f4fc6a7-5dfb-46d4-ba0b-5ca5c101e9a9" status: 200 len: 194 microversion: 2.20 time: 0.067649 Jul 20 04:44:57.318350 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3084/6155] 10.222.0.59 () {60 vars in 1453 bytes} [Wed Jul 20 04:44:57 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments/9f4fc6a7-5dfb-46d4-ba0b-5ca5c101e9a9 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:44:57.329237 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ef5123df-8a68-41b5-830c-20869bc04207 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.123333 Jul 20 04:44:57.330270 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3072/6156] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:44:57 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:57.400205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d50c970f-c68b-4ef9-bd88-5113eca436bc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.400916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d50c970f-c68b-4ef9-bd88-5113eca436bc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.407576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d50c970f-c68b-4ef9-bd88-5113eca436bc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.408220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d50c970f-c68b-4ef9-bd88-5113eca436bc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.409393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d50c970f-c68b-4ef9-bd88-5113eca436bc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.410670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d50c970f-c68b-4ef9-bd88-5113eca436bc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.569435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-d50c970f-c68b-4ef9-bd88-5113eca436bc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lazy-loading 'services' on Instance uuid f3973340-115d-4612-a266-e4403274d648 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:44:57.688042 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d50c970f-c68b-4ef9-bd88-5113eca436bc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments/9f4fc6a7-5dfb-46d4-ba0b-5ca5c101e9a9" status: 202 len: 0 microversion: 2.20 time: 0.292760 Jul 20 04:44:57.689529 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3085/6157] 10.222.0.59 () {60 vars in 1456 bytes} [Wed Jul 20 04:44:57 2022] DELETE /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments/9f4fc6a7-5dfb-46d4-ba0b-5ca5c101e9a9 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:57.701071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c6d5480-a576-4351-b05a-cddd5bf24c1a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.702023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8c6d5480-a576-4351-b05a-cddd5bf24c1a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.737769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c6d5480-a576-4351-b05a-cddd5bf24c1a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.741004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c6d5480-a576-4351-b05a-cddd5bf24c1a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.744237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c6d5480-a576-4351-b05a-cddd5bf24c1a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.745505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c6d5480-a576-4351-b05a-cddd5bf24c1a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.798732 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c6d5480-a576-4351-b05a-cddd5bf24c1a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103401 Jul 20 04:44:57.802485 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3073/6158] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:44:57 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:44:58.814854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b7861d0f-a18e-4444-9a3b-9f081b93fe00 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:58.817918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b7861d0f-a18e-4444-9a3b-9f081b93fe00 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:58.828003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7861d0f-a18e-4444-9a3b-9f081b93fe00 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.828659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7861d0f-a18e-4444-9a3b-9f081b93fe00 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.829332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7861d0f-a18e-4444-9a3b-9f081b93fe00 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.829953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7861d0f-a18e-4444-9a3b-9f081b93fe00 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.867662 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b7861d0f-a18e-4444-9a3b-9f081b93fe00 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059223 Jul 20 04:44:58.869388 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3086/6159] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:44:58 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:44:59.880922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5cd4ed6b-65da-4ad0-952d-043ee3301e72 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:59.881879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5cd4ed6b-65da-4ad0-952d-043ee3301e72 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:59.923826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5cd4ed6b-65da-4ad0-952d-043ee3301e72 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.924483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5cd4ed6b-65da-4ad0-952d-043ee3301e72 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:59.925550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5cd4ed6b-65da-4ad0-952d-043ee3301e72 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.926280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5cd4ed6b-65da-4ad0-952d-043ee3301e72 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.028143 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5cd4ed6b-65da-4ad0-952d-043ee3301e72 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147242 Jul 20 04:45:00.034570 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3074/6160] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:44:59 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:45:01.043471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1107054-fa6c-417f-bbf8-8fb55b4f45f5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:01.044419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d1107054-fa6c-417f-bbf8-8fb55b4f45f5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:01.056913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1107054-fa6c-417f-bbf8-8fb55b4f45f5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.060712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1107054-fa6c-417f-bbf8-8fb55b4f45f5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.062312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1107054-fa6c-417f-bbf8-8fb55b4f45f5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.064581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1107054-fa6c-417f-bbf8-8fb55b4f45f5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.143275 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1107054-fa6c-417f-bbf8-8fb55b4f45f5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104492 Jul 20 04:45:01.145710 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3087/6161] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:45:01 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:45:02.156343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dad04a53-199c-41eb-89d6-7cab2601971b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:02.157853 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dad04a53-199c-41eb-89d6-7cab2601971b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:02.171057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dad04a53-199c-41eb-89d6-7cab2601971b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.173462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dad04a53-199c-41eb-89d6-7cab2601971b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.174518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dad04a53-199c-41eb-89d6-7cab2601971b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.178978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dad04a53-199c-41eb-89d6-7cab2601971b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.225521 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dad04a53-199c-41eb-89d6-7cab2601971b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073050 Jul 20 04:45:02.227144 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3075/6162] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:45:02 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:45:03.237952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9497da6b-acc9-4792-8d66-5af8a17089af tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:03.252735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9497da6b-acc9-4792-8d66-5af8a17089af tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:03.282869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9497da6b-acc9-4792-8d66-5af8a17089af tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:03.283619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9497da6b-acc9-4792-8d66-5af8a17089af tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:03.287087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9497da6b-acc9-4792-8d66-5af8a17089af tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:03.288067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9497da6b-acc9-4792-8d66-5af8a17089af tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:03.371430 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9497da6b-acc9-4792-8d66-5af8a17089af tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.136248 Jul 20 04:45:03.379436 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3088/6163] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:45:03 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:45:04.384470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6014f506-54ad-43d0-8eea-ab56c0dc9a7a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:04.387079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6014f506-54ad-43d0-8eea-ab56c0dc9a7a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:04.405097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6014f506-54ad-43d0-8eea-ab56c0dc9a7a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.405555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6014f506-54ad-43d0-8eea-ab56c0dc9a7a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.406395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6014f506-54ad-43d0-8eea-ab56c0dc9a7a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.406852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6014f506-54ad-43d0-8eea-ab56c0dc9a7a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.462174 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6014f506-54ad-43d0-8eea-ab56c0dc9a7a tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.082238 Jul 20 04:45:04.464059 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3076/6164] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:45:04 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:04.539426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1af5958f-55f0-40e4-bbcf-652691b12593 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:04.539953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1af5958f-55f0-40e4-bbcf-652691b12593 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:04.550418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=30 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:04.575926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1af5958f-55f0-40e4-bbcf-652691b12593 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.576397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1af5958f-55f0-40e4-bbcf-652691b12593 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.577199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1af5958f-55f0-40e4-bbcf-652691b12593 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.577649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1af5958f-55f0-40e4-bbcf-652691b12593 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.626043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1af5958f-55f0-40e4-bbcf-652691b12593 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:45:04.736831 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1af5958f-55f0-40e4-bbcf-652691b12593 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 204 len: 0 microversion: 2.20 time: 0.204007 Jul 20 04:45:04.739665 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3089/6165] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:45:04 2022] DELETE /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:45:04.749844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66e7ee6b-1346-4057-b338-5e3662631196 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:04.750792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-66e7ee6b-1346-4057-b338-5e3662631196 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:04.761288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66e7ee6b-1346-4057-b338-5e3662631196 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.761988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66e7ee6b-1346-4057-b338-5e3662631196 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.763446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66e7ee6b-1346-4057-b338-5e3662631196 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.764101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66e7ee6b-1346-4057-b338-5e3662631196 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:05.032724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66e7ee6b-1346-4057-b338-5e3662631196 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:05.053366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66e7ee6b-1346-4057-b338-5e3662631196 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:05.061211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66e7ee6b-1346-4057-b338-5e3662631196 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:05.067738 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-66e7ee6b-1346-4057-b338-5e3662631196 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.322476 Jul 20 04:45:05.068474 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3077/6166] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:04 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:06.090904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31c563ab-b35b-47bd-8a4e-06b0c26de426 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:06.092399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31c563ab-b35b-47bd-8a4e-06b0c26de426 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:06.100248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31c563ab-b35b-47bd-8a4e-06b0c26de426 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:06.100722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31c563ab-b35b-47bd-8a4e-06b0c26de426 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.101561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31c563ab-b35b-47bd-8a4e-06b0c26de426 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:06.102042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31c563ab-b35b-47bd-8a4e-06b0c26de426 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.784749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31c563ab-b35b-47bd-8a4e-06b0c26de426 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:06.803533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31c563ab-b35b-47bd-8a4e-06b0c26de426 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:06.805386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31c563ab-b35b-47bd-8a4e-06b0c26de426 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:06.806959 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31c563ab-b35b-47bd-8a4e-06b0c26de426 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1724 microversion: 2.20 time: 0.723490 Jul 20 04:45:06.808029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3090/6167] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:06 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1724 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:07.826614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d13a3d8-a149-421d-a95e-e797b957b821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:07.827412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d13a3d8-a149-421d-a95e-e797b957b821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:07.830536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:07.843365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d13a3d8-a149-421d-a95e-e797b957b821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:07.847090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d13a3d8-a149-421d-a95e-e797b957b821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.850346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d13a3d8-a149-421d-a95e-e797b957b821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:07.853011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d13a3d8-a149-421d-a95e-e797b957b821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.898102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c6e55c42-10c3-4b30-b154-c21a3782ed74 req-3815ee64-6f23-468b-94a9-ee924cb84053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3973340-115d-4612-a266-e4403274d648", "name": "network-vif-deleted", "tag": "d14f90e5-dbf1-405a-80b2-d712f8275251"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:07.912474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c6e55c42-10c3-4b30-b154-c21a3782ed74 req-3815ee64-6f23-468b-94a9-ee924cb84053 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:07.912980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c6e55c42-10c3-4b30-b154-c21a3782ed74 req-3815ee64-6f23-468b-94a9-ee924cb84053 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.933896 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c6e55c42-10c3-4b30-b154-c21a3782ed74 req-3815ee64-6f23-468b-94a9-ee924cb84053 service nova] Creating event network-vif-deleted:d14f90e5-dbf1-405a-80b2-d712f8275251 for instance f3973340-115d-4612-a266-e4403274d648 on n-h2-760456-11 Jul 20 04:45:07.939269 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c6e55c42-10c3-4b30-b154-c21a3782ed74 req-3815ee64-6f23-468b-94a9-ee924cb84053 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045402 Jul 20 04:45:07.940233 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3091/6168] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:08.037863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d13a3d8-a149-421d-a95e-e797b957b821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:08.060094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d13a3d8-a149-421d-a95e-e797b957b821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:08.067208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d13a3d8-a149-421d-a95e-e797b957b821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:08.075243 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d13a3d8-a149-421d-a95e-e797b957b821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 200 len: 1656 microversion: 2.20 time: 0.253954 Jul 20 04:45:08.077671 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3078/6169] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:07 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 1656 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:09.107464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a8a84c86-1ec5-45e4-b3a1-4d698fab4cfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:09.108583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a8a84c86-1ec5-45e4-b3a1-4d698fab4cfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:09.122177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8a84c86-1ec5-45e4-b3a1-4d698fab4cfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:09.122905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8a84c86-1ec5-45e4-b3a1-4d698fab4cfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:09.123887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8a84c86-1ec5-45e4-b3a1-4d698fab4cfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:09.124506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8a84c86-1ec5-45e4-b3a1-4d698fab4cfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:09.169886 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a8a84c86-1ec5-45e4-b3a1-4d698fab4cfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] HTTP exception thrown: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a8a84c86-1ec5-45e4-b3a1-4d698fab4cfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Request method failure captured: Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 HTTP/1.1 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14eliJ5bPMTh7FMHMamK9Icp_E_ZQeJLxzP1_rfc0JYhqFUmHbojAFhI5Ht94nxbGGSvzyPlq4Q9tU_aVQXsuo8L91g_qHZCTqzfVbgTxJWn8pw-sQiyZjYKUO8ozRPyYm4Pm-5YcxU3OqMNHfv2U0ENmaMFBjRdpEDe5ohibpVzWQE Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 3d81b221d0764da793a85facc04b48f0 Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'f3973340-115d-4612-a266-e4403274d648'} Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:45:09.186091 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:09.189877 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:45:09.189877 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:09.189877 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:09.189877 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:09.189877 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:45:09.189877 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:45:09.189877 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:45:09.189877 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:45:09.195566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a8a84c86-1ec5-45e4-b3a1-4d698fab4cfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Returning 404 to user: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:45:09.197277 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a8a84c86-1ec5-45e4-b3a1-4d698fab4cfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 404 len: 111 microversion: 2.20 time: 0.105975 Jul 20 04:45:09.198064 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3092/6170] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:09 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:45:09.208517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-49db5c8c-c232-4a7d-9dd2-f89ab131729c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '.version_select at 0x7fb8413ba0d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:09.238450 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-49db5c8c-c232-4a7d-9dd2-f89ab131729c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-267800987" status: 204 len: 0 microversion: 2.20 time: 0.035668 Jul 20 04:45:09.240107 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3079/6171] 10.222.0.59 () {60 vars in 1258 bytes} [Wed Jul 20 04:45:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-267800987 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:45:10.523707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-55017f85-b335-4928-aed0-f69d066feeb4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Action: 'create', calling method: .version_select at 0x7fb842c8bee0>, body: {"keypair": {"name": "tempest-keypair-1639539680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7QXzG2NA/2rh0GZt/OXSKjeUWPAXuhff0XUxXKkbIYLo1OZo14DzVHuX6D25kj5R/M7bZ6rvW60eZfpOQtgKMHQ4AqU7j/vbHp9LftxsGTiijLEYAN0etlXddl3l1Fzw=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:10.547426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-55017f85-b335-4928-aed0-f69d066feeb4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Getting quotas for project 0e78752a239344cba02a2e6ed3e088f7. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:10.553936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-55017f85-b335-4928-aed0-f69d066feeb4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Getting quotas for user 3d81b221d0764da793a85facc04b48f0 and project 0e78752a239344cba02a2e6ed3e088f7. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:10.588658 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-55017f85-b335-4928-aed0-f69d066feeb4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.068942 Jul 20 04:45:10.589959 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3093/6172] 10.222.0.59 () {62 vars in 1199 bytes} [Wed Jul 20 04:45:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:45:12.376060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-505469319", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94c27959-ad93-4b8c-bd1d-184ec2f86d1a"}], "security_groups": [{"name": "tempest-securitygroup--176900490"}], "key_name": "tempest-keypair-1639539680", "user_data": "}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:12.550801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] validate_networks() for [('94c27959-ad93-4b8c-bd1d-184ec2f86d1a', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:45:13.559240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:45:13.559764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:45:13.560062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:45:13.560489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:45:13.561092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:45:13.570444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.571188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.572249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.572718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.594895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Getting quotas for project 0e78752a239344cba02a2e6ed3e088f7. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:13.600809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Getting quotas for user 3d81b221d0764da793a85facc04b48f0 and project 0e78752a239344cba02a2e6ed3e088f7. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:13.625805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:45:13.627728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:45:13.745624 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fb65209f-6bd4-43f4-aa36-2a980c89b9a8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.375098 Jul 20 04:45:13.756376 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3080/6173] 10.222.0.59 () {62 vars in 1187 bytes} [Wed Jul 20 04:45:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:45:13.763200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3dc59d92-93b1-47c8-ac2e-d296c458182d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:13.764043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3dc59d92-93b1-47c8-ac2e-d296c458182d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:13.861206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3dc59d92-93b1-47c8-ac2e-d296c458182d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:13.870243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3dc59d92-93b1-47c8-ac2e-d296c458182d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:13.872082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3dc59d92-93b1-47c8-ac2e-d296c458182d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:13.873269 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3dc59d92-93b1-47c8-ac2e-d296c458182d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1281 microversion: 2.20 time: 0.115959 Jul 20 04:45:13.885285 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3094/6174] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:13 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1281 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:45:14.893960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5228a66e-12c0-4da9-8e1a-0ff1a5f682c2 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:14.894893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5228a66e-12c0-4da9-8e1a-0ff1a5f682c2 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:14.897031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:14.907594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5228a66e-12c0-4da9-8e1a-0ff1a5f682c2 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:14.910008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5228a66e-12c0-4da9-8e1a-0ff1a5f682c2 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:14.912236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5228a66e-12c0-4da9-8e1a-0ff1a5f682c2 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:14.912747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5228a66e-12c0-4da9-8e1a-0ff1a5f682c2 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:15.002585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5228a66e-12c0-4da9-8e1a-0ff1a5f682c2 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:15.014685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5228a66e-12c0-4da9-8e1a-0ff1a5f682c2 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:15.017195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5228a66e-12c0-4da9-8e1a-0ff1a5f682c2 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:15.018379 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5228a66e-12c0-4da9-8e1a-0ff1a5f682c2 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1333 microversion: 2.20 time: 0.129835 Jul 20 04:45:15.019692 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3081/6175] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:14 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1333 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:16.041003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-95eda8a0-59eb-4807-9d15-a9cf75eb0ed1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:16.042476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-95eda8a0-59eb-4807-9d15-a9cf75eb0ed1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:16.054822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95eda8a0-59eb-4807-9d15-a9cf75eb0ed1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:16.055383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95eda8a0-59eb-4807-9d15-a9cf75eb0ed1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:16.056962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95eda8a0-59eb-4807-9d15-a9cf75eb0ed1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:16.057566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95eda8a0-59eb-4807-9d15-a9cf75eb0ed1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:16.071947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:16.430082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-95eda8a0-59eb-4807-9d15-a9cf75eb0ed1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:16.444384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-95eda8a0-59eb-4807-9d15-a9cf75eb0ed1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:16.446114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-95eda8a0-59eb-4807-9d15-a9cf75eb0ed1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:16.449247 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-95eda8a0-59eb-4807-9d15-a9cf75eb0ed1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1406 microversion: 2.20 time: 0.412849 Jul 20 04:45:16.450560 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3095/6176] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:16 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:17.285696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-8cf60c67-19d4-4416-9cf8-9610c2d330ae req-7438e794-8f9f-4003-82c0-1f739080d313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7726d31d-d502-4fb4-b3f4-9f216964f472", "tag": "0e4b1655-ae06-4440-bff4-5a605861043d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:17.317058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8cf60c67-19d4-4416-9cf8-9610c2d330ae req-7438e794-8f9f-4003-82c0-1f739080d313 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.319106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8cf60c67-19d4-4416-9cf8-9610c2d330ae req-7438e794-8f9f-4003-82c0-1f739080d313 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.349099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=67 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:17.360208 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8cf60c67-19d4-4416-9cf8-9610c2d330ae req-7438e794-8f9f-4003-82c0-1f739080d313 service nova] Creating event network-changed:0e4b1655-ae06-4440-bff4-5a605861043d for instance 7726d31d-d502-4fb4-b3f4-9f216964f472 on n-h1-760456-11 Jul 20 04:45:17.368783 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-8cf60c67-19d4-4416-9cf8-9610c2d330ae req-7438e794-8f9f-4003-82c0-1f739080d313 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087137 Jul 20 04:45:17.372079 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3082/6177] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:45:17.470204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-80548ed7-1e99-44a3-91ee-8dd87f1e01a1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:17.471489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-80548ed7-1e99-44a3-91ee-8dd87f1e01a1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:17.485513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80548ed7-1e99-44a3-91ee-8dd87f1e01a1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.486385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80548ed7-1e99-44a3-91ee-8dd87f1e01a1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.487409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80548ed7-1e99-44a3-91ee-8dd87f1e01a1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.488069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80548ed7-1e99-44a3-91ee-8dd87f1e01a1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:18.157820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-80548ed7-1e99-44a3-91ee-8dd87f1e01a1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:18.173271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-80548ed7-1e99-44a3-91ee-8dd87f1e01a1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:18.174820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-80548ed7-1e99-44a3-91ee-8dd87f1e01a1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:18.176174 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-80548ed7-1e99-44a3-91ee-8dd87f1e01a1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1406 microversion: 2.20 time: 0.710638 Jul 20 04:45:18.177422 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3096/6178] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:17 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1406 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:19.198196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8fbf3a5d-5442-46c8-9150-61cc9ad5530b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:19.198937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8fbf3a5d-5442-46c8-9150-61cc9ad5530b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:19.211239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fbf3a5d-5442-46c8-9150-61cc9ad5530b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:19.213725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fbf3a5d-5442-46c8-9150-61cc9ad5530b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:19.216368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fbf3a5d-5442-46c8-9150-61cc9ad5530b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:19.217776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fbf3a5d-5442-46c8-9150-61cc9ad5530b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:19.417881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8fbf3a5d-5442-46c8-9150-61cc9ad5530b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:19.433736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8fbf3a5d-5442-46c8-9150-61cc9ad5530b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:19.436073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8fbf3a5d-5442-46c8-9150-61cc9ad5530b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:19.443392 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8fbf3a5d-5442-46c8-9150-61cc9ad5530b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1406 microversion: 2.20 time: 0.250097 Jul 20 04:45:19.457629 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3083/6179] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:19 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:20.463436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-16b49991-b683-4678-8b6d-0d28b14925d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:20.463931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-16b49991-b683-4678-8b6d-0d28b14925d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:20.475423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16b49991-b683-4678-8b6d-0d28b14925d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:20.475891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16b49991-b683-4678-8b6d-0d28b14925d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:20.476700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16b49991-b683-4678-8b6d-0d28b14925d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:20.477154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16b49991-b683-4678-8b6d-0d28b14925d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:20.629248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-16b49991-b683-4678-8b6d-0d28b14925d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:20.642562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-16b49991-b683-4678-8b6d-0d28b14925d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:20.646355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-16b49991-b683-4678-8b6d-0d28b14925d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:20.647620 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-16b49991-b683-4678-8b6d-0d28b14925d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1406 microversion: 2.20 time: 0.189077 Jul 20 04:45:20.650797 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3097/6180] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:20 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:21.668803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a2acd2a7-3389-4b02-a8c4-d0d1808e9d30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:21.670105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a2acd2a7-3389-4b02-a8c4-d0d1808e9d30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:21.696922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2acd2a7-3389-4b02-a8c4-d0d1808e9d30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.697705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2acd2a7-3389-4b02-a8c4-d0d1808e9d30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.698782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2acd2a7-3389-4b02-a8c4-d0d1808e9d30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.699422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a2acd2a7-3389-4b02-a8c4-d0d1808e9d30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.978198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a2acd2a7-3389-4b02-a8c4-d0d1808e9d30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:22.002931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a2acd2a7-3389-4b02-a8c4-d0d1808e9d30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:22.005801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a2acd2a7-3389-4b02-a8c4-d0d1808e9d30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:22.007496 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a2acd2a7-3389-4b02-a8c4-d0d1808e9d30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1406 microversion: 2.20 time: 0.343084 Jul 20 04:45:22.008684 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3084/6181] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:21 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:23.032252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-07ea74ab-7b9b-4682-8b60-c5fed694bf8d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:23.032896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-07ea74ab-7b9b-4682-8b60-c5fed694bf8d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:23.052500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07ea74ab-7b9b-4682-8b60-c5fed694bf8d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.052971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07ea74ab-7b9b-4682-8b60-c5fed694bf8d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.053783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07ea74ab-7b9b-4682-8b60-c5fed694bf8d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.054237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07ea74ab-7b9b-4682-8b60-c5fed694bf8d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.158461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-484ed95b-6edb-4579-b026-56f3f61508e1 req-d5844807-6a85-4b45-b0ad-6aff463c9925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7726d31d-d502-4fb4-b3f4-9f216964f472", "name": "network-vif-plugged", "status": "completed", "tag": "0e4b1655-ae06-4440-bff4-5a605861043d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:23.184528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-484ed95b-6edb-4579-b026-56f3f61508e1 req-d5844807-6a85-4b45-b0ad-6aff463c9925 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.185034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-484ed95b-6edb-4579-b026-56f3f61508e1 req-d5844807-6a85-4b45-b0ad-6aff463c9925 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.225531 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-484ed95b-6edb-4579-b026-56f3f61508e1 req-d5844807-6a85-4b45-b0ad-6aff463c9925 service nova] Creating event network-vif-plugged:0e4b1655-ae06-4440-bff4-5a605861043d for instance 7726d31d-d502-4fb4-b3f4-9f216964f472 on n-h1-760456-11 Jul 20 04:45:23.247044 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-484ed95b-6edb-4579-b026-56f3f61508e1 req-d5844807-6a85-4b45-b0ad-6aff463c9925 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092487 Jul 20 04:45:23.252154 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3085/6182] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:45:23.554603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-07ea74ab-7b9b-4682-8b60-c5fed694bf8d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:23.563844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-07ea74ab-7b9b-4682-8b60-c5fed694bf8d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:23.565800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-07ea74ab-7b9b-4682-8b60-c5fed694bf8d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:23.567154 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-07ea74ab-7b9b-4682-8b60-c5fed694bf8d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1406 microversion: 2.20 time: 0.540344 Jul 20 04:45:23.573158 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3098/6183] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:23 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1406 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:24.065065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1367440105", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-834958577", "security_groups": [{"name": "tempest-secgroup-smoke-1582677957"}], "block_device_mapping_v2": [{"uuid": "786ab916-dbb5-4270-8bba-ec343a58e8aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff98390c-0468-4cc8-9649-ee7fac3db692"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:24.075711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:24.076515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:24.289258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] validate_networks() for [('ff98390c-0468-4cc8-9649-ee7fac3db692', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:45:24.591148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-487ac32e-699e-4f9c-913a-e25d740d06c9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:24.591705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-487ac32e-699e-4f9c-913a-e25d740d06c9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:24.606877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:24.610036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-487ac32e-699e-4f9c-913a-e25d740d06c9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.610523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-487ac32e-699e-4f9c-913a-e25d740d06c9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.611317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-487ac32e-699e-4f9c-913a-e25d740d06c9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.611761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-487ac32e-699e-4f9c-913a-e25d740d06c9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.810610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-487ac32e-699e-4f9c-913a-e25d740d06c9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:24.818806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-487ac32e-699e-4f9c-913a-e25d740d06c9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:24.820341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-487ac32e-699e-4f9c-913a-e25d740d06c9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:24.822944 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-487ac32e-699e-4f9c-913a-e25d740d06c9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1406 microversion: 2.20 time: 0.240818 Jul 20 04:45:24.823534 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3099/6184] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:24 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:45:24.947365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:45:24.948159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:45:24.949512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:45:24.950104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:45:24.951425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:45:24.973395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.973876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.974755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.975220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.998217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:25.004296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for user f1067c18d4074c78a512d89e07141915 and project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:25.077571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:45:25.082074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='786ab916-dbb5-4270-8bba-ec343a58e8aa',volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:45:25.246173 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3301ad4a-acc0-4479-8d8b-b7bfa280d143 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.186130 Jul 20 04:45:25.247863 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3086/6185] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:45:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:45:25.258472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1e7fca7f-774a-41be-a77f-e21b7e1010f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:25.260285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1e7fca7f-774a-41be-a77f-e21b7e1010f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:25.335313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1e7fca7f-774a-41be-a77f-e21b7e1010f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:25.347684 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1e7fca7f-774a-41be-a77f-e21b7e1010f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1094 microversion: 2.1 time: 0.092919 Jul 20 04:45:25.360518 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3100/6186] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:25 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1094 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:25.842984 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-880a4cd6-be18-4e82-919a-aa148862df30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:25.844372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-880a4cd6-be18-4e82-919a-aa148862df30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:25.851502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-880a4cd6-be18-4e82-919a-aa148862df30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:25.853269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-880a4cd6-be18-4e82-919a-aa148862df30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:25.854365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-880a4cd6-be18-4e82-919a-aa148862df30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:25.855055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-880a4cd6-be18-4e82-919a-aa148862df30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.136961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-880a4cd6-be18-4e82-919a-aa148862df30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:26.146282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-880a4cd6-be18-4e82-919a-aa148862df30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:26.147942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-880a4cd6-be18-4e82-919a-aa148862df30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:26.149658 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-880a4cd6-be18-4e82-919a-aa148862df30 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1597 microversion: 2.20 time: 0.311271 Jul 20 04:45:26.151014 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3087/6187] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:45:25 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1597 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:45:26.175483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fe732795-90c5-41bb-8e2b-fc6dd82d3de6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:26.175998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fe732795-90c5-41bb-8e2b-fc6dd82d3de6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:26.189247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe732795-90c5-41bb-8e2b-fc6dd82d3de6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:26.190848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe732795-90c5-41bb-8e2b-fc6dd82d3de6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.192097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe732795-90c5-41bb-8e2b-fc6dd82d3de6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:26.192717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe732795-90c5-41bb-8e2b-fc6dd82d3de6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.364816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e4759291-062d-4e13-9802-fa98b667e297 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:26.365348 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fe732795-90c5-41bb-8e2b-fc6dd82d3de6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.201400 Jul 20 04:45:26.365477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e4759291-062d-4e13-9802-fa98b667e297 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:26.366465 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3101/6188] 10.222.0.59 () {60 vars in 1315 bytes} [Wed Jul 20 04:45:26 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:45:26.378656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4759291-062d-4e13-9802-fa98b667e297 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:26.379403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4759291-062d-4e13-9802-fa98b667e297 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.380703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4759291-062d-4e13-9802-fa98b667e297 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:26.381472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4759291-062d-4e13-9802-fa98b667e297 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.509999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e4759291-062d-4e13-9802-fa98b667e297 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:26.521871 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e4759291-062d-4e13-9802-fa98b667e297 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1210 microversion: 2.1 time: 0.160699 Jul 20 04:45:26.522511 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3088/6189] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:26 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1210 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:27.540845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b990a6a6-93a2-4f63-9bff-a266aedccfcc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:27.542206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b990a6a6-93a2-4f63-9bff-a266aedccfcc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:27.555105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b990a6a6-93a2-4f63-9bff-a266aedccfcc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:27.565683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b990a6a6-93a2-4f63-9bff-a266aedccfcc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:27.566972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b990a6a6-93a2-4f63-9bff-a266aedccfcc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:27.567678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b990a6a6-93a2-4f63-9bff-a266aedccfcc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:27.956210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b990a6a6-93a2-4f63-9bff-a266aedccfcc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:27.956210 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b990a6a6-93a2-4f63-9bff-a266aedccfcc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1210 microversion: 2.1 time: 0.360475 Jul 20 04:45:27.956210 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3102/6190] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:27 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1210 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:28.913836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b748379-5a69-4169-818d-9202ceba449f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:28.915112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0b748379-5a69-4169-818d-9202ceba449f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:28.940849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b748379-5a69-4169-818d-9202ceba449f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:28.943097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b748379-5a69-4169-818d-9202ceba449f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:28.944258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b748379-5a69-4169-818d-9202ceba449f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:28.946582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0b748379-5a69-4169-818d-9202ceba449f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:29.097158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ca865560-106d-4897-8a1b-3e38d5072cc9 req-df6313d7-95d4-4118-be60-4a723e721709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7726d31d-d502-4fb4-b3f4-9f216964f472", "tag": "0e4b1655-ae06-4440-bff4-5a605861043d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:29.122458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ca865560-106d-4897-8a1b-3e38d5072cc9 req-df6313d7-95d4-4118-be60-4a723e721709 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:29.122925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ca865560-106d-4897-8a1b-3e38d5072cc9 req-df6313d7-95d4-4118-be60-4a723e721709 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:29.176702 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ca865560-106d-4897-8a1b-3e38d5072cc9 req-df6313d7-95d4-4118-be60-4a723e721709 service nova] Creating event network-changed:0e4b1655-ae06-4440-bff4-5a605861043d for instance 7726d31d-d502-4fb4-b3f4-9f216964f472 on n-h1-760456-11 Jul 20 04:45:29.191895 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ca865560-106d-4897-8a1b-3e38d5072cc9 req-df6313d7-95d4-4118-be60-4a723e721709 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098613 Jul 20 04:45:29.192686 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3103/6191] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:29.967775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0b748379-5a69-4169-818d-9202ceba449f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:29.995185 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b748379-5a69-4169-818d-9202ceba449f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1278 microversion: 2.1 time: 1.085887 Jul 20 04:45:29.997159 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3089/6192] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:28 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1278 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:31.024989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a34e5a03-fc46-4e36-b29e-65f730c3f321 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:31.026487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a34e5a03-fc46-4e36-b29e-65f730c3f321 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:31.043739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a34e5a03-fc46-4e36-b29e-65f730c3f321 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:31.044666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a34e5a03-fc46-4e36-b29e-65f730c3f321 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:31.046923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a34e5a03-fc46-4e36-b29e-65f730c3f321 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:31.049021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a34e5a03-fc46-4e36-b29e-65f730c3f321 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:31.235299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c39c2b33-94e7-4ff4-bf42-0ccb2b3a6dd5 req-ab2d5d28-1a4f-4a1d-aa05-74e198085d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e04f244-7107-4419-aaca-08303464f6a9", "tag": "98a2bc3d-06e3-42f4-b7f2-69256c152d9f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:31.257234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c39c2b33-94e7-4ff4-bf42-0ccb2b3a6dd5 req-ab2d5d28-1a4f-4a1d-aa05-74e198085d9e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:31.260027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c39c2b33-94e7-4ff4-bf42-0ccb2b3a6dd5 req-ab2d5d28-1a4f-4a1d-aa05-74e198085d9e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:31.298625 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c39c2b33-94e7-4ff4-bf42-0ccb2b3a6dd5 req-ab2d5d28-1a4f-4a1d-aa05-74e198085d9e service nova] Creating event network-changed:98a2bc3d-06e3-42f4-b7f2-69256c152d9f for instance 4e04f244-7107-4419-aaca-08303464f6a9 on n-h2-760456-11 Jul 20 04:45:31.311243 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c39c2b33-94e7-4ff4-bf42-0ccb2b3a6dd5 req-ab2d5d28-1a4f-4a1d-aa05-74e198085d9e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084861 Jul 20 04:45:31.315156 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3090/6193] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:31.542857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a34e5a03-fc46-4e36-b29e-65f730c3f321 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:31.559266 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a34e5a03-fc46-4e36-b29e-65f730c3f321 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1278 microversion: 2.1 time: 0.547385 Jul 20 04:45:31.569925 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3104/6194] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:31 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1278 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:32.591396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80c880a2-549e-48a8-994e-3779bd8bd0ed tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:32.597972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-80c880a2-549e-48a8-994e-3779bd8bd0ed tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:32.608937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80c880a2-549e-48a8-994e-3779bd8bd0ed tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:32.609790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80c880a2-549e-48a8-994e-3779bd8bd0ed tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:32.610773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80c880a2-549e-48a8-994e-3779bd8bd0ed tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:32.611403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80c880a2-549e-48a8-994e-3779bd8bd0ed tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:32.858291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-80c880a2-549e-48a8-994e-3779bd8bd0ed tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:32.891591 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-80c880a2-549e-48a8-994e-3779bd8bd0ed tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1278 microversion: 2.1 time: 0.311257 Jul 20 04:45:32.893989 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3091/6195] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:32 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1278 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:33.913292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ad9587ac-2e4e-41e5-8578-320f0108757d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:33.915356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ad9587ac-2e4e-41e5-8578-320f0108757d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:33.938824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad9587ac-2e4e-41e5-8578-320f0108757d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:33.939652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad9587ac-2e4e-41e5-8578-320f0108757d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:33.946181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad9587ac-2e4e-41e5-8578-320f0108757d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:33.947083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ad9587ac-2e4e-41e5-8578-320f0108757d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:34.170109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ad9587ac-2e4e-41e5-8578-320f0108757d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:34.179548 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ad9587ac-2e4e-41e5-8578-320f0108757d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1278 microversion: 2.1 time: 0.271230 Jul 20 04:45:34.181994 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3105/6196] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:33 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1278 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:35.199085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-61197f33-4f39-4955-87b2-72fd143bc176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:35.200352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-61197f33-4f39-4955-87b2-72fd143bc176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:35.207019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:35.207660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:35.210423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61197f33-4f39-4955-87b2-72fd143bc176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:35.211055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61197f33-4f39-4955-87b2-72fd143bc176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:35.212612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61197f33-4f39-4955-87b2-72fd143bc176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:35.213601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61197f33-4f39-4955-87b2-72fd143bc176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:35.691087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-61197f33-4f39-4955-87b2-72fd143bc176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:35.714541 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-61197f33-4f39-4955-87b2-72fd143bc176 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1266 microversion: 2.1 time: 0.519797 Jul 20 04:45:35.720677 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3092/6197] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:35 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1266 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:36.732369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-09cdefa1-f1f8-4008-af11-e8942b9f839d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:36.733244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-09cdefa1-f1f8-4008-af11-e8942b9f839d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:36.736288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:36.737822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:36.745272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09cdefa1-f1f8-4008-af11-e8942b9f839d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:36.745850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09cdefa1-f1f8-4008-af11-e8942b9f839d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:36.747032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09cdefa1-f1f8-4008-af11-e8942b9f839d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:36.747567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09cdefa1-f1f8-4008-af11-e8942b9f839d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:36.915643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09cdefa1-f1f8-4008-af11-e8942b9f839d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:36.924400 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-09cdefa1-f1f8-4008-af11-e8942b9f839d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1266 microversion: 2.1 time: 0.195971 Jul 20 04:45:36.934212 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3106/6198] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:36 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:37.942288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc13ad53-b055-4b62-92b5-fdf23377c619 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:37.943001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cc13ad53-b055-4b62-92b5-fdf23377c619 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:37.951744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc13ad53-b055-4b62-92b5-fdf23377c619 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:37.952470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc13ad53-b055-4b62-92b5-fdf23377c619 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:37.953282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc13ad53-b055-4b62-92b5-fdf23377c619 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:37.954119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc13ad53-b055-4b62-92b5-fdf23377c619 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:38.138398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cc13ad53-b055-4b62-92b5-fdf23377c619 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:38.146186 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cc13ad53-b055-4b62-92b5-fdf23377c619 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1266 microversion: 2.1 time: 0.208471 Jul 20 04:45:38.146850 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3093/6199] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:37 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:39.163565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-11d385aa-f954-47cd-a5a9-0f6521cbb2e5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:39.165365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-11d385aa-f954-47cd-a5a9-0f6521cbb2e5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:39.173557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11d385aa-f954-47cd-a5a9-0f6521cbb2e5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:39.174316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11d385aa-f954-47cd-a5a9-0f6521cbb2e5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.175381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11d385aa-f954-47cd-a5a9-0f6521cbb2e5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:39.175996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11d385aa-f954-47cd-a5a9-0f6521cbb2e5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.370751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-11d385aa-f954-47cd-a5a9-0f6521cbb2e5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:39.380514 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-11d385aa-f954-47cd-a5a9-0f6521cbb2e5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1266 microversion: 2.1 time: 0.221095 Jul 20 04:45:39.391837 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3107/6200] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:39 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:40.400464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1984c38b-6b78-4b5b-a406-32420f869059 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:40.402898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1984c38b-6b78-4b5b-a406-32420f869059 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:40.414413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1984c38b-6b78-4b5b-a406-32420f869059 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.415274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1984c38b-6b78-4b5b-a406-32420f869059 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:40.416541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1984c38b-6b78-4b5b-a406-32420f869059 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.417482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1984c38b-6b78-4b5b-a406-32420f869059 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:40.652009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1984c38b-6b78-4b5b-a406-32420f869059 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:40.671066 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1984c38b-6b78-4b5b-a406-32420f869059 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1266 microversion: 2.1 time: 0.268074 Jul 20 04:45:40.683828 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3094/6201] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:40 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:41.691287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2116afcd-048e-4da4-892e-aa49c7e2019b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:41.692622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2116afcd-048e-4da4-892e-aa49c7e2019b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:41.706562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2116afcd-048e-4da4-892e-aa49c7e2019b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:41.707283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2116afcd-048e-4da4-892e-aa49c7e2019b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:41.708287 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2116afcd-048e-4da4-892e-aa49c7e2019b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:41.708905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2116afcd-048e-4da4-892e-aa49c7e2019b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:41.941980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2116afcd-048e-4da4-892e-aa49c7e2019b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:41.954282 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2116afcd-048e-4da4-892e-aa49c7e2019b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1266 microversion: 2.1 time: 0.267097 Jul 20 04:45:41.965439 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3108/6202] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:41 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:42.973225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3a56563c-18ba-4a38-a1b5-22562bb88834 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:42.974157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3a56563c-18ba-4a38-a1b5-22562bb88834 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:42.981773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a56563c-18ba-4a38-a1b5-22562bb88834 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:42.982243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a56563c-18ba-4a38-a1b5-22562bb88834 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:42.983062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a56563c-18ba-4a38-a1b5-22562bb88834 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:42.983512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a56563c-18ba-4a38-a1b5-22562bb88834 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:43.198365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3a56563c-18ba-4a38-a1b5-22562bb88834 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:43.206532 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3a56563c-18ba-4a38-a1b5-22562bb88834 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1266 microversion: 2.1 time: 0.237219 Jul 20 04:45:43.208439 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3095/6203] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:42 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:44.232050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a470d5a-cfe3-433c-b985-7f9767a4555f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:44.235121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4a470d5a-cfe3-433c-b985-7f9767a4555f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:44.243464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a470d5a-cfe3-433c-b985-7f9767a4555f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.244220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a470d5a-cfe3-433c-b985-7f9767a4555f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.245416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a470d5a-cfe3-433c-b985-7f9767a4555f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.246086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a470d5a-cfe3-433c-b985-7f9767a4555f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.414292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4a470d5a-cfe3-433c-b985-7f9767a4555f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:44.425155 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4a470d5a-cfe3-433c-b985-7f9767a4555f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1266 microversion: 2.1 time: 0.204211 Jul 20 04:45:44.427192 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3109/6204] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:44 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:45.444060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9453636e-6378-4ddf-8470-cf243609889b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:45.444728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9453636e-6378-4ddf-8470-cf243609889b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:45.448443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:45.455724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9453636e-6378-4ddf-8470-cf243609889b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.456720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9453636e-6378-4ddf-8470-cf243609889b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.457453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9453636e-6378-4ddf-8470-cf243609889b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.457953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9453636e-6378-4ddf-8470-cf243609889b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.539566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-6a584415-ef05-463d-be95-16df0e76fffd req-22094df9-ef44-403d-b8ea-930d60b957fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e04f244-7107-4419-aaca-08303464f6a9", "name": "network-vif-plugged", "status": "completed", "tag": "98a2bc3d-06e3-42f4-b7f2-69256c152d9f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:45.584330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6a584415-ef05-463d-be95-16df0e76fffd req-22094df9-ef44-403d-b8ea-930d60b957fe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.584797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-6a584415-ef05-463d-be95-16df0e76fffd req-22094df9-ef44-403d-b8ea-930d60b957fe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.609689 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-6a584415-ef05-463d-be95-16df0e76fffd req-22094df9-ef44-403d-b8ea-930d60b957fe service nova] Creating event network-vif-plugged:98a2bc3d-06e3-42f4-b7f2-69256c152d9f for instance 4e04f244-7107-4419-aaca-08303464f6a9 on n-h2-760456-11 Jul 20 04:45:45.617515 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-6a584415-ef05-463d-be95-16df0e76fffd req-22094df9-ef44-403d-b8ea-930d60b957fe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081549 Jul 20 04:45:45.619416 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3110/6205] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:45.957742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9453636e-6378-4ddf-8470-cf243609889b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:45.967821 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9453636e-6378-4ddf-8470-cf243609889b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1266 microversion: 2.1 time: 0.529202 Jul 20 04:45:45.979043 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3096/6206] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:45 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1266 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:46.985680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-03a6456c-e9a5-4902-a987-d223e9d7cea1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:46.986355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-03a6456c-e9a5-4902-a987-d223e9d7cea1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:46.996746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03a6456c-e9a5-4902-a987-d223e9d7cea1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:46.997212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03a6456c-e9a5-4902-a987-d223e9d7cea1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:46.998632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03a6456c-e9a5-4902-a987-d223e9d7cea1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:46.999090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03a6456c-e9a5-4902-a987-d223e9d7cea1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.002072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=80 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:47.224137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-03a6456c-e9a5-4902-a987-d223e9d7cea1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:47.233027 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-03a6456c-e9a5-4902-a987-d223e9d7cea1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1453 microversion: 2.1 time: 0.251574 Jul 20 04:45:47.233987 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3111/6207] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:46 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1453 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:47.251064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bca528b1-43b9-4ec0-8fa8-d811ba9d3093 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:47.251736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bca528b1-43b9-4ec0-8fa8-d811ba9d3093 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:47.259690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bca528b1-43b9-4ec0-8fa8-d811ba9d3093 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:47.260599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bca528b1-43b9-4ec0-8fa8-d811ba9d3093 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.261248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bca528b1-43b9-4ec0-8fa8-d811ba9d3093 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:47.261778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bca528b1-43b9-4ec0-8fa8-d811ba9d3093 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.482801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bca528b1-43b9-4ec0-8fa8-d811ba9d3093 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:47.493342 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bca528b1-43b9-4ec0-8fa8-d811ba9d3093 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1453 microversion: 2.1 time: 0.246767 Jul 20 04:45:47.494139 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3097/6208] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:47 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1453 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:50.504058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-74ccfcaa-0db7-4a41-969e-3427a516ca54 req-1dd6f5be-8ab4-44f5-a505-410bce619834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e04f244-7107-4419-aaca-08303464f6a9", "tag": "98a2bc3d-06e3-42f4-b7f2-69256c152d9f"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:50.525875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-74ccfcaa-0db7-4a41-969e-3427a516ca54 req-1dd6f5be-8ab4-44f5-a505-410bce619834 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:50.528554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-74ccfcaa-0db7-4a41-969e-3427a516ca54 req-1dd6f5be-8ab4-44f5-a505-410bce619834 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:50.564021 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-74ccfcaa-0db7-4a41-969e-3427a516ca54 req-1dd6f5be-8ab4-44f5-a505-410bce619834 service nova] Creating event network-changed:98a2bc3d-06e3-42f4-b7f2-69256c152d9f for instance 4e04f244-7107-4419-aaca-08303464f6a9 on n-h2-760456-11 Jul 20 04:45:50.581854 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-74ccfcaa-0db7-4a41-969e-3427a516ca54 req-1dd6f5be-8ab4-44f5-a505-410bce619834 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081702 Jul 20 04:45:50.585389 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3112/6209] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:02.175192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7c3c8aba-fd77-4b68-b41a-c0cb31e0657b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:02.175872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7c3c8aba-fd77-4b68-b41a-c0cb31e0657b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:02.178710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:02.179949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=79 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:02.185835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c3c8aba-fd77-4b68-b41a-c0cb31e0657b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.186348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c3c8aba-fd77-4b68-b41a-c0cb31e0657b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.187154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c3c8aba-fd77-4b68-b41a-c0cb31e0657b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:02.187617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7c3c8aba-fd77-4b68-b41a-c0cb31e0657b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:02.211899 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7c3c8aba-fd77-4b68-b41a-c0cb31e0657b tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/ips" status: 200 len: 151 microversion: 2.20 time: 0.040770 Jul 20 04:46:02.212579 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3098/6210] 10.222.0.59 () {60 vars in 1288 bytes} [Wed Jul 20 04:46:02 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:46:04.109675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-63ea2212-6cbf-4321-a806-c3b6428fcd60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:04.111013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63ea2212-6cbf-4321-a806-c3b6428fcd60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:04.118826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=13 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:04.120223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=7 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:04.122710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63ea2212-6cbf-4321-a806-c3b6428fcd60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:04.123526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63ea2212-6cbf-4321-a806-c3b6428fcd60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:04.124525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63ea2212-6cbf-4321-a806-c3b6428fcd60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:04.125234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63ea2212-6cbf-4321-a806-c3b6428fcd60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:04.156457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-63ea2212-6cbf-4321-a806-c3b6428fcd60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lazy-loading 'flavor' on Instance uuid 7726d31d-d502-4fb4-b3f4-9f216964f472 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:46:04.494348 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-63ea2212-6cbf-4321-a806-c3b6428fcd60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "POST /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/action" status: 202 len: 0 microversion: 2.20 time: 0.389910 Jul 20 04:46:04.498396 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3113/6211] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:46:04 2022] POST /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:04.506716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8863be02-06d5-4868-aae1-ae3e9af9a560 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:04.509575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8863be02-06d5-4868-aae1-ae3e9af9a560 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:04.519320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8863be02-06d5-4868-aae1-ae3e9af9a560 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:04.520259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8863be02-06d5-4868-aae1-ae3e9af9a560 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:04.521968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8863be02-06d5-4868-aae1-ae3e9af9a560 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:04.523096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8863be02-06d5-4868-aae1-ae3e9af9a560 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:04.756078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8863be02-06d5-4868-aae1-ae3e9af9a560 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:04.765335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8863be02-06d5-4868-aae1-ae3e9af9a560 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:04.767082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8863be02-06d5-4868-aae1-ae3e9af9a560 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:04.769110 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8863be02-06d5-4868-aae1-ae3e9af9a560 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1722 microversion: 2.20 time: 0.269275 Jul 20 04:46:04.781068 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3099/6212] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:04 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:05.791091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a8eb067f-3c6b-4607-ad5a-909261d587ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:05.791951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a8eb067f-3c6b-4607-ad5a-909261d587ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:05.806168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8eb067f-3c6b-4607-ad5a-909261d587ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.806659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8eb067f-3c6b-4607-ad5a-909261d587ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.807508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8eb067f-3c6b-4607-ad5a-909261d587ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.807954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a8eb067f-3c6b-4607-ad5a-909261d587ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:06.008692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a8eb067f-3c6b-4607-ad5a-909261d587ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:06.034701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a8eb067f-3c6b-4607-ad5a-909261d587ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:06.036715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a8eb067f-3c6b-4607-ad5a-909261d587ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:06.039804 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a8eb067f-3c6b-4607-ad5a-909261d587ff tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1722 microversion: 2.20 time: 0.252723 Jul 20 04:46:06.040415 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3114/6213] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:05 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:07.073112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-46f2a73c-6b7a-4544-8d52-cc0925782404 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:07.076675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-46f2a73c-6b7a-4544-8d52-cc0925782404 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:07.095445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f2a73c-6b7a-4544-8d52-cc0925782404 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:07.096115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f2a73c-6b7a-4544-8d52-cc0925782404 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:07.096942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f2a73c-6b7a-4544-8d52-cc0925782404 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:07.097436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46f2a73c-6b7a-4544-8d52-cc0925782404 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:07.365641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-46f2a73c-6b7a-4544-8d52-cc0925782404 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:07.395628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-46f2a73c-6b7a-4544-8d52-cc0925782404 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:07.398385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-46f2a73c-6b7a-4544-8d52-cc0925782404 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:07.400824 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-46f2a73c-6b7a-4544-8d52-cc0925782404 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1722 microversion: 2.20 time: 0.335548 Jul 20 04:46:07.401967 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3100/6214] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:07 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:08.435673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-378633dd-2811-43e8-b1f4-d8954b9528d9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:08.443609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-378633dd-2811-43e8-b1f4-d8954b9528d9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:08.473414 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-378633dd-2811-43e8-b1f4-d8954b9528d9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.474242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-378633dd-2811-43e8-b1f4-d8954b9528d9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.475810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-378633dd-2811-43e8-b1f4-d8954b9528d9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.476999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-378633dd-2811-43e8-b1f4-d8954b9528d9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.682651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-378633dd-2811-43e8-b1f4-d8954b9528d9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:08.694463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-378633dd-2811-43e8-b1f4-d8954b9528d9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:08.696632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-378633dd-2811-43e8-b1f4-d8954b9528d9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:08.699661 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-378633dd-2811-43e8-b1f4-d8954b9528d9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1722 microversion: 2.20 time: 0.282308 Jul 20 04:46:08.706927 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3115/6215] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:08 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:09.721365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-995b00f0-2110-4071-9742-c9ca1130dcbc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:09.724436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-995b00f0-2110-4071-9742-c9ca1130dcbc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:09.743728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-995b00f0-2110-4071-9742-c9ca1130dcbc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:09.744636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-995b00f0-2110-4071-9742-c9ca1130dcbc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:09.745612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-995b00f0-2110-4071-9742-c9ca1130dcbc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:09.746533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-995b00f0-2110-4071-9742-c9ca1130dcbc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:09.926528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-995b00f0-2110-4071-9742-c9ca1130dcbc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:09.937761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-995b00f0-2110-4071-9742-c9ca1130dcbc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:09.939918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-995b00f0-2110-4071-9742-c9ca1130dcbc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:09.941695 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-995b00f0-2110-4071-9742-c9ca1130dcbc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1722 microversion: 2.20 time: 0.226023 Jul 20 04:46:09.943112 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3101/6216] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:09 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:10.965720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-46e504f8-aecf-4727-9c3c-e0e52268b4b5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:10.967003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-46e504f8-aecf-4727-9c3c-e0e52268b4b5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:10.982504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46e504f8-aecf-4727-9c3c-e0e52268b4b5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:10.983722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46e504f8-aecf-4727-9c3c-e0e52268b4b5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:10.984718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46e504f8-aecf-4727-9c3c-e0e52268b4b5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:10.985452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-46e504f8-aecf-4727-9c3c-e0e52268b4b5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:11.225925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-46e504f8-aecf-4727-9c3c-e0e52268b4b5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:11.235189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-46e504f8-aecf-4727-9c3c-e0e52268b4b5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:11.236898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-46e504f8-aecf-4727-9c3c-e0e52268b4b5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:11.239016 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-46e504f8-aecf-4727-9c3c-e0e52268b4b5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1722 microversion: 2.20 time: 0.279736 Jul 20 04:46:11.239016 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3116/6217] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:10 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:12.259612 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c70459dd-9d3d-4f8c-a738-1e648849e673 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:12.261647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c70459dd-9d3d-4f8c-a738-1e648849e673 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:12.280165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c70459dd-9d3d-4f8c-a738-1e648849e673 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:12.280731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c70459dd-9d3d-4f8c-a738-1e648849e673 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:12.287174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c70459dd-9d3d-4f8c-a738-1e648849e673 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:12.288794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c70459dd-9d3d-4f8c-a738-1e648849e673 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:12.544494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c70459dd-9d3d-4f8c-a738-1e648849e673 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:12.557264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c70459dd-9d3d-4f8c-a738-1e648849e673 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:12.560700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c70459dd-9d3d-4f8c-a738-1e648849e673 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:12.562433 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c70459dd-9d3d-4f8c-a738-1e648849e673 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1722 microversion: 2.20 time: 0.307916 Jul 20 04:46:12.564924 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3102/6218] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:12 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:13.594428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-81ae7b42-ebff-4d16-8686-da357f726ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:13.595744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-81ae7b42-ebff-4d16-8686-da357f726ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:13.622189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81ae7b42-ebff-4d16-8686-da357f726ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.627235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81ae7b42-ebff-4d16-8686-da357f726ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.634482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81ae7b42-ebff-4d16-8686-da357f726ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.635553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81ae7b42-ebff-4d16-8686-da357f726ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.872465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-81ae7b42-ebff-4d16-8686-da357f726ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:13.882528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-81ae7b42-ebff-4d16-8686-da357f726ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:13.884236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-81ae7b42-ebff-4d16-8686-da357f726ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:13.885877 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-81ae7b42-ebff-4d16-8686-da357f726ef1 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1722 microversion: 2.20 time: 0.304026 Jul 20 04:46:13.897064 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3117/6219] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:13 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:14.906644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-feb1fdb9-68ca-404b-8fbc-a723912b0eb8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:14.907450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-feb1fdb9-68ca-404b-8fbc-a723912b0eb8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:14.926349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-feb1fdb9-68ca-404b-8fbc-a723912b0eb8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.929510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-feb1fdb9-68ca-404b-8fbc-a723912b0eb8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.931556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-feb1fdb9-68ca-404b-8fbc-a723912b0eb8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.932095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-feb1fdb9-68ca-404b-8fbc-a723912b0eb8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:15.124454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-feb1fdb9-68ca-404b-8fbc-a723912b0eb8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:15.140025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-feb1fdb9-68ca-404b-8fbc-a723912b0eb8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:15.144516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-feb1fdb9-68ca-404b-8fbc-a723912b0eb8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:15.147074 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-feb1fdb9-68ca-404b-8fbc-a723912b0eb8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1743 microversion: 2.20 time: 0.245286 Jul 20 04:46:15.149402 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3103/6220] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:14 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:16.168380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0792f392-39ac-43ba-a2b1-25509a0676f6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:16.169010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0792f392-39ac-43ba-a2b1-25509a0676f6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:16.176944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0792f392-39ac-43ba-a2b1-25509a0676f6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:16.177613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0792f392-39ac-43ba-a2b1-25509a0676f6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:16.179002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0792f392-39ac-43ba-a2b1-25509a0676f6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:16.179840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0792f392-39ac-43ba-a2b1-25509a0676f6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:16.443364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0792f392-39ac-43ba-a2b1-25509a0676f6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:16.456503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0792f392-39ac-43ba-a2b1-25509a0676f6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:16.459500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0792f392-39ac-43ba-a2b1-25509a0676f6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:16.462742 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0792f392-39ac-43ba-a2b1-25509a0676f6 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1743 microversion: 2.20 time: 0.298451 Jul 20 04:46:16.464266 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3118/6221] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:16 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1743 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:17.483764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-df370cb5-bac4-4d47-8e1d-6dc16e3f43e5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:17.484380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-df370cb5-bac4-4d47-8e1d-6dc16e3f43e5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:17.496395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df370cb5-bac4-4d47-8e1d-6dc16e3f43e5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:17.496897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df370cb5-bac4-4d47-8e1d-6dc16e3f43e5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:17.503675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df370cb5-bac4-4d47-8e1d-6dc16e3f43e5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:17.510941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-df370cb5-bac4-4d47-8e1d-6dc16e3f43e5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:17.735539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df370cb5-bac4-4d47-8e1d-6dc16e3f43e5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:17.750718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df370cb5-bac4-4d47-8e1d-6dc16e3f43e5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:17.756376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-df370cb5-bac4-4d47-8e1d-6dc16e3f43e5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:17.758369 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-df370cb5-bac4-4d47-8e1d-6dc16e3f43e5 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1738 microversion: 2.20 time: 0.279660 Jul 20 04:46:17.761094 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3104/6222] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:17 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:18.784855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5dbc64b7-e65e-453e-b371-f204e0be6245 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:18.786353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5dbc64b7-e65e-453e-b371-f204e0be6245 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:18.798538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5dbc64b7-e65e-453e-b371-f204e0be6245 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.802096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5dbc64b7-e65e-453e-b371-f204e0be6245 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.804430 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5dbc64b7-e65e-453e-b371-f204e0be6245 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.804888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5dbc64b7-e65e-453e-b371-f204e0be6245 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.035632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5dbc64b7-e65e-453e-b371-f204e0be6245 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:19.045212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5dbc64b7-e65e-453e-b371-f204e0be6245 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:19.046988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5dbc64b7-e65e-453e-b371-f204e0be6245 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:19.048358 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5dbc64b7-e65e-453e-b371-f204e0be6245 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1738 microversion: 2.20 time: 0.271161 Jul 20 04:46:19.049384 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3119/6223] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:18 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:19.330953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-88290f66-995a-4da1-b158-acbcb6103daa req-e4c29de7-b150-4044-9a9f-9d76df3624ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7726d31d-d502-4fb4-b3f4-9f216964f472", "name": "network-vif-plugged", "status": "completed", "tag": "0e4b1655-ae06-4440-bff4-5a605861043d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:19.352705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-88290f66-995a-4da1-b158-acbcb6103daa req-e4c29de7-b150-4044-9a9f-9d76df3624ef service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.359141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-88290f66-995a-4da1-b158-acbcb6103daa req-e4c29de7-b150-4044-9a9f-9d76df3624ef service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.403181 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-88290f66-995a-4da1-b158-acbcb6103daa req-e4c29de7-b150-4044-9a9f-9d76df3624ef service nova] Creating event network-vif-plugged:0e4b1655-ae06-4440-bff4-5a605861043d for instance 7726d31d-d502-4fb4-b3f4-9f216964f472 on n-h1-760456-11 Jul 20 04:46:19.420938 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-88290f66-995a-4da1-b158-acbcb6103daa req-e4c29de7-b150-4044-9a9f-9d76df3624ef service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094434 Jul 20 04:46:19.422378 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3105/6224] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:20.067473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7269a7f2-5710-4f7b-b814-5162d901b884 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:20.068784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7269a7f2-5710-4f7b-b814-5162d901b884 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:20.077398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7269a7f2-5710-4f7b-b814-5162d901b884 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:20.078191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7269a7f2-5710-4f7b-b814-5162d901b884 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:20.079208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7269a7f2-5710-4f7b-b814-5162d901b884 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:20.079849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7269a7f2-5710-4f7b-b814-5162d901b884 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:20.358918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7269a7f2-5710-4f7b-b814-5162d901b884 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:20.371454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7269a7f2-5710-4f7b-b814-5162d901b884 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:20.376944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7269a7f2-5710-4f7b-b814-5162d901b884 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:20.378726 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7269a7f2-5710-4f7b-b814-5162d901b884 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1738 microversion: 2.20 time: 0.315378 Jul 20 04:46:20.380115 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3120/6225] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:20 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1738 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:21.400835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2825dfdc-0b30-4380-b8cb-ae42bea304e4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:21.401556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2825dfdc-0b30-4380-b8cb-ae42bea304e4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:21.414059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2825dfdc-0b30-4380-b8cb-ae42bea304e4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:21.415019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2825dfdc-0b30-4380-b8cb-ae42bea304e4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:21.416046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2825dfdc-0b30-4380-b8cb-ae42bea304e4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:21.416712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2825dfdc-0b30-4380-b8cb-ae42bea304e4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:21.593144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2825dfdc-0b30-4380-b8cb-ae42bea304e4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:21.603934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2825dfdc-0b30-4380-b8cb-ae42bea304e4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:21.605519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2825dfdc-0b30-4380-b8cb-ae42bea304e4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:21.606780 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2825dfdc-0b30-4380-b8cb-ae42bea304e4 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1738 microversion: 2.20 time: 0.211727 Jul 20 04:46:21.608493 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3106/6226] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:21 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:22.625845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d8e9095a-2322-42a2-a7d2-1562c7d3be14 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:22.626509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d8e9095a-2322-42a2-a7d2-1562c7d3be14 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:22.638574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8e9095a-2322-42a2-a7d2-1562c7d3be14 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:22.639035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8e9095a-2322-42a2-a7d2-1562c7d3be14 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:22.639839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8e9095a-2322-42a2-a7d2-1562c7d3be14 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:22.640285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d8e9095a-2322-42a2-a7d2-1562c7d3be14 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:22.976359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8e9095a-2322-42a2-a7d2-1562c7d3be14 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:22.999103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8e9095a-2322-42a2-a7d2-1562c7d3be14 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:23.004040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d8e9095a-2322-42a2-a7d2-1562c7d3be14 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:23.009903 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d8e9095a-2322-42a2-a7d2-1562c7d3be14 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1738 microversion: 2.20 time: 0.384116 Jul 20 04:46:23.012334 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3121/6227] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:22 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1738 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:24.032865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dc25a875-c4b4-4518-a638-e548b7393bfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:24.036250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dc25a875-c4b4-4518-a638-e548b7393bfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:24.052466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc25a875-c4b4-4518-a638-e548b7393bfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.054142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc25a875-c4b4-4518-a638-e548b7393bfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.056139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc25a875-c4b4-4518-a638-e548b7393bfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.057275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc25a875-c4b4-4518-a638-e548b7393bfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.398160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dc25a875-c4b4-4518-a638-e548b7393bfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:24.407288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dc25a875-c4b4-4518-a638-e548b7393bfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:24.409964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dc25a875-c4b4-4518-a638-e548b7393bfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:24.411795 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dc25a875-c4b4-4518-a638-e548b7393bfb tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1738 microversion: 2.20 time: 0.383520 Jul 20 04:46:24.412606 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3107/6228] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:24 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1738 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:25.433103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a18f9efb-c382-45e7-93b5-fadf562d833c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:25.434357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a18f9efb-c382-45e7-93b5-fadf562d833c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:25.450885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a18f9efb-c382-45e7-93b5-fadf562d833c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.451569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a18f9efb-c382-45e7-93b5-fadf562d833c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.453359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a18f9efb-c382-45e7-93b5-fadf562d833c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.461070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a18f9efb-c382-45e7-93b5-fadf562d833c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.713501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a18f9efb-c382-45e7-93b5-fadf562d833c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:25.743286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a18f9efb-c382-45e7-93b5-fadf562d833c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:25.748392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a18f9efb-c382-45e7-93b5-fadf562d833c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:25.750391 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a18f9efb-c382-45e7-93b5-fadf562d833c tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1738 microversion: 2.20 time: 0.322884 Jul 20 04:46:25.751820 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3122/6229] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:25 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:26.772247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fd05b43a-878d-4947-983a-28b4ef21a6c8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:26.772860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fd05b43a-878d-4947-983a-28b4ef21a6c8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:26.786896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd05b43a-878d-4947-983a-28b4ef21a6c8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:26.787419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd05b43a-878d-4947-983a-28b4ef21a6c8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:26.788287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd05b43a-878d-4947-983a-28b4ef21a6c8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:26.788774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd05b43a-878d-4947-983a-28b4ef21a6c8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:27.013003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fd05b43a-878d-4947-983a-28b4ef21a6c8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:27.036364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fd05b43a-878d-4947-983a-28b4ef21a6c8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:27.039489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fd05b43a-878d-4947-983a-28b4ef21a6c8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:27.041765 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fd05b43a-878d-4947-983a-28b4ef21a6c8 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1738 microversion: 2.20 time: 0.273936 Jul 20 04:46:27.043996 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3108/6230] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:26 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:28.070801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-90c02832-a117-48ca-bf93-1d614f501573 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:28.073059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-90c02832-a117-48ca-bf93-1d614f501573 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:28.113310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90c02832-a117-48ca-bf93-1d614f501573 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.114119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90c02832-a117-48ca-bf93-1d614f501573 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.121341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90c02832-a117-48ca-bf93-1d614f501573 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.132500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90c02832-a117-48ca-bf93-1d614f501573 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.449654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90c02832-a117-48ca-bf93-1d614f501573 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:28.466699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90c02832-a117-48ca-bf93-1d614f501573 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:28.469062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90c02832-a117-48ca-bf93-1d614f501573 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:28.470679 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-90c02832-a117-48ca-bf93-1d614f501573 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1738 microversion: 2.20 time: 0.411130 Jul 20 04:46:28.471730 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3123/6231] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:28 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1738 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:29.493749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d75e594d-7c18-49a3-9374-5a39e5a1f590 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:29.494638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d75e594d-7c18-49a3-9374-5a39e5a1f590 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:29.510130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d75e594d-7c18-49a3-9374-5a39e5a1f590 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.511519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d75e594d-7c18-49a3-9374-5a39e5a1f590 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.512373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d75e594d-7c18-49a3-9374-5a39e5a1f590 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.517260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d75e594d-7c18-49a3-9374-5a39e5a1f590 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.703102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d75e594d-7c18-49a3-9374-5a39e5a1f590 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:29.714728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d75e594d-7c18-49a3-9374-5a39e5a1f590 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:29.716379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d75e594d-7c18-49a3-9374-5a39e5a1f590 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:29.718600 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d75e594d-7c18-49a3-9374-5a39e5a1f590 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1738 microversion: 2.20 time: 0.230418 Jul 20 04:46:29.719307 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3109/6232] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:29 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:30.739737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-67728fb0-9628-4bd8-8be3-546599885c9d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:30.742034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-67728fb0-9628-4bd8-8be3-546599885c9d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:30.752963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67728fb0-9628-4bd8-8be3-546599885c9d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.753623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67728fb0-9628-4bd8-8be3-546599885c9d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.754629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67728fb0-9628-4bd8-8be3-546599885c9d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.755317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67728fb0-9628-4bd8-8be3-546599885c9d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.994477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-67728fb0-9628-4bd8-8be3-546599885c9d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:31.004676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-67728fb0-9628-4bd8-8be3-546599885c9d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:31.007851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-67728fb0-9628-4bd8-8be3-546599885c9d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:31.009198 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-67728fb0-9628-4bd8-8be3-546599885c9d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1720 microversion: 2.20 time: 0.275070 Jul 20 04:46:31.021598 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3124/6233] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:30 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1720 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:32.029600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ffb6c74a-de71-4825-811a-100c0f7f0296 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:32.030285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ffb6c74a-de71-4825-811a-100c0f7f0296 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:32.038805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffb6c74a-de71-4825-811a-100c0f7f0296 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:32.039396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffb6c74a-de71-4825-811a-100c0f7f0296 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:32.040436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffb6c74a-de71-4825-811a-100c0f7f0296 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:32.041026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffb6c74a-de71-4825-811a-100c0f7f0296 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:32.188441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ffb6c74a-de71-4825-811a-100c0f7f0296 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:32.190833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=71 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:32.199047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ffb6c74a-de71-4825-811a-100c0f7f0296 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:32.200610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ffb6c74a-de71-4825-811a-100c0f7f0296 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:32.201997 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ffb6c74a-de71-4825-811a-100c0f7f0296 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1720 microversion: 2.20 time: 0.176721 Jul 20 04:46:32.202423 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3110/6234] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:32 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:33.220707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2635cd18-889a-45e3-a541-3c8d74f7b676 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:33.221328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2635cd18-889a-45e3-a541-3c8d74f7b676 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.236018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2635cd18-889a-45e3-a541-3c8d74f7b676 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.236490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2635cd18-889a-45e3-a541-3c8d74f7b676 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.237290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2635cd18-889a-45e3-a541-3c8d74f7b676 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.237923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2635cd18-889a-45e3-a541-3c8d74f7b676 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.362320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-fcf680e5-dd49-49f3-a5d8-d5cc4d7b2aee req-7674902b-635f-4839-9ea7-28639944522d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7726d31d-d502-4fb4-b3f4-9f216964f472", "name": "network-vif-unplugged", "status": "completed", "tag": "0e4b1655-ae06-4440-bff4-5a605861043d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:33.367513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=27 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:33.379755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fcf680e5-dd49-49f3-a5d8-d5cc4d7b2aee req-7674902b-635f-4839-9ea7-28639944522d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.380443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fcf680e5-dd49-49f3-a5d8-d5cc4d7b2aee req-7674902b-635f-4839-9ea7-28639944522d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.410349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.compute.server_external_events [req-fcf680e5-dd49-49f3-a5d8-d5cc4d7b2aee req-7674902b-635f-4839-9ea7-28639944522d service nova] Unable to find a host for instance 7726d31d-d502-4fb4-b3f4-9f216964f472. Dropping event network-vif-unplugged {{(pid=119605) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:46:33.411323 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-fcf680e5-dd49-49f3-a5d8-d5cc4d7b2aee req-7674902b-635f-4839-9ea7-28639944522d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053549 Jul 20 04:46:33.420550 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3111/6235] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:46:33.457566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2635cd18-889a-45e3-a541-3c8d74f7b676 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:33.466223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2635cd18-889a-45e3-a541-3c8d74f7b676 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:33.467882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2635cd18-889a-45e3-a541-3c8d74f7b676 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:33.469091 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2635cd18-889a-45e3-a541-3c8d74f7b676 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1663 microversion: 2.20 time: 0.252441 Jul 20 04:46:33.474051 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3125/6236] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:33 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1663 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:33.487376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b31ee4d5-173e-4b79-a933-47d2e088b529 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "daa1764a-d11b-4bd6-998c-e7b382892b02"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:33.488461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b31ee4d5-173e-4b79-a933-47d2e088b529 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.495479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b31ee4d5-173e-4b79-a933-47d2e088b529 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.496290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b31ee4d5-173e-4b79-a933-47d2e088b529 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.497159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b31ee4d5-173e-4b79-a933-47d2e088b529 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.497615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b31ee4d5-173e-4b79-a933-47d2e088b529 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.838173 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b31ee4d5-173e-4b79-a933-47d2e088b529 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "POST /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.354701 Jul 20 04:46:33.840127 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3112/6237] 10.222.0.59 () {62 vars in 1363 bytes} [Wed Jul 20 04:46:33 2022] POST /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/os-volume_attachments => generated 188 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:46:33.965902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86e3c0f7-f217-43fc-a1ac-9be11fe91821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:33.966479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-86e3c0f7-f217-43fc-a1ac-9be11fe91821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.973875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86e3c0f7-f217-43fc-a1ac-9be11fe91821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.974889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86e3c0f7-f217-43fc-a1ac-9be11fe91821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.976536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86e3c0f7-f217-43fc-a1ac-9be11fe91821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.977115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86e3c0f7-f217-43fc-a1ac-9be11fe91821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.118604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:34.330000 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-86e3c0f7-f217-43fc-a1ac-9be11fe91821 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/os-volume_attachments/daa1764a-d11b-4bd6-998c-e7b382892b02" status: 202 len: 0 microversion: 2.20 time: 0.367874 Jul 20 04:46:34.331394 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3126/6238] 10.222.0.59 () {60 vars in 1456 bytes} [Wed Jul 20 04:46:33 2022] DELETE /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/os-volume_attachments/daa1764a-d11b-4bd6-998c-e7b382892b02 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:34.396603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f52570f-b6a9-4eb6-91bd-9e533f0a3b41 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:34.397979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f52570f-b6a9-4eb6-91bd-9e533f0a3b41 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:34.408856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f52570f-b6a9-4eb6-91bd-9e533f0a3b41 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.412403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f52570f-b6a9-4eb6-91bd-9e533f0a3b41 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.413420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f52570f-b6a9-4eb6-91bd-9e533f0a3b41 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.414656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f52570f-b6a9-4eb6-91bd-9e533f0a3b41 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.501792 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f52570f-b6a9-4eb6-91bd-9e533f0a3b41 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "POST /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/action" status: 202 len: 0 microversion: 2.20 time: 0.111834 Jul 20 04:46:34.503089 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3113/6239] 10.222.0.59 () {62 vars in 1318 bytes} [Wed Jul 20 04:46:34 2022] POST /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:34.512801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc6bec21-d41d-476e-bbb8-77478ebe3e18 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:34.513928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc6bec21-d41d-476e-bbb8-77478ebe3e18 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:34.516375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=29 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:34.524956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc6bec21-d41d-476e-bbb8-77478ebe3e18 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.525818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc6bec21-d41d-476e-bbb8-77478ebe3e18 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.527251 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc6bec21-d41d-476e-bbb8-77478ebe3e18 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.527810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc6bec21-d41d-476e-bbb8-77478ebe3e18 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.707837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc6bec21-d41d-476e-bbb8-77478ebe3e18 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:34.718724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc6bec21-d41d-476e-bbb8-77478ebe3e18 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:34.720601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc6bec21-d41d-476e-bbb8-77478ebe3e18 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:34.722063 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc6bec21-d41d-476e-bbb8-77478ebe3e18 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1671 microversion: 2.20 time: 0.213970 Jul 20 04:46:34.731103 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3127/6240] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:34 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1671 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:35.743261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c05a488f-7360-4633-ac98-e63dc3f7359f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:35.744683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c05a488f-7360-4633-ac98-e63dc3f7359f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:35.751583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c05a488f-7360-4633-ac98-e63dc3f7359f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:35.752145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c05a488f-7360-4633-ac98-e63dc3f7359f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:35.753027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c05a488f-7360-4633-ac98-e63dc3f7359f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:35.753563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c05a488f-7360-4633-ac98-e63dc3f7359f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:35.915786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c05a488f-7360-4633-ac98-e63dc3f7359f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:35.925556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c05a488f-7360-4633-ac98-e63dc3f7359f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:35.927273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c05a488f-7360-4633-ac98-e63dc3f7359f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:35.929460 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c05a488f-7360-4633-ac98-e63dc3f7359f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.192290 Jul 20 04:46:35.930721 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3114/6241] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:35 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:36.950160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-400d51a3-4a9f-485e-ad9e-9b0cd7af1ed9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:36.951598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-400d51a3-4a9f-485e-ad9e-9b0cd7af1ed9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:36.966368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-400d51a3-4a9f-485e-ad9e-9b0cd7af1ed9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.967478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-400d51a3-4a9f-485e-ad9e-9b0cd7af1ed9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:36.968461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-400d51a3-4a9f-485e-ad9e-9b0cd7af1ed9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.969489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-400d51a3-4a9f-485e-ad9e-9b0cd7af1ed9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.159254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-400d51a3-4a9f-485e-ad9e-9b0cd7af1ed9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:37.169935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-400d51a3-4a9f-485e-ad9e-9b0cd7af1ed9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:37.174535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-400d51a3-4a9f-485e-ad9e-9b0cd7af1ed9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:37.176906 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-400d51a3-4a9f-485e-ad9e-9b0cd7af1ed9 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.232104 Jul 20 04:46:37.187929 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3128/6242] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:36 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:38.197595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-158199ae-6cc2-4a43-ab33-35c5eabdb836 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:38.199045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-158199ae-6cc2-4a43-ab33-35c5eabdb836 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:38.217001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-158199ae-6cc2-4a43-ab33-35c5eabdb836 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.236322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-158199ae-6cc2-4a43-ab33-35c5eabdb836 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.243262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-158199ae-6cc2-4a43-ab33-35c5eabdb836 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.244921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-158199ae-6cc2-4a43-ab33-35c5eabdb836 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.563334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-158199ae-6cc2-4a43-ab33-35c5eabdb836 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:38.576208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-158199ae-6cc2-4a43-ab33-35c5eabdb836 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:38.578403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-158199ae-6cc2-4a43-ab33-35c5eabdb836 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:38.580056 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-158199ae-6cc2-4a43-ab33-35c5eabdb836 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.387066 Jul 20 04:46:38.581147 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3115/6243] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:38 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:39.600047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc858075-2085-4070-a969-b38e307d062f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:39.601755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc858075-2085-4070-a969-b38e307d062f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:39.615791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc858075-2085-4070-a969-b38e307d062f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:39.616909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc858075-2085-4070-a969-b38e307d062f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:39.618546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc858075-2085-4070-a969-b38e307d062f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:39.619249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc858075-2085-4070-a969-b38e307d062f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:39.829091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc858075-2085-4070-a969-b38e307d062f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:39.840388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc858075-2085-4070-a969-b38e307d062f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:39.842175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc858075-2085-4070-a969-b38e307d062f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:39.843677 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc858075-2085-4070-a969-b38e307d062f tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.248072 Jul 20 04:46:39.844586 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3129/6244] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:39 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:40.867125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7420dccf-947f-4a29-8bcc-a929ed4acf48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:40.867708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7420dccf-947f-4a29-8bcc-a929ed4acf48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:40.884735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7420dccf-947f-4a29-8bcc-a929ed4acf48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.885469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7420dccf-947f-4a29-8bcc-a929ed4acf48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.886351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7420dccf-947f-4a29-8bcc-a929ed4acf48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.886808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7420dccf-947f-4a29-8bcc-a929ed4acf48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.266279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7420dccf-947f-4a29-8bcc-a929ed4acf48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:41.280413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7420dccf-947f-4a29-8bcc-a929ed4acf48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:41.284637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7420dccf-947f-4a29-8bcc-a929ed4acf48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:41.287936 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7420dccf-947f-4a29-8bcc-a929ed4acf48 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.427833 Jul 20 04:46:41.301514 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3116/6245] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:40 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:46:42.316401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7bf9415c-fdbb-48e4-8e3d-5e3540715945 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:42.317651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7bf9415c-fdbb-48e4-8e3d-5e3540715945 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:42.330698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bf9415c-fdbb-48e4-8e3d-5e3540715945 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.332784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bf9415c-fdbb-48e4-8e3d-5e3540715945 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.337983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bf9415c-fdbb-48e4-8e3d-5e3540715945 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.341489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7bf9415c-fdbb-48e4-8e3d-5e3540715945 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.617516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7bf9415c-fdbb-48e4-8e3d-5e3540715945 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:42.628062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7bf9415c-fdbb-48e4-8e3d-5e3540715945 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:42.636213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7bf9415c-fdbb-48e4-8e3d-5e3540715945 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:42.637764 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7bf9415c-fdbb-48e4-8e3d-5e3540715945 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.326352 Jul 20 04:46:42.654978 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3130/6246] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:42 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:43.663296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a4abd8b3-a5ab-42cc-b9be-a0cfa2202557 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:43.663911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a4abd8b3-a5ab-42cc-b9be-a0cfa2202557 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:43.671666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4abd8b3-a5ab-42cc-b9be-a0cfa2202557 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.672139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4abd8b3-a5ab-42cc-b9be-a0cfa2202557 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.673193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4abd8b3-a5ab-42cc-b9be-a0cfa2202557 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.673602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4abd8b3-a5ab-42cc-b9be-a0cfa2202557 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.917905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a4abd8b3-a5ab-42cc-b9be-a0cfa2202557 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.926553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a4abd8b3-a5ab-42cc-b9be-a0cfa2202557 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.935535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a4abd8b3-a5ab-42cc-b9be-a0cfa2202557 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.938434 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a4abd8b3-a5ab-42cc-b9be-a0cfa2202557 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.279691 Jul 20 04:46:43.949186 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3117/6247] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:43 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:44.957594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2627af1f-a362-4b5a-a337-5173ab7c9d79 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.959559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2627af1f-a362-4b5a-a337-5173ab7c9d79 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.967485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2627af1f-a362-4b5a-a337-5173ab7c9d79 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.968264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2627af1f-a362-4b5a-a337-5173ab7c9d79 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.969247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2627af1f-a362-4b5a-a337-5173ab7c9d79 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.969852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2627af1f-a362-4b5a-a337-5173ab7c9d79 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.121401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2627af1f-a362-4b5a-a337-5173ab7c9d79 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:45.130298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2627af1f-a362-4b5a-a337-5173ab7c9d79 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:45.132759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2627af1f-a362-4b5a-a337-5173ab7c9d79 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:45.134167 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2627af1f-a362-4b5a-a337-5173ab7c9d79 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.181052 Jul 20 04:46:45.134937 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3131/6248] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:44 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:46.154969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4b6c58b5-3df7-4837-9cd1-43c0e5071c16 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:46.155609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4b6c58b5-3df7-4837-9cd1-43c0e5071c16 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:46.166297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b6c58b5-3df7-4837-9cd1-43c0e5071c16 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.167063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b6c58b5-3df7-4837-9cd1-43c0e5071c16 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.168068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b6c58b5-3df7-4837-9cd1-43c0e5071c16 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.168607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b6c58b5-3df7-4837-9cd1-43c0e5071c16 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.324056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4b6c58b5-3df7-4837-9cd1-43c0e5071c16 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:46.334094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4b6c58b5-3df7-4837-9cd1-43c0e5071c16 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:46.336028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4b6c58b5-3df7-4837-9cd1-43c0e5071c16 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:46.337301 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4b6c58b5-3df7-4837-9cd1-43c0e5071c16 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.186413 Jul 20 04:46:46.338376 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3118/6249] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:46 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:47.357100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6195da0-a2e1-464e-969e-4c4cf1618466 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:47.357847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6195da0-a2e1-464e-969e-4c4cf1618466 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:47.366323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6195da0-a2e1-464e-969e-4c4cf1618466 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:47.367107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6195da0-a2e1-464e-969e-4c4cf1618466 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:47.367903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6195da0-a2e1-464e-969e-4c4cf1618466 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:47.368555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6195da0-a2e1-464e-969e-4c4cf1618466 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:47.532503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6195da0-a2e1-464e-969e-4c4cf1618466 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:47.543018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6195da0-a2e1-464e-969e-4c4cf1618466 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:47.545056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6195da0-a2e1-464e-969e-4c4cf1618466 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:47.546647 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6195da0-a2e1-464e-969e-4c4cf1618466 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.193951 Jul 20 04:46:47.547514 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3132/6250] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:47 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:48.567541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-55014ac0-0ec9-413d-90ac-d89df352bfdf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:48.570649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-55014ac0-0ec9-413d-90ac-d89df352bfdf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:48.577709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55014ac0-0ec9-413d-90ac-d89df352bfdf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.578455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55014ac0-0ec9-413d-90ac-d89df352bfdf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.580772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55014ac0-0ec9-413d-90ac-d89df352bfdf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.581518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55014ac0-0ec9-413d-90ac-d89df352bfdf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.722317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-55014ac0-0ec9-413d-90ac-d89df352bfdf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:48.730761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-55014ac0-0ec9-413d-90ac-d89df352bfdf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:48.732320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-55014ac0-0ec9-413d-90ac-d89df352bfdf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:48.733742 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-55014ac0-0ec9-413d-90ac-d89df352bfdf tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.170308 Jul 20 04:46:48.734331 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3119/6251] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:48 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:46:49.755350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc1ee79b-8756-4585-83fd-89cfdd24b077 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:49.757027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc1ee79b-8756-4585-83fd-89cfdd24b077 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:49.767375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc1ee79b-8756-4585-83fd-89cfdd24b077 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.768042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc1ee79b-8756-4585-83fd-89cfdd24b077 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.768946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc1ee79b-8756-4585-83fd-89cfdd24b077 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.769580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc1ee79b-8756-4585-83fd-89cfdd24b077 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.926209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc1ee79b-8756-4585-83fd-89cfdd24b077 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:49.942159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc1ee79b-8756-4585-83fd-89cfdd24b077 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:49.945196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc1ee79b-8756-4585-83fd-89cfdd24b077 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:49.947617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc1ee79b-8756-4585-83fd-89cfdd24b077 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.197706 Jul 20 04:46:49.948567 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3133/6252] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:49 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:50.967753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-91e11b2e-3996-42af-867d-4ca8bcac9406 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:50.968689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-91e11b2e-3996-42af-867d-4ca8bcac9406 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:50.977223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91e11b2e-3996-42af-867d-4ca8bcac9406 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.977813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91e11b2e-3996-42af-867d-4ca8bcac9406 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.978648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91e11b2e-3996-42af-867d-4ca8bcac9406 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.979285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91e11b2e-3996-42af-867d-4ca8bcac9406 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.164158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-91e11b2e-3996-42af-867d-4ca8bcac9406 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:51.176011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-91e11b2e-3996-42af-867d-4ca8bcac9406 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:51.178699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-91e11b2e-3996-42af-867d-4ca8bcac9406 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:51.180316 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-91e11b2e-3996-42af-867d-4ca8bcac9406 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.217435 Jul 20 04:46:51.180976 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3120/6253] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:50 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:51.441948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-235bd4a9-9b0a-4b57-87e1-f24f575d5017 req-66deaa64-ab82-4ca8-9097-dd2e04ed88e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7726d31d-d502-4fb4-b3f4-9f216964f472", "name": "network-vif-plugged", "status": "completed", "tag": "0e4b1655-ae06-4440-bff4-5a605861043d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:51.457772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-235bd4a9-9b0a-4b57-87e1-f24f575d5017 req-66deaa64-ab82-4ca8-9097-dd2e04ed88e5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.458596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-235bd4a9-9b0a-4b57-87e1-f24f575d5017 req-66deaa64-ab82-4ca8-9097-dd2e04ed88e5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.478818 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-235bd4a9-9b0a-4b57-87e1-f24f575d5017 req-66deaa64-ab82-4ca8-9097-dd2e04ed88e5 service nova] Creating event network-vif-plugged:0e4b1655-ae06-4440-bff4-5a605861043d for instance 7726d31d-d502-4fb4-b3f4-9f216964f472 on n-h1-760456-11 Jul 20 04:46:51.487294 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-235bd4a9-9b0a-4b57-87e1-f24f575d5017 req-66deaa64-ab82-4ca8-9097-dd2e04ed88e5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048600 Jul 20 04:46:51.488692 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3134/6254] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:52.205571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8368231d-ec04-4c3c-9b99-2270a5abd44d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:52.208647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8368231d-ec04-4c3c-9b99-2270a5abd44d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:52.231251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8368231d-ec04-4c3c-9b99-2270a5abd44d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:52.233008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8368231d-ec04-4c3c-9b99-2270a5abd44d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:52.234047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8368231d-ec04-4c3c-9b99-2270a5abd44d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:52.234542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8368231d-ec04-4c3c-9b99-2270a5abd44d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:52.431569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8368231d-ec04-4c3c-9b99-2270a5abd44d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:52.440533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8368231d-ec04-4c3c-9b99-2270a5abd44d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:52.442423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8368231d-ec04-4c3c-9b99-2270a5abd44d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:52.444517 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8368231d-ec04-4c3c-9b99-2270a5abd44d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.249368 Jul 20 04:46:52.445492 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3121/6255] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:52 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:53.464380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ec835c44-210b-4602-9739-f0a994a2d852 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:53.465764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ec835c44-210b-4602-9739-f0a994a2d852 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:53.475056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec835c44-210b-4602-9739-f0a994a2d852 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.476080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec835c44-210b-4602-9739-f0a994a2d852 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.477211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec835c44-210b-4602-9739-f0a994a2d852 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.477990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ec835c44-210b-4602-9739-f0a994a2d852 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.653286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ec835c44-210b-4602-9739-f0a994a2d852 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:53.664143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ec835c44-210b-4602-9739-f0a994a2d852 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:53.666086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ec835c44-210b-4602-9739-f0a994a2d852 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:53.667732 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ec835c44-210b-4602-9739-f0a994a2d852 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1729 microversion: 2.20 time: 0.208395 Jul 20 04:46:53.668870 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3135/6256] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:53 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:46:54.687188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5f850a9d-f140-47bb-bfa6-a53b16d333d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:54.688498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5f850a9d-f140-47bb-bfa6-a53b16d333d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:54.696129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f850a9d-f140-47bb-bfa6-a53b16d333d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.696598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f850a9d-f140-47bb-bfa6-a53b16d333d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.697387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f850a9d-f140-47bb-bfa6-a53b16d333d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.697837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5f850a9d-f140-47bb-bfa6-a53b16d333d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.841540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5f850a9d-f140-47bb-bfa6-a53b16d333d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:54.851924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5f850a9d-f140-47bb-bfa6-a53b16d333d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:54.853465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5f850a9d-f140-47bb-bfa6-a53b16d333d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:54.854696 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5f850a9d-f140-47bb-bfa6-a53b16d333d3 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1716 microversion: 2.20 time: 0.171473 Jul 20 04:46:54.855271 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3122/6257] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:46:54 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1716 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:47:25.588770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ff836c56-a33e-4210-b3fb-a2178f68d924 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:25.590282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ff836c56-a33e-4210-b3fb-a2178f68d924 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:25.594673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=17 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:25.595658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:25.602608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff836c56-a33e-4210-b3fb-a2178f68d924 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.603446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff836c56-a33e-4210-b3fb-a2178f68d924 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.604407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff836c56-a33e-4210-b3fb-a2178f68d924 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.605013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ff836c56-a33e-4210-b3fb-a2178f68d924 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.647378 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ff836c56-a33e-4210-b3fb-a2178f68d924 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064255 Jul 20 04:47:25.649344 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3136/6258] 10.222.0.59 () {60 vars in 1342 bytes} [Wed Jul 20 04:47:25 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:25.730295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-713ee578-c642-46e4-bfa7-d4d13be9fcfc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:25.731648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-713ee578-c642-46e4-bfa7-d4d13be9fcfc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:25.739598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=25 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:25.740605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:25.743157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-713ee578-c642-46e4-bfa7-d4d13be9fcfc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.743888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-713ee578-c642-46e4-bfa7-d4d13be9fcfc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.744905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-713ee578-c642-46e4-bfa7-d4d13be9fcfc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.746154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-713ee578-c642-46e4-bfa7-d4d13be9fcfc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.779036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-713ee578-c642-46e4-bfa7-d4d13be9fcfc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:47:25.910705 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-713ee578-c642-46e4-bfa7-d4d13be9fcfc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 204 len: 0 microversion: 2.20 time: 0.183684 Jul 20 04:47:25.914860 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3123/6259] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:47:25 2022] DELETE /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:47:25.919885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c6bd3a80-53b5-445f-a368-3a2357cc4041 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:25.920519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c6bd3a80-53b5-445f-a368-3a2357cc4041 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:25.931315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6bd3a80-53b5-445f-a368-3a2357cc4041 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.932066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6bd3a80-53b5-445f-a368-3a2357cc4041 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.933222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6bd3a80-53b5-445f-a368-3a2357cc4041 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.933824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6bd3a80-53b5-445f-a368-3a2357cc4041 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.355612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6bd3a80-53b5-445f-a368-3a2357cc4041 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:26.365331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6bd3a80-53b5-445f-a368-3a2357cc4041 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:26.367118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6bd3a80-53b5-445f-a368-3a2357cc4041 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:26.368477 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c6bd3a80-53b5-445f-a368-3a2357cc4041 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1722 microversion: 2.20 time: 0.452839 Jul 20 04:47:26.369056 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3137/6260] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:47:25 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1722 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:47:27.388696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-720dd94f-07cf-45fa-92ea-d2865429da60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:27.390128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-720dd94f-07cf-45fa-92ea-d2865429da60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:27.398192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-720dd94f-07cf-45fa-92ea-d2865429da60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:27.399005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-720dd94f-07cf-45fa-92ea-d2865429da60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:27.400025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-720dd94f-07cf-45fa-92ea-d2865429da60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:27.400686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-720dd94f-07cf-45fa-92ea-d2865429da60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:27.665192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-720dd94f-07cf-45fa-92ea-d2865429da60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:27.682688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-720dd94f-07cf-45fa-92ea-d2865429da60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:27.684469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-720dd94f-07cf-45fa-92ea-d2865429da60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:27.685876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-720dd94f-07cf-45fa-92ea-d2865429da60 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1722 microversion: 2.20 time: 0.301519 Jul 20 04:47:27.687788 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3124/6261] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:47:27 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:47:28.265248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c9fe53ba-e982-4d34-9ac6-3c3d2e293d39 req-e97d7a32-558f-45b9-9944-643ef04c45f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7726d31d-d502-4fb4-b3f4-9f216964f472", "name": "network-vif-deleted", "tag": "0e4b1655-ae06-4440-bff4-5a605861043d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:28.300423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c9fe53ba-e982-4d34-9ac6-3c3d2e293d39 req-e97d7a32-558f-45b9-9944-643ef04c45f2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.304001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c9fe53ba-e982-4d34-9ac6-3c3d2e293d39 req-e97d7a32-558f-45b9-9944-643ef04c45f2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.354738 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c9fe53ba-e982-4d34-9ac6-3c3d2e293d39 req-e97d7a32-558f-45b9-9944-643ef04c45f2 service nova] Creating event network-vif-deleted:0e4b1655-ae06-4440-bff4-5a605861043d for instance 7726d31d-d502-4fb4-b3f4-9f216964f472 on n-h1-760456-11 Jul 20 04:47:28.360355 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c9fe53ba-e982-4d34-9ac6-3c3d2e293d39 req-e97d7a32-558f-45b9-9944-643ef04c45f2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102662 Jul 20 04:47:28.363007 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3138/6262] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:28.710135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:28.711503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:28.720267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.721047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.722134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.723628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.786000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.786620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.787259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lazy-loading 'fault' on Instance uuid 7726d31d-d502-4fb4-b3f4-9f216964f472 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:28.882075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:28.902331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:28.907771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d81b221d0764da793a85facc04b48f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e78752a239344cba02a2e6ed3e088f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:28.911264 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-56288bba-c899-4031-b5d2-e4a3c76867be tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 200 len: 1371 microversion: 2.20 time: 0.207664 Jul 20 04:47:28.913606 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3125/6263] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:47:28 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:47:29.935590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c483929a-c09a-4412-a785-efc6487ec450 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:29.936371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c483929a-c09a-4412-a785-efc6487ec450 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:29.944108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c483929a-c09a-4412-a785-efc6487ec450 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.944570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c483929a-c09a-4412-a785-efc6487ec450 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.945350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c483929a-c09a-4412-a785-efc6487ec450 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.945791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c483929a-c09a-4412-a785-efc6487ec450 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.960709 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-c483929a-c09a-4412-a785-efc6487ec450 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] HTTP exception thrown: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c483929a-c09a-4412-a785-efc6487ec450 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Request method failure captured: Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 HTTP/1.1 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14eliJ5bPMTh7FMHMamK9Icp_E_ZQeJLxzP1_rfc0JYhqFUmHbojAFhI5Ht94nxbGGSvzyPlq4Q9tU_aVQXsuo8L91g_qHZCTqzfVbgTxJWn8pw-sQiyZjYKUO8ozRPyYm4Pm-5YcxU3OqMNHfv2U0ENmaMFBjRdpEDe5ohibpVzWQE Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 3d81b221d0764da793a85facc04b48f0 Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '7726d31d-d502-4fb4-b3f4-9f216964f472'} Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:29.962429 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c483929a-c09a-4412-a785-efc6487ec450 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Returning 404 to user: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c483929a-c09a-4412-a785-efc6487ec450 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 404 len: 111 microversion: 2.20 time: 0.036336 Jul 20 04:47:29.966994 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3139/6264] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:47:29 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:47:29.973656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a2c519f9-69ea-4472-a751-db93157fe304 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '.version_select at 0x7fb84132e310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:29.993381 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a2c519f9-69ea-4472-a751-db93157fe304 tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639539680" status: 204 len: 0 microversion: 2.20 time: 0.024204 Jul 20 04:47:29.993905 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3126/6265] 10.222.0.59 () {60 vars in 1261 bytes} [Wed Jul 20 04:47:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639539680 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:47:32.889421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-57bc5d60-f672-4175-9771-d45f74141a6d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:32.890928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-57bc5d60-f672-4175-9771-d45f74141a6d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:32.904720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-57bc5d60-f672-4175-9771-d45f74141a6d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.918510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-57bc5d60-f672-4175-9771-d45f74141a6d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.919522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-57bc5d60-f672-4175-9771-d45f74141a6d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.919992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-57bc5d60-f672-4175-9771-d45f74141a6d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.946027 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-57bc5d60-f672-4175-9771-d45f74141a6d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] HTTP exception thrown: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-57bc5d60-f672-4175-9771-d45f74141a6d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Request method failure captured: Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 HTTP/1.1 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14eliJ5bPMTh7FMHMamK9Icp_E_ZQeJLxzP1_rfc0JYhqFUmHbojAFhI5Ht94nxbGGSvzyPlq4Q9tU_aVQXsuo8L91g_qHZCTqzfVbgTxJWn8pw-sQiyZjYKUO8ozRPyYm4Pm-5YcxU3OqMNHfv2U0ENmaMFBjRdpEDe5ohibpVzWQE Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 3d81b221d0764da793a85facc04b48f0 Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '7726d31d-d502-4fb4-b3f4-9f216964f472'} Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:32.948211 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:32.952921 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:32.955190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-57bc5d60-f672-4175-9771-d45f74141a6d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Returning 404 to user: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:32.956173 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-57bc5d60-f672-4175-9771-d45f74141a6d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 404 len: 111 microversion: 2.20 time: 0.072245 Jul 20 04:47:32.957406 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3140/6266] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:47:32 2022] DELETE /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:47:32.966818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-418d0256-b888-4598-8dff-b51486dea39d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:32.968037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-418d0256-b888-4598-8dff-b51486dea39d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: 7726d31d-d502-4fb4-b3f4-9f216964f472] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:32.976283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-418d0256-b888-4598-8dff-b51486dea39d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.977243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-418d0256-b888-4598-8dff-b51486dea39d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.978370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-418d0256-b888-4598-8dff-b51486dea39d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.979127 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-418d0256-b888-4598-8dff-b51486dea39d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.996442 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-418d0256-b888-4598-8dff-b51486dea39d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] HTTP exception thrown: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-418d0256-b888-4598-8dff-b51486dea39d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Request method failure captured: Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 HTTP/1.1 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14eliJ5bPMTh7FMHMamK9Icp_E_ZQeJLxzP1_rfc0JYhqFUmHbojAFhI5Ht94nxbGGSvzyPlq4Q9tU_aVQXsuo8L91g_qHZCTqzfVbgTxJWn8pw-sQiyZjYKUO8ozRPyYm4Pm-5YcxU3OqMNHfv2U0ENmaMFBjRdpEDe5ohibpVzWQE Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 3d81b221d0764da793a85facc04b48f0 Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7726d31d-d502-4fb4-b3f4-9f216964f472'} Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:32.998925 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:33.003681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:33.003681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:33.003681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:33.003681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:33.003681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:33.003681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:33.003681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. Jul 20 04:47:33.003681 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:33.005816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-418d0256-b888-4598-8dff-b51486dea39d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Returning 404 to user: Instance 7726d31d-d502-4fb4-b3f4-9f216964f472 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:33.007073 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-418d0256-b888-4598-8dff-b51486dea39d tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472" status: 404 len: 111 microversion: 2.20 time: 0.045803 Jul 20 04:47:33.008039 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3127/6267] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:47:32 2022] GET /compute/v2.1/servers/7726d31d-d502-4fb4-b3f4-9f216964f472 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:47:36.347365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5da7ea25-c07c-4855-9d25-0d5bd98c6ebc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:36.348016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5da7ea25-c07c-4855-9d25-0d5bd98c6ebc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:36.364576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5da7ea25-c07c-4855-9d25-0d5bd98c6ebc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.365127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5da7ea25-c07c-4855-9d25-0d5bd98c6ebc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.365961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5da7ea25-c07c-4855-9d25-0d5bd98c6ebc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.366454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5da7ea25-c07c-4855-9d25-0d5bd98c6ebc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.401373 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-5da7ea25-c07c-4855-9d25-0d5bd98c6ebc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] HTTP exception thrown: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5da7ea25-c07c-4855-9d25-0d5bd98c6ebc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Request method failure captured: Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 HTTP/1.1 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14eliJ5bPMTh7FMHMamK9Icp_E_ZQeJLxzP1_rfc0JYhqFUmHbojAFhI5Ht94nxbGGSvzyPlq4Q9tU_aVQXsuo8L91g_qHZCTqzfVbgTxJWn8pw-sQiyZjYKUO8ozRPyYm4Pm-5YcxU3OqMNHfv2U0ENmaMFBjRdpEDe5ohibpVzWQE Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 3d81b221d0764da793a85facc04b48f0 Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'f3973340-115d-4612-a266-e4403274d648'} Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:36.403370 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:47:36.407724 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.409368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5da7ea25-c07c-4855-9d25-0d5bd98c6ebc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Returning 404 to user: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:36.411180 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5da7ea25-c07c-4855-9d25-0d5bd98c6ebc tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 404 len: 111 microversion: 2.20 time: 0.067816 Jul 20 04:47:36.415206 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3141/6268] 10.222.0.59 () {60 vars in 1279 bytes} [Wed Jul 20 04:47:36 2022] DELETE /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:47:36.420123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34ed2cf8-5076-4864-b68e-c2d153bc03dd tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:36.420763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-34ed2cf8-5076-4864-b68e-c2d153bc03dd tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] [instance: f3973340-115d-4612-a266-e4403274d648] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:36.432516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34ed2cf8-5076-4864-b68e-c2d153bc03dd tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.432991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34ed2cf8-5076-4864-b68e-c2d153bc03dd tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.433808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34ed2cf8-5076-4864-b68e-c2d153bc03dd tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.434285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34ed2cf8-5076-4864-b68e-c2d153bc03dd tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.460975 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-34ed2cf8-5076-4864-b68e-c2d153bc03dd tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] HTTP exception thrown: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34ed2cf8-5076-4864-b68e-c2d153bc03dd tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Request method failure captured: Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 HTTP/1.1 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14eliJ5bPMTh7FMHMamK9Icp_E_ZQeJLxzP1_rfc0JYhqFUmHbojAFhI5Ht94nxbGGSvzyPlq4Q9tU_aVQXsuo8L91g_qHZCTqzfVbgTxJWn8pw-sQiyZjYKUO8ozRPyYm4Pm-5YcxU3OqMNHfv2U0ENmaMFBjRdpEDe5ohibpVzWQE Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0e78752a239344cba02a2e6ed3e088f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 0e78752a239344cba02a2e6ed3e088f7 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1284994280 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 3d81b221d0764da793a85facc04b48f0 Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1284994280-project Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'f3973340-115d-4612-a266-e4403274d648'} Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.462849 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:36.467333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.467333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:36.467333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:36.467333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:36.467333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:36.467333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:36.467333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. Jul 20 04:47:36.467333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:36.468720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34ed2cf8-5076-4864-b68e-c2d153bc03dd tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] Returning 404 to user: Instance f3973340-115d-4612-a266-e4403274d648 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:36.469633 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-34ed2cf8-5076-4864-b68e-c2d153bc03dd tempest-AttachVolumeShelveTestJSON-1284994280 tempest-AttachVolumeShelveTestJSON-1284994280-project] 10.222.0.59 "GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648" status: 404 len: 111 microversion: 2.20 time: 0.053537 Jul 20 04:47:36.470211 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3128/6269] 10.222.0.59 () {60 vars in 1276 bytes} [Wed Jul 20 04:47:36 2022] GET /compute/v2.1/servers/f3973340-115d-4612-a266-e4403274d648 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:47:43.372594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-260178c2-a138-4f71-811c-270f908226dd tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Action: 'create', calling method: .version_select at 0x7fb841c8b5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1612168523"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:43.695690 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-260178c2-a138-4f71-811c-270f908226dd tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.522176 Jul 20 04:47:43.696438 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3142/6270] 10.222.0.59 () {60 vars in 1154 bytes} [Wed Jul 20 04:47:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 524 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 04:47:43.709262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3433110a-900c-4301-ba92-23380d95f197 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841e651f0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:43.766664 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3433110a-900c-4301-ba92-23380d95f197 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8" status: 200 len: 345 microversion: 2.1 time: 0.062343 Jul 20 04:47:43.770201 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3129/6271] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:47:43 2022] GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:44.805377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-75579a96-cd18-4f6b-865a-3a5647a65b6b tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841ed4c10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:44.882523 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-75579a96-cd18-4f6b-865a-3a5647a65b6b tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8" status: 200 len: 346 microversion: 2.1 time: 0.095799 Jul 20 04:47:44.882523 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3143/6272] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:47:44 2022] GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 => generated 346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:44.888242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-53376c64-4592-4b6a-ad89-7f039f324f58 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Action: 'create', calling method: .version_select at 0x7fb841f17280>, body: {"snapshot": {"volume_id": "c65aa5b6-d38c-4014-967c-97aadeb820a8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1245179884"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:45.080496 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-53376c64-4592-4b6a-ad89-7f039f324f58 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.196312 Jul 20 04:47:45.081103 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3130/6273] 10.222.0.59 () {60 vars in 1161 bytes} [Wed Jul 20 04:47:44 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:45.093621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b2f579c3-86a5-445d-8ad1-1026c3a4f770 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841d01a60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:45.150005 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b2f579c3-86a5-445d-8ad1-1026c3a4f770 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed" status: 200 len: 287 microversion: 2.1 time: 0.061842 Jul 20 04:47:45.150655 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3144/6274] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 04:47:45 2022] GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:45.162705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fcce48bf-51aa-4632-9b81-567096ff5b45 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841e65040>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:45.205849 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fcce48bf-51aa-4632-9b81-567096ff5b45 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.048741 Jul 20 04:47:45.207329 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3131/6275] 10.222.0.59 () {58 vars in 1139 bytes} [Wed Jul 20 04:47:45 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:45.219331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6554d5ac-7a45-4e4b-b6a1-3d5d175e759f tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb8422d43a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:45.255398 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6554d5ac-7a45-4e4b-b6a1-3d5d175e759f tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed" status: 200 len: 287 microversion: 2.1 time: 0.041452 Jul 20 04:47:45.256160 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3145/6276] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 04:47:45 2022] GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:46.268559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0b75fdd6-1ee8-42b9-8293-6525976ce38b tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841e47d30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:46.328919 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0b75fdd6-1ee8-42b9-8293-6525976ce38b tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed" status: 200 len: 287 microversion: 2.1 time: 0.062635 Jul 20 04:47:46.330974 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3132/6277] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 04:47:46 2022] GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:47.340917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:47.342145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=20 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:47.346178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6191ad4f-ef09-4c02-be7b-fc52cb27be7e tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb8421ac310>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:47.383275 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6191ad4f-ef09-4c02-be7b-fc52cb27be7e tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed" status: 200 len: 288 microversion: 2.1 time: 0.044277 Jul 20 04:47:47.383875 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3146/6278] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 04:47:47 2022] GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed => generated 288 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:47.391340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:47.392882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:47.400158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84ae107f-0dfe-4598-9abd-075f3176a3d9 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841ced040>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:47.486917 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-84ae107f-0dfe-4598-9abd-075f3176a3d9 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed" status: 202 len: 0 microversion: 2.1 time: 0.096282 Jul 20 04:47:47.488641 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3133/6279] 10.222.0.59 () {58 vars in 1253 bytes} [Wed Jul 20 04:47:47 2022] DELETE /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:47.498577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b5707fc-abff-49d8-9c6c-19910a1348f2 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841b1e8b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:47.543269 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b5707fc-abff-49d8-9c6c-19910a1348f2 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed" status: 200 len: 287 microversion: 2.1 time: 0.050262 Jul 20 04:47:47.544480 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3147/6280] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 04:47:47 2022] GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:47.587976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a81f8c49-1bfa-4ce7-95cb-d325e45568a4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:47.588969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a81f8c49-1bfa-4ce7-95cb-d325e45568a4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:47.596787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a81f8c49-1bfa-4ce7-95cb-d325e45568a4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:47.598856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a81f8c49-1bfa-4ce7-95cb-d325e45568a4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.599917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a81f8c49-1bfa-4ce7-95cb-d325e45568a4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:47.600605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a81f8c49-1bfa-4ce7-95cb-d325e45568a4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.631783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a81f8c49-1bfa-4ce7-95cb-d325e45568a4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:47:47.731284 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a81f8c49-1bfa-4ce7-95cb-d325e45568a4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 204 len: 0 microversion: 2.1 time: 0.148418 Jul 20 04:47:47.732289 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3134/6281] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:47:47 2022] DELETE /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:47:47.741571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-eeeb2238-bf48-41cc-8ef9-ff7a85eb000f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:47.742664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-eeeb2238-bf48-41cc-8ef9-ff7a85eb000f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:47.756467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eeeb2238-bf48-41cc-8ef9-ff7a85eb000f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:47.759680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eeeb2238-bf48-41cc-8ef9-ff7a85eb000f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.763492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eeeb2238-bf48-41cc-8ef9-ff7a85eb000f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:47.764207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eeeb2238-bf48-41cc-8ef9-ff7a85eb000f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.939871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eeeb2238-bf48-41cc-8ef9-ff7a85eb000f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:47.958759 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-eeeb2238-bf48-41cc-8ef9-ff7a85eb000f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1577 microversion: 2.1 time: 0.220348 Jul 20 04:47:47.959999 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3148/6282] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:47 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:48.556134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fb7c7612-db4a-49f4-b3d8-56d04571de4a tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb84839cd30>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:48.616521 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fb7c7612-db4a-49f4-b3d8-56d04571de4a tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed" status: 200 len: 287 microversion: 2.1 time: 0.064779 Jul 20 04:47:48.617355 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3135/6283] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 04:47:48 2022] GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:48.978636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-03cd6804-c990-4d12-a0be-d5c5a79909f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:48.979892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-03cd6804-c990-4d12-a0be-d5c5a79909f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:48.989427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03cd6804-c990-4d12-a0be-d5c5a79909f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.990211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03cd6804-c990-4d12-a0be-d5c5a79909f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.991880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03cd6804-c990-4d12-a0be-d5c5a79909f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.992554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03cd6804-c990-4d12-a0be-d5c5a79909f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.199469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-03cd6804-c990-4d12-a0be-d5c5a79909f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:49.208456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-03cd6804-c990-4d12-a0be-d5c5a79909f9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1577 microversion: 2.1 time: 0.234019 Jul 20 04:47:49.229429 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3149/6284] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:48 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:49.630071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-946ee221-84d9-41d1-81a4-7e8a815dffe0 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841eb79d0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:49.686702 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-946ee221-84d9-41d1-81a4-7e8a815dffe0 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] HTTP exception thrown: Snapshot 7a43cb62-a986-4a2c-a7df-5567347669ed could not be found. Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-946ee221-84d9-41d1-81a4-7e8a815dffe0 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Request method failure captured: Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed HTTP/1.1 Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14jvga-E_d7fSOTQx4LnCqH48LQcUB1git1sZZ4b_IiVEk33sSg6jkcAOlIlA0U7tpz3mKGF4wdxMt9c642l0KYM-qbWtY4mnSzqmqkJ8CoaLj0C8v_c6DTV6mAeW2FvgXY-PZD8HbohVXyDRf5t-pZ-kwf08HY-g9CiFxclf3bwZEo Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 602fcfcdfbec4fb2a5c28988d1023c85 Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 602fcfcdfbec4fb2a5c28988d1023c85 Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesSnapshotsTestJSON-375522752-project Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2b65c817e4f44ee3b92cfab416c56475 Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-375522752-project Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: exception: Snapshot 7a43cb62-a986-4a2c-a7df-5567347669ed could not be found. Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7a43cb62-a986-4a2c-a7df-5567347669ed'} Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7a43cb62-a986-4a2c-a7df-5567347669ed could not be found. (HTTP 404) (Request-ID: req-502a5a0c-bd15-4b2f-9102-247eb10cbd91) Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:47:49.695803 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7a43cb62-a986-4a2c-a7df-5567347669ed could not be found. Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7a43cb62-a986-4a2c-a7df-5567347669ed could not be found. Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7a43cb62-a986-4a2c-a7df-5567347669ed could not be found. Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-946ee221-84d9-41d1-81a4-7e8a815dffe0 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Returning 404 to user: Snapshot 7a43cb62-a986-4a2c-a7df-5567347669ed could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:49.700344 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-946ee221-84d9-41d1-81a4-7e8a815dffe0 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed" status: 404 len: 111 microversion: 2.1 time: 0.074481 Jul 20 04:47:49.708772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-000662fd-a001-4b91-bba6-3804317ab5ec tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841b49550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:49.714627 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3136/6285] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 04:47:49 2022] GET /compute/v2.1/os-snapshots/7a43cb62-a986-4a2c-a7df-5567347669ed => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:49.819610 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-000662fd-a001-4b91-bba6-3804317ab5ec tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8" status: 202 len: 0 microversion: 2.1 time: 0.114963 Jul 20 04:47:49.827876 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3150/6286] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:47:49 2022] DELETE /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:49.829497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dbb3253b-97ff-4164-87b3-14e8365a7310 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841e651f0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:49.927360 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dbb3253b-97ff-4164-87b3-14e8365a7310 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8" status: 200 len: 345 microversion: 2.1 time: 0.102156 Jul 20 04:47:49.933212 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3137/6287] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:47:49 2022] GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 => generated 345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:50.227189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-64fb20c8-14f1-445f-9156-488ad54f5df8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:50.227725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-64fb20c8-14f1-445f-9156-488ad54f5df8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:50.243441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64fb20c8-14f1-445f-9156-488ad54f5df8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.244640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64fb20c8-14f1-445f-9156-488ad54f5df8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.245875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64fb20c8-14f1-445f-9156-488ad54f5df8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.246528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-64fb20c8-14f1-445f-9156-488ad54f5df8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.387745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-64fb20c8-14f1-445f-9156-488ad54f5df8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:50.397953 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-64fb20c8-14f1-445f-9156-488ad54f5df8 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1509 microversion: 2.1 time: 0.174636 Jul 20 04:47:50.401926 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3151/6288] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:50 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:50.654706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2963a42c-7552-44bc-8390-c4c10e349f45 req-877038ce-f141-4ac2-aa90-338c34fa9bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e04f244-7107-4419-aaca-08303464f6a9", "name": "network-vif-deleted", "tag": "98a2bc3d-06e3-42f4-b7f2-69256c152d9f"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:50.683152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2963a42c-7552-44bc-8390-c4c10e349f45 req-877038ce-f141-4ac2-aa90-338c34fa9bd7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:50.685817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2963a42c-7552-44bc-8390-c4c10e349f45 req-877038ce-f141-4ac2-aa90-338c34fa9bd7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:50.713958 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2963a42c-7552-44bc-8390-c4c10e349f45 req-877038ce-f141-4ac2-aa90-338c34fa9bd7 service nova] Creating event network-vif-deleted:98a2bc3d-06e3-42f4-b7f2-69256c152d9f for instance 4e04f244-7107-4419-aaca-08303464f6a9 on n-h2-760456-11 Jul 20 04:47:50.720758 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2963a42c-7552-44bc-8390-c4c10e349f45 req-877038ce-f141-4ac2-aa90-338c34fa9bd7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069936 Jul 20 04:47:50.721730 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3138/6289] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:50.942909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a824ab6d-f19c-420e-bf13-ed3550f72832 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb842b930d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:51.033964 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a824ab6d-f19c-420e-bf13-ed3550f72832 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8" status: 200 len: 345 microversion: 2.1 time: 0.096592 Jul 20 04:47:51.039541 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3152/6290] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:47:50 2022] GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:51.419110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e738ecfb-fc6a-40cc-a0ca-cdaed5c744f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:51.420265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e738ecfb-fc6a-40cc-a0ca-cdaed5c744f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:51.429482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e738ecfb-fc6a-40cc-a0ca-cdaed5c744f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:51.434900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e738ecfb-fc6a-40cc-a0ca-cdaed5c744f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:51.435990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e738ecfb-fc6a-40cc-a0ca-cdaed5c744f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:51.440737 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e738ecfb-fc6a-40cc-a0ca-cdaed5c744f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:51.550561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e738ecfb-fc6a-40cc-a0ca-cdaed5c744f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:51.560177 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e738ecfb-fc6a-40cc-a0ca-cdaed5c744f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1225 microversion: 2.1 time: 0.145329 Jul 20 04:47:51.570583 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3139/6291] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:51 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:52.046796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c19c17c9-2ea8-4dcb-b2ff-13acef8bbab0 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841b49550>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:52.372683 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c19c17c9-2ea8-4dcb-b2ff-13acef8bbab0 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8" status: 200 len: 345 microversion: 2.1 time: 0.329631 Jul 20 04:47:52.373446 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3153/6292] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:47:52 2022] GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 => generated 345 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:52.580144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-22fe87b3-50fa-4fb4-b91e-cc26a2a2bc24 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:52.582876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22fe87b3-50fa-4fb4-b91e-cc26a2a2bc24 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:52.594216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22fe87b3-50fa-4fb4-b91e-cc26a2a2bc24 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.595061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22fe87b3-50fa-4fb4-b91e-cc26a2a2bc24 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.597738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22fe87b3-50fa-4fb4-b91e-cc26a2a2bc24 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.598799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22fe87b3-50fa-4fb4-b91e-cc26a2a2bc24 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.692896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-22fe87b3-50fa-4fb4-b91e-cc26a2a2bc24 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:52.701705 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-22fe87b3-50fa-4fb4-b91e-cc26a2a2bc24 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1225 microversion: 2.1 time: 0.128660 Jul 20 04:47:52.704286 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3140/6293] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:52 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:53.390441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28e1c297-d1de-497e-bc54-5ed8c66c1607 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841241700>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.430457 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-28e1c297-d1de-497e-bc54-5ed8c66c1607 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] HTTP exception thrown: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28e1c297-d1de-497e-bc54-5ed8c66c1607 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Request method failure captured: Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 HTTP/1.1 Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14jvga-E_d7fSOTQx4LnCqH48LQcUB1git1sZZ4b_IiVEk33sSg6jkcAOlIlA0U7tpz3mKGF4wdxMt9c642l0KYM-qbWtY4mnSzqmqkJ8CoaLj0C8v_c6DTV6mAeW2FvgXY-PZD8HbohVXyDRf5t-pZ-kwf08HY-g9CiFxclf3bwZEo Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 602fcfcdfbec4fb2a5c28988d1023c85 Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 602fcfcdfbec4fb2a5c28988d1023c85 Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-VolumesSnapshotsTestJSON-375522752-project Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2b65c817e4f44ee3b92cfab416c56475 Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-VolumesSnapshotsTestJSON-375522752-project Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: exception: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'c65aa5b6-d38c-4014-967c-97aadeb820a8'} Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. (HTTP 404) (Request-ID: req-5412d18d-8b87-43b5-a2ee-510f582eb5ba) Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:47:53.437544 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28e1c297-d1de-497e-bc54-5ed8c66c1607 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Returning 404 to user: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:53.443466 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-28e1c297-d1de-497e-bc54-5ed8c66c1607 tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8" status: 404 len: 109 microversion: 2.1 time: 0.060229 Jul 20 04:47:53.446913 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3154/6294] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:47:53 2022] GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:53.453266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-555eb423-4c17-4105-9e91-13f956a0d3ab tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841b6c310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.532442 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-555eb423-4c17-4105-9e91-13f956a0d3ab tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] HTTP exception thrown: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-555eb423-4c17-4105-9e91-13f956a0d3ab tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Request method failure captured: Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 HTTP/1.1 Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14jvga-E_d7fSOTQx4LnCqH48LQcUB1git1sZZ4b_IiVEk33sSg6jkcAOlIlA0U7tpz3mKGF4wdxMt9c642l0KYM-qbWtY4mnSzqmqkJ8CoaLj0C8v_c6DTV6mAeW2FvgXY-PZD8HbohVXyDRf5t-pZ-kwf08HY-g9CiFxclf3bwZEo Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 602fcfcdfbec4fb2a5c28988d1023c85 Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 602fcfcdfbec4fb2a5c28988d1023c85 Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesSnapshotsTestJSON-375522752-project Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 2b65c817e4f44ee3b92cfab416c56475 Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-375522752-project Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: method: Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: exception: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c65aa5b6-d38c-4014-967c-97aadeb820a8'} Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. (HTTP 404) (Request-ID: req-c36a2a73-044f-498f-8b19-58170698a79c) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:47:53.534947 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-555eb423-4c17-4105-9e91-13f956a0d3ab tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Returning 404 to user: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-555eb423-4c17-4105-9e91-13f956a0d3ab tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8" status: 404 len: 109 microversion: 2.1 time: 0.087135 Jul 20 04:47:53.539334 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3141/6295] 10.222.0.59 () {58 vars in 1247 bytes} [Wed Jul 20 04:47:53 2022] DELETE /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:53.548839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04b75276-7a4a-40cc-a229-870914993e9b tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Calling method '.version_select at 0x7fb841241820>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.582225 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-04b75276-7a4a-40cc-a229-870914993e9b tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] HTTP exception thrown: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04b75276-7a4a-40cc-a229-870914993e9b tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Request method failure captured: Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 HTTP/1.1 Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14jvga-E_d7fSOTQx4LnCqH48LQcUB1git1sZZ4b_IiVEk33sSg6jkcAOlIlA0U7tpz3mKGF4wdxMt9c642l0KYM-qbWtY4mnSzqmqkJ8CoaLj0C8v_c6DTV6mAeW2FvgXY-PZD8HbohVXyDRf5t-pZ-kwf08HY-g9CiFxclf3bwZEo Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 602fcfcdfbec4fb2a5c28988d1023c85 Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_602fcfcdfbec4fb2a5c28988d1023c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 602fcfcdfbec4fb2a5c28988d1023c85 Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-375522752 Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-VolumesSnapshotsTestJSON-375522752-project Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 2b65c817e4f44ee3b92cfab416c56475 Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-VolumesSnapshotsTestJSON-375522752-project Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: method: Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: exception: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'c65aa5b6-d38c-4014-967c-97aadeb820a8'} Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. (HTTP 404) (Request-ID: req-4b0ba9c5-6c95-461e-a56e-0ea31fc25798) Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:47:53.584731 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04b75276-7a4a-40cc-a229-870914993e9b tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] Returning 404 to user: Volume c65aa5b6-d38c-4014-967c-97aadeb820a8 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04b75276-7a4a-40cc-a229-870914993e9b tempest-VolumesSnapshotsTestJSON-375522752 tempest-VolumesSnapshotsTestJSON-375522752-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8" status: 404 len: 109 microversion: 2.1 time: 0.041692 Jul 20 04:47:53.589492 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3155/6296] 10.222.0.59 () {58 vars in 1244 bytes} [Wed Jul 20 04:47:53 2022] GET /compute/v2.1/os-volumes/c65aa5b6-d38c-4014-967c-97aadeb820a8 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:53.720245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d4e2ee4e-c17a-47f7-bab8-b5c5b036d299 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.722460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d4e2ee4e-c17a-47f7-bab8-b5c5b036d299 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:53.731077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4e2ee4e-c17a-47f7-bab8-b5c5b036d299 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.734525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4e2ee4e-c17a-47f7-bab8-b5c5b036d299 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.736403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4e2ee4e-c17a-47f7-bab8-b5c5b036d299 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.741389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4e2ee4e-c17a-47f7-bab8-b5c5b036d299 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.854176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d4e2ee4e-c17a-47f7-bab8-b5c5b036d299 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:53.863715 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d4e2ee4e-c17a-47f7-bab8-b5c5b036d299 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1225 microversion: 2.1 time: 0.149278 Jul 20 04:47:53.864312 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3142/6297] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:53 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1225 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:54.882745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b12ef980-0cfe-40a6-a88f-a511a353c537 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:54.883988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b12ef980-0cfe-40a6-a88f-a511a353c537 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:54.894208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b12ef980-0cfe-40a6-a88f-a511a353c537 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:54.895340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b12ef980-0cfe-40a6-a88f-a511a353c537 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:54.896163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b12ef980-0cfe-40a6-a88f-a511a353c537 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:54.896618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b12ef980-0cfe-40a6-a88f-a511a353c537 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:54.992091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b12ef980-0cfe-40a6-a88f-a511a353c537 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:55.002241 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b12ef980-0cfe-40a6-a88f-a511a353c537 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1225 microversion: 2.1 time: 0.123848 Jul 20 04:47:55.003821 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3156/6298] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:54 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:56.020460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f12863e0-0d2b-4b8d-83da-6aaeeae57070 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:56.021101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f12863e0-0d2b-4b8d-83da-6aaeeae57070 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:56.027919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f12863e0-0d2b-4b8d-83da-6aaeeae57070 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:56.028392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f12863e0-0d2b-4b8d-83da-6aaeeae57070 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:56.029376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f12863e0-0d2b-4b8d-83da-6aaeeae57070 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:56.030017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f12863e0-0d2b-4b8d-83da-6aaeeae57070 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:56.104411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f12863e0-0d2b-4b8d-83da-6aaeeae57070 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:56.112661 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f12863e0-0d2b-4b8d-83da-6aaeeae57070 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1225 microversion: 2.1 time: 0.096834 Jul 20 04:47:56.113249 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3143/6299] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:56 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:57.132801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e5408176-d79b-42d6-af88-8504297227e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:57.133516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e5408176-d79b-42d6-af88-8504297227e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:57.144588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5408176-d79b-42d6-af88-8504297227e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:57.145806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5408176-d79b-42d6-af88-8504297227e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:57.146781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5408176-d79b-42d6-af88-8504297227e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:57.147404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5408176-d79b-42d6-af88-8504297227e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:57.222966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e5408176-d79b-42d6-af88-8504297227e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:57.232488 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e5408176-d79b-42d6-af88-8504297227e6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 200 len: 1225 microversion: 2.1 time: 0.105570 Jul 20 04:47:57.244513 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3157/6300] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:57 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:58.251934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e8c4419-9237-4b1a-b94a-e3d417269c8a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:58.252613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5e8c4419-9237-4b1a-b94a-e3d417269c8a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:58.260136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e8c4419-9237-4b1a-b94a-e3d417269c8a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:58.262930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e8c4419-9237-4b1a-b94a-e3d417269c8a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.263813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e8c4419-9237-4b1a-b94a-e3d417269c8a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:58.264566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5e8c4419-9237-4b1a-b94a-e3d417269c8a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.281866 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-5e8c4419-9237-4b1a-b94a-e3d417269c8a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e8c4419-9237-4b1a-b94a-e3d417269c8a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 HTTP/1.1 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4e04f244-7107-4419-aaca-08303464f6a9'} Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:58.286743 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:58.301275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:58.301275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:58.301275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:58.301275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:58.301275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:58.301275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:47:58.301275 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:47:58.301275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5e8c4419-9237-4b1a-b94a-e3d417269c8a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:58.301275 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5e8c4419-9237-4b1a-b94a-e3d417269c8a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 404 len: 111 microversion: 2.1 time: 0.040591 Jul 20 04:47:58.301275 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3144/6301] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:58 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:58.439243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-63433561", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-834958577", "security_groups": [{"name": "tempest-secgroup-smoke-1582677957"}], "block_device_mapping_v2": [{"uuid": "786ab916-dbb5-4270-8bba-ec343a58e8aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff98390c-0468-4cc8-9649-ee7fac3db692"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:58.624198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] validate_networks() for [('ff98390c-0468-4cc8-9649-ee7fac3db692', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:47:59.142783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:47:59.147123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:47:59.147631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:47:59.148062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:47:59.150872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:47:59.164440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.165361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.166192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.166666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.185576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:59.194511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for user f1067c18d4074c78a512d89e07141915 and project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:59.273599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:47:59.276816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='786ab916-dbb5-4270-8bba-ec343a58e8aa',volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:47:59.488716 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d04f6ea1-a629-4056-ad14-96e9ac1a4758 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.053404 Jul 20 04:47:59.491492 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3158/6302] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:47:59.500811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cb3ca601-f00c-4980-8f2b-980027c2b082 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:59.502211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cb3ca601-f00c-4980-8f2b-980027c2b082 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:59.609962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cb3ca601-f00c-4980-8f2b-980027c2b082 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:59.625603 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cb3ca601-f00c-4980-8f2b-980027c2b082 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1092 microversion: 2.1 time: 0.128989 Jul 20 04:47:59.627032 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3145/6303] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:59 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1092 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:00.647196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4581a82-9964-494b-b3e9-432e7f130e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:00.648651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a4581a82-9964-494b-b3e9-432e7f130e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:00.659622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4581a82-9964-494b-b3e9-432e7f130e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:00.660323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4581a82-9964-494b-b3e9-432e7f130e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:00.661456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4581a82-9964-494b-b3e9-432e7f130e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:00.662380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4581a82-9964-494b-b3e9-432e7f130e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:00.782503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a4581a82-9964-494b-b3e9-432e7f130e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:00.793566 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a4581a82-9964-494b-b3e9-432e7f130e65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1198 microversion: 2.1 time: 0.153955 Jul 20 04:48:00.794825 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3159/6304] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:00 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1198 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:01.812215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6979e55a-abdd-422d-9280-16ccea9b6cbc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:01.813013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6979e55a-abdd-422d-9280-16ccea9b6cbc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:01.835036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6979e55a-abdd-422d-9280-16ccea9b6cbc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.838745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6979e55a-abdd-422d-9280-16ccea9b6cbc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:01.842503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6979e55a-abdd-422d-9280-16ccea9b6cbc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:01.844622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6979e55a-abdd-422d-9280-16ccea9b6cbc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.035940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6979e55a-abdd-422d-9280-16ccea9b6cbc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:02.047364 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6979e55a-abdd-422d-9280-16ccea9b6cbc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1208 microversion: 2.1 time: 0.239429 Jul 20 04:48:02.052497 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3146/6305] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:01 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1208 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:03.070990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-70076fea-18da-4354-a934-c9303dbb32c9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:03.072313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-70076fea-18da-4354-a934-c9303dbb32c9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:03.100257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70076fea-18da-4354-a934-c9303dbb32c9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.115208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70076fea-18da-4354-a934-c9303dbb32c9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.117154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70076fea-18da-4354-a934-c9303dbb32c9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.124806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-70076fea-18da-4354-a934-c9303dbb32c9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.683822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-70076fea-18da-4354-a934-c9303dbb32c9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:03.702018 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-70076fea-18da-4354-a934-c9303dbb32c9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1276 microversion: 2.1 time: 0.632287 Jul 20 04:48:03.708363 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3160/6306] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:03 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1276 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:04.370648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-014bcb96-143c-42fe-b0c4-983cab78d6d5 req-3d1819b7-0382-4048-bc9a-34ae64384340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27cd449-5ffc-42e0-9ad1-0b2742174178", "tag": "a797f02c-f5b2-4e5c-ae65-e7c540fb850b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:04.389536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-014bcb96-143c-42fe-b0c4-983cab78d6d5 req-3d1819b7-0382-4048-bc9a-34ae64384340 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.390004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-014bcb96-143c-42fe-b0c4-983cab78d6d5 req-3d1819b7-0382-4048-bc9a-34ae64384340 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.448827 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-014bcb96-143c-42fe-b0c4-983cab78d6d5 req-3d1819b7-0382-4048-bc9a-34ae64384340 service nova] Creating event network-changed:a797f02c-f5b2-4e5c-ae65-e7c540fb850b for instance f27cd449-5ffc-42e0-9ad1-0b2742174178 on n-h2-760456-11 Jul 20 04:48:04.502451 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-014bcb96-143c-42fe-b0c4-983cab78d6d5 req-3d1819b7-0382-4048-bc9a-34ae64384340 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134960 Jul 20 04:48:04.503515 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3147/6307] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:04.738564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d2d9c40e-1d15-4883-988e-36e42792d4f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:04.743727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d2d9c40e-1d15-4883-988e-36e42792d4f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:04.776740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2d9c40e-1d15-4883-988e-36e42792d4f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.777274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2d9c40e-1d15-4883-988e-36e42792d4f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.778579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2d9c40e-1d15-4883-988e-36e42792d4f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.779920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2d9c40e-1d15-4883-988e-36e42792d4f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:05.230715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d2d9c40e-1d15-4883-988e-36e42792d4f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:05.243905 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d2d9c40e-1d15-4883-988e-36e42792d4f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1276 microversion: 2.1 time: 0.524855 Jul 20 04:48:05.246347 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3161/6308] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:04 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1276 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:06.267174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a30d4507-c457-4c03-b9ba-b3885bc655aa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:06.267927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a30d4507-c457-4c03-b9ba-b3885bc655aa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:06.278324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a30d4507-c457-4c03-b9ba-b3885bc655aa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:06.290529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a30d4507-c457-4c03-b9ba-b3885bc655aa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:06.291800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a30d4507-c457-4c03-b9ba-b3885bc655aa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:06.292282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a30d4507-c457-4c03-b9ba-b3885bc655aa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:06.516699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a30d4507-c457-4c03-b9ba-b3885bc655aa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:06.528985 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a30d4507-c457-4c03-b9ba-b3885bc655aa tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1276 microversion: 2.1 time: 0.267548 Jul 20 04:48:06.533041 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3148/6309] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:06 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1276 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:06.789736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1400826044", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "6daf288d-d7f8-4967-a70b-3a5d8312d069"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:06.874564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] validate_networks() for [('6daf288d-d7f8-4967-a70b-3a5d8312d069', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:48:07.358213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:48:07.358886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:48:07.359435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:48:07.360044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:48:07.360538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:48:07.371567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:07.372436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:07.373936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:07.374750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:07.399745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Getting quotas for project b0ceba3691ac48b5b8f8e9916c733a68. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:48:07.406975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Getting quotas for user e7971fe4e0c4457eaa0c727c60a610de and project b0ceba3691ac48b5b8f8e9916c733a68. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:48:07.421156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:48:07.423608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:48:07.481024 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-86680697-f9bc-4725-945c-f1490340b8dc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696367 Jul 20 04:48:07.482117 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3162/6310] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:48:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:48:07.493319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-91be4c56-1429-44c0-85ca-2cdb4e0b04a9 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:07.496093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-91be4c56-1429-44c0-85ca-2cdb4e0b04a9 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:07.547276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fb0d61f8-4a81-42be-8011-4e15dc5edb2e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:07.547991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fb0d61f8-4a81-42be-8011-4e15dc5edb2e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:07.570744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb0d61f8-4a81-42be-8011-4e15dc5edb2e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:07.571281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb0d61f8-4a81-42be-8011-4e15dc5edb2e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:07.572101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb0d61f8-4a81-42be-8011-4e15dc5edb2e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:07.572705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fb0d61f8-4a81-42be-8011-4e15dc5edb2e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:07.587892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-91be4c56-1429-44c0-85ca-2cdb4e0b04a9 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:07.597914 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-91be4c56-1429-44c0-85ca-2cdb4e0b04a9 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1219 microversion: 2.1 time: 0.109726 Jul 20 04:48:07.599716 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3149/6311] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:07 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:07.889998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fb0d61f8-4a81-42be-8011-4e15dc5edb2e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:07.900745 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fb0d61f8-4a81-42be-8011-4e15dc5edb2e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1276 microversion: 2.1 time: 0.357520 Jul 20 04:48:07.901354 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3163/6312] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:07 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1276 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:08.627848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e89e3b9e-2791-42db-8f72-0d5241c308d7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:08.636786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e89e3b9e-2791-42db-8f72-0d5241c308d7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:08.708092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e89e3b9e-2791-42db-8f72-0d5241c308d7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.711365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e89e3b9e-2791-42db-8f72-0d5241c308d7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.714062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e89e3b9e-2791-42db-8f72-0d5241c308d7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.720573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e89e3b9e-2791-42db-8f72-0d5241c308d7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.858942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e89e3b9e-2791-42db-8f72-0d5241c308d7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:08.873509 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e89e3b9e-2791-42db-8f72-0d5241c308d7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1279 microversion: 2.1 time: 0.260856 Jul 20 04:48:08.884727 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3150/6313] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:08 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:08.919022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4833dfcc-7119-49dd-82a5-5a867e41ccf6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:08.919848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4833dfcc-7119-49dd-82a5-5a867e41ccf6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:08.936619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4833dfcc-7119-49dd-82a5-5a867e41ccf6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.945978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4833dfcc-7119-49dd-82a5-5a867e41ccf6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.947103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4833dfcc-7119-49dd-82a5-5a867e41ccf6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.948936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4833dfcc-7119-49dd-82a5-5a867e41ccf6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:09.254174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4833dfcc-7119-49dd-82a5-5a867e41ccf6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:09.262978 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4833dfcc-7119-49dd-82a5-5a867e41ccf6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1276 microversion: 2.1 time: 0.348731 Jul 20 04:48:09.267626 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3164/6314] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:08 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1276 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:09.893703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-424ffb30-8bde-47e1-9fa7-7e79064f600d tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:09.894487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-424ffb30-8bde-47e1-9fa7-7e79064f600d tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:09.902558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-424ffb30-8bde-47e1-9fa7-7e79064f600d tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:09.903142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-424ffb30-8bde-47e1-9fa7-7e79064f600d tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:09.903933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-424ffb30-8bde-47e1-9fa7-7e79064f600d tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:09.904380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-424ffb30-8bde-47e1-9fa7-7e79064f600d tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.095059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-424ffb30-8bde-47e1-9fa7-7e79064f600d tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:10.117100 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-424ffb30-8bde-47e1-9fa7-7e79064f600d tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1319 microversion: 2.1 time: 0.228249 Jul 20 04:48:10.118417 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3151/6315] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:09 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:10.281120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b38d022-d821-47e2-8449-06888076bd1d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:10.282645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4b38d022-d821-47e2-8449-06888076bd1d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:10.291203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b38d022-d821-47e2-8449-06888076bd1d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.292010 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b38d022-d821-47e2-8449-06888076bd1d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.293317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b38d022-d821-47e2-8449-06888076bd1d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.294330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b38d022-d821-47e2-8449-06888076bd1d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.524346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4b38d022-d821-47e2-8449-06888076bd1d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:10.533782 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4b38d022-d821-47e2-8449-06888076bd1d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1264 microversion: 2.1 time: 0.256669 Jul 20 04:48:10.544468 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3165/6316] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:10 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1264 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:10.595731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e6f43cb7-4240-458d-8de4-54b2f8a3229d req-3f15b47c-641a-4dc5-bf4c-090aa1767098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b", "tag": "982b5f2f-2796-4389-8f00-a7d33c3c3e28"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:10.609094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e6f43cb7-4240-458d-8de4-54b2f8a3229d req-3f15b47c-641a-4dc5-bf4c-090aa1767098 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.609873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e6f43cb7-4240-458d-8de4-54b2f8a3229d req-3f15b47c-641a-4dc5-bf4c-090aa1767098 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.622613 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e6f43cb7-4240-458d-8de4-54b2f8a3229d req-3f15b47c-641a-4dc5-bf4c-090aa1767098 service nova] Creating event network-changed:982b5f2f-2796-4389-8f00-a7d33c3c3e28 for instance 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b on n-h1-760456-11 Jul 20 04:48:10.631617 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e6f43cb7-4240-458d-8de4-54b2f8a3229d req-3f15b47c-641a-4dc5-bf4c-090aa1767098 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041394 Jul 20 04:48:10.632809 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3152/6317] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:11.137194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e2a77a68-9da2-49b5-9ad1-fb9af34a65e7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:11.137974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e2a77a68-9da2-49b5-9ad1-fb9af34a65e7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:11.146972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2a77a68-9da2-49b5-9ad1-fb9af34a65e7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.147434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2a77a68-9da2-49b5-9ad1-fb9af34a65e7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:11.148231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2a77a68-9da2-49b5-9ad1-fb9af34a65e7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.148674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2a77a68-9da2-49b5-9ad1-fb9af34a65e7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:11.310678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e2a77a68-9da2-49b5-9ad1-fb9af34a65e7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:11.318431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e2a77a68-9da2-49b5-9ad1-fb9af34a65e7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1319 microversion: 2.1 time: 0.186285 Jul 20 04:48:11.319024 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3166/6318] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:11 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:11.553470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f0b1f67f-7b8e-4f2d-b760-69bb281c6831 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:11.554434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f0b1f67f-7b8e-4f2d-b760-69bb281c6831 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:11.560868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0b1f67f-7b8e-4f2d-b760-69bb281c6831 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.561339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0b1f67f-7b8e-4f2d-b760-69bb281c6831 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:11.562164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0b1f67f-7b8e-4f2d-b760-69bb281c6831 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.562726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0b1f67f-7b8e-4f2d-b760-69bb281c6831 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:11.714382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f0b1f67f-7b8e-4f2d-b760-69bb281c6831 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:11.722950 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f0b1f67f-7b8e-4f2d-b760-69bb281c6831 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1264 microversion: 2.1 time: 0.175168 Jul 20 04:48:11.723544 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3153/6319] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:11 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:12.339909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-481d6d6a-7ef5-496f-9a76-18b61235f2e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:12.341844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-481d6d6a-7ef5-496f-9a76-18b61235f2e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:12.357262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-481d6d6a-7ef5-496f-9a76-18b61235f2e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.358337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-481d6d6a-7ef5-496f-9a76-18b61235f2e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.359935 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-481d6d6a-7ef5-496f-9a76-18b61235f2e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.360953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-481d6d6a-7ef5-496f-9a76-18b61235f2e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.535491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-481d6d6a-7ef5-496f-9a76-18b61235f2e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:12.543941 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-481d6d6a-7ef5-496f-9a76-18b61235f2e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1319 microversion: 2.1 time: 0.210917 Jul 20 04:48:12.544550 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3167/6320] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:12 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:12.741933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f691026-ac4b-4790-af8d-f484c49c2670 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:12.742952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6f691026-ac4b-4790-af8d-f484c49c2670 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:12.751252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f691026-ac4b-4790-af8d-f484c49c2670 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.751731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f691026-ac4b-4790-af8d-f484c49c2670 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.753617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f691026-ac4b-4790-af8d-f484c49c2670 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.754080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f691026-ac4b-4790-af8d-f484c49c2670 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.907285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6f691026-ac4b-4790-af8d-f484c49c2670 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:12.916982 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f691026-ac4b-4790-af8d-f484c49c2670 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1264 microversion: 2.1 time: 0.181155 Jul 20 04:48:12.918111 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3154/6321] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:12 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:13.560917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3000cf5a-2124-4335-ad36-4a39626cb7fc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:13.561546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3000cf5a-2124-4335-ad36-4a39626cb7fc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:13.569676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3000cf5a-2124-4335-ad36-4a39626cb7fc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.570135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3000cf5a-2124-4335-ad36-4a39626cb7fc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.571236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3000cf5a-2124-4335-ad36-4a39626cb7fc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.571684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3000cf5a-2124-4335-ad36-4a39626cb7fc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.747939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3000cf5a-2124-4335-ad36-4a39626cb7fc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:13.758298 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3000cf5a-2124-4335-ad36-4a39626cb7fc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1319 microversion: 2.1 time: 0.201060 Jul 20 04:48:13.758953 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3168/6322] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:13 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:13.938651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6c28679-9bec-441e-aa2c-df59ff4013c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:13.940596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6c28679-9bec-441e-aa2c-df59ff4013c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:13.951058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6c28679-9bec-441e-aa2c-df59ff4013c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.951547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6c28679-9bec-441e-aa2c-df59ff4013c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.952488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6c28679-9bec-441e-aa2c-df59ff4013c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:13.953000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6c28679-9bec-441e-aa2c-df59ff4013c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.135404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f6c28679-9bec-441e-aa2c-df59ff4013c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:14.149092 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6c28679-9bec-441e-aa2c-df59ff4013c5 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1264 microversion: 2.1 time: 0.217667 Jul 20 04:48:14.150437 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3155/6323] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:13 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:14.777193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-531a38ea-d8d7-4c9c-85fa-71e6176cfefc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:14.777821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-531a38ea-d8d7-4c9c-85fa-71e6176cfefc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:14.785506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-531a38ea-d8d7-4c9c-85fa-71e6176cfefc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.786128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-531a38ea-d8d7-4c9c-85fa-71e6176cfefc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.787014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-531a38ea-d8d7-4c9c-85fa-71e6176cfefc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.787795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-531a38ea-d8d7-4c9c-85fa-71e6176cfefc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.958710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-531a38ea-d8d7-4c9c-85fa-71e6176cfefc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:14.968297 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-531a38ea-d8d7-4c9c-85fa-71e6176cfefc tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1319 microversion: 2.1 time: 0.195135 Jul 20 04:48:14.978350 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3169/6324] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:14 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:15.168523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-65fa00a8-a04b-4627-8ace-8b21d891092b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:15.169154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-65fa00a8-a04b-4627-8ace-8b21d891092b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:15.177252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65fa00a8-a04b-4627-8ace-8b21d891092b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:15.177781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65fa00a8-a04b-4627-8ace-8b21d891092b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.178602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65fa00a8-a04b-4627-8ace-8b21d891092b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:15.179259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65fa00a8-a04b-4627-8ace-8b21d891092b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.333170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-65fa00a8-a04b-4627-8ace-8b21d891092b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:15.340821 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-65fa00a8-a04b-4627-8ace-8b21d891092b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1264 microversion: 2.1 time: 0.176198 Jul 20 04:48:15.341706 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3156/6325] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:15 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:15.824779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9ee3746b-8ce9-49e1-8498-63b4006fd408 req-94fa2c99-2b0f-49a3-b909-a8e454f1b931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b", "name": "network-vif-plugged", "status": "completed", "tag": "982b5f2f-2796-4389-8f00-a7d33c3c3e28"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:15.835315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9ee3746b-8ce9-49e1-8498-63b4006fd408 req-94fa2c99-2b0f-49a3-b909-a8e454f1b931 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:15.835768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9ee3746b-8ce9-49e1-8498-63b4006fd408 req-94fa2c99-2b0f-49a3-b909-a8e454f1b931 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.848687 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9ee3746b-8ce9-49e1-8498-63b4006fd408 req-94fa2c99-2b0f-49a3-b909-a8e454f1b931 service nova] Creating event network-vif-plugged:982b5f2f-2796-4389-8f00-a7d33c3c3e28 for instance 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b on n-h1-760456-11 Jul 20 04:48:15.854099 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9ee3746b-8ce9-49e1-8498-63b4006fd408 req-94fa2c99-2b0f-49a3-b909-a8e454f1b931 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035427 Jul 20 04:48:15.855061 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3170/6326] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:15.987812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-05f3f817-7528-4cb3-84eb-e2ced1056af3 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:15.988456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05f3f817-7528-4cb3-84eb-e2ced1056af3 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:16.000622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05f3f817-7528-4cb3-84eb-e2ced1056af3 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.000622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05f3f817-7528-4cb3-84eb-e2ced1056af3 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.000622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05f3f817-7528-4cb3-84eb-e2ced1056af3 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.000622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05f3f817-7528-4cb3-84eb-e2ced1056af3 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.019322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:16.175109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05f3f817-7528-4cb3-84eb-e2ced1056af3 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:16.184136 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-05f3f817-7528-4cb3-84eb-e2ced1056af3 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1319 microversion: 2.1 time: 0.200857 Jul 20 04:48:16.185282 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3157/6327] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:15 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:16.360097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e8ca8574-e785-47b1-86a5-2c11c88bb5b6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:16.361109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e8ca8574-e785-47b1-86a5-2c11c88bb5b6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:16.368591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e8ca8574-e785-47b1-86a5-2c11c88bb5b6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.369212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e8ca8574-e785-47b1-86a5-2c11c88bb5b6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.370085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e8ca8574-e785-47b1-86a5-2c11c88bb5b6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.371048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e8ca8574-e785-47b1-86a5-2c11c88bb5b6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.391065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=100 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:16.519654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e8ca8574-e785-47b1-86a5-2c11c88bb5b6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:16.528189 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e8ca8574-e785-47b1-86a5-2c11c88bb5b6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1264 microversion: 2.1 time: 0.172813 Jul 20 04:48:16.528776 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3171/6328] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:16 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:17.201661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8fcf7313-d287-4c48-ad63-18adfa2f58cf tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:17.202890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8fcf7313-d287-4c48-ad63-18adfa2f58cf tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:17.210960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fcf7313-d287-4c48-ad63-18adfa2f58cf tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.211427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fcf7313-d287-4c48-ad63-18adfa2f58cf tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.212225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fcf7313-d287-4c48-ad63-18adfa2f58cf tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.212676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fcf7313-d287-4c48-ad63-18adfa2f58cf tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.375028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8fcf7313-d287-4c48-ad63-18adfa2f58cf tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:17.384304 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8fcf7313-d287-4c48-ad63-18adfa2f58cf tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1508 microversion: 2.1 time: 0.186692 Jul 20 04:48:17.384893 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3158/6329] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:17 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:17.546469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a90244b5-9bf8-4b13-b1e9-7b8af40cbe7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:17.547174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a90244b5-9bf8-4b13-b1e9-7b8af40cbe7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:17.550556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:17.551543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:17.552409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:17.561249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a90244b5-9bf8-4b13-b1e9-7b8af40cbe7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.561716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a90244b5-9bf8-4b13-b1e9-7b8af40cbe7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.562572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a90244b5-9bf8-4b13-b1e9-7b8af40cbe7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.563031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a90244b5-9bf8-4b13-b1e9-7b8af40cbe7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.771974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a90244b5-9bf8-4b13-b1e9-7b8af40cbe7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:17.780099 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a90244b5-9bf8-4b13-b1e9-7b8af40cbe7e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1264 microversion: 2.1 time: 0.237606 Jul 20 04:48:17.780929 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3172/6330] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:17 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:18.801134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d3c498d7-d14f-4bc5-af02-b41f4360d00d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:18.802007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d3c498d7-d14f-4bc5-af02-b41f4360d00d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:18.805969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:18.811143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:18.824796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3c498d7-d14f-4bc5-af02-b41f4360d00d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:18.825816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3c498d7-d14f-4bc5-af02-b41f4360d00d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:18.828683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3c498d7-d14f-4bc5-af02-b41f4360d00d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:18.829787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d3c498d7-d14f-4bc5-af02-b41f4360d00d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.039200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d3c498d7-d14f-4bc5-af02-b41f4360d00d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:19.047303 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d3c498d7-d14f-4bc5-af02-b41f4360d00d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1264 microversion: 2.1 time: 0.252141 Jul 20 04:48:19.047895 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3159/6331] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:18 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1264 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:20.066233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-feae4d88-9f50-45f1-8833-8e1525dc8b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:20.067652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-feae4d88-9f50-45f1-8833-8e1525dc8b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:20.085827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feae4d88-9f50-45f1-8833-8e1525dc8b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:20.086676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feae4d88-9f50-45f1-8833-8e1525dc8b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:20.087735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feae4d88-9f50-45f1-8833-8e1525dc8b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:20.088298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feae4d88-9f50-45f1-8833-8e1525dc8b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:20.259914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-feae4d88-9f50-45f1-8833-8e1525dc8b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:20.270945 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-feae4d88-9f50-45f1-8833-8e1525dc8b45 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1264 microversion: 2.1 time: 0.209952 Jul 20 04:48:20.271951 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3173/6332] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:20 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:20.301568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-30a62ca8-4828-45c6-91e0-ebb6f62b290b req-1647569f-fba5-42c1-9a6e-5bbffbe32940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27cd449-5ffc-42e0-9ad1-0b2742174178", "name": "network-vif-plugged", "status": "completed", "tag": "a797f02c-f5b2-4e5c-ae65-e7c540fb850b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:20.320572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-30a62ca8-4828-45c6-91e0-ebb6f62b290b req-1647569f-fba5-42c1-9a6e-5bbffbe32940 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:20.321238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-30a62ca8-4828-45c6-91e0-ebb6f62b290b req-1647569f-fba5-42c1-9a6e-5bbffbe32940 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:20.354046 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-30a62ca8-4828-45c6-91e0-ebb6f62b290b req-1647569f-fba5-42c1-9a6e-5bbffbe32940 service nova] Creating event network-vif-plugged:a797f02c-f5b2-4e5c-ae65-e7c540fb850b for instance f27cd449-5ffc-42e0-9ad1-0b2742174178 on n-h2-760456-11 Jul 20 04:48:20.364983 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-30a62ca8-4828-45c6-91e0-ebb6f62b290b req-1647569f-fba5-42c1-9a6e-5bbffbe32940 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067249 Jul 20 04:48:20.366632 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3160/6333] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:21.289377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e64543ed-b184-429c-ab80-56a1f6599d59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:21.290921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e64543ed-b184-429c-ab80-56a1f6599d59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:21.299993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e64543ed-b184-429c-ab80-56a1f6599d59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:21.300698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e64543ed-b184-429c-ab80-56a1f6599d59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:21.301483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e64543ed-b184-429c-ab80-56a1f6599d59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:21.301967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e64543ed-b184-429c-ab80-56a1f6599d59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:21.515916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e64543ed-b184-429c-ab80-56a1f6599d59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:21.526037 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e64543ed-b184-429c-ab80-56a1f6599d59 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1264 microversion: 2.1 time: 0.241390 Jul 20 04:48:21.527184 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3174/6334] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:21 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:22.547213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d8e51a47-a3b9-4f0e-a3e1-368eca276158 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:22.548086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d8e51a47-a3b9-4f0e-a3e1-368eca276158 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:22.557795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8e51a47-a3b9-4f0e-a3e1-368eca276158 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.559134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8e51a47-a3b9-4f0e-a3e1-368eca276158 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.559970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8e51a47-a3b9-4f0e-a3e1-368eca276158 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.560428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8e51a47-a3b9-4f0e-a3e1-368eca276158 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.739047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d8e51a47-a3b9-4f0e-a3e1-368eca276158 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:22.748664 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d8e51a47-a3b9-4f0e-a3e1-368eca276158 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1452 microversion: 2.1 time: 0.207329 Jul 20 04:48:22.749534 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3161/6335] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:22 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1452 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:22.766171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-39835490-62c2-4431-a2a4-06edfa9c716d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:22.766878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-39835490-62c2-4431-a2a4-06edfa9c716d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:22.777792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39835490-62c2-4431-a2a4-06edfa9c716d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.778194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39835490-62c2-4431-a2a4-06edfa9c716d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.779046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39835490-62c2-4431-a2a4-06edfa9c716d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.779494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39835490-62c2-4431-a2a4-06edfa9c716d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.953273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-39835490-62c2-4431-a2a4-06edfa9c716d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:22.972163 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-39835490-62c2-4431-a2a4-06edfa9c716d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1452 microversion: 2.1 time: 0.209795 Jul 20 04:48:22.973242 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3175/6336] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:22 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1452 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:26.727434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-00b1d85f-326d-44ac-be9f-29118387b21c req-0b385fe7-9bf8-4343-a300-9b3637b8bd73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27cd449-5ffc-42e0-9ad1-0b2742174178", "tag": "a797f02c-f5b2-4e5c-ae65-e7c540fb850b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:26.742977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-00b1d85f-326d-44ac-be9f-29118387b21c req-0b385fe7-9bf8-4343-a300-9b3637b8bd73 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:26.743454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-00b1d85f-326d-44ac-be9f-29118387b21c req-0b385fe7-9bf8-4343-a300-9b3637b8bd73 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:26.786146 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-00b1d85f-326d-44ac-be9f-29118387b21c req-0b385fe7-9bf8-4343-a300-9b3637b8bd73 service nova] Creating event network-changed:a797f02c-f5b2-4e5c-ae65-e7c540fb850b for instance f27cd449-5ffc-42e0-9ad1-0b2742174178 on n-h2-760456-11 Jul 20 04:48:26.795729 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-00b1d85f-326d-44ac-be9f-29118387b21c req-0b385fe7-9bf8-4343-a300-9b3637b8bd73 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.561935 Jul 20 04:48:26.796343 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3162/6337] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:38.239875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0ec4609b-e8c3-4e6f-9240-a54c4bd396eb tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6856f69b-6868-4a30-bd2d-78c7f6a91a2c", "device": "/dev/sdb"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:38.240989 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0ec4609b-e8c3-4e6f-9240-a54c4bd396eb tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:38.243552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=7 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:38.244207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=26 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:38.250678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ec4609b-e8c3-4e6f-9240-a54c4bd396eb tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:38.251181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ec4609b-e8c3-4e6f-9240-a54c4bd396eb tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.251974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ec4609b-e8c3-4e6f-9240-a54c4bd396eb tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:38.252440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ec4609b-e8c3-4e6f-9240-a54c4bd396eb tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.583778 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0ec4609b-e8c3-4e6f-9240-a54c4bd396eb tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "POST /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348409 Jul 20 04:48:38.585627 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3176/6338] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:48:38 2022] POST /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:52.222186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=7 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:52.223130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=24 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:52.366781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3880247a-9e83-45ab-ad39-a25b151f8d52 tempest-PortsAdminExtendedAttrsTestJSON-1896456679 tempest-PortsAdminExtendedAttrsTestJSON-1896456679-project-admin] Calling method '.version_select at 0x7fb841378280>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:52.367693 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:48:52.367693 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:48:52.368897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3880247a-9e83-45ab-ad39-a25b151f8d52 tempest-PortsAdminExtendedAttrsTestJSON-1896456679 tempest-PortsAdminExtendedAttrsTestJSON-1896456679-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.369403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3880247a-9e83-45ab-ad39-a25b151f8d52 tempest-PortsAdminExtendedAttrsTestJSON-1896456679 tempest-PortsAdminExtendedAttrsTestJSON-1896456679-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.384789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3880247a-9e83-45ab-ad39-a25b151f8d52 tempest-PortsAdminExtendedAttrsTestJSON-1896456679 tempest-PortsAdminExtendedAttrsTestJSON-1896456679-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.385267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3880247a-9e83-45ab-ad39-a25b151f8d52 tempest-PortsAdminExtendedAttrsTestJSON-1896456679 tempest-PortsAdminExtendedAttrsTestJSON-1896456679-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.395399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3880247a-9e83-45ab-ad39-a25b151f8d52 tempest-PortsAdminExtendedAttrsTestJSON-1896456679 tempest-PortsAdminExtendedAttrsTestJSON-1896456679-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.395869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3880247a-9e83-45ab-ad39-a25b151f8d52 tempest-PortsAdminExtendedAttrsTestJSON-1896456679 tempest-PortsAdminExtendedAttrsTestJSON-1896456679-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.401583 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3880247a-9e83-45ab-ad39-a25b151f8d52 tempest-PortsAdminExtendedAttrsTestJSON-1896456679 tempest-PortsAdminExtendedAttrsTestJSON-1896456679-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.181256 Jul 20 04:48:52.402285 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3163/6339] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 04:48:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:03.731467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:03.732911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:03.738354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b1737fa6-1307-41f5-87bf-27d60715d124 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:03.739221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b1737fa6-1307-41f5-87bf-27d60715d124 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:03.748748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1737fa6-1307-41f5-87bf-27d60715d124 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:03.749520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1737fa6-1307-41f5-87bf-27d60715d124 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:03.750561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1737fa6-1307-41f5-87bf-27d60715d124 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:03.752089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1737fa6-1307-41f5-87bf-27d60715d124 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:03.856452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-b1737fa6-1307-41f5-87bf-27d60715d124 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lazy-loading 'services' on Instance uuid 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:49:03.963418 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b1737fa6-1307-41f5-87bf-27d60715d124 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b/os-volume_attachments/6856f69b-6868-4a30-bd2d-78c7f6a91a2c" status: 202 len: 0 microversion: 2.1 time: 0.233542 Jul 20 04:49:03.968400 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3177/6340] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:49:03 2022] DELETE /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b/os-volume_attachments/6856f69b-6868-4a30-bd2d-78c7f6a91a2c => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:49:09.446145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-76330fb9-2ab0-4ffc-9def-541b426bc544 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:09.447522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-76330fb9-2ab0-4ffc-9def-541b426bc544 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:09.451517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:09.452453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:09.456842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76330fb9-2ab0-4ffc-9def-541b426bc544 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.457315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76330fb9-2ab0-4ffc-9def-541b426bc544 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.458347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76330fb9-2ab0-4ffc-9def-541b426bc544 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.459039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76330fb9-2ab0-4ffc-9def-541b426bc544 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.487646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-76330fb9-2ab0-4ffc-9def-541b426bc544 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:49:09.580638 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-76330fb9-2ab0-4ffc-9def-541b426bc544 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 204 len: 0 microversion: 2.1 time: 0.138194 Jul 20 04:49:09.581656 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3164/6341] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:09 2022] DELETE /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:49:09.592641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-603bf1ad-ab39-4387-addc-07fa16855305 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:09.594115 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-603bf1ad-ab39-4387-addc-07fa16855305 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:09.603650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-603bf1ad-ab39-4387-addc-07fa16855305 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.604417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-603bf1ad-ab39-4387-addc-07fa16855305 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.605371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-603bf1ad-ab39-4387-addc-07fa16855305 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:09.605987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-603bf1ad-ab39-4387-addc-07fa16855305 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:09.780575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-603bf1ad-ab39-4387-addc-07fa16855305 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:09.791189 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-603bf1ad-ab39-4387-addc-07fa16855305 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1514 microversion: 2.1 time: 0.204043 Jul 20 04:49:09.795464 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3178/6342] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:09 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:10.810371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-be19c5f1-2a49-4973-b7cf-2a5fe4626353 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:10.811113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-be19c5f1-2a49-4973-b7cf-2a5fe4626353 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:10.834945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be19c5f1-2a49-4973-b7cf-2a5fe4626353 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:10.835623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be19c5f1-2a49-4973-b7cf-2a5fe4626353 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:10.836599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be19c5f1-2a49-4973-b7cf-2a5fe4626353 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:10.837212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-be19c5f1-2a49-4973-b7cf-2a5fe4626353 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:11.100239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-be19c5f1-2a49-4973-b7cf-2a5fe4626353 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:11.133571 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-be19c5f1-2a49-4973-b7cf-2a5fe4626353 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 200 len: 1514 microversion: 2.1 time: 0.327952 Jul 20 04:49:11.134619 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3165/6343] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:10 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:11.615745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8a3d3c24-7f2c-4b0e-b486-e1da625b02de req-8efe80d3-8534-447c-8dd5-b935f1ed301e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b", "name": "network-vif-deleted", "tag": "982b5f2f-2796-4389-8f00-a7d33c3c3e28"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:11.629086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8a3d3c24-7f2c-4b0e-b486-e1da625b02de req-8efe80d3-8534-447c-8dd5-b935f1ed301e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:11.629835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8a3d3c24-7f2c-4b0e-b486-e1da625b02de req-8efe80d3-8534-447c-8dd5-b935f1ed301e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:11.651791 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8a3d3c24-7f2c-4b0e-b486-e1da625b02de req-8efe80d3-8534-447c-8dd5-b935f1ed301e service nova] Creating event network-vif-deleted:982b5f2f-2796-4389-8f00-a7d33c3c3e28 for instance 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b on n-h1-760456-11 Jul 20 04:49:11.658785 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8a3d3c24-7f2c-4b0e-b486-e1da625b02de req-8efe80d3-8534-447c-8dd5-b935f1ed301e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047418 Jul 20 04:49:11.660054 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3179/6344] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:12.154785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a49cf62f-d891-415a-98b3-174e2eefbda0 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:12.155856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a49cf62f-d891-415a-98b3-174e2eefbda0 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:12.167185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a49cf62f-d891-415a-98b3-174e2eefbda0 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:12.171621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a49cf62f-d891-415a-98b3-174e2eefbda0 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:12.173192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a49cf62f-d891-415a-98b3-174e2eefbda0 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:12.173969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a49cf62f-d891-415a-98b3-174e2eefbda0 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:12.191573 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a49cf62f-d891-415a-98b3-174e2eefbda0 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] HTTP exception thrown: Instance 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b could not be found. Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a49cf62f-d891-415a-98b3-174e2eefbda0 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Request method failure captured: Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b HTTP/1.1 Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14jDqoWPjWim82aLSdTgclGIaXUiAmgjRWOO5Ouebsu7JolrG7fhzBH8qFEagL5JboEI53hwUY6cJcvWnRZdzwZcIVCEo7Um9hR-PJ6VTfwl1mA_OHyR9Vygjt4Hg9yCvREnpzRW-CeihywNtX7kUHba9nHG7cF31htNAwzl_qhEvX0 Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b0ceba3691ac48b5b8f8e9916c733a68 Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesSnapshotTestJSON-227171180 Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b0ceba3691ac48b5b8f8e9916c733a68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0ceba3691ac48b5b8f8e9916c733a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0ceba3691ac48b5b8f8e9916c733a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b0ceba3691ac48b5b8f8e9916c733a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesSnapshotTestJSON-227171180 Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b0ceba3691ac48b5b8f8e9916c733a68 Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-227171180 Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesSnapshotTestJSON-227171180-project Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e7971fe4e0c4457eaa0c727c60a610de Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesSnapshotTestJSON-227171180-project Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b could not be found. Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b'} Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b could not be found. Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b could not be found. Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:12.193491 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:49:12.198303 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:12.198303 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:12.198303 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:12.198303 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:12.198303 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:12.198303 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b could not be found. Jul 20 04:49:12.198303 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:49:12.199677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a49cf62f-d891-415a-98b3-174e2eefbda0 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Returning 404 to user: Instance 4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:12.200565 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a49cf62f-d891-415a-98b3-174e2eefbda0 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b" status: 404 len: 111 microversion: 2.1 time: 0.051366 Jul 20 04:49:12.201143 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3166/6345] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:12 2022] GET /compute/v2.1/servers/4f7dd5eb-8bb8-42f0-a230-a6c5a311d29b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:19.197776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-939484995", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "6daf288d-d7f8-4967-a70b-3a5d8312d069"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:19.259420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] validate_networks() for [('6daf288d-d7f8-4967-a70b-3a5d8312d069', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:49:20.060285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:49:20.060740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:49:20.061215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:49:20.061626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:49:20.062041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:49:20.071475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:20.071933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:20.072732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:20.073174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:20.092841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Getting quotas for project b0ceba3691ac48b5b8f8e9916c733a68. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:49:20.099744 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Getting quotas for user e7971fe4e0c4457eaa0c727c60a610de and project b0ceba3691ac48b5b8f8e9916c733a68. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:49:20.122114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:49:20.124571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:49:20.171616 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b96854ab-fe03-4e91-8242-d0a15384cb40 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979096 Jul 20 04:49:20.178153 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3180/6346] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:49:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:49:20.184156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf4fd6b9-d3c5-47e9-b9e6-b121995b6d45 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:20.185009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cf4fd6b9-d3c5-47e9-b9e6-b121995b6d45 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:20.265299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cf4fd6b9-d3c5-47e9-b9e6-b121995b6d45 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:20.277132 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf4fd6b9-d3c5-47e9-b9e6-b121995b6d45 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1218 microversion: 2.1 time: 0.096855 Jul 20 04:49:20.282806 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3167/6347] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:20 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:21.296690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6678cab8-b572-4c41-961b-4cb90bcdeb83 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:21.297937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6678cab8-b572-4c41-961b-4cb90bcdeb83 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:21.320568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6678cab8-b572-4c41-961b-4cb90bcdeb83 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:21.321036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6678cab8-b572-4c41-961b-4cb90bcdeb83 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:21.321841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6678cab8-b572-4c41-961b-4cb90bcdeb83 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:21.322315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6678cab8-b572-4c41-961b-4cb90bcdeb83 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:21.423818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6678cab8-b572-4c41-961b-4cb90bcdeb83 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:21.436179 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6678cab8-b572-4c41-961b-4cb90bcdeb83 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1278 microversion: 2.1 time: 0.143359 Jul 20 04:49:21.439378 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3181/6348] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:21 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:22.456704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0dcf7f90-b51c-4d04-b9cb-9f30f694a0aa tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:22.458185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0dcf7f90-b51c-4d04-b9cb-9f30f694a0aa tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:22.461319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:22.477892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0dcf7f90-b51c-4d04-b9cb-9f30f694a0aa tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:22.480101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0dcf7f90-b51c-4d04-b9cb-9f30f694a0aa tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:22.481797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0dcf7f90-b51c-4d04-b9cb-9f30f694a0aa tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:22.489489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0dcf7f90-b51c-4d04-b9cb-9f30f694a0aa tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:22.833882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0dcf7f90-b51c-4d04-b9cb-9f30f694a0aa tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:22.844921 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0dcf7f90-b51c-4d04-b9cb-9f30f694a0aa tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1318 microversion: 2.1 time: 0.392800 Jul 20 04:49:22.845993 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3168/6349] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:22 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:23.065195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-63805ba7-2031-47a5-a587-afa3de34cf24 req-1e39d933-1e5f-487b-82bc-f69da2b4108e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "204539d6-86ac-48ec-9581-90c974ec4316", "tag": "e4ba3dcb-5b38-4785-b1c7-0f38568fcdca"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:23.077839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-63805ba7-2031-47a5-a587-afa3de34cf24 req-1e39d933-1e5f-487b-82bc-f69da2b4108e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.078932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-63805ba7-2031-47a5-a587-afa3de34cf24 req-1e39d933-1e5f-487b-82bc-f69da2b4108e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.101793 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-63805ba7-2031-47a5-a587-afa3de34cf24 req-1e39d933-1e5f-487b-82bc-f69da2b4108e service nova] Creating event network-changed:e4ba3dcb-5b38-4785-b1c7-0f38568fcdca for instance 204539d6-86ac-48ec-9581-90c974ec4316 on n-h1-760456-11 Jul 20 04:49:23.108967 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-63805ba7-2031-47a5-a587-afa3de34cf24 req-1e39d933-1e5f-487b-82bc-f69da2b4108e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047712 Jul 20 04:49:23.112399 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3182/6350] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:23.867285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4b7fc42-c0d2-41db-b5f7-89ef3716af7f tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:23.867942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b4b7fc42-c0d2-41db-b5f7-89ef3716af7f tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:23.876560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4b7fc42-c0d2-41db-b5f7-89ef3716af7f tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.877074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4b7fc42-c0d2-41db-b5f7-89ef3716af7f tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.877927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4b7fc42-c0d2-41db-b5f7-89ef3716af7f tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.878457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4b7fc42-c0d2-41db-b5f7-89ef3716af7f tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:24.101950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b4b7fc42-c0d2-41db-b5f7-89ef3716af7f tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:24.110933 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b4b7fc42-c0d2-41db-b5f7-89ef3716af7f tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1318 microversion: 2.1 time: 0.246264 Jul 20 04:49:24.111687 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3169/6351] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:23 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:25.130525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f429d5f-0dda-4f5d-a5ca-ffb895fcbfe7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:25.132743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8f429d5f-0dda-4f5d-a5ca-ffb895fcbfe7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:25.142060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f429d5f-0dda-4f5d-a5ca-ffb895fcbfe7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.142238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f429d5f-0dda-4f5d-a5ca-ffb895fcbfe7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.142958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f429d5f-0dda-4f5d-a5ca-ffb895fcbfe7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.143651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8f429d5f-0dda-4f5d-a5ca-ffb895fcbfe7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.540237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8f429d5f-0dda-4f5d-a5ca-ffb895fcbfe7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:25.548569 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8f429d5f-0dda-4f5d-a5ca-ffb895fcbfe7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1318 microversion: 2.1 time: 0.423322 Jul 20 04:49:25.549164 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3183/6352] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:25 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:26.567257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7791162b-1f37-45c8-9942-268525047765 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:26.568512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7791162b-1f37-45c8-9942-268525047765 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:26.584284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7791162b-1f37-45c8-9942-268525047765 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:26.584876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7791162b-1f37-45c8-9942-268525047765 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:26.585804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7791162b-1f37-45c8-9942-268525047765 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:26.586666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7791162b-1f37-45c8-9942-268525047765 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:26.752483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7791162b-1f37-45c8-9942-268525047765 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:26.760638 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7791162b-1f37-45c8-9942-268525047765 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1318 microversion: 2.1 time: 0.199513 Jul 20 04:49:26.761779 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3170/6353] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:26 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:27.798699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-acdaef57-28ca-41a6-a911-6aa33936f112 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:27.802220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-acdaef57-28ca-41a6-a911-6aa33936f112 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:27.819434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-acdaef57-28ca-41a6-a911-6aa33936f112 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.819928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-acdaef57-28ca-41a6-a911-6aa33936f112 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.820729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-acdaef57-28ca-41a6-a911-6aa33936f112 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.821176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-acdaef57-28ca-41a6-a911-6aa33936f112 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:28.000857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-acdaef57-28ca-41a6-a911-6aa33936f112 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:28.015289 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-acdaef57-28ca-41a6-a911-6aa33936f112 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1318 microversion: 2.1 time: 0.239743 Jul 20 04:49:28.016763 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3184/6354] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:27 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:29.033018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84c216ed-51c2-434a-aaf3-2c81236f078a tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:29.033840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-84c216ed-51c2-434a-aaf3-2c81236f078a tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:29.040969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84c216ed-51c2-434a-aaf3-2c81236f078a tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.041583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84c216ed-51c2-434a-aaf3-2c81236f078a tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.042515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84c216ed-51c2-434a-aaf3-2c81236f078a tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.043095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84c216ed-51c2-434a-aaf3-2c81236f078a tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.233097 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-84c216ed-51c2-434a-aaf3-2c81236f078a tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:29.242123 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-84c216ed-51c2-434a-aaf3-2c81236f078a tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1318 microversion: 2.1 time: 0.213162 Jul 20 04:49:29.242886 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3171/6355] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:29 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:30.260162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ee9256b6-bd1d-4154-a840-c00c4e675897 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:30.260829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ee9256b6-bd1d-4154-a840-c00c4e675897 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:30.267886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:30.268524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:30.273956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee9256b6-bd1d-4154-a840-c00c4e675897 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:30.274456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee9256b6-bd1d-4154-a840-c00c4e675897 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.275259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee9256b6-bd1d-4154-a840-c00c4e675897 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:30.275706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ee9256b6-bd1d-4154-a840-c00c4e675897 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.493038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:30.495248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ee9256b6-bd1d-4154-a840-c00c4e675897 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:30.508528 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ee9256b6-bd1d-4154-a840-c00c4e675897 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1318 microversion: 2.1 time: 0.251623 Jul 20 04:49:30.521454 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3185/6356] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:30 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:30.653187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a065ae26-b10d-4625-a365-50fcdb10825e req-a3d6b4cf-2fe1-47f3-9e88-eec83f527043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204539d6-86ac-48ec-9581-90c974ec4316", "name": "network-vif-plugged", "status": "completed", "tag": "e4ba3dcb-5b38-4785-b1c7-0f38568fcdca"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:30.667200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a065ae26-b10d-4625-a365-50fcdb10825e req-a3d6b4cf-2fe1-47f3-9e88-eec83f527043 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:30.668820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a065ae26-b10d-4625-a365-50fcdb10825e req-a3d6b4cf-2fe1-47f3-9e88-eec83f527043 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.682183 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a065ae26-b10d-4625-a365-50fcdb10825e req-a3d6b4cf-2fe1-47f3-9e88-eec83f527043 service nova] Creating event network-vif-plugged:e4ba3dcb-5b38-4785-b1c7-0f38568fcdca for instance 204539d6-86ac-48ec-9581-90c974ec4316 on n-h1-760456-11 Jul 20 04:49:30.688720 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a065ae26-b10d-4625-a365-50fcdb10825e req-a3d6b4cf-2fe1-47f3-9e88-eec83f527043 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209587 Jul 20 04:49:30.689899 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3172/6357] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:49:31.526309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f340816-9805-4bf6-87bc-66c2edaa3956 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:31.526974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9f340816-9805-4bf6-87bc-66c2edaa3956 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:31.535735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f340816-9805-4bf6-87bc-66c2edaa3956 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:31.536328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f340816-9805-4bf6-87bc-66c2edaa3956 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:31.537350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f340816-9805-4bf6-87bc-66c2edaa3956 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:31.538024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f340816-9805-4bf6-87bc-66c2edaa3956 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:31.695008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9f340816-9805-4bf6-87bc-66c2edaa3956 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:31.709161 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f340816-9805-4bf6-87bc-66c2edaa3956 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1318 microversion: 2.1 time: 0.186835 Jul 20 04:49:31.710423 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3186/6358] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:31 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:32.728324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-93c8ff63-21b2-466a-b1a9-5d2ef7b05d72 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:32.729061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-93c8ff63-21b2-466a-b1a9-5d2ef7b05d72 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:32.737002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93c8ff63-21b2-466a-b1a9-5d2ef7b05d72 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:32.737750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93c8ff63-21b2-466a-b1a9-5d2ef7b05d72 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:32.739270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93c8ff63-21b2-466a-b1a9-5d2ef7b05d72 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:32.739744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93c8ff63-21b2-466a-b1a9-5d2ef7b05d72 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:32.927025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-93c8ff63-21b2-466a-b1a9-5d2ef7b05d72 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:32.936906 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-93c8ff63-21b2-466a-b1a9-5d2ef7b05d72 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1507 microversion: 2.1 time: 0.213796 Jul 20 04:49:32.937551 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3173/6359] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:32 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:32.955111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4dfaf177-8fd7-409c-86fd-205ef4a0b09e tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da2cb9da-8e75-43f8-aa49-2eb2b658f2f9", "device": "/dev/sdb"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:32.956325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4dfaf177-8fd7-409c-86fd-205ef4a0b09e tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:32.963866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dfaf177-8fd7-409c-86fd-205ef4a0b09e tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:32.964386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dfaf177-8fd7-409c-86fd-205ef4a0b09e tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:32.965208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dfaf177-8fd7-409c-86fd-205ef4a0b09e tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:32.965693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dfaf177-8fd7-409c-86fd-205ef4a0b09e tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.253952 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4dfaf177-8fd7-409c-86fd-205ef4a0b09e tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "POST /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303737 Jul 20 04:49:33.255751 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3187/6360] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 04:49:32 2022] POST /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:56.355136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3bf0608d-687d-4be5-b392-2c50f4b2fb5c tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:56.356143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3bf0608d-687d-4be5-b392-2c50f4b2fb5c tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:56.360326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:56.364401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=32 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:56.374829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bf0608d-687d-4be5-b392-2c50f4b2fb5c tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:56.375315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bf0608d-687d-4be5-b392-2c50f4b2fb5c tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:56.376130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bf0608d-687d-4be5-b392-2c50f4b2fb5c tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:56.376590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bf0608d-687d-4be5-b392-2c50f4b2fb5c tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:56.476551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-3bf0608d-687d-4be5-b392-2c50f4b2fb5c tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lazy-loading 'services' on Instance uuid 204539d6-86ac-48ec-9581-90c974ec4316 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:49:56.574407 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3bf0608d-687d-4be5-b392-2c50f4b2fb5c tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "DELETE /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316/os-volume_attachments/da2cb9da-8e75-43f8-aa49-2eb2b658f2f9" status: 202 len: 0 microversion: 2.1 time: 0.224157 Jul 20 04:49:56.579210 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3174/6361] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 04:49:56 2022] DELETE /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316/os-volume_attachments/da2cb9da-8e75-43f8-aa49-2eb2b658f2f9 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:50:03.329999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:03.331707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:03.338062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94c13556-9da4-49e9-82ef-002705c86423 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:03.338717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-94c13556-9da4-49e9-82ef-002705c86423 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:03.351043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94c13556-9da4-49e9-82ef-002705c86423 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.352104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94c13556-9da4-49e9-82ef-002705c86423 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.361860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94c13556-9da4-49e9-82ef-002705c86423 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.363051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94c13556-9da4-49e9-82ef-002705c86423 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.417795 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-94c13556-9da4-49e9-82ef-002705c86423 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:50:03.567187 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94c13556-9da4-49e9-82ef-002705c86423 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "DELETE /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 204 len: 0 microversion: 2.1 time: 0.239505 Jul 20 04:50:03.568749 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3188/6362] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:50:03 2022] DELETE /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:50:03.579348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-96c0d0f3-af36-4a1c-bda3-4946865564d8 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:03.580673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-96c0d0f3-af36-4a1c-bda3-4946865564d8 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:03.593162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-96c0d0f3-af36-4a1c-bda3-4946865564d8 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.593386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-96c0d0f3-af36-4a1c-bda3-4946865564d8 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.594677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-96c0d0f3-af36-4a1c-bda3-4946865564d8 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.595546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-96c0d0f3-af36-4a1c-bda3-4946865564d8 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.831898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-96c0d0f3-af36-4a1c-bda3-4946865564d8 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:03.850087 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-96c0d0f3-af36-4a1c-bda3-4946865564d8 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1513 microversion: 2.1 time: 0.275388 Jul 20 04:50:03.851560 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3175/6363] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:03 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:04.870553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aa475683-106a-4c1e-99df-90521d2dc7e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:04.872328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aa475683-106a-4c1e-99df-90521d2dc7e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:04.884039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa475683-106a-4c1e-99df-90521d2dc7e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:04.884308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa475683-106a-4c1e-99df-90521d2dc7e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:04.885122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa475683-106a-4c1e-99df-90521d2dc7e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:04.885811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aa475683-106a-4c1e-99df-90521d2dc7e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:05.251560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aa475683-106a-4c1e-99df-90521d2dc7e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:05.261025 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aa475683-106a-4c1e-99df-90521d2dc7e5 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1513 microversion: 2.1 time: 0.395184 Jul 20 04:50:05.277090 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3189/6364] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:04 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1513 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:06.279558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d57d958-5718-4ce1-a2c2-5e66c7c0fa99 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:06.280320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d57d958-5718-4ce1-a2c2-5e66c7c0fa99 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:06.287875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d57d958-5718-4ce1-a2c2-5e66c7c0fa99 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:06.288350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d57d958-5718-4ce1-a2c2-5e66c7c0fa99 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:06.289161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d57d958-5718-4ce1-a2c2-5e66c7c0fa99 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:06.289611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d57d958-5718-4ce1-a2c2-5e66c7c0fa99 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:06.564151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d57d958-5718-4ce1-a2c2-5e66c7c0fa99 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7971fe4e0c4457eaa0c727c60a610de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ceba3691ac48b5b8f8e9916c733a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:06.611515 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d57d958-5718-4ce1-a2c2-5e66c7c0fa99 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 200 len: 1513 microversion: 2.1 time: 0.334651 Jul 20 04:50:06.637921 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3176/6365] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:06 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:06.702663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b063461a-4f31-4bab-9929-fa71c965dad5 req-4d0d22be-5054-4cd0-b994-1670b97169db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204539d6-86ac-48ec-9581-90c974ec4316", "name": "network-vif-deleted", "tag": "e4ba3dcb-5b38-4785-b1c7-0f38568fcdca"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:06.713778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b063461a-4f31-4bab-9929-fa71c965dad5 req-4d0d22be-5054-4cd0-b994-1670b97169db service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:06.714669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b063461a-4f31-4bab-9929-fa71c965dad5 req-4d0d22be-5054-4cd0-b994-1670b97169db service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:06.729252 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b063461a-4f31-4bab-9929-fa71c965dad5 req-4d0d22be-5054-4cd0-b994-1670b97169db service nova] Creating event network-vif-deleted:e4ba3dcb-5b38-4785-b1c7-0f38568fcdca for instance 204539d6-86ac-48ec-9581-90c974ec4316 on n-h1-760456-11 Jul 20 04:50:06.745970 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b063461a-4f31-4bab-9929-fa71c965dad5 req-4d0d22be-5054-4cd0-b994-1670b97169db service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048703 Jul 20 04:50:06.747259 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3190/6366] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:07.668368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89667dc0-3f48-41ff-b976-d6520160cfc7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:07.672668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-89667dc0-3f48-41ff-b976-d6520160cfc7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] [instance: 204539d6-86ac-48ec-9581-90c974ec4316] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:07.685642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89667dc0-3f48-41ff-b976-d6520160cfc7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:07.687076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89667dc0-3f48-41ff-b976-d6520160cfc7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:07.687958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89667dc0-3f48-41ff-b976-d6520160cfc7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:07.688415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89667dc0-3f48-41ff-b976-d6520160cfc7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:07.707468 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-89667dc0-3f48-41ff-b976-d6520160cfc7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] HTTP exception thrown: Instance 204539d6-86ac-48ec-9581-90c974ec4316 could not be found. Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89667dc0-3f48-41ff-b976-d6520160cfc7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Request method failure captured: Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 HTTP/1.1 Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14jDqoWPjWim82aLSdTgclGIaXUiAmgjRWOO5Ouebsu7JolrG7fhzBH8qFEagL5JboEI53hwUY6cJcvWnRZdzwZcIVCEo7Um9hR-PJ6VTfwl1mA_OHyR9Vygjt4Hg9yCvREnpzRW-CeihywNtX7kUHba9nHG7cF31htNAwzl_qhEvX0 Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b0ceba3691ac48b5b8f8e9916c733a68 Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesSnapshotTestJSON-227171180 Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b0ceba3691ac48b5b8f8e9916c733a68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0ceba3691ac48b5b8f8e9916c733a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0ceba3691ac48b5b8f8e9916c733a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b0ceba3691ac48b5b8f8e9916c733a68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesSnapshotTestJSON-227171180 Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b0ceba3691ac48b5b8f8e9916c733a68 Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-227171180 Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesSnapshotTestJSON-227171180-project Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e7971fe4e0c4457eaa0c727c60a610de Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesSnapshotTestJSON-227171180-project Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 204539d6-86ac-48ec-9581-90c974ec4316 could not be found. Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '204539d6-86ac-48ec-9581-90c974ec4316'} Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 204539d6-86ac-48ec-9581-90c974ec4316 could not be found. Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 204539d6-86ac-48ec-9581-90c974ec4316 could not be found. Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:07.709755 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:50:07.714836 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:07.714836 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:07.714836 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:07.714836 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:50:07.714836 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:50:07.714836 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 204539d6-86ac-48ec-9581-90c974ec4316 could not be found. Jul 20 04:50:07.714836 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:50:07.716457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89667dc0-3f48-41ff-b976-d6520160cfc7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] Returning 404 to user: Instance 204539d6-86ac-48ec-9581-90c974ec4316 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:50:07.717822 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89667dc0-3f48-41ff-b976-d6520160cfc7 tempest-VolumesSnapshotTestJSON-227171180 tempest-VolumesSnapshotTestJSON-227171180-project] 10.222.0.59 "GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316" status: 404 len: 111 microversion: 2.1 time: 0.071727 Jul 20 04:50:07.722391 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3177/6367] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:07 2022] GET /compute/v2.1/servers/204539d6-86ac-48ec-9581-90c974ec4316 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:50:08.474468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1552558503", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-834958577", "security_groups": [{"name": "tempest-secgroup-smoke-1582677957"}], "block_device_mapping_v2": [{"uuid": "7d06caf9-4c63-400d-b9d2-afcb7cbe4884", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff98390c-0468-4cc8-9649-ee7fac3db692"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:08.657200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] validate_networks() for [('ff98390c-0468-4cc8-9649-ee7fac3db692', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:50:09.174783 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:50:09.175328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:50:09.175915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:50:09.176438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:50:09.176962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:50:09.193199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:09.193976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:09.195096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:09.196049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:09.220840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:50:09.227108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Getting quotas for user f1067c18d4074c78a512d89e07141915 and project ddf178a8537f486682d29fa0d175b943. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:50:09.297389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:50:09.299746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d06caf9-4c63-400d-b9d2-afcb7cbe4884',volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:50:09.461591 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e58ab86d-552d-4a02-88a1-4c779627ce47 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.994600 Jul 20 04:50:09.468044 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3191/6368] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:50:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:50:09.472579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e4e1033e-63f9-48d7-bcef-14324188369a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:09.473279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e4e1033e-63f9-48d7-bcef-14324188369a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:09.570031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e4e1033e-63f9-48d7-bcef-14324188369a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:09.587121 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e4e1033e-63f9-48d7-bcef-14324188369a tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1094 microversion: 2.1 time: 0.118522 Jul 20 04:50:09.588037 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3178/6369] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:09 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1094 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:10.610527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-092846fb-049b-480e-b008-f0c060a3b1f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:10.612337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-092846fb-049b-480e-b008-f0c060a3b1f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:10.634781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-092846fb-049b-480e-b008-f0c060a3b1f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:10.635604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-092846fb-049b-480e-b008-f0c060a3b1f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:10.636754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-092846fb-049b-480e-b008-f0c060a3b1f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:10.637443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-092846fb-049b-480e-b008-f0c060a3b1f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:10.793900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-092846fb-049b-480e-b008-f0c060a3b1f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:10.809556 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-092846fb-049b-480e-b008-f0c060a3b1f2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1200 microversion: 2.1 time: 0.205672 Jul 20 04:50:10.810163 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3192/6370] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:10 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1200 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:11.828374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a4303037-f690-4d43-acdb-80c8d62617ae tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:11.829008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a4303037-f690-4d43-acdb-80c8d62617ae tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:11.838567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4303037-f690-4d43-acdb-80c8d62617ae tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.843937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4303037-f690-4d43-acdb-80c8d62617ae tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:11.845106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4303037-f690-4d43-acdb-80c8d62617ae tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.845733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a4303037-f690-4d43-acdb-80c8d62617ae tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.014926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a4303037-f690-4d43-acdb-80c8d62617ae tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:12.037090 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a4303037-f690-4d43-acdb-80c8d62617ae tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1210 microversion: 2.1 time: 0.211577 Jul 20 04:50:12.039149 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3179/6371] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:11 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1210 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:13.056550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0d49949-7136-4bab-b9c7-b4a61e150804 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:13.057356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0d49949-7136-4bab-b9c7-b4a61e150804 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:13.067459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0d49949-7136-4bab-b9c7-b4a61e150804 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:13.069737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0d49949-7136-4bab-b9c7-b4a61e150804 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:13.076022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0d49949-7136-4bab-b9c7-b4a61e150804 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:13.076838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0d49949-7136-4bab-b9c7-b4a61e150804 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:13.384743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a0d49949-7136-4bab-b9c7-b4a61e150804 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:13.407795 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0d49949-7136-4bab-b9c7-b4a61e150804 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1278 microversion: 2.1 time: 0.353485 Jul 20 04:50:13.409174 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3193/6372] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:13 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1278 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:13.560778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-90be2316-c8d1-4f6d-8cd3-87ff225bb94d req-d03339f2-0d32-467e-abab-24840de73508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f63512-b53a-4bef-afe5-83412d180814", "tag": "319adfd4-609d-4eeb-a320-0836f1069c64"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:13.594527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-90be2316-c8d1-4f6d-8cd3-87ff225bb94d req-d03339f2-0d32-467e-abab-24840de73508 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:13.594994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-90be2316-c8d1-4f6d-8cd3-87ff225bb94d req-d03339f2-0d32-467e-abab-24840de73508 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:13.640343 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-90be2316-c8d1-4f6d-8cd3-87ff225bb94d req-d03339f2-0d32-467e-abab-24840de73508 service nova] Creating event network-changed:319adfd4-609d-4eeb-a320-0836f1069c64 for instance 51f63512-b53a-4bef-afe5-83412d180814 on n-h1-760456-11 Jul 20 04:50:13.647005 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-90be2316-c8d1-4f6d-8cd3-87ff225bb94d req-d03339f2-0d32-467e-abab-24840de73508 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091420 Jul 20 04:50:13.648171 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3180/6373] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:14.426114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2fa26c74-424e-4ca6-abf7-742d3d6cc1ef tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:14.426902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2fa26c74-424e-4ca6-abf7-742d3d6cc1ef tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:14.443882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fa26c74-424e-4ca6-abf7-742d3d6cc1ef tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:14.444356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fa26c74-424e-4ca6-abf7-742d3d6cc1ef tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:14.445197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fa26c74-424e-4ca6-abf7-742d3d6cc1ef tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:14.445735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fa26c74-424e-4ca6-abf7-742d3d6cc1ef tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:14.903712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2fa26c74-424e-4ca6-abf7-742d3d6cc1ef tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:14.914848 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2fa26c74-424e-4ca6-abf7-742d3d6cc1ef tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1278 microversion: 2.1 time: 0.493102 Jul 20 04:50:14.915788 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3194/6374] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:14 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1278 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:15.935860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-799d1c28-9332-4e9d-a29c-e03b75ab73f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:15.938622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-799d1c28-9332-4e9d-a29c-e03b75ab73f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:15.951525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-799d1c28-9332-4e9d-a29c-e03b75ab73f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:15.952539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-799d1c28-9332-4e9d-a29c-e03b75ab73f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:15.953596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-799d1c28-9332-4e9d-a29c-e03b75ab73f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:15.954230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-799d1c28-9332-4e9d-a29c-e03b75ab73f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:16.305827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-799d1c28-9332-4e9d-a29c-e03b75ab73f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:16.323204 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-799d1c28-9332-4e9d-a29c-e03b75ab73f3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1278 microversion: 2.1 time: 0.394062 Jul 20 04:50:16.330412 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3181/6375] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:15 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1278 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:17.350301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f38c356f-88f7-4b02-88df-3ed7bb804ddc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:17.352605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f38c356f-88f7-4b02-88df-3ed7bb804ddc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:17.368994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f38c356f-88f7-4b02-88df-3ed7bb804ddc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:17.369712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f38c356f-88f7-4b02-88df-3ed7bb804ddc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:17.370569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f38c356f-88f7-4b02-88df-3ed7bb804ddc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:17.371005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f38c356f-88f7-4b02-88df-3ed7bb804ddc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:17.591348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f38c356f-88f7-4b02-88df-3ed7bb804ddc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:17.601610 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f38c356f-88f7-4b02-88df-3ed7bb804ddc tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1278 microversion: 2.1 time: 0.255289 Jul 20 04:50:17.603035 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3195/6376] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:17 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:18.699448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b0ed192-c411-4d9c-9cca-01aa3e3efdd9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:18.700096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6b0ed192-c411-4d9c-9cca-01aa3e3efdd9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:18.710093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b0ed192-c411-4d9c-9cca-01aa3e3efdd9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:18.710603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b0ed192-c411-4d9c-9cca-01aa3e3efdd9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:18.711399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b0ed192-c411-4d9c-9cca-01aa3e3efdd9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:18.713773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b0ed192-c411-4d9c-9cca-01aa3e3efdd9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:18.970228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6b0ed192-c411-4d9c-9cca-01aa3e3efdd9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:18.979237 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b0ed192-c411-4d9c-9cca-01aa3e3efdd9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1266 microversion: 2.1 time: 0.363720 Jul 20 04:50:18.988167 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3182/6377] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:18 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1266 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:19.998630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-854782bd-a361-4fe1-b5bf-e54498ebe162 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:20.000167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-854782bd-a361-4fe1-b5bf-e54498ebe162 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:20.007729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:20.009180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:20.012187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-854782bd-a361-4fe1-b5bf-e54498ebe162 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:20.013101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-854782bd-a361-4fe1-b5bf-e54498ebe162 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:20.015890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-854782bd-a361-4fe1-b5bf-e54498ebe162 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:20.016662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-854782bd-a361-4fe1-b5bf-e54498ebe162 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:20.265674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-854782bd-a361-4fe1-b5bf-e54498ebe162 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:20.278109 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-854782bd-a361-4fe1-b5bf-e54498ebe162 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1266 microversion: 2.1 time: 0.283845 Jul 20 04:50:20.280126 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3196/6378] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:19 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:20.548555 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:50:20.549137 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 04:50:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:50:21.296655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ce60b9df-a5f2-4770-9400-0e62195ebef6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:21.297549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ce60b9df-a5f2-4770-9400-0e62195ebef6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:21.300996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:21.307673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce60b9df-a5f2-4770-9400-0e62195ebef6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:21.308466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce60b9df-a5f2-4770-9400-0e62195ebef6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:21.309322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce60b9df-a5f2-4770-9400-0e62195ebef6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:21.309953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce60b9df-a5f2-4770-9400-0e62195ebef6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:21.493490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ce60b9df-a5f2-4770-9400-0e62195ebef6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:21.505827 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ce60b9df-a5f2-4770-9400-0e62195ebef6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1266 microversion: 2.1 time: 0.212726 Jul 20 04:50:21.516925 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3183/6379] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:21 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:22.525340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bc439106-c9b5-427e-b3ab-7997c8c77c65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:22.526965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bc439106-c9b5-427e-b3ab-7997c8c77c65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:22.540268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc439106-c9b5-427e-b3ab-7997c8c77c65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:22.543299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc439106-c9b5-427e-b3ab-7997c8c77c65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:22.544472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc439106-c9b5-427e-b3ab-7997c8c77c65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:22.545585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bc439106-c9b5-427e-b3ab-7997c8c77c65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:22.790859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bc439106-c9b5-427e-b3ab-7997c8c77c65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:22.809031 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bc439106-c9b5-427e-b3ab-7997c8c77c65 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1266 microversion: 2.1 time: 0.288880 Jul 20 04:50:22.809808 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3197/6380] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:22 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:23.831695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-079ad51f-6294-4231-b9c3-f3e225cadee3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:23.832334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-079ad51f-6294-4231-b9c3-f3e225cadee3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:23.839543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-079ad51f-6294-4231-b9c3-f3e225cadee3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:23.839965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-079ad51f-6294-4231-b9c3-f3e225cadee3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:23.840765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-079ad51f-6294-4231-b9c3-f3e225cadee3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:23.841224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-079ad51f-6294-4231-b9c3-f3e225cadee3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:23.984725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-079ad51f-6294-4231-b9c3-f3e225cadee3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:23.994771 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-079ad51f-6294-4231-b9c3-f3e225cadee3 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1266 microversion: 2.1 time: 0.166649 Jul 20 04:50:23.995780 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3184/6381] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:23 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:25.012478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a7eab268-733b-4d8a-9abc-416d92b9dc21 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:25.013021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a7eab268-733b-4d8a-9abc-416d92b9dc21 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:25.020693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7eab268-733b-4d8a-9abc-416d92b9dc21 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:25.021163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7eab268-733b-4d8a-9abc-416d92b9dc21 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:25.021958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7eab268-733b-4d8a-9abc-416d92b9dc21 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:25.022440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7eab268-733b-4d8a-9abc-416d92b9dc21 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:25.231147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a7eab268-733b-4d8a-9abc-416d92b9dc21 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:25.239465 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a7eab268-733b-4d8a-9abc-416d92b9dc21 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1266 microversion: 2.1 time: 0.231310 Jul 20 04:50:25.240152 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3198/6382] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:25 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:26.257632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aefe5e19-1788-4264-869a-f51507baf23d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:26.258300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aefe5e19-1788-4264-869a-f51507baf23d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:26.269550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aefe5e19-1788-4264-869a-f51507baf23d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:26.270032 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aefe5e19-1788-4264-869a-f51507baf23d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:26.270874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aefe5e19-1788-4264-869a-f51507baf23d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:26.273281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aefe5e19-1788-4264-869a-f51507baf23d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:26.553207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aefe5e19-1788-4264-869a-f51507baf23d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:26.555502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:26.580817 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aefe5e19-1788-4264-869a-f51507baf23d tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1266 microversion: 2.1 time: 0.327225 Jul 20 04:50:26.582968 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3185/6383] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:26 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:27.598114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e82be59f-cd88-466f-84b6-235d01159cf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:27.598843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e82be59f-cd88-466f-84b6-235d01159cf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:27.606305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e82be59f-cd88-466f-84b6-235d01159cf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:27.607509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e82be59f-cd88-466f-84b6-235d01159cf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:27.609198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e82be59f-cd88-466f-84b6-235d01159cf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:27.609839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e82be59f-cd88-466f-84b6-235d01159cf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:27.768073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e82be59f-cd88-466f-84b6-235d01159cf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:27.775752 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e82be59f-cd88-466f-84b6-235d01159cf1 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1266 microversion: 2.1 time: 0.181493 Jul 20 04:50:27.776907 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3199/6384] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:27 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:28.591126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-03480adc-48cc-4055-900a-9f01339340ef req-e897dc1c-10db-430b-a52b-4ff2f1f23f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f63512-b53a-4bef-afe5-83412d180814", "name": "network-vif-plugged", "status": "completed", "tag": "319adfd4-609d-4eeb-a320-0836f1069c64"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:28.598567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=27 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:28.605790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-03480adc-48cc-4055-900a-9f01339340ef req-e897dc1c-10db-430b-a52b-4ff2f1f23f3d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.606449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-03480adc-48cc-4055-900a-9f01339340ef req-e897dc1c-10db-430b-a52b-4ff2f1f23f3d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.620196 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-03480adc-48cc-4055-900a-9f01339340ef req-e897dc1c-10db-430b-a52b-4ff2f1f23f3d service nova] Creating event network-vif-plugged:319adfd4-609d-4eeb-a320-0836f1069c64 for instance 51f63512-b53a-4bef-afe5-83412d180814 on n-h1-760456-11 Jul 20 04:50:28.626762 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-03480adc-48cc-4055-900a-9f01339340ef req-e897dc1c-10db-430b-a52b-4ff2f1f23f3d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042032 Jul 20 04:50:28.627541 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3186/6385] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:28.796929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-61335a75-dd20-4659-9e1d-1cf86dbcdb88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:28.797916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-61335a75-dd20-4659-9e1d-1cf86dbcdb88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:28.807186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-61335a75-dd20-4659-9e1d-1cf86dbcdb88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.808245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-61335a75-dd20-4659-9e1d-1cf86dbcdb88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.809396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-61335a75-dd20-4659-9e1d-1cf86dbcdb88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:28.810081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-61335a75-dd20-4659-9e1d-1cf86dbcdb88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:29.303185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-61335a75-dd20-4659-9e1d-1cf86dbcdb88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:29.322935 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-61335a75-dd20-4659-9e1d-1cf86dbcdb88 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1266 microversion: 2.1 time: 0.531454 Jul 20 04:50:29.326967 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3200/6386] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:28 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1266 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:30.346712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2c070964-9f03-4df3-8baa-7549894833e0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:30.348001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2c070964-9f03-4df3-8baa-7549894833e0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:30.369660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c070964-9f03-4df3-8baa-7549894833e0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:30.372070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c070964-9f03-4df3-8baa-7549894833e0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:30.373170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c070964-9f03-4df3-8baa-7549894833e0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:30.373601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c070964-9f03-4df3-8baa-7549894833e0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:30.560069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2c070964-9f03-4df3-8baa-7549894833e0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:30.568948 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2c070964-9f03-4df3-8baa-7549894833e0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1266 microversion: 2.1 time: 0.229099 Jul 20 04:50:30.569696 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3187/6387] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:30 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:31.586299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7fa16e66-d7e1-46b1-ab2d-d4eff862d85f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:31.586828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7fa16e66-d7e1-46b1-ab2d-d4eff862d85f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:31.599256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fa16e66-d7e1-46b1-ab2d-d4eff862d85f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:31.600049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fa16e66-d7e1-46b1-ab2d-d4eff862d85f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:31.603617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fa16e66-d7e1-46b1-ab2d-d4eff862d85f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:31.604569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fa16e66-d7e1-46b1-ab2d-d4eff862d85f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:31.853077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7fa16e66-d7e1-46b1-ab2d-d4eff862d85f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:31.862633 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7fa16e66-d7e1-46b1-ab2d-d4eff862d85f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1454 microversion: 2.1 time: 0.280199 Jul 20 04:50:31.863966 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3201/6388] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:31 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1454 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:31.880307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e30e379d-f7fe-4719-a676-19e479cc8aa2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:31.880945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e30e379d-f7fe-4719-a676-19e479cc8aa2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:31.889246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e30e379d-f7fe-4719-a676-19e479cc8aa2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:31.889732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e30e379d-f7fe-4719-a676-19e479cc8aa2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:31.890620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e30e379d-f7fe-4719-a676-19e479cc8aa2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:31.891298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e30e379d-f7fe-4719-a676-19e479cc8aa2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:32.047587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e30e379d-f7fe-4719-a676-19e479cc8aa2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:32.055743 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e30e379d-f7fe-4719-a676-19e479cc8aa2 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1454 microversion: 2.1 time: 0.179333 Jul 20 04:50:32.056941 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3188/6389] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:31 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:35.329583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4fd5590c-1681-45d1-ac3f-4af6aa68aa59 req-a57914ca-6fd5-4b3c-b0df-7ad2a55b2630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f63512-b53a-4bef-afe5-83412d180814", "tag": "319adfd4-609d-4eeb-a320-0836f1069c64"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:35.333380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:35.349153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4fd5590c-1681-45d1-ac3f-4af6aa68aa59 req-a57914ca-6fd5-4b3c-b0df-7ad2a55b2630 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:35.349927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4fd5590c-1681-45d1-ac3f-4af6aa68aa59 req-a57914ca-6fd5-4b3c-b0df-7ad2a55b2630 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:35.355246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:35.369138 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4fd5590c-1681-45d1-ac3f-4af6aa68aa59 req-a57914ca-6fd5-4b3c-b0df-7ad2a55b2630 service nova] Creating event network-changed:319adfd4-609d-4eeb-a320-0836f1069c64 for instance 51f63512-b53a-4bef-afe5-83412d180814 on n-h1-760456-11 Jul 20 04:50:35.377002 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4fd5590c-1681-45d1-ac3f-4af6aa68aa59 req-a57914ca-6fd5-4b3c-b0df-7ad2a55b2630 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252943 Jul 20 04:50:35.378169 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3202/6390] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:45.812625 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:50:45.813333 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 04:50:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:51:33.729038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=5 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:33.730190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=15 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:33.868738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e83abf38-286e-4fa0-8e87-deeb7e356464 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-578521233", "availability_zone": "foo_zone"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:33.871074 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:33.871074 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:51:33.872019 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.aggregate [None req-e83abf38-286e-4fa0-8e87-deeb7e356464 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Generated uuid ba166561-e2b6-450b-9050-5d512c4cf3d1 for aggregate {{(pid=119605) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:51:33.901490 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e83abf38-286e-4fa0-8e87-deeb7e356464 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] [7ba94ed2-cf1b-4861-bf6b-3cd08e35f9b7] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 04:51:34.911941 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [None req-e83abf38-286e-4fa0-8e87-deeb7e356464 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] [7ba94ed2-cf1b-4861-bf6b-3cd08e35f9b7] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 44136. Jul 20 04:51:34.917922 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e83abf38-286e-4fa0-8e87-deeb7e356464 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.191581 Jul 20 04:51:34.919364 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3189/6391] 10.222.0.59 () {60 vars in 1163 bytes} [Wed Jul 20 04:51:33 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:34.932488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d8efce4-2825-4bc9-a6dd-0b7db839cca4 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:34.938369 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:34.938369 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:51:34.971050 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d8efce4-2825-4bc9-a6dd-0b7db839cca4 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.045583 Jul 20 04:51:34.977114 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3203/6392] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:51:34 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:34.982146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea529d55-fb84-46ee-98ca-7a65a93a00b1 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:34.985046 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:34.985046 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:51:34.986694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea529d55-fb84-46ee-98ca-7a65a93a00b1 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:34.987601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea529d55-fb84-46ee-98ca-7a65a93a00b1 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:34.989312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea529d55-fb84-46ee-98ca-7a65a93a00b1 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:34.989770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea529d55-fb84-46ee-98ca-7a65a93a00b1 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:35.020915 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ea529d55-fb84-46ee-98ca-7a65a93a00b1 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.042688 Jul 20 04:51:35.021538 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3190/6393] 10.222.0.59 () {58 vars in 1175 bytes} [Wed Jul 20 04:51:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:35.038116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7838e76d-b2a2-4e40-add4-f142740ab98e tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:35.038972 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:35.038972 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:51:35.048783 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7838e76d-b2a2-4e40-add4-f142740ab98e tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.019868 Jul 20 04:51:35.049297 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3204/6394] 10.222.0.59 () {58 vars in 1142 bytes} [Wed Jul 20 04:51:35 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:35.060708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ab06a4a-ef6b-4185-959b-c94d7f24f3f2 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-760456-11"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:35.061981 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:35.061981 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:51:35.070325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ab06a4a-ef6b-4185-959b-c94d7f24f3f2 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:35.070966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ab06a4a-ef6b-4185-959b-c94d7f24f3f2 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:35.355373 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ab06a4a-ef6b-4185-959b-c94d7f24f3f2 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.299516 Jul 20 04:51:35.356092 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3191/6395] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:51:35 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:35.374442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72b424ec-b9da-47d1-87c0-3f73f846692a tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:35.375253 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:35.375253 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:51:35.383791 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72b424ec-b9da-47d1-87c0-3f73f846692a tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.018000 Jul 20 04:51:35.384529 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3205/6396] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:51:35 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:35.396147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-810acc60-1b59-4fa7-8dbe-e8c609fdf8bc tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-735494487", "availability_zone": "foo_zone"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:35.476946 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:35.476946 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:51:35.530818 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-810acc60-1b59-4fa7-8dbe-e8c609fdf8bc tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.138849 Jul 20 04:51:35.532243 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3192/6397] 10.222.0.59 () {60 vars in 1172 bytes} [Wed Jul 20 04:51:35 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:35.545861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-717ad823-e0a2-4e96-b7ed-7cdaae22364d tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:35.547303 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:35.547303 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:51:35.576965 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-717ad823-e0a2-4e96-b7ed-7cdaae22364d tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.038238 Jul 20 04:51:35.578217 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3206/6398] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:51:35 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:35.588063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f5dbafd1-8777-4bb2-b0dc-8e188d5d654a tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:35.590601 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:35.590601 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:51:35.599373 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f5dbafd1-8777-4bb2-b0dc-8e188d5d654a tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.015135 Jul 20 04:51:35.599953 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3193/6399] 10.222.0.59 () {58 vars in 1151 bytes} [Wed Jul 20 04:51:35 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:35.615724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5be9de93-0618-4ef9-a57e-d1b9256cc5cf tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-760456-11"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:35.616995 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:35.616995 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 04:51:35.629125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5be9de93-0618-4ef9-a57e-d1b9256cc5cf tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:35.629472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5be9de93-0618-4ef9-a57e-d1b9256cc5cf tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:35.861971 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5be9de93-0618-4ef9-a57e-d1b9256cc5cf tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.254541 Jul 20 04:51:35.863553 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3207/6400] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Jul 20 04:51:35 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:35.877191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4e9ded10-7efb-4668-9b4d-255bd28814f3 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:35.879162 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:35.879162 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 04:51:35.908257 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4e9ded10-7efb-4668-9b4d-255bd28814f3 tempest-TestAggregatesBasicOps-35247337 tempest-TestAggregatesBasicOps-35247337-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.035479 Jul 20 04:51:35.909129 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3194/6401] 10.222.0.59 () {58 vars in 1154 bytes} [Wed Jul 20 04:51:35 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:51:53.362234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=5 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:53.363028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:53.368372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c36cf38d-759e-467e-b93f-55741c998764 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Action: 'create', calling method: .version_select at 0x7fb8421f1940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1784688683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqpngHWf/U5ydWR69JhrPKhYO/bk6BuW/uUP4+ONqB6FeTLtjCpYEd9v4ASCOiv+PQ0+xefuTKpQKlI9YpZDMDArmUvAPgvIdLez94JCuRvylc9Dl6M2Sl3DW8+FS6goA=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:53.425215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-c36cf38d-759e-467e-b93f-55741c998764 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:53.444563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-c36cf38d-759e-467e-b93f-55741c998764 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for user 1cebf52f619044e689d7c74258944ddf and project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:53.501077 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c36cf38d-759e-467e-b93f-55741c998764 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.138056 Jul 20 04:51:53.503057 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3208/6402] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:51:53 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:54.975882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2135951982", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "f657cd46-267b-4331-9cff-17cd314f4fff"}], "key_name": "tempest-TestNetworkBasicOps-1784688683", "security_groups": [{"name": "tempest-secgroup-smoke-717995364"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:54.987711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:54.989107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:54.990107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:55.135805 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] validate_networks() for [('f657cd46-267b-4331-9cff-17cd314f4fff', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:51:55.568513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1407594961", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:55.626957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] validate_networks() for None {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:51:55.676066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:51:55.676510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:51:55.677011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:51:55.677443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:51:55.677876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:51:55.690106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.690923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.691759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.692220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.711397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:55.717998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for user 1cebf52f619044e689d7c74258944ddf and project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:55.732200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:51:55.734582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:51:55.789482 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f71ed52d-58c1-4460-ac0b-b420ae984d35 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.818028 Jul 20 04:51:55.790694 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3195/6403] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:51:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:51:55.800536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a9eb1b84-798e-4ea4-9523-58861290d1e9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:55.801344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a9eb1b84-798e-4ea4-9523-58861290d1e9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:55.862358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a9eb1b84-798e-4ea4-9523-58861290d1e9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:55.871553 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a9eb1b84-798e-4ea4-9523-58861290d1e9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1249 microversion: 2.1 time: 0.074980 Jul 20 04:51:55.872634 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3196/6404] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:55 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:55.970270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:51:55.970748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:51:55.971228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:51:55.971639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:51:55.972055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:51:55.982212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.982700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.983537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.984000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:56.003318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Getting quotas for project f4e725185a5b4c538dc503e7859d948e. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:56.009358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Getting quotas for user 8bad8702d8854106b511d752fd6ebfef and project f4e725185a5b4c538dc503e7859d948e. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:56.022623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:51:56.024969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:51:56.072168 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-602a45ab-da27-4f33-9692-06001f8a1aab tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507560 Jul 20 04:51:56.073300 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3209/6405] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:51:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:51:56.083558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d741830-d2f4-49a7-aa7e-70d0a38e8142 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:56.084570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d741830-d2f4-49a7-aa7e-70d0a38e8142 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:56.156275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d741830-d2f4-49a7-aa7e-70d0a38e8142 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:56.163089 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d741830-d2f4-49a7-aa7e-70d0a38e8142 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1215 microversion: 2.1 time: 0.083660 Jul 20 04:51:56.163667 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3197/6406] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:56 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:56.889641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-392ddf06-676b-49e8-8173-0c9f8bae37e5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:56.890275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-392ddf06-676b-49e8-8173-0c9f8bae37e5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:56.948902 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-392ddf06-676b-49e8-8173-0c9f8bae37e5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:56.955910 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-392ddf06-676b-49e8-8173-0c9f8bae37e5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1249 microversion: 2.1 time: 0.070950 Jul 20 04:51:56.956490 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3210/6407] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:56 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1249 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:57.181033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e9271ee9-0950-4331-928a-65aa75aea213 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:57.181632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e9271ee9-0950-4331-928a-65aa75aea213 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:57.237021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e9271ee9-0950-4331-928a-65aa75aea213 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:57.244178 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e9271ee9-0950-4331-928a-65aa75aea213 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1215 microversion: 2.1 time: 0.066944 Jul 20 04:51:57.245431 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3198/6408] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:57 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:57.973319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9c645c85-7be9-4d48-ad8b-17776b01fc7d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:57.973942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9c645c85-7be9-4d48-ad8b-17776b01fc7d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:57.981760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c645c85-7be9-4d48-ad8b-17776b01fc7d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:57.982227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c645c85-7be9-4d48-ad8b-17776b01fc7d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:57.983028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c645c85-7be9-4d48-ad8b-17776b01fc7d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:57.983477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9c645c85-7be9-4d48-ad8b-17776b01fc7d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:58.044953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9c645c85-7be9-4d48-ad8b-17776b01fc7d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:58.052682 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9c645c85-7be9-4d48-ad8b-17776b01fc7d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1253 microversion: 2.1 time: 0.083275 Jul 20 04:51:58.053269 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3211/6409] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:57 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1253 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:58.261668 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10a51ab3-d336-41ee-b706-e15aad0e6d52 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:58.262488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10a51ab3-d336-41ee-b706-e15aad0e6d52 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:58.319860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10a51ab3-d336-41ee-b706-e15aad0e6d52 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:58.327317 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10a51ab3-d336-41ee-b706-e15aad0e6d52 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1215 microversion: 2.1 time: 0.070241 Jul 20 04:51:58.327894 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3199/6410] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:58 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:59.070632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f68eaaec-4a66-4fb5-a646-df26aa48ed79 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:59.071163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f68eaaec-4a66-4fb5-a646-df26aa48ed79 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:59.078938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f68eaaec-4a66-4fb5-a646-df26aa48ed79 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:59.079395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f68eaaec-4a66-4fb5-a646-df26aa48ed79 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:59.080163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f68eaaec-4a66-4fb5-a646-df26aa48ed79 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:59.080601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f68eaaec-4a66-4fb5-a646-df26aa48ed79 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:59.156432 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f68eaaec-4a66-4fb5-a646-df26aa48ed79 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:59.164493 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f68eaaec-4a66-4fb5-a646-df26aa48ed79 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1307 microversion: 2.1 time: 0.097871 Jul 20 04:51:59.165278 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3212/6411] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:59 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:59.345107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d69a9704-9fb0-4446-ab4e-2af704d39846 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:59.345644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d69a9704-9fb0-4446-ab4e-2af704d39846 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:59.360111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d69a9704-9fb0-4446-ab4e-2af704d39846 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:59.361743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d69a9704-9fb0-4446-ab4e-2af704d39846 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:59.362947 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d69a9704-9fb0-4446-ab4e-2af704d39846 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:59.363755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d69a9704-9fb0-4446-ab4e-2af704d39846 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:59.473459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d69a9704-9fb0-4446-ab4e-2af704d39846 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:59.482555 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d69a9704-9fb0-4446-ab4e-2af704d39846 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1273 microversion: 2.1 time: 0.142597 Jul 20 04:51:59.492188 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3200/6412] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:59 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:00.187901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dcba346c-61ea-4f62-b7d0-d76bc4e0abff tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:00.189153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dcba346c-61ea-4f62-b7d0-d76bc4e0abff tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:00.196474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcba346c-61ea-4f62-b7d0-d76bc4e0abff tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:00.197663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcba346c-61ea-4f62-b7d0-d76bc4e0abff tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:00.198825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcba346c-61ea-4f62-b7d0-d76bc4e0abff tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:00.199461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dcba346c-61ea-4f62-b7d0-d76bc4e0abff tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:00.437515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dcba346c-61ea-4f62-b7d0-d76bc4e0abff tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:00.452759 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dcba346c-61ea-4f62-b7d0-d76bc4e0abff tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1374 microversion: 2.1 time: 0.275451 Jul 20 04:52:00.455418 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3213/6413] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:00 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1374 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:00.505679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b4f2d06f-cf9d-4e97-a9be-40f38d400988 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:00.506461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b4f2d06f-cf9d-4e97-a9be-40f38d400988 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:00.515039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4f2d06f-cf9d-4e97-a9be-40f38d400988 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:00.515799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4f2d06f-cf9d-4e97-a9be-40f38d400988 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:00.516810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4f2d06f-cf9d-4e97-a9be-40f38d400988 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:00.517968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b4f2d06f-cf9d-4e97-a9be-40f38d400988 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:00.678708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-030db356-52bf-4d21-b32c-cafdc9ba3d51 req-0eb3776d-2d25-495b-8599-2a805026b64b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e6bc49-6273-4c78-93c5-95d413c57fb8", "tag": "360aa579-fb9c-4691-afe3-cde8c652baa9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:00.694349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-030db356-52bf-4d21-b32c-cafdc9ba3d51 req-0eb3776d-2d25-495b-8599-2a805026b64b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:00.695075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-030db356-52bf-4d21-b32c-cafdc9ba3d51 req-0eb3776d-2d25-495b-8599-2a805026b64b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:00.719063 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-030db356-52bf-4d21-b32c-cafdc9ba3d51 req-0eb3776d-2d25-495b-8599-2a805026b64b service nova] Creating event network-changed:360aa579-fb9c-4691-afe3-cde8c652baa9 for instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 on n-h2-760456-11 Jul 20 04:52:00.726539 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-030db356-52bf-4d21-b32c-cafdc9ba3d51 req-0eb3776d-2d25-495b-8599-2a805026b64b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050612 Jul 20 04:52:00.727545 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3214/6414] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:00.777890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b4f2d06f-cf9d-4e97-a9be-40f38d400988 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:00.787272 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b4f2d06f-cf9d-4e97-a9be-40f38d400988 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1315 microversion: 2.1 time: 0.290192 Jul 20 04:52:00.788543 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3201/6415] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:00 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:01.097721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a5ee57d5-757c-47dc-b063-6b16eb2de9fa req-908320e7-88d1-4d59-b65f-2f9fb38a8862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d284ac6-ca41-48b0-81ff-d96ce555d634", "tag": "1d8f33bc-0205-4ba5-81bd-c66200666a5a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:01.108077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a5ee57d5-757c-47dc-b063-6b16eb2de9fa req-908320e7-88d1-4d59-b65f-2f9fb38a8862 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:01.108858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a5ee57d5-757c-47dc-b063-6b16eb2de9fa req-908320e7-88d1-4d59-b65f-2f9fb38a8862 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:01.128455 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a5ee57d5-757c-47dc-b063-6b16eb2de9fa req-908320e7-88d1-4d59-b65f-2f9fb38a8862 service nova] Creating event network-changed:1d8f33bc-0205-4ba5-81bd-c66200666a5a for instance 9d284ac6-ca41-48b0-81ff-d96ce555d634 on n-h2-760456-11 Jul 20 04:52:01.138320 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a5ee57d5-757c-47dc-b063-6b16eb2de9fa req-908320e7-88d1-4d59-b65f-2f9fb38a8862 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044924 Jul 20 04:52:01.138961 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3215/6416] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:52:01.472758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-39c7a03f-96fb-4ab8-aec7-e27d0699778c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:01.473404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-39c7a03f-96fb-4ab8-aec7-e27d0699778c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:01.480239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39c7a03f-96fb-4ab8-aec7-e27d0699778c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:01.480696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39c7a03f-96fb-4ab8-aec7-e27d0699778c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:01.481469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39c7a03f-96fb-4ab8-aec7-e27d0699778c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:01.481922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-39c7a03f-96fb-4ab8-aec7-e27d0699778c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:01.616342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-39c7a03f-96fb-4ab8-aec7-e27d0699778c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:01.624858 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-39c7a03f-96fb-4ab8-aec7-e27d0699778c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1374 microversion: 2.1 time: 0.156017 Jul 20 04:52:01.625437 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3202/6417] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:01 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:01.805706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-773ba827-a17e-4720-a114-82ffae1f5b0e tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:01.806397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-773ba827-a17e-4720-a114-82ffae1f5b0e tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:01.813798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-773ba827-a17e-4720-a114-82ffae1f5b0e tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:01.814270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-773ba827-a17e-4720-a114-82ffae1f5b0e tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:01.815058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-773ba827-a17e-4720-a114-82ffae1f5b0e tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:01.815505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-773ba827-a17e-4720-a114-82ffae1f5b0e tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:01.946731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-773ba827-a17e-4720-a114-82ffae1f5b0e tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:01.954789 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-773ba827-a17e-4720-a114-82ffae1f5b0e tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1315 microversion: 2.1 time: 0.153461 Jul 20 04:52:01.955366 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3216/6418] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:01 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:02.641497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1b0778b0-840d-4a61-9c07-2e7f24f19671 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:02.642133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1b0778b0-840d-4a61-9c07-2e7f24f19671 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:02.649130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b0778b0-840d-4a61-9c07-2e7f24f19671 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.649606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b0778b0-840d-4a61-9c07-2e7f24f19671 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:02.650597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b0778b0-840d-4a61-9c07-2e7f24f19671 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.651171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1b0778b0-840d-4a61-9c07-2e7f24f19671 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:02.783674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1b0778b0-840d-4a61-9c07-2e7f24f19671 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:02.791738 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1b0778b0-840d-4a61-9c07-2e7f24f19671 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1374 microversion: 2.1 time: 0.153649 Jul 20 04:52:02.792375 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3203/6419] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:02 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:02.972443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-39b94ca1-2128-4952-ba7d-b64fd55e1243 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:02.973170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-39b94ca1-2128-4952-ba7d-b64fd55e1243 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:02.981342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39b94ca1-2128-4952-ba7d-b64fd55e1243 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.981710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39b94ca1-2128-4952-ba7d-b64fd55e1243 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:02.982721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39b94ca1-2128-4952-ba7d-b64fd55e1243 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.983161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39b94ca1-2128-4952-ba7d-b64fd55e1243 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:03.121733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-39b94ca1-2128-4952-ba7d-b64fd55e1243 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:03.129901 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-39b94ca1-2128-4952-ba7d-b64fd55e1243 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1315 microversion: 2.1 time: 0.160986 Jul 20 04:52:03.139659 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3217/6420] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:02 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:03.808869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-93684ca5-fb07-4bc9-96a7-f94aa034c5be tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:03.809518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-93684ca5-fb07-4bc9-96a7-f94aa034c5be tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:03.816458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93684ca5-fb07-4bc9-96a7-f94aa034c5be tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:03.816927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93684ca5-fb07-4bc9-96a7-f94aa034c5be tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:03.817713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93684ca5-fb07-4bc9-96a7-f94aa034c5be tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:03.818180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-93684ca5-fb07-4bc9-96a7-f94aa034c5be tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:03.961355 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-93684ca5-fb07-4bc9-96a7-f94aa034c5be tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:03.969271 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-93684ca5-fb07-4bc9-96a7-f94aa034c5be tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1374 microversion: 2.1 time: 0.164598 Jul 20 04:52:03.969857 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3204/6421] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:03 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:04.147458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6df29cd8-718c-435c-a1c8-28f44bc8540b tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:04.148079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6df29cd8-718c-435c-a1c8-28f44bc8540b tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:04.155572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6df29cd8-718c-435c-a1c8-28f44bc8540b tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.155967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6df29cd8-718c-435c-a1c8-28f44bc8540b tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.156738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6df29cd8-718c-435c-a1c8-28f44bc8540b tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.157178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6df29cd8-718c-435c-a1c8-28f44bc8540b tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.291380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6df29cd8-718c-435c-a1c8-28f44bc8540b tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:04.305468 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6df29cd8-718c-435c-a1c8-28f44bc8540b tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1315 microversion: 2.1 time: 0.161913 Jul 20 04:52:04.306046 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3218/6422] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:04 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:04.987503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-50532dcc-e9fb-46b4-9064-4af88d5c23d2 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:04.988171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-50532dcc-e9fb-46b4-9064-4af88d5c23d2 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:04.995975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50532dcc-e9fb-46b4-9064-4af88d5c23d2 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.996450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50532dcc-e9fb-46b4-9064-4af88d5c23d2 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.997247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50532dcc-e9fb-46b4-9064-4af88d5c23d2 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.997708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50532dcc-e9fb-46b4-9064-4af88d5c23d2 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:05.135910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-50532dcc-e9fb-46b4-9064-4af88d5c23d2 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:05.143696 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-50532dcc-e9fb-46b4-9064-4af88d5c23d2 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1374 microversion: 2.1 time: 0.160909 Jul 20 04:52:05.144269 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3205/6423] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:04 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:05.263275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-cc54fe4c-7dcf-468e-8e1a-e2f6dd4ab5e3 req-add9b45d-3b3c-445e-a62c-58df81b3f71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e6bc49-6273-4c78-93c5-95d413c57fb8", "name": "network-vif-plugged", "status": "completed", "tag": "360aa579-fb9c-4691-afe3-cde8c652baa9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:05.280155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cc54fe4c-7dcf-468e-8e1a-e2f6dd4ab5e3 req-add9b45d-3b3c-445e-a62c-58df81b3f71b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:05.280998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cc54fe4c-7dcf-468e-8e1a-e2f6dd4ab5e3 req-add9b45d-3b3c-445e-a62c-58df81b3f71b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:05.302452 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-cc54fe4c-7dcf-468e-8e1a-e2f6dd4ab5e3 req-add9b45d-3b3c-445e-a62c-58df81b3f71b service nova] Creating event network-vif-plugged:360aa579-fb9c-4691-afe3-cde8c652baa9 for instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 on n-h2-760456-11 Jul 20 04:52:05.311731 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-cc54fe4c-7dcf-468e-8e1a-e2f6dd4ab5e3 req-add9b45d-3b3c-445e-a62c-58df81b3f71b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056118 Jul 20 04:52:05.312923 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3219/6424] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:05.324326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f3f75ed-cad8-43ce-8b1a-6377d97c7896 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:05.324957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0f3f75ed-cad8-43ce-8b1a-6377d97c7896 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:05.331323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f3f75ed-cad8-43ce-8b1a-6377d97c7896 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:05.332018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f3f75ed-cad8-43ce-8b1a-6377d97c7896 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:05.333000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f3f75ed-cad8-43ce-8b1a-6377d97c7896 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:05.333622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f3f75ed-cad8-43ce-8b1a-6377d97c7896 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:05.540422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0f3f75ed-cad8-43ce-8b1a-6377d97c7896 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:05.549635 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0f3f75ed-cad8-43ce-8b1a-6377d97c7896 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1315 microversion: 2.1 time: 0.230347 Jul 20 04:52:05.550464 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3206/6425] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:05 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:06.158355 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:06.162954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e18b2463-2bfd-4f73-a6a5-7b877f0f884f tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:06.163675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e18b2463-2bfd-4f73-a6a5-7b877f0f884f tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:06.170409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e18b2463-2bfd-4f73-a6a5-7b877f0f884f tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:06.170876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e18b2463-2bfd-4f73-a6a5-7b877f0f884f tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:06.171655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e18b2463-2bfd-4f73-a6a5-7b877f0f884f tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:06.172102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e18b2463-2bfd-4f73-a6a5-7b877f0f884f tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:06.305566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e18b2463-2bfd-4f73-a6a5-7b877f0f884f tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:06.313712 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e18b2463-2bfd-4f73-a6a5-7b877f0f884f tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1374 microversion: 2.1 time: 0.156346 Jul 20 04:52:06.314305 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3220/6426] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:06 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:06.564458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:06.569585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-28471411-ebe3-4557-9a60-cab33430a616 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:06.570228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-28471411-ebe3-4557-9a60-cab33430a616 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:06.579163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28471411-ebe3-4557-9a60-cab33430a616 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:06.580838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28471411-ebe3-4557-9a60-cab33430a616 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:06.581708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28471411-ebe3-4557-9a60-cab33430a616 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:06.582282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-28471411-ebe3-4557-9a60-cab33430a616 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:06.722535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-28471411-ebe3-4557-9a60-cab33430a616 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:06.731558 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-28471411-ebe3-4557-9a60-cab33430a616 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1315 microversion: 2.1 time: 0.167782 Jul 20 04:52:06.732392 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3207/6427] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:06 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:07.326618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a6ecfe53-927b-4428-9a46-f87e660fe4a6 req-0182d9ac-2c0b-49e9-9f4b-300efb342aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d284ac6-ca41-48b0-81ff-d96ce555d634", "name": "network-vif-plugged", "status": "completed", "tag": "1d8f33bc-0205-4ba5-81bd-c66200666a5a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:07.330116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:07.331358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-539b7fdc-b53e-49b4-87a7-0393769be662 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:07.332111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-539b7fdc-b53e-49b4-87a7-0393769be662 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:07.337041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a6ecfe53-927b-4428-9a46-f87e660fe4a6 req-0182d9ac-2c0b-49e9-9f4b-300efb342aa7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.337488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a6ecfe53-927b-4428-9a46-f87e660fe4a6 req-0182d9ac-2c0b-49e9-9f4b-300efb342aa7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:07.339816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-539b7fdc-b53e-49b4-87a7-0393769be662 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.340363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-539b7fdc-b53e-49b4-87a7-0393769be662 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:07.341226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-539b7fdc-b53e-49b4-87a7-0393769be662 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.341753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-539b7fdc-b53e-49b4-87a7-0393769be662 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:07.350575 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a6ecfe53-927b-4428-9a46-f87e660fe4a6 req-0182d9ac-2c0b-49e9-9f4b-300efb342aa7 service nova] Creating event network-vif-plugged:1d8f33bc-0205-4ba5-81bd-c66200666a5a for instance 9d284ac6-ca41-48b0-81ff-d96ce555d634 on n-h2-760456-11 Jul 20 04:52:07.355956 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a6ecfe53-927b-4428-9a46-f87e660fe4a6 req-0182d9ac-2c0b-49e9-9f4b-300efb342aa7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033313 Jul 20 04:52:07.356854 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3221/6428] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:07.530306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-539b7fdc-b53e-49b4-87a7-0393769be662 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:07.538735 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-539b7fdc-b53e-49b4-87a7-0393769be662 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1546 microversion: 2.1 time: 0.211317 Jul 20 04:52:07.546537 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3208/6429] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:07 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1546 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:07.557098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7165f73-3fca-4bbb-986c-9ab2e2ea9ee9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:07.557826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7165f73-3fca-4bbb-986c-9ab2e2ea9ee9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:07.564653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7165f73-3fca-4bbb-986c-9ab2e2ea9ee9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.565114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7165f73-3fca-4bbb-986c-9ab2e2ea9ee9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:07.565910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7165f73-3fca-4bbb-986c-9ab2e2ea9ee9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.566400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7165f73-3fca-4bbb-986c-9ab2e2ea9ee9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:07.749941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d980d67a-040c-486b-80a1-62d3831aa3f9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:07.750657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d980d67a-040c-486b-80a1-62d3831aa3f9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:07.757957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d980d67a-040c-486b-80a1-62d3831aa3f9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.758468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d980d67a-040c-486b-80a1-62d3831aa3f9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:07.759277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d980d67a-040c-486b-80a1-62d3831aa3f9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.759840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d980d67a-040c-486b-80a1-62d3831aa3f9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:08.111304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e7165f73-3fca-4bbb-986c-9ab2e2ea9ee9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:08.121346 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7165f73-3fca-4bbb-986c-9ab2e2ea9ee9 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1546 microversion: 2.1 time: 0.569002 Jul 20 04:52:08.131836 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3222/6430] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:07 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1546 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:08.246815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d980d67a-040c-486b-80a1-62d3831aa3f9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:08.254217 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d980d67a-040c-486b-80a1-62d3831aa3f9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1315 microversion: 2.1 time: 0.508320 Jul 20 04:52:08.254822 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3209/6431] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:07 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:09.272622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b22ff13a-6725-4b1e-a32c-c8c21dff982c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:09.273462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b22ff13a-6725-4b1e-a32c-c8c21dff982c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:09.281465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b22ff13a-6725-4b1e-a32c-c8c21dff982c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.281919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b22ff13a-6725-4b1e-a32c-c8c21dff982c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.282728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b22ff13a-6725-4b1e-a32c-c8c21dff982c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.283196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b22ff13a-6725-4b1e-a32c-c8c21dff982c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.311235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b041cd0-293d-4f86-b60b-37d916bbbae7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:09.313058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3b041cd0-293d-4f86-b60b-37d916bbbae7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:09.321338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=14 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:09.325632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b041cd0-293d-4f86-b60b-37d916bbbae7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.326112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b041cd0-293d-4f86-b60b-37d916bbbae7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.326986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b041cd0-293d-4f86-b60b-37d916bbbae7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.327464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b041cd0-293d-4f86-b60b-37d916bbbae7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.356743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3b041cd0-293d-4f86-b60b-37d916bbbae7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:52:09.452930 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3b041cd0-293d-4f86-b60b-37d916bbbae7 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 204 len: 0 microversion: 2.1 time: 0.149015 Jul 20 04:52:09.454014 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3210/6432] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:52:09 2022] DELETE /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:52:09.461535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c855ba8a-5998-4afb-8ab2-8c676575a50a req-be8ed6e1-21bb-4df5-bfcd-258a3519446a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f63512-b53a-4bef-afe5-83412d180814", "tag": "319adfd4-609d-4eeb-a320-0836f1069c64"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:09.473910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c855ba8a-5998-4afb-8ab2-8c676575a50a req-be8ed6e1-21bb-4df5-bfcd-258a3519446a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.475104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c855ba8a-5998-4afb-8ab2-8c676575a50a req-be8ed6e1-21bb-4df5-bfcd-258a3519446a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.492631 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c855ba8a-5998-4afb-8ab2-8c676575a50a req-be8ed6e1-21bb-4df5-bfcd-258a3519446a service nova] Creating event network-changed:319adfd4-609d-4eeb-a320-0836f1069c64 for instance 51f63512-b53a-4bef-afe5-83412d180814 on n-h1-760456-11 Jul 20 04:52:09.498766 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c855ba8a-5998-4afb-8ab2-8c676575a50a req-be8ed6e1-21bb-4df5-bfcd-258a3519446a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043141 Jul 20 04:52:09.499630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3211/6433] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:09.505194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45dabf84-ff60-473d-8bfa-c3dc6425e60b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:09.506170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-45dabf84-ff60-473d-8bfa-c3dc6425e60b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:09.512935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45dabf84-ff60-473d-8bfa-c3dc6425e60b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.513887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45dabf84-ff60-473d-8bfa-c3dc6425e60b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.514379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45dabf84-ff60-473d-8bfa-c3dc6425e60b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.514922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45dabf84-ff60-473d-8bfa-c3dc6425e60b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.614231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b22ff13a-6725-4b1e-a32c-c8c21dff982c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:09.627301 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b22ff13a-6725-4b1e-a32c-c8c21dff982c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1465 microversion: 2.1 time: 0.357708 Jul 20 04:52:09.639550 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3223/6434] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:09 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1465 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:09.672126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-45dabf84-ff60-473d-8bfa-c3dc6425e60b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:09.676698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9db328c8-34b5-46e2-a8b1-7b76a3e037c9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:09.677381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9db328c8-34b5-46e2-a8b1-7b76a3e037c9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:09.682369 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-45dabf84-ff60-473d-8bfa-c3dc6425e60b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1577 microversion: 2.1 time: 0.180369 Jul 20 04:52:09.692395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9db328c8-34b5-46e2-a8b1-7b76a3e037c9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.692395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9db328c8-34b5-46e2-a8b1-7b76a3e037c9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.692395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9db328c8-34b5-46e2-a8b1-7b76a3e037c9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.692395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9db328c8-34b5-46e2-a8b1-7b76a3e037c9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.693539 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3212/6435] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:09 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:09.718466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9db328c8-34b5-46e2-a8b1-7b76a3e037c9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:52:09.802777 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9db328c8-34b5-46e2-a8b1-7b76a3e037c9 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 204 len: 0 microversion: 2.1 time: 0.133613 Jul 20 04:52:09.813193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-22acc3ae-ba06-42ee-85da-99ba6b75ba1c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:09.813915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22acc3ae-ba06-42ee-85da-99ba6b75ba1c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:09.818663 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3224/6436] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:52:09 2022] DELETE /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:52:09.821034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22acc3ae-ba06-42ee-85da-99ba6b75ba1c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.821580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22acc3ae-ba06-42ee-85da-99ba6b75ba1c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.822840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22acc3ae-ba06-42ee-85da-99ba6b75ba1c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.823505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22acc3ae-ba06-42ee-85da-99ba6b75ba1c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.970316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-22acc3ae-ba06-42ee-85da-99ba6b75ba1c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:09.979245 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-22acc3ae-ba06-42ee-85da-99ba6b75ba1c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1471 microversion: 2.1 time: 0.170237 Jul 20 04:52:09.989313 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3213/6437] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:09 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:10.701284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9d11391d-64f3-4dbe-af0e-25c7ab3c75e9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:10.702700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9d11391d-64f3-4dbe-af0e-25c7ab3c75e9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:10.709766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d11391d-64f3-4dbe-af0e-25c7ab3c75e9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:10.710298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d11391d-64f3-4dbe-af0e-25c7ab3c75e9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:10.711098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d11391d-64f3-4dbe-af0e-25c7ab3c75e9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:10.711548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9d11391d-64f3-4dbe-af0e-25c7ab3c75e9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:10.977682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9d11391d-64f3-4dbe-af0e-25c7ab3c75e9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:10.986623 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9d11391d-64f3-4dbe-af0e-25c7ab3c75e9 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1577 microversion: 2.1 time: 0.290170 Jul 20 04:52:10.987485 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3225/6438] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:10 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1577 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:10.997719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-48ed958b-77f6-460d-81cc-91a97cbc0336 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:10.999175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-48ed958b-77f6-460d-81cc-91a97cbc0336 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:11.006937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48ed958b-77f6-460d-81cc-91a97cbc0336 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:11.007500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48ed958b-77f6-460d-81cc-91a97cbc0336 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:11.008398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48ed958b-77f6-460d-81cc-91a97cbc0336 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:11.009066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-48ed958b-77f6-460d-81cc-91a97cbc0336 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:11.348369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-48ed958b-77f6-460d-81cc-91a97cbc0336 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:11.362112 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-48ed958b-77f6-460d-81cc-91a97cbc0336 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1471 microversion: 2.1 time: 0.368091 Jul 20 04:52:11.363392 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3214/6439] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:10 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1471 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:11.514627 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9f265e2e-e34b-4359-aae1-3f6ff1f46dbe req-8d9f6dfd-72d5-4938-b65e-64079408cb00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e6bc49-6273-4c78-93c5-95d413c57fb8", "tag": "360aa579-fb9c-4691-afe3-cde8c652baa9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:11.522761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9f265e2e-e34b-4359-aae1-3f6ff1f46dbe req-8d9f6dfd-72d5-4938-b65e-64079408cb00 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:11.523462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9f265e2e-e34b-4359-aae1-3f6ff1f46dbe req-8d9f6dfd-72d5-4938-b65e-64079408cb00 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:11.538588 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9f265e2e-e34b-4359-aae1-3f6ff1f46dbe req-8d9f6dfd-72d5-4938-b65e-64079408cb00 service nova] Creating event network-changed:360aa579-fb9c-4691-afe3-cde8c652baa9 for instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 on n-h2-760456-11 Jul 20 04:52:11.545473 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9f265e2e-e34b-4359-aae1-3f6ff1f46dbe req-8d9f6dfd-72d5-4938-b65e-64079408cb00 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034396 Jul 20 04:52:11.547031 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3226/6440] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:11.813497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2995eafa-c5fb-411f-9e3f-fb9205e228ee req-cb86c4d2-699a-4959-8b56-85fa824f7f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f63512-b53a-4bef-afe5-83412d180814", "name": "network-vif-deleted", "tag": "319adfd4-609d-4eeb-a320-0836f1069c64"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:11.836347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2995eafa-c5fb-411f-9e3f-fb9205e228ee req-cb86c4d2-699a-4959-8b56-85fa824f7f79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:11.837067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2995eafa-c5fb-411f-9e3f-fb9205e228ee req-cb86c4d2-699a-4959-8b56-85fa824f7f79 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:11.843350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:11.854144 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2995eafa-c5fb-411f-9e3f-fb9205e228ee req-cb86c4d2-699a-4959-8b56-85fa824f7f79 service nova] Creating event network-vif-deleted:319adfd4-609d-4eeb-a320-0836f1069c64 for instance 51f63512-b53a-4bef-afe5-83412d180814 on n-h1-760456-11 Jul 20 04:52:11.862143 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2995eafa-c5fb-411f-9e3f-fb9205e228ee req-cb86c4d2-699a-4959-8b56-85fa824f7f79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057526 Jul 20 04:52:11.863416 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3215/6441] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:12.006936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-702e24e0-13e3-48d1-8d3f-3ef3ce4bfc73 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:12.007977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-702e24e0-13e3-48d1-8d3f-3ef3ce4bfc73 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:12.027478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-702e24e0-13e3-48d1-8d3f-3ef3ce4bfc73 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.030097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-702e24e0-13e3-48d1-8d3f-3ef3ce4bfc73 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.031241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-702e24e0-13e3-48d1-8d3f-3ef3ce4bfc73 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.031889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-702e24e0-13e3-48d1-8d3f-3ef3ce4bfc73 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.213316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-702e24e0-13e3-48d1-8d3f-3ef3ce4bfc73 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:12.225070 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-702e24e0-13e3-48d1-8d3f-3ef3ce4bfc73 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1225 microversion: 2.1 time: 0.222332 Jul 20 04:52:12.227618 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3227/6442] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:11 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1225 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:12.382209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:12.384191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:12.395230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.395716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.396542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.396987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.439861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.440609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.441259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lazy-loading 'fault' on Instance uuid 9d284ac6-ca41-48b0-81ff-d96ce555d634 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:52:12.536819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bad8702d8854106b511d752fd6ebfef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e725185a5b4c538dc503e7859d948e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:12.547960 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-019f894b-747c-4346-ba21-0178b0b2a68c tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 200 len: 1305 microversion: 2.1 time: 0.170208 Jul 20 04:52:12.549545 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3216/6443] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:12 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 1305 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:13.246073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94fe5f5a-536b-4529-a2ec-f5c5ffda72b4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:13.246666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-94fe5f5a-536b-4529-a2ec-f5c5ffda72b4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:13.253724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94fe5f5a-536b-4529-a2ec-f5c5ffda72b4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:13.254179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94fe5f5a-536b-4529-a2ec-f5c5ffda72b4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:13.254977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94fe5f5a-536b-4529-a2ec-f5c5ffda72b4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:13.255420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94fe5f5a-536b-4529-a2ec-f5c5ffda72b4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:13.321135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-94fe5f5a-536b-4529-a2ec-f5c5ffda72b4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:13.324882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:13.330210 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94fe5f5a-536b-4529-a2ec-f5c5ffda72b4 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1225 microversion: 2.1 time: 0.089118 Jul 20 04:52:13.330815 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3228/6444] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:13 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:13.568769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d1399c8-e3dd-4194-9b5c-012efc69bd06 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:13.569407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d1399c8-e3dd-4194-9b5c-012efc69bd06 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] [instance: 9d284ac6-ca41-48b0-81ff-d96ce555d634] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:13.577100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d1399c8-e3dd-4194-9b5c-012efc69bd06 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:13.577568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d1399c8-e3dd-4194-9b5c-012efc69bd06 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:13.578421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d1399c8-e3dd-4194-9b5c-012efc69bd06 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:13.578881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3d1399c8-e3dd-4194-9b5c-012efc69bd06 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:13.594300 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-3d1399c8-e3dd-4194-9b5c-012efc69bd06 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] HTTP exception thrown: Instance 9d284ac6-ca41-48b0-81ff-d96ce555d634 could not be found. Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d1399c8-e3dd-4194-9b5c-012efc69bd06 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Request method failure captured: Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 HTTP/1.1 Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14nohaY9xTdv5JZwb7FiEEKhIxHdq0v9cShFAy9IVgJiz9_pcLnDorhAF-aAIXpzqFKg00rPL_ULsy6h1pP07LY0TtqyzKzDQc-ko2svW636K_t5Lx2RqnLBOFVJrgRF7mRaQCuo-88Ch4TE-e2JMF42V-rEYZ3F4B5QyZU-ZX68tk0 Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: f4e725185a5b4c538dc503e7859d948e Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-VolumesNegativeTest-383889092 Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f4e725185a5b4c538dc503e7859d948e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f4e725185a5b4c538dc503e7859d948e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f4e725185a5b4c538dc503e7859d948e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f4e725185a5b4c538dc503e7859d948e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-VolumesNegativeTest-383889092 Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: f4e725185a5b4c538dc503e7859d948e Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-VolumesNegativeTest-383889092 Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-VolumesNegativeTest-383889092-project Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 8bad8702d8854106b511d752fd6ebfef Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-VolumesNegativeTest-383889092-project Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 9d284ac6-ca41-48b0-81ff-d96ce555d634 could not be found. Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '9d284ac6-ca41-48b0-81ff-d96ce555d634'} Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d284ac6-ca41-48b0-81ff-d96ce555d634 could not be found. Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d284ac6-ca41-48b0-81ff-d96ce555d634 could not be found. Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:13.595982 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.600637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.600637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:13.600637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:13.600637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:13.600637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:13.600637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d284ac6-ca41-48b0-81ff-d96ce555d634 could not be found. Jul 20 04:52:13.600637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.600637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d1399c8-e3dd-4194-9b5c-012efc69bd06 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] Returning 404 to user: Instance 9d284ac6-ca41-48b0-81ff-d96ce555d634 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:13.600637 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d1399c8-e3dd-4194-9b5c-012efc69bd06 tempest-VolumesNegativeTest-383889092 tempest-VolumesNegativeTest-383889092-project] 10.222.0.59 "GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634" status: 404 len: 111 microversion: 2.1 time: 0.032845 Jul 20 04:52:13.600637 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3217/6445] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:13 2022] GET /compute/v2.1/servers/9d284ac6-ca41-48b0-81ff-d96ce555d634 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:13.882237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2a7b06cc-9172-4b1c-a640-67701ce383e6 req-240dc55b-544a-473f-ba01-0174ae4c34d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d284ac6-ca41-48b0-81ff-d96ce555d634", "name": "network-vif-deleted", "tag": "1d8f33bc-0205-4ba5-81bd-c66200666a5a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:13.892633 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2a7b06cc-9172-4b1c-a640-67701ce383e6 req-240dc55b-544a-473f-ba01-0174ae4c34d7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:13.893207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2a7b06cc-9172-4b1c-a640-67701ce383e6 req-240dc55b-544a-473f-ba01-0174ae4c34d7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:13.907091 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2a7b06cc-9172-4b1c-a640-67701ce383e6 req-240dc55b-544a-473f-ba01-0174ae4c34d7 service nova] Creating event network-vif-deleted:1d8f33bc-0205-4ba5-81bd-c66200666a5a for instance 9d284ac6-ca41-48b0-81ff-d96ce555d634 on n-h2-760456-11 Jul 20 04:52:13.912092 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2a7b06cc-9172-4b1c-a640-67701ce383e6 req-240dc55b-544a-473f-ba01-0174ae4c34d7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034420 Jul 20 04:52:13.912890 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3229/6446] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:14.347494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a8e8ebaf-e116-4619-8234-36c85208b050 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:14.348317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a8e8ebaf-e116-4619-8234-36c85208b050 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:14.355522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8e8ebaf-e116-4619-8234-36c85208b050 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:14.356069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8e8ebaf-e116-4619-8234-36c85208b050 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:14.356937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8e8ebaf-e116-4619-8234-36c85208b050 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:14.357471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8e8ebaf-e116-4619-8234-36c85208b050 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:14.427565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a8e8ebaf-e116-4619-8234-36c85208b050 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:14.437204 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a8e8ebaf-e116-4619-8234-36c85208b050 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1225 microversion: 2.1 time: 0.093620 Jul 20 04:52:14.437784 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3218/6447] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:14 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:15.455834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ab299d53-e1d0-4d69-90cc-9c5e6d2d80bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:15.456643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ab299d53-e1d0-4d69-90cc-9c5e6d2d80bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:15.464301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab299d53-e1d0-4d69-90cc-9c5e6d2d80bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:15.465041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab299d53-e1d0-4d69-90cc-9c5e6d2d80bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:15.465949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab299d53-e1d0-4d69-90cc-9c5e6d2d80bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:15.466814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ab299d53-e1d0-4d69-90cc-9c5e6d2d80bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:15.546597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ab299d53-e1d0-4d69-90cc-9c5e6d2d80bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:15.553512 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ab299d53-e1d0-4d69-90cc-9c5e6d2d80bd tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1225 microversion: 2.1 time: 0.103457 Jul 20 04:52:15.554626 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3230/6448] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:15 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:16.572608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:16.573109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:16.580395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:16.580862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:16.581650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:16.582101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:16.615507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:16.616081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:16.616547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lazy-loading 'fault' on Instance uuid 51f63512-b53a-4bef-afe5-83412d180814 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:52:16.662042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:16.671145 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4f20d78c-ec8f-44f7-af95-4cd0c4b447f6 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 200 len: 1230 microversion: 2.1 time: 0.103057 Jul 20 04:52:16.671466 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3219/6449] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:16 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:17.688580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a97c268-537d-4c47-93a5-106c3623340c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:17.689213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6a97c268-537d-4c47-93a5-106c3623340c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 51f63512-b53a-4bef-afe5-83412d180814] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:17.696645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a97c268-537d-4c47-93a5-106c3623340c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:17.697325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a97c268-537d-4c47-93a5-106c3623340c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:17.698125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a97c268-537d-4c47-93a5-106c3623340c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:17.698616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6a97c268-537d-4c47-93a5-106c3623340c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:17.712386 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-6a97c268-537d-4c47-93a5-106c3623340c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 51f63512-b53a-4bef-afe5-83412d180814 could not be found. Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a97c268-537d-4c47-93a5-106c3623340c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 HTTP/1.1 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 51f63512-b53a-4bef-afe5-83412d180814 could not be found. Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '51f63512-b53a-4bef-afe5-83412d180814'} Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51f63512-b53a-4bef-afe5-83412d180814 could not be found. Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51f63512-b53a-4bef-afe5-83412d180814 could not be found. Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:17.714167 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:52:17.719365 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:17.719365 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:17.719365 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:17.719365 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:17.719365 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:17.719365 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51f63512-b53a-4bef-afe5-83412d180814 could not be found. Jul 20 04:52:17.719365 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:52:17.719365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6a97c268-537d-4c47-93a5-106c3623340c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 51f63512-b53a-4bef-afe5-83412d180814 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:17.719365 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6a97c268-537d-4c47-93a5-106c3623340c tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814" status: 404 len: 111 microversion: 2.1 time: 0.034450 Jul 20 04:52:17.720057 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3231/6450] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:17 2022] GET /compute/v2.1/servers/51f63512-b53a-4bef-afe5-83412d180814 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:24.247251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c4a9653f-2d29-4b3b-a6ef-84976a907269 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:24.247799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c4a9653f-2d29-4b3b-a6ef-84976a907269 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:24.249652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-53353f82-5f81-4c49-9a1b-7e6cc3a4b069 req-d2184321-056d-47c2-9fca-60c412788f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27cd449-5ffc-42e0-9ad1-0b2742174178", "tag": "a797f02c-f5b2-4e5c-ae65-e7c540fb850b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:24.254284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:24.255213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4a9653f-2d29-4b3b-a6ef-84976a907269 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:24.255601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4a9653f-2d29-4b3b-a6ef-84976a907269 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:24.256395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4a9653f-2d29-4b3b-a6ef-84976a907269 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:24.256871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c4a9653f-2d29-4b3b-a6ef-84976a907269 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:24.260939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-53353f82-5f81-4c49-9a1b-7e6cc3a4b069 req-d2184321-056d-47c2-9fca-60c412788f1a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:24.261399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-53353f82-5f81-4c49-9a1b-7e6cc3a4b069 req-d2184321-056d-47c2-9fca-60c412788f1a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:24.274130 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-53353f82-5f81-4c49-9a1b-7e6cc3a4b069 req-d2184321-056d-47c2-9fca-60c412788f1a service nova] Creating event network-changed:a797f02c-f5b2-4e5c-ae65-e7c540fb850b for instance f27cd449-5ffc-42e0-9ad1-0b2742174178 on n-h2-760456-11 Jul 20 04:52:24.280763 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-53353f82-5f81-4c49-9a1b-7e6cc3a4b069 req-d2184321-056d-47c2-9fca-60c412788f1a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034804 Jul 20 04:52:24.281744 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3232/6451] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:24.284839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c4a9653f-2d29-4b3b-a6ef-84976a907269 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:52:24.381600 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c4a9653f-2d29-4b3b-a6ef-84976a907269 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 204 len: 0 microversion: 2.1 time: 0.138161 Jul 20 04:52:24.382894 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3220/6452] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:52:24 2022] DELETE /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:52:24.392019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ed19d51c-396b-4fed-a58c-6e71c02c5205 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:24.392751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ed19d51c-396b-4fed-a58c-6e71c02c5205 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:24.399934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed19d51c-396b-4fed-a58c-6e71c02c5205 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:24.400546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed19d51c-396b-4fed-a58c-6e71c02c5205 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:24.401347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed19d51c-396b-4fed-a58c-6e71c02c5205 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:24.401826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed19d51c-396b-4fed-a58c-6e71c02c5205 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:24.563525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ed19d51c-396b-4fed-a58c-6e71c02c5205 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:24.571985 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ed19d51c-396b-4fed-a58c-6e71c02c5205 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1577 microversion: 2.1 time: 0.184203 Jul 20 04:52:24.572769 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3233/6453] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:24 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:25.589579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43fec271-4f48-411c-a014-e19df8e2833f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:25.590332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43fec271-4f48-411c-a014-e19df8e2833f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:25.593116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:25.599086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43fec271-4f48-411c-a014-e19df8e2833f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:25.599575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43fec271-4f48-411c-a014-e19df8e2833f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:25.600398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43fec271-4f48-411c-a014-e19df8e2833f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:25.600858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43fec271-4f48-411c-a014-e19df8e2833f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:25.740933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-43fec271-4f48-411c-a014-e19df8e2833f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:25.749198 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43fec271-4f48-411c-a014-e19df8e2833f tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1577 microversion: 2.1 time: 0.163979 Jul 20 04:52:25.749920 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3221/6454] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:25 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:26.451723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-cc60ab85-4340-490b-845d-4b972379285e req-9e3717fe-8ebf-42ad-ae7c-c3ae5ce1d61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27cd449-5ffc-42e0-9ad1-0b2742174178", "name": "network-vif-deleted", "tag": "a797f02c-f5b2-4e5c-ae65-e7c540fb850b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:26.461561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cc60ab85-4340-490b-845d-4b972379285e req-9e3717fe-8ebf-42ad-ae7c-c3ae5ce1d61f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:26.462717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cc60ab85-4340-490b-845d-4b972379285e req-9e3717fe-8ebf-42ad-ae7c-c3ae5ce1d61f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:26.474851 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-cc60ab85-4340-490b-845d-4b972379285e req-9e3717fe-8ebf-42ad-ae7c-c3ae5ce1d61f service nova] Creating event network-vif-deleted:a797f02c-f5b2-4e5c-ae65-e7c540fb850b for instance f27cd449-5ffc-42e0-9ad1-0b2742174178 on n-h2-760456-11 Jul 20 04:52:26.480726 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-cc60ab85-4340-490b-845d-4b972379285e req-9e3717fe-8ebf-42ad-ae7c-c3ae5ce1d61f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032824 Jul 20 04:52:26.481335 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3234/6455] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:26.767270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8e48f6dc-f707-4785-9fa2-580a92e2293e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:26.768775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8e48f6dc-f707-4785-9fa2-580a92e2293e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:26.777487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e48f6dc-f707-4785-9fa2-580a92e2293e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:26.777958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e48f6dc-f707-4785-9fa2-580a92e2293e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:26.778829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e48f6dc-f707-4785-9fa2-580a92e2293e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:26.779283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8e48f6dc-f707-4785-9fa2-580a92e2293e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:26.852276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8e48f6dc-f707-4785-9fa2-580a92e2293e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:26.861029 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8e48f6dc-f707-4785-9fa2-580a92e2293e tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1223 microversion: 2.1 time: 0.097963 Jul 20 04:52:26.861739 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3222/6456] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:26 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:27.881418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8a99336a-e733-4bee-be1f-87afb2bf16da tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:27.882673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8a99336a-e733-4bee-be1f-87afb2bf16da tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:27.889803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a99336a-e733-4bee-be1f-87afb2bf16da tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:27.890288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a99336a-e733-4bee-be1f-87afb2bf16da tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:27.891087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a99336a-e733-4bee-be1f-87afb2bf16da tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:27.891538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a99336a-e733-4bee-be1f-87afb2bf16da tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:28.127285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8a99336a-e733-4bee-be1f-87afb2bf16da tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:28.137110 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8a99336a-e733-4bee-be1f-87afb2bf16da tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1223 microversion: 2.1 time: 0.261330 Jul 20 04:52:28.137717 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3235/6457] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:27 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1223 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:29.154564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1c71deec-ecc7-4dcf-8bd5-d4440a5b1421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:29.155186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1c71deec-ecc7-4dcf-8bd5-d4440a5b1421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:29.161812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c71deec-ecc7-4dcf-8bd5-d4440a5b1421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:29.162301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c71deec-ecc7-4dcf-8bd5-d4440a5b1421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:29.163087 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c71deec-ecc7-4dcf-8bd5-d4440a5b1421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:29.163539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1c71deec-ecc7-4dcf-8bd5-d4440a5b1421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:29.294646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1c71deec-ecc7-4dcf-8bd5-d4440a5b1421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:29.302467 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1c71deec-ecc7-4dcf-8bd5-d4440a5b1421 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1223 microversion: 2.1 time: 0.152022 Jul 20 04:52:29.303043 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3223/6458] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:29 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:30.319806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0a71413b-25c1-492c-bd50-60b481c84f98 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:30.320417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0a71413b-25c1-492c-bd50-60b481c84f98 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:30.328105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a71413b-25c1-492c-bd50-60b481c84f98 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.328571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a71413b-25c1-492c-bd50-60b481c84f98 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.329350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a71413b-25c1-492c-bd50-60b481c84f98 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.329834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0a71413b-25c1-492c-bd50-60b481c84f98 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.394939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0a71413b-25c1-492c-bd50-60b481c84f98 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1067c18d4074c78a512d89e07141915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf178a8537f486682d29fa0d175b943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:30.403496 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0a71413b-25c1-492c-bd50-60b481c84f98 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 200 len: 1223 microversion: 2.1 time: 0.087593 Jul 20 04:52:30.404167 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3236/6459] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:30 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:31.420881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c11a2b8-6957-4038-82a9-e89f73cb5890 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:31.421636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8c11a2b8-6957-4038-82a9-e89f73cb5890 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: f27cd449-5ffc-42e0-9ad1-0b2742174178] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:31.429224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c11a2b8-6957-4038-82a9-e89f73cb5890 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:31.429700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c11a2b8-6957-4038-82a9-e89f73cb5890 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:31.430528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c11a2b8-6957-4038-82a9-e89f73cb5890 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:31.430985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8c11a2b8-6957-4038-82a9-e89f73cb5890 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:31.445636 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8c11a2b8-6957-4038-82a9-e89f73cb5890 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance f27cd449-5ffc-42e0-9ad1-0b2742174178 could not be found. Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c11a2b8-6957-4038-82a9-e89f73cb5890 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 HTTP/1.1 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance f27cd449-5ffc-42e0-9ad1-0b2742174178 could not be found. Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'f27cd449-5ffc-42e0-9ad1-0b2742174178'} Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27cd449-5ffc-42e0-9ad1-0b2742174178 could not be found. Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27cd449-5ffc-42e0-9ad1-0b2742174178 could not be found. Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:31.447613 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.453430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:31.453430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:31.453430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:31.453430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:31.453430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:31.453430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27cd449-5ffc-42e0-9ad1-0b2742174178 could not be found. Jul 20 04:52:31.453430 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.453430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8c11a2b8-6957-4038-82a9-e89f73cb5890 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance f27cd449-5ffc-42e0-9ad1-0b2742174178 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:31.453430 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8c11a2b8-6957-4038-82a9-e89f73cb5890 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178" status: 404 len: 111 microversion: 2.1 time: 0.033488 Jul 20 04:52:31.453430 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3224/6460] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:31 2022] GET /compute/v2.1/servers/f27cd449-5ffc-42e0-9ad1-0b2742174178 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:31.924290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cfd3aac8-7963-46a6-b03e-4d64a0ef64a0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:31.925399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cfd3aac8-7963-46a6-b03e-4d64a0ef64a0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:31.933947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cfd3aac8-7963-46a6-b03e-4d64a0ef64a0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:31.934372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cfd3aac8-7963-46a6-b03e-4d64a0ef64a0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:31.935147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cfd3aac8-7963-46a6-b03e-4d64a0ef64a0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:31.935596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cfd3aac8-7963-46a6-b03e-4d64a0ef64a0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:31.949895 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-cfd3aac8-7963-46a6-b03e-4d64a0ef64a0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cfd3aac8-7963-46a6-b03e-4d64a0ef64a0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 HTTP/1.1 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4e04f244-7107-4419-aaca-08303464f6a9'} Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:31.951645 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cfd3aac8-7963-46a6-b03e-4d64a0ef64a0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cfd3aac8-7963-46a6-b03e-4d64a0ef64a0 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 404 len: 111 microversion: 2.1 time: 0.033281 Jul 20 04:52:31.956266 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3237/6461] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:52:31 2022] DELETE /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:31.962393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-661eddc9-ec1f-447c-8a3f-ff9e2fcf235b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:31.964218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-661eddc9-ec1f-447c-8a3f-ff9e2fcf235b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] [instance: 4e04f244-7107-4419-aaca-08303464f6a9] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:31.970429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-661eddc9-ec1f-447c-8a3f-ff9e2fcf235b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:31.970905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-661eddc9-ec1f-447c-8a3f-ff9e2fcf235b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:31.971732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-661eddc9-ec1f-447c-8a3f-ff9e2fcf235b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:31.972191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-661eddc9-ec1f-447c-8a3f-ff9e2fcf235b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:31.986471 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-661eddc9-ec1f-447c-8a3f-ff9e2fcf235b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] HTTP exception thrown: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-661eddc9-ec1f-447c-8a3f-ff9e2fcf235b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Request method failure captured: Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 HTTP/1.1 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14cYwVpRvba6RopyGLxxUePKY2ZGakIxhX10rJKYJ4cx-HxFKF-v8_Z9P_wq8R6lhiKjGp8z3qX8EmrKWmQ2STvxPO9nQIIBFJ3Cm07lKXtdr4NFuyp1FUOFTimlhVBCRPuzyG36BocUW4pUXumXJUpsxDY0zdYOrimEZnvcwjLlM_0 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ddf178a8537f486682d29fa0d175b943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ddf178a8537f486682d29fa0d175b943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: ddf178a8537f486682d29fa0d175b943 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestVolumeBootPattern-962637922 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: f1067c18d4074c78a512d89e07141915 Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestVolumeBootPattern-962637922-project Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4e04f244-7107-4419-aaca-08303464f6a9'} Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:31.988056 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.993396 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:31.993396 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:31.993396 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:31.993396 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:31.993396 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:31.993396 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. Jul 20 04:52:31.993396 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:52:31.993396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-661eddc9-ec1f-447c-8a3f-ff9e2fcf235b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Returning 404 to user: Instance 4e04f244-7107-4419-aaca-08303464f6a9 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:31.993396 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-661eddc9-ec1f-447c-8a3f-ff9e2fcf235b tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9" status: 404 len: 111 microversion: 2.1 time: 0.031390 Jul 20 04:52:31.993396 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3225/6462] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:31 2022] GET /compute/v2.1/servers/4e04f244-7107-4419-aaca-08303464f6a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:33.729816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b328621e-6932-405a-86b6-9c0c998da023 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:33.730716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b328621e-6932-405a-86b6-9c0c998da023 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:33.737691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b328621e-6932-405a-86b6-9c0c998da023 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:33.738159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b328621e-6932-405a-86b6-9c0c998da023 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:33.738985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b328621e-6932-405a-86b6-9c0c998da023 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:33.739443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b328621e-6932-405a-86b6-9c0c998da023 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:33.791983 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b328621e-6932-405a-86b6-9c0c998da023 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "POST /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8/action" status: 200 len: 24571 microversion: 2.1 time: 0.065332 Jul 20 04:52:33.798584 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3238/6463] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:52:33 2022] POST /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:52:35.414792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2d531c40-154b-4da5-8e80-55923c4d6643 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] Calling method '.version_select at 0x7fb841ebb430>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:35.437989 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2d531c40-154b-4da5-8e80-55923c4d6643 tempest-TestVolumeBootPattern-962637922 tempest-TestVolumeBootPattern-962637922-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-834958577" status: 202 len: 0 microversion: 2.1 time: 0.027502 Jul 20 04:52:35.442882 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3226/6464] 10.222.0.59 () {58 vars in 1259 bytes} [Wed Jul 20 04:52:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-834958577 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:52:46.857406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8eaac5b3-ac18-44d6-b817-6e01a28796b0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Action: 'create', calling method: .version_select at 0x7fb840e10af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2084981587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuWFRHEcS2EfptOlw1MMT+0tCXGQcRPmnTQcHQSwHPoMfqldwuikWVXOD/HKHXdv7ubQC6iGxrmy9grj7ny1p7//ITxFVoXe4UfPnAdtzB+Rv97cvVfAouQVBKIAlwR8A=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:46.863655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=13 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:46.864314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=38 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:46.877575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-8eaac5b3-ac18-44d6-b817-6e01a28796b0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:52:46.883016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-8eaac5b3-ac18-44d6-b817-6e01a28796b0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for user 1cebf52f619044e689d7c74258944ddf and project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:52:46.907937 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8eaac5b3-ac18-44d6-b817-6e01a28796b0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.055280 Jul 20 04:52:46.908549 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3239/6465] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:52:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:48.023387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:48.024212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:48.029758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-647814367", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "89b4cc0b-f8c1-4865-a6be-4dad90fc47f4"}], "key_name": "tempest-TestNetworkBasicOps-2084981587", "security_groups": [{"name": "tempest-secgroup-smoke-1265965770"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:48.152346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] validate_networks() for [('89b4cc0b-f8c1-4865-a6be-4dad90fc47f4', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:52:48.598314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:52:48.599289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:52:48.599976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:52:48.601024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:52:48.601833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:52:48.612899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.613675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:48.615305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.615962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:48.640410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:52:48.647157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for user 1cebf52f619044e689d7c74258944ddf and project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:52:48.666538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:52:48.670564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:52:48.740933 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f65193fc-0252-4929-b558-6b01b8894f84 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720196 Jul 20 04:52:48.746860 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3227/6466] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:52:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:52:48.754053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fbdfbd1b-69c3-4574-bfda-d6bc699543fe tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:48.756030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fbdfbd1b-69c3-4574-bfda-d6bc699543fe tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:48.835979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbdfbd1b-69c3-4574-bfda-d6bc699543fe tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:48.845014 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fbdfbd1b-69c3-4574-bfda-d6bc699543fe tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1248 microversion: 2.1 time: 0.096169 Jul 20 04:52:48.845956 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3240/6467] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:48 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1248 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:49.864581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-acf3ebc4-7d52-4c7b-9334-328427eee5d6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:49.865835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-acf3ebc4-7d52-4c7b-9334-328427eee5d6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:49.873595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acf3ebc4-7d52-4c7b-9334-328427eee5d6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:49.874072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acf3ebc4-7d52-4c7b-9334-328427eee5d6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:49.874956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acf3ebc4-7d52-4c7b-9334-328427eee5d6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:49.875400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acf3ebc4-7d52-4c7b-9334-328427eee5d6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:49.949699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-acf3ebc4-7d52-4c7b-9334-328427eee5d6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:49.959889 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-acf3ebc4-7d52-4c7b-9334-328427eee5d6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1306 microversion: 2.1 time: 0.100559 Jul 20 04:52:49.961014 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3228/6468] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:49 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:50.977388 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-df6e6e7d-6882-4b65-9b6d-180b15ac8964 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:50.979588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-df6e6e7d-6882-4b65-9b6d-180b15ac8964 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:50.987333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df6e6e7d-6882-4b65-9b6d-180b15ac8964 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:50.987960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df6e6e7d-6882-4b65-9b6d-180b15ac8964 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:50.988829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df6e6e7d-6882-4b65-9b6d-180b15ac8964 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:50.989349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df6e6e7d-6882-4b65-9b6d-180b15ac8964 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:51.146122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-df6e6e7d-6882-4b65-9b6d-180b15ac8964 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:51.156298 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-df6e6e7d-6882-4b65-9b6d-180b15ac8964 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1374 microversion: 2.1 time: 0.183130 Jul 20 04:52:51.157130 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3241/6469] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:50 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:51.170309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c40d4e39-cfa6-4d3b-a1ab-e5f5be5d38f5 req-c27e21db-014d-4600-80da-3f4e15bd8595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40", "tag": "5ab86b03-2068-48b0-9dc8-357626503920"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:51.187034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c40d4e39-cfa6-4d3b-a1ab-e5f5be5d38f5 req-c27e21db-014d-4600-80da-3f4e15bd8595 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:51.187507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c40d4e39-cfa6-4d3b-a1ab-e5f5be5d38f5 req-c27e21db-014d-4600-80da-3f4e15bd8595 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:51.199785 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c40d4e39-cfa6-4d3b-a1ab-e5f5be5d38f5 req-c27e21db-014d-4600-80da-3f4e15bd8595 service nova] Creating event network-changed:5ab86b03-2068-48b0-9dc8-357626503920 for instance 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 on n-h1-760456-11 Jul 20 04:52:51.205132 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c40d4e39-cfa6-4d3b-a1ab-e5f5be5d38f5 req-c27e21db-014d-4600-80da-3f4e15bd8595 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041057 Jul 20 04:52:51.206061 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3229/6470] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:52.173812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7fde0e8a-1e21-4a0d-9554-318c9d59f646 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:52.174470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7fde0e8a-1e21-4a0d-9554-318c9d59f646 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:52.182273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fde0e8a-1e21-4a0d-9554-318c9d59f646 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:52.182742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fde0e8a-1e21-4a0d-9554-318c9d59f646 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:52.183524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fde0e8a-1e21-4a0d-9554-318c9d59f646 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:52.183974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7fde0e8a-1e21-4a0d-9554-318c9d59f646 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:52.314013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7fde0e8a-1e21-4a0d-9554-318c9d59f646 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:52.322221 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7fde0e8a-1e21-4a0d-9554-318c9d59f646 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1374 microversion: 2.1 time: 0.151736 Jul 20 04:52:52.322882 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3242/6471] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:52 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:53.340468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f05ba1b7-a1b0-444d-8458-52aa40ceb305 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:53.341301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f05ba1b7-a1b0-444d-8458-52aa40ceb305 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:53.347699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f05ba1b7-a1b0-444d-8458-52aa40ceb305 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:53.348177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f05ba1b7-a1b0-444d-8458-52aa40ceb305 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:53.348971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f05ba1b7-a1b0-444d-8458-52aa40ceb305 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:53.349434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f05ba1b7-a1b0-444d-8458-52aa40ceb305 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:53.485330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f05ba1b7-a1b0-444d-8458-52aa40ceb305 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:53.492885 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f05ba1b7-a1b0-444d-8458-52aa40ceb305 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1374 microversion: 2.1 time: 0.158220 Jul 20 04:52:53.493751 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3230/6472] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:53 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:54.512338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b8c6f109-89ca-4be6-a6e1-8ddde335f93c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:54.512988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b8c6f109-89ca-4be6-a6e1-8ddde335f93c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:54.521127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8c6f109-89ca-4be6-a6e1-8ddde335f93c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:54.521582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8c6f109-89ca-4be6-a6e1-8ddde335f93c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:54.522399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8c6f109-89ca-4be6-a6e1-8ddde335f93c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:54.522844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8c6f109-89ca-4be6-a6e1-8ddde335f93c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:54.680368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b8c6f109-89ca-4be6-a6e1-8ddde335f93c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:54.688784 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b8c6f109-89ca-4be6-a6e1-8ddde335f93c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1374 microversion: 2.1 time: 0.182442 Jul 20 04:52:54.689367 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3243/6473] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:54 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:55.709794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1cf97d61-6731-414d-9743-06829f5c8dad tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:55.710508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1cf97d61-6731-414d-9743-06829f5c8dad tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:55.717869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cf97d61-6731-414d-9743-06829f5c8dad tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:55.718377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cf97d61-6731-414d-9743-06829f5c8dad tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:55.719167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cf97d61-6731-414d-9743-06829f5c8dad tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:55.719627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cf97d61-6731-414d-9743-06829f5c8dad tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:55.853220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1cf97d61-6731-414d-9743-06829f5c8dad tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:55.860759 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1cf97d61-6731-414d-9743-06829f5c8dad tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1374 microversion: 2.1 time: 0.154836 Jul 20 04:52:55.861337 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3231/6474] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:55 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:56.878052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cd8480e1-6cd6-4267-91c8-12a5c34191e7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:56.878658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cd8480e1-6cd6-4267-91c8-12a5c34191e7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:56.886638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd8480e1-6cd6-4267-91c8-12a5c34191e7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:56.887104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd8480e1-6cd6-4267-91c8-12a5c34191e7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:56.887887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd8480e1-6cd6-4267-91c8-12a5c34191e7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:56.888336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cd8480e1-6cd6-4267-91c8-12a5c34191e7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:57.023743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cd8480e1-6cd6-4267-91c8-12a5c34191e7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:57.031809 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cd8480e1-6cd6-4267-91c8-12a5c34191e7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1374 microversion: 2.1 time: 0.157785 Jul 20 04:52:57.032758 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3244/6475] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:56 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:57.075248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-19c19cb2-22e9-4df2-8520-ee6619b16a22 req-8d484b27-6287-4504-9be5-eeab9e1ab00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40", "name": "network-vif-plugged", "status": "completed", "tag": "5ab86b03-2068-48b0-9dc8-357626503920"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:57.084747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-19c19cb2-22e9-4df2-8520-ee6619b16a22 req-8d484b27-6287-4504-9be5-eeab9e1ab00c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:57.085607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-19c19cb2-22e9-4df2-8520-ee6619b16a22 req-8d484b27-6287-4504-9be5-eeab9e1ab00c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:57.097220 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-19c19cb2-22e9-4df2-8520-ee6619b16a22 req-8d484b27-6287-4504-9be5-eeab9e1ab00c service nova] Creating event network-vif-plugged:5ab86b03-2068-48b0-9dc8-357626503920 for instance 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 on n-h1-760456-11 Jul 20 04:52:57.102149 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-19c19cb2-22e9-4df2-8520-ee6619b16a22 req-8d484b27-6287-4504-9be5-eeab9e1ab00c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031576 Jul 20 04:52:57.103324 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3232/6476] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:58.047923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-36674500-c586-43da-8940-f3b0692a193b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:58.048535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-36674500-c586-43da-8940-f3b0692a193b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:58.055517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36674500-c586-43da-8940-f3b0692a193b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:58.055965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36674500-c586-43da-8940-f3b0692a193b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:58.056729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36674500-c586-43da-8940-f3b0692a193b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:58.057168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-36674500-c586-43da-8940-f3b0692a193b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:58.199730 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-36674500-c586-43da-8940-f3b0692a193b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:58.208266 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-36674500-c586-43da-8940-f3b0692a193b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1374 microversion: 2.1 time: 0.164176 Jul 20 04:52:58.208866 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3245/6477] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:58 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:59.224941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:59.225739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:59.230734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-998b7692-21db-461b-8cfa-e62f12773d39 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:59.231459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-998b7692-21db-461b-8cfa-e62f12773d39 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:59.238607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-998b7692-21db-461b-8cfa-e62f12773d39 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:59.239083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-998b7692-21db-461b-8cfa-e62f12773d39 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:59.239862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-998b7692-21db-461b-8cfa-e62f12773d39 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:59.240320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-998b7692-21db-461b-8cfa-e62f12773d39 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:59.379756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-998b7692-21db-461b-8cfa-e62f12773d39 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:59.388528 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-998b7692-21db-461b-8cfa-e62f12773d39 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1546 microversion: 2.1 time: 0.165437 Jul 20 04:52:59.389109 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3233/6478] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:59 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:59.404732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-94c10fd9-6017-4976-8391-3392ec65cfe0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:59.405369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-94c10fd9-6017-4976-8391-3392ec65cfe0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:59.407252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:59.413302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94c10fd9-6017-4976-8391-3392ec65cfe0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:59.413752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94c10fd9-6017-4976-8391-3392ec65cfe0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:59.414555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94c10fd9-6017-4976-8391-3392ec65cfe0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:59.414996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-94c10fd9-6017-4976-8391-3392ec65cfe0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:59.547080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-94c10fd9-6017-4976-8391-3392ec65cfe0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:59.554777 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-94c10fd9-6017-4976-8391-3392ec65cfe0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1546 microversion: 2.1 time: 0.154074 Jul 20 04:52:59.555352 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3246/6479] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:59 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:25.017667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1e22f31a-923e-4a9e-b6f0-80957aa26c93 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:25.018193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1e22f31a-923e-4a9e-b6f0-80957aa26c93 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:25.020958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:25.021760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=30 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:25.028807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e22f31a-923e-4a9e-b6f0-80957aa26c93 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:25.029307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e22f31a-923e-4a9e-b6f0-80957aa26c93 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:25.030098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e22f31a-923e-4a9e-b6f0-80957aa26c93 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:25.030590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e22f31a-923e-4a9e-b6f0-80957aa26c93 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:25.061054 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1e22f31a-923e-4a9e-b6f0-80957aa26c93 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:53:25.147481 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1e22f31a-923e-4a9e-b6f0-80957aa26c93 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 204 len: 0 microversion: 2.1 time: 0.133564 Jul 20 04:53:25.153224 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3234/6480] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:53:25 2022] DELETE /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:53:25.163439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a4c8c26b-3e34-473b-b02e-b6179067e953 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:25.164314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a4c8c26b-3e34-473b-b02e-b6179067e953 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:25.167295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:25.168284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=36 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:25.175620 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4c8c26b-3e34-473b-b02e-b6179067e953 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:25.176460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4c8c26b-3e34-473b-b02e-b6179067e953 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:25.178712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4c8c26b-3e34-473b-b02e-b6179067e953 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:25.179172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a4c8c26b-3e34-473b-b02e-b6179067e953 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:25.320339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a4c8c26b-3e34-473b-b02e-b6179067e953 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:25.328234 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a4c8c26b-3e34-473b-b02e-b6179067e953 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1552 microversion: 2.1 time: 0.170483 Jul 20 04:53:25.328833 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3247/6481] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:25 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:26.346065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4cb49fd3-83a1-4040-8836-279acd6850c5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:26.346747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4cb49fd3-83a1-4040-8836-279acd6850c5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:26.353705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4cb49fd3-83a1-4040-8836-279acd6850c5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:26.354800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4cb49fd3-83a1-4040-8836-279acd6850c5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:26.355594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4cb49fd3-83a1-4040-8836-279acd6850c5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:26.356049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4cb49fd3-83a1-4040-8836-279acd6850c5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:26.494326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4cb49fd3-83a1-4040-8836-279acd6850c5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:26.502217 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4cb49fd3-83a1-4040-8836-279acd6850c5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 200 len: 1552 microversion: 2.1 time: 0.160481 Jul 20 04:53:26.502830 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3235/6482] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:26 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:26.977195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-bddf221a-7269-4c5a-9c00-06de96ea426f req-12027ae1-b781-4d00-becf-aa8a2c80ee64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40", "name": "network-vif-deleted", "tag": "5ab86b03-2068-48b0-9dc8-357626503920"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:26.988188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bddf221a-7269-4c5a-9c00-06de96ea426f req-12027ae1-b781-4d00-becf-aa8a2c80ee64 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:26.988771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bddf221a-7269-4c5a-9c00-06de96ea426f req-12027ae1-b781-4d00-becf-aa8a2c80ee64 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:27.002043 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-bddf221a-7269-4c5a-9c00-06de96ea426f req-12027ae1-b781-4d00-becf-aa8a2c80ee64 service nova] Creating event network-vif-deleted:5ab86b03-2068-48b0-9dc8-357626503920 for instance 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 on n-h1-760456-11 Jul 20 04:53:27.006936 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-bddf221a-7269-4c5a-9c00-06de96ea426f req-12027ae1-b781-4d00-becf-aa8a2c80ee64 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033588 Jul 20 04:53:27.007532 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3248/6483] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:27.519399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35f1274e-9bdc-45ed-a6c7-91b5a8281b22 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:27.520008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-35f1274e-9bdc-45ed-a6c7-91b5a8281b22 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:27.527708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f1274e-9bdc-45ed-a6c7-91b5a8281b22 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:27.528180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f1274e-9bdc-45ed-a6c7-91b5a8281b22 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:27.528973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f1274e-9bdc-45ed-a6c7-91b5a8281b22 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:27.529436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f1274e-9bdc-45ed-a6c7-91b5a8281b22 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:27.543515 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-35f1274e-9bdc-45ed-a6c7-91b5a8281b22 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] HTTP exception thrown: Instance 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 could not be found. Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35f1274e-9bdc-45ed-a6c7-91b5a8281b22 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Request method failure captured: Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 HTTP/1.1 Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14nixMlO5siLecetrB-fJHfkBTR_Zim1l29zm-jo7-P-EBGRLYj_jhjMZwQF-uVrQMejhDXLrgttWu8qpqWgNN0BsaT30ACYtLAu64HATId1SWN13lvTqa2Dc1Xa5mQbXL3skI_7_rm7T_s2YKFY11un7R98wNVxxc6Hfs0K0SPv0_0 Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: de3c68fe27d043e6a2a77d5201a41bc6 Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestNetworkBasicOps-1299453667 Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestNetworkBasicOps-1299453667 Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: de3c68fe27d043e6a2a77d5201a41bc6 Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestNetworkBasicOps-1299453667 Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestNetworkBasicOps-1299453667-project Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 1cebf52f619044e689d7c74258944ddf Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestNetworkBasicOps-1299453667-project Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 could not be found. Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40'} Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 could not be found. Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 could not be found. Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:27.545212 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:53:27.550954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:27.550954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:27.550954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:27.550954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:53:27.550954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:53:27.550954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 could not be found. Jul 20 04:53:27.550954 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:53:27.550954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35f1274e-9bdc-45ed-a6c7-91b5a8281b22 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Returning 404 to user: Instance 3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:53:27.550954 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-35f1274e-9bdc-45ed-a6c7-91b5a8281b22 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40" status: 404 len: 111 microversion: 2.1 time: 0.031411 Jul 20 04:53:27.550954 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3236/6484] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:27 2022] GET /compute/v2.1/servers/3a7d628f-8b8e-41ff-a3ce-7c5561bc8e40 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:53:27.709532 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dbafa715-f237-4a0d-b62c-ff56993a0c51 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '.version_select at 0x7fb840e9e0d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:27.731041 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dbafa715-f237-4a0d-b62c-ff56993a0c51 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2084981587" status: 202 len: 0 microversion: 2.1 time: 0.025759 Jul 20 04:53:27.731671 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3249/6485] 10.222.0.59 () {58 vars in 1256 bytes} [Wed Jul 20 04:53:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2084981587 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:53:29.991495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7668471a-b9fd-4e0a-b86b-82789526cbd5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:29.992021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7668471a-b9fd-4e0a-b86b-82789526cbd5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:29.999995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7668471a-b9fd-4e0a-b86b-82789526cbd5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:30.000204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-69e20680-c36a-472c-899a-506e8ee679b4 req-4132805a-3756-464a-bae0-55d7fe605e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e6bc49-6273-4c78-93c5-95d413c57fb8", "tag": "360aa579-fb9c-4691-afe3-cde8c652baa9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:30.000659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7668471a-b9fd-4e0a-b86b-82789526cbd5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:30.001254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7668471a-b9fd-4e0a-b86b-82789526cbd5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:30.001711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7668471a-b9fd-4e0a-b86b-82789526cbd5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:30.009694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-69e20680-c36a-472c-899a-506e8ee679b4 req-4132805a-3756-464a-bae0-55d7fe605e2a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:30.011670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-69e20680-c36a-472c-899a-506e8ee679b4 req-4132805a-3756-464a-bae0-55d7fe605e2a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:30.022227 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-69e20680-c36a-472c-899a-506e8ee679b4 req-4132805a-3756-464a-bae0-55d7fe605e2a service nova] Creating event network-changed:360aa579-fb9c-4691-afe3-cde8c652baa9 for instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 on n-h2-760456-11 Jul 20 04:53:30.027568 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-69e20680-c36a-472c-899a-506e8ee679b4 req-4132805a-3756-464a-bae0-55d7fe605e2a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032570 Jul 20 04:53:30.028320 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3250/6486] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:30.028839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7668471a-b9fd-4e0a-b86b-82789526cbd5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:53:30.117000 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7668471a-b9fd-4e0a-b86b-82789526cbd5 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 204 len: 0 microversion: 2.1 time: 0.129078 Jul 20 04:53:30.117607 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3237/6487] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:53:29 2022] DELETE /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:53:30.128409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce61ade6-7a0d-48da-a709-b76453741c2d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:30.129965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce61ade6-7a0d-48da-a709-b76453741c2d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:30.139851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce61ade6-7a0d-48da-a709-b76453741c2d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:30.140306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce61ade6-7a0d-48da-a709-b76453741c2d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:30.141088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce61ade6-7a0d-48da-a709-b76453741c2d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:30.141525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce61ade6-7a0d-48da-a709-b76453741c2d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:30.283418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce61ade6-7a0d-48da-a709-b76453741c2d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:30.291167 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce61ade6-7a0d-48da-a709-b76453741c2d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1670 microversion: 2.1 time: 0.167861 Jul 20 04:53:30.292412 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3251/6488] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:30 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:31.310516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-466f68a6-981d-4909-b166-12588f2b0cd6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:31.311381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-466f68a6-981d-4909-b166-12588f2b0cd6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:31.320357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-466f68a6-981d-4909-b166-12588f2b0cd6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:31.320833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-466f68a6-981d-4909-b166-12588f2b0cd6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:31.321637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-466f68a6-981d-4909-b166-12588f2b0cd6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:31.322096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-466f68a6-981d-4909-b166-12588f2b0cd6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:31.533058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-466f68a6-981d-4909-b166-12588f2b0cd6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:31.542965 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-466f68a6-981d-4909-b166-12588f2b0cd6 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 200 len: 1670 microversion: 2.1 time: 0.237292 Jul 20 04:53:31.552732 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3238/6489] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:31 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 1670 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:32.052023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e6c5444d-edc9-4ed1-b977-8ff5fb97ae45 req-6ecc8346-e9b3-4c19-860f-ed8882972f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e6bc49-6273-4c78-93c5-95d413c57fb8", "name": "network-vif-deleted", "tag": "360aa579-fb9c-4691-afe3-cde8c652baa9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:32.061255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e6c5444d-edc9-4ed1-b977-8ff5fb97ae45 req-6ecc8346-e9b3-4c19-860f-ed8882972f4d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:32.061710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e6c5444d-edc9-4ed1-b977-8ff5fb97ae45 req-6ecc8346-e9b3-4c19-860f-ed8882972f4d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:32.072381 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e6c5444d-edc9-4ed1-b977-8ff5fb97ae45 req-6ecc8346-e9b3-4c19-860f-ed8882972f4d service nova] Creating event network-vif-deleted:360aa579-fb9c-4691-afe3-cde8c652baa9 for instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 on n-h2-760456-11 Jul 20 04:53:32.078512 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e6c5444d-edc9-4ed1-b977-8ff5fb97ae45 req-6ecc8346-e9b3-4c19-860f-ed8882972f4d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166979 Jul 20 04:53:32.079090 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3252/6490] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:32.561255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-32d02e04-0e48-4406-aa6c-84b5d9c51dde tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:32.561859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-32d02e04-0e48-4406-aa6c-84b5d9c51dde tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: f8e6bc49-6273-4c78-93c5-95d413c57fb8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:32.569026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32d02e04-0e48-4406-aa6c-84b5d9c51dde tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:32.569498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32d02e04-0e48-4406-aa6c-84b5d9c51dde tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:32.570322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32d02e04-0e48-4406-aa6c-84b5d9c51dde tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:32.570783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-32d02e04-0e48-4406-aa6c-84b5d9c51dde tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:32.585016 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-32d02e04-0e48-4406-aa6c-84b5d9c51dde tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] HTTP exception thrown: Instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 could not be found. Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-32d02e04-0e48-4406-aa6c-84b5d9c51dde tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Request method failure captured: Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 HTTP/1.1 Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14nixMlO5siLecetrB-fJHfkBTR_Zim1l29zm-jo7-P-EBGRLYj_jhjMZwQF-uVrQMejhDXLrgttWu8qpqWgNN0BsaT30ACYtLAu64HATId1SWN13lvTqa2Dc1Xa5mQbXL3skI_7_rm7T_s2YKFY11un7R98wNVxxc6Hfs0K0SPv0_0 Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: de3c68fe27d043e6a2a77d5201a41bc6 Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestNetworkBasicOps-1299453667 Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestNetworkBasicOps-1299453667 Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: de3c68fe27d043e6a2a77d5201a41bc6 Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestNetworkBasicOps-1299453667 Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestNetworkBasicOps-1299453667-project Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 1cebf52f619044e689d7c74258944ddf Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestNetworkBasicOps-1299453667-project Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 could not be found. Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'f8e6bc49-6273-4c78-93c5-95d413c57fb8'} Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 could not be found. Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 could not be found. Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:32.586745 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:53:32.592916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:32.592916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:32.592916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:32.592916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:53:32.592916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:53:32.592916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 could not be found. Jul 20 04:53:32.592916 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:53:32.592916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-32d02e04-0e48-4406-aa6c-84b5d9c51dde tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Returning 404 to user: Instance f8e6bc49-6273-4c78-93c5-95d413c57fb8 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:53:32.592916 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-32d02e04-0e48-4406-aa6c-84b5d9c51dde tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8" status: 404 len: 111 microversion: 2.1 time: 0.031676 Jul 20 04:53:32.592916 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3239/6491] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:32 2022] GET /compute/v2.1/servers/f8e6bc49-6273-4c78-93c5-95d413c57fb8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:53:32.759389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8f0e1d8b-256d-48cc-a63b-a475bbc3b443 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '.version_select at 0x7fb841b71c10>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:32.781022 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8f0e1d8b-256d-48cc-a63b-a475bbc3b443 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1784688683" status: 202 len: 0 microversion: 2.1 time: 0.025877 Jul 20 04:53:32.782219 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3253/6492] 10.222.0.59 () {58 vars in 1256 bytes} [Wed Jul 20 04:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1784688683 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:53:41.287438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7cd79e9c-805b-4305-b890-5ab28c3ad543 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Action: 'create', calling method: .version_select at 0x7fb8414be040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1379303828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++5YKaXK2Y8HnsqVqGUcTNbJR6L/rB1oYjSCecrzWrzrPwXaEdBz6Fx7Y0CNNsNEiE9OIao4hJAj2JV3uMKWc4w8dXIDLqrAYo1zun1DbWkJNxcobwWGXfK+KBpw2lBw=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:41.307480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-7cd79e9c-805b-4305-b890-5ab28c3ad543 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:53:41.313062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-7cd79e9c-805b-4305-b890-5ab28c3ad543 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for user 1cebf52f619044e689d7c74258944ddf and project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:53:41.339209 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7cd79e9c-805b-4305-b890-5ab28c3ad543 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.055146 Jul 20 04:53:41.345315 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3240/6493] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:53:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:42.397851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-324694296", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "6069355a-a0a5-4c7d-9711-34b27bb819e2"}], "key_name": "tempest-TestNetworkBasicOps-1379303828", "security_groups": [{"name": "tempest-secgroup-smoke-1491665192"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:42.408387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=18 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:42.530528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] validate_networks() for [('6069355a-a0a5-4c7d-9711-34b27bb819e2', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:53:42.940281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:53:42.940851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:53:42.941406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:53:42.942069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:53:42.942586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:53:42.952792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:42.953330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:42.954214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:42.954868 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:42.979697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:53:42.985657 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Getting quotas for user 1cebf52f619044e689d7c74258944ddf and project de3c68fe27d043e6a2a77d5201a41bc6. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:53:43.000366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:53:43.002834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:53:43.070818 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d370edec-f70d-4305-9fc4-f21a37db2eb0 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.677390 Jul 20 04:53:43.071984 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3254/6494] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:53:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:53:43.080397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:43.084699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3d0985cd-0a8a-4426-a5d4-178a55f15f67 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:43.085590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3d0985cd-0a8a-4426-a5d4-178a55f15f67 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:43.173874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3d0985cd-0a8a-4426-a5d4-178a55f15f67 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:43.181459 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3d0985cd-0a8a-4426-a5d4-178a55f15f67 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1248 microversion: 2.1 time: 0.102679 Jul 20 04:53:43.192517 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3241/6495] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:43 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1248 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:44.201173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4caec695-34ba-41d1-aaba-630da4523e3b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:44.201800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4caec695-34ba-41d1-aaba-630da4523e3b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:44.209144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4caec695-34ba-41d1-aaba-630da4523e3b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:44.209614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4caec695-34ba-41d1-aaba-630da4523e3b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:44.210433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4caec695-34ba-41d1-aaba-630da4523e3b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:44.210884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4caec695-34ba-41d1-aaba-630da4523e3b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:44.285535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4caec695-34ba-41d1-aaba-630da4523e3b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:44.293932 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4caec695-34ba-41d1-aaba-630da4523e3b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1306 microversion: 2.1 time: 0.098230 Jul 20 04:53:44.294583 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3255/6496] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:44 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:45.312634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b2c822a8-405e-43bb-b07b-161c95655f9b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:45.313446 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b2c822a8-405e-43bb-b07b-161c95655f9b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:45.324589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2c822a8-405e-43bb-b07b-161c95655f9b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.325072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2c822a8-405e-43bb-b07b-161c95655f9b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.325887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2c822a8-405e-43bb-b07b-161c95655f9b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.326417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2c822a8-405e-43bb-b07b-161c95655f9b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.478708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a31a5430-dfd0-4ab6-a4d3-d9a13339d752 req-b580bdf9-d089-44d7-8aca-fffab75bd0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81976c35-434c-4ee4-81cf-aa8c659331de", "tag": "a4c54a16-a691-48d2-bd21-ee7476ec2cf8"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:45.489105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b2c822a8-405e-43bb-b07b-161c95655f9b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:45.493514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a31a5430-dfd0-4ab6-a4d3-d9a13339d752 req-b580bdf9-d089-44d7-8aca-fffab75bd0f1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.494983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a31a5430-dfd0-4ab6-a4d3-d9a13339d752 req-b580bdf9-d089-44d7-8aca-fffab75bd0f1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.498184 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b2c822a8-405e-43bb-b07b-161c95655f9b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1374 microversion: 2.1 time: 0.190497 Jul 20 04:53:45.505684 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3242/6497] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:45 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1374 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:45.512118 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a31a5430-dfd0-4ab6-a4d3-d9a13339d752 req-b580bdf9-d089-44d7-8aca-fffab75bd0f1 service nova] Creating event network-changed:a4c54a16-a691-48d2-bd21-ee7476ec2cf8 for instance 81976c35-434c-4ee4-81cf-aa8c659331de on n-h2-760456-11 Jul 20 04:53:45.518020 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a31a5430-dfd0-4ab6-a4d3-d9a13339d752 req-b580bdf9-d089-44d7-8aca-fffab75bd0f1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045094 Jul 20 04:53:45.518911 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3256/6498] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:53:46.522194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b187cfb-9204-476c-8524-43ac3af89991 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:46.522854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3b187cfb-9204-476c-8524-43ac3af89991 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:46.530270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b187cfb-9204-476c-8524-43ac3af89991 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.530761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b187cfb-9204-476c-8524-43ac3af89991 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.531545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b187cfb-9204-476c-8524-43ac3af89991 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.532002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3b187cfb-9204-476c-8524-43ac3af89991 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.665075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3b187cfb-9204-476c-8524-43ac3af89991 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:46.672953 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3b187cfb-9204-476c-8524-43ac3af89991 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1374 microversion: 2.1 time: 0.154681 Jul 20 04:53:46.673532 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3243/6499] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:46 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:47.690571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fac727da-6ebb-4655-9dac-47fbb9b927ec tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:47.691285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fac727da-6ebb-4655-9dac-47fbb9b927ec tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:47.699679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fac727da-6ebb-4655-9dac-47fbb9b927ec tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.700145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fac727da-6ebb-4655-9dac-47fbb9b927ec tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.700926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fac727da-6ebb-4655-9dac-47fbb9b927ec tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:47.701380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fac727da-6ebb-4655-9dac-47fbb9b927ec tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.847645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fac727da-6ebb-4655-9dac-47fbb9b927ec tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:47.856009 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fac727da-6ebb-4655-9dac-47fbb9b927ec tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1374 microversion: 2.1 time: 0.169660 Jul 20 04:53:47.857162 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3257/6500] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:47 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:48.873872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8a9694b8-0d1d-4202-8ff5-c31a8cafb159 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:48.874544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8a9694b8-0d1d-4202-8ff5-c31a8cafb159 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:48.881215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a9694b8-0d1d-4202-8ff5-c31a8cafb159 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.881726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a9694b8-0d1d-4202-8ff5-c31a8cafb159 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.882535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a9694b8-0d1d-4202-8ff5-c31a8cafb159 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.882996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a9694b8-0d1d-4202-8ff5-c31a8cafb159 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.016585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8a9694b8-0d1d-4202-8ff5-c31a8cafb159 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:49.024157 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8a9694b8-0d1d-4202-8ff5-c31a8cafb159 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1374 microversion: 2.1 time: 0.154848 Jul 20 04:53:49.024740 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3244/6501] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:48 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:50.041050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f35747ee-00bd-476a-9af3-04930b3944f7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:50.041636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f35747ee-00bd-476a-9af3-04930b3944f7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:50.049365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f35747ee-00bd-476a-9af3-04930b3944f7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:50.049816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f35747ee-00bd-476a-9af3-04930b3944f7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:50.050624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f35747ee-00bd-476a-9af3-04930b3944f7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:50.051065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f35747ee-00bd-476a-9af3-04930b3944f7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:50.184644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f35747ee-00bd-476a-9af3-04930b3944f7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:50.192241 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f35747ee-00bd-476a-9af3-04930b3944f7 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1374 microversion: 2.1 time: 0.155223 Jul 20 04:53:50.192820 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3258/6502] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:50 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:51.209359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-21f505a2-1214-4ded-9c88-7cf8b1e0bd4c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:51.210317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-21f505a2-1214-4ded-9c88-7cf8b1e0bd4c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:51.218771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21f505a2-1214-4ded-9c88-7cf8b1e0bd4c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:51.219256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21f505a2-1214-4ded-9c88-7cf8b1e0bd4c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:51.220059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21f505a2-1214-4ded-9c88-7cf8b1e0bd4c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:51.220512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-21f505a2-1214-4ded-9c88-7cf8b1e0bd4c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:51.355653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-21f505a2-1214-4ded-9c88-7cf8b1e0bd4c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:51.363145 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-21f505a2-1214-4ded-9c88-7cf8b1e0bd4c tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1374 microversion: 2.1 time: 0.158071 Jul 20 04:53:51.363720 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3245/6503] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:51 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:51.545559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9840bc57-cbbe-4f9e-a18a-7fe39d6f73cd req-61e37e4d-77a4-4807-8cf0-fb762c2af8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81976c35-434c-4ee4-81cf-aa8c659331de", "name": "network-vif-plugged", "status": "completed", "tag": "a4c54a16-a691-48d2-bd21-ee7476ec2cf8"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:51.554442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9840bc57-cbbe-4f9e-a18a-7fe39d6f73cd req-61e37e4d-77a4-4807-8cf0-fb762c2af8e2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:51.555008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9840bc57-cbbe-4f9e-a18a-7fe39d6f73cd req-61e37e4d-77a4-4807-8cf0-fb762c2af8e2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:51.567193 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9840bc57-cbbe-4f9e-a18a-7fe39d6f73cd req-61e37e4d-77a4-4807-8cf0-fb762c2af8e2 service nova] Creating event network-vif-plugged:a4c54a16-a691-48d2-bd21-ee7476ec2cf8 for instance 81976c35-434c-4ee4-81cf-aa8c659331de on n-h2-760456-11 Jul 20 04:53:51.572067 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9840bc57-cbbe-4f9e-a18a-7fe39d6f73cd req-61e37e4d-77a4-4807-8cf0-fb762c2af8e2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030349 Jul 20 04:53:51.572692 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3259/6504] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:53:52.382979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-55965c8e-bb14-4f43-8707-4aa1838abc16 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:52.383543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-55965c8e-bb14-4f43-8707-4aa1838abc16 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:52.390506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55965c8e-bb14-4f43-8707-4aa1838abc16 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.390975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55965c8e-bb14-4f43-8707-4aa1838abc16 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.391756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55965c8e-bb14-4f43-8707-4aa1838abc16 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.392204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55965c8e-bb14-4f43-8707-4aa1838abc16 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.529317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-55965c8e-bb14-4f43-8707-4aa1838abc16 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:52.536716 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-55965c8e-bb14-4f43-8707-4aa1838abc16 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1374 microversion: 2.1 time: 0.159278 Jul 20 04:53:52.537282 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3246/6505] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:52 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:53.551724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:53.552500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:53.556889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ede63eb7-b6a8-4f35-8ae9-d28801456ccb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:53.557663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ede63eb7-b6a8-4f35-8ae9-d28801456ccb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:53.565520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ede63eb7-b6a8-4f35-8ae9-d28801456ccb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.565978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ede63eb7-b6a8-4f35-8ae9-d28801456ccb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.566767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ede63eb7-b6a8-4f35-8ae9-d28801456ccb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.567209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ede63eb7-b6a8-4f35-8ae9-d28801456ccb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.708366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ede63eb7-b6a8-4f35-8ae9-d28801456ccb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:53.716618 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ede63eb7-b6a8-4f35-8ae9-d28801456ccb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1545 microversion: 2.1 time: 0.166740 Jul 20 04:53:53.717208 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3260/6506] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:53 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1545 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:53.733775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29a820a0-c0f1-48ba-8845-b6bb42b97c46 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:53.734439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-29a820a0-c0f1-48ba-8845-b6bb42b97c46 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:53.736309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:53.742724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29a820a0-c0f1-48ba-8845-b6bb42b97c46 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.743451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29a820a0-c0f1-48ba-8845-b6bb42b97c46 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.744234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29a820a0-c0f1-48ba-8845-b6bb42b97c46 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.744689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29a820a0-c0f1-48ba-8845-b6bb42b97c46 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.878350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-29a820a0-c0f1-48ba-8845-b6bb42b97c46 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:53.886082 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-29a820a0-c0f1-48ba-8845-b6bb42b97c46 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1545 microversion: 2.1 time: 0.157036 Jul 20 04:53:53.886685 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3247/6507] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:53 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1545 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:55.915137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-43ea3d6d-ed41-4155-98df-e9075597457d req-67dda3df-7907-493a-a6f7-7bef6641eb2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81976c35-434c-4ee4-81cf-aa8c659331de", "tag": "a4c54a16-a691-48d2-bd21-ee7476ec2cf8"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:55.924334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:55.926879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-43ea3d6d-ed41-4155-98df-e9075597457d req-67dda3df-7907-493a-a6f7-7bef6641eb2d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:55.927609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-43ea3d6d-ed41-4155-98df-e9075597457d req-67dda3df-7907-493a-a6f7-7bef6641eb2d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:55.941365 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-43ea3d6d-ed41-4155-98df-e9075597457d req-67dda3df-7907-493a-a6f7-7bef6641eb2d service nova] Creating event network-changed:a4c54a16-a691-48d2-bd21-ee7476ec2cf8 for instance 81976c35-434c-4ee4-81cf-aa8c659331de on n-h2-760456-11 Jul 20 04:53:55.947073 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-43ea3d6d-ed41-4155-98df-e9075597457d req-67dda3df-7907-493a-a6f7-7bef6641eb2d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036958 Jul 20 04:53:55.947866 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3261/6508] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:54:18.204999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6ee11f1a-aaf4-4aac-bb0a-198028284c89 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:18.206007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6ee11f1a-aaf4-4aac-bb0a-198028284c89 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:18.208367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:18.209116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=36 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:18.216424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ee11f1a-aaf4-4aac-bb0a-198028284c89 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:18.216943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ee11f1a-aaf4-4aac-bb0a-198028284c89 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:18.217750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ee11f1a-aaf4-4aac-bb0a-198028284c89 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:18.218213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ee11f1a-aaf4-4aac-bb0a-198028284c89 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:18.274690 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6ee11f1a-aaf4-4aac-bb0a-198028284c89 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "POST /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de/action" status: 200 len: 24567 microversion: 2.1 time: 0.073559 Jul 20 04:54:18.275343 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3248/6509] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:54:18 2022] POST /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de/action => generated 24567 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:54:24.741155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d970b14f-10fc-4170-8760-fe1bb320b5a3 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:24.742166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d970b14f-10fc-4170-8760-fe1bb320b5a3 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:24.744574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=32 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:24.751250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d970b14f-10fc-4170-8760-fe1bb320b5a3 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:24.751704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d970b14f-10fc-4170-8760-fe1bb320b5a3 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:24.752468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d970b14f-10fc-4170-8760-fe1bb320b5a3 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:24.752911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d970b14f-10fc-4170-8760-fe1bb320b5a3 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:24.802731 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d970b14f-10fc-4170-8760-fe1bb320b5a3 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "POST /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de/action" status: 200 len: 32637 microversion: 2.1 time: 0.066234 Jul 20 04:54:24.803382 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3262/6510] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 04:54:24 2022] POST /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de/action => generated 32637 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:54:25.897810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dc6600ec-c6f7-48d4-85b0-dadca64cd77b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:25.898816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-42dd34c3-47f5-4daf-84ec-a4426ab3ed28 req-dcbf0ce6-8112-4c23-9233-13b9f6a7e43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81976c35-434c-4ee4-81cf-aa8c659331de", "tag": "a4c54a16-a691-48d2-bd21-ee7476ec2cf8"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:25.899859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dc6600ec-c6f7-48d4-85b0-dadca64cd77b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:25.912966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc6600ec-c6f7-48d4-85b0-dadca64cd77b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.913836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc6600ec-c6f7-48d4-85b0-dadca64cd77b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.915202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-42dd34c3-47f5-4daf-84ec-a4426ab3ed28 req-dcbf0ce6-8112-4c23-9233-13b9f6a7e43b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.915353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc6600ec-c6f7-48d4-85b0-dadca64cd77b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.915933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-42dd34c3-47f5-4daf-84ec-a4426ab3ed28 req-dcbf0ce6-8112-4c23-9233-13b9f6a7e43b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.916058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dc6600ec-c6f7-48d4-85b0-dadca64cd77b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.937761 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-42dd34c3-47f5-4daf-84ec-a4426ab3ed28 req-dcbf0ce6-8112-4c23-9233-13b9f6a7e43b service nova] Creating event network-changed:a4c54a16-a691-48d2-bd21-ee7476ec2cf8 for instance 81976c35-434c-4ee4-81cf-aa8c659331de on n-h2-760456-11 Jul 20 04:54:25.946368 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-42dd34c3-47f5-4daf-84ec-a4426ab3ed28 req-dcbf0ce6-8112-4c23-9233-13b9f6a7e43b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054533 Jul 20 04:54:25.948329 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3263/6511] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:25.960105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dc6600ec-c6f7-48d4-85b0-dadca64cd77b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:54:26.047823 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dc6600ec-c6f7-48d4-85b0-dadca64cd77b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "DELETE /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 204 len: 0 microversion: 2.1 time: 0.157549 Jul 20 04:54:26.048482 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3249/6512] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:54:25 2022] DELETE /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:54:26.057927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a78179cd-d845-439c-bc8b-8692944cac31 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:26.058767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a78179cd-d845-439c-bc8b-8692944cac31 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:26.065860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a78179cd-d845-439c-bc8b-8692944cac31 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.066462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a78179cd-d845-439c-bc8b-8692944cac31 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.067338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a78179cd-d845-439c-bc8b-8692944cac31 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.067851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a78179cd-d845-439c-bc8b-8692944cac31 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.218723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a78179cd-d845-439c-bc8b-8692944cac31 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:26.226715 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a78179cd-d845-439c-bc8b-8692944cac31 tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1670 microversion: 2.1 time: 0.173430 Jul 20 04:54:26.227303 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3264/6513] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:26 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:27.246428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-698e496d-200b-4f06-b559-5df618f1b17d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:27.247803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-698e496d-200b-4f06-b559-5df618f1b17d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:27.256407 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-698e496d-200b-4f06-b559-5df618f1b17d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.256882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-698e496d-200b-4f06-b559-5df618f1b17d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.257912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-698e496d-200b-4f06-b559-5df618f1b17d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.258410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-698e496d-200b-4f06-b559-5df618f1b17d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.406295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-698e496d-200b-4f06-b559-5df618f1b17d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cebf52f619044e689d7c74258944ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3c68fe27d043e6a2a77d5201a41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:27.413904 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-698e496d-200b-4f06-b559-5df618f1b17d tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 200 len: 1670 microversion: 2.1 time: 0.172681 Jul 20 04:54:27.414513 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3250/6514] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:27 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:27.932640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-d950dff6-a48e-489b-950b-1616bed4fdea req-db6bdae8-5330-49a3-a921-a1f46fcacebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81976c35-434c-4ee4-81cf-aa8c659331de", "name": "network-vif-deleted", "tag": "a4c54a16-a691-48d2-bd21-ee7476ec2cf8"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:27.942422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d950dff6-a48e-489b-950b-1616bed4fdea req-db6bdae8-5330-49a3-a921-a1f46fcacebb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.942888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d950dff6-a48e-489b-950b-1616bed4fdea req-db6bdae8-5330-49a3-a921-a1f46fcacebb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.955708 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-d950dff6-a48e-489b-950b-1616bed4fdea req-db6bdae8-5330-49a3-a921-a1f46fcacebb service nova] Creating event network-vif-deleted:a4c54a16-a691-48d2-bd21-ee7476ec2cf8 for instance 81976c35-434c-4ee4-81cf-aa8c659331de on n-h2-760456-11 Jul 20 04:54:27.960862 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-d950dff6-a48e-489b-950b-1616bed4fdea req-db6bdae8-5330-49a3-a921-a1f46fcacebb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032641 Jul 20 04:54:27.961464 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3265/6515] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:28.432562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d248ea3-0503-47de-84b9-23d92a02d7eb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:28.433110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8d248ea3-0503-47de-84b9-23d92a02d7eb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] [instance: 81976c35-434c-4ee4-81cf-aa8c659331de] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:28.439938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d248ea3-0503-47de-84b9-23d92a02d7eb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:28.440401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d248ea3-0503-47de-84b9-23d92a02d7eb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:28.441178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d248ea3-0503-47de-84b9-23d92a02d7eb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:28.441629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d248ea3-0503-47de-84b9-23d92a02d7eb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:28.455486 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-8d248ea3-0503-47de-84b9-23d92a02d7eb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] HTTP exception thrown: Instance 81976c35-434c-4ee4-81cf-aa8c659331de could not be found. Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d248ea3-0503-47de-84b9-23d92a02d7eb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Request method failure captured: Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de HTTP/1.1 Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14nixMlO5siLecetrB-fJHfkBTR_Zim1l29zm-jo7-P-EBGRLYj_jhjMZwQF-uVrQMejhDXLrgttWu8qpqWgNN0BsaT30ACYtLAu64HATId1SWN13lvTqa2Dc1Xa5mQbXL3skI_7_rm7T_s2YKFY11un7R98wNVxxc6Hfs0K0SPv0_0 Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: de3c68fe27d043e6a2a77d5201a41bc6 Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestNetworkBasicOps-1299453667 Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_de3c68fe27d043e6a2a77d5201a41bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestNetworkBasicOps-1299453667 Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: de3c68fe27d043e6a2a77d5201a41bc6 Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestNetworkBasicOps-1299453667 Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestNetworkBasicOps-1299453667-project Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 1cebf52f619044e689d7c74258944ddf Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestNetworkBasicOps-1299453667-project Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 81976c35-434c-4ee4-81cf-aa8c659331de could not be found. Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '81976c35-434c-4ee4-81cf-aa8c659331de'} Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81976c35-434c-4ee4-81cf-aa8c659331de could not be found. Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81976c35-434c-4ee4-81cf-aa8c659331de could not be found. Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:28.457115 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:54:28.463711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:28.463711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:28.463711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:28.463711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:28.463711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:28.463711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81976c35-434c-4ee4-81cf-aa8c659331de could not be found. Jul 20 04:54:28.463711 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:54:28.463711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d248ea3-0503-47de-84b9-23d92a02d7eb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Returning 404 to user: Instance 81976c35-434c-4ee4-81cf-aa8c659331de could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:28.463711 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8d248ea3-0503-47de-84b9-23d92a02d7eb tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de" status: 404 len: 111 microversion: 2.1 time: 0.030418 Jul 20 04:54:28.463711 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3251/6516] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:28 2022] GET /compute/v2.1/servers/81976c35-434c-4ee4-81cf-aa8c659331de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:54:28.627678 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c01aae4f-c0b6-44a0-8325-2dea7ccbf37b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] Calling method '.version_select at 0x7fb8421631f0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:28.649149 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c01aae4f-c0b6-44a0-8325-2dea7ccbf37b tempest-TestNetworkBasicOps-1299453667 tempest-TestNetworkBasicOps-1299453667-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1379303828" status: 202 len: 0 microversion: 2.1 time: 0.026496 Jul 20 04:54:28.649763 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3266/6517] 10.222.0.59 () {58 vars in 1256 bytes} [Wed Jul 20 04:54:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1379303828 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:54:46.131539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:46.132316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:46.310110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ced1175-32df-4d09-8920-df1ea16fe886 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Action: 'create', calling method: .version_select at 0x7fb841cea1f0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1939096064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0s5XLIAtcCHP/JtHxsvTqZvNBFNHQh3vnatK0dA6c+HRP9FJt3NhRX3o5Xbr1Fivayt7/9WAQq+Lr1ITqE4ZhlXM3o8eYIoaPrfdGcvO0MvdTaQuOs1nMSLxyb06SiFg=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:46.324918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4ced1175-32df-4d09-8920-df1ea16fe886 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Getting quotas for project 091c058b47a14a9b89f52cef7faed7f9. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:54:46.331199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-4ced1175-32df-4d09-8920-df1ea16fe886 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Getting quotas for user bf33d6998b394b83aed475ad126de15a and project 091c058b47a14a9b89f52cef7faed7f9. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:54:46.356885 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ced1175-32df-4d09-8920-df1ea16fe886 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.231071 Jul 20 04:54:46.357508 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3252/6518] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 04:54:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:47.528703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=14 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:47.529688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:47.534530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1892351225", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1939096064", "security_groups": [{"name": "tempest-secgroup-smoke-787960168"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "aca3bb46-8355-4006-afc0-95063e85fadf"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:47.646442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] validate_networks() for [('aca3bb46-8355-4006-afc0-95063e85fadf', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:54:48.156336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Getting quotas for project 091c058b47a14a9b89f52cef7faed7f9. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:54:48.161527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Getting quotas for user bf33d6998b394b83aed475ad126de15a and project 091c058b47a14a9b89f52cef7faed7f9. Resources: dict_keys(['metadata_items']) {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:54:48.174830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:54:48.175265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:54:48.175751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:54:48.176173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:54:48.176600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:54:48.185046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:48.185510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:48.186390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:48.186842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:48.204928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Getting quotas for project 091c058b47a14a9b89f52cef7faed7f9. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:54:48.210688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Getting quotas for user bf33d6998b394b83aed475ad126de15a and project 091c058b47a14a9b89f52cef7faed7f9. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:54:48.224373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:54:48.226863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:54:48.273087 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-16dc683c-96cf-4712-a8bb-8ae614d449b8 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746161 Jul 20 04:54:48.273747 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3267/6519] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 04:54:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:54:48.284261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e0c72bbc-8656-4915-bba2-21b5379a1fa2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:48.284905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e0c72bbc-8656-4915-bba2-21b5379a1fa2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:48.343672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e0c72bbc-8656-4915-bba2-21b5379a1fa2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:48.351565 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e0c72bbc-8656-4915-bba2-21b5379a1fa2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1303 microversion: 2.1 time: 0.071230 Jul 20 04:54:48.352224 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3253/6520] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:48 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1303 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:49.371313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5983c2f-b77d-497e-9a51-600ae49fce2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:49.372642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5983c2f-b77d-497e-9a51-600ae49fce2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:49.380612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5983c2f-b77d-497e-9a51-600ae49fce2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:49.381056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5983c2f-b77d-497e-9a51-600ae49fce2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:49.382223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5983c2f-b77d-497e-9a51-600ae49fce2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:49.382930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5983c2f-b77d-497e-9a51-600ae49fce2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:49.460453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a5983c2f-b77d-497e-9a51-600ae49fce2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:49.475168 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5983c2f-b77d-497e-9a51-600ae49fce2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1361 microversion: 2.1 time: 0.109495 Jul 20 04:54:49.475783 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3268/6521] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:49 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1361 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:50.494968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-04b97638-7f80-45df-88d0-8ce19ca19ad1 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:50.495618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-04b97638-7f80-45df-88d0-8ce19ca19ad1 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:50.505500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04b97638-7f80-45df-88d0-8ce19ca19ad1 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:50.506205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04b97638-7f80-45df-88d0-8ce19ca19ad1 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:50.508121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04b97638-7f80-45df-88d0-8ce19ca19ad1 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:50.508862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-04b97638-7f80-45df-88d0-8ce19ca19ad1 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:50.816304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-04b97638-7f80-45df-88d0-8ce19ca19ad1 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:50.825438 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-04b97638-7f80-45df-88d0-8ce19ca19ad1 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1428 microversion: 2.1 time: 0.335248 Jul 20 04:54:50.826594 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3254/6522] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:50 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1428 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:51.202957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c45d7218-d8d3-4872-a304-d553e5d0a4e6 req-723d3466-432b-4e53-bfdc-ed153294ce38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b40acbc-0aab-4e71-8751-031e4d217845", "tag": "a480ccf6-7bcb-46d5-90d2-2c00fa89d294"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:51.212502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c45d7218-d8d3-4872-a304-d553e5d0a4e6 req-723d3466-432b-4e53-bfdc-ed153294ce38 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:51.213384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c45d7218-d8d3-4872-a304-d553e5d0a4e6 req-723d3466-432b-4e53-bfdc-ed153294ce38 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:51.234668 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c45d7218-d8d3-4872-a304-d553e5d0a4e6 req-723d3466-432b-4e53-bfdc-ed153294ce38 service nova] Creating event network-changed:a480ccf6-7bcb-46d5-90d2-2c00fa89d294 for instance 7b40acbc-0aab-4e71-8751-031e4d217845 on n-h2-760456-11 Jul 20 04:54:51.240755 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c45d7218-d8d3-4872-a304-d553e5d0a4e6 req-723d3466-432b-4e53-bfdc-ed153294ce38 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042868 Jul 20 04:54:51.241896 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3269/6523] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:51.843657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3ba018b4-cb66-4c7e-909d-c876eed9d115 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:51.844394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3ba018b4-cb66-4c7e-909d-c876eed9d115 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:51.851428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ba018b4-cb66-4c7e-909d-c876eed9d115 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:51.851896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ba018b4-cb66-4c7e-909d-c876eed9d115 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:51.852672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ba018b4-cb66-4c7e-909d-c876eed9d115 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:51.853412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ba018b4-cb66-4c7e-909d-c876eed9d115 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:51.992834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3ba018b4-cb66-4c7e-909d-c876eed9d115 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:52.000612 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3ba018b4-cb66-4c7e-909d-c876eed9d115 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1428 microversion: 2.1 time: 0.160918 Jul 20 04:54:52.001294 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3255/6524] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:51 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1428 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:53.019874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-41fe4124-f88e-41d1-927f-676c0b4b85c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:53.020581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-41fe4124-f88e-41d1-927f-676c0b4b85c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:53.027124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41fe4124-f88e-41d1-927f-676c0b4b85c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:53.027583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41fe4124-f88e-41d1-927f-676c0b4b85c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:53.028356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41fe4124-f88e-41d1-927f-676c0b4b85c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:53.028806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41fe4124-f88e-41d1-927f-676c0b4b85c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:53.169573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-41fe4124-f88e-41d1-927f-676c0b4b85c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:53.177117 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-41fe4124-f88e-41d1-927f-676c0b4b85c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1428 microversion: 2.1 time: 0.162425 Jul 20 04:54:53.177721 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3270/6525] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:53 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1428 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:54.194845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-24ef3c0f-96db-48ed-8057-225d3f2cc8f5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:54.195488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-24ef3c0f-96db-48ed-8057-225d3f2cc8f5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:54.203206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24ef3c0f-96db-48ed-8057-225d3f2cc8f5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:54.203679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24ef3c0f-96db-48ed-8057-225d3f2cc8f5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:54.204470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24ef3c0f-96db-48ed-8057-225d3f2cc8f5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:54.204926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24ef3c0f-96db-48ed-8057-225d3f2cc8f5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:54.340121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24ef3c0f-96db-48ed-8057-225d3f2cc8f5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:54.347695 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-24ef3c0f-96db-48ed-8057-225d3f2cc8f5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1428 microversion: 2.1 time: 0.157154 Jul 20 04:54:54.348295 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3256/6526] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:54 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1428 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:55.363869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-db3d7758-951b-4876-83fa-fa6123b37b2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:55.364495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-db3d7758-951b-4876-83fa-fa6123b37b2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:55.372238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db3d7758-951b-4876-83fa-fa6123b37b2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:55.372694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db3d7758-951b-4876-83fa-fa6123b37b2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:55.373468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db3d7758-951b-4876-83fa-fa6123b37b2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:55.373911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-db3d7758-951b-4876-83fa-fa6123b37b2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:55.508285 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-db3d7758-951b-4876-83fa-fa6123b37b2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:55.516821 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-db3d7758-951b-4876-83fa-fa6123b37b2a tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1428 microversion: 2.1 time: 0.156885 Jul 20 04:54:55.517397 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3271/6527] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:55 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1428 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:56.066073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-da6c1cc4-9306-412a-a89b-a44153a95a8b req-2094edff-8cbd-4202-a51a-3618fa441f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b40acbc-0aab-4e71-8751-031e4d217845", "name": "network-vif-plugged", "status": "completed", "tag": "a480ccf6-7bcb-46d5-90d2-2c00fa89d294"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:56.075628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-da6c1cc4-9306-412a-a89b-a44153a95a8b req-2094edff-8cbd-4202-a51a-3618fa441f8a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:56.076101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-da6c1cc4-9306-412a-a89b-a44153a95a8b req-2094edff-8cbd-4202-a51a-3618fa441f8a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:56.086873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-da6c1cc4-9306-412a-a89b-a44153a95a8b req-2094edff-8cbd-4202-a51a-3618fa441f8a service nova] Creating event network-vif-plugged:a480ccf6-7bcb-46d5-90d2-2c00fa89d294 for instance 7b40acbc-0aab-4e71-8751-031e4d217845 on n-h2-760456-11 Jul 20 04:54:56.092439 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-da6c1cc4-9306-412a-a89b-a44153a95a8b req-2094edff-8cbd-4202-a51a-3618fa441f8a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250610 Jul 20 04:54:56.093029 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3257/6528] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:56.533946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1a8ddeb6-0f7a-4c47-98dc-7f610ed223ff tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:56.534604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1a8ddeb6-0f7a-4c47-98dc-7f610ed223ff tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:56.542264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a8ddeb6-0f7a-4c47-98dc-7f610ed223ff tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:56.542891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a8ddeb6-0f7a-4c47-98dc-7f610ed223ff tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:56.543698 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a8ddeb6-0f7a-4c47-98dc-7f610ed223ff tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:56.544152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1a8ddeb6-0f7a-4c47-98dc-7f610ed223ff tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:56.682286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1a8ddeb6-0f7a-4c47-98dc-7f610ed223ff tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:56.689884 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1a8ddeb6-0f7a-4c47-98dc-7f610ed223ff tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1428 microversion: 2.1 time: 0.160015 Jul 20 04:54:56.690498 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3272/6529] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:56 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:57.707463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a1ddf847-bbcc-4ba3-b71d-d691200af6ae tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:57.708191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a1ddf847-bbcc-4ba3-b71d-d691200af6ae tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:57.715581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1ddf847-bbcc-4ba3-b71d-d691200af6ae tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.716057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1ddf847-bbcc-4ba3-b71d-d691200af6ae tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:57.716846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1ddf847-bbcc-4ba3-b71d-d691200af6ae tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.717309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1ddf847-bbcc-4ba3-b71d-d691200af6ae tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:57.853553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a1ddf847-bbcc-4ba3-b71d-d691200af6ae tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:57.863225 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a1ddf847-bbcc-4ba3-b71d-d691200af6ae tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1608 microversion: 2.1 time: 0.160079 Jul 20 04:54:57.863821 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3258/6530] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:57 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1608 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:57.880723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-69c9efd0-97b5-409b-a96c-c8e4ba9b898c tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:57.881346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-69c9efd0-97b5-409b-a96c-c8e4ba9b898c tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:57.888892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69c9efd0-97b5-409b-a96c-c8e4ba9b898c tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.889359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69c9efd0-97b5-409b-a96c-c8e4ba9b898c tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:57.890168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69c9efd0-97b5-409b-a96c-c8e4ba9b898c tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.890643 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69c9efd0-97b5-409b-a96c-c8e4ba9b898c tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:58.024341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-69c9efd0-97b5-409b-a96c-c8e4ba9b898c tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:58.032697 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-69c9efd0-97b5-409b-a96c-c8e4ba9b898c tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1608 microversion: 2.1 time: 0.156201 Jul 20 04:54:58.033263 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3273/6531] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:57 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1608 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:58.048510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e7f3162-6c60-4e44-be1e-1a63447196c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:58.049149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e7f3162-6c60-4e44-be1e-1a63447196c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:58.055290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e7f3162-6c60-4e44-be1e-1a63447196c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:58.055758 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e7f3162-6c60-4e44-be1e-1a63447196c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:58.056539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e7f3162-6c60-4e44-be1e-1a63447196c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:58.057057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e7f3162-6c60-4e44-be1e-1a63447196c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:58.203929 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e7f3162-6c60-4e44-be1e-1a63447196c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:58.210648 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e7f3162-6c60-4e44-be1e-1a63447196c9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1608 microversion: 2.1 time: 0.166009 Jul 20 04:54:58.211244 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3259/6532] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:58 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1608 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:59.887391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-70094a03-e7ad-463d-ac59-4f43f2a80f2e req-a95e7341-8f1b-47ca-83ed-19411045b390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b40acbc-0aab-4e71-8751-031e4d217845", "tag": "a480ccf6-7bcb-46d5-90d2-2c00fa89d294"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:59.891042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:59.892092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=10 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:59.900108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-70094a03-e7ad-463d-ac59-4f43f2a80f2e req-a95e7341-8f1b-47ca-83ed-19411045b390 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:59.901072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-70094a03-e7ad-463d-ac59-4f43f2a80f2e req-a95e7341-8f1b-47ca-83ed-19411045b390 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:59.912594 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-70094a03-e7ad-463d-ac59-4f43f2a80f2e req-a95e7341-8f1b-47ca-83ed-19411045b390 service nova] Creating event network-changed:a480ccf6-7bcb-46d5-90d2-2c00fa89d294 for instance 7b40acbc-0aab-4e71-8751-031e4d217845 on n-h2-760456-11 Jul 20 04:54:59.918440 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-70094a03-e7ad-463d-ac59-4f43f2a80f2e req-a95e7341-8f1b-47ca-83ed-19411045b390 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034799 Jul 20 04:54:59.919171 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3274/6533] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:55:35.973646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-88f60c8c-4062-4e44-9eae-649b64c77a00 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:35.974285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-88f60c8c-4062-4e44-9eae-649b64c77a00 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:35.976473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:35.977311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:35.978004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=32 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:35.985698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88f60c8c-4062-4e44-9eae-649b64c77a00 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:35.986180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88f60c8c-4062-4e44-9eae-649b64c77a00 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:35.987014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88f60c8c-4062-4e44-9eae-649b64c77a00 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:35.987473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-88f60c8c-4062-4e44-9eae-649b64c77a00 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:36.015263 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-88f60c8c-4062-4e44-9eae-649b64c77a00 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.045627 Jul 20 04:55:36.015894 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3260/6534] 10.222.0.59 () {58 vars in 1292 bytes} [Wed Jul 20 04:55:35 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845/os-server-password => generated 116 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:16.411446 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:57:16.412064 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 04:57:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:57:25.824641 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:57:25.825400 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 04:57:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:57:30.775269 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:57:30.775738 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 04:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:57:43.788365 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:57:43.788905 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 04:57:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:58:40.608608 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 04:58:40.609233 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 04:58:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 04:59:39.484012 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33eca72a-4e3b-4f88-b8f7-6f5bf76f74ec] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 04:59:39.485547 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0d612395-2abe-406a-94ab-07f31ffa6d77] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 04:59:39.485739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:39.486672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=36 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:39.491554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c238bd39-3214-43cc-9eca-8dfd9e4cb1b2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:39.492151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c238bd39-3214-43cc-9eca-8dfd9e4cb1b2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:39.501184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c238bd39-3214-43cc-9eca-8dfd9e4cb1b2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:39.501644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c238bd39-3214-43cc-9eca-8dfd9e4cb1b2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:39.502488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c238bd39-3214-43cc-9eca-8dfd9e4cb1b2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:39.502932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c238bd39-3214-43cc-9eca-8dfd9e4cb1b2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:39.531311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c238bd39-3214-43cc-9eca-8dfd9e4cb1b2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:59:39.611038 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c238bd39-3214-43cc-9eca-8dfd9e4cb1b2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 204 len: 0 microversion: 2.1 time: 0.128706 Jul 20 04:59:39.611715 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3275/6535] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:59:39 2022] DELETE /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:59:39.618693 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec14a2d6-59f0-443f-9e2b-92ddf2d0a5cf] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 04:59:39.619859 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac98bfe5-b186-469e-8e5c-23ebe79e6c0b] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 04:59:39.620333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:39.621091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:39.625352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d4142a3e-1b5e-4eb8-9e40-90f00e36bfc5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:39.625981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d4142a3e-1b5e-4eb8-9e40-90f00e36bfc5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:39.635116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4142a3e-1b5e-4eb8-9e40-90f00e36bfc5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:39.635582 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4142a3e-1b5e-4eb8-9e40-90f00e36bfc5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:39.636371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4142a3e-1b5e-4eb8-9e40-90f00e36bfc5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:39.636823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d4142a3e-1b5e-4eb8-9e40-90f00e36bfc5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:39.868472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d4142a3e-1b5e-4eb8-9e40-90f00e36bfc5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:39.876268 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d4142a3e-1b5e-4eb8-9e40-90f00e36bfc5 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1732 microversion: 2.1 time: 0.259642 Jul 20 04:59:39.876836 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3261/6536] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:39 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1732 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:40.894966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6eb43bb-36ba-4d1e-b295-869f6abf30b9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:40.896207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d6eb43bb-36ba-4d1e-b295-869f6abf30b9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:40.911229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6eb43bb-36ba-4d1e-b295-869f6abf30b9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:40.913042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6eb43bb-36ba-4d1e-b295-869f6abf30b9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:40.913844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6eb43bb-36ba-4d1e-b295-869f6abf30b9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:40.914314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6eb43bb-36ba-4d1e-b295-869f6abf30b9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:40.922295 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] [0d612395-2abe-406a-94ab-07f31ffa6d77] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 45796. Jul 20 04:59:40.923017 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] [33eca72a-4e3b-4f88-b8f7-6f5bf76f74ec] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 45794. Jul 20 04:59:41.163994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d6eb43bb-36ba-4d1e-b295-869f6abf30b9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:41.171565 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d6eb43bb-36ba-4d1e-b295-869f6abf30b9 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1732 microversion: 2.1 time: 0.280968 Jul 20 04:59:41.172144 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3276/6537] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:40 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1732 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:41.798055 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec14a2d6-59f0-443f-9e2b-92ddf2d0a5cf] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 45808. Jul 20 04:59:41.798904 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac98bfe5-b186-469e-8e5c-23ebe79e6c0b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 45810. Jul 20 04:59:41.877062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-fdbeb6a4-59c2-474c-a54c-8bf674bde8bb req-87135155-2fb3-4cf9-8f88-a14e8adeec2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b40acbc-0aab-4e71-8751-031e4d217845", "name": "network-vif-deleted", "tag": "a480ccf6-7bcb-46d5-90d2-2c00fa89d294"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:41.887702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fdbeb6a4-59c2-474c-a54c-8bf674bde8bb req-87135155-2fb3-4cf9-8f88-a14e8adeec2a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:41.888504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fdbeb6a4-59c2-474c-a54c-8bf674bde8bb req-87135155-2fb3-4cf9-8f88-a14e8adeec2a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:41.906740 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-fdbeb6a4-59c2-474c-a54c-8bf674bde8bb req-87135155-2fb3-4cf9-8f88-a14e8adeec2a service nova] Creating event network-vif-deleted:a480ccf6-7bcb-46d5-90d2-2c00fa89d294 for instance 7b40acbc-0aab-4e71-8751-031e4d217845 on n-h2-760456-11 Jul 20 04:59:41.922733 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-fdbeb6a4-59c2-474c-a54c-8bf674bde8bb req-87135155-2fb3-4cf9-8f88-a14e8adeec2a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138248 Jul 20 04:59:41.924013 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3262/6538] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:42.188684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:42.189386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:42.197098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:42.197671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:42.198772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:42.199296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:42.234568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:42.235139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:42.235861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lazy-loading 'fault' on Instance uuid 7b40acbc-0aab-4e71-8751-031e4d217845 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:59:42.282794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf33d6998b394b83aed475ad126de15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '091c058b47a14a9b89f52cef7faed7f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:42.290544 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-622e875a-8967-403e-baff-ff0693b34fc2 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 200 len: 1389 microversion: 2.1 time: 0.105863 Jul 20 04:59:42.291135 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3277/6539] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:42 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 1389 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:43.308987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e4581011-a404-4c15-bde8-e070e03e3cab tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:43.309714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e4581011-a404-4c15-bde8-e070e03e3cab tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:43.317016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4581011-a404-4c15-bde8-e070e03e3cab tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.317486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4581011-a404-4c15-bde8-e070e03e3cab tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.319106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4581011-a404-4c15-bde8-e070e03e3cab tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.319565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4581011-a404-4c15-bde8-e070e03e3cab tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.332749 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-e4581011-a404-4c15-bde8-e070e03e3cab tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] HTTP exception thrown: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e4581011-a404-4c15-bde8-e070e03e3cab tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Request method failure captured: Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 HTTP/1.1 Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14qQmfTnMx3JF8lW3glhNPcp3BruAKqb-CjWYBdzJW9SrEq9YNFZ8daHy9u_BoLyZmk8uMW6_F2q2eIRbuvwJm7PX2VL_uET12AxPgylWoX_B0lVhh_09yJPRoIe8TuveE2nZpegYaNKrCPSixmRpGjeYmQu_yoMBYo8T69gkD5vaFU Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 091c058b47a14a9b89f52cef7faed7f9 Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestServerBasicOps-441828477 Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestServerBasicOps-441828477 Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 091c058b47a14a9b89f52cef7faed7f9 Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestServerBasicOps-441828477 Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestServerBasicOps-441828477-project Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: bf33d6998b394b83aed475ad126de15a Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestServerBasicOps-441828477-project Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7b40acbc-0aab-4e71-8751-031e4d217845'} Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:43.334558 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.340767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:43.340767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:43.340767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:43.340767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:43.340767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:43.340767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.340767 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.340767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e4581011-a404-4c15-bde8-e070e03e3cab tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Returning 404 to user: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:43.340767 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e4581011-a404-4c15-bde8-e070e03e3cab tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 404 len: 111 microversion: 2.1 time: 0.031390 Jul 20 04:59:43.340767 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3263/6540] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:43 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:43.804211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6824366d-ce44-45d2-a79f-71f8e7025e81 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:43.804755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6824366d-ce44-45d2-a79f-71f8e7025e81 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:43.811571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6824366d-ce44-45d2-a79f-71f8e7025e81 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.812029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6824366d-ce44-45d2-a79f-71f8e7025e81 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.812797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6824366d-ce44-45d2-a79f-71f8e7025e81 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.813243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6824366d-ce44-45d2-a79f-71f8e7025e81 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.826757 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-6824366d-ce44-45d2-a79f-71f8e7025e81 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] HTTP exception thrown: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6824366d-ce44-45d2-a79f-71f8e7025e81 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Request method failure captured: Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 HTTP/1.1 Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14qQmfTnMx3JF8lW3glhNPcp3BruAKqb-CjWYBdzJW9SrEq9YNFZ8daHy9u_BoLyZmk8uMW6_F2q2eIRbuvwJm7PX2VL_uET12AxPgylWoX_B0lVhh_09yJPRoIe8TuveE2nZpegYaNKrCPSixmRpGjeYmQu_yoMBYo8T69gkD5vaFU Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 091c058b47a14a9b89f52cef7faed7f9 Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestServerBasicOps-441828477 Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestServerBasicOps-441828477 Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 091c058b47a14a9b89f52cef7faed7f9 Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestServerBasicOps-441828477 Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestServerBasicOps-441828477-project Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: bf33d6998b394b83aed475ad126de15a Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestServerBasicOps-441828477-project Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '7b40acbc-0aab-4e71-8751-031e4d217845'} Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:43.828422 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6824366d-ce44-45d2-a79f-71f8e7025e81 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Returning 404 to user: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6824366d-ce44-45d2-a79f-71f8e7025e81 tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 404 len: 111 microversion: 2.1 time: 0.029642 Jul 20 04:59:43.834514 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3278/6541] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 04:59:43 2022] DELETE /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:43.838869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f184a336-004f-466d-8b67-1fd3b4c0068f tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:43.839501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f184a336-004f-466d-8b67-1fd3b4c0068f tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] [instance: 7b40acbc-0aab-4e71-8751-031e4d217845] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:43.845404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f184a336-004f-466d-8b67-1fd3b4c0068f tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.845860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f184a336-004f-466d-8b67-1fd3b4c0068f tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.846664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f184a336-004f-466d-8b67-1fd3b4c0068f tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.847112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f184a336-004f-466d-8b67-1fd3b4c0068f tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.863522 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-f184a336-004f-466d-8b67-1fd3b4c0068f tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] HTTP exception thrown: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f184a336-004f-466d-8b67-1fd3b4c0068f tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Request method failure captured: Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 HTTP/1.1 Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14qQmfTnMx3JF8lW3glhNPcp3BruAKqb-CjWYBdzJW9SrEq9YNFZ8daHy9u_BoLyZmk8uMW6_F2q2eIRbuvwJm7PX2VL_uET12AxPgylWoX_B0lVhh_09yJPRoIe8TuveE2nZpegYaNKrCPSixmRpGjeYmQu_yoMBYo8T69gkD5vaFU Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 091c058b47a14a9b89f52cef7faed7f9 Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestServerBasicOps-441828477 Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_091c058b47a14a9b89f52cef7faed7f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestServerBasicOps-441828477 Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 091c058b47a14a9b89f52cef7faed7f9 Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestServerBasicOps-441828477 Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestServerBasicOps-441828477-project Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: bf33d6998b394b83aed475ad126de15a Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestServerBasicOps-441828477-project Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '7b40acbc-0aab-4e71-8751-031e4d217845'} Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:43.865228 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.871285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:43.871285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:43.871285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:43.871285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:43.871285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:43.871285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. Jul 20 04:59:43.871285 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 04:59:43.871285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f184a336-004f-466d-8b67-1fd3b4c0068f tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Returning 404 to user: Instance 7b40acbc-0aab-4e71-8751-031e4d217845 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:43.871285 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f184a336-004f-466d-8b67-1fd3b4c0068f tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845" status: 404 len: 111 microversion: 2.1 time: 0.031571 Jul 20 04:59:43.871285 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3264/6542] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:43 2022] GET /compute/v2.1/servers/7b40acbc-0aab-4e71-8751-031e4d217845 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:44.033941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2a50231-cd1b-4481-82d4-d7259ab8d9ac tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] Calling method '.version_select at 0x7fb842163a60>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:44.058774 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f2a50231-cd1b-4481-82d4-d7259ab8d9ac tempest-TestServerBasicOps-441828477 tempest-TestServerBasicOps-441828477-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1939096064" status: 202 len: 0 microversion: 2.1 time: 0.028360 Jul 20 04:59:44.065754 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3279/6543] 10.222.0.59 () {58 vars in 1253 bytes} [Wed Jul 20 04:59:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1939096064 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:00:12.565041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:12.565937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=12 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:12.680637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-168953363", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:12.733746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] validate_networks() for None {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:00:12.926735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:00:12.927172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:00:12.927658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:00:12.928075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:00:12.929059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:00:12.938123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:12.938688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:12.939499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:12.939949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:12.958078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Getting quotas for project 196033ae7455413a9d0981c496b5c67c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:00:12.963699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Getting quotas for user 9cd21bb0ddbf4df3ac84268074eb30d3 and project 196033ae7455413a9d0981c496b5c67c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:00:12.976107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:00:12.978402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:00:13.024203 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-725adeff-cef0-4dc9-8288-1152c5461a9b tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.464077 Jul 20 05:00:13.030117 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3265/6544] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:00:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:00:13.033288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:13.034049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:13.039031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-15bb4403-fc7e-48d4-b75a-009a9c922be1 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:13.039659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-15bb4403-fc7e-48d4-b75a-009a9c922be1 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:13.099062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-15bb4403-fc7e-48d4-b75a-009a9c922be1 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd21bb0ddbf4df3ac84268074eb30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196033ae7455413a9d0981c496b5c67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:13.106684 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-15bb4403-fc7e-48d4-b75a-009a9c922be1 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 200 len: 1221 microversion: 2.1 time: 0.075130 Jul 20 05:00:13.107262 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3280/6545] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:13 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 1221 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:14.126045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e6161134-ba25-4ed5-800e-f1b3159952ca tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:14.127476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e6161134-ba25-4ed5-800e-f1b3159952ca tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:14.135374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6161134-ba25-4ed5-800e-f1b3159952ca tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:14.135952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6161134-ba25-4ed5-800e-f1b3159952ca tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:14.136831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6161134-ba25-4ed5-800e-f1b3159952ca tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:14.137534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e6161134-ba25-4ed5-800e-f1b3159952ca tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:14.236844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e6161134-ba25-4ed5-800e-f1b3159952ca tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd21bb0ddbf4df3ac84268074eb30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196033ae7455413a9d0981c496b5c67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:14.244875 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e6161134-ba25-4ed5-800e-f1b3159952ca tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 200 len: 1281 microversion: 2.1 time: 0.123473 Jul 20 05:00:14.245579 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3266/6546] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:14 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:15.262526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c82c8bca-8f7f-4fcb-988a-7f9a9885efe5 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:15.263273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c82c8bca-8f7f-4fcb-988a-7f9a9885efe5 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:15.270272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c82c8bca-8f7f-4fcb-988a-7f9a9885efe5 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:15.270759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c82c8bca-8f7f-4fcb-988a-7f9a9885efe5 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:15.271544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c82c8bca-8f7f-4fcb-988a-7f9a9885efe5 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:15.272031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c82c8bca-8f7f-4fcb-988a-7f9a9885efe5 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:15.423058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c82c8bca-8f7f-4fcb-988a-7f9a9885efe5 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd21bb0ddbf4df3ac84268074eb30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196033ae7455413a9d0981c496b5c67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:15.431375 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c82c8bca-8f7f-4fcb-988a-7f9a9885efe5 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 200 len: 1321 microversion: 2.1 time: 0.172726 Jul 20 05:00:15.431975 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3281/6547] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:15 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:15.723641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-f0e00ee2-6bd3-41b6-a406-4e9ccd6f741d req-bdb39311-dced-43d3-b922-df132998ff8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a7f365e-6100-4e95-b80a-f91871d2b0a3", "tag": "c963c4a8-5866-493a-a947-4c80e944c5f5"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:15.740085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f0e00ee2-6bd3-41b6-a406-4e9ccd6f741d req-bdb39311-dced-43d3-b922-df132998ff8b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:15.741959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-f0e00ee2-6bd3-41b6-a406-4e9ccd6f741d req-bdb39311-dced-43d3-b922-df132998ff8b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:15.764736 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-f0e00ee2-6bd3-41b6-a406-4e9ccd6f741d req-bdb39311-dced-43d3-b922-df132998ff8b service nova] Creating event network-changed:c963c4a8-5866-493a-a947-4c80e944c5f5 for instance 4a7f365e-6100-4e95-b80a-f91871d2b0a3 on n-h2-760456-11 Jul 20 05:00:15.771611 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-f0e00ee2-6bd3-41b6-a406-4e9ccd6f741d req-bdb39311-dced-43d3-b922-df132998ff8b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052990 Jul 20 05:00:15.773287 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3267/6548] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:16.450268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-35348fd7-af47-403f-afc4-4e1a41ea41a6 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:16.450912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-35348fd7-af47-403f-afc4-4e1a41ea41a6 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:16.458131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-35348fd7-af47-403f-afc4-4e1a41ea41a6 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:16.458656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-35348fd7-af47-403f-afc4-4e1a41ea41a6 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:16.459525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-35348fd7-af47-403f-afc4-4e1a41ea41a6 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:16.460039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-35348fd7-af47-403f-afc4-4e1a41ea41a6 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:16.598053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-35348fd7-af47-403f-afc4-4e1a41ea41a6 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd21bb0ddbf4df3ac84268074eb30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196033ae7455413a9d0981c496b5c67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:16.606489 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-35348fd7-af47-403f-afc4-4e1a41ea41a6 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 200 len: 1321 microversion: 2.1 time: 0.161027 Jul 20 05:00:16.607075 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3282/6549] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:16 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:17.625831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bd9066c1-e610-4f13-a74f-d1c618142f25 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:17.626488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bd9066c1-e610-4f13-a74f-d1c618142f25 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:17.636622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd9066c1-e610-4f13-a74f-d1c618142f25 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:17.637137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd9066c1-e610-4f13-a74f-d1c618142f25 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:17.637926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd9066c1-e610-4f13-a74f-d1c618142f25 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:17.638425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bd9066c1-e610-4f13-a74f-d1c618142f25 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:17.778876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bd9066c1-e610-4f13-a74f-d1c618142f25 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd21bb0ddbf4df3ac84268074eb30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196033ae7455413a9d0981c496b5c67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:17.786724 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bd9066c1-e610-4f13-a74f-d1c618142f25 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 200 len: 1321 microversion: 2.1 time: 0.165206 Jul 20 05:00:17.787315 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3268/6550] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:17 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:18.804815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1c2b0ae-aeef-40c2-a9e2-a284db7ed530 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:18.805452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1c2b0ae-aeef-40c2-a9e2-a284db7ed530 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:18.812412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1c2b0ae-aeef-40c2-a9e2-a284db7ed530 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:18.812863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1c2b0ae-aeef-40c2-a9e2-a284db7ed530 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:18.813628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1c2b0ae-aeef-40c2-a9e2-a284db7ed530 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:18.814071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1c2b0ae-aeef-40c2-a9e2-a284db7ed530 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:18.945170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a1c2b0ae-aeef-40c2-a9e2-a284db7ed530 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd21bb0ddbf4df3ac84268074eb30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196033ae7455413a9d0981c496b5c67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:18.952740 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1c2b0ae-aeef-40c2-a9e2-a284db7ed530 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 200 len: 1321 microversion: 2.1 time: 0.152493 Jul 20 05:00:18.953315 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3283/6551] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:18 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:19.443024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-21f13212-aef1-420f-81c9-2f8c60042841 req-bffb293d-0206-4066-8acc-37eda267ecd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a7f365e-6100-4e95-b80a-f91871d2b0a3", "name": "network-vif-plugged", "status": "completed", "tag": "c963c4a8-5866-493a-a947-4c80e944c5f5"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:19.451305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-21f13212-aef1-420f-81c9-2f8c60042841 req-bffb293d-0206-4066-8acc-37eda267ecd3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:19.451771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-21f13212-aef1-420f-81c9-2f8c60042841 req-bffb293d-0206-4066-8acc-37eda267ecd3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:19.463542 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-21f13212-aef1-420f-81c9-2f8c60042841 req-bffb293d-0206-4066-8acc-37eda267ecd3 service nova] Creating event network-vif-plugged:c963c4a8-5866-493a-a947-4c80e944c5f5 for instance 4a7f365e-6100-4e95-b80a-f91871d2b0a3 on n-h2-760456-11 Jul 20 05:00:19.469040 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-21f13212-aef1-420f-81c9-2f8c60042841 req-bffb293d-0206-4066-8acc-37eda267ecd3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097164 Jul 20 05:00:19.469633 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3269/6552] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:19.969583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a51ecd92-2773-4b0e-ad75-a617500895e0 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:19.970181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a51ecd92-2773-4b0e-ad75-a617500895e0 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:19.977249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51ecd92-2773-4b0e-ad75-a617500895e0 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:19.977707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51ecd92-2773-4b0e-ad75-a617500895e0 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:19.978517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51ecd92-2773-4b0e-ad75-a617500895e0 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:19.978963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51ecd92-2773-4b0e-ad75-a617500895e0 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:20.124799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a51ecd92-2773-4b0e-ad75-a617500895e0 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd21bb0ddbf4df3ac84268074eb30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196033ae7455413a9d0981c496b5c67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:20.133354 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a51ecd92-2773-4b0e-ad75-a617500895e0 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 200 len: 1321 microversion: 2.1 time: 0.167619 Jul 20 05:00:20.133952 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3284/6553] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:19 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:20.568054 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:00:20.568679 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:00:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:00:21.151250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4efd3104-4852-4383-9aa0-a5e8a9f24c7f tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:21.151977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4efd3104-4852-4383-9aa0-a5e8a9f24c7f tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:21.159184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4efd3104-4852-4383-9aa0-a5e8a9f24c7f tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:21.159649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4efd3104-4852-4383-9aa0-a5e8a9f24c7f tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:21.160436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4efd3104-4852-4383-9aa0-a5e8a9f24c7f tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:21.160897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4efd3104-4852-4383-9aa0-a5e8a9f24c7f tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:21.289523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4efd3104-4852-4383-9aa0-a5e8a9f24c7f tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd21bb0ddbf4df3ac84268074eb30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196033ae7455413a9d0981c496b5c67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:21.297108 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4efd3104-4852-4383-9aa0-a5e8a9f24c7f tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 200 len: 1470 microversion: 2.1 time: 0.150529 Jul 20 05:00:21.297689 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3270/6554] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:21 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:21.373177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4309db31-e0a2-4d55-adf1-2ee97e37de69 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Calling method '.version_select at 0x7fb840ec10d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:21.440617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4309db31-e0a2-4d55-adf1-2ee97e37de69 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/7594a0d02bd2417ea1054aed197f4d9a" status: 200 len: 371 microversion: 2.1 time: 0.126725 Jul 20 05:00:21.441307 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3285/6555] 10.222.0.59 () {58 vars in 1241 bytes} [Wed Jul 20 05:00:21 2022] GET /compute/v2.1/os-quota-sets/7594a0d02bd2417ea1054aed197f4d9a => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:21.451711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-91df04f5-03c7-41aa-8a71-bc6293186265 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-68859043", "id": 1780983970, "os-flavor-access:is_public": "True"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:21.453345 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:00:21.453345 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 05:00:21.468415 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-91df04f5-03c7-41aa-8a71-bc6293186265 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.020440 Jul 20 05:00:21.469155 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3271/6556] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:00:21 2022] POST /compute/v2.1/flavors => generated 436 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:21.481079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1780983970"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:21.482150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:21.488693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:21.489162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:21.489950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:21.490458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:21.631239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5a9b2308a58046359e2c66e7976c0e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7594a0d02bd2417ea1054aed197f4d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:21.638443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-68859043 {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:00:21.644869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:21.645333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:21.646146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:21.646632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:21.669801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Getting quotas for project 196033ae7455413a9d0981c496b5c67c. Resources: {'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:00:21.674988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Getting quotas for user 9cd21bb0ddbf4df3ac84268074eb30d3 and project 196033ae7455413a9d0981c496b5c67c. Resources: {'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:00:21.689453 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.compute.api [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] ram quota exceeded for 7594a0d02bd2417ea1054aed197f4d9a, tried to resize instance. Jul 20 05:00:21.690013 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Request method failure captured: Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3/action HTTP/1.1 Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 39 Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14vchC3j2Fhiv8TqGn3iY_J0x3OOTtqGqr4Tx1kjFXDF0m-NHFoYqNjJFoL6xb-EnaSYW0jYebKAvWzi6-jl8zb3W9FDmR_qzQZ9qCB8FGUkJEq05zbVVy5cgdtkU7LYBxj-nFGQb2ck2PTARnCd_FrHNrkvF-tkqj5PJjIVvypSckA Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 7594a0d02bd2417ea1054aed197f4d9a Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1284159074 Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader,admin Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader,admin Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7594a0d02bd2417ea1054aed197f4d9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7594a0d02bd2417ea1054aed197f4d9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7594a0d02bd2417ea1054aed197f4d9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7594a0d02bd2417ea1054aed197f4d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1284159074 Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 7594a0d02bd2417ea1054aed197f4d9a Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1284159074 Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersAdminNegativeTestJSON-1284159074-project-admin Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 5a9b2308a58046359e2c66e7976c0e67 Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1284159074-project-admin Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: {"resize": {"flavorRef": "1780983970"}} Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4a7f365e-6100-4e95-b80a-f91871d2b0a3', 'body': {'resize': {'flavorRef': '1780983970'}}} Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:00:21.697709 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-04b23460-f4a3-40e4-b596-ec5fe42edf74 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3/action" status: 403 len: 118 microversion: 2.1 time: 0.223487 Jul 20 05:00:21.703296 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3286/6557] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:00:21 2022] POST /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3/action => generated 118 bytes in 225 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:00:21.708150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d4f76798-d7bf-43b0-873d-0334052f52a5 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:21.708947 n-d-760456-11 devstack@n-api.service[119605]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:00:21.708947 n-d-760456-11 devstack@n-api.service[119605]: warnings.warn(msg) Jul 20 05:00:21.725773 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d4f76798-d7bf-43b0-873d-0334052f52a5 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1780983970" status: 202 len: 0 microversion: 2.1 time: 0.021364 Jul 20 05:00:21.726348 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3272/6558] 10.222.0.59 () {58 vars in 1160 bytes} [Wed Jul 20 05:00:21 2022] DELETE /compute/v2.1/flavors/1780983970 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:00:21.734654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c12b162a-10ca-4886-b9c9-8d91fa8c5171 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:21.755187 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c12b162a-10ca-4886-b9c9-8d91fa8c5171 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024181 Jul 20 05:00:21.755764 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3287/6559] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 05:00:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:21.772462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-18c43e3d-de02-4a34-96e3-09d0fc689185 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Calling method '.version_select at 0x7fb841be1040>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:21.842679 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-18c43e3d-de02-4a34-96e3-09d0fc689185 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/7594a0d02bd2417ea1054aed197f4d9a" status: 200 len: 371 microversion: 2.1 time: 0.073945 Jul 20 05:00:21.843248 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3273/6560] 10.222.0.59 () {58 vars in 1241 bytes} [Wed Jul 20 05:00:21 2022] GET /compute/v2.1/os-quota-sets/7594a0d02bd2417ea1054aed197f4d9a => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:21.853785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-edf332bb-4bd6-496c-9682-5fe1bc3c6899 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1112228716", "id": 242266800, "os-flavor-access:is_public": "True"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:21.855901 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:00:21.855901 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 05:00:21.871491 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-edf332bb-4bd6-496c-9682-5fe1bc3c6899 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021767 Jul 20 05:00:21.872063 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3288/6561] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:00:21 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:21.883440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "242266800"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:21.884575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:21.890850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:21.891268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:21.892055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:21.892513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.031640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5a9b2308a58046359e2c66e7976c0e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7594a0d02bd2417ea1054aed197f4d9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:22.039219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1112228716 {{(pid=119605) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:00:22.045793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:22.046344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.047172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:22.047633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.068592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Getting quotas for project 196033ae7455413a9d0981c496b5c67c. Resources: {'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:00:22.074763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Getting quotas for user 9cd21bb0ddbf4df3ac84268074eb30d3 and project 196033ae7455413a9d0981c496b5c67c. Resources: {'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:00:22.087553 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.compute.api [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] cores quota exceeded for 7594a0d02bd2417ea1054aed197f4d9a, tried to resize instance. Jul 20 05:00:22.088125 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Request method failure captured: Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3/action HTTP/1.1 Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 38 Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14vchC3j2Fhiv8TqGn3iY_J0x3OOTtqGqr4Tx1kjFXDF0m-NHFoYqNjJFoL6xb-EnaSYW0jYebKAvWzi6-jl8zb3W9FDmR_qzQZ9qCB8FGUkJEq05zbVVy5cgdtkU7LYBxj-nFGQb2ck2PTARnCd_FrHNrkvF-tkqj5PJjIVvypSckA Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 7594a0d02bd2417ea1054aed197f4d9a Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1284159074 Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader,admin Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader,admin Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7594a0d02bd2417ea1054aed197f4d9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7594a0d02bd2417ea1054aed197f4d9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7594a0d02bd2417ea1054aed197f4d9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7594a0d02bd2417ea1054aed197f4d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1284159074 Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 7594a0d02bd2417ea1054aed197f4d9a Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1284159074 Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersAdminNegativeTestJSON-1284159074-project-admin Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 5a9b2308a58046359e2c66e7976c0e67 Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1284159074-project-admin Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: {"resize": {"flavorRef": "242266800"}} Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4a7f365e-6100-4e95-b80a-f91871d2b0a3', 'body': {'resize': {'flavorRef': '242266800'}}} Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:00:22.090276 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eaac628e-effc-4820-beee-04067a03d4dd tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3/action" status: 403 len: 113 microversion: 2.1 time: 0.212992 Jul 20 05:00:22.095565 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3274/6562] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:00:21 2022] POST /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3/action => generated 113 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:00:22.100765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1ea561be-3306-4c43-9e66-43e88ebf9f62 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:22.101549 n-d-760456-11 devstack@n-api.service[119606]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:00:22.101549 n-d-760456-11 devstack@n-api.service[119606]: warnings.warn(msg) Jul 20 05:00:22.118436 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1ea561be-3306-4c43-9e66-43e88ebf9f62 tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/242266800" status: 202 len: 0 microversion: 2.1 time: 0.021517 Jul 20 05:00:22.119003 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3289/6563] 10.222.0.59 () {58 vars in 1157 bytes} [Wed Jul 20 05:00:22 2022] DELETE /compute/v2.1/flavors/242266800 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:00:22.127171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b1b4358f-a6b4-42a8-87f0-3a12cb33a04a tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:22.146435 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b1b4358f-a6b4-42a8-87f0-3a12cb33a04a tempest-ServersAdminNegativeTestJSON-1284159074 tempest-ServersAdminNegativeTestJSON-1284159074-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022851 Jul 20 05:00:22.146947 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3275/6564] 10.222.0.59 () {58 vars in 1145 bytes} [Wed Jul 20 05:00:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:22.163991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b88c513e-6ba3-4353-b11d-2174f04e247c tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:22.164531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b88c513e-6ba3-4353-b11d-2174f04e247c tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:22.170567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b88c513e-6ba3-4353-b11d-2174f04e247c tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:22.171026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b88c513e-6ba3-4353-b11d-2174f04e247c tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.171794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b88c513e-6ba3-4353-b11d-2174f04e247c tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:22.172234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b88c513e-6ba3-4353-b11d-2174f04e247c tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.198079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b88c513e-6ba3-4353-b11d-2174f04e247c tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:00:22.275393 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b88c513e-6ba3-4353-b11d-2174f04e247c tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 204 len: 0 microversion: 2.1 time: 0.114302 Jul 20 05:00:22.276075 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3290/6565] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:00:22 2022] DELETE /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:00:22.284900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2215c33-92d3-4f81-8e55-0bbd53eb37cf tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:22.285657 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c2215c33-92d3-4f81-8e55-0bbd53eb37cf tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:22.293068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2215c33-92d3-4f81-8e55-0bbd53eb37cf tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:22.293542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2215c33-92d3-4f81-8e55-0bbd53eb37cf tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.294466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2215c33-92d3-4f81-8e55-0bbd53eb37cf tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:22.294874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2215c33-92d3-4f81-8e55-0bbd53eb37cf tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.447025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2215c33-92d3-4f81-8e55-0bbd53eb37cf tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd21bb0ddbf4df3ac84268074eb30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196033ae7455413a9d0981c496b5c67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:22.454501 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c2215c33-92d3-4f81-8e55-0bbd53eb37cf tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 200 len: 1476 microversion: 2.1 time: 0.173516 Jul 20 05:00:22.455010 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3276/6566] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:22 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 1476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:23.472052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-730b0cd2-8e19-436d-ba6e-66935efde838 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:23.472768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-730b0cd2-8e19-436d-ba6e-66935efde838 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:23.482715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-730b0cd2-8e19-436d-ba6e-66935efde838 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:23.483180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-730b0cd2-8e19-436d-ba6e-66935efde838 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:23.483969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-730b0cd2-8e19-436d-ba6e-66935efde838 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:23.484415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-730b0cd2-8e19-436d-ba6e-66935efde838 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:23.623155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-730b0cd2-8e19-436d-ba6e-66935efde838 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd21bb0ddbf4df3ac84268074eb30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196033ae7455413a9d0981c496b5c67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:23.631431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-730b0cd2-8e19-436d-ba6e-66935efde838 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 200 len: 1476 microversion: 2.1 time: 0.163633 Jul 20 05:00:23.632014 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3291/6567] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:23 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:24.020724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4c81575f-1a39-4800-aaff-1159359f53a3 req-59a7c187-2a4c-4673-b407-ae060dc878a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a7f365e-6100-4e95-b80a-f91871d2b0a3", "name": "network-vif-deleted", "tag": "c963c4a8-5866-493a-a947-4c80e944c5f5"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:24.035472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4c81575f-1a39-4800-aaff-1159359f53a3 req-59a7c187-2a4c-4673-b407-ae060dc878a2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:24.036256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4c81575f-1a39-4800-aaff-1159359f53a3 req-59a7c187-2a4c-4673-b407-ae060dc878a2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:24.050016 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4c81575f-1a39-4800-aaff-1159359f53a3 req-59a7c187-2a4c-4673-b407-ae060dc878a2 service nova] Creating event network-vif-deleted:c963c4a8-5866-493a-a947-4c80e944c5f5 for instance 4a7f365e-6100-4e95-b80a-f91871d2b0a3 on n-h2-760456-11 Jul 20 05:00:24.057058 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4c81575f-1a39-4800-aaff-1159359f53a3 req-59a7c187-2a4c-4673-b407-ae060dc878a2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039581 Jul 20 05:00:24.058513 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3277/6568] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:24.649706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d5232dc3-8fcd-4fda-ba70-9586e5829098 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:24.650279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d5232dc3-8fcd-4fda-ba70-9586e5829098 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] [instance: 4a7f365e-6100-4e95-b80a-f91871d2b0a3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:24.657340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5232dc3-8fcd-4fda-ba70-9586e5829098 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:24.657801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5232dc3-8fcd-4fda-ba70-9586e5829098 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:24.658611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5232dc3-8fcd-4fda-ba70-9586e5829098 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:24.659059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5232dc3-8fcd-4fda-ba70-9586e5829098 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:24.673264 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-d5232dc3-8fcd-4fda-ba70-9586e5829098 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] HTTP exception thrown: Instance 4a7f365e-6100-4e95-b80a-f91871d2b0a3 could not be found. Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d5232dc3-8fcd-4fda-ba70-9586e5829098 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Request method failure captured: Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 HTTP/1.1 Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14vbcZTBtvVpW5tKPO1AjHO8fgOLDlnQp23t1XmtUr0cckXE4Fyp2hqoqiNqIxJD9zSVEvo8Ky1w-5VlH65cN6efu1g2ivBHpi0fnlKFP2RS9LJxz69jmE2b-rjNIhu5_EqhLmgN-Lwr4Z_Z-gRIF6vft_O9c5KtTllbtmRI830oZXA Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 196033ae7455413a9d0981c496b5c67c Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1919731864 Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/196033ae7455413a9d0981c496b5c67c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/196033ae7455413a9d0981c496b5c67c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/196033ae7455413a9d0981c496b5c67c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_196033ae7455413a9d0981c496b5c67c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1919731864 Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 196033ae7455413a9d0981c496b5c67c Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1919731864 Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersAdminNegativeTestJSON-1919731864-project Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 9cd21bb0ddbf4df3ac84268074eb30d3 Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1919731864-project Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4a7f365e-6100-4e95-b80a-f91871d2b0a3 could not be found. Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4a7f365e-6100-4e95-b80a-f91871d2b0a3'} Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a7f365e-6100-4e95-b80a-f91871d2b0a3 could not be found. Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a7f365e-6100-4e95-b80a-f91871d2b0a3 could not be found. Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:24.674956 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a7f365e-6100-4e95-b80a-f91871d2b0a3 could not be found. Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d5232dc3-8fcd-4fda-ba70-9586e5829098 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] Returning 404 to user: Instance 4a7f365e-6100-4e95-b80a-f91871d2b0a3 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d5232dc3-8fcd-4fda-ba70-9586e5829098 tempest-ServersAdminNegativeTestJSON-1919731864 tempest-ServersAdminNegativeTestJSON-1919731864-project] 10.222.0.59 "GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3" status: 404 len: 111 microversion: 2.1 time: 0.031133 Jul 20 05:00:24.681219 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3292/6569] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:24 2022] GET /compute/v2.1/servers/4a7f365e-6100-4e95-b80a-f91871d2b0a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:00:31.000930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-791414685", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "337e4b45-c353-4768-a8da-17958eb142f3"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:31.057792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] validate_networks() for [('337e4b45-c353-4768-a8da-17958eb142f3', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:00:31.457782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:00:31.458232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:00:31.458755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:00:31.459182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:00:31.459611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:00:31.469529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:31.470031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:31.470894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:31.471356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:31.489201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Getting quotas for project abdaf6b4f64a4339a3c984b7fdb11788. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:00:31.496494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Getting quotas for user a51fc47d7d79458e922bc18e6fd4d30c and project abdaf6b4f64a4339a3c984b7fdb11788. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:00:31.509533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:00:31.511964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:00:31.559496 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f6d22d2c-8a2e-4bce-adf8-042bd18449c9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687252 Jul 20 05:00:31.560404 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3278/6570] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:00:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:00:31.570762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2635d8f9-9a24-428f-9bcd-b4a7e7b16c3e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:31.571374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2635d8f9-9a24-428f-9bcd-b4a7e7b16c3e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:31.574296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:31.631370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2635d8f9-9a24-428f-9bcd-b4a7e7b16c3e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:31.639952 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2635d8f9-9a24-428f-9bcd-b4a7e7b16c3e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1214 microversion: 2.1 time: 0.073014 Jul 20 05:00:31.640548 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3293/6571] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:31 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:32.658264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d6f9869f-5d6a-41a4-a79d-693df578d1ac tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:32.658963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d6f9869f-5d6a-41a4-a79d-693df578d1ac tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:32.675797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6f9869f-5d6a-41a4-a79d-693df578d1ac tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:32.676261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6f9869f-5d6a-41a4-a79d-693df578d1ac tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:32.688474 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6f9869f-5d6a-41a4-a79d-693df578d1ac tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:32.688931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6f9869f-5d6a-41a4-a79d-693df578d1ac tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:32.802146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d6f9869f-5d6a-41a4-a79d-693df578d1ac tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:32.815124 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d6f9869f-5d6a-41a4-a79d-693df578d1ac tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1274 microversion: 2.1 time: 0.161774 Jul 20 05:00:32.816787 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3279/6572] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:32 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:33.835035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7a4b1e08-40ac-4f7e-82eb-fc9f4881455b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:33.838032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7a4b1e08-40ac-4f7e-82eb-fc9f4881455b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:33.843453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:33.852996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a4b1e08-40ac-4f7e-82eb-fc9f4881455b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:33.853459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a4b1e08-40ac-4f7e-82eb-fc9f4881455b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:33.854483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a4b1e08-40ac-4f7e-82eb-fc9f4881455b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:33.855114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a4b1e08-40ac-4f7e-82eb-fc9f4881455b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:34.009962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7a4b1e08-40ac-4f7e-82eb-fc9f4881455b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:34.018397 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7a4b1e08-40ac-4f7e-82eb-fc9f4881455b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1314 microversion: 2.1 time: 0.187521 Jul 20 05:00:34.022569 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3294/6573] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:33 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:34.623430 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-fff5ee2d-5e3f-49c8-975a-520e6273400b req-1aa60267-8dd4-404c-bf08-c0831964ce33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872ef0c8-1a6e-410d-b364-d718d85d081d", "tag": "4d0e6650-da64-44c7-af62-74fe684fa2e5"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:34.653903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fff5ee2d-5e3f-49c8-975a-520e6273400b req-1aa60267-8dd4-404c-bf08-c0831964ce33 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:34.654398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fff5ee2d-5e3f-49c8-975a-520e6273400b req-1aa60267-8dd4-404c-bf08-c0831964ce33 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:34.668218 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-fff5ee2d-5e3f-49c8-975a-520e6273400b req-1aa60267-8dd4-404c-bf08-c0831964ce33 service nova] Creating event network-changed:4d0e6650-da64-44c7-af62-74fe684fa2e5 for instance 872ef0c8-1a6e-410d-b364-d718d85d081d on n-h2-760456-11 Jul 20 05:00:34.675376 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-fff5ee2d-5e3f-49c8-975a-520e6273400b req-1aa60267-8dd4-404c-bf08-c0831964ce33 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055700 Jul 20 05:00:34.676004 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3280/6574] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:35.037107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1500954b-1a22-4329-af43-7e0e0e879ece tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:35.037859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1500954b-1a22-4329-af43-7e0e0e879ece tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:35.046404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1500954b-1a22-4329-af43-7e0e0e879ece tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:35.047458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1500954b-1a22-4329-af43-7e0e0e879ece tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:35.048346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1500954b-1a22-4329-af43-7e0e0e879ece tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:35.048870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1500954b-1a22-4329-af43-7e0e0e879ece tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:35.190113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1500954b-1a22-4329-af43-7e0e0e879ece tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:35.198006 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1500954b-1a22-4329-af43-7e0e0e879ece tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1314 microversion: 2.1 time: 0.164818 Jul 20 05:00:35.198606 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3295/6575] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:35 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:36.217023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d9b99978-8ff7-4b78-9d9a-a08e36ec7744 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:36.217756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d9b99978-8ff7-4b78-9d9a-a08e36ec7744 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:36.224074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b99978-8ff7-4b78-9d9a-a08e36ec7744 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:36.224547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b99978-8ff7-4b78-9d9a-a08e36ec7744 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:36.225340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b99978-8ff7-4b78-9d9a-a08e36ec7744 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:36.225800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b99978-8ff7-4b78-9d9a-a08e36ec7744 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:36.419129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d9b99978-8ff7-4b78-9d9a-a08e36ec7744 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:36.426694 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d9b99978-8ff7-4b78-9d9a-a08e36ec7744 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1314 microversion: 2.1 time: 0.214908 Jul 20 05:00:36.427276 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3281/6576] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:36 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:37.444341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-34b28c75-962d-4e97-b6d0-c74a2832ceea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:37.445676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-34b28c75-962d-4e97-b6d0-c74a2832ceea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:37.457501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34b28c75-962d-4e97-b6d0-c74a2832ceea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:37.457977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34b28c75-962d-4e97-b6d0-c74a2832ceea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:37.458808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34b28c75-962d-4e97-b6d0-c74a2832ceea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:37.459262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34b28c75-962d-4e97-b6d0-c74a2832ceea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:37.603133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-34b28c75-962d-4e97-b6d0-c74a2832ceea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:37.610809 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-34b28c75-962d-4e97-b6d0-c74a2832ceea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1314 microversion: 2.1 time: 0.170399 Jul 20 05:00:37.611581 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3296/6577] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:37 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:38.628334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-54a8d11a-5389-4746-bdf0-a78da8f28973 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:38.628896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-54a8d11a-5389-4746-bdf0-a78da8f28973 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:38.636807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a8d11a-5389-4746-bdf0-a78da8f28973 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:38.637273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a8d11a-5389-4746-bdf0-a78da8f28973 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:38.638059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a8d11a-5389-4746-bdf0-a78da8f28973 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:38.638538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-54a8d11a-5389-4746-bdf0-a78da8f28973 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:38.777405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-54a8d11a-5389-4746-bdf0-a78da8f28973 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:38.785431 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-54a8d11a-5389-4746-bdf0-a78da8f28973 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1314 microversion: 2.1 time: 0.161092 Jul 20 05:00:38.786008 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3282/6578] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:38 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:39.455579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-face58dc-efef-4aaf-ae4b-26eff00e3fbc req-7d91905b-bdb8-45ea-b5ee-a01741baef98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872ef0c8-1a6e-410d-b364-d718d85d081d", "name": "network-vif-plugged", "status": "completed", "tag": "4d0e6650-da64-44c7-af62-74fe684fa2e5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:39.465407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-face58dc-efef-4aaf-ae4b-26eff00e3fbc req-7d91905b-bdb8-45ea-b5ee-a01741baef98 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:39.465861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-face58dc-efef-4aaf-ae4b-26eff00e3fbc req-7d91905b-bdb8-45ea-b5ee-a01741baef98 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:39.477378 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-face58dc-efef-4aaf-ae4b-26eff00e3fbc req-7d91905b-bdb8-45ea-b5ee-a01741baef98 service nova] Creating event network-vif-plugged:4d0e6650-da64-44c7-af62-74fe684fa2e5 for instance 872ef0c8-1a6e-410d-b364-d718d85d081d on n-h2-760456-11 Jul 20 05:00:39.482944 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-face58dc-efef-4aaf-ae4b-26eff00e3fbc req-7d91905b-bdb8-45ea-b5ee-a01741baef98 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031509 Jul 20 05:00:39.483566 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3297/6579] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:39.802705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5896cb77-5801-4668-b5fa-0b6a8aef69b6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:39.803322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5896cb77-5801-4668-b5fa-0b6a8aef69b6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:39.811090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5896cb77-5801-4668-b5fa-0b6a8aef69b6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:39.811560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5896cb77-5801-4668-b5fa-0b6a8aef69b6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:39.812346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5896cb77-5801-4668-b5fa-0b6a8aef69b6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:39.812800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5896cb77-5801-4668-b5fa-0b6a8aef69b6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:39.945904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5896cb77-5801-4668-b5fa-0b6a8aef69b6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:39.953361 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5896cb77-5801-4668-b5fa-0b6a8aef69b6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1314 microversion: 2.1 time: 0.154780 Jul 20 05:00:39.953935 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3283/6580] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:39 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:40.970466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-501e0802-7825-440d-ac28-c3b8dca3c65b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:40.971326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-501e0802-7825-440d-ac28-c3b8dca3c65b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:40.980227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-501e0802-7825-440d-ac28-c3b8dca3c65b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:40.980701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-501e0802-7825-440d-ac28-c3b8dca3c65b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:40.981479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-501e0802-7825-440d-ac28-c3b8dca3c65b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:40.981929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-501e0802-7825-440d-ac28-c3b8dca3c65b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:41.118183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-501e0802-7825-440d-ac28-c3b8dca3c65b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:41.126109 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-501e0802-7825-440d-ac28-c3b8dca3c65b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1501 microversion: 2.1 time: 0.159880 Jul 20 05:00:41.126726 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3298/6581] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:40 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:41.143056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:41.144040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:41.152702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:41.153169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:41.153945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:41.154423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:41.182013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:41.187788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Old instance type m1.heat2, new instance type m1.heat {{(pid=119605) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:00:41.195341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:00:41.195889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:00:41.196482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:00:41.196919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:00:41.197353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:00:41.261472 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-91af96d0-489f-4201-a325-18fc6c3c041b tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "POST /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d/action" status: 202 len: 0 microversion: 2.1 time: 0.122287 Jul 20 05:00:41.265322 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3284/6582] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:00:41 2022] POST /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:00:41.270305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-269be9ec-6d1a-4861-8d2a-da6ff7cef9cd tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:41.271006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-269be9ec-6d1a-4861-8d2a-da6ff7cef9cd tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:41.278048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-269be9ec-6d1a-4861-8d2a-da6ff7cef9cd tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:41.278535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-269be9ec-6d1a-4861-8d2a-da6ff7cef9cd tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:41.279312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-269be9ec-6d1a-4861-8d2a-da6ff7cef9cd tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:41.279749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-269be9ec-6d1a-4861-8d2a-da6ff7cef9cd tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:41.419301 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-269be9ec-6d1a-4861-8d2a-da6ff7cef9cd tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:41.427130 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-269be9ec-6d1a-4861-8d2a-da6ff7cef9cd tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1510 microversion: 2.1 time: 0.160723 Jul 20 05:00:41.427829 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3299/6583] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:41 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:42.442570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=7 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:42.443533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=14 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:42.450690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-daa885a1-6ef8-4b3b-b78d-995c6c1182ed tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:42.451324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-daa885a1-6ef8-4b3b-b78d-995c6c1182ed tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:42.458664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-daa885a1-6ef8-4b3b-b78d-995c6c1182ed tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:42.459132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-daa885a1-6ef8-4b3b-b78d-995c6c1182ed tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:42.459911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-daa885a1-6ef8-4b3b-b78d-995c6c1182ed tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:42.460363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-daa885a1-6ef8-4b3b-b78d-995c6c1182ed tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:42.607993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-daa885a1-6ef8-4b3b-b78d-995c6c1182ed tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:42.610228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:42.617838 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-daa885a1-6ef8-4b3b-b78d-995c6c1182ed tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1510 microversion: 2.1 time: 0.176119 Jul 20 05:00:42.618465 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3285/6584] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:42 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:43.635281 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d77354ae-66ac-423c-831a-f3e86c019e54 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:43.635903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d77354ae-66ac-423c-831a-f3e86c019e54 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:43.637870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:43.639404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:43.645435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d77354ae-66ac-423c-831a-f3e86c019e54 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:43.645892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d77354ae-66ac-423c-831a-f3e86c019e54 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:43.646711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d77354ae-66ac-423c-831a-f3e86c019e54 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:43.647163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d77354ae-66ac-423c-831a-f3e86c019e54 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:43.651869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:43.783630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d77354ae-66ac-423c-831a-f3e86c019e54 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:43.791792 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d77354ae-66ac-423c-831a-f3e86c019e54 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.160782 Jul 20 05:00:43.792358 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3300/6585] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:43 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:44.810285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a56677eb-3eb4-4db4-92da-fa923ed6fc08 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:44.810850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a56677eb-3eb4-4db4-92da-fa923ed6fc08 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:44.813637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:44.821047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a56677eb-3eb4-4db4-92da-fa923ed6fc08 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:44.821549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a56677eb-3eb4-4db4-92da-fa923ed6fc08 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:44.823145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a56677eb-3eb4-4db4-92da-fa923ed6fc08 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:44.823876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a56677eb-3eb4-4db4-92da-fa923ed6fc08 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:44.958468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a56677eb-3eb4-4db4-92da-fa923ed6fc08 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:44.966885 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a56677eb-3eb4-4db4-92da-fa923ed6fc08 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.161281 Jul 20 05:00:44.967469 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3286/6586] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:44 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:45.984153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e03b5338-b204-412f-a099-6b9ced380d21 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:45.984808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e03b5338-b204-412f-a099-6b9ced380d21 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:45.991849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e03b5338-b204-412f-a099-6b9ced380d21 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:45.992309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e03b5338-b204-412f-a099-6b9ced380d21 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:45.993085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e03b5338-b204-412f-a099-6b9ced380d21 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:45.993533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e03b5338-b204-412f-a099-6b9ced380d21 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:46.128626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e03b5338-b204-412f-a099-6b9ced380d21 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:46.137039 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e03b5338-b204-412f-a099-6b9ced380d21 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.156779 Jul 20 05:00:46.137613 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3301/6587] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:45 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:47.154094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-841dba63-d56b-4fc2-8df8-5efdd0c854d0 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:47.154749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-841dba63-d56b-4fc2-8df8-5efdd0c854d0 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:47.161751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-841dba63-d56b-4fc2-8df8-5efdd0c854d0 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:47.162270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-841dba63-d56b-4fc2-8df8-5efdd0c854d0 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:47.163348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-841dba63-d56b-4fc2-8df8-5efdd0c854d0 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:47.163808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-841dba63-d56b-4fc2-8df8-5efdd0c854d0 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:47.300237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-841dba63-d56b-4fc2-8df8-5efdd0c854d0 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:47.308513 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-841dba63-d56b-4fc2-8df8-5efdd0c854d0 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.157565 Jul 20 05:00:47.309117 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3287/6588] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:47 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:48.326377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-724d33cd-83fe-426b-b295-e5ff25947eff tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:48.327007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-724d33cd-83fe-426b-b295-e5ff25947eff tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:48.334047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-724d33cd-83fe-426b-b295-e5ff25947eff tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:48.334544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-724d33cd-83fe-426b-b295-e5ff25947eff tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:48.335328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-724d33cd-83fe-426b-b295-e5ff25947eff tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:48.335778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-724d33cd-83fe-426b-b295-e5ff25947eff tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:48.467568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-724d33cd-83fe-426b-b295-e5ff25947eff tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:48.475164 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-724d33cd-83fe-426b-b295-e5ff25947eff tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.153633 Jul 20 05:00:48.475743 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3302/6589] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:48 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:49.492438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a24dbdf5-d812-484e-9ffe-ef12ef42923a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:49.493068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a24dbdf5-d812-484e-9ffe-ef12ef42923a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:49.500738 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a24dbdf5-d812-484e-9ffe-ef12ef42923a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.501211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a24dbdf5-d812-484e-9ffe-ef12ef42923a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:49.502049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a24dbdf5-d812-484e-9ffe-ef12ef42923a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.502533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a24dbdf5-d812-484e-9ffe-ef12ef42923a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:49.633404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a24dbdf5-d812-484e-9ffe-ef12ef42923a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:49.641611 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a24dbdf5-d812-484e-9ffe-ef12ef42923a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.153205 Jul 20 05:00:49.642204 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3288/6590] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:49 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:50.658806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e6d96aa2-4287-4bab-8e44-caa5cebc11ef tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:50.659428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e6d96aa2-4287-4bab-8e44-caa5cebc11ef tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:50.666683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6d96aa2-4287-4bab-8e44-caa5cebc11ef tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:50.667866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6d96aa2-4287-4bab-8e44-caa5cebc11ef tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:50.668660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6d96aa2-4287-4bab-8e44-caa5cebc11ef tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:50.669135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e6d96aa2-4287-4bab-8e44-caa5cebc11ef tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:50.804896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e6d96aa2-4287-4bab-8e44-caa5cebc11ef tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:50.812486 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e6d96aa2-4287-4bab-8e44-caa5cebc11ef tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.157662 Jul 20 05:00:50.813064 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3303/6591] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:50 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:51.830300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-774f1053-f253-41d7-b0f4-67063c51dd25 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:51.830945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-774f1053-f253-41d7-b0f4-67063c51dd25 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:51.837997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-774f1053-f253-41d7-b0f4-67063c51dd25 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:51.838528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-774f1053-f253-41d7-b0f4-67063c51dd25 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:51.840177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-774f1053-f253-41d7-b0f4-67063c51dd25 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:51.840630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-774f1053-f253-41d7-b0f4-67063c51dd25 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:51.972163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-774f1053-f253-41d7-b0f4-67063c51dd25 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:51.979796 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-774f1053-f253-41d7-b0f4-67063c51dd25 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.153363 Jul 20 05:00:51.980374 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3289/6592] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:51 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:52.997295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-63e3f713-4e91-4696-9346-4a0253641539 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:52.997915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63e3f713-4e91-4696-9346-4a0253641539 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:53.005173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63e3f713-4e91-4696-9346-4a0253641539 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:53.005638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63e3f713-4e91-4696-9346-4a0253641539 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:53.006435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63e3f713-4e91-4696-9346-4a0253641539 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:53.006885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63e3f713-4e91-4696-9346-4a0253641539 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:53.141248 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-63e3f713-4e91-4696-9346-4a0253641539 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:53.148812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-63e3f713-4e91-4696-9346-4a0253641539 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.155836 Jul 20 05:00:53.149390 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3304/6593] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:52 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:54.167016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cd5de23d-983e-47f2-a40d-fcdfecece8cc tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:54.167658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cd5de23d-983e-47f2-a40d-fcdfecece8cc tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:54.176067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd5de23d-983e-47f2-a40d-fcdfecece8cc tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:54.176537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd5de23d-983e-47f2-a40d-fcdfecece8cc tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:54.177343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd5de23d-983e-47f2-a40d-fcdfecece8cc tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:54.177793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd5de23d-983e-47f2-a40d-fcdfecece8cc tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:54.320025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cd5de23d-983e-47f2-a40d-fcdfecece8cc tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:54.327907 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cd5de23d-983e-47f2-a40d-fcdfecece8cc tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.164783 Jul 20 05:00:54.328521 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3290/6594] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:54 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:55.345347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f6eb1502-879b-41c9-9d53-58f5808c50be tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:55.345969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f6eb1502-879b-41c9-9d53-58f5808c50be tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:55.352922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6eb1502-879b-41c9-9d53-58f5808c50be tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:55.353374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6eb1502-879b-41c9-9d53-58f5808c50be tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:55.354137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6eb1502-879b-41c9-9d53-58f5808c50be tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:55.354606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6eb1502-879b-41c9-9d53-58f5808c50be tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:55.489956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f6eb1502-879b-41c9-9d53-58f5808c50be tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:55.507056 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f6eb1502-879b-41c9-9d53-58f5808c50be tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.165571 Jul 20 05:00:55.507664 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3305/6595] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:55 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:56.525658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-647ccffb-f373-4c23-9e44-e0bfe286e422 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:56.526312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-647ccffb-f373-4c23-9e44-e0bfe286e422 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:56.533883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-647ccffb-f373-4c23-9e44-e0bfe286e422 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.534396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-647ccffb-f373-4c23-9e44-e0bfe286e422 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.535183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-647ccffb-f373-4c23-9e44-e0bfe286e422 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.535642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-647ccffb-f373-4c23-9e44-e0bfe286e422 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.668996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-647ccffb-f373-4c23-9e44-e0bfe286e422 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:56.676581 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-647ccffb-f373-4c23-9e44-e0bfe286e422 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.154916 Jul 20 05:00:56.677159 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3291/6596] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:56 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:57.694518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8dfa4b7e-ce04-40eb-9e0e-6e909bd1fb64 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:57.695137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8dfa4b7e-ce04-40eb-9e0e-6e909bd1fb64 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:57.702845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8dfa4b7e-ce04-40eb-9e0e-6e909bd1fb64 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:57.703336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8dfa4b7e-ce04-40eb-9e0e-6e909bd1fb64 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:57.704113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8dfa4b7e-ce04-40eb-9e0e-6e909bd1fb64 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:57.704559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8dfa4b7e-ce04-40eb-9e0e-6e909bd1fb64 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:57.836003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8dfa4b7e-ce04-40eb-9e0e-6e909bd1fb64 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:57.844270 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8dfa4b7e-ce04-40eb-9e0e-6e909bd1fb64 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.153734 Jul 20 05:00:57.844856 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3306/6597] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:57 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:58.861628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f02c2f91-7392-4290-94f6-ed103bafa081 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:58.862287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f02c2f91-7392-4290-94f6-ed103bafa081 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:58.869224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f02c2f91-7392-4290-94f6-ed103bafa081 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:58.869951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f02c2f91-7392-4290-94f6-ed103bafa081 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:58.870775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f02c2f91-7392-4290-94f6-ed103bafa081 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:58.871237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f02c2f91-7392-4290-94f6-ed103bafa081 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:59.004755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f02c2f91-7392-4290-94f6-ed103bafa081 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:59.013005 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f02c2f91-7392-4290-94f6-ed103bafa081 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.154595 Jul 20 05:00:59.013595 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3292/6598] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:58 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:01:00.030202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-de8871fc-6502-4281-9851-5c3a3a7cb1e6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:00.030846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-de8871fc-6502-4281-9851-5c3a3a7cb1e6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:00.037805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-de8871fc-6502-4281-9851-5c3a3a7cb1e6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:00.038280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-de8871fc-6502-4281-9851-5c3a3a7cb1e6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:00.039075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-de8871fc-6502-4281-9851-5c3a3a7cb1e6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:00.039521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-de8871fc-6502-4281-9851-5c3a3a7cb1e6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:00.171905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-de8871fc-6502-4281-9851-5c3a3a7cb1e6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:00.179543 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-de8871fc-6502-4281-9851-5c3a3a7cb1e6 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.153438 Jul 20 05:01:00.180154 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3307/6599] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:00 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:01.197204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6339d1fb-6197-4fab-b203-17f4f53835f9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:01.197865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6339d1fb-6197-4fab-b203-17f4f53835f9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:01.205444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6339d1fb-6197-4fab-b203-17f4f53835f9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:01.205913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6339d1fb-6197-4fab-b203-17f4f53835f9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:01.206733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6339d1fb-6197-4fab-b203-17f4f53835f9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:01.207194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6339d1fb-6197-4fab-b203-17f4f53835f9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:01.341360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6339d1fb-6197-4fab-b203-17f4f53835f9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:01.348917 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6339d1fb-6197-4fab-b203-17f4f53835f9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.155640 Jul 20 05:01:01.349493 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3293/6600] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:01 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:02.367085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-11e9ff2e-cd50-4188-a463-935ffb5f95d9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:02.367708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-11e9ff2e-cd50-4188-a463-935ffb5f95d9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:02.375801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11e9ff2e-cd50-4188-a463-935ffb5f95d9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:02.376262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11e9ff2e-cd50-4188-a463-935ffb5f95d9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:02.377040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11e9ff2e-cd50-4188-a463-935ffb5f95d9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:02.377485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-11e9ff2e-cd50-4188-a463-935ffb5f95d9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:02.512672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-11e9ff2e-cd50-4188-a463-935ffb5f95d9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:02.521107 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-11e9ff2e-cd50-4188-a463-935ffb5f95d9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.157914 Jul 20 05:01:02.521685 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3308/6601] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:02 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:03.539105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f9d72ba-e5e4-4792-ac17-da62f5e00d09 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:03.539733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0f9d72ba-e5e4-4792-ac17-da62f5e00d09 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:03.547238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f9d72ba-e5e4-4792-ac17-da62f5e00d09 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:03.547706 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f9d72ba-e5e4-4792-ac17-da62f5e00d09 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:03.548489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f9d72ba-e5e4-4792-ac17-da62f5e00d09 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:03.548942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0f9d72ba-e5e4-4792-ac17-da62f5e00d09 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:03.678595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0f9d72ba-e5e4-4792-ac17-da62f5e00d09 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:03.686477 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0f9d72ba-e5e4-4792-ac17-da62f5e00d09 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.151542 Jul 20 05:01:03.687062 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3294/6602] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:03 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:03.796747 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:01:03.797314 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:01:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:01:04.703702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-196d507e-4e47-4040-bf72-a49d6794f391 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:04.704322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-196d507e-4e47-4040-bf72-a49d6794f391 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:04.711304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-196d507e-4e47-4040-bf72-a49d6794f391 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:04.711759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-196d507e-4e47-4040-bf72-a49d6794f391 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:04.712525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-196d507e-4e47-4040-bf72-a49d6794f391 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:04.712965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-196d507e-4e47-4040-bf72-a49d6794f391 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:04.844488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-196d507e-4e47-4040-bf72-a49d6794f391 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:04.852052 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-196d507e-4e47-4040-bf72-a49d6794f391 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.152255 Jul 20 05:01:04.852618 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3309/6603] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:04 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:05.869956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35396930-4f72-4c99-882c-8cbcc9581f24 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:05.870656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-35396930-4f72-4c99-882c-8cbcc9581f24 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:05.878453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35396930-4f72-4c99-882c-8cbcc9581f24 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:05.878930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35396930-4f72-4c99-882c-8cbcc9581f24 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:05.879722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35396930-4f72-4c99-882c-8cbcc9581f24 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:05.880183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35396930-4f72-4c99-882c-8cbcc9581f24 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:06.023269 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-35396930-4f72-4c99-882c-8cbcc9581f24 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:06.031113 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-35396930-4f72-4c99-882c-8cbcc9581f24 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.165330 Jul 20 05:01:06.031661 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3295/6604] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:05 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:07.048290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-81631318-b476-4054-a409-b31cc87c7043 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:07.048899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-81631318-b476-4054-a409-b31cc87c7043 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:07.055942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81631318-b476-4054-a409-b31cc87c7043 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:07.056403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81631318-b476-4054-a409-b31cc87c7043 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:07.057186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81631318-b476-4054-a409-b31cc87c7043 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:07.057641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-81631318-b476-4054-a409-b31cc87c7043 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:07.192974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-81631318-b476-4054-a409-b31cc87c7043 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:07.200497 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-81631318-b476-4054-a409-b31cc87c7043 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.156232 Jul 20 05:01:07.201920 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3310/6605] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:07 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:08.219394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d0f47177-e638-4b47-ab10-193c03c8ee52 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:08.220024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d0f47177-e638-4b47-ab10-193c03c8ee52 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:08.227060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0f47177-e638-4b47-ab10-193c03c8ee52 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:08.227534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0f47177-e638-4b47-ab10-193c03c8ee52 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:08.228317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0f47177-e638-4b47-ab10-193c03c8ee52 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:08.228774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d0f47177-e638-4b47-ab10-193c03c8ee52 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:08.364965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d0f47177-e638-4b47-ab10-193c03c8ee52 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:08.373850 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d0f47177-e638-4b47-ab10-193c03c8ee52 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.159389 Jul 20 05:01:08.374455 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3296/6606] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:08 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:09.391212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-23fd3fbb-559a-41a6-a528-c5dc75f84b87 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:09.391943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-23fd3fbb-559a-41a6-a528-c5dc75f84b87 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:09.399035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23fd3fbb-559a-41a6-a528-c5dc75f84b87 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:09.399487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23fd3fbb-559a-41a6-a528-c5dc75f84b87 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:09.400256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23fd3fbb-559a-41a6-a528-c5dc75f84b87 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:09.400693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23fd3fbb-559a-41a6-a528-c5dc75f84b87 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:09.538520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-23fd3fbb-559a-41a6-a528-c5dc75f84b87 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:09.546072 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-23fd3fbb-559a-41a6-a528-c5dc75f84b87 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1515 microversion: 2.1 time: 0.158895 Jul 20 05:01:09.546708 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3311/6607] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:09 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:10.536180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d5cc938e-7879-4bfc-8c07-2492b2d672af req-81f222d0-405e-43fb-8762-0741d2a8b5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872ef0c8-1a6e-410d-b364-d718d85d081d", "name": "network-vif-unplugged", "status": "completed", "tag": "4d0e6650-da64-44c7-af62-74fe684fa2e5"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:10.546124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d5cc938e-7879-4bfc-8c07-2492b2d672af req-81f222d0-405e-43fb-8762-0741d2a8b5d6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:10.546619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d5cc938e-7879-4bfc-8c07-2492b2d672af req-81f222d0-405e-43fb-8762-0741d2a8b5d6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:10.559210 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d5cc938e-7879-4bfc-8c07-2492b2d672af req-81f222d0-405e-43fb-8762-0741d2a8b5d6 service nova] Creating event network-vif-unplugged:4d0e6650-da64-44c7-af62-74fe684fa2e5 for instance 872ef0c8-1a6e-410d-b364-d718d85d081d on n-h1-760456-11 Jul 20 05:01:10.565084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-829d1afe-b8b1-41bf-860e-149e2665156c tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:10.565776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-d5cc938e-7879-4bfc-8c07-2492b2d672af req-81f222d0-405e-43fb-8762-0741d2a8b5d6 service nova] Instance 872ef0c8-1a6e-410d-b364-d718d85d081d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:01:10.566339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-829d1afe-b8b1-41bf-860e-149e2665156c tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:10.573718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-829d1afe-b8b1-41bf-860e-149e2665156c tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:10.574289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-829d1afe-b8b1-41bf-860e-149e2665156c tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:10.575147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-829d1afe-b8b1-41bf-860e-149e2665156c tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:10.575807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-829d1afe-b8b1-41bf-860e-149e2665156c tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:10.576932 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d5cc938e-7879-4bfc-8c07-2492b2d672af req-81f222d0-405e-43fb-8762-0741d2a8b5d6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044574 Jul 20 05:01:10.577759 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3297/6608] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:10.730040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-829d1afe-b8b1-41bf-860e-149e2665156c tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:10.739579 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-829d1afe-b8b1-41bf-860e-149e2665156c tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1514 microversion: 2.1 time: 0.179926 Jul 20 05:01:10.740166 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3312/6609] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:10 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:01:11.759817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f8600419-cc72-4d33-946a-9fc8775c9f2a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:11.760598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f8600419-cc72-4d33-946a-9fc8775c9f2a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:11.767716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8600419-cc72-4d33-946a-9fc8775c9f2a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:11.768190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8600419-cc72-4d33-946a-9fc8775c9f2a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:11.768979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8600419-cc72-4d33-946a-9fc8775c9f2a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:11.769442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8600419-cc72-4d33-946a-9fc8775c9f2a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:11.905226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f8600419-cc72-4d33-946a-9fc8775c9f2a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:11.912925 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f8600419-cc72-4d33-946a-9fc8775c9f2a tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1512 microversion: 2.1 time: 0.158439 Jul 20 05:01:11.913505 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3298/6610] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:11 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:12.606888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-37347a94-f00c-4022-9ab7-38f54e35de40 req-b8719caf-540a-4628-819b-bf4f9f12aa18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872ef0c8-1a6e-410d-b364-d718d85d081d", "tag": "4d0e6650-da64-44c7-af62-74fe684fa2e5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:12.615142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-37347a94-f00c-4022-9ab7-38f54e35de40 req-b8719caf-540a-4628-819b-bf4f9f12aa18 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:12.615595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-37347a94-f00c-4022-9ab7-38f54e35de40 req-b8719caf-540a-4628-819b-bf4f9f12aa18 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:12.627821 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-37347a94-f00c-4022-9ab7-38f54e35de40 req-b8719caf-540a-4628-819b-bf4f9f12aa18 service nova] Creating event network-changed:4d0e6650-da64-44c7-af62-74fe684fa2e5 for instance 872ef0c8-1a6e-410d-b364-d718d85d081d on n-h1-760456-11 Jul 20 05:01:12.633095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-37347a94-f00c-4022-9ab7-38f54e35de40 req-b8719caf-540a-4628-819b-bf4f9f12aa18 service nova] Instance 872ef0c8-1a6e-410d-b364-d718d85d081d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:01:12.644571 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-37347a94-f00c-4022-9ab7-38f54e35de40 req-b8719caf-540a-4628-819b-bf4f9f12aa18 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041920 Jul 20 05:01:12.645280 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3313/6611] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:12.931222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6ac16028-49d5-4417-8d82-4d1f7a9ed8c1 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:12.932302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6ac16028-49d5-4417-8d82-4d1f7a9ed8c1 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:12.942948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ac16028-49d5-4417-8d82-4d1f7a9ed8c1 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:12.943318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ac16028-49d5-4417-8d82-4d1f7a9ed8c1 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:12.944068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ac16028-49d5-4417-8d82-4d1f7a9ed8c1 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:12.944516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ac16028-49d5-4417-8d82-4d1f7a9ed8c1 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:13.260085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6ac16028-49d5-4417-8d82-4d1f7a9ed8c1 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:13.269265 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6ac16028-49d5-4417-8d82-4d1f7a9ed8c1 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1509 microversion: 2.1 time: 0.342148 Jul 20 05:01:13.270111 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3299/6612] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:12 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1509 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:13.286808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7604a220-0f26-47b4-9c84-4b887b2cfb03 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:13.287718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7604a220-0f26-47b4-9c84-4b887b2cfb03 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:13.294507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7604a220-0f26-47b4-9c84-4b887b2cfb03 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:13.295333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7604a220-0f26-47b4-9c84-4b887b2cfb03 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:13.296327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7604a220-0f26-47b4-9c84-4b887b2cfb03 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:13.296947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7604a220-0f26-47b4-9c84-4b887b2cfb03 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:13.329175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7604a220-0f26-47b4-9c84-4b887b2cfb03 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:01:13.395366 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.compute.api [None req-7604a220-0f26-47b4-9c84-4b887b2cfb03 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Found an unconfirmed migration during delete, id: 16, status: finished Jul 20 05:01:14.691074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:14.710170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=30 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:14.728371 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7604a220-0f26-47b4-9c84-4b887b2cfb03 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "DELETE /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 204 len: 0 microversion: 2.1 time: 1.445565 Jul 20 05:01:14.728960 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3314/6613] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:01:13 2022] DELETE /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 0 bytes in 1447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:01:14.737937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6719668f-6b08-4504-b363-5ff48ddeb148 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:14.738898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6719668f-6b08-4504-b363-5ff48ddeb148 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:14.746103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6719668f-6b08-4504-b363-5ff48ddeb148 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:14.746610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6719668f-6b08-4504-b363-5ff48ddeb148 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:14.747406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6719668f-6b08-4504-b363-5ff48ddeb148 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:14.747893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6719668f-6b08-4504-b363-5ff48ddeb148 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:14.882573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6719668f-6b08-4504-b363-5ff48ddeb148 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:14.884982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=88 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:14.892221 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6719668f-6b08-4504-b363-5ff48ddeb148 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1501 microversion: 2.1 time: 0.158300 Jul 20 05:01:14.892809 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3300/6614] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:14 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:15.367304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-cdfaae7d-ac7a-4dfc-847a-62415c87b395 req-7dbd98a5-ef90-47af-af02-abfa23634c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872ef0c8-1a6e-410d-b364-d718d85d081d", "name": "network-vif-plugged", "status": "completed", "tag": "4d0e6650-da64-44c7-af62-74fe684fa2e5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:15.377612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cdfaae7d-ac7a-4dfc-847a-62415c87b395 req-7dbd98a5-ef90-47af-af02-abfa23634c17 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:15.378118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cdfaae7d-ac7a-4dfc-847a-62415c87b395 req-7dbd98a5-ef90-47af-af02-abfa23634c17 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:15.391423 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-cdfaae7d-ac7a-4dfc-847a-62415c87b395 req-7dbd98a5-ef90-47af-af02-abfa23634c17 service nova] Creating event network-vif-plugged:4d0e6650-da64-44c7-af62-74fe684fa2e5 for instance 872ef0c8-1a6e-410d-b364-d718d85d081d on n-h1-760456-11 Jul 20 05:01:15.396206 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-cdfaae7d-ac7a-4dfc-847a-62415c87b395 req-7dbd98a5-ef90-47af-af02-abfa23634c17 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032972 Jul 20 05:01:15.396840 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3315/6615] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:15.909902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fb145770-e39e-49d9-b372-7994f46712e2 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:15.910720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fb145770-e39e-49d9-b372-7994f46712e2 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:15.913574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=30 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:15.919654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb145770-e39e-49d9-b372-7994f46712e2 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:15.920121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb145770-e39e-49d9-b372-7994f46712e2 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:15.920920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb145770-e39e-49d9-b372-7994f46712e2 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:15.921384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fb145770-e39e-49d9-b372-7994f46712e2 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:16.095646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fb145770-e39e-49d9-b372-7994f46712e2 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51fc47d7d79458e922bc18e6fd4d30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdaf6b4f64a4339a3c984b7fdb11788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:16.103554 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fb145770-e39e-49d9-b372-7994f46712e2 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 200 len: 1501 microversion: 2.1 time: 0.197968 Jul 20 05:01:16.104337 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3301/6616] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:15 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:16.501192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-721195f8-7a68-497a-a67b-a0707ef23f6c req-8494af66-b3f7-4848-ac11-e8d960265e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872ef0c8-1a6e-410d-b364-d718d85d081d", "name": "network-vif-deleted", "tag": "4d0e6650-da64-44c7-af62-74fe684fa2e5"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:16.512339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-721195f8-7a68-497a-a67b-a0707ef23f6c req-8494af66-b3f7-4848-ac11-e8d960265e6a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:16.512854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-721195f8-7a68-497a-a67b-a0707ef23f6c req-8494af66-b3f7-4848-ac11-e8d960265e6a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:16.527072 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-721195f8-7a68-497a-a67b-a0707ef23f6c req-8494af66-b3f7-4848-ac11-e8d960265e6a service nova] Creating event network-vif-deleted:4d0e6650-da64-44c7-af62-74fe684fa2e5 for instance 872ef0c8-1a6e-410d-b364-d718d85d081d on n-h1-760456-11 Jul 20 05:01:16.532503 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-721195f8-7a68-497a-a67b-a0707ef23f6c req-8494af66-b3f7-4848-ac11-e8d960265e6a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038272 Jul 20 05:01:16.533528 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3316/6617] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:17.120844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43edee9d-4118-4b6a-81ef-be6c9f8dd34e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:17.121399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43edee9d-4118-4b6a-81ef-be6c9f8dd34e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:17.128436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43edee9d-4118-4b6a-81ef-be6c9f8dd34e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:17.128905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43edee9d-4118-4b6a-81ef-be6c9f8dd34e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:17.129698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43edee9d-4118-4b6a-81ef-be6c9f8dd34e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:17.130156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43edee9d-4118-4b6a-81ef-be6c9f8dd34e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:17.144040 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-43edee9d-4118-4b6a-81ef-be6c9f8dd34e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] HTTP exception thrown: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43edee9d-4118-4b6a-81ef-be6c9f8dd34e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Request method failure captured: Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d HTTP/1.1 Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14vuWf1HhrfRwaY0nxekJYje4jA2g0RpiBpaHUo3h1hscizfvg_JTuKyIFf4hnAhjMASJaf3sFL7E8xpyszw46zWHS8B9aGsb_sEbfgh6ApgeFWk6VHXq8yHzqfVR000VYJSuLpbPEAKjPatlw8pOOotTAnEzfCpN54aaODPX-x0TdE Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: abdaf6b4f64a4339a3c984b7fdb11788 Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-664390455 Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-664390455 Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: abdaf6b4f64a4339a3c984b7fdb11788 Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-664390455 Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-664390455-project Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: a51fc47d7d79458e922bc18e6fd4d30c Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-664390455-project Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '872ef0c8-1a6e-410d-b364-d718d85d081d'} Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:01:17.145704 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.151531 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:17.151531 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:01:17.151531 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:01:17.151531 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:01:17.151531 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:01:17.151531 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.151531 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.151531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43edee9d-4118-4b6a-81ef-be6c9f8dd34e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Returning 404 to user: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:01:17.151531 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43edee9d-4118-4b6a-81ef-be6c9f8dd34e tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 404 len: 111 microversion: 2.1 time: 0.030725 Jul 20 05:01:17.151531 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3302/6618] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:17 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:01:17.165839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08df3dc0-2f2d-4bd8-a4f5-5091b7f00ed9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:17.166525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-08df3dc0-2f2d-4bd8-a4f5-5091b7f00ed9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:17.172996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08df3dc0-2f2d-4bd8-a4f5-5091b7f00ed9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:17.173450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08df3dc0-2f2d-4bd8-a4f5-5091b7f00ed9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:17.174207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08df3dc0-2f2d-4bd8-a4f5-5091b7f00ed9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:17.174675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08df3dc0-2f2d-4bd8-a4f5-5091b7f00ed9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:17.187866 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-08df3dc0-2f2d-4bd8-a4f5-5091b7f00ed9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] HTTP exception thrown: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08df3dc0-2f2d-4bd8-a4f5-5091b7f00ed9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Request method failure captured: Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d HTTP/1.1 Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14vuWf1HhrfRwaY0nxekJYje4jA2g0RpiBpaHUo3h1hscizfvg_JTuKyIFf4hnAhjMASJaf3sFL7E8xpyszw46zWHS8B9aGsb_sEbfgh6ApgeFWk6VHXq8yHzqfVR000VYJSuLpbPEAKjPatlw8pOOotTAnEzfCpN54aaODPX-x0TdE Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: abdaf6b4f64a4339a3c984b7fdb11788 Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-DeleteServersTestJSON-664390455 Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-DeleteServersTestJSON-664390455 Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: abdaf6b4f64a4339a3c984b7fdb11788 Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-DeleteServersTestJSON-664390455 Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-DeleteServersTestJSON-664390455-project Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: a51fc47d7d79458e922bc18e6fd4d30c Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-DeleteServersTestJSON-664390455-project Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '872ef0c8-1a6e-410d-b364-d718d85d081d'} Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:01:17.189488 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08df3dc0-2f2d-4bd8-a4f5-5091b7f00ed9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Returning 404 to user: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08df3dc0-2f2d-4bd8-a4f5-5091b7f00ed9 tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "DELETE /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 404 len: 111 microversion: 2.1 time: 0.029958 Jul 20 05:01:17.194899 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3317/6619] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:01:17 2022] DELETE /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:01:17.199344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fcba0c22-4272-4fcc-bffa-e9309e059eea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:17.199970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fcba0c22-4272-4fcc-bffa-e9309e059eea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] [instance: 872ef0c8-1a6e-410d-b364-d718d85d081d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:17.206768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fcba0c22-4272-4fcc-bffa-e9309e059eea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:17.207230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fcba0c22-4272-4fcc-bffa-e9309e059eea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:17.208004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fcba0c22-4272-4fcc-bffa-e9309e059eea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:17.208451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fcba0c22-4272-4fcc-bffa-e9309e059eea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:17.222107 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-fcba0c22-4272-4fcc-bffa-e9309e059eea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] HTTP exception thrown: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fcba0c22-4272-4fcc-bffa-e9309e059eea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Request method failure captured: Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d HTTP/1.1 Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14vuWf1HhrfRwaY0nxekJYje4jA2g0RpiBpaHUo3h1hscizfvg_JTuKyIFf4hnAhjMASJaf3sFL7E8xpyszw46zWHS8B9aGsb_sEbfgh6ApgeFWk6VHXq8yHzqfVR000VYJSuLpbPEAKjPatlw8pOOotTAnEzfCpN54aaODPX-x0TdE Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: abdaf6b4f64a4339a3c984b7fdb11788 Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-DeleteServersTestJSON-664390455 Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_abdaf6b4f64a4339a3c984b7fdb11788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-DeleteServersTestJSON-664390455 Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: abdaf6b4f64a4339a3c984b7fdb11788 Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-DeleteServersTestJSON-664390455 Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-DeleteServersTestJSON-664390455-project Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: a51fc47d7d79458e922bc18e6fd4d30c Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-DeleteServersTestJSON-664390455-project Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '872ef0c8-1a6e-410d-b364-d718d85d081d'} Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:01:17.223637 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.228877 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:17.228877 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:01:17.228877 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:01:17.228877 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:01:17.228877 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:01:17.228877 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. Jul 20 05:01:17.228877 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:01:17.228877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fcba0c22-4272-4fcc-bffa-e9309e059eea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] Returning 404 to user: Instance 872ef0c8-1a6e-410d-b364-d718d85d081d could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:01:17.228877 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fcba0c22-4272-4fcc-bffa-e9309e059eea tempest-DeleteServersTestJSON-664390455 tempest-DeleteServersTestJSON-664390455-project] 10.222.0.59 "GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d" status: 404 len: 111 microversion: 2.1 time: 0.029513 Jul 20 05:01:17.228877 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3303/6620] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:17 2022] GET /compute/v2.1/servers/872ef0c8-1a6e-410d-b364-d718d85d081d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:01:26.020628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-145169936", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "51a7070e-b502-4382-bd05-e8d2ce9db180"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:26.077027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] validate_networks() for [('51a7070e-b502-4382-bd05-e8d2ce9db180', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:01:26.498440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:01:26.498961 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:01:26.499601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:01:26.500166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:01:26.500591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:01:26.510083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:26.510570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:26.511369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:26.512014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:26.533359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Getting quotas for project b4761098051e4917ac4567da7bb55898. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:01:26.539805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Getting quotas for user e96a3000ee4046e3a705f359a4825ddd and project b4761098051e4917ac4567da7bb55898. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:01:26.552962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:01:26.555294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:01:26.605816 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31b769c7-4f17-41fa-b9c3-9c010d9d734e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735183 Jul 20 05:01:26.606936 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3318/6621] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:01:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:01:26.617042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-adb652fc-03ba-4aa2-9c29-1f856c0a4620 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:26.618317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-adb652fc-03ba-4aa2-9c29-1f856c0a4620 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:26.679511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-adb652fc-03ba-4aa2-9c29-1f856c0a4620 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:26.687178 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-adb652fc-03ba-4aa2-9c29-1f856c0a4620 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1217 microversion: 2.1 time: 0.074011 Jul 20 05:01:26.687764 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3304/6622] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:26 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:01:27.706622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-328ca9e3-681f-401b-9b19-565077191b57 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:27.707259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-328ca9e3-681f-401b-9b19-565077191b57 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:27.714503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-328ca9e3-681f-401b-9b19-565077191b57 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:27.715211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-328ca9e3-681f-401b-9b19-565077191b57 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:27.716817 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-328ca9e3-681f-401b-9b19-565077191b57 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:27.717457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-328ca9e3-681f-401b-9b19-565077191b57 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:27.782912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-328ca9e3-681f-401b-9b19-565077191b57 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:27.790886 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-328ca9e3-681f-401b-9b19-565077191b57 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1275 microversion: 2.1 time: 0.089233 Jul 20 05:01:27.792026 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3319/6623] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:27 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:28.808890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8fb4a84e-8b49-4cca-847f-af2fcf53124b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:28.809774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8fb4a84e-8b49-4cca-847f-af2fcf53124b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:28.811932 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=11 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:28.819156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fb4a84e-8b49-4cca-847f-af2fcf53124b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:28.819942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fb4a84e-8b49-4cca-847f-af2fcf53124b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:28.820942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fb4a84e-8b49-4cca-847f-af2fcf53124b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:28.821400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8fb4a84e-8b49-4cca-847f-af2fcf53124b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:29.096910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8fb4a84e-8b49-4cca-847f-af2fcf53124b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:29.105697 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8fb4a84e-8b49-4cca-847f-af2fcf53124b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1317 microversion: 2.1 time: 0.300694 Jul 20 05:01:29.123207 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3305/6624] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:28 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:29.276417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1cbeab78-2548-40f7-9eb1-8d9cf24d4b45 req-726d2534-7a23-4a57-96dd-06fc154c42c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260da9fa-8105-4df3-b174-3bce407b6193", "tag": "29ed9c5b-236f-494f-b507-208db1a71197"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:29.302377 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1cbeab78-2548-40f7-9eb1-8d9cf24d4b45 req-726d2534-7a23-4a57-96dd-06fc154c42c0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:29.303722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1cbeab78-2548-40f7-9eb1-8d9cf24d4b45 req-726d2534-7a23-4a57-96dd-06fc154c42c0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:29.336168 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1cbeab78-2548-40f7-9eb1-8d9cf24d4b45 req-726d2534-7a23-4a57-96dd-06fc154c42c0 service nova] Creating event network-changed:29ed9c5b-236f-494f-b507-208db1a71197 for instance 260da9fa-8105-4df3-b174-3bce407b6193 on n-h1-760456-11 Jul 20 05:01:29.345953 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1cbeab78-2548-40f7-9eb1-8d9cf24d4b45 req-726d2534-7a23-4a57-96dd-06fc154c42c0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074310 Jul 20 05:01:29.347037 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3320/6625] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:30.129416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cb14253b-e377-4235-9390-8749708cd788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:30.130061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cb14253b-e377-4235-9390-8749708cd788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:30.137225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb14253b-e377-4235-9390-8749708cd788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:30.137976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb14253b-e377-4235-9390-8749708cd788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:30.138816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb14253b-e377-4235-9390-8749708cd788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:30.139285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb14253b-e377-4235-9390-8749708cd788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:30.276245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cb14253b-e377-4235-9390-8749708cd788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:30.284764 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cb14253b-e377-4235-9390-8749708cd788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1317 microversion: 2.1 time: 0.159425 Jul 20 05:01:30.285389 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3306/6626] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:30 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:31.302940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1f13bd56-13a9-4600-b311-c04908481de1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:31.303815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1f13bd56-13a9-4600-b311-c04908481de1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:31.310181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f13bd56-13a9-4600-b311-c04908481de1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:31.310682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f13bd56-13a9-4600-b311-c04908481de1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:31.311473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f13bd56-13a9-4600-b311-c04908481de1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:31.311924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f13bd56-13a9-4600-b311-c04908481de1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:31.461687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1f13bd56-13a9-4600-b311-c04908481de1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:31.471602 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1f13bd56-13a9-4600-b311-c04908481de1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1317 microversion: 2.1 time: 0.173634 Jul 20 05:01:31.472338 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3321/6627] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:31 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:32.489005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f70e0251-b1ea-4fb8-8c06-1f5ce1cd30e2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:32.489709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f70e0251-b1ea-4fb8-8c06-1f5ce1cd30e2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:32.496875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f70e0251-b1ea-4fb8-8c06-1f5ce1cd30e2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:32.497384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f70e0251-b1ea-4fb8-8c06-1f5ce1cd30e2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:32.498417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f70e0251-b1ea-4fb8-8c06-1f5ce1cd30e2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:32.498889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f70e0251-b1ea-4fb8-8c06-1f5ce1cd30e2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:32.635386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f70e0251-b1ea-4fb8-8c06-1f5ce1cd30e2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:32.642936 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f70e0251-b1ea-4fb8-8c06-1f5ce1cd30e2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1317 microversion: 2.1 time: 0.157851 Jul 20 05:01:32.643526 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3307/6628] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:32 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:33.434625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-d6517b04-224b-496b-85fb-e9f76a345bcb req-71ac0884-19f0-45b6-a617-891e830cf08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260da9fa-8105-4df3-b174-3bce407b6193", "name": "network-vif-plugged", "status": "completed", "tag": "29ed9c5b-236f-494f-b507-208db1a71197"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:33.445143 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d6517b04-224b-496b-85fb-e9f76a345bcb req-71ac0884-19f0-45b6-a617-891e830cf08f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:33.446406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d6517b04-224b-496b-85fb-e9f76a345bcb req-71ac0884-19f0-45b6-a617-891e830cf08f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:33.459180 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-d6517b04-224b-496b-85fb-e9f76a345bcb req-71ac0884-19f0-45b6-a617-891e830cf08f service nova] Creating event network-vif-plugged:29ed9c5b-236f-494f-b507-208db1a71197 for instance 260da9fa-8105-4df3-b174-3bce407b6193 on n-h1-760456-11 Jul 20 05:01:33.464475 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-d6517b04-224b-496b-85fb-e9f76a345bcb req-71ac0884-19f0-45b6-a617-891e830cf08f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034127 Jul 20 05:01:33.465072 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3322/6629] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:33.659968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-126fcd13-5d5f-44a0-a214-4f6b525f370f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:33.660644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-126fcd13-5d5f-44a0-a214-4f6b525f370f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:33.667764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-126fcd13-5d5f-44a0-a214-4f6b525f370f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:33.668263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-126fcd13-5d5f-44a0-a214-4f6b525f370f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:33.669595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-126fcd13-5d5f-44a0-a214-4f6b525f370f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:33.670041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-126fcd13-5d5f-44a0-a214-4f6b525f370f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:33.804059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-126fcd13-5d5f-44a0-a214-4f6b525f370f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:33.812253 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-126fcd13-5d5f-44a0-a214-4f6b525f370f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1317 microversion: 2.1 time: 0.156205 Jul 20 05:01:33.812830 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3308/6630] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:33 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:34.830711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-589a6dec-6738-4c83-a241-36e35e7bbaaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:34.831419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-589a6dec-6738-4c83-a241-36e35e7bbaaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:34.838973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-589a6dec-6738-4c83-a241-36e35e7bbaaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:34.839440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-589a6dec-6738-4c83-a241-36e35e7bbaaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:34.840211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-589a6dec-6738-4c83-a241-36e35e7bbaaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:34.841081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-589a6dec-6738-4c83-a241-36e35e7bbaaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:34.974002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-589a6dec-6738-4c83-a241-36e35e7bbaaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:34.982177 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-589a6dec-6738-4c83-a241-36e35e7bbaaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1507 microversion: 2.1 time: 0.155759 Jul 20 05:01:34.982817 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3323/6631] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:34 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:35.000321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-05975947-6be3-40c5-875d-282d80e688b1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:35.001006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-05975947-6be3-40c5-875d-282d80e688b1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:35.008190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05975947-6be3-40c5-875d-282d80e688b1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.008663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05975947-6be3-40c5-875d-282d80e688b1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.009452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05975947-6be3-40c5-875d-282d80e688b1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.009909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-05975947-6be3-40c5-875d-282d80e688b1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.142109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-05975947-6be3-40c5-875d-282d80e688b1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:35.149818 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-05975947-6be3-40c5-875d-282d80e688b1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1507 microversion: 2.1 time: 0.154367 Jul 20 05:01:35.150420 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3309/6632] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:34 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:35.165930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-19db927e-e652-4b10-882c-070e14aa20d0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:35.167108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-19db927e-e652-4b10-882c-070e14aa20d0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:35.174323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19db927e-e652-4b10-882c-070e14aa20d0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.174790 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19db927e-e652-4b10-882c-070e14aa20d0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.175585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19db927e-e652-4b10-882c-070e14aa20d0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.176029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-19db927e-e652-4b10-882c-070e14aa20d0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.237566 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-19db927e-e652-4b10-882c-070e14aa20d0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "PUT /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1079 microversion: 2.1 time: 0.075420 Jul 20 05:01:35.238131 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3324/6633] 10.222.0.59 () {60 vars in 1255 bytes} [Wed Jul 20 05:01:35 2022] PUT /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1079 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:35.252875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bfc987c6-5452-4647-9fa7-f724d36f53e9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:35.253505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bfc987c6-5452-4647-9fa7-f724d36f53e9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:35.259507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfc987c6-5452-4647-9fa7-f724d36f53e9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.259967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfc987c6-5452-4647-9fa7-f724d36f53e9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.260743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfc987c6-5452-4647-9fa7-f724d36f53e9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.261188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfc987c6-5452-4647-9fa7-f724d36f53e9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.392926 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bfc987c6-5452-4647-9fa7-f724d36f53e9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:35.400399 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bfc987c6-5452-4647-9fa7-f724d36f53e9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1505 microversion: 2.1 time: 0.151356 Jul 20 05:01:35.400965 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3310/6634] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:35 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:35.418273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-76e3fcec-30e8-4a27-b386-b819117ac329 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:35.419602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-76e3fcec-30e8-4a27-b386-b819117ac329 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:35.425619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76e3fcec-30e8-4a27-b386-b819117ac329 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.426103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76e3fcec-30e8-4a27-b386-b819117ac329 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.426916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76e3fcec-30e8-4a27-b386-b819117ac329 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.427362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76e3fcec-30e8-4a27-b386-b819117ac329 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.565473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-76e3fcec-30e8-4a27-b386-b819117ac329 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:35.573063 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-76e3fcec-30e8-4a27-b386-b819117ac329 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1505 microversion: 2.1 time: 0.158709 Jul 20 05:01:35.573635 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3325/6635] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:35 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:35.589253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:35.590277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:35.597260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.597727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.598641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.599099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.628624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:35.634725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Old instance type m1.heat2, new instance type m1.heat {{(pid=119605) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:01:35.641545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:01:35.642046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:01:35.642562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:01:35.642991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:01:35.643419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:01:35.707473 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9e0d95a7-098a-4029-a96e-0646f03cbcf0 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "POST /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193/action" status: 202 len: 0 microversion: 2.1 time: 0.122159 Jul 20 05:01:35.708082 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3311/6636] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:01:35 2022] POST /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:01:35.717836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a51fa7f8-3014-4929-9ee1-a4a97cac0ed1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:35.718481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a51fa7f8-3014-4929-9ee1-a4a97cac0ed1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:35.724667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51fa7f8-3014-4929-9ee1-a4a97cac0ed1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.725125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51fa7f8-3014-4929-9ee1-a4a97cac0ed1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.725895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51fa7f8-3014-4929-9ee1-a4a97cac0ed1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.726384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a51fa7f8-3014-4929-9ee1-a4a97cac0ed1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.864179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a51fa7f8-3014-4929-9ee1-a4a97cac0ed1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:35.872230 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a51fa7f8-3014-4929-9ee1-a4a97cac0ed1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1516 microversion: 2.1 time: 0.158732 Jul 20 05:01:35.872817 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3326/6637] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:35 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:36.887535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:36.891794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e9b6d8e6-24fe-4c61-9892-a59a3a87c360 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:36.892589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e9b6d8e6-24fe-4c61-9892-a59a3a87c360 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:36.899832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9b6d8e6-24fe-4c61-9892-a59a3a87c360 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:36.900296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9b6d8e6-24fe-4c61-9892-a59a3a87c360 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:36.901075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9b6d8e6-24fe-4c61-9892-a59a3a87c360 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:36.901527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9b6d8e6-24fe-4c61-9892-a59a3a87c360 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:37.132313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e9b6d8e6-24fe-4c61-9892-a59a3a87c360 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:37.145256 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e9b6d8e6-24fe-4c61-9892-a59a3a87c360 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1516 microversion: 2.1 time: 0.259342 Jul 20 05:01:37.145859 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3312/6638] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:36 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1516 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:38.164028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-323131c6-5b69-44ba-8dda-b092af4a66de tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:38.164654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-323131c6-5b69-44ba-8dda-b092af4a66de tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:38.166660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:38.167329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:38.174940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-323131c6-5b69-44ba-8dda-b092af4a66de tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:38.175405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-323131c6-5b69-44ba-8dda-b092af4a66de tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:38.176180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-323131c6-5b69-44ba-8dda-b092af4a66de tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:38.176660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-323131c6-5b69-44ba-8dda-b092af4a66de tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:38.308669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-323131c6-5b69-44ba-8dda-b092af4a66de tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:38.316934 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-323131c6-5b69-44ba-8dda-b092af4a66de tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.156718 Jul 20 05:01:38.317531 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3327/6639] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:38 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:39.334816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9b118448-5a83-43c9-84b2-f9dc4676bc6c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:39.335487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9b118448-5a83-43c9-84b2-f9dc4676bc6c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:39.343431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b118448-5a83-43c9-84b2-f9dc4676bc6c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:39.343905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b118448-5a83-43c9-84b2-f9dc4676bc6c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:39.344684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b118448-5a83-43c9-84b2-f9dc4676bc6c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:39.345134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9b118448-5a83-43c9-84b2-f9dc4676bc6c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:39.481418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9b118448-5a83-43c9-84b2-f9dc4676bc6c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:39.489215 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9b118448-5a83-43c9-84b2-f9dc4676bc6c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.158348 Jul 20 05:01:39.489800 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3313/6640] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:39 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:40.507635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d7529d2a-ce0d-4638-8885-e762dce60c77 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:40.508267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d7529d2a-ce0d-4638-8885-e762dce60c77 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:40.515514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7529d2a-ce0d-4638-8885-e762dce60c77 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:40.515978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7529d2a-ce0d-4638-8885-e762dce60c77 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:40.516759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7529d2a-ce0d-4638-8885-e762dce60c77 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:40.517212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7529d2a-ce0d-4638-8885-e762dce60c77 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:40.663897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d7529d2a-ce0d-4638-8885-e762dce60c77 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:40.672481 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d7529d2a-ce0d-4638-8885-e762dce60c77 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.168753 Jul 20 05:01:40.673072 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3328/6641] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:40 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:41.690346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-81c1ec84-a5a6-4148-bcff-6eb73a71669f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:41.690982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-81c1ec84-a5a6-4148-bcff-6eb73a71669f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:41.697934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81c1ec84-a5a6-4148-bcff-6eb73a71669f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:41.698436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81c1ec84-a5a6-4148-bcff-6eb73a71669f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:41.699216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81c1ec84-a5a6-4148-bcff-6eb73a71669f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:41.699670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-81c1ec84-a5a6-4148-bcff-6eb73a71669f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:41.834409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-81c1ec84-a5a6-4148-bcff-6eb73a71669f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:41.843370 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-81c1ec84-a5a6-4148-bcff-6eb73a71669f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.156919 Jul 20 05:01:41.843954 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3314/6642] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:41 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:42.860760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f9f48e80-098a-47d5-8b53-b760cb485d18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:42.862124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f9f48e80-098a-47d5-8b53-b760cb485d18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:42.869769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9f48e80-098a-47d5-8b53-b760cb485d18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:42.869769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9f48e80-098a-47d5-8b53-b760cb485d18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:42.870607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9f48e80-098a-47d5-8b53-b760cb485d18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:42.870966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9f48e80-098a-47d5-8b53-b760cb485d18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:43.000742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f9f48e80-098a-47d5-8b53-b760cb485d18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:43.008255 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f9f48e80-098a-47d5-8b53-b760cb485d18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.151462 Jul 20 05:01:43.008831 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3329/6643] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:42 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:44.025692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8cdddbde-3184-4c74-a438-a56199fefe2e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:44.026340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8cdddbde-3184-4c74-a438-a56199fefe2e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:44.033787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cdddbde-3184-4c74-a438-a56199fefe2e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:44.034274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cdddbde-3184-4c74-a438-a56199fefe2e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:44.035060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cdddbde-3184-4c74-a438-a56199fefe2e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:44.035518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cdddbde-3184-4c74-a438-a56199fefe2e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:44.165641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8cdddbde-3184-4c74-a438-a56199fefe2e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:44.173203 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8cdddbde-3184-4c74-a438-a56199fefe2e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.151454 Jul 20 05:01:44.173775 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3315/6644] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:44 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:45.190310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1a5ce21-6ff2-47d6-86f8-50b4823589cd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:45.190941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d1a5ce21-6ff2-47d6-86f8-50b4823589cd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:45.193796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:45.199343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1a5ce21-6ff2-47d6-86f8-50b4823589cd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:45.199811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1a5ce21-6ff2-47d6-86f8-50b4823589cd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:45.201327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1a5ce21-6ff2-47d6-86f8-50b4823589cd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:45.201797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1a5ce21-6ff2-47d6-86f8-50b4823589cd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:45.205278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:45.337461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1a5ce21-6ff2-47d6-86f8-50b4823589cd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:45.346172 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1a5ce21-6ff2-47d6-86f8-50b4823589cd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.159802 Jul 20 05:01:45.346784 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3330/6645] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:45 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:46.364056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-029d68f4-788c-4c59-bd95-ed15aab2fec5 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:46.364686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-029d68f4-788c-4c59-bd95-ed15aab2fec5 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:46.367659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=36 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:46.374063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-029d68f4-788c-4c59-bd95-ed15aab2fec5 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:46.374555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-029d68f4-788c-4c59-bd95-ed15aab2fec5 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:46.375338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-029d68f4-788c-4c59-bd95-ed15aab2fec5 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:46.375794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-029d68f4-788c-4c59-bd95-ed15aab2fec5 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:46.512115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-029d68f4-788c-4c59-bd95-ed15aab2fec5 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:46.520460 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-029d68f4-788c-4c59-bd95-ed15aab2fec5 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.160380 Jul 20 05:01:46.521046 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3316/6646] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:46 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:47.537621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-365296c7-c341-4932-be08-3e527182a4ed tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:47.538624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-365296c7-c341-4932-be08-3e527182a4ed tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:47.547089 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-365296c7-c341-4932-be08-3e527182a4ed tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:47.547555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-365296c7-c341-4932-be08-3e527182a4ed tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:47.548359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-365296c7-c341-4932-be08-3e527182a4ed tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:47.548791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-365296c7-c341-4932-be08-3e527182a4ed tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:47.678667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-365296c7-c341-4932-be08-3e527182a4ed tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:47.686510 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-365296c7-c341-4932-be08-3e527182a4ed tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.152832 Jul 20 05:01:47.687098 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3331/6647] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:47 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:48.703886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c64a9816-43ac-42d9-9fa1-540e643407ea tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:48.704517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c64a9816-43ac-42d9-9fa1-540e643407ea tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:48.711765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c64a9816-43ac-42d9-9fa1-540e643407ea tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:48.712248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c64a9816-43ac-42d9-9fa1-540e643407ea tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:48.713045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c64a9816-43ac-42d9-9fa1-540e643407ea tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:48.713508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c64a9816-43ac-42d9-9fa1-540e643407ea tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:48.845352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c64a9816-43ac-42d9-9fa1-540e643407ea tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:48.852913 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c64a9816-43ac-42d9-9fa1-540e643407ea tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.153244 Jul 20 05:01:48.853774 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3317/6648] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:48 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:49.871233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-207e4e42-8989-459a-a5fa-706f0939efd9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:49.872543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-207e4e42-8989-459a-a5fa-706f0939efd9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:49.879642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-207e4e42-8989-459a-a5fa-706f0939efd9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:49.880235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-207e4e42-8989-459a-a5fa-706f0939efd9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:49.881019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-207e4e42-8989-459a-a5fa-706f0939efd9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:49.881473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-207e4e42-8989-459a-a5fa-706f0939efd9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:50.014998 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-207e4e42-8989-459a-a5fa-706f0939efd9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:50.022483 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-207e4e42-8989-459a-a5fa-706f0939efd9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.155385 Jul 20 05:01:50.023054 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3332/6649] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:49 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:51.040187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-169b4e9d-6aad-4129-9b5c-6c5dbc0a4476 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:51.040828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-169b4e9d-6aad-4129-9b5c-6c5dbc0a4476 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:51.049496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-169b4e9d-6aad-4129-9b5c-6c5dbc0a4476 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:51.049966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-169b4e9d-6aad-4129-9b5c-6c5dbc0a4476 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:51.050782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-169b4e9d-6aad-4129-9b5c-6c5dbc0a4476 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:51.051240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-169b4e9d-6aad-4129-9b5c-6c5dbc0a4476 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:51.188673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-169b4e9d-6aad-4129-9b5c-6c5dbc0a4476 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:51.196094 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-169b4e9d-6aad-4129-9b5c-6c5dbc0a4476 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.159904 Jul 20 05:01:51.196699 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3318/6650] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:51 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:01:52.213029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93407ded-0ad9-4861-8afe-6a245a11ed2d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:52.213647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-93407ded-0ad9-4861-8afe-6a245a11ed2d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:52.221175 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93407ded-0ad9-4861-8afe-6a245a11ed2d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:52.221632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93407ded-0ad9-4861-8afe-6a245a11ed2d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:52.222431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93407ded-0ad9-4861-8afe-6a245a11ed2d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:52.222876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93407ded-0ad9-4861-8afe-6a245a11ed2d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:52.356080 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-93407ded-0ad9-4861-8afe-6a245a11ed2d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:52.364397 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-93407ded-0ad9-4861-8afe-6a245a11ed2d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.155299 Jul 20 05:01:52.364969 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3333/6651] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:52 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:53.382890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40f7047d-9ebf-4135-8e2f-9a4e47d4bc18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:53.383469 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40f7047d-9ebf-4135-8e2f-9a4e47d4bc18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:53.391188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f7047d-9ebf-4135-8e2f-9a4e47d4bc18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:53.391651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f7047d-9ebf-4135-8e2f-9a4e47d4bc18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:53.392551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f7047d-9ebf-4135-8e2f-9a4e47d4bc18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:53.393061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40f7047d-9ebf-4135-8e2f-9a4e47d4bc18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:53.527340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-40f7047d-9ebf-4135-8e2f-9a4e47d4bc18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:53.535673 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40f7047d-9ebf-4135-8e2f-9a4e47d4bc18 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.157209 Jul 20 05:01:53.536251 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3319/6652] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:53 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:54.553833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-15735a73-9b44-443a-8282-d191e41bdc68 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:54.554477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-15735a73-9b44-443a-8282-d191e41bdc68 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:54.561396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15735a73-9b44-443a-8282-d191e41bdc68 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:54.561850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15735a73-9b44-443a-8282-d191e41bdc68 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:54.562644 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15735a73-9b44-443a-8282-d191e41bdc68 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:54.563086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-15735a73-9b44-443a-8282-d191e41bdc68 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:54.693047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-15735a73-9b44-443a-8282-d191e41bdc68 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:54.700649 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-15735a73-9b44-443a-8282-d191e41bdc68 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.150711 Jul 20 05:01:54.701220 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3334/6653] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:54 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:55.717609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-67a17aa5-de81-4753-8d15-0fed1ca96882 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:55.718279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-67a17aa5-de81-4753-8d15-0fed1ca96882 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:55.725179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67a17aa5-de81-4753-8d15-0fed1ca96882 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:55.725645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67a17aa5-de81-4753-8d15-0fed1ca96882 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:55.726461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67a17aa5-de81-4753-8d15-0fed1ca96882 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:55.726911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-67a17aa5-de81-4753-8d15-0fed1ca96882 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:55.730804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:55.883164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-67a17aa5-de81-4753-8d15-0fed1ca96882 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:55.891809 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-67a17aa5-de81-4753-8d15-0fed1ca96882 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.178330 Jul 20 05:01:55.892397 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3320/6654] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:55 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:56.908615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c577110b-9c5f-44c8-bb4f-5f18516590f4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:56.909243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c577110b-9c5f-44c8-bb4f-5f18516590f4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:56.916154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c577110b-9c5f-44c8-bb4f-5f18516590f4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:56.916609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c577110b-9c5f-44c8-bb4f-5f18516590f4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:56.917419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c577110b-9c5f-44c8-bb4f-5f18516590f4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:56.917859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c577110b-9c5f-44c8-bb4f-5f18516590f4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:57.364666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c577110b-9c5f-44c8-bb4f-5f18516590f4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:57.373162 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c577110b-9c5f-44c8-bb4f-5f18516590f4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.468514 Jul 20 05:01:57.373728 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3335/6655] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:56 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:58.389666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1e0d35ef-4392-4757-939b-8143427194b9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:58.390169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1e0d35ef-4392-4757-939b-8143427194b9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:58.397175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e0d35ef-4392-4757-939b-8143427194b9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:58.397686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e0d35ef-4392-4757-939b-8143427194b9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:58.398633 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e0d35ef-4392-4757-939b-8143427194b9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:58.399085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e0d35ef-4392-4757-939b-8143427194b9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:58.533597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1e0d35ef-4392-4757-939b-8143427194b9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:58.541069 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1e0d35ef-4392-4757-939b-8143427194b9 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.155673 Jul 20 05:01:58.541645 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3321/6656] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:58 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:59.558437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c99f1db2-d45e-407f-8cf1-c96011819624 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:59.559986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c99f1db2-d45e-407f-8cf1-c96011819624 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:59.567028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c99f1db2-d45e-407f-8cf1-c96011819624 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:59.567481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c99f1db2-d45e-407f-8cf1-c96011819624 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:59.568255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c99f1db2-d45e-407f-8cf1-c96011819624 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:59.568696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c99f1db2-d45e-407f-8cf1-c96011819624 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:59.697568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c99f1db2-d45e-407f-8cf1-c96011819624 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:59.705325 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c99f1db2-d45e-407f-8cf1-c96011819624 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.150828 Jul 20 05:01:59.705906 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3336/6657] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:59 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:00.722619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b93f4a28-3dcc-47aa-a78b-dae75189576f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:00.723256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b93f4a28-3dcc-47aa-a78b-dae75189576f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:00.730342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b93f4a28-3dcc-47aa-a78b-dae75189576f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:00.730815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b93f4a28-3dcc-47aa-a78b-dae75189576f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:00.731627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b93f4a28-3dcc-47aa-a78b-dae75189576f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:00.732088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b93f4a28-3dcc-47aa-a78b-dae75189576f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:00.863161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b93f4a28-3dcc-47aa-a78b-dae75189576f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:00.870876 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b93f4a28-3dcc-47aa-a78b-dae75189576f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.152267 Jul 20 05:02:00.871563 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3322/6658] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:00 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:01.889198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b7f59b2b-4612-4ba7-b533-2df80f1b4582 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:01.889727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b7f59b2b-4612-4ba7-b533-2df80f1b4582 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:01.896825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7f59b2b-4612-4ba7-b533-2df80f1b4582 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:01.897283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7f59b2b-4612-4ba7-b533-2df80f1b4582 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:01.898057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7f59b2b-4612-4ba7-b533-2df80f1b4582 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:01.898603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b7f59b2b-4612-4ba7-b533-2df80f1b4582 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:02.036773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b7f59b2b-4612-4ba7-b533-2df80f1b4582 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:02.044456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b7f59b2b-4612-4ba7-b533-2df80f1b4582 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.160283 Jul 20 05:02:02.045031 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3337/6659] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:01 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:03.061024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9531dc78-7b5b-4222-800d-d48bde8e6d06 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:03.061656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9531dc78-7b5b-4222-800d-d48bde8e6d06 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:03.068639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9531dc78-7b5b-4222-800d-d48bde8e6d06 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:03.069099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9531dc78-7b5b-4222-800d-d48bde8e6d06 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:03.069870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9531dc78-7b5b-4222-800d-d48bde8e6d06 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:03.070353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9531dc78-7b5b-4222-800d-d48bde8e6d06 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:03.206204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9531dc78-7b5b-4222-800d-d48bde8e6d06 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:03.213751 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9531dc78-7b5b-4222-800d-d48bde8e6d06 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.156763 Jul 20 05:02:03.214350 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3323/6660] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:03 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:04.230811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c740b21f-ea1d-4a89-b949-bc8a17aa79f7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:04.232264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c740b21f-ea1d-4a89-b949-bc8a17aa79f7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:04.238762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c740b21f-ea1d-4a89-b949-bc8a17aa79f7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:04.239214 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c740b21f-ea1d-4a89-b949-bc8a17aa79f7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:04.239984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c740b21f-ea1d-4a89-b949-bc8a17aa79f7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:04.240422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c740b21f-ea1d-4a89-b949-bc8a17aa79f7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:04.372452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c740b21f-ea1d-4a89-b949-bc8a17aa79f7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:04.379995 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c740b21f-ea1d-4a89-b949-bc8a17aa79f7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1521 microversion: 2.1 time: 0.153321 Jul 20 05:02:04.380575 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3338/6661] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:04 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:05.252252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a19df0f2-38b7-4cd4-b7e0-5b2a6f17b6c1 req-f91c2247-d821-4a7f-ba0c-4b50131f4de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260da9fa-8105-4df3-b174-3bce407b6193", "name": "network-vif-unplugged", "status": "completed", "tag": "29ed9c5b-236f-494f-b507-208db1a71197"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:05.262807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a19df0f2-38b7-4cd4-b7e0-5b2a6f17b6c1 req-f91c2247-d821-4a7f-ba0c-4b50131f4de0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:05.263277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a19df0f2-38b7-4cd4-b7e0-5b2a6f17b6c1 req-f91c2247-d821-4a7f-ba0c-4b50131f4de0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:05.281517 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a19df0f2-38b7-4cd4-b7e0-5b2a6f17b6c1 req-f91c2247-d821-4a7f-ba0c-4b50131f4de0 service nova] Creating event network-vif-unplugged:29ed9c5b-236f-494f-b507-208db1a71197 for instance 260da9fa-8105-4df3-b174-3bce407b6193 on n-h2-760456-11 Jul 20 05:02:05.287871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-a19df0f2-38b7-4cd4-b7e0-5b2a6f17b6c1 req-f91c2247-d821-4a7f-ba0c-4b50131f4de0 service nova] Instance 260da9fa-8105-4df3-b174-3bce407b6193 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:02:05.301154 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a19df0f2-38b7-4cd4-b7e0-5b2a6f17b6c1 req-f91c2247-d821-4a7f-ba0c-4b50131f4de0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129384 Jul 20 05:02:05.302106 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3324/6662] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:05.397094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b9e7f7d-c2b5-4f52-ad77-aca610d4a06e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:05.397964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3b9e7f7d-c2b5-4f52-ad77-aca610d4a06e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:05.406339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b9e7f7d-c2b5-4f52-ad77-aca610d4a06e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:05.407449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b9e7f7d-c2b5-4f52-ad77-aca610d4a06e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:05.409326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b9e7f7d-c2b5-4f52-ad77-aca610d4a06e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:05.409952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b9e7f7d-c2b5-4f52-ad77-aca610d4a06e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:05.672109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3b9e7f7d-c2b5-4f52-ad77-aca610d4a06e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:05.679756 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b9e7f7d-c2b5-4f52-ad77-aca610d4a06e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1520 microversion: 2.1 time: 0.286675 Jul 20 05:02:05.680348 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3339/6663] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:05 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:06.698002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ef7ab328-250c-446d-aec9-076f8b5e0cb8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:06.698761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ef7ab328-250c-446d-aec9-076f8b5e0cb8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:06.711273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef7ab328-250c-446d-aec9-076f8b5e0cb8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:06.711749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef7ab328-250c-446d-aec9-076f8b5e0cb8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:06.712548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef7ab328-250c-446d-aec9-076f8b5e0cb8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:06.713008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ef7ab328-250c-446d-aec9-076f8b5e0cb8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:06.849442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ef7ab328-250c-446d-aec9-076f8b5e0cb8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:06.858558 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ef7ab328-250c-446d-aec9-076f8b5e0cb8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1518 microversion: 2.1 time: 0.164809 Jul 20 05:02:06.859162 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3325/6664] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:06 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:07.317774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8edda359-bf5d-4c01-b2c3-37a1ad587a74 req-8bfd4f9f-ae5c-4941-a752-74f4f28f6f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260da9fa-8105-4df3-b174-3bce407b6193", "tag": "29ed9c5b-236f-494f-b507-208db1a71197"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:07.326735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8edda359-bf5d-4c01-b2c3-37a1ad587a74 req-8bfd4f9f-ae5c-4941-a752-74f4f28f6f43 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:07.327188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8edda359-bf5d-4c01-b2c3-37a1ad587a74 req-8bfd4f9f-ae5c-4941-a752-74f4f28f6f43 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:07.338407 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8edda359-bf5d-4c01-b2c3-37a1ad587a74 req-8bfd4f9f-ae5c-4941-a752-74f4f28f6f43 service nova] Creating event network-changed:29ed9c5b-236f-494f-b507-208db1a71197 for instance 260da9fa-8105-4df3-b174-3bce407b6193 on n-h2-760456-11 Jul 20 05:02:07.344243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-8edda359-bf5d-4c01-b2c3-37a1ad587a74 req-8bfd4f9f-ae5c-4941-a752-74f4f28f6f43 service nova] Instance 260da9fa-8105-4df3-b174-3bce407b6193 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:02:07.354736 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8edda359-bf5d-4c01-b2c3-37a1ad587a74 req-8bfd4f9f-ae5c-4941-a752-74f4f28f6f43 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040669 Jul 20 05:02:07.355321 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3340/6665] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:07.877033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9c0f7b17-9dab-4a26-8940-9278ac495891 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:07.877697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9c0f7b17-9dab-4a26-8940-9278ac495891 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:07.884891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0f7b17-9dab-4a26-8940-9278ac495891 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:07.885367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0f7b17-9dab-4a26-8940-9278ac495891 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:07.886156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0f7b17-9dab-4a26-8940-9278ac495891 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:07.886640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9c0f7b17-9dab-4a26-8940-9278ac495891 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:08.023688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9c0f7b17-9dab-4a26-8940-9278ac495891 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:08.031899 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9c0f7b17-9dab-4a26-8940-9278ac495891 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1515 microversion: 2.1 time: 0.158842 Jul 20 05:02:08.032476 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3326/6666] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:07 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:08.049858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9d69ef7-fdd0-432a-8408-7ce31452f331 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:08.050582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e9d69ef7-fdd0-432a-8408-7ce31452f331 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:08.056890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d69ef7-fdd0-432a-8408-7ce31452f331 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:08.057401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d69ef7-fdd0-432a-8408-7ce31452f331 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:08.058182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d69ef7-fdd0-432a-8408-7ce31452f331 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:08.058659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9d69ef7-fdd0-432a-8408-7ce31452f331 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:08.120136 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9d69ef7-fdd0-432a-8408-7ce31452f331 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "POST /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193/action" status: 204 len: 0 microversion: 2.1 time: 0.074147 Jul 20 05:02:08.120794 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3341/6667] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:02:08 2022] POST /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:02:08.129776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-82bc0600-961b-4a15-b57d-64f37463bef7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:08.130485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-82bc0600-961b-4a15-b57d-64f37463bef7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:08.136661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82bc0600-961b-4a15-b57d-64f37463bef7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:08.137347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82bc0600-961b-4a15-b57d-64f37463bef7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:08.138418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82bc0600-961b-4a15-b57d-64f37463bef7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:08.138915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82bc0600-961b-4a15-b57d-64f37463bef7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:08.395765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-82bc0600-961b-4a15-b57d-64f37463bef7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:08.404209 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-82bc0600-961b-4a15-b57d-64f37463bef7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1515 microversion: 2.1 time: 0.278420 Jul 20 05:02:08.408325 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3327/6668] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:08 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:09.423567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-398dfcb6-9deb-4f0e-b290-7f2520a6f972 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:09.424895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-398dfcb6-9deb-4f0e-b290-7f2520a6f972 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:09.431713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-398dfcb6-9deb-4f0e-b290-7f2520a6f972 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:09.432182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-398dfcb6-9deb-4f0e-b290-7f2520a6f972 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:09.432970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-398dfcb6-9deb-4f0e-b290-7f2520a6f972 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:09.433426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-398dfcb6-9deb-4f0e-b290-7f2520a6f972 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:09.570404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-398dfcb6-9deb-4f0e-b290-7f2520a6f972 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:09.578339 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-398dfcb6-9deb-4f0e-b290-7f2520a6f972 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1507 microversion: 2.1 time: 0.160594 Jul 20 05:02:09.578925 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3342/6669] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:09 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:09.595234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0c02bad1-12c4-4394-b16a-dbc3d1bd5470 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:09.595868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0c02bad1-12c4-4394-b16a-dbc3d1bd5470 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:09.602769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c02bad1-12c4-4394-b16a-dbc3d1bd5470 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:09.603258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c02bad1-12c4-4394-b16a-dbc3d1bd5470 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:09.604093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c02bad1-12c4-4394-b16a-dbc3d1bd5470 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:09.604554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c02bad1-12c4-4394-b16a-dbc3d1bd5470 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:09.741921 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0c02bad1-12c4-4394-b16a-dbc3d1bd5470 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:09.749909 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0c02bad1-12c4-4394-b16a-dbc3d1bd5470 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1507 microversion: 2.1 time: 0.158588 Jul 20 05:02:09.750524 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3328/6670] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:09 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:09.769508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7fbcfe07-b03f-4a68-ad23-501ebaaeb9ec tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Action: 'create', calling method: .version_select at 0x7fb840d92430>, body: {"keypair": {"name": "tempest-keypair-1885867541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXfuAr+ilCX4az/rx4NFLHCx+sEkCkjy9Z5YuMcyKvuGWzdOopGumhMYyfI8VFV/El6qALRnvP/vU6YS3t6AeuCOeFdSPpJD1gihNx3cQdh+5CLtFWTXAiN5V15T8GMqw=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:09.783932 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-7fbcfe07-b03f-4a68-ad23-501ebaaeb9ec tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Getting quotas for project b4761098051e4917ac4567da7bb55898. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:02:09.789173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-7fbcfe07-b03f-4a68-ad23-501ebaaeb9ec tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Getting quotas for user e96a3000ee4046e3a705f359a4825ddd and project b4761098051e4917ac4567da7bb55898. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:02:09.819843 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7fbcfe07-b03f-4a68-ad23-501ebaaeb9ec tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054132 Jul 20 05:02:09.820699 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3343/6671] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:02:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:11.036305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fd0075b3-0a27-47c8-b354-4d24f716ce7c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:11.036936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fd0075b3-0a27-47c8-b354-4d24f716ce7c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:11.044536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd0075b3-0a27-47c8-b354-4d24f716ce7c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.044996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd0075b3-0a27-47c8-b354-4d24f716ce7c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.045774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd0075b3-0a27-47c8-b354-4d24f716ce7c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.046268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fd0075b3-0a27-47c8-b354-4d24f716ce7c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.179728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fd0075b3-0a27-47c8-b354-4d24f716ce7c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:11.187402 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fd0075b3-0a27-47c8-b354-4d24f716ce7c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 200 len: 1507 microversion: 2.1 time: 0.155012 Jul 20 05:02:11.187979 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3329/6672] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:11 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:11.203566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d5e5d490-b3ba-4ba1-be05-7469c43628d7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:11.204082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d5e5d490-b3ba-4ba1-be05-7469c43628d7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:11.210385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5e5d490-b3ba-4ba1-be05-7469c43628d7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.210849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5e5d490-b3ba-4ba1-be05-7469c43628d7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.211631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5e5d490-b3ba-4ba1-be05-7469c43628d7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.212081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d5e5d490-b3ba-4ba1-be05-7469c43628d7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.238910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d5e5d490-b3ba-4ba1-be05-7469c43628d7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:02:11.317009 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d5e5d490-b3ba-4ba1-be05-7469c43628d7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "DELETE /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 204 len: 0 microversion: 2.1 time: 0.117138 Jul 20 05:02:11.317616 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3344/6673] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:02:11 2022] DELETE /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:02:11.373846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-789614038", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "51a7070e-b502-4382-bd05-e8d2ce9db180"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:11.425109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] validate_networks() for [('51a7070e-b502-4382-bd05-e8d2ce9db180', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:02:11.816100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:02:11.816586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:02:11.817160 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:02:11.817689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:02:11.818198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:02:11.828431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.829199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.830034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.830522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.852311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Getting quotas for project b4761098051e4917ac4567da7bb55898. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:02:11.857918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Getting quotas for user e96a3000ee4046e3a705f359a4825ddd and project b4761098051e4917ac4567da7bb55898. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:02:11.871816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:02:11.874363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:02:11.885904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-7b978e69-96cf-42a7-b772-e2851ff33fc1 req-2080fe4a-3935-4800-b160-6b061cf810cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260da9fa-8105-4df3-b174-3bce407b6193", "name": "network-vif-plugged", "status": "completed", "tag": "29ed9c5b-236f-494f-b507-208db1a71197"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:11.897869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7b978e69-96cf-42a7-b772-e2851ff33fc1 req-2080fe4a-3935-4800-b160-6b061cf810cf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.898439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-7b978e69-96cf-42a7-b772-e2851ff33fc1 req-2080fe4a-3935-4800-b160-6b061cf810cf service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.905413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:11.917070 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-7b978e69-96cf-42a7-b772-e2851ff33fc1 req-2080fe4a-3935-4800-b160-6b061cf810cf service nova] Creating event network-vif-plugged:29ed9c5b-236f-494f-b507-208db1a71197 for instance 260da9fa-8105-4df3-b174-3bce407b6193 on n-h2-760456-11 Jul 20 05:02:11.923143 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-7b978e69-96cf-42a7-b772-e2851ff33fc1 req-2080fe4a-3935-4800-b160-6b061cf810cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041979 Jul 20 05:02:11.923773 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3345/6674] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:11.926601 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3ea1d05-1c2e-4cf0-a187-3f5eb61567ca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556907 Jul 20 05:02:11.932490 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3330/6675] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:02:11.939299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-19407b26-e726-41bd-af91-addcb019f5b6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:11.939987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-19407b26-e726-41bd-af91-addcb019f5b6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:12.009476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-19407b26-e726-41bd-af91-addcb019f5b6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:12.017041 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-19407b26-e726-41bd-af91-addcb019f5b6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1217 microversion: 2.1 time: 0.083211 Jul 20 05:02:12.017621 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3346/6676] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:11 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:13.037418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0cff7eeb-69c6-4dce-b212-a9e491965438 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:13.038861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0cff7eeb-69c6-4dce-b212-a9e491965438 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:13.052174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cff7eeb-69c6-4dce-b212-a9e491965438 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:13.052966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cff7eeb-69c6-4dce-b212-a9e491965438 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:13.054025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cff7eeb-69c6-4dce-b212-a9e491965438 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:13.054780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cff7eeb-69c6-4dce-b212-a9e491965438 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:13.149690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0cff7eeb-69c6-4dce-b212-a9e491965438 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:13.158599 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0cff7eeb-69c6-4dce-b212-a9e491965438 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1287 microversion: 2.1 time: 0.127110 Jul 20 05:02:13.159886 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3331/6677] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:13 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:13.328733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-064b940d-be64-4439-8797-92badd14be7b req-77539d64-b3cd-4053-916a-602dffbcff9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260da9fa-8105-4df3-b174-3bce407b6193", "name": "network-vif-deleted", "tag": "29ed9c5b-236f-494f-b507-208db1a71197"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:13.339502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-064b940d-be64-4439-8797-92badd14be7b req-77539d64-b3cd-4053-916a-602dffbcff9b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:13.340825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-064b940d-be64-4439-8797-92badd14be7b req-77539d64-b3cd-4053-916a-602dffbcff9b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:13.352668 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-064b940d-be64-4439-8797-92badd14be7b req-77539d64-b3cd-4053-916a-602dffbcff9b service nova] Creating event network-vif-deleted:29ed9c5b-236f-494f-b507-208db1a71197 for instance 260da9fa-8105-4df3-b174-3bce407b6193 on n-h2-760456-11 Jul 20 05:02:13.358902 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-064b940d-be64-4439-8797-92badd14be7b req-77539d64-b3cd-4053-916a-602dffbcff9b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034056 Jul 20 05:02:13.359798 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3347/6678] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:14.177707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66ad90e1-d851-49cc-91bc-db6285a98fca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:14.178391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-66ad90e1-d851-49cc-91bc-db6285a98fca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:14.186390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66ad90e1-d851-49cc-91bc-db6285a98fca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:14.186855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66ad90e1-d851-49cc-91bc-db6285a98fca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:14.187867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66ad90e1-d851-49cc-91bc-db6285a98fca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:14.188393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66ad90e1-d851-49cc-91bc-db6285a98fca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:14.386664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66ad90e1-d851-49cc-91bc-db6285a98fca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:14.394800 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-66ad90e1-d851-49cc-91bc-db6285a98fca tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1317 microversion: 2.1 time: 0.220966 Jul 20 05:02:14.395383 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3332/6679] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:14 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:14.468677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ee246068-1cc1-44f7-b18e-db5b5a56709e req-ed6183d6-effb-4d9f-bb45-a9b368c28140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13aa653-0cae-4c61-8feb-13f52f088056", "tag": "fa28bdac-f377-4608-96f6-54aa3cb800bb"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:14.479520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ee246068-1cc1-44f7-b18e-db5b5a56709e req-ed6183d6-effb-4d9f-bb45-a9b368c28140 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:14.480133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ee246068-1cc1-44f7-b18e-db5b5a56709e req-ed6183d6-effb-4d9f-bb45-a9b368c28140 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:14.492726 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ee246068-1cc1-44f7-b18e-db5b5a56709e req-ed6183d6-effb-4d9f-bb45-a9b368c28140 service nova] Creating event network-changed:fa28bdac-f377-4608-96f6-54aa3cb800bb for instance f13aa653-0cae-4c61-8feb-13f52f088056 on n-h2-760456-11 Jul 20 05:02:14.498617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ee246068-1cc1-44f7-b18e-db5b5a56709e req-ed6183d6-effb-4d9f-bb45-a9b368c28140 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040466 Jul 20 05:02:14.499235 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3348/6680] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:15.412978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c9651cf8-7ab5-4b7f-b67b-524f42cd3dc7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:15.413985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c9651cf8-7ab5-4b7f-b67b-524f42cd3dc7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:15.422451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9651cf8-7ab5-4b7f-b67b-524f42cd3dc7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:15.422920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9651cf8-7ab5-4b7f-b67b-524f42cd3dc7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:15.423710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9651cf8-7ab5-4b7f-b67b-524f42cd3dc7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:15.424165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c9651cf8-7ab5-4b7f-b67b-524f42cd3dc7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:15.554828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c9651cf8-7ab5-4b7f-b67b-524f42cd3dc7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:15.563012 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c9651cf8-7ab5-4b7f-b67b-524f42cd3dc7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1317 microversion: 2.1 time: 0.154217 Jul 20 05:02:15.563585 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3333/6681] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:15 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:16.581702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1d27cd48-0d6b-4ee6-8064-f8f6e1383b0e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:16.582446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1d27cd48-0d6b-4ee6-8064-f8f6e1383b0e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:16.584427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:16.591051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d27cd48-0d6b-4ee6-8064-f8f6e1383b0e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:16.591798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d27cd48-0d6b-4ee6-8064-f8f6e1383b0e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:16.592593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d27cd48-0d6b-4ee6-8064-f8f6e1383b0e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:16.593046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d27cd48-0d6b-4ee6-8064-f8f6e1383b0e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:16.729498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d27cd48-0d6b-4ee6-8064-f8f6e1383b0e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:16.737135 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1d27cd48-0d6b-4ee6-8064-f8f6e1383b0e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1317 microversion: 2.1 time: 0.160795 Jul 20 05:02:16.737711 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3349/6682] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:16 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:17.754436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3a4650a9-6b1e-43d9-b95d-d89d4470f0d3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:17.755075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3a4650a9-6b1e-43d9-b95d-d89d4470f0d3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:17.757971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:17.764004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a4650a9-6b1e-43d9-b95d-d89d4470f0d3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.764484 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a4650a9-6b1e-43d9-b95d-d89d4470f0d3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.765286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a4650a9-6b1e-43d9-b95d-d89d4470f0d3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.765801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a4650a9-6b1e-43d9-b95d-d89d4470f0d3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.906977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3a4650a9-6b1e-43d9-b95d-d89d4470f0d3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:17.916459 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3a4650a9-6b1e-43d9-b95d-d89d4470f0d3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1317 microversion: 2.1 time: 0.165891 Jul 20 05:02:17.917398 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3334/6683] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:17 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:18.934984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e1353a19-cfbf-40bc-8d78-5491fee0a761 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:18.935613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e1353a19-cfbf-40bc-8d78-5491fee0a761 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:18.942715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1353a19-cfbf-40bc-8d78-5491fee0a761 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:18.943176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1353a19-cfbf-40bc-8d78-5491fee0a761 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:18.943949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1353a19-cfbf-40bc-8d78-5491fee0a761 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:18.944396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1353a19-cfbf-40bc-8d78-5491fee0a761 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:19.073894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e1353a19-cfbf-40bc-8d78-5491fee0a761 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:19.081862 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e1353a19-cfbf-40bc-8d78-5491fee0a761 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1317 microversion: 2.1 time: 0.152010 Jul 20 05:02:19.082478 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3350/6684] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:18 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:19.890077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-4dc1d89b-271f-4700-96f4-e3c2bd18574c req-69425a38-8182-4a60-be84-c885843280c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13aa653-0cae-4c61-8feb-13f52f088056", "name": "network-vif-plugged", "status": "completed", "tag": "fa28bdac-f377-4608-96f6-54aa3cb800bb"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:19.899791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4dc1d89b-271f-4700-96f4-e3c2bd18574c req-69425a38-8182-4a60-be84-c885843280c9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:19.900250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-4dc1d89b-271f-4700-96f4-e3c2bd18574c req-69425a38-8182-4a60-be84-c885843280c9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:19.914945 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-4dc1d89b-271f-4700-96f4-e3c2bd18574c req-69425a38-8182-4a60-be84-c885843280c9 service nova] Creating event network-vif-plugged:fa28bdac-f377-4608-96f6-54aa3cb800bb for instance f13aa653-0cae-4c61-8feb-13f52f088056 on n-h2-760456-11 Jul 20 05:02:19.920386 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-4dc1d89b-271f-4700-96f4-e3c2bd18574c req-69425a38-8182-4a60-be84-c885843280c9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034433 Jul 20 05:02:19.920992 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3335/6685] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:20.098729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cb320b02-ba58-4203-b6e8-e50c9108cab3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:20.099360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cb320b02-ba58-4203-b6e8-e50c9108cab3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:20.106526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb320b02-ba58-4203-b6e8-e50c9108cab3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.107610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb320b02-ba58-4203-b6e8-e50c9108cab3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.108408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb320b02-ba58-4203-b6e8-e50c9108cab3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.108863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb320b02-ba58-4203-b6e8-e50c9108cab3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.241399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cb320b02-ba58-4203-b6e8-e50c9108cab3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:20.249477 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cb320b02-ba58-4203-b6e8-e50c9108cab3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1317 microversion: 2.1 time: 0.154785 Jul 20 05:02:20.250059 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3351/6686] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:20 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:21.266878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bfedda23-1180-47fa-9712-2e2672c6609a tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:21.267628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bfedda23-1180-47fa-9712-2e2672c6609a tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:21.274860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfedda23-1180-47fa-9712-2e2672c6609a tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.275335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfedda23-1180-47fa-9712-2e2672c6609a tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.276115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfedda23-1180-47fa-9712-2e2672c6609a tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.276671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bfedda23-1180-47fa-9712-2e2672c6609a tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.406295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bfedda23-1180-47fa-9712-2e2672c6609a tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:21.414644 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bfedda23-1180-47fa-9712-2e2672c6609a tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1508 microversion: 2.1 time: 0.152376 Jul 20 05:02:21.415484 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3336/6687] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:21 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:21.432192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ef9bc93-77e6-4c9e-81d0-76574ffa6b08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:21.432819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2ef9bc93-77e6-4c9e-81d0-76574ffa6b08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:21.440858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef9bc93-77e6-4c9e-81d0-76574ffa6b08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.441319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef9bc93-77e6-4c9e-81d0-76574ffa6b08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.442093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef9bc93-77e6-4c9e-81d0-76574ffa6b08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.442572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ef9bc93-77e6-4c9e-81d0-76574ffa6b08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.578531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2ef9bc93-77e6-4c9e-81d0-76574ffa6b08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:21.586057 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ef9bc93-77e6-4c9e-81d0-76574ffa6b08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1508 microversion: 2.1 time: 0.157720 Jul 20 05:02:21.586661 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3352/6688] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:21 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:21.602717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:21.603715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:21.610886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.611351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.612124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.612586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.639709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:21.645357 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Old instance type m1.heat2, new instance type m1.heat {{(pid=119605) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:02:21.651500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:02:21.651933 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:02:21.652462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:02:21.652911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:02:21.653796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:02:21.682856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:21.717247 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-736235f1-dc7b-4c05-ad42-cb9091468ef8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "POST /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056/action" status: 202 len: 0 microversion: 2.1 time: 0.118474 Jul 20 05:02:21.717858 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3337/6689] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:02:21 2022] POST /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:02:21.726304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce469a48-b8a0-4615-9869-9488ba32b0c3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:21.727047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce469a48-b8a0-4615-9869-9488ba32b0c3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:21.733923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce469a48-b8a0-4615-9869-9488ba32b0c3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.734416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce469a48-b8a0-4615-9869-9488ba32b0c3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.735203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce469a48-b8a0-4615-9869-9488ba32b0c3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.735649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce469a48-b8a0-4615-9869-9488ba32b0c3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.882893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce469a48-b8a0-4615-9869-9488ba32b0c3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:21.891451 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce469a48-b8a0-4615-9869-9488ba32b0c3 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1515 microversion: 2.1 time: 0.169178 Jul 20 05:02:21.892113 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3353/6690] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:21 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:22.906575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:22.907392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:22.914150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b0a1a70c-bfa7-4b10-92e8-b2de8f1c1f61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:22.915194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b0a1a70c-bfa7-4b10-92e8-b2de8f1c1f61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:22.930711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0a1a70c-bfa7-4b10-92e8-b2de8f1c1f61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:22.931197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0a1a70c-bfa7-4b10-92e8-b2de8f1c1f61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:22.932068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0a1a70c-bfa7-4b10-92e8-b2de8f1c1f61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:22.933235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0a1a70c-bfa7-4b10-92e8-b2de8f1c1f61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:23.155502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0a1a70c-bfa7-4b10-92e8-b2de8f1c1f61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:23.163008 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b0a1a70c-bfa7-4b10-92e8-b2de8f1c1f61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1515 microversion: 2.1 time: 0.257352 Jul 20 05:02:23.163585 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3338/6691] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:22 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:24.181456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b2d63c79-fefc-41a0-b238-475c843d5ab7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:24.182084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b2d63c79-fefc-41a0-b238-475c843d5ab7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:24.184049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:24.190557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2d63c79-fefc-41a0-b238-475c843d5ab7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:24.191018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2d63c79-fefc-41a0-b238-475c843d5ab7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:24.191799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2d63c79-fefc-41a0-b238-475c843d5ab7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:24.192247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b2d63c79-fefc-41a0-b238-475c843d5ab7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:24.324975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b2d63c79-fefc-41a0-b238-475c843d5ab7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:24.333121 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b2d63c79-fefc-41a0-b238-475c843d5ab7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.155831 Jul 20 05:02:24.333714 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3354/6692] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:24 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:25.351391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc750f04-ddf6-4266-a252-d80851d9539b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:25.352024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cc750f04-ddf6-4266-a252-d80851d9539b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:25.360418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc750f04-ddf6-4266-a252-d80851d9539b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:25.360883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc750f04-ddf6-4266-a252-d80851d9539b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:25.361667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc750f04-ddf6-4266-a252-d80851d9539b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:25.362126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc750f04-ddf6-4266-a252-d80851d9539b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:25.508148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cc750f04-ddf6-4266-a252-d80851d9539b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:25.516661 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cc750f04-ddf6-4266-a252-d80851d9539b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.169151 Jul 20 05:02:25.517243 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3339/6693] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:25 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:26.537245 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1d1c8209-30c9-44f7-80b1-9efcf5498638 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:26.537901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1d1c8209-30c9-44f7-80b1-9efcf5498638 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:26.545051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d1c8209-30c9-44f7-80b1-9efcf5498638 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:26.545517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d1c8209-30c9-44f7-80b1-9efcf5498638 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:26.547503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d1c8209-30c9-44f7-80b1-9efcf5498638 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:26.547964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1d1c8209-30c9-44f7-80b1-9efcf5498638 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:26.681407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d1c8209-30c9-44f7-80b1-9efcf5498638 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:26.689926 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1d1c8209-30c9-44f7-80b1-9efcf5498638 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.156642 Jul 20 05:02:26.690537 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3355/6694] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:26 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:27.706893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6c96721c-4aba-4b51-9910-68b37cc94eee tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:27.707545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6c96721c-4aba-4b51-9910-68b37cc94eee tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:27.714422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c96721c-4aba-4b51-9910-68b37cc94eee tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:27.714887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c96721c-4aba-4b51-9910-68b37cc94eee tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:27.715665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c96721c-4aba-4b51-9910-68b37cc94eee tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:27.716114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6c96721c-4aba-4b51-9910-68b37cc94eee tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:27.844136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6c96721c-4aba-4b51-9910-68b37cc94eee tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:27.851948 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6c96721c-4aba-4b51-9910-68b37cc94eee tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.149586 Jul 20 05:02:27.852528 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3340/6695] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:27 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:28.870787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c658bb6e-f24e-416c-a6e7-25d7a11bd235 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:28.871463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c658bb6e-f24e-416c-a6e7-25d7a11bd235 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:28.879413 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c658bb6e-f24e-416c-a6e7-25d7a11bd235 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:28.879878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c658bb6e-f24e-416c-a6e7-25d7a11bd235 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:28.880652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c658bb6e-f24e-416c-a6e7-25d7a11bd235 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:28.881097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c658bb6e-f24e-416c-a6e7-25d7a11bd235 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:29.015660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c658bb6e-f24e-416c-a6e7-25d7a11bd235 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:29.024034 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c658bb6e-f24e-416c-a6e7-25d7a11bd235 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.157447 Jul 20 05:02:29.024648 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3356/6696] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:28 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:30.041153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a8e41cf8-c703-40c9-8c07-c36b7bd0a59c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:30.041778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a8e41cf8-c703-40c9-8c07-c36b7bd0a59c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:30.048963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8e41cf8-c703-40c9-8c07-c36b7bd0a59c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:30.049422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8e41cf8-c703-40c9-8c07-c36b7bd0a59c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:30.050197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8e41cf8-c703-40c9-8c07-c36b7bd0a59c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:30.050672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a8e41cf8-c703-40c9-8c07-c36b7bd0a59c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:30.185325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a8e41cf8-c703-40c9-8c07-c36b7bd0a59c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:30.192956 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a8e41cf8-c703-40c9-8c07-c36b7bd0a59c tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.155725 Jul 20 05:02:30.193521 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3341/6697] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:30 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:31.210059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-554ce367-bb4a-4ec7-bcc2-71f88e971c21 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:31.210710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-554ce367-bb4a-4ec7-bcc2-71f88e971c21 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:31.217606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-554ce367-bb4a-4ec7-bcc2-71f88e971c21 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:31.218063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-554ce367-bb4a-4ec7-bcc2-71f88e971c21 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:31.218878 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-554ce367-bb4a-4ec7-bcc2-71f88e971c21 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:31.219969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-554ce367-bb4a-4ec7-bcc2-71f88e971c21 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:31.364124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-554ce367-bb4a-4ec7-bcc2-71f88e971c21 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:31.372043 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-554ce367-bb4a-4ec7-bcc2-71f88e971c21 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.166007 Jul 20 05:02:31.372622 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3357/6698] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:31 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:32.389253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-70740046-573c-412c-9f5f-2f6004f49ed4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:32.389823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-70740046-573c-412c-9f5f-2f6004f49ed4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:32.397083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70740046-573c-412c-9f5f-2f6004f49ed4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:32.397547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70740046-573c-412c-9f5f-2f6004f49ed4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:32.398348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70740046-573c-412c-9f5f-2f6004f49ed4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:32.398799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-70740046-573c-412c-9f5f-2f6004f49ed4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:32.531505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-70740046-573c-412c-9f5f-2f6004f49ed4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:32.539161 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-70740046-573c-412c-9f5f-2f6004f49ed4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.153857 Jul 20 05:02:32.539761 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3342/6699] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:32 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:33.557029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac376479-f81a-4e6a-8ee6-aea809a940f2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:33.557652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac376479-f81a-4e6a-8ee6-aea809a940f2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:33.565487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac376479-f81a-4e6a-8ee6-aea809a940f2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:33.565943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac376479-f81a-4e6a-8ee6-aea809a940f2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:33.566749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac376479-f81a-4e6a-8ee6-aea809a940f2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:33.567198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac376479-f81a-4e6a-8ee6-aea809a940f2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:33.701621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ac376479-f81a-4e6a-8ee6-aea809a940f2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:33.709647 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac376479-f81a-4e6a-8ee6-aea809a940f2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.156595 Jul 20 05:02:33.710219 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3358/6700] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:33 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:34.726526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea1fd352-5586-4690-92a4-f10c4cdf1ec4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:34.727162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ea1fd352-5586-4690-92a4-f10c4cdf1ec4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:34.734194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea1fd352-5586-4690-92a4-f10c4cdf1ec4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:34.734741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea1fd352-5586-4690-92a4-f10c4cdf1ec4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:34.735790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea1fd352-5586-4690-92a4-f10c4cdf1ec4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:34.736243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea1fd352-5586-4690-92a4-f10c4cdf1ec4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:34.865315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ea1fd352-5586-4690-92a4-f10c4cdf1ec4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:34.872998 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ea1fd352-5586-4690-92a4-f10c4cdf1ec4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.150464 Jul 20 05:02:34.873568 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3343/6701] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:34 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:35.891422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-84397211-899b-487a-a8a8-166158172cfd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:35.892641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-84397211-899b-487a-a8a8-166158172cfd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:35.899381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84397211-899b-487a-a8a8-166158172cfd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.899982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84397211-899b-487a-a8a8-166158172cfd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:35.900778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84397211-899b-487a-a8a8-166158172cfd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:35.901232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-84397211-899b-487a-a8a8-166158172cfd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:36.032777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-84397211-899b-487a-a8a8-166158172cfd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:36.040328 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-84397211-899b-487a-a8a8-166158172cfd tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.152848 Jul 20 05:02:36.040903 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3359/6702] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:35 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:37.057769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea390b94-3179-4c8f-8af7-967d6d2155d4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:37.058432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ea390b94-3179-4c8f-8af7-967d6d2155d4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:37.066425 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea390b94-3179-4c8f-8af7-967d6d2155d4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:37.066891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea390b94-3179-4c8f-8af7-967d6d2155d4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:37.067703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea390b94-3179-4c8f-8af7-967d6d2155d4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:37.068180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea390b94-3179-4c8f-8af7-967d6d2155d4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:37.205468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ea390b94-3179-4c8f-8af7-967d6d2155d4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:37.213006 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ea390b94-3179-4c8f-8af7-967d6d2155d4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.159195 Jul 20 05:02:37.213593 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3344/6703] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:37 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:38.230812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d646de51-6248-4c57-af8a-877e10a773a4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:38.231435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d646de51-6248-4c57-af8a-877e10a773a4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:38.239171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d646de51-6248-4c57-af8a-877e10a773a4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:38.239630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d646de51-6248-4c57-af8a-877e10a773a4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:38.240405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d646de51-6248-4c57-af8a-877e10a773a4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:38.240850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d646de51-6248-4c57-af8a-877e10a773a4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:38.382701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d646de51-6248-4c57-af8a-877e10a773a4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:38.390738 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d646de51-6248-4c57-af8a-877e10a773a4 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.163766 Jul 20 05:02:38.392054 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3360/6704] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:38 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:39.409173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-55828f13-3dc5-4dfd-99b8-dc3bc9990c4f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:39.409719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-55828f13-3dc5-4dfd-99b8-dc3bc9990c4f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:39.416704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55828f13-3dc5-4dfd-99b8-dc3bc9990c4f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:39.417179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55828f13-3dc5-4dfd-99b8-dc3bc9990c4f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:39.417960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55828f13-3dc5-4dfd-99b8-dc3bc9990c4f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:39.418440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-55828f13-3dc5-4dfd-99b8-dc3bc9990c4f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:39.559143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-55828f13-3dc5-4dfd-99b8-dc3bc9990c4f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:39.568396 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-55828f13-3dc5-4dfd-99b8-dc3bc9990c4f tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.163226 Jul 20 05:02:39.569012 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3345/6705] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:39 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:40.585788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-07ac0c9a-43a9-4557-af2c-c69c54df9490 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:40.586443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-07ac0c9a-43a9-4557-af2c-c69c54df9490 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:40.593396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07ac0c9a-43a9-4557-af2c-c69c54df9490 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:40.593849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07ac0c9a-43a9-4557-af2c-c69c54df9490 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:40.594739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07ac0c9a-43a9-4557-af2c-c69c54df9490 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:40.595177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-07ac0c9a-43a9-4557-af2c-c69c54df9490 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:40.732944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-07ac0c9a-43a9-4557-af2c-c69c54df9490 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:40.741912 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-07ac0c9a-43a9-4557-af2c-c69c54df9490 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.160084 Jul 20 05:02:40.742541 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3361/6706] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:40 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:41.760703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5aad9d72-8354-423c-9a46-c8f888332380 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:41.761392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5aad9d72-8354-423c-9a46-c8f888332380 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:41.769128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5aad9d72-8354-423c-9a46-c8f888332380 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:41.769604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5aad9d72-8354-423c-9a46-c8f888332380 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:41.770433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5aad9d72-8354-423c-9a46-c8f888332380 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:41.770893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5aad9d72-8354-423c-9a46-c8f888332380 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:41.913868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5aad9d72-8354-423c-9a46-c8f888332380 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:41.921508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5aad9d72-8354-423c-9a46-c8f888332380 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.164775 Jul 20 05:02:41.922341 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3346/6707] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:41 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:42.939851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-764d3dd4-6316-4385-ae23-18d44abdf663 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:42.940483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-764d3dd4-6316-4385-ae23-18d44abdf663 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:42.946680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-764d3dd4-6316-4385-ae23-18d44abdf663 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:42.947147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-764d3dd4-6316-4385-ae23-18d44abdf663 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:42.947926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-764d3dd4-6316-4385-ae23-18d44abdf663 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:42.948384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-764d3dd4-6316-4385-ae23-18d44abdf663 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:42.952365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=83 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:43.078764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-764d3dd4-6316-4385-ae23-18d44abdf663 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:43.086502 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-764d3dd4-6316-4385-ae23-18d44abdf663 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.151041 Jul 20 05:02:43.087078 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3362/6708] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:42 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:44.105058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d7ebd0d6-8a95-4197-9c2a-e7b4dfa741d6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:44.105683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d7ebd0d6-8a95-4197-9c2a-e7b4dfa741d6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:44.114135 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7ebd0d6-8a95-4197-9c2a-e7b4dfa741d6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:44.114750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7ebd0d6-8a95-4197-9c2a-e7b4dfa741d6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:44.115620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7ebd0d6-8a95-4197-9c2a-e7b4dfa741d6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:44.116156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7ebd0d6-8a95-4197-9c2a-e7b4dfa741d6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:44.248650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d7ebd0d6-8a95-4197-9c2a-e7b4dfa741d6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:44.256431 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d7ebd0d6-8a95-4197-9c2a-e7b4dfa741d6 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.155294 Jul 20 05:02:44.257015 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3347/6709] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:44 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:45.274180 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6c28a7d3-1555-4992-ba13-44af98e6ae08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:45.274865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6c28a7d3-1555-4992-ba13-44af98e6ae08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:45.282197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c28a7d3-1555-4992-ba13-44af98e6ae08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:45.282690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c28a7d3-1555-4992-ba13-44af98e6ae08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:45.283466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c28a7d3-1555-4992-ba13-44af98e6ae08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:45.283918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6c28a7d3-1555-4992-ba13-44af98e6ae08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:45.419827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6c28a7d3-1555-4992-ba13-44af98e6ae08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:45.428619 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6c28a7d3-1555-4992-ba13-44af98e6ae08 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.158377 Jul 20 05:02:45.429209 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3363/6710] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:45 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:46.446137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3379a3ab-b6c8-4a39-b711-4332250107e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:46.446827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3379a3ab-b6c8-4a39-b711-4332250107e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:46.453907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3379a3ab-b6c8-4a39-b711-4332250107e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:46.455360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3379a3ab-b6c8-4a39-b711-4332250107e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:46.456244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3379a3ab-b6c8-4a39-b711-4332250107e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:46.456698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3379a3ab-b6c8-4a39-b711-4332250107e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:46.589092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3379a3ab-b6c8-4a39-b711-4332250107e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:46.596895 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3379a3ab-b6c8-4a39-b711-4332250107e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.154755 Jul 20 05:02:46.597475 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3348/6711] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:46 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:47.614645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-df974df5-7685-4fdd-a862-d590b443b14d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:47.615267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-df974df5-7685-4fdd-a862-d590b443b14d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:47.618330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=30 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:47.624266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df974df5-7685-4fdd-a862-d590b443b14d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:47.624735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df974df5-7685-4fdd-a862-d590b443b14d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:47.625523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df974df5-7685-4fdd-a862-d590b443b14d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:47.626517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-df974df5-7685-4fdd-a862-d590b443b14d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:47.761951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-df974df5-7685-4fdd-a862-d590b443b14d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:47.770176 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-df974df5-7685-4fdd-a862-d590b443b14d tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.159878 Jul 20 05:02:47.770768 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3364/6712] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:47 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:48.787980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bb5bcd44-9fac-4535-aa05-6c54f92f9b61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:48.788610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bb5bcd44-9fac-4535-aa05-6c54f92f9b61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:48.791760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=34 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:48.797527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb5bcd44-9fac-4535-aa05-6c54f92f9b61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:48.798033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb5bcd44-9fac-4535-aa05-6c54f92f9b61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:48.798941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb5bcd44-9fac-4535-aa05-6c54f92f9b61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:48.799401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb5bcd44-9fac-4535-aa05-6c54f92f9b61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:48.939289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bb5bcd44-9fac-4535-aa05-6c54f92f9b61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:48.947448 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bb5bcd44-9fac-4535-aa05-6c54f92f9b61 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.163382 Jul 20 05:02:48.948837 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3349/6713] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:48 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:49.964923 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-61834839-8dec-4746-9a7e-b8a0dafc2d1e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:49.965544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-61834839-8dec-4746-9a7e-b8a0dafc2d1e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:49.973386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-61834839-8dec-4746-9a7e-b8a0dafc2d1e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:49.973849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-61834839-8dec-4746-9a7e-b8a0dafc2d1e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:49.974651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-61834839-8dec-4746-9a7e-b8a0dafc2d1e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:49.975096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-61834839-8dec-4746-9a7e-b8a0dafc2d1e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:50.108658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-61834839-8dec-4746-9a7e-b8a0dafc2d1e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:50.116828 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-61834839-8dec-4746-9a7e-b8a0dafc2d1e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1520 microversion: 2.1 time: 0.155780 Jul 20 05:02:50.117392 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3365/6714] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:49 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:51.134833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d6a11dcd-6b8d-4c00-ad25-90a7f1519139 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:51.135466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d6a11dcd-6b8d-4c00-ad25-90a7f1519139 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:51.142434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6a11dcd-6b8d-4c00-ad25-90a7f1519139 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:51.142910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6a11dcd-6b8d-4c00-ad25-90a7f1519139 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:51.143712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6a11dcd-6b8d-4c00-ad25-90a7f1519139 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:51.144199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6a11dcd-6b8d-4c00-ad25-90a7f1519139 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:51.194645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b8ee19cc-1fa2-46be-961b-9e0b16b654eb req-d8d6052f-d570-4d47-a450-770aebc5a644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13aa653-0cae-4c61-8feb-13f52f088056", "name": "network-vif-unplugged", "status": "completed", "tag": "fa28bdac-f377-4608-96f6-54aa3cb800bb"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:51.203810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b8ee19cc-1fa2-46be-961b-9e0b16b654eb req-d8d6052f-d570-4d47-a450-770aebc5a644 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:51.204594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b8ee19cc-1fa2-46be-961b-9e0b16b654eb req-d8d6052f-d570-4d47-a450-770aebc5a644 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:51.216637 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b8ee19cc-1fa2-46be-961b-9e0b16b654eb req-d8d6052f-d570-4d47-a450-770aebc5a644 service nova] Creating event network-vif-unplugged:fa28bdac-f377-4608-96f6-54aa3cb800bb for instance f13aa653-0cae-4c61-8feb-13f52f088056 on n-h1-760456-11 Jul 20 05:02:51.222692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-b8ee19cc-1fa2-46be-961b-9e0b16b654eb req-d8d6052f-d570-4d47-a450-770aebc5a644 service nova] Instance f13aa653-0cae-4c61-8feb-13f52f088056 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:02:51.233498 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b8ee19cc-1fa2-46be-961b-9e0b16b654eb req-d8d6052f-d570-4d47-a450-770aebc5a644 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042481 Jul 20 05:02:51.234451 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3366/6715] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:02:51.373218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d6a11dcd-6b8d-4c00-ad25-90a7f1519139 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:51.381621 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d6a11dcd-6b8d-4c00-ad25-90a7f1519139 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1519 microversion: 2.1 time: 0.250552 Jul 20 05:02:51.382348 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3350/6716] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:51 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:52.400903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9746fc86-05ec-46b1-941d-8685a1634c0b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:52.401601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9746fc86-05ec-46b1-941d-8685a1634c0b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:52.408715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9746fc86-05ec-46b1-941d-8685a1634c0b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:52.409165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9746fc86-05ec-46b1-941d-8685a1634c0b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:52.409934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9746fc86-05ec-46b1-941d-8685a1634c0b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:52.410400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9746fc86-05ec-46b1-941d-8685a1634c0b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:52.552259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9746fc86-05ec-46b1-941d-8685a1634c0b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:52.559877 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9746fc86-05ec-46b1-941d-8685a1634c0b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1517 microversion: 2.1 time: 0.164182 Jul 20 05:02:52.560457 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3367/6717] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:52 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:53.250747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-50a8af43-4d23-47cb-ad28-8882e91dc905 req-93507529-ea56-40be-9963-af23e102e101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13aa653-0cae-4c61-8feb-13f52f088056", "tag": "fa28bdac-f377-4608-96f6-54aa3cb800bb"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:53.260728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-50a8af43-4d23-47cb-ad28-8882e91dc905 req-93507529-ea56-40be-9963-af23e102e101 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:53.261233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-50a8af43-4d23-47cb-ad28-8882e91dc905 req-93507529-ea56-40be-9963-af23e102e101 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:53.265088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:53.273841 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-50a8af43-4d23-47cb-ad28-8882e91dc905 req-93507529-ea56-40be-9963-af23e102e101 service nova] Creating event network-changed:fa28bdac-f377-4608-96f6-54aa3cb800bb for instance f13aa653-0cae-4c61-8feb-13f52f088056 on n-h1-760456-11 Jul 20 05:02:53.279962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-50a8af43-4d23-47cb-ad28-8882e91dc905 req-93507529-ea56-40be-9963-af23e102e101 service nova] Instance f13aa653-0cae-4c61-8feb-13f52f088056 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:02:53.291527 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-50a8af43-4d23-47cb-ad28-8882e91dc905 req-93507529-ea56-40be-9963-af23e102e101 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044560 Jul 20 05:02:53.292126 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3351/6718] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:53.577109 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-23faa608-7fee-46a6-b8d1-9ad6c6219788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:53.577737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-23faa608-7fee-46a6-b8d1-9ad6c6219788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:53.586117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23faa608-7fee-46a6-b8d1-9ad6c6219788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:53.586682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23faa608-7fee-46a6-b8d1-9ad6c6219788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:53.587472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23faa608-7fee-46a6-b8d1-9ad6c6219788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:53.587925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-23faa608-7fee-46a6-b8d1-9ad6c6219788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:53.739181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-23faa608-7fee-46a6-b8d1-9ad6c6219788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:53.748776 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-23faa608-7fee-46a6-b8d1-9ad6c6219788 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1517 microversion: 2.1 time: 0.175647 Jul 20 05:02:53.749486 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3368/6719] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:53 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:54.768418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a27a5e22-4dc2-41ce-b19f-8ac35fa971e7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:54.769138 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a27a5e22-4dc2-41ce-b19f-8ac35fa971e7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:54.775423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a27a5e22-4dc2-41ce-b19f-8ac35fa971e7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:54.775897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a27a5e22-4dc2-41ce-b19f-8ac35fa971e7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:54.776684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a27a5e22-4dc2-41ce-b19f-8ac35fa971e7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:54.777142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a27a5e22-4dc2-41ce-b19f-8ac35fa971e7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:54.913844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a27a5e22-4dc2-41ce-b19f-8ac35fa971e7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:54.921418 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a27a5e22-4dc2-41ce-b19f-8ac35fa971e7 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1514 microversion: 2.1 time: 0.158784 Jul 20 05:02:54.921999 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3352/6720] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:54 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:54.939011 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-68ac2724-3ff7-40a0-908f-68555cb1134e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:54.939659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-68ac2724-3ff7-40a0-908f-68555cb1134e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:54.946799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68ac2724-3ff7-40a0-908f-68555cb1134e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:54.947268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68ac2724-3ff7-40a0-908f-68555cb1134e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:54.948064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68ac2724-3ff7-40a0-908f-68555cb1134e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:54.948517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-68ac2724-3ff7-40a0-908f-68555cb1134e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:55.011672 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-68ac2724-3ff7-40a0-908f-68555cb1134e tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "POST /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056/action" status: 204 len: 0 microversion: 2.1 time: 0.077071 Jul 20 05:02:55.012408 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3369/6721] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:02:54 2022] POST /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:02:55.021038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ff1d5e03-9285-44e1-a169-a88e381d77e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:55.021604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ff1d5e03-9285-44e1-a169-a88e381d77e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:55.027630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff1d5e03-9285-44e1-a169-a88e381d77e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:55.028096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff1d5e03-9285-44e1-a169-a88e381d77e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:55.028917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff1d5e03-9285-44e1-a169-a88e381d77e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:55.029323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ff1d5e03-9285-44e1-a169-a88e381d77e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:55.240646 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ff1d5e03-9285-44e1-a169-a88e381d77e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:55.248528 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ff1d5e03-9285-44e1-a169-a88e381d77e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1514 microversion: 2.1 time: 0.231882 Jul 20 05:02:55.249112 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3353/6722] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:55 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:55.900069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3383d056-fb2b-4411-8442-fc9d51054d67 req-eda1f1cb-370b-422d-88ee-3c7316b876fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13aa653-0cae-4c61-8feb-13f52f088056", "name": "network-vif-plugged", "status": "completed", "tag": "fa28bdac-f377-4608-96f6-54aa3cb800bb"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:55.910076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3383d056-fb2b-4411-8442-fc9d51054d67 req-eda1f1cb-370b-422d-88ee-3c7316b876fe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:55.910560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3383d056-fb2b-4411-8442-fc9d51054d67 req-eda1f1cb-370b-422d-88ee-3c7316b876fe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:55.922485 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3383d056-fb2b-4411-8442-fc9d51054d67 req-eda1f1cb-370b-422d-88ee-3c7316b876fe service nova] Creating event network-vif-plugged:fa28bdac-f377-4608-96f6-54aa3cb800bb for instance f13aa653-0cae-4c61-8feb-13f52f088056 on n-h1-760456-11 Jul 20 05:02:55.928598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-3383d056-fb2b-4411-8442-fc9d51054d67 req-eda1f1cb-370b-422d-88ee-3c7316b876fe service nova] Instance f13aa653-0cae-4c61-8feb-13f52f088056 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:02:55.939306 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3383d056-fb2b-4411-8442-fc9d51054d67 req-eda1f1cb-370b-422d-88ee-3c7316b876fe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043338 Jul 20 05:02:55.939895 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3370/6723] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:56.266726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-40e66c35-3718-468c-bf57-07a5e59d1aaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:56.267424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-40e66c35-3718-468c-bf57-07a5e59d1aaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:56.275490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40e66c35-3718-468c-bf57-07a5e59d1aaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.275966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40e66c35-3718-468c-bf57-07a5e59d1aaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.276767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40e66c35-3718-468c-bf57-07a5e59d1aaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.277224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-40e66c35-3718-468c-bf57-07a5e59d1aaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.416644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-40e66c35-3718-468c-bf57-07a5e59d1aaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:56.425135 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-40e66c35-3718-468c-bf57-07a5e59d1aaa tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1506 microversion: 2.1 time: 0.163265 Jul 20 05:02:56.425707 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3354/6724] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:56 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:56.443406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-569cb2da-11c7-48bc-be53-8051d9d83869 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:56.444118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-569cb2da-11c7-48bc-be53-8051d9d83869 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:56.450401 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-569cb2da-11c7-48bc-be53-8051d9d83869 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.450859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-569cb2da-11c7-48bc-be53-8051d9d83869 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.451631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-569cb2da-11c7-48bc-be53-8051d9d83869 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.452077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-569cb2da-11c7-48bc-be53-8051d9d83869 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.593736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-569cb2da-11c7-48bc-be53-8051d9d83869 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:56.602183 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-569cb2da-11c7-48bc-be53-8051d9d83869 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1506 microversion: 2.1 time: 0.164551 Jul 20 05:02:56.602787 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3371/6725] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:56 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:56.619139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-237cd2ab-df22-4bd6-a158-562d04b1f022 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:56.620028 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-237cd2ab-df22-4bd6-a158-562d04b1f022 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:56.626528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-237cd2ab-df22-4bd6-a158-562d04b1f022 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.627003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-237cd2ab-df22-4bd6-a158-562d04b1f022 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.627794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-237cd2ab-df22-4bd6-a158-562d04b1f022 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.628255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-237cd2ab-df22-4bd6-a158-562d04b1f022 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.761740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-237cd2ab-df22-4bd6-a158-562d04b1f022 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:56.769719 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-237cd2ab-df22-4bd6-a158-562d04b1f022 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1506 microversion: 2.1 time: 0.154774 Jul 20 05:02:56.770688 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3355/6726] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:56 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:56.791384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e4060ad3-7af6-45b5-928e-1188045ae794 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:56.791893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e4060ad3-7af6-45b5-928e-1188045ae794 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:56.800216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4060ad3-7af6-45b5-928e-1188045ae794 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.800671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4060ad3-7af6-45b5-928e-1188045ae794 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.801456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4060ad3-7af6-45b5-928e-1188045ae794 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.801905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4060ad3-7af6-45b5-928e-1188045ae794 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.828862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e4060ad3-7af6-45b5-928e-1188045ae794 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:02:56.916746 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e4060ad3-7af6-45b5-928e-1188045ae794 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 204 len: 0 microversion: 2.1 time: 0.128908 Jul 20 05:02:56.917444 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3372/6727] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:02:56 2022] DELETE /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:02:56.935387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4884d96d-752e-4a41-a13e-d680f6f3f6d2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:56.935918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4884d96d-752e-4a41-a13e-d680f6f3f6d2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:56.942746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4884d96d-752e-4a41-a13e-d680f6f3f6d2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.943207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4884d96d-752e-4a41-a13e-d680f6f3f6d2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.943989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4884d96d-752e-4a41-a13e-d680f6f3f6d2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:56.944437 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4884d96d-752e-4a41-a13e-d680f6f3f6d2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:56.971745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4884d96d-752e-4a41-a13e-d680f6f3f6d2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:02:57.021127 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.compute.api [None req-4884d96d-752e-4a41-a13e-d680f6f3f6d2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Instance is already in deleting state, ignoring this request Jul 20 05:02:57.021969 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4884d96d-752e-4a41-a13e-d680f6f3f6d2 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 204 len: 0 microversion: 2.1 time: 0.090744 Jul 20 05:02:57.022580 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3356/6728] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:02:56 2022] DELETE /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:02:57.031238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9e6aa3c7-82b3-4eb7-b8f5-6c1b4c2fd056 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:57.031953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9e6aa3c7-82b3-4eb7-b8f5-6c1b4c2fd056 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:57.039969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e6aa3c7-82b3-4eb7-b8f5-6c1b4c2fd056 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:57.040431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e6aa3c7-82b3-4eb7-b8f5-6c1b4c2fd056 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:57.041321 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e6aa3c7-82b3-4eb7-b8f5-6c1b4c2fd056 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:57.041765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9e6aa3c7-82b3-4eb7-b8f5-6c1b4c2fd056 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:57.191236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9e6aa3c7-82b3-4eb7-b8f5-6c1b4c2fd056 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:57.199059 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9e6aa3c7-82b3-4eb7-b8f5-6c1b4c2fd056 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1512 microversion: 2.1 time: 0.172031 Jul 20 05:02:57.199637 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3373/6729] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:57 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:58.217839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-85f24968-8937-449c-a53e-9eea4ebd37a8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:58.218566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-85f24968-8937-449c-a53e-9eea4ebd37a8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:58.226234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85f24968-8937-449c-a53e-9eea4ebd37a8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:58.226729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85f24968-8937-449c-a53e-9eea4ebd37a8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:58.227509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85f24968-8937-449c-a53e-9eea4ebd37a8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:58.227960 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-85f24968-8937-449c-a53e-9eea4ebd37a8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:58.442513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-85f24968-8937-449c-a53e-9eea4ebd37a8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e96a3000ee4046e3a705f359a4825ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4761098051e4917ac4567da7bb55898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:58.450115 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-85f24968-8937-449c-a53e-9eea4ebd37a8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 200 len: 1512 microversion: 2.1 time: 0.236214 Jul 20 05:02:58.450734 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3357/6730] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:58 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:58.739773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-85796b6f-3f83-405b-8e31-01dd7dd5b979 req-1ca4792f-0843-4e8e-81af-66114d28ed91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13aa653-0cae-4c61-8feb-13f52f088056", "name": "network-vif-deleted", "tag": "fa28bdac-f377-4608-96f6-54aa3cb800bb"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:58.749288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-85796b6f-3f83-405b-8e31-01dd7dd5b979 req-1ca4792f-0843-4e8e-81af-66114d28ed91 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:58.749746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-85796b6f-3f83-405b-8e31-01dd7dd5b979 req-1ca4792f-0843-4e8e-81af-66114d28ed91 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:59.035674 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-85796b6f-3f83-405b-8e31-01dd7dd5b979 req-1ca4792f-0843-4e8e-81af-66114d28ed91 service nova] Creating event network-vif-deleted:fa28bdac-f377-4608-96f6-54aa3cb800bb for instance f13aa653-0cae-4c61-8feb-13f52f088056 on n-h1-760456-11 Jul 20 05:02:59.040467 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-85796b6f-3f83-405b-8e31-01dd7dd5b979 req-1ca4792f-0843-4e8e-81af-66114d28ed91 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304911 Jul 20 05:02:59.041057 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3374/6731] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:59.468237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-50f0070e-ac3c-46e2-acd2-b634348c34da tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:59.468880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-50f0070e-ac3c-46e2-acd2-b634348c34da tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: f13aa653-0cae-4c61-8feb-13f52f088056] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:59.476149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50f0070e-ac3c-46e2-acd2-b634348c34da tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:59.476971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50f0070e-ac3c-46e2-acd2-b634348c34da tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:59.478410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50f0070e-ac3c-46e2-acd2-b634348c34da tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:59.479265 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50f0070e-ac3c-46e2-acd2-b634348c34da tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:59.497760 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-50f0070e-ac3c-46e2-acd2-b634348c34da tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] HTTP exception thrown: Instance f13aa653-0cae-4c61-8feb-13f52f088056 could not be found. Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-50f0070e-ac3c-46e2-acd2-b634348c34da tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Request method failure captured: Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 HTTP/1.1 Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14wlniDBXQSThpJ-5WJZHKLMLypbxo__cxP_B3qj1ccte11ALV61ulqdbxxyfHW3MCH3FqOyQJIMWSLxki5XcXMz93z7RCFx323YJdnD9UZQwlIQYgyf_YBXybLPnaG0O0tDxgmTtpnqnHpzgtORiY4weQrMqqotLzdTJR_5dNXWpGo Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b4761098051e4917ac4567da7bb55898 Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerDiskConfigTestJSON-462620575 Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4761098051e4917ac4567da7bb55898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4761098051e4917ac4567da7bb55898"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4761098051e4917ac4567da7bb55898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4761098051e4917ac4567da7bb55898"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerDiskConfigTestJSON-462620575 Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b4761098051e4917ac4567da7bb55898 Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-462620575 Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerDiskConfigTestJSON-462620575-project Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e96a3000ee4046e3a705f359a4825ddd Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerDiskConfigTestJSON-462620575-project Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance f13aa653-0cae-4c61-8feb-13f52f088056 could not be found. Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'f13aa653-0cae-4c61-8feb-13f52f088056'} Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13aa653-0cae-4c61-8feb-13f52f088056 could not be found. Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13aa653-0cae-4c61-8feb-13f52f088056 could not be found. Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:59.499471 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:02:59.504244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:59.504244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:59.504244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:59.504244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:02:59.504244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:02:59.504244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13aa653-0cae-4c61-8feb-13f52f088056 could not be found. Jul 20 05:02:59.504244 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:02:59.504244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-50f0070e-ac3c-46e2-acd2-b634348c34da tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Returning 404 to user: Instance f13aa653-0cae-4c61-8feb-13f52f088056 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:02:59.504244 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-50f0070e-ac3c-46e2-acd2-b634348c34da tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056" status: 404 len: 111 microversion: 2.1 time: 0.036801 Jul 20 05:02:59.504244 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3358/6732] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:59 2022] GET /compute/v2.1/servers/f13aa653-0cae-4c61-8feb-13f52f088056 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:02:59.511177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-71959d20-177a-447a-8290-cbe476bde07b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '.version_select at 0x7fb840d4f0d0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:59.530406 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-71959d20-177a-447a-8290-cbe476bde07b tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885867541" status: 202 len: 0 microversion: 2.1 time: 0.023364 Jul 20 05:02:59.530986 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3375/6733] 10.222.0.59 () {58 vars in 1220 bytes} [Wed Jul 20 05:02:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885867541 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:03:00.139102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-108e6e96-7fa7-4167-ac95-9d297eb7d3e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:00.139549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-108e6e96-7fa7-4167-ac95-9d297eb7d3e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:00.145673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-108e6e96-7fa7-4167-ac95-9d297eb7d3e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:00.146137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-108e6e96-7fa7-4167-ac95-9d297eb7d3e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:00.146944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-108e6e96-7fa7-4167-ac95-9d297eb7d3e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:00.147395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-108e6e96-7fa7-4167-ac95-9d297eb7d3e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:00.160443 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-108e6e96-7fa7-4167-ac95-9d297eb7d3e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] HTTP exception thrown: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-108e6e96-7fa7-4167-ac95-9d297eb7d3e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Request method failure captured: Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 HTTP/1.1 Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14wlniDBXQSThpJ-5WJZHKLMLypbxo__cxP_B3qj1ccte11ALV61ulqdbxxyfHW3MCH3FqOyQJIMWSLxki5XcXMz93z7RCFx323YJdnD9UZQwlIQYgyf_YBXybLPnaG0O0tDxgmTtpnqnHpzgtORiY4weQrMqqotLzdTJR_5dNXWpGo Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: b4761098051e4917ac4567da7bb55898 Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerDiskConfigTestJSON-462620575 Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4761098051e4917ac4567da7bb55898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4761098051e4917ac4567da7bb55898"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4761098051e4917ac4567da7bb55898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4761098051e4917ac4567da7bb55898"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerDiskConfigTestJSON-462620575 Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: b4761098051e4917ac4567da7bb55898 Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-462620575 Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerDiskConfigTestJSON-462620575-project Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e96a3000ee4046e3a705f359a4825ddd Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerDiskConfigTestJSON-462620575-project Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '260da9fa-8105-4df3-b174-3bce407b6193'} Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:03:00.161985 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-108e6e96-7fa7-4167-ac95-9d297eb7d3e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Returning 404 to user: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-108e6e96-7fa7-4167-ac95-9d297eb7d3e8 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "DELETE /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 404 len: 111 microversion: 2.1 time: 0.028343 Jul 20 05:03:00.165454 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3359/6734] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:03:00 2022] DELETE /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:03:00.172058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b8b7ad33-bcf0-4364-ba17-13a2aab5d4c1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:00.173456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b8b7ad33-bcf0-4364-ba17-13a2aab5d4c1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] [instance: 260da9fa-8105-4df3-b174-3bce407b6193] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:00.181046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8b7ad33-bcf0-4364-ba17-13a2aab5d4c1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:00.181515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8b7ad33-bcf0-4364-ba17-13a2aab5d4c1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:00.182320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8b7ad33-bcf0-4364-ba17-13a2aab5d4c1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:00.182777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b8b7ad33-bcf0-4364-ba17-13a2aab5d4c1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:00.196380 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-b8b7ad33-bcf0-4364-ba17-13a2aab5d4c1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] HTTP exception thrown: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b8b7ad33-bcf0-4364-ba17-13a2aab5d4c1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Request method failure captured: Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 HTTP/1.1 Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14wlniDBXQSThpJ-5WJZHKLMLypbxo__cxP_B3qj1ccte11ALV61ulqdbxxyfHW3MCH3FqOyQJIMWSLxki5XcXMz93z7RCFx323YJdnD9UZQwlIQYgyf_YBXybLPnaG0O0tDxgmTtpnqnHpzgtORiY4weQrMqqotLzdTJR_5dNXWpGo Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: b4761098051e4917ac4567da7bb55898 Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerDiskConfigTestJSON-462620575 Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4761098051e4917ac4567da7bb55898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4761098051e4917ac4567da7bb55898"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4761098051e4917ac4567da7bb55898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4761098051e4917ac4567da7bb55898"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerDiskConfigTestJSON-462620575 Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: b4761098051e4917ac4567da7bb55898 Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-462620575 Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerDiskConfigTestJSON-462620575-project Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e96a3000ee4046e3a705f359a4825ddd Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerDiskConfigTestJSON-462620575-project Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '260da9fa-8105-4df3-b174-3bce407b6193'} Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:03:00.198019 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:03:00.201254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:03:00.201254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:03:00.201254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:03:00.201254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:03:00.201254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:03:00.201254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. Jul 20 05:03:00.201254 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:03:00.201254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b8b7ad33-bcf0-4364-ba17-13a2aab5d4c1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] Returning 404 to user: Instance 260da9fa-8105-4df3-b174-3bce407b6193 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:03:00.201254 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b8b7ad33-bcf0-4364-ba17-13a2aab5d4c1 tempest-ServerDiskConfigTestJSON-462620575 tempest-ServerDiskConfigTestJSON-462620575-project] 10.222.0.59 "GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193" status: 404 len: 111 microversion: 2.1 time: 0.031474 Jul 20 05:03:00.201254 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3376/6735] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:00 2022] GET /compute/v2.1/servers/260da9fa-8105-4df3-b174-3bce407b6193 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:03:08.887026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b2fd1e45-9011-4208-8bfb-58ea184adcf8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'create', calling method: .version_select at 0x7fb841ca8310>, body: {"keypair": {"name": "tempest-keypair-949232659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASFXCtQfgxwQQtKaVzp3OXJYPioKgOJLi6229J3xo+Q2RV/b8qPdIBZCIpQPaiwbyTW4gYtrAbXFeEvMycaxwkHT25x6K2I7vlPF2HVzp1NH5UWhF495P/EvotG8eASYg=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:08.902360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b2fd1e45-9011-4208-8bfb-58ea184adcf8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:03:08.908594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b2fd1e45-9011-4208-8bfb-58ea184adcf8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for user e4ea64dbd5d2458aa813ee734342bf4d and project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:03:08.945892 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b2fd1e45-9011-4208-8bfb-58ea184adcf8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184141 Jul 20 05:03:08.946556 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3360/6736] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:03:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:03:10.437083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-345599254", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e66e46ae-4c0a-4cb2-9eef-7f390ec8fc02"}], "security_groups": [{"name": "tempest-securitygroup--1777061867"}], "key_name": "tempest-keypair-949232659", "user_data": "}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:10.446677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:10.447478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:10.553146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] validate_networks() for [('e66e46ae-4c0a-4cb2-9eef-7f390ec8fc02', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:03:10.961160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:03:10.962596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:03:10.963425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:03:10.963978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:03:10.964588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:03:10.977201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:10.977770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:10.981655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:10.982282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:11.002090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:03:11.010061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for user e4ea64dbd5d2458aa813ee734342bf4d and project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:03:11.025059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:03:11.028492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:03:11.080158 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f9bdc0a6-fff0-4df5-b15d-0fad8e253b83 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.647176 Jul 20 05:03:11.080866 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3377/6737] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:03:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:03:11.090822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7e27c499-5090-43ac-af87-9be94d9189ee tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:11.091459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7e27c499-5090-43ac-af87-9be94d9189ee tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:11.095907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:11.181348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7e27c499-5090-43ac-af87-9be94d9189ee tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:11.188113 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7e27c499-5090-43ac-af87-9be94d9189ee tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1237 microversion: 2.1 time: 0.101102 Jul 20 05:03:11.188783 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3361/6738] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:11 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:12.206851 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c6584236-701c-4103-85b8-09eb020ddc08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:12.207487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c6584236-701c-4103-85b8-09eb020ddc08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:12.214122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6584236-701c-4103-85b8-09eb020ddc08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:12.214893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6584236-701c-4103-85b8-09eb020ddc08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:12.215958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6584236-701c-4103-85b8-09eb020ddc08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:12.216608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c6584236-701c-4103-85b8-09eb020ddc08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:12.292494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c6584236-701c-4103-85b8-09eb020ddc08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:12.301955 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c6584236-701c-4103-85b8-09eb020ddc08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1295 microversion: 2.1 time: 0.100700 Jul 20 05:03:12.303166 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3378/6739] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:12 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:13.320936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-35f6f03c-7c58-4760-af37-658f6705f5d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:13.322098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-35f6f03c-7c58-4760-af37-658f6705f5d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:13.329526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f6f03c-7c58-4760-af37-658f6705f5d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:13.330018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f6f03c-7c58-4760-af37-658f6705f5d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:13.330880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f6f03c-7c58-4760-af37-658f6705f5d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:13.331340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-35f6f03c-7c58-4760-af37-658f6705f5d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:13.551830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-35f6f03c-7c58-4760-af37-658f6705f5d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:13.559661 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-35f6f03c-7c58-4760-af37-658f6705f5d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1363 microversion: 2.1 time: 0.243175 Jul 20 05:03:13.560249 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3362/6740] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:13 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:13.639697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9def727c-be9f-4b15-a994-d1f20e0e49c5 req-71b1c0cb-cee1-4b92-b89f-1838d86d81ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4537bade-25ce-4131-b844-d72d19cf5b31", "tag": "74fce215-56ba-439c-bea1-394fd27cece6"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:13.649134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9def727c-be9f-4b15-a994-d1f20e0e49c5 req-71b1c0cb-cee1-4b92-b89f-1838d86d81ce service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:13.649653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9def727c-be9f-4b15-a994-d1f20e0e49c5 req-71b1c0cb-cee1-4b92-b89f-1838d86d81ce service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:13.667748 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9def727c-be9f-4b15-a994-d1f20e0e49c5 req-71b1c0cb-cee1-4b92-b89f-1838d86d81ce service nova] Creating event network-changed:74fce215-56ba-439c-bea1-394fd27cece6 for instance 4537bade-25ce-4131-b844-d72d19cf5b31 on n-h1-760456-11 Jul 20 05:03:13.674839 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9def727c-be9f-4b15-a994-d1f20e0e49c5 req-71b1c0cb-cee1-4b92-b89f-1838d86d81ce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037808 Jul 20 05:03:13.675487 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3379/6741] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:14.577003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c95079b9-337c-4817-8cb5-863ecb69b623 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:14.577637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c95079b9-337c-4817-8cb5-863ecb69b623 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:14.585155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c95079b9-337c-4817-8cb5-863ecb69b623 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:14.585632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c95079b9-337c-4817-8cb5-863ecb69b623 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:14.586461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c95079b9-337c-4817-8cb5-863ecb69b623 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:14.586925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c95079b9-337c-4817-8cb5-863ecb69b623 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:14.717492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c95079b9-337c-4817-8cb5-863ecb69b623 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:14.725394 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c95079b9-337c-4817-8cb5-863ecb69b623 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1363 microversion: 2.1 time: 0.152307 Jul 20 05:03:14.725974 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3363/6742] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:14 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:15.742884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e18c0f0a-319c-4fb9-a98a-2b173e9c4938 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:15.743596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e18c0f0a-319c-4fb9-a98a-2b173e9c4938 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:15.751618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e18c0f0a-319c-4fb9-a98a-2b173e9c4938 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:15.752074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e18c0f0a-319c-4fb9-a98a-2b173e9c4938 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:15.752848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e18c0f0a-319c-4fb9-a98a-2b173e9c4938 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:15.753291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e18c0f0a-319c-4fb9-a98a-2b173e9c4938 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:15.884068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e18c0f0a-319c-4fb9-a98a-2b173e9c4938 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:15.891862 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e18c0f0a-319c-4fb9-a98a-2b173e9c4938 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1363 microversion: 2.1 time: 0.153251 Jul 20 05:03:15.892450 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3380/6743] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:15 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:16.909045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3eddb946-a7fe-428b-9a90-d564d8ddef4e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:16.909685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3eddb946-a7fe-428b-9a90-d564d8ddef4e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:16.916642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3eddb946-a7fe-428b-9a90-d564d8ddef4e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:16.917115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3eddb946-a7fe-428b-9a90-d564d8ddef4e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:16.917906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3eddb946-a7fe-428b-9a90-d564d8ddef4e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:16.918393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3eddb946-a7fe-428b-9a90-d564d8ddef4e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:17.049294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3eddb946-a7fe-428b-9a90-d564d8ddef4e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:17.056837 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3eddb946-a7fe-428b-9a90-d564d8ddef4e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1363 microversion: 2.1 time: 0.151866 Jul 20 05:03:17.057414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3364/6744] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:16 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:18.074750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f31bbdd7-a7a4-438d-8ebd-c10ba1cea158 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:18.075467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f31bbdd7-a7a4-438d-8ebd-c10ba1cea158 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:18.079548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3b671b25-34d5-4354-a2e5-dd20b67d5513 req-d66a980d-acae-45a3-95ab-c55ad3b9e353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4537bade-25ce-4131-b844-d72d19cf5b31", "name": "network-vif-plugged", "status": "completed", "tag": "74fce215-56ba-439c-bea1-394fd27cece6"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:18.084539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f31bbdd7-a7a4-438d-8ebd-c10ba1cea158 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:18.085291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f31bbdd7-a7a4-438d-8ebd-c10ba1cea158 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:18.086019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f31bbdd7-a7a4-438d-8ebd-c10ba1cea158 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:18.086704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f31bbdd7-a7a4-438d-8ebd-c10ba1cea158 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:18.089344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3b671b25-34d5-4354-a2e5-dd20b67d5513 req-d66a980d-acae-45a3-95ab-c55ad3b9e353 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:18.089635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3b671b25-34d5-4354-a2e5-dd20b67d5513 req-d66a980d-acae-45a3-95ab-c55ad3b9e353 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:18.103768 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3b671b25-34d5-4354-a2e5-dd20b67d5513 req-d66a980d-acae-45a3-95ab-c55ad3b9e353 service nova] Creating event network-vif-plugged:74fce215-56ba-439c-bea1-394fd27cece6 for instance 4537bade-25ce-4131-b844-d72d19cf5b31 on n-h1-760456-11 Jul 20 05:03:18.110469 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3b671b25-34d5-4354-a2e5-dd20b67d5513 req-d66a980d-acae-45a3-95ab-c55ad3b9e353 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035515 Jul 20 05:03:18.112528 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3365/6745] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:03:18.243418 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f31bbdd7-a7a4-438d-8ebd-c10ba1cea158 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:18.252454 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f31bbdd7-a7a4-438d-8ebd-c10ba1cea158 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1363 microversion: 2.1 time: 0.181627 Jul 20 05:03:18.253067 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3381/6746] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:18 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:19.271707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1946e0d3-a5a0-4069-9225-3a3e36d3d579 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:19.272439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1946e0d3-a5a0-4069-9225-3a3e36d3d579 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:19.274423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:19.280744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1946e0d3-a5a0-4069-9225-3a3e36d3d579 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:19.281275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1946e0d3-a5a0-4069-9225-3a3e36d3d579 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:19.282722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1946e0d3-a5a0-4069-9225-3a3e36d3d579 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:19.283208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1946e0d3-a5a0-4069-9225-3a3e36d3d579 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:19.418843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1946e0d3-a5a0-4069-9225-3a3e36d3d579 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:19.427020 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1946e0d3-a5a0-4069-9225-3a3e36d3d579 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1363 microversion: 2.1 time: 0.161037 Jul 20 05:03:19.427611 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3366/6747] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:19 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:20.445119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c8ea0a41-e8dc-446c-be71-73b38cf4b5fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:20.445735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c8ea0a41-e8dc-446c-be71-73b38cf4b5fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:20.452854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8ea0a41-e8dc-446c-be71-73b38cf4b5fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:20.453318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8ea0a41-e8dc-446c-be71-73b38cf4b5fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:20.454102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8ea0a41-e8dc-446c-be71-73b38cf4b5fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:20.454585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c8ea0a41-e8dc-446c-be71-73b38cf4b5fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:20.588578 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c8ea0a41-e8dc-446c-be71-73b38cf4b5fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:20.597325 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c8ea0a41-e8dc-446c-be71-73b38cf4b5fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1550 microversion: 2.1 time: 0.156217 Jul 20 05:03:20.597915 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3382/6748] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:20 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:20.614364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5453e597-1833-4c8f-bfc9-9bb1a68bbb98 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:20.614889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5453e597-1833-4c8f-bfc9-9bb1a68bbb98 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:20.622003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5453e597-1833-4c8f-bfc9-9bb1a68bbb98 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:20.622508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5453e597-1833-4c8f-bfc9-9bb1a68bbb98 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:20.623299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5453e597-1833-4c8f-bfc9-9bb1a68bbb98 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:20.623761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5453e597-1833-4c8f-bfc9-9bb1a68bbb98 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:20.707260 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5453e597-1833-4c8f-bfc9-9bb1a68bbb98 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097353 Jul 20 05:03:20.707874 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3367/6749] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 05:03:20 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:21.651727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1447326b-dc91-4ad6-976f-35ff26c87f80 req-23023caa-2218-4d39-8dbe-0ad09d9edd4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4537bade-25ce-4131-b844-d72d19cf5b31", "tag": "74fce215-56ba-439c-bea1-394fd27cece6"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:21.655376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:21.656135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:21.663865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1447326b-dc91-4ad6-976f-35ff26c87f80 req-23023caa-2218-4d39-8dbe-0ad09d9edd4f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:21.664760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1447326b-dc91-4ad6-976f-35ff26c87f80 req-23023caa-2218-4d39-8dbe-0ad09d9edd4f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:21.676320 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1447326b-dc91-4ad6-976f-35ff26c87f80 req-23023caa-2218-4d39-8dbe-0ad09d9edd4f service nova] Creating event network-changed:74fce215-56ba-439c-bea1-394fd27cece6 for instance 4537bade-25ce-4131-b844-d72d19cf5b31 on n-h1-760456-11 Jul 20 05:03:21.682671 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1447326b-dc91-4ad6-976f-35ff26c87f80 req-23023caa-2218-4d39-8dbe-0ad09d9edd4f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034724 Jul 20 05:03:21.683637 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3383/6750] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:03:57.980824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:57.982885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:57.983539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=30 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:57.988238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cabfeb33-4c40-4ee4-8bda-7bf96d14976a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:57.988869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cabfeb33-4c40-4ee4-8bda-7bf96d14976a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:57.996498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cabfeb33-4c40-4ee4-8bda-7bf96d14976a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:57.996968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cabfeb33-4c40-4ee4-8bda-7bf96d14976a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:57.997753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cabfeb33-4c40-4ee4-8bda-7bf96d14976a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:57.998208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cabfeb33-4c40-4ee4-8bda-7bf96d14976a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:58.129137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cabfeb33-4c40-4ee4-8bda-7bf96d14976a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:58.136670 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cabfeb33-4c40-4ee4-8bda-7bf96d14976a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1669 microversion: 2.1 time: 0.156577 Jul 20 05:03:58.137238 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3368/6751] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:57 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:58.154446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-44066c5c-8921-4eff-b1fc-c1bbff16b536 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:58.155154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-44066c5c-8921-4eff-b1fc-c1bbff16b536 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:58.157396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:58.158184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=30 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:03:58.164455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44066c5c-8921-4eff-b1fc-c1bbff16b536 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:58.164912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44066c5c-8921-4eff-b1fc-c1bbff16b536 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:58.165686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44066c5c-8921-4eff-b1fc-c1bbff16b536 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:58.166132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-44066c5c-8921-4eff-b1fc-c1bbff16b536 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:58.307867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-44066c5c-8921-4eff-b1fc-c1bbff16b536 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:58.316272 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-44066c5c-8921-4eff-b1fc-c1bbff16b536 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1669 microversion: 2.1 time: 0.166316 Jul 20 05:03:58.316852 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3384/6752] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:58 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:58.333710 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-36417ae1-740f-480e-b6ff-d838569e0c2c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:58.334394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-36417ae1-740f-480e-b6ff-d838569e0c2c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:58.340421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36417ae1-740f-480e-b6ff-d838569e0c2c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:58.340890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36417ae1-740f-480e-b6ff-d838569e0c2c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:58.341666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36417ae1-740f-480e-b6ff-d838569e0c2c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:58.342115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-36417ae1-740f-480e-b6ff-d838569e0c2c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:58.474174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-36417ae1-740f-480e-b6ff-d838569e0c2c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:58.481613 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-36417ae1-740f-480e-b6ff-d838569e0c2c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1669 microversion: 2.1 time: 0.152811 Jul 20 05:03:58.482187 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3369/6753] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:58 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:58.499116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:03:58.500036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:58.506856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:58.507323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:58.508102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:58.508555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:58.583327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:58.589863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Old instance type m1.heat2, new instance type m1.heat {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:03:58.596685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:03:58.597118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:03:58.597604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:03:58.598025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:03:58.598485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:03:58.711009 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a275b946-c0e2-4198-a9e9-e8c3a93a0ab8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31/action" status: 202 len: 0 microversion: 2.1 time: 0.216363 Jul 20 05:03:58.712063 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3385/6754] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:03:58 2022] POST /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:03:58.720147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c8892144-fb96-45d4-8c9a-cb6ca2c2026e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:58.720859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c8892144-fb96-45d4-8c9a-cb6ca2c2026e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:58.726957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8892144-fb96-45d4-8c9a-cb6ca2c2026e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:58.727426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8892144-fb96-45d4-8c9a-cb6ca2c2026e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:58.728276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8892144-fb96-45d4-8c9a-cb6ca2c2026e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:58.728727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c8892144-fb96-45d4-8c9a-cb6ca2c2026e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:58.887205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c8892144-fb96-45d4-8c9a-cb6ca2c2026e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:03:58.895439 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c8892144-fb96-45d4-8c9a-cb6ca2c2026e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1678 microversion: 2.1 time: 0.179327 Jul 20 05:03:58.896016 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3370/6755] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:58 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:03:59.916102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3a61b37-4e65-43d5-8351-de245d8f0d7c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:03:59.916735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d3a61b37-4e65-43d5-8351-de245d8f0d7c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:03:59.924517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3a61b37-4e65-43d5-8351-de245d8f0d7c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:59.925748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3a61b37-4e65-43d5-8351-de245d8f0d7c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:03:59.926930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3a61b37-4e65-43d5-8351-de245d8f0d7c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:03:59.927499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3a61b37-4e65-43d5-8351-de245d8f0d7c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:00.069166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d3a61b37-4e65-43d5-8351-de245d8f0d7c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:00.076785 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d3a61b37-4e65-43d5-8351-de245d8f0d7c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1678 microversion: 2.1 time: 0.165904 Jul 20 05:04:00.077363 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3386/6756] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:03:59 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:01.095366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-47ac71ce-82cc-451b-8f6e-9e0faf46fed0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:01.096006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-47ac71ce-82cc-451b-8f6e-9e0faf46fed0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:01.103045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47ac71ce-82cc-451b-8f6e-9e0faf46fed0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:01.103528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47ac71ce-82cc-451b-8f6e-9e0faf46fed0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:01.104325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47ac71ce-82cc-451b-8f6e-9e0faf46fed0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:01.104788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47ac71ce-82cc-451b-8f6e-9e0faf46fed0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:01.234687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-47ac71ce-82cc-451b-8f6e-9e0faf46fed0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:01.243355 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-47ac71ce-82cc-451b-8f6e-9e0faf46fed0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1683 microversion: 2.1 time: 0.152507 Jul 20 05:04:01.243935 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3371/6757] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:01 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:02.261200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7829e427-245b-4314-acd7-81942abddef2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:02.261833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7829e427-245b-4314-acd7-81942abddef2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:02.268988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7829e427-245b-4314-acd7-81942abddef2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:02.269451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7829e427-245b-4314-acd7-81942abddef2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:02.270226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7829e427-245b-4314-acd7-81942abddef2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:02.270699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7829e427-245b-4314-acd7-81942abddef2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:02.402198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7829e427-245b-4314-acd7-81942abddef2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:02.410579 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7829e427-245b-4314-acd7-81942abddef2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1683 microversion: 2.1 time: 0.153303 Jul 20 05:04:02.411198 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3387/6758] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:02 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:03.430536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2c808e5d-5a23-4b9a-826a-a0bc340a1478 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:03.431537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2c808e5d-5a23-4b9a-826a-a0bc340a1478 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:03.438678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c808e5d-5a23-4b9a-826a-a0bc340a1478 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:03.439258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c808e5d-5a23-4b9a-826a-a0bc340a1478 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:03.440241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c808e5d-5a23-4b9a-826a-a0bc340a1478 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:03.440697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2c808e5d-5a23-4b9a-826a-a0bc340a1478 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:03.577379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2c808e5d-5a23-4b9a-826a-a0bc340a1478 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:03.585627 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2c808e5d-5a23-4b9a-826a-a0bc340a1478 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1683 microversion: 2.1 time: 0.160071 Jul 20 05:04:03.586195 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3372/6759] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:03 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:04.603015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dccca802-a1d6-4d6d-b146-fa349462128f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:04.603635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dccca802-a1d6-4d6d-b146-fa349462128f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:04.611463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dccca802-a1d6-4d6d-b146-fa349462128f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:04.611971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dccca802-a1d6-4d6d-b146-fa349462128f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:04.612763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dccca802-a1d6-4d6d-b146-fa349462128f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:04.613218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dccca802-a1d6-4d6d-b146-fa349462128f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:04.743286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dccca802-a1d6-4d6d-b146-fa349462128f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:04.751256 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dccca802-a1d6-4d6d-b146-fa349462128f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1683 microversion: 2.1 time: 0.152135 Jul 20 05:04:04.751837 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3388/6760] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:04 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:05.769432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6bdb2efc-9ad8-4f98-ba5c-7dab0e33dc26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:05.770094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6bdb2efc-9ad8-4f98-ba5c-7dab0e33dc26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:05.777123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bdb2efc-9ad8-4f98-ba5c-7dab0e33dc26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:05.777597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bdb2efc-9ad8-4f98-ba5c-7dab0e33dc26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:05.778422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bdb2efc-9ad8-4f98-ba5c-7dab0e33dc26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:05.778885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6bdb2efc-9ad8-4f98-ba5c-7dab0e33dc26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:05.911843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6bdb2efc-9ad8-4f98-ba5c-7dab0e33dc26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:05.919457 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6bdb2efc-9ad8-4f98-ba5c-7dab0e33dc26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1683 microversion: 2.1 time: 0.154684 Jul 20 05:04:05.920028 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3373/6761] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:05 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:06.937275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e711c59e-a61e-4949-9c1b-aa5bca74489a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:06.937876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e711c59e-a61e-4949-9c1b-aa5bca74489a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:06.945565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e711c59e-a61e-4949-9c1b-aa5bca74489a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:06.946025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e711c59e-a61e-4949-9c1b-aa5bca74489a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:06.946839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e711c59e-a61e-4949-9c1b-aa5bca74489a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:06.947323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e711c59e-a61e-4949-9c1b-aa5bca74489a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:07.390208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e711c59e-a61e-4949-9c1b-aa5bca74489a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:07.398445 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e711c59e-a61e-4949-9c1b-aa5bca74489a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1683 microversion: 2.1 time: 0.465066 Jul 20 05:04:07.399029 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3389/6762] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:06 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1683 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:08.416107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ba378b0c-492d-4896-bd47-b219438edbb3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:08.416741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ba378b0c-492d-4896-bd47-b219438edbb3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:08.424372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba378b0c-492d-4896-bd47-b219438edbb3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:08.424924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba378b0c-492d-4896-bd47-b219438edbb3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:08.425717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba378b0c-492d-4896-bd47-b219438edbb3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:08.426170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ba378b0c-492d-4896-bd47-b219438edbb3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:08.558736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ba378b0c-492d-4896-bd47-b219438edbb3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:08.567418 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ba378b0c-492d-4896-bd47-b219438edbb3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1683 microversion: 2.1 time: 0.155416 Jul 20 05:04:08.568008 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3374/6763] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:08 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:09.585148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1e59fec0-e457-489d-8154-e1e5c8737c1f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:09.585792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1e59fec0-e457-489d-8154-e1e5c8737c1f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:09.593258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e59fec0-e457-489d-8154-e1e5c8737c1f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:09.594124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e59fec0-e457-489d-8154-e1e5c8737c1f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:09.594616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e59fec0-e457-489d-8154-e1e5c8737c1f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:09.595566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e59fec0-e457-489d-8154-e1e5c8737c1f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:09.738410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1e59fec0-e457-489d-8154-e1e5c8737c1f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:09.746533 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1e59fec0-e457-489d-8154-e1e5c8737c1f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1683 microversion: 2.1 time: 0.165504 Jul 20 05:04:09.747116 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3390/6764] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:09 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:10.763919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eabd4430-e225-430f-8e95-5d5740fe42d1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:10.764555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eabd4430-e225-430f-8e95-5d5740fe42d1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:10.771939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eabd4430-e225-430f-8e95-5d5740fe42d1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:10.772412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eabd4430-e225-430f-8e95-5d5740fe42d1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:10.773197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eabd4430-e225-430f-8e95-5d5740fe42d1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:10.773665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eabd4430-e225-430f-8e95-5d5740fe42d1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:10.908637 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eabd4430-e225-430f-8e95-5d5740fe42d1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:10.916633 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eabd4430-e225-430f-8e95-5d5740fe42d1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1683 microversion: 2.1 time: 0.156682 Jul 20 05:04:10.917210 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3375/6765] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:10 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:11.935484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-52e999c0-7890-4787-abe3-afcda8ee28aa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:11.936091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-52e999c0-7890-4787-abe3-afcda8ee28aa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:11.943033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52e999c0-7890-4787-abe3-afcda8ee28aa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:11.943530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52e999c0-7890-4787-abe3-afcda8ee28aa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:11.944305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52e999c0-7890-4787-abe3-afcda8ee28aa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:11.944748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-52e999c0-7890-4787-abe3-afcda8ee28aa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:12.083960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-52e999c0-7890-4787-abe3-afcda8ee28aa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:12.091555 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-52e999c0-7890-4787-abe3-afcda8ee28aa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1683 microversion: 2.1 time: 0.160126 Jul 20 05:04:12.092131 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3391/6766] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:11 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:13.085532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-17ffccfc-7b66-453e-bded-80b95a3567b5 req-08c7f74a-ebb4-479b-a729-c91a5947faa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4537bade-25ce-4131-b844-d72d19cf5b31", "name": "network-vif-unplugged", "status": "completed", "tag": "74fce215-56ba-439c-bea1-394fd27cece6"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:13.093917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-17ffccfc-7b66-453e-bded-80b95a3567b5 req-08c7f74a-ebb4-479b-a729-c91a5947faa2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:13.094412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-17ffccfc-7b66-453e-bded-80b95a3567b5 req-08c7f74a-ebb4-479b-a729-c91a5947faa2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:13.109026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c4cb1276-03c5-4cc2-bcdc-0fee4c230753 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:13.110046 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-17ffccfc-7b66-453e-bded-80b95a3567b5 req-08c7f74a-ebb4-479b-a729-c91a5947faa2 service nova] Creating event network-vif-unplugged:74fce215-56ba-439c-bea1-394fd27cece6 for instance 4537bade-25ce-4131-b844-d72d19cf5b31 on n-h2-760456-11 Jul 20 05:04:13.110693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c4cb1276-03c5-4cc2-bcdc-0fee4c230753 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:13.116285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-17ffccfc-7b66-453e-bded-80b95a3567b5 req-08c7f74a-ebb4-479b-a729-c91a5947faa2 service nova] Instance 4537bade-25ce-4131-b844-d72d19cf5b31 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:04:13.118690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4cb1276-03c5-4cc2-bcdc-0fee4c230753 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:13.119361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4cb1276-03c5-4cc2-bcdc-0fee4c230753 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:13.120707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4cb1276-03c5-4cc2-bcdc-0fee4c230753 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:13.121362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c4cb1276-03c5-4cc2-bcdc-0fee4c230753 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:13.129468 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-17ffccfc-7b66-453e-bded-80b95a3567b5 req-08c7f74a-ebb4-479b-a729-c91a5947faa2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047252 Jul 20 05:04:13.129940 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3376/6767] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:13.270529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c4cb1276-03c5-4cc2-bcdc-0fee4c230753 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:13.279508 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c4cb1276-03c5-4cc2-bcdc-0fee4c230753 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1682 microversion: 2.1 time: 0.174409 Jul 20 05:04:13.290993 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3392/6768] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:13 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:14.298501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1f0ba48e-58a7-4da6-8f44-bf1938db5146 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:14.299225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1f0ba48e-58a7-4da6-8f44-bf1938db5146 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:14.306478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f0ba48e-58a7-4da6-8f44-bf1938db5146 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:14.306952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f0ba48e-58a7-4da6-8f44-bf1938db5146 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:14.307732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f0ba48e-58a7-4da6-8f44-bf1938db5146 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:14.308239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1f0ba48e-58a7-4da6-8f44-bf1938db5146 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:14.439169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1f0ba48e-58a7-4da6-8f44-bf1938db5146 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:14.446713 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1f0ba48e-58a7-4da6-8f44-bf1938db5146 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1680 microversion: 2.1 time: 0.152638 Jul 20 05:04:14.447280 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3377/6769] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:14 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:15.143847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-698642fa-9e3b-4527-9427-8b15a1e934c7 req-b6a81012-64f6-47c5-81ab-6f25eb9a995e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4537bade-25ce-4131-b844-d72d19cf5b31", "tag": "74fce215-56ba-439c-bea1-394fd27cece6"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:15.152684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-698642fa-9e3b-4527-9427-8b15a1e934c7 req-b6a81012-64f6-47c5-81ab-6f25eb9a995e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:15.153135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-698642fa-9e3b-4527-9427-8b15a1e934c7 req-b6a81012-64f6-47c5-81ab-6f25eb9a995e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:15.164829 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-698642fa-9e3b-4527-9427-8b15a1e934c7 req-b6a81012-64f6-47c5-81ab-6f25eb9a995e service nova] Creating event network-changed:74fce215-56ba-439c-bea1-394fd27cece6 for instance 4537bade-25ce-4131-b844-d72d19cf5b31 on n-h2-760456-11 Jul 20 05:04:15.170057 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-698642fa-9e3b-4527-9427-8b15a1e934c7 req-b6a81012-64f6-47c5-81ab-6f25eb9a995e service nova] Instance 4537bade-25ce-4131-b844-d72d19cf5b31 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:04:15.181613 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-698642fa-9e3b-4527-9427-8b15a1e934c7 req-b6a81012-64f6-47c5-81ab-6f25eb9a995e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041553 Jul 20 05:04:15.182200 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3393/6770] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:15.465154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9ed1bbce-eb08-40ad-8123-f418b4fa4185 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:15.465794 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9ed1bbce-eb08-40ad-8123-f418b4fa4185 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:15.473791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ed1bbce-eb08-40ad-8123-f418b4fa4185 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:15.474288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ed1bbce-eb08-40ad-8123-f418b4fa4185 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:15.475150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ed1bbce-eb08-40ad-8123-f418b4fa4185 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:15.475608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9ed1bbce-eb08-40ad-8123-f418b4fa4185 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:15.791995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9ed1bbce-eb08-40ad-8123-f418b4fa4185 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:15.800536 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9ed1bbce-eb08-40ad-8123-f418b4fa4185 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1680 microversion: 2.1 time: 0.339598 Jul 20 05:04:15.801326 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3378/6771] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:15 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1680 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:16.818732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1042586f-17aa-4abe-8751-6cc8987e0764 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:16.819392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1042586f-17aa-4abe-8751-6cc8987e0764 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:16.825778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1042586f-17aa-4abe-8751-6cc8987e0764 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:16.826263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1042586f-17aa-4abe-8751-6cc8987e0764 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:16.827054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1042586f-17aa-4abe-8751-6cc8987e0764 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:16.827546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1042586f-17aa-4abe-8751-6cc8987e0764 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:16.966638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1042586f-17aa-4abe-8751-6cc8987e0764 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:16.974858 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1042586f-17aa-4abe-8751-6cc8987e0764 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1677 microversion: 2.1 time: 0.161595 Jul 20 05:04:16.975439 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3394/6772] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:16 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:16.991491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cd59b6ca-c24a-465a-a276-fbfa2983840b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:16.992056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cd59b6ca-c24a-465a-a276-fbfa2983840b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:16.999299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd59b6ca-c24a-465a-a276-fbfa2983840b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:16.999777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd59b6ca-c24a-465a-a276-fbfa2983840b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:17.000564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd59b6ca-c24a-465a-a276-fbfa2983840b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:17.001025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd59b6ca-c24a-465a-a276-fbfa2983840b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:17.058114 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cd59b6ca-c24a-465a-a276-fbfa2983840b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31/action" status: 204 len: 0 microversion: 2.1 time: 0.070387 Jul 20 05:04:17.058861 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3379/6773] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:04:16 2022] POST /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:04:17.070581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae86a68e-92cc-477d-91f1-b1c66b86605a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:17.071172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ae86a68e-92cc-477d-91f1-b1c66b86605a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:17.077891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae86a68e-92cc-477d-91f1-b1c66b86605a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:17.078460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae86a68e-92cc-477d-91f1-b1c66b86605a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:17.080882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae86a68e-92cc-477d-91f1-b1c66b86605a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:17.081357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae86a68e-92cc-477d-91f1-b1c66b86605a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:17.222194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae86a68e-92cc-477d-91f1-b1c66b86605a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:17.229946 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae86a68e-92cc-477d-91f1-b1c66b86605a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1677 microversion: 2.1 time: 0.165137 Jul 20 05:04:17.230628 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3395/6774] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:17 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:18.248815 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-50193552-3d99-413a-9c37-8cb55e68d58d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:18.250164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-50193552-3d99-413a-9c37-8cb55e68d58d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:18.259233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50193552-3d99-413a-9c37-8cb55e68d58d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.259705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50193552-3d99-413a-9c37-8cb55e68d58d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.260490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50193552-3d99-413a-9c37-8cb55e68d58d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.260941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-50193552-3d99-413a-9c37-8cb55e68d58d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.405022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-50193552-3d99-413a-9c37-8cb55e68d58d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:18.413855 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-50193552-3d99-413a-9c37-8cb55e68d58d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1669 microversion: 2.1 time: 0.169514 Jul 20 05:04:18.414569 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3380/6775] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:18 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:18.432690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0d471728-7f1a-461d-8fe5-52807c25db5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:18.433318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0d471728-7f1a-461d-8fe5-52807c25db5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:18.440813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d471728-7f1a-461d-8fe5-52807c25db5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.441270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d471728-7f1a-461d-8fe5-52807c25db5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.442286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d471728-7f1a-461d-8fe5-52807c25db5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.442865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d471728-7f1a-461d-8fe5-52807c25db5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.578597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0d471728-7f1a-461d-8fe5-52807c25db5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:18.591549 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0d471728-7f1a-461d-8fe5-52807c25db5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1669 microversion: 2.1 time: 0.162702 Jul 20 05:04:18.592580 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3396/6776] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:18 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:18.608434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3665a575-473d-438b-b58f-e24ceb804411 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:18.609064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3665a575-473d-438b-b58f-e24ceb804411 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:18.615989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3665a575-473d-438b-b58f-e24ceb804411 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.616457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3665a575-473d-438b-b58f-e24ceb804411 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.617239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3665a575-473d-438b-b58f-e24ceb804411 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.617689 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3665a575-473d-438b-b58f-e24ceb804411 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.749176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3665a575-473d-438b-b58f-e24ceb804411 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:18.757536 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3665a575-473d-438b-b58f-e24ceb804411 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1669 microversion: 2.1 time: 0.152925 Jul 20 05:04:18.758114 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3381/6777] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:18 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:18.773815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1fdfbee3-6e96-41f7-b8c1-5fd688a82c70 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:18.774363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1fdfbee3-6e96-41f7-b8c1-5fd688a82c70 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:18.780610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fdfbee3-6e96-41f7-b8c1-5fd688a82c70 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.781079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fdfbee3-6e96-41f7-b8c1-5fd688a82c70 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.781969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fdfbee3-6e96-41f7-b8c1-5fd688a82c70 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.782469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fdfbee3-6e96-41f7-b8c1-5fd688a82c70 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.811200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1fdfbee3-6e96-41f7-b8c1-5fd688a82c70 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:04:18.865561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:18.899562 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1fdfbee3-6e96-41f7-b8c1-5fd688a82c70 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 204 len: 0 microversion: 2.1 time: 0.129274 Jul 20 05:04:18.900294 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3397/6778] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:04:18 2022] DELETE /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:04:18.909833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3084cc63-551c-4516-ae45-4cdbf6e6860d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:18.910524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3084cc63-551c-4516-ae45-4cdbf6e6860d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:18.916953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3084cc63-551c-4516-ae45-4cdbf6e6860d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.917433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3084cc63-551c-4516-ae45-4cdbf6e6860d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.918283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3084cc63-551c-4516-ae45-4cdbf6e6860d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.918776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3084cc63-551c-4516-ae45-4cdbf6e6860d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:19.056443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3084cc63-551c-4516-ae45-4cdbf6e6860d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:19.064077 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3084cc63-551c-4516-ae45-4cdbf6e6860d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1675 microversion: 2.1 time: 0.159177 Jul 20 05:04:19.065154 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3382/6779] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:18 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:20.083443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-47a531cf-f543-4826-88d2-d54fea7a6e8f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:20.084166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-47a531cf-f543-4826-88d2-d54fea7a6e8f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:20.091297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47a531cf-f543-4826-88d2-d54fea7a6e8f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:20.091774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47a531cf-f543-4826-88d2-d54fea7a6e8f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:20.092590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47a531cf-f543-4826-88d2-d54fea7a6e8f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:20.093053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-47a531cf-f543-4826-88d2-d54fea7a6e8f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:20.228110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-47a531cf-f543-4826-88d2-d54fea7a6e8f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:20.235812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-47a531cf-f543-4826-88d2-d54fea7a6e8f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1675 microversion: 2.1 time: 0.157392 Jul 20 05:04:20.236934 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3398/6780] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:20 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:20.709545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3e681734-159d-44ae-9f09-ffac24e5055d req-92c75e71-1e41-4d68-9f07-ac13971c76f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4537bade-25ce-4131-b844-d72d19cf5b31", "name": "network-vif-plugged", "status": "completed", "tag": "74fce215-56ba-439c-bea1-394fd27cece6"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:20.719599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3e681734-159d-44ae-9f09-ffac24e5055d req-92c75e71-1e41-4d68-9f07-ac13971c76f8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:20.720064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3e681734-159d-44ae-9f09-ffac24e5055d req-92c75e71-1e41-4d68-9f07-ac13971c76f8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:20.733244 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3e681734-159d-44ae-9f09-ffac24e5055d req-92c75e71-1e41-4d68-9f07-ac13971c76f8 service nova] Creating event network-vif-plugged:74fce215-56ba-439c-bea1-394fd27cece6 for instance 4537bade-25ce-4131-b844-d72d19cf5b31 on n-h2-760456-11 Jul 20 05:04:20.739007 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3e681734-159d-44ae-9f09-ffac24e5055d req-92c75e71-1e41-4d68-9f07-ac13971c76f8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033958 Jul 20 05:04:20.739778 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3383/6781] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:21.130240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a031e491-2d71-4d9c-969d-04b3e5759fd8 req-2c0401d6-cf34-48af-b158-4a96cb1fc28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4537bade-25ce-4131-b844-d72d19cf5b31", "name": "network-vif-deleted", "tag": "74fce215-56ba-439c-bea1-394fd27cece6"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:21.140501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a031e491-2d71-4d9c-969d-04b3e5759fd8 req-2c0401d6-cf34-48af-b158-4a96cb1fc28a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:21.140952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a031e491-2d71-4d9c-969d-04b3e5759fd8 req-2c0401d6-cf34-48af-b158-4a96cb1fc28a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:21.153594 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a031e491-2d71-4d9c-969d-04b3e5759fd8 req-2c0401d6-cf34-48af-b158-4a96cb1fc28a service nova] Creating event network-vif-deleted:74fce215-56ba-439c-bea1-394fd27cece6 for instance 4537bade-25ce-4131-b844-d72d19cf5b31 on n-h2-760456-11 Jul 20 05:04:21.158515 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a031e491-2d71-4d9c-969d-04b3e5759fd8 req-2c0401d6-cf34-48af-b158-4a96cb1fc28a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032217 Jul 20 05:04:21.159322 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3399/6782] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:04:21.257208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:21.265181 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:21.273039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:21.273625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:21.274732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:21.275291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:21.292626 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:21.312319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:21.312898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:21.313450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lazy-loading 'fault' on Instance uuid 4537bade-25ce-4131-b844-d72d19cf5b31 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:04:21.371989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:21.381882 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-370f39e7-2150-4a57-8a63-532dafd2a628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 200 len: 1327 microversion: 2.1 time: 0.131109 Jul 20 05:04:21.392630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3384/6783] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:21 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 1327 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:22.400904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a31850e6-7b9a-4012-8043-d44d8f29ce1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:22.401535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a31850e6-7b9a-4012-8043-d44d8f29ce1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:22.407958 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a31850e6-7b9a-4012-8043-d44d8f29ce1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:22.409218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a31850e6-7b9a-4012-8043-d44d8f29ce1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:22.410022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a31850e6-7b9a-4012-8043-d44d8f29ce1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:22.410511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a31850e6-7b9a-4012-8043-d44d8f29ce1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:22.425502 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-a31850e6-7b9a-4012-8043-d44d8f29ce1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a31850e6-7b9a-4012-8043-d44d8f29ce1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 HTTP/1.1 Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4537bade-25ce-4131-b844-d72d19cf5b31'} Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:04:22.427450 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:04:22.431906 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:22.431906 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:04:22.431906 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:04:22.431906 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:04:22.431906 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:04:22.431906 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:04:22.431906 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:04:22.431906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a31850e6-7b9a-4012-8043-d44d8f29ce1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:04:22.431906 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a31850e6-7b9a-4012-8043-d44d8f29ce1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 404 len: 111 microversion: 2.1 time: 0.033434 Jul 20 05:04:22.431906 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3400/6784] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:22 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:04:22.440463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a1762222-be6d-44c9-90e1-f2ef55852ac0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:22.441101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a1762222-be6d-44c9-90e1-f2ef55852ac0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:22.448102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1762222-be6d-44c9-90e1-f2ef55852ac0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:22.448576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1762222-be6d-44c9-90e1-f2ef55852ac0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:22.449400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1762222-be6d-44c9-90e1-f2ef55852ac0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:22.449862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1762222-be6d-44c9-90e1-f2ef55852ac0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:22.464105 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a1762222-be6d-44c9-90e1-f2ef55852ac0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a1762222-be6d-44c9-90e1-f2ef55852ac0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 HTTP/1.1 Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4537bade-25ce-4131-b844-d72d19cf5b31'} Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:04:22.465781 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:04:22.469795 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:04:22.469795 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:04:22.469795 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:04:22.469795 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:04:22.469795 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:04:22.469795 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:04:22.469795 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:04:22.469795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a1762222-be6d-44c9-90e1-f2ef55852ac0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:04:22.469795 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a1762222-be6d-44c9-90e1-f2ef55852ac0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 404 len: 111 microversion: 2.1 time: 0.030852 Jul 20 05:04:22.469795 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3385/6785] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:22 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:04:22.515692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-427563944", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "e66e46ae-4c0a-4cb2-9eef-7f390ec8fc02"}], "security_groups": [{"name": "tempest-securitygroup--1777061867"}], "key_name": "tempest-keypair-949232659", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:22.619064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] validate_networks() for [('e66e46ae-4c0a-4cb2-9eef-7f390ec8fc02', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:04:22.992727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:04:22.993164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:04:22.993675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:04:22.994092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:04:22.994554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:04:23.004513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:23.004972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:23.005784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:23.006236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:23.023834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:04:23.029145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for user e4ea64dbd5d2458aa813ee734342bf4d and project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:04:23.041762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:04:23.044063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:04:23.090523 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-65a608c2-5a0b-4e14-9882-78b4c679b55c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.578715 Jul 20 05:04:23.091426 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3401/6786] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:04:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:04:23.102024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1eb1cbed-ee18-48f7-8960-ab7e0c78a893 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:23.102833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1eb1cbed-ee18-48f7-8960-ab7e0c78a893 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:23.158283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1eb1cbed-ee18-48f7-8960-ab7e0c78a893 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:23.165452 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1eb1cbed-ee18-48f7-8960-ab7e0c78a893 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1237 microversion: 2.1 time: 0.067434 Jul 20 05:04:23.166019 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3386/6787] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:23 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:24.183894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-25456100-d399-4602-bddc-a9f45398c6ba tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:24.184621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-25456100-d399-4602-bddc-a9f45398c6ba tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:24.192765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25456100-d399-4602-bddc-a9f45398c6ba tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:24.193234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25456100-d399-4602-bddc-a9f45398c6ba tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:24.194026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25456100-d399-4602-bddc-a9f45398c6ba tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:24.194510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-25456100-d399-4602-bddc-a9f45398c6ba tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:24.258310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-25456100-d399-4602-bddc-a9f45398c6ba tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:24.266065 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-25456100-d399-4602-bddc-a9f45398c6ba tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1295 microversion: 2.1 time: 0.086164 Jul 20 05:04:24.266676 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3402/6788] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:24 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:25.284742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3898848b-d4bd-4d01-9215-563ec4ffb260 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:25.286121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3898848b-d4bd-4d01-9215-563ec4ffb260 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:25.294121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3898848b-d4bd-4d01-9215-563ec4ffb260 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:25.294714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3898848b-d4bd-4d01-9215-563ec4ffb260 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:25.295761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3898848b-d4bd-4d01-9215-563ec4ffb260 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:25.296295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3898848b-d4bd-4d01-9215-563ec4ffb260 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:25.398538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9d6ef031-75b0-4c19-bf31-395b3d100cb6 req-a8c53698-7886-4b30-add1-455ae79dc09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da00dba-9ddf-4adb-8a9f-4c701809d181", "tag": "ecd16a19-475e-4bd8-88e9-de051b471001"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:25.411296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9d6ef031-75b0-4c19-bf31-395b3d100cb6 req-a8c53698-7886-4b30-add1-455ae79dc09d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:25.412288 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9d6ef031-75b0-4c19-bf31-395b3d100cb6 req-a8c53698-7886-4b30-add1-455ae79dc09d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:25.446691 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9d6ef031-75b0-4c19-bf31-395b3d100cb6 req-a8c53698-7886-4b30-add1-455ae79dc09d service nova] Creating event network-changed:ecd16a19-475e-4bd8-88e9-de051b471001 for instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 on n-h1-760456-11 Jul 20 05:04:25.453349 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9d6ef031-75b0-4c19-bf31-395b3d100cb6 req-a8c53698-7886-4b30-add1-455ae79dc09d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058368 Jul 20 05:04:25.454516 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3403/6789] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:25.531150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3898848b-d4bd-4d01-9215-563ec4ffb260 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:25.541495 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3898848b-d4bd-4d01-9215-563ec4ffb260 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1363 microversion: 2.1 time: 0.260688 Jul 20 05:04:25.542091 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3387/6790] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:25 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:26.560561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bd5cebc0-7ac4-413a-9232-b9ceb5985692 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:26.561280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bd5cebc0-7ac4-413a-9232-b9ceb5985692 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:26.568189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd5cebc0-7ac4-413a-9232-b9ceb5985692 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:26.568653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd5cebc0-7ac4-413a-9232-b9ceb5985692 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:26.569551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd5cebc0-7ac4-413a-9232-b9ceb5985692 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:26.570005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd5cebc0-7ac4-413a-9232-b9ceb5985692 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:26.711535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bd5cebc0-7ac4-413a-9232-b9ceb5985692 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:26.719297 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bd5cebc0-7ac4-413a-9232-b9ceb5985692 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1363 microversion: 2.1 time: 0.163929 Jul 20 05:04:26.719867 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3404/6791] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:26 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:27.736274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-98f906f3-16ec-49e0-be10-f4135ab60c2b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:27.736907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-98f906f3-16ec-49e0-be10-f4135ab60c2b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:27.743991 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98f906f3-16ec-49e0-be10-f4135ab60c2b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:27.744457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98f906f3-16ec-49e0-be10-f4135ab60c2b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:27.745488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98f906f3-16ec-49e0-be10-f4135ab60c2b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:27.745936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98f906f3-16ec-49e0-be10-f4135ab60c2b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:27.876813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-98f906f3-16ec-49e0-be10-f4135ab60c2b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:27.885278 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-98f906f3-16ec-49e0-be10-f4135ab60c2b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1363 microversion: 2.1 time: 0.152900 Jul 20 05:04:27.885860 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3388/6792] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:27 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:28.903400 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-58c7be4b-7ebd-4e1a-a476-f5b1a6e39aad tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:28.903993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-58c7be4b-7ebd-4e1a-a476-f5b1a6e39aad tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:28.906877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:28.912954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58c7be4b-7ebd-4e1a-a476-f5b1a6e39aad tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:28.913415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58c7be4b-7ebd-4e1a-a476-f5b1a6e39aad tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:28.914190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58c7be4b-7ebd-4e1a-a476-f5b1a6e39aad tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:28.914660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58c7be4b-7ebd-4e1a-a476-f5b1a6e39aad tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:29.049314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-58c7be4b-7ebd-4e1a-a476-f5b1a6e39aad tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:29.057428 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-58c7be4b-7ebd-4e1a-a476-f5b1a6e39aad tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1363 microversion: 2.1 time: 0.158049 Jul 20 05:04:29.058025 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3405/6793] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:28 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:30.075129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d3aa96c-9c97-434c-9058-56057cd57f9d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:30.075773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d3aa96c-9c97-434c-9058-56057cd57f9d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:30.078673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=47 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:30.084402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d3aa96c-9c97-434c-9058-56057cd57f9d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:30.084873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d3aa96c-9c97-434c-9058-56057cd57f9d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:30.085672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d3aa96c-9c97-434c-9058-56057cd57f9d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:30.086161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d3aa96c-9c97-434c-9058-56057cd57f9d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:30.223082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d3aa96c-9c97-434c-9058-56057cd57f9d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:30.230633 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d3aa96c-9c97-434c-9058-56057cd57f9d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1363 microversion: 2.1 time: 0.159370 Jul 20 05:04:30.231218 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3389/6794] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:30 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:30.437104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-40ddb7ee-8284-4318-9aa8-d402d26d813f req-e941c5c3-994b-4ca1-b9b6-f20301022b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da00dba-9ddf-4adb-8a9f-4c701809d181", "name": "network-vif-plugged", "status": "completed", "tag": "ecd16a19-475e-4bd8-88e9-de051b471001"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:30.446586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-40ddb7ee-8284-4318-9aa8-d402d26d813f req-e941c5c3-994b-4ca1-b9b6-f20301022b81 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:30.447041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-40ddb7ee-8284-4318-9aa8-d402d26d813f req-e941c5c3-994b-4ca1-b9b6-f20301022b81 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:30.458565 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-40ddb7ee-8284-4318-9aa8-d402d26d813f req-e941c5c3-994b-4ca1-b9b6-f20301022b81 service nova] Creating event network-vif-plugged:ecd16a19-475e-4bd8-88e9-de051b471001 for instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 on n-h1-760456-11 Jul 20 05:04:30.463697 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-40ddb7ee-8284-4318-9aa8-d402d26d813f req-e941c5c3-994b-4ca1-b9b6-f20301022b81 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030249 Jul 20 05:04:30.464285 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3406/6795] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:31.248971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fc245fbb-c487-442f-b13e-72b1c3f69f21 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:31.249535 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fc245fbb-c487-442f-b13e-72b1c3f69f21 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:31.257073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc245fbb-c487-442f-b13e-72b1c3f69f21 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:31.257552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc245fbb-c487-442f-b13e-72b1c3f69f21 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:31.258366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc245fbb-c487-442f-b13e-72b1c3f69f21 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:31.258831 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc245fbb-c487-442f-b13e-72b1c3f69f21 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:31.392772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fc245fbb-c487-442f-b13e-72b1c3f69f21 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:31.400442 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fc245fbb-c487-442f-b13e-72b1c3f69f21 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1363 microversion: 2.1 time: 0.155762 Jul 20 05:04:31.401022 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3390/6796] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:31 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:32.419257 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f749041c-833f-4aa6-acf3-1cc9bfd1a54d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:32.419982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f749041c-833f-4aa6-acf3-1cc9bfd1a54d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:32.427059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f749041c-833f-4aa6-acf3-1cc9bfd1a54d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:32.427613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f749041c-833f-4aa6-acf3-1cc9bfd1a54d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:32.428459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f749041c-833f-4aa6-acf3-1cc9bfd1a54d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:32.428917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f749041c-833f-4aa6-acf3-1cc9bfd1a54d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:32.563227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f749041c-833f-4aa6-acf3-1cc9bfd1a54d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:32.571576 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f749041c-833f-4aa6-acf3-1cc9bfd1a54d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1550 microversion: 2.1 time: 0.157527 Jul 20 05:04:32.572156 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3407/6797] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:32 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:32.589031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a28fa6f1-3cee-46bc-ac4b-fad3c14c1906 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:32.589537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a28fa6f1-3cee-46bc-ac4b-fad3c14c1906 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:32.596432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a28fa6f1-3cee-46bc-ac4b-fad3c14c1906 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:32.596965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a28fa6f1-3cee-46bc-ac4b-fad3c14c1906 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:32.597944 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a28fa6f1-3cee-46bc-ac4b-fad3c14c1906 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:32.598502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a28fa6f1-3cee-46bc-ac4b-fad3c14c1906 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:32.675816 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a28fa6f1-3cee-46bc-ac4b-fad3c14c1906 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090309 Jul 20 05:04:32.676471 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3391/6798] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 05:04:32 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:33.606849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-00b6d14e-ab10-4c0c-9122-1ce3b3896018 req-ce0b890a-13b3-4a12-ad96-7a025be58527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da00dba-9ddf-4adb-8a9f-4c701809d181", "tag": "ecd16a19-475e-4bd8-88e9-de051b471001"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:33.610583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:33.611262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:33.619619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-00b6d14e-ab10-4c0c-9122-1ce3b3896018 req-ce0b890a-13b3-4a12-ad96-7a025be58527 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:33.620341 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-00b6d14e-ab10-4c0c-9122-1ce3b3896018 req-ce0b890a-13b3-4a12-ad96-7a025be58527 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:33.632333 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-00b6d14e-ab10-4c0c-9122-1ce3b3896018 req-ce0b890a-13b3-4a12-ad96-7a025be58527 service nova] Creating event network-changed:ecd16a19-475e-4bd8-88e9-de051b471001 for instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 on n-h1-760456-11 Jul 20 05:04:33.637544 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-00b6d14e-ab10-4c0c-9122-1ce3b3896018 req-ce0b890a-13b3-4a12-ad96-7a025be58527 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034364 Jul 20 05:04:33.638153 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3408/6799] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:08.812276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:08.814665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=5 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:08.815310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=35 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:08.819927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eb827da4-8191-423e-9aee-dbaaff92eb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:08.827769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb827da4-8191-423e-9aee-dbaaff92eb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:08.828230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eb827da4-8191-423e-9aee-dbaaff92eb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:08.851439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eb827da4-8191-423e-9aee-dbaaff92eb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Going to try to stop instance {{(pid=119605) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 05:05:08.892596 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eb827da4-8191-423e-9aee-dbaaff92eb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181/action" status: 202 len: 0 microversion: 2.1 time: 0.080767 Jul 20 05:05:08.893262 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3392/6800] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:05:08 2022] POST /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:05:08.903022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d88a8389-9695-44d8-805e-91714052774d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:08.903735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d88a8389-9695-44d8-805e-91714052774d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:08.906107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=7 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:08.907108 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=42 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:08.914672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d88a8389-9695-44d8-805e-91714052774d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:08.915156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d88a8389-9695-44d8-805e-91714052774d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:08.915947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d88a8389-9695-44d8-805e-91714052774d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:08.916396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d88a8389-9695-44d8-805e-91714052774d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:09.234045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d88a8389-9695-44d8-805e-91714052774d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:09.242185 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d88a8389-9695-44d8-805e-91714052774d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.343800 Jul 20 05:05:09.242810 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3409/6801] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:08 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:10.261687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aac8125d-b9ed-4770-9964-06e98bf35181 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:10.262440 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aac8125d-b9ed-4770-9964-06e98bf35181 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:10.268763 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aac8125d-b9ed-4770-9964-06e98bf35181 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:10.269553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aac8125d-b9ed-4770-9964-06e98bf35181 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:10.270371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aac8125d-b9ed-4770-9964-06e98bf35181 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:10.270828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aac8125d-b9ed-4770-9964-06e98bf35181 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:10.521051 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aac8125d-b9ed-4770-9964-06e98bf35181 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:10.528623 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aac8125d-b9ed-4770-9964-06e98bf35181 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.272181 Jul 20 05:05:10.529197 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3393/6802] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:10 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:11.547479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5ea23340-10ca-40fa-9545-29e7af919851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:11.548135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5ea23340-10ca-40fa-9545-29e7af919851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:11.555153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ea23340-10ca-40fa-9545-29e7af919851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:11.555614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ea23340-10ca-40fa-9545-29e7af919851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:11.556395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ea23340-10ca-40fa-9545-29e7af919851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:11.556850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5ea23340-10ca-40fa-9545-29e7af919851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:11.687655 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5ea23340-10ca-40fa-9545-29e7af919851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:11.696472 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5ea23340-10ca-40fa-9545-29e7af919851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.153093 Jul 20 05:05:11.697055 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3410/6803] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:11 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:12.714063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29953d20-ed44-4707-9929-682e1f4e9bdb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:12.714721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-29953d20-ed44-4707-9929-682e1f4e9bdb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:12.721078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29953d20-ed44-4707-9929-682e1f4e9bdb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:12.721547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29953d20-ed44-4707-9929-682e1f4e9bdb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:12.723573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29953d20-ed44-4707-9929-682e1f4e9bdb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:12.724036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29953d20-ed44-4707-9929-682e1f4e9bdb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:12.859353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-29953d20-ed44-4707-9929-682e1f4e9bdb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:12.867269 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-29953d20-ed44-4707-9929-682e1f4e9bdb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.157344 Jul 20 05:05:12.867852 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3394/6804] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:12 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:13.885124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-435a163e-2197-43a5-840c-d749c952a068 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:13.885673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-435a163e-2197-43a5-840c-d749c952a068 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:13.892780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-435a163e-2197-43a5-840c-d749c952a068 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:13.893246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-435a163e-2197-43a5-840c-d749c952a068 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:13.894029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-435a163e-2197-43a5-840c-d749c952a068 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:13.895099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-435a163e-2197-43a5-840c-d749c952a068 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:14.029243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-435a163e-2197-43a5-840c-d749c952a068 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:14.037514 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-435a163e-2197-43a5-840c-d749c952a068 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.156417 Jul 20 05:05:14.038090 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3411/6805] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:13 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:15.060900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ca02e17e-ffd9-4dca-8b99-0851a95636d4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:15.061557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ca02e17e-ffd9-4dca-8b99-0851a95636d4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:15.069761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca02e17e-ffd9-4dca-8b99-0851a95636d4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:15.070240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca02e17e-ffd9-4dca-8b99-0851a95636d4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:15.071057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca02e17e-ffd9-4dca-8b99-0851a95636d4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:15.071512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ca02e17e-ffd9-4dca-8b99-0851a95636d4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:15.209331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ca02e17e-ffd9-4dca-8b99-0851a95636d4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:15.216849 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ca02e17e-ffd9-4dca-8b99-0851a95636d4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.159894 Jul 20 05:05:15.217470 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3395/6806] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:15 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:16.234576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-220f2266-5f9d-4ba7-aa65-683483044ed7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:16.235204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-220f2266-5f9d-4ba7-aa65-683483044ed7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:16.242947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-220f2266-5f9d-4ba7-aa65-683483044ed7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:16.243412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-220f2266-5f9d-4ba7-aa65-683483044ed7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:16.244199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-220f2266-5f9d-4ba7-aa65-683483044ed7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:16.244650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-220f2266-5f9d-4ba7-aa65-683483044ed7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:16.373567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-220f2266-5f9d-4ba7-aa65-683483044ed7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:16.381881 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-220f2266-5f9d-4ba7-aa65-683483044ed7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.151235 Jul 20 05:05:16.382418 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3412/6807] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:16 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:17.399274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ddf520fb-fe82-45c1-adb9-838bbee4fa80 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:17.399905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ddf520fb-fe82-45c1-adb9-838bbee4fa80 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:17.407294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddf520fb-fe82-45c1-adb9-838bbee4fa80 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:17.407767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddf520fb-fe82-45c1-adb9-838bbee4fa80 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:17.408555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddf520fb-fe82-45c1-adb9-838bbee4fa80 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:17.409014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ddf520fb-fe82-45c1-adb9-838bbee4fa80 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:17.543844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ddf520fb-fe82-45c1-adb9-838bbee4fa80 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:17.552176 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ddf520fb-fe82-45c1-adb9-838bbee4fa80 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.156806 Jul 20 05:05:17.552768 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3396/6808] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:17 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:18.570410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-515f995b-5a1a-4bd1-989b-bcad97b19e08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:18.571042 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-515f995b-5a1a-4bd1-989b-bcad97b19e08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:18.578078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515f995b-5a1a-4bd1-989b-bcad97b19e08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:18.578574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515f995b-5a1a-4bd1-989b-bcad97b19e08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:18.579358 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515f995b-5a1a-4bd1-989b-bcad97b19e08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:18.579813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-515f995b-5a1a-4bd1-989b-bcad97b19e08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:18.717232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-515f995b-5a1a-4bd1-989b-bcad97b19e08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:18.725157 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-515f995b-5a1a-4bd1-989b-bcad97b19e08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.159511 Jul 20 05:05:18.725753 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3413/6809] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:18 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:19.744008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d774767f-e7ab-4f79-9c33-6ab807e3ddaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:19.744642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d774767f-e7ab-4f79-9c33-6ab807e3ddaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:19.752009 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d774767f-e7ab-4f79-9c33-6ab807e3ddaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:19.752486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d774767f-e7ab-4f79-9c33-6ab807e3ddaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:19.753291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d774767f-e7ab-4f79-9c33-6ab807e3ddaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:19.754037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d774767f-e7ab-4f79-9c33-6ab807e3ddaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:19.888313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d774767f-e7ab-4f79-9c33-6ab807e3ddaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:19.896338 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d774767f-e7ab-4f79-9c33-6ab807e3ddaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.156238 Jul 20 05:05:19.896927 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3397/6810] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:19 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:20.579441 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:05:20.579633 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:05:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:05:20.620496 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:05:20.620634 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:05:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:05:20.913046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8c5eb1b6-8824-4122-aaf0-3f5a54ecbc90 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:20.913683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8c5eb1b6-8824-4122-aaf0-3f5a54ecbc90 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:20.921751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c5eb1b6-8824-4122-aaf0-3f5a54ecbc90 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:20.922228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c5eb1b6-8824-4122-aaf0-3f5a54ecbc90 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:20.923046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c5eb1b6-8824-4122-aaf0-3f5a54ecbc90 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:20.923500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c5eb1b6-8824-4122-aaf0-3f5a54ecbc90 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:21.056600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c5eb1b6-8824-4122-aaf0-3f5a54ecbc90 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:21.064412 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8c5eb1b6-8824-4122-aaf0-3f5a54ecbc90 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.155369 Jul 20 05:05:21.064997 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3414/6811] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:20 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:22.083233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-729bf0c5-689e-429f-86b0-5880a6fa1be7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:22.083873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-729bf0c5-689e-429f-86b0-5880a6fa1be7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:22.091487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-729bf0c5-689e-429f-86b0-5880a6fa1be7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:22.091961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-729bf0c5-689e-429f-86b0-5880a6fa1be7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:22.092752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-729bf0c5-689e-429f-86b0-5880a6fa1be7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:22.093214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-729bf0c5-689e-429f-86b0-5880a6fa1be7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:22.221367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-729bf0c5-689e-429f-86b0-5880a6fa1be7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:22.228852 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-729bf0c5-689e-429f-86b0-5880a6fa1be7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.150457 Jul 20 05:05:22.229420 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3398/6812] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:22 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:23.246482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c7560827-6e0e-42be-9d46-8c68f5cd2515 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:23.247036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c7560827-6e0e-42be-9d46-8c68f5cd2515 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:23.254761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7560827-6e0e-42be-9d46-8c68f5cd2515 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:23.255229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7560827-6e0e-42be-9d46-8c68f5cd2515 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:23.256016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7560827-6e0e-42be-9d46-8c68f5cd2515 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:23.256472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c7560827-6e0e-42be-9d46-8c68f5cd2515 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:23.390556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c7560827-6e0e-42be-9d46-8c68f5cd2515 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:23.398518 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c7560827-6e0e-42be-9d46-8c68f5cd2515 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.156317 Jul 20 05:05:23.399109 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3415/6813] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:23 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:24.415478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d237362f-ef28-45f2-9753-44633127ba08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:24.416103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d237362f-ef28-45f2-9753-44633127ba08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:24.423169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d237362f-ef28-45f2-9753-44633127ba08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:24.423628 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d237362f-ef28-45f2-9753-44633127ba08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:24.424403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d237362f-ef28-45f2-9753-44633127ba08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:24.424850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d237362f-ef28-45f2-9753-44633127ba08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:24.561836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d237362f-ef28-45f2-9753-44633127ba08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:24.569547 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d237362f-ef28-45f2-9753-44633127ba08 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1656 microversion: 2.1 time: 0.158005 Jul 20 05:05:24.570114 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3399/6814] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:24 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:05:24.586907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:24.587888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:24.594885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:24.595351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:24.596122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:24.596568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:24.625871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:24.632365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Old instance type m1.heat2, new instance type m1.heat {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:05:24.638654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:05:24.639084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:05:24.639568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:05:24.639985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:05:24.640408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:05:24.702774 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d7b12cd-abf7-475d-98a4-127b8a74aa17 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181/action" status: 202 len: 0 microversion: 2.1 time: 0.119607 Jul 20 05:05:24.703314 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3416/6815] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:05:24 2022] POST /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:05:24.712373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0c9b0ec1-ffe5-4c65-b519-36ca437b84da tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:24.713015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0c9b0ec1-ffe5-4c65-b519-36ca437b84da tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:24.719259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c9b0ec1-ffe5-4c65-b519-36ca437b84da tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:24.719729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c9b0ec1-ffe5-4c65-b519-36ca437b84da tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:24.720515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c9b0ec1-ffe5-4c65-b519-36ca437b84da tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:24.721067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c9b0ec1-ffe5-4c65-b519-36ca437b84da tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:24.884696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0c9b0ec1-ffe5-4c65-b519-36ca437b84da tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:24.892427 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0c9b0ec1-ffe5-4c65-b519-36ca437b84da tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.184046 Jul 20 05:05:24.893004 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3400/6816] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:24 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:25.912138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7b0241e3-32be-46b5-b3f6-2ef50381c370 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:25.912767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7b0241e3-32be-46b5-b3f6-2ef50381c370 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:25.919784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b0241e3-32be-46b5-b3f6-2ef50381c370 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:25.920250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b0241e3-32be-46b5-b3f6-2ef50381c370 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:25.921028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b0241e3-32be-46b5-b3f6-2ef50381c370 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:25.921477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7b0241e3-32be-46b5-b3f6-2ef50381c370 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:26.065220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7b0241e3-32be-46b5-b3f6-2ef50381c370 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:26.073096 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7b0241e3-32be-46b5-b3f6-2ef50381c370 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1679 microversion: 2.1 time: 0.167055 Jul 20 05:05:26.084789 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3417/6817] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:25 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:27.097490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-492845c2-c8b6-4764-a8f0-60dbbbe71ea3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:27.098682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-492845c2-c8b6-4764-a8f0-60dbbbe71ea3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:27.105749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-492845c2-c8b6-4764-a8f0-60dbbbe71ea3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:27.106297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-492845c2-c8b6-4764-a8f0-60dbbbe71ea3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:27.107082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-492845c2-c8b6-4764-a8f0-60dbbbe71ea3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:27.107542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-492845c2-c8b6-4764-a8f0-60dbbbe71ea3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:27.239781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-492845c2-c8b6-4764-a8f0-60dbbbe71ea3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:27.247516 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-492845c2-c8b6-4764-a8f0-60dbbbe71ea3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1684 microversion: 2.1 time: 0.153970 Jul 20 05:05:27.248067 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3401/6818] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:27 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:28.265197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c66b6782-b15c-40ca-9460-bef43be76f4d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:28.265913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c66b6782-b15c-40ca-9460-bef43be76f4d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:28.273710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c66b6782-b15c-40ca-9460-bef43be76f4d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:28.274186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c66b6782-b15c-40ca-9460-bef43be76f4d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:28.275019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c66b6782-b15c-40ca-9460-bef43be76f4d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:28.275480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c66b6782-b15c-40ca-9460-bef43be76f4d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:28.410885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c66b6782-b15c-40ca-9460-bef43be76f4d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:28.419455 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c66b6782-b15c-40ca-9460-bef43be76f4d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1684 microversion: 2.1 time: 0.158159 Jul 20 05:05:28.420418 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3418/6819] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:28 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:29.017819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-7cd20914-81d9-478b-be34-7bb4f4578c75 req-d54e542d-bffe-44bd-85db-c708c3ee42f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da00dba-9ddf-4adb-8a9f-4c701809d181", "name": "network-vif-unplugged", "status": "completed", "tag": "ecd16a19-475e-4bd8-88e9-de051b471001"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:29.027562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7cd20914-81d9-478b-be34-7bb4f4578c75 req-d54e542d-bffe-44bd-85db-c708c3ee42f6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:29.028026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7cd20914-81d9-478b-be34-7bb4f4578c75 req-d54e542d-bffe-44bd-85db-c708c3ee42f6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:29.044687 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-7cd20914-81d9-478b-be34-7bb4f4578c75 req-d54e542d-bffe-44bd-85db-c708c3ee42f6 service nova] Creating event network-vif-unplugged:ecd16a19-475e-4bd8-88e9-de051b471001 for instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 on n-h2-760456-11 Jul 20 05:05:29.050713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-7cd20914-81d9-478b-be34-7bb4f4578c75 req-d54e542d-bffe-44bd-85db-c708c3ee42f6 service nova] Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:05:29.064003 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-7cd20914-81d9-478b-be34-7bb4f4578c75 req-d54e542d-bffe-44bd-85db-c708c3ee42f6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112984 Jul 20 05:05:29.064897 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3402/6820] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:05:29.440953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7ae5fbfb-ed28-4533-88d4-41553d082399 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:29.442280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7ae5fbfb-ed28-4533-88d4-41553d082399 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:29.452768 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ae5fbfb-ed28-4533-88d4-41553d082399 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:29.453240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ae5fbfb-ed28-4533-88d4-41553d082399 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:29.454498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ae5fbfb-ed28-4533-88d4-41553d082399 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:29.454949 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7ae5fbfb-ed28-4533-88d4-41553d082399 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:29.610026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7ae5fbfb-ed28-4533-88d4-41553d082399 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:29.618787 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7ae5fbfb-ed28-4533-88d4-41553d082399 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1683 microversion: 2.1 time: 0.182870 Jul 20 05:05:29.619389 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3419/6821] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:29 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:30.637803 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a50d4aa0-10f5-4b59-82f5-f58fe9ede2b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:30.638655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a50d4aa0-10f5-4b59-82f5-f58fe9ede2b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:30.644793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a50d4aa0-10f5-4b59-82f5-f58fe9ede2b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:30.645415 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a50d4aa0-10f5-4b59-82f5-f58fe9ede2b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:30.646193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a50d4aa0-10f5-4b59-82f5-f58fe9ede2b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:30.646672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a50d4aa0-10f5-4b59-82f5-f58fe9ede2b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:30.782898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a50d4aa0-10f5-4b59-82f5-f58fe9ede2b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:30.791132 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a50d4aa0-10f5-4b59-82f5-f58fe9ede2b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1681 microversion: 2.1 time: 0.158573 Jul 20 05:05:30.791708 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3403/6822] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:30 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:31.106856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-66ca32cc-b005-4a1b-8205-868ef0a47aa6 req-dd1ea102-4346-49b0-8b50-fac5d72136db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da00dba-9ddf-4adb-8a9f-4c701809d181", "tag": "ecd16a19-475e-4bd8-88e9-de051b471001"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:31.116331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-66ca32cc-b005-4a1b-8205-868ef0a47aa6 req-dd1ea102-4346-49b0-8b50-fac5d72136db service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:31.116796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-66ca32cc-b005-4a1b-8205-868ef0a47aa6 req-dd1ea102-4346-49b0-8b50-fac5d72136db service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:31.129235 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-66ca32cc-b005-4a1b-8205-868ef0a47aa6 req-dd1ea102-4346-49b0-8b50-fac5d72136db service nova] Creating event network-changed:ecd16a19-475e-4bd8-88e9-de051b471001 for instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 on n-h2-760456-11 Jul 20 05:05:31.134946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-66ca32cc-b005-4a1b-8205-868ef0a47aa6 req-dd1ea102-4346-49b0-8b50-fac5d72136db service nova] Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:05:31.147501 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-66ca32cc-b005-4a1b-8205-868ef0a47aa6 req-dd1ea102-4346-49b0-8b50-fac5d72136db service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044226 Jul 20 05:05:31.148102 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3420/6823] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:31.808761 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-627b8d54-b843-47e7-b184-196f46697373 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:31.809308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-627b8d54-b843-47e7-b184-196f46697373 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:31.816176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-627b8d54-b843-47e7-b184-196f46697373 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:31.816640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-627b8d54-b843-47e7-b184-196f46697373 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:31.818202 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-627b8d54-b843-47e7-b184-196f46697373 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:31.818683 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-627b8d54-b843-47e7-b184-196f46697373 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:32.111839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-627b8d54-b843-47e7-b184-196f46697373 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:32.120525 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-627b8d54-b843-47e7-b184-196f46697373 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1677 microversion: 2.1 time: 0.315481 Jul 20 05:05:32.121979 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3404/6824] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:31 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1677 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:32.139229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f779528-3135-4923-8449-7e8baf7471f6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:32.139950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9f779528-3135-4923-8449-7e8baf7471f6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:32.148003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f779528-3135-4923-8449-7e8baf7471f6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:32.148761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f779528-3135-4923-8449-7e8baf7471f6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:32.149556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f779528-3135-4923-8449-7e8baf7471f6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:32.150001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9f779528-3135-4923-8449-7e8baf7471f6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:32.209268 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f779528-3135-4923-8449-7e8baf7471f6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181/action" status: 204 len: 0 microversion: 2.1 time: 0.074322 Jul 20 05:05:32.209905 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3421/6825] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:05:32 2022] POST /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:05:32.218281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e4656aeb-6baa-41be-9bc2-6b8400613750 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:32.219237 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e4656aeb-6baa-41be-9bc2-6b8400613750 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:32.226361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4656aeb-6baa-41be-9bc2-6b8400613750 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:32.226868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4656aeb-6baa-41be-9bc2-6b8400613750 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:32.227723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4656aeb-6baa-41be-9bc2-6b8400613750 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:32.228486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e4656aeb-6baa-41be-9bc2-6b8400613750 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:32.447134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e4656aeb-6baa-41be-9bc2-6b8400613750 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:32.454811 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e4656aeb-6baa-41be-9bc2-6b8400613750 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1677 microversion: 2.1 time: 0.240592 Jul 20 05:05:32.455391 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3405/6826] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:32 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:33.475342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0851acf9-35b8-414c-8134-07f1bd28e26b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:33.476101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0851acf9-35b8-414c-8134-07f1bd28e26b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:33.482765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0851acf9-35b8-414c-8134-07f1bd28e26b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:33.483446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0851acf9-35b8-414c-8134-07f1bd28e26b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:33.484244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0851acf9-35b8-414c-8134-07f1bd28e26b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:33.484729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0851acf9-35b8-414c-8134-07f1bd28e26b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:33.629426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0851acf9-35b8-414c-8134-07f1bd28e26b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:33.637186 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0851acf9-35b8-414c-8134-07f1bd28e26b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1656 microversion: 2.1 time: 0.167960 Jul 20 05:05:33.637759 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3422/6827] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:33 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1656 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:33.653615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a932dc14-1be0-43fb-b114-e58f2e0bfc14 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:33.654242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a932dc14-1be0-43fb-b114-e58f2e0bfc14 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:33.661602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a932dc14-1be0-43fb-b114-e58f2e0bfc14 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:33.662119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a932dc14-1be0-43fb-b114-e58f2e0bfc14 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:33.662861 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a932dc14-1be0-43fb-b114-e58f2e0bfc14 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:33.663315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a932dc14-1be0-43fb-b114-e58f2e0bfc14 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:33.796198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a932dc14-1be0-43fb-b114-e58f2e0bfc14 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:33.804359 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a932dc14-1be0-43fb-b114-e58f2e0bfc14 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1656 microversion: 2.1 time: 0.154557 Jul 20 05:05:33.804947 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3406/6828] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:33 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:05:33.820610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e1ae77dd-858b-473a-96bd-c9556a505d16 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:33.826728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1ae77dd-858b-473a-96bd-c9556a505d16 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:33.827188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e1ae77dd-858b-473a-96bd-c9556a505d16 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:33.840541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:33.851147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e1ae77dd-858b-473a-96bd-c9556a505d16 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Going to try to start instance {{(pid=119606) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 05:05:33.892364 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e1ae77dd-858b-473a-96bd-c9556a505d16 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181/action" status: 202 len: 0 microversion: 2.1 time: 0.075639 Jul 20 05:05:33.892966 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3423/6829] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:05:33 2022] POST /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:05:33.901886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-251d91d3-111f-49bb-9010-3d3567f6cb8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:33.902560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-251d91d3-111f-49bb-9010-3d3567f6cb8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:33.909280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-251d91d3-111f-49bb-9010-3d3567f6cb8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:33.909793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-251d91d3-111f-49bb-9010-3d3567f6cb8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:33.910687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-251d91d3-111f-49bb-9010-3d3567f6cb8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:33.911698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-251d91d3-111f-49bb-9010-3d3567f6cb8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:34.099377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-251d91d3-111f-49bb-9010-3d3567f6cb8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:34.103887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:34.112292 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-251d91d3-111f-49bb-9010-3d3567f6cb8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1665 microversion: 2.1 time: 0.214214 Jul 20 05:05:34.113135 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3407/6830] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:33 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1665 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:35.010924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-26f91e25-7f03-49d2-b2d5-40f203b6f7af req-d8f30c46-ed58-413a-a284-700681a9dd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da00dba-9ddf-4adb-8a9f-4c701809d181", "name": "network-vif-plugged", "status": "completed", "tag": "ecd16a19-475e-4bd8-88e9-de051b471001"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:35.019201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-26f91e25-7f03-49d2-b2d5-40f203b6f7af req-d8f30c46-ed58-413a-a284-700681a9dd51 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:35.019664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-26f91e25-7f03-49d2-b2d5-40f203b6f7af req-d8f30c46-ed58-413a-a284-700681a9dd51 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:35.030829 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-26f91e25-7f03-49d2-b2d5-40f203b6f7af req-d8f30c46-ed58-413a-a284-700681a9dd51 service nova] Creating event network-vif-plugged:ecd16a19-475e-4bd8-88e9-de051b471001 for instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 on n-h2-760456-11 Jul 20 05:05:35.035570 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-26f91e25-7f03-49d2-b2d5-40f203b6f7af req-d8f30c46-ed58-413a-a284-700681a9dd51 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087138 Jul 20 05:05:35.036676 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3424/6831] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:35.130496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3df70ddc-66af-48a3-8560-945a0a8f872a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:35.131141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3df70ddc-66af-48a3-8560-945a0a8f872a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:35.139604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3df70ddc-66af-48a3-8560-945a0a8f872a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:35.140067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3df70ddc-66af-48a3-8560-945a0a8f872a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:35.140852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3df70ddc-66af-48a3-8560-945a0a8f872a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:35.141304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3df70ddc-66af-48a3-8560-945a0a8f872a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:35.281911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3df70ddc-66af-48a3-8560-945a0a8f872a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:35.291414 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3df70ddc-66af-48a3-8560-945a0a8f872a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1665 microversion: 2.1 time: 0.165020 Jul 20 05:05:35.292002 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3408/6832] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:35 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:36.310599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7f0a5403-ff47-4abe-bed6-be347f1cea22 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:36.311307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7f0a5403-ff47-4abe-bed6-be347f1cea22 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:36.317720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f0a5403-ff47-4abe-bed6-be347f1cea22 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:36.318703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f0a5403-ff47-4abe-bed6-be347f1cea22 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:36.319473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f0a5403-ff47-4abe-bed6-be347f1cea22 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:36.319920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f0a5403-ff47-4abe-bed6-be347f1cea22 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:36.453811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7f0a5403-ff47-4abe-bed6-be347f1cea22 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:36.462581 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7f0a5403-ff47-4abe-bed6-be347f1cea22 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1669 microversion: 2.1 time: 0.157109 Jul 20 05:05:36.463157 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3425/6833] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:36 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:36.479063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7bc336fb-a6e3-4d16-b932-c26e49ad4187 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:36.479587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7bc336fb-a6e3-4d16-b932-c26e49ad4187 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:36.486599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bc336fb-a6e3-4d16-b932-c26e49ad4187 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:36.487070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bc336fb-a6e3-4d16-b932-c26e49ad4187 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:36.487856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bc336fb-a6e3-4d16-b932-c26e49ad4187 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:36.488314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7bc336fb-a6e3-4d16-b932-c26e49ad4187 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:36.517632 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7bc336fb-a6e3-4d16-b932-c26e49ad4187 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:05:36.592804 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7bc336fb-a6e3-4d16-b932-c26e49ad4187 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 204 len: 0 microversion: 2.1 time: 0.117434 Jul 20 05:05:36.594128 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3409/6834] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:05:36 2022] DELETE /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:05:36.603211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e7af5b5-fa38-40a9-b7ad-4d4de4d49e52 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:36.603975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e7af5b5-fa38-40a9-b7ad-4d4de4d49e52 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:36.610319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e7af5b5-fa38-40a9-b7ad-4d4de4d49e52 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:36.610930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e7af5b5-fa38-40a9-b7ad-4d4de4d49e52 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:36.611905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e7af5b5-fa38-40a9-b7ad-4d4de4d49e52 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:36.612456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e7af5b5-fa38-40a9-b7ad-4d4de4d49e52 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:36.747745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e7af5b5-fa38-40a9-b7ad-4d4de4d49e52 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:36.755598 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e7af5b5-fa38-40a9-b7ad-4d4de4d49e52 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1675 microversion: 2.1 time: 0.156844 Jul 20 05:05:36.756275 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3426/6835] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:36 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:37.773597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-265c6a2e-ddd6-4174-9f90-66a7458d0464 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:37.774339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-265c6a2e-ddd6-4174-9f90-66a7458d0464 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:37.781351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-265c6a2e-ddd6-4174-9f90-66a7458d0464 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:37.781818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-265c6a2e-ddd6-4174-9f90-66a7458d0464 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:37.782650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-265c6a2e-ddd6-4174-9f90-66a7458d0464 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:37.783111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-265c6a2e-ddd6-4174-9f90-66a7458d0464 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:37.957165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-265c6a2e-ddd6-4174-9f90-66a7458d0464 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:37.965508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-265c6a2e-ddd6-4174-9f90-66a7458d0464 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1675 microversion: 2.1 time: 0.196211 Jul 20 05:05:37.966111 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3410/6836] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:37 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:38.783353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5ff4eb80-01e2-4477-92e2-305507d7b323 req-8ab6bdea-3832-437a-ad2e-edd14b5290b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da00dba-9ddf-4adb-8a9f-4c701809d181", "name": "network-vif-deleted", "tag": "ecd16a19-475e-4bd8-88e9-de051b471001"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:38.798762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5ff4eb80-01e2-4477-92e2-305507d7b323 req-8ab6bdea-3832-437a-ad2e-edd14b5290b5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:38.799500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5ff4eb80-01e2-4477-92e2-305507d7b323 req-8ab6bdea-3832-437a-ad2e-edd14b5290b5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:38.815511 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5ff4eb80-01e2-4477-92e2-305507d7b323 req-8ab6bdea-3832-437a-ad2e-edd14b5290b5 service nova] Creating event network-vif-deleted:ecd16a19-475e-4bd8-88e9-de051b471001 for instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 on n-h2-760456-11 Jul 20 05:05:38.821611 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5ff4eb80-01e2-4477-92e2-305507d7b323 req-8ab6bdea-3832-437a-ad2e-edd14b5290b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042986 Jul 20 05:05:38.822386 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3427/6837] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:38.982564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:38.983268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:38.986363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:39.000059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:39.000826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:39.002568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:39.004079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:39.047069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:39.047780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:39.048404 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lazy-loading 'fault' on Instance uuid 0da00dba-9ddf-4adb-8a9f-4c701809d181 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:05:39.095848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:39.103666 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-285e1b3a-c132-4255-a3b6-044a6a5352c4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 200 len: 1327 microversion: 2.1 time: 0.125121 Jul 20 05:05:39.113903 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3411/6838] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:38 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 1327 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:40.122717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1b2c944f-084b-4ee4-8671-9d1de5e82379 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:40.123397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1b2c944f-084b-4ee4-8671-9d1de5e82379 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:40.126231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=43 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:40.132534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b2c944f-084b-4ee4-8671-9d1de5e82379 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:40.133004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b2c944f-084b-4ee4-8671-9d1de5e82379 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:40.133797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b2c944f-084b-4ee4-8671-9d1de5e82379 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:40.134279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1b2c944f-084b-4ee4-8671-9d1de5e82379 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:40.155123 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-1b2c944f-084b-4ee4-8671-9d1de5e82379 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1b2c944f-084b-4ee4-8671-9d1de5e82379 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 HTTP/1.1 Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '0da00dba-9ddf-4adb-8a9f-4c701809d181'} Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:05:40.156810 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:05:40.160721 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:05:40.160721 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:05:40.160721 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:05:40.160721 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:05:40.160721 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:05:40.160721 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:05:40.160721 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:05:40.160721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1b2c944f-084b-4ee4-8671-9d1de5e82379 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:05:40.160721 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1b2c944f-084b-4ee4-8671-9d1de5e82379 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 404 len: 111 microversion: 2.1 time: 0.040292 Jul 20 05:05:40.160721 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3428/6839] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:40 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:05:40.175775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66a9380e-5263-40d0-b249-5c59cf0d3948 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:40.176402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-66a9380e-5263-40d0-b249-5c59cf0d3948 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:40.184252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a9380e-5263-40d0-b249-5c59cf0d3948 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:40.184725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a9380e-5263-40d0-b249-5c59cf0d3948 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:40.185497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a9380e-5263-40d0-b249-5c59cf0d3948 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:40.185948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66a9380e-5263-40d0-b249-5c59cf0d3948 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:40.199629 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-66a9380e-5263-40d0-b249-5c59cf0d3948 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66a9380e-5263-40d0-b249-5c59cf0d3948 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 HTTP/1.1 Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '0da00dba-9ddf-4adb-8a9f-4c701809d181'} Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:05:40.201257 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:05:40.204608 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:05:40.204608 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:05:40.204608 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:05:40.204608 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:05:40.204608 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:05:40.204608 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:05:40.204608 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:05:40.204608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66a9380e-5263-40d0-b249-5c59cf0d3948 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:05:40.204608 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-66a9380e-5263-40d0-b249-5c59cf0d3948 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 404 len: 111 microversion: 2.1 time: 0.030789 Jul 20 05:05:40.204608 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3412/6840] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:40 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:05:40.250965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-514096990", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "e66e46ae-4c0a-4cb2-9eef-7f390ec8fc02"}], "security_groups": [{"name": "tempest-securitygroup--1777061867"}], "key_name": "tempest-keypair-949232659", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:40.354360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] validate_networks() for [('e66e46ae-4c0a-4cb2-9eef-7f390ec8fc02', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:05:40.776277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:05:40.776752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:05:40.777241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:05:40.778477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:05:40.778914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:05:40.789370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:40.789863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:40.790709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:40.791160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:40.808268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:05:40.813616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for user e4ea64dbd5d2458aa813ee734342bf4d and project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:05:40.826112 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:05:40.828500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:05:40.875853 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-93baf860-10eb-4326-b638-fd7d89de2188 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.628739 Jul 20 05:05:40.876509 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3429/6841] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:05:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:05:40.887256 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0f101a3d-cdc1-41f0-9725-c637ddbd764f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:40.887893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0f101a3d-cdc1-41f0-9725-c637ddbd764f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:40.947199 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0f101a3d-cdc1-41f0-9725-c637ddbd764f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:40.953809 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0f101a3d-cdc1-41f0-9725-c637ddbd764f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1237 microversion: 2.1 time: 0.070478 Jul 20 05:05:40.954408 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3413/6842] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:40 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:41.973979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-57515bb8-272a-41db-ba00-e0c9dbe23249 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:41.974660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-57515bb8-272a-41db-ba00-e0c9dbe23249 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:41.981942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-57515bb8-272a-41db-ba00-e0c9dbe23249 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:41.982437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-57515bb8-272a-41db-ba00-e0c9dbe23249 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:41.983225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-57515bb8-272a-41db-ba00-e0c9dbe23249 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:41.983700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-57515bb8-272a-41db-ba00-e0c9dbe23249 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:42.052046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-57515bb8-272a-41db-ba00-e0c9dbe23249 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:42.061098 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-57515bb8-272a-41db-ba00-e0c9dbe23249 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1297 microversion: 2.1 time: 0.092124 Jul 20 05:05:42.061935 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3430/6843] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:41 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:43.080914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c51afb7e-98b4-4d98-a97f-81cf2f76e775 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:43.082298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c51afb7e-98b4-4d98-a97f-81cf2f76e775 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:43.089195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c51afb7e-98b4-4d98-a97f-81cf2f76e775 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:43.089634 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c51afb7e-98b4-4d98-a97f-81cf2f76e775 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:43.090451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c51afb7e-98b4-4d98-a97f-81cf2f76e775 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:43.090898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c51afb7e-98b4-4d98-a97f-81cf2f76e775 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:43.295700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c51afb7e-98b4-4d98-a97f-81cf2f76e775 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:43.303731 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c51afb7e-98b4-4d98-a97f-81cf2f76e775 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1363 microversion: 2.1 time: 0.226939 Jul 20 05:05:43.304314 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3414/6844] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:43 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:43.412306 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1ba4dec8-bd1c-4919-b72b-94547b6a34f0 req-36961604-cde7-4767-974c-87763672f745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1", "tag": "0c8ad3fe-361c-4cfa-8ba5-32478036f0ff"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:43.427642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1ba4dec8-bd1c-4919-b72b-94547b6a34f0 req-36961604-cde7-4767-974c-87763672f745 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:43.428405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1ba4dec8-bd1c-4919-b72b-94547b6a34f0 req-36961604-cde7-4767-974c-87763672f745 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:43.453820 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1ba4dec8-bd1c-4919-b72b-94547b6a34f0 req-36961604-cde7-4767-974c-87763672f745 service nova] Creating event network-changed:0c8ad3fe-361c-4cfa-8ba5-32478036f0ff for instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 on n-h1-760456-11 Jul 20 05:05:43.460572 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1ba4dec8-bd1c-4919-b72b-94547b6a34f0 req-36961604-cde7-4767-974c-87763672f745 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054384 Jul 20 05:05:43.461434 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3431/6845] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:44.321377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-22c45db0-8043-4be0-b9bf-a1775237fc9b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:44.322038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22c45db0-8043-4be0-b9bf-a1775237fc9b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:44.329090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22c45db0-8043-4be0-b9bf-a1775237fc9b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:44.329560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22c45db0-8043-4be0-b9bf-a1775237fc9b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:44.330433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22c45db0-8043-4be0-b9bf-a1775237fc9b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:44.330897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22c45db0-8043-4be0-b9bf-a1775237fc9b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:44.459524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-22c45db0-8043-4be0-b9bf-a1775237fc9b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:44.467016 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-22c45db0-8043-4be0-b9bf-a1775237fc9b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1363 microversion: 2.1 time: 0.149883 Jul 20 05:05:44.467589 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3415/6846] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:44 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:45.485519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-139bf1dd-df35-4607-b390-4833a56f37e0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:45.486231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-139bf1dd-df35-4607-b390-4833a56f37e0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:45.494135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-139bf1dd-df35-4607-b390-4833a56f37e0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:45.494630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-139bf1dd-df35-4607-b390-4833a56f37e0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:45.495684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-139bf1dd-df35-4607-b390-4833a56f37e0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:45.496133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-139bf1dd-df35-4607-b390-4833a56f37e0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:45.630187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-139bf1dd-df35-4607-b390-4833a56f37e0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:45.637802 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-139bf1dd-df35-4607-b390-4833a56f37e0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1363 microversion: 2.1 time: 0.156594 Jul 20 05:05:45.638414 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3432/6847] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:45 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:45.838333 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:05:45.838543 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:05:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:05:46.662182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d97e97d4-c146-4c17-a710-69975a8ae739 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:46.663147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d97e97d4-c146-4c17-a710-69975a8ae739 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:46.673931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d97e97d4-c146-4c17-a710-69975a8ae739 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:46.674694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d97e97d4-c146-4c17-a710-69975a8ae739 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:46.675519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d97e97d4-c146-4c17-a710-69975a8ae739 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:46.675983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d97e97d4-c146-4c17-a710-69975a8ae739 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:46.819156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d97e97d4-c146-4c17-a710-69975a8ae739 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:46.826648 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d97e97d4-c146-4c17-a710-69975a8ae739 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1363 microversion: 2.1 time: 0.168588 Jul 20 05:05:46.827229 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3416/6848] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:46 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:47.845016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31886f5a-ec64-412f-86c8-f1599c478a3b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:47.845648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31886f5a-ec64-412f-86c8-f1599c478a3b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:47.852771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31886f5a-ec64-412f-86c8-f1599c478a3b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:47.853239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31886f5a-ec64-412f-86c8-f1599c478a3b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:47.854055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31886f5a-ec64-412f-86c8-f1599c478a3b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:47.854543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31886f5a-ec64-412f-86c8-f1599c478a3b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:47.987273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31886f5a-ec64-412f-86c8-f1599c478a3b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:47.995324 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31886f5a-ec64-412f-86c8-f1599c478a3b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1363 microversion: 2.1 time: 0.154121 Jul 20 05:05:47.995897 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3433/6849] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:47 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:48.794881 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-cf36f0d7-9374-4425-8327-7c138bdd7409 req-dc8afd16-5460-4c4f-9c1c-09a23c2cd75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1", "name": "network-vif-plugged", "status": "completed", "tag": "0c8ad3fe-361c-4cfa-8ba5-32478036f0ff"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:48.805079 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cf36f0d7-9374-4425-8327-7c138bdd7409 req-dc8afd16-5460-4c4f-9c1c-09a23c2cd75e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:48.805544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-cf36f0d7-9374-4425-8327-7c138bdd7409 req-dc8afd16-5460-4c4f-9c1c-09a23c2cd75e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:48.818754 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-cf36f0d7-9374-4425-8327-7c138bdd7409 req-dc8afd16-5460-4c4f-9c1c-09a23c2cd75e service nova] Creating event network-vif-plugged:0c8ad3fe-361c-4cfa-8ba5-32478036f0ff for instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 on n-h1-760456-11 Jul 20 05:05:48.823735 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-cf36f0d7-9374-4425-8327-7c138bdd7409 req-dc8afd16-5460-4c4f-9c1c-09a23c2cd75e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032724 Jul 20 05:05:48.824346 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3417/6850] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:49.012835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f487c93c-ab8e-4d48-9e56-340abbb44c72 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:49.013466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f487c93c-ab8e-4d48-9e56-340abbb44c72 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:49.020461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f487c93c-ab8e-4d48-9e56-340abbb44c72 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:49.021447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f487c93c-ab8e-4d48-9e56-340abbb44c72 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:49.022232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f487c93c-ab8e-4d48-9e56-340abbb44c72 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:49.022708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f487c93c-ab8e-4d48-9e56-340abbb44c72 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:49.158292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f487c93c-ab8e-4d48-9e56-340abbb44c72 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:49.166897 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f487c93c-ab8e-4d48-9e56-340abbb44c72 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1363 microversion: 2.1 time: 0.158061 Jul 20 05:05:49.167640 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3434/6851] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:49 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:50.185194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80bbe32e-7aea-4b38-8347-83f1f5d994c7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:50.185914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-80bbe32e-7aea-4b38-8347-83f1f5d994c7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:50.193513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80bbe32e-7aea-4b38-8347-83f1f5d994c7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:50.194026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80bbe32e-7aea-4b38-8347-83f1f5d994c7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:50.194838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80bbe32e-7aea-4b38-8347-83f1f5d994c7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:50.195294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80bbe32e-7aea-4b38-8347-83f1f5d994c7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:50.326305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-80bbe32e-7aea-4b38-8347-83f1f5d994c7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:05:50.333743 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-80bbe32e-7aea-4b38-8347-83f1f5d994c7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1550 microversion: 2.1 time: 0.152835 Jul 20 05:05:50.334334 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3418/6852] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:05:50 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:05:50.350888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8541351-9d8e-4afe-958e-b93f309f91bf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:05:50.351402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f8541351-9d8e-4afe-958e-b93f309f91bf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:05:50.358506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8541351-9d8e-4afe-958e-b93f309f91bf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:50.358974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8541351-9d8e-4afe-958e-b93f309f91bf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:50.359759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8541351-9d8e-4afe-958e-b93f309f91bf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:50.360215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8541351-9d8e-4afe-958e-b93f309f91bf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:50.439241 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f8541351-9d8e-4afe-958e-b93f309f91bf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092804 Jul 20 05:05:50.439876 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3435/6853] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 05:05:50 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:05:51.365373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2a86e438-3c31-4810-a70d-dbfb9db6aa51 req-92ff5cc0-e16d-4d1a-96ad-6d3b051cc6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1", "tag": "0c8ad3fe-361c-4cfa-8ba5-32478036f0ff"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:05:51.369013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:05:51.376182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2a86e438-3c31-4810-a70d-dbfb9db6aa51 req-92ff5cc0-e16d-4d1a-96ad-6d3b051cc6f3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:05:51.376648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2a86e438-3c31-4810-a70d-dbfb9db6aa51 req-92ff5cc0-e16d-4d1a-96ad-6d3b051cc6f3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:05:51.388012 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2a86e438-3c31-4810-a70d-dbfb9db6aa51 req-92ff5cc0-e16d-4d1a-96ad-6d3b051cc6f3 service nova] Creating event network-changed:0c8ad3fe-361c-4cfa-8ba5-32478036f0ff for instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 on n-h1-760456-11 Jul 20 05:05:51.393037 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2a86e438-3c31-4810-a70d-dbfb9db6aa51 req-92ff5cc0-e16d-4d1a-96ad-6d3b051cc6f3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031674 Jul 20 05:05:51.393704 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3419/6854] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:27.413791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:27.414611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:27.417692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:27.418470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:27.422772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:27.423754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:27.433074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:27.433563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:27.434531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:27.435015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:27.468952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:27.477353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Old instance type m1.heat2, new instance type m1.heat {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:06:27.484987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:06:27.485423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:06:27.485914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:06:27.486362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:06:27.486791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:06:27.550803 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-63934649-19e4-496c-8614-697b2504ba0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1/action" status: 202 len: 0 microversion: 2.1 time: 0.137591 Jul 20 05:06:27.551423 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3436/6855] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:06:27 2022] POST /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:06:27.558172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=21 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:27.559021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:27.563647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-01e1c7e7-744c-4ac3-ac32-2bf2c72e5b5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:27.564192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-01e1c7e7-744c-4ac3-ac32-2bf2c72e5b5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:27.575426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01e1c7e7-744c-4ac3-ac32-2bf2c72e5b5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:27.575892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01e1c7e7-744c-4ac3-ac32-2bf2c72e5b5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:27.576678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01e1c7e7-744c-4ac3-ac32-2bf2c72e5b5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:27.577188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-01e1c7e7-744c-4ac3-ac32-2bf2c72e5b5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:27.754515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-01e1c7e7-744c-4ac3-ac32-2bf2c72e5b5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:27.762564 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-01e1c7e7-744c-4ac3-ac32-2bf2c72e5b5a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1678 microversion: 2.1 time: 0.206586 Jul 20 05:06:27.763297 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3420/6856] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:27 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:28.782041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-80f37949-1527-4f83-bc60-6f58b6860a8c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:28.782639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-80f37949-1527-4f83-bc60-6f58b6860a8c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:28.788793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80f37949-1527-4f83-bc60-6f58b6860a8c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:28.789261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80f37949-1527-4f83-bc60-6f58b6860a8c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:28.790048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80f37949-1527-4f83-bc60-6f58b6860a8c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:28.790530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80f37949-1527-4f83-bc60-6f58b6860a8c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:28.930987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-80f37949-1527-4f83-bc60-6f58b6860a8c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:28.939134 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-80f37949-1527-4f83-bc60-6f58b6860a8c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1678 microversion: 2.1 time: 0.162005 Jul 20 05:06:28.939867 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3437/6857] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:28 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:29.956863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ee9738f6-a7f5-4a56-b19d-de11a8cfa96c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:29.957525 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ee9738f6-a7f5-4a56-b19d-de11a8cfa96c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:29.965119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee9738f6-a7f5-4a56-b19d-de11a8cfa96c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:29.965589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee9738f6-a7f5-4a56-b19d-de11a8cfa96c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:29.966402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee9738f6-a7f5-4a56-b19d-de11a8cfa96c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:29.966863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee9738f6-a7f5-4a56-b19d-de11a8cfa96c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:30.098117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ee9738f6-a7f5-4a56-b19d-de11a8cfa96c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:30.106402 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ee9738f6-a7f5-4a56-b19d-de11a8cfa96c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.153484 Jul 20 05:06:30.107018 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3421/6858] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:29 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:31.125330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-258f8ebe-1320-43e2-a693-7eb69968efbe tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:31.125957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-258f8ebe-1320-43e2-a693-7eb69968efbe tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:31.132963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-258f8ebe-1320-43e2-a693-7eb69968efbe tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:31.133423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-258f8ebe-1320-43e2-a693-7eb69968efbe tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:31.134198 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-258f8ebe-1320-43e2-a693-7eb69968efbe tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:31.134684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-258f8ebe-1320-43e2-a693-7eb69968efbe tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:31.264592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-258f8ebe-1320-43e2-a693-7eb69968efbe tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:31.272280 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-258f8ebe-1320-43e2-a693-7eb69968efbe tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.151889 Jul 20 05:06:31.272803 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3438/6859] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:31 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:32.290068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0a3da14a-9390-45b5-9ad0-749696930e82 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:32.290717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0a3da14a-9390-45b5-9ad0-749696930e82 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:32.297852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a3da14a-9390-45b5-9ad0-749696930e82 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:32.298353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a3da14a-9390-45b5-9ad0-749696930e82 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:32.299129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a3da14a-9390-45b5-9ad0-749696930e82 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:32.299581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0a3da14a-9390-45b5-9ad0-749696930e82 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:32.432376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0a3da14a-9390-45b5-9ad0-749696930e82 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:32.440522 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0a3da14a-9390-45b5-9ad0-749696930e82 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.154361 Jul 20 05:06:32.441093 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3422/6860] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:32 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:33.459307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f5b07c43-8a6a-4b6c-b076-235aafcbe698 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:33.459943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f5b07c43-8a6a-4b6c-b076-235aafcbe698 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:33.467685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5b07c43-8a6a-4b6c-b076-235aafcbe698 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:33.468167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5b07c43-8a6a-4b6c-b076-235aafcbe698 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:33.468938 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5b07c43-8a6a-4b6c-b076-235aafcbe698 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:33.469394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5b07c43-8a6a-4b6c-b076-235aafcbe698 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:33.605082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f5b07c43-8a6a-4b6c-b076-235aafcbe698 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:33.612763 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f5b07c43-8a6a-4b6c-b076-235aafcbe698 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.157449 Jul 20 05:06:33.613346 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3439/6861] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:33 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:34.630464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1bfc670e-21a8-4e38-96a6-43d564a7222b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:34.631096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1bfc670e-21a8-4e38-96a6-43d564a7222b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:34.638098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1bfc670e-21a8-4e38-96a6-43d564a7222b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:34.638594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1bfc670e-21a8-4e38-96a6-43d564a7222b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:34.639377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1bfc670e-21a8-4e38-96a6-43d564a7222b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:34.639833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1bfc670e-21a8-4e38-96a6-43d564a7222b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:34.772590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1bfc670e-21a8-4e38-96a6-43d564a7222b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:34.780794 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1bfc670e-21a8-4e38-96a6-43d564a7222b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.154350 Jul 20 05:06:34.781375 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3423/6862] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:34 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:35.797528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-77c834d7-4cbb-4b12-9c15-6af937881156 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:35.798146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-77c834d7-4cbb-4b12-9c15-6af937881156 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:35.805146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77c834d7-4cbb-4b12-9c15-6af937881156 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:35.805606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77c834d7-4cbb-4b12-9c15-6af937881156 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:35.806411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77c834d7-4cbb-4b12-9c15-6af937881156 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:35.806866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77c834d7-4cbb-4b12-9c15-6af937881156 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:35.943325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-77c834d7-4cbb-4b12-9c15-6af937881156 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:35.952306 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-77c834d7-4cbb-4b12-9c15-6af937881156 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.158759 Jul 20 05:06:35.952929 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3440/6863] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:35 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:36.970551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-919e0563-235d-4e92-a14b-e65732f5cd8d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:36.971183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-919e0563-235d-4e92-a14b-e65732f5cd8d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:36.978041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-919e0563-235d-4e92-a14b-e65732f5cd8d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:36.978545 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-919e0563-235d-4e92-a14b-e65732f5cd8d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:36.980351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-919e0563-235d-4e92-a14b-e65732f5cd8d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:36.980889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-919e0563-235d-4e92-a14b-e65732f5cd8d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:37.113809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-919e0563-235d-4e92-a14b-e65732f5cd8d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:37.121667 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-919e0563-235d-4e92-a14b-e65732f5cd8d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.155061 Jul 20 05:06:37.122274 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3424/6864] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:36 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:38.138331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-50ab246b-7db5-4ccb-b856-dd683e89bc7b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:38.138900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-50ab246b-7db5-4ccb-b856-dd683e89bc7b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:38.145901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50ab246b-7db5-4ccb-b856-dd683e89bc7b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:38.146395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50ab246b-7db5-4ccb-b856-dd683e89bc7b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:38.147162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50ab246b-7db5-4ccb-b856-dd683e89bc7b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:38.147606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-50ab246b-7db5-4ccb-b856-dd683e89bc7b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:38.283706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-50ab246b-7db5-4ccb-b856-dd683e89bc7b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:38.292431 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-50ab246b-7db5-4ccb-b856-dd683e89bc7b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.157003 Jul 20 05:06:38.293020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3441/6865] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:38 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:39.309667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4f64b1fe-5553-4ef7-8b7e-b7805ec08fbc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:39.310203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4f64b1fe-5553-4ef7-8b7e-b7805ec08fbc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:39.317305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f64b1fe-5553-4ef7-8b7e-b7805ec08fbc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:39.317766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f64b1fe-5553-4ef7-8b7e-b7805ec08fbc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:39.318574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f64b1fe-5553-4ef7-8b7e-b7805ec08fbc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:39.319026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f64b1fe-5553-4ef7-8b7e-b7805ec08fbc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:39.452905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4f64b1fe-5553-4ef7-8b7e-b7805ec08fbc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:39.460508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4f64b1fe-5553-4ef7-8b7e-b7805ec08fbc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.155480 Jul 20 05:06:39.461142 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3425/6866] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:39 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:40.477232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0d9bb336-af48-4bbc-82e1-827e2166cb58 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:40.477885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0d9bb336-af48-4bbc-82e1-827e2166cb58 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:40.485558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d9bb336-af48-4bbc-82e1-827e2166cb58 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:40.486073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d9bb336-af48-4bbc-82e1-827e2166cb58 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:40.486921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d9bb336-af48-4bbc-82e1-827e2166cb58 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:40.487390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0d9bb336-af48-4bbc-82e1-827e2166cb58 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:40.617415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0d9bb336-af48-4bbc-82e1-827e2166cb58 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:40.626156 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0d9bb336-af48-4bbc-82e1-827e2166cb58 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.152889 Jul 20 05:06:40.626783 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3442/6867] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:40 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:41.643630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1a9fb44f-6ade-4b2f-9cd1-eacfa85402b9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:41.644154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1a9fb44f-6ade-4b2f-9cd1-eacfa85402b9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:41.651060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a9fb44f-6ade-4b2f-9cd1-eacfa85402b9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:41.652260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a9fb44f-6ade-4b2f-9cd1-eacfa85402b9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:41.653057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a9fb44f-6ade-4b2f-9cd1-eacfa85402b9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:41.653503 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1a9fb44f-6ade-4b2f-9cd1-eacfa85402b9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:42.086241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1a9fb44f-6ade-4b2f-9cd1-eacfa85402b9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:42.094305 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1a9fb44f-6ade-4b2f-9cd1-eacfa85402b9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.454674 Jul 20 05:06:42.094887 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3426/6868] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:41 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:43.112337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6cb27dd0-9b7e-4b71-ba8d-3f9ab722135f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:43.112966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6cb27dd0-9b7e-4b71-ba8d-3f9ab722135f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:43.119409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cb27dd0-9b7e-4b71-ba8d-3f9ab722135f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:43.119872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cb27dd0-9b7e-4b71-ba8d-3f9ab722135f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:43.121452 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cb27dd0-9b7e-4b71-ba8d-3f9ab722135f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:43.121986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6cb27dd0-9b7e-4b71-ba8d-3f9ab722135f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:43.254933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6cb27dd0-9b7e-4b71-ba8d-3f9ab722135f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:43.263545 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6cb27dd0-9b7e-4b71-ba8d-3f9ab722135f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.155550 Jul 20 05:06:43.264122 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3443/6869] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:43 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:44.282402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4b8b8998-6cf0-43d9-8bf1-8ea9ceaee8e9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:44.283121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4b8b8998-6cf0-43d9-8bf1-8ea9ceaee8e9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:44.290270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b8b8998-6cf0-43d9-8bf1-8ea9ceaee8e9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:44.290757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b8b8998-6cf0-43d9-8bf1-8ea9ceaee8e9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:44.291549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b8b8998-6cf0-43d9-8bf1-8ea9ceaee8e9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:44.293122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b8b8998-6cf0-43d9-8bf1-8ea9ceaee8e9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:44.432877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4b8b8998-6cf0-43d9-8bf1-8ea9ceaee8e9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:44.441176 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4b8b8998-6cf0-43d9-8bf1-8ea9ceaee8e9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.163215 Jul 20 05:06:44.441765 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3427/6870] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:44 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:45.458724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c82ce2a6-43d1-4165-9569-d98d18c3b8a7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:45.459345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c82ce2a6-43d1-4165-9569-d98d18c3b8a7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:45.466721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c82ce2a6-43d1-4165-9569-d98d18c3b8a7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:45.467174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c82ce2a6-43d1-4165-9569-d98d18c3b8a7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:45.468035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c82ce2a6-43d1-4165-9569-d98d18c3b8a7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:45.468489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c82ce2a6-43d1-4165-9569-d98d18c3b8a7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:45.606466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c82ce2a6-43d1-4165-9569-d98d18c3b8a7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:45.614214 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c82ce2a6-43d1-4165-9569-d98d18c3b8a7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1683 microversion: 2.1 time: 0.159440 Jul 20 05:06:45.614822 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3444/6871] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:45 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:46.632965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-880adaa5-e2d3-4795-83e3-19300b9a3c65 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:46.633685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-880adaa5-e2d3-4795-83e3-19300b9a3c65 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:46.641302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-880adaa5-e2d3-4795-83e3-19300b9a3c65 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:46.641920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-880adaa5-e2d3-4795-83e3-19300b9a3c65 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:46.642702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-880adaa5-e2d3-4795-83e3-19300b9a3c65 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:46.643258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-880adaa5-e2d3-4795-83e3-19300b9a3c65 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:46.863587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-880adaa5-e2d3-4795-83e3-19300b9a3c65 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:46.871565 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-880adaa5-e2d3-4795-83e3-19300b9a3c65 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1682 microversion: 2.1 time: 0.242640 Jul 20 05:06:46.872342 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3428/6872] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:46 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1682 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:47.162453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ab2f8b0c-d4a9-4ee2-9024-dda3aff295fc req-b01bea7e-9593-49a4-9bba-29c06dcd4ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1", "name": "network-vif-unplugged", "status": "completed", "tag": "0c8ad3fe-361c-4cfa-8ba5-32478036f0ff"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:47.173201 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ab2f8b0c-d4a9-4ee2-9024-dda3aff295fc req-b01bea7e-9593-49a4-9bba-29c06dcd4ab0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:47.173723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ab2f8b0c-d4a9-4ee2-9024-dda3aff295fc req-b01bea7e-9593-49a4-9bba-29c06dcd4ab0 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:47.186987 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ab2f8b0c-d4a9-4ee2-9024-dda3aff295fc req-b01bea7e-9593-49a4-9bba-29c06dcd4ab0 service nova] Creating event network-vif-unplugged:0c8ad3fe-361c-4cfa-8ba5-32478036f0ff for instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 on n-h2-760456-11 Jul 20 05:06:47.192952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-ab2f8b0c-d4a9-4ee2-9024-dda3aff295fc req-b01bea7e-9593-49a4-9bba-29c06dcd4ab0 service nova] Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:06:47.205606 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ab2f8b0c-d4a9-4ee2-9024-dda3aff295fc req-b01bea7e-9593-49a4-9bba-29c06dcd4ab0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048008 Jul 20 05:06:47.206236 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3445/6873] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:47.889965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-733133ff-9397-43c6-8a9f-a40f2c3ac3f2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:47.890659 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-733133ff-9397-43c6-8a9f-a40f2c3ac3f2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:47.898514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-733133ff-9397-43c6-8a9f-a40f2c3ac3f2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:47.898997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-733133ff-9397-43c6-8a9f-a40f2c3ac3f2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:47.899800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-733133ff-9397-43c6-8a9f-a40f2c3ac3f2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:47.900262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-733133ff-9397-43c6-8a9f-a40f2c3ac3f2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:48.107227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-733133ff-9397-43c6-8a9f-a40f2c3ac3f2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:48.117074 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-733133ff-9397-43c6-8a9f-a40f2c3ac3f2 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1682 microversion: 2.1 time: 0.231789 Jul 20 05:06:48.117858 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3429/6874] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:47 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1682 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:49.136910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7cb48fe5-9ac9-4941-baba-5a316a46d662 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:49.137615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7cb48fe5-9ac9-4941-baba-5a316a46d662 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:49.145025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7cb48fe5-9ac9-4941-baba-5a316a46d662 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:49.145482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7cb48fe5-9ac9-4941-baba-5a316a46d662 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:49.146260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7cb48fe5-9ac9-4941-baba-5a316a46d662 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:49.146713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7cb48fe5-9ac9-4941-baba-5a316a46d662 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:49.219924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-73a15c32-8e28-413d-9985-169e9f93f23a req-21ff28e6-a85a-4129-85bf-a2e723eb6bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1", "tag": "0c8ad3fe-361c-4cfa-8ba5-32478036f0ff"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:49.228605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-73a15c32-8e28-413d-9985-169e9f93f23a req-21ff28e6-a85a-4129-85bf-a2e723eb6bf5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:49.229057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-73a15c32-8e28-413d-9985-169e9f93f23a req-21ff28e6-a85a-4129-85bf-a2e723eb6bf5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:49.241288 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-73a15c32-8e28-413d-9985-169e9f93f23a req-21ff28e6-a85a-4129-85bf-a2e723eb6bf5 service nova] Creating event network-changed:0c8ad3fe-361c-4cfa-8ba5-32478036f0ff for instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 on n-h2-760456-11 Jul 20 05:06:49.247841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-73a15c32-8e28-413d-9985-169e9f93f23a req-21ff28e6-a85a-4129-85bf-a2e723eb6bf5 service nova] Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:06:49.258743 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-73a15c32-8e28-413d-9985-169e9f93f23a req-21ff28e6-a85a-4129-85bf-a2e723eb6bf5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042439 Jul 20 05:06:49.259387 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3430/6875] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:06:49.283294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7cb48fe5-9ac9-4941-baba-5a316a46d662 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:49.291416 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7cb48fe5-9ac9-4941-baba-5a316a46d662 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1680 microversion: 2.1 time: 0.159430 Jul 20 05:06:49.292554 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3446/6876] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:49 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:50.311784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e1d5a84f-8f4b-40ce-b9b4-120ed95ebcc5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:50.312540 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e1d5a84f-8f4b-40ce-b9b4-120ed95ebcc5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:50.318897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1d5a84f-8f4b-40ce-b9b4-120ed95ebcc5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:50.319314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1d5a84f-8f4b-40ce-b9b4-120ed95ebcc5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:50.320099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1d5a84f-8f4b-40ce-b9b4-120ed95ebcc5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:50.320558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1d5a84f-8f4b-40ce-b9b4-120ed95ebcc5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:50.458607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e1d5a84f-8f4b-40ce-b9b4-120ed95ebcc5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:50.466312 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e1d5a84f-8f4b-40ce-b9b4-120ed95ebcc5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1677 microversion: 2.1 time: 0.160668 Jul 20 05:06:50.466894 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3431/6877] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:50 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:50.482874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:50.483408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:50.490299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:50.490766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:50.491547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:50.492029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:50.532800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:50.533265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:50.534090 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:50.534565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:50.557903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:06:50.563345 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for user e4ea64dbd5d2458aa813ee734342bf4d and project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:06:50.671322 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-859aa751-3c03-488c-bbe1-7cfa17f09b75 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1/action" status: 202 len: 0 microversion: 2.1 time: 0.192195 Jul 20 05:06:50.671956 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3447/6878] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:06:50 2022] POST /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:06:50.680834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-fc6ce851-d99c-4da3-ae86-f9f8593e2ee5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:50.681470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-fc6ce851-d99c-4da3-ae86-f9f8593e2ee5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:50.688543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc6ce851-d99c-4da3-ae86-f9f8593e2ee5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:50.689247 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc6ce851-d99c-4da3-ae86-f9f8593e2ee5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:50.690400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc6ce851-d99c-4da3-ae86-f9f8593e2ee5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:50.690855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-fc6ce851-d99c-4da3-ae86-f9f8593e2ee5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:50.891976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-fc6ce851-d99c-4da3-ae86-f9f8593e2ee5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:50.900582 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-fc6ce851-d99c-4da3-ae86-f9f8593e2ee5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1676 microversion: 2.1 time: 0.224052 Jul 20 05:06:50.901187 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3432/6879] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:50 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:51.920580 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-39984e66-7741-4ce8-8772-9643ae54b000 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:51.921332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-39984e66-7741-4ce8-8772-9643ae54b000 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:51.928665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39984e66-7741-4ce8-8772-9643ae54b000 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:51.929130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39984e66-7741-4ce8-8772-9643ae54b000 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:51.929914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39984e66-7741-4ce8-8772-9643ae54b000 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:51.930398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-39984e66-7741-4ce8-8772-9643ae54b000 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:51.948317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:52.068746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-39984e66-7741-4ce8-8772-9643ae54b000 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:52.076469 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-39984e66-7741-4ce8-8772-9643ae54b000 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1676 microversion: 2.1 time: 0.161832 Jul 20 05:06:52.077048 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3448/6880] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:51 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:53.094024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-935d8d99-61c7-4e13-9fdb-36099a8505fc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:53.094749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-935d8d99-61c7-4e13-9fdb-36099a8505fc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:53.101977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-935d8d99-61c7-4e13-9fdb-36099a8505fc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:53.102537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-935d8d99-61c7-4e13-9fdb-36099a8505fc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:53.103347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-935d8d99-61c7-4e13-9fdb-36099a8505fc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:53.103808 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-935d8d99-61c7-4e13-9fdb-36099a8505fc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:53.242978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-935d8d99-61c7-4e13-9fdb-36099a8505fc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:53.251795 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-935d8d99-61c7-4e13-9fdb-36099a8505fc tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1676 microversion: 2.1 time: 0.161733 Jul 20 05:06:53.261972 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3433/6881] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:53 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:53.346797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a3c87eb2-85d9-4147-953d-d607416e97aa req-f05af8fd-634c-4a10-beb6-6a0d1f9863a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1", "name": "network-vif-plugged", "status": "completed", "tag": "0c8ad3fe-361c-4cfa-8ba5-32478036f0ff"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:53.357247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a3c87eb2-85d9-4147-953d-d607416e97aa req-f05af8fd-634c-4a10-beb6-6a0d1f9863a1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:53.358624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a3c87eb2-85d9-4147-953d-d607416e97aa req-f05af8fd-634c-4a10-beb6-6a0d1f9863a1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:53.380049 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a3c87eb2-85d9-4147-953d-d607416e97aa req-f05af8fd-634c-4a10-beb6-6a0d1f9863a1 service nova] Creating event network-vif-plugged:0c8ad3fe-361c-4cfa-8ba5-32478036f0ff for instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 on n-h1-760456-11 Jul 20 05:06:53.389193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-a3c87eb2-85d9-4147-953d-d607416e97aa req-f05af8fd-634c-4a10-beb6-6a0d1f9863a1 service nova] Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:06:53.401520 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a3c87eb2-85d9-4147-953d-d607416e97aa req-f05af8fd-634c-4a10-beb6-6a0d1f9863a1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058538 Jul 20 05:06:53.402725 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3449/6882] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:06:53.700903 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5bb24ecb-0bc0-4f86-86cb-7d9e3b9a6896 req-04fda7c0-25b3-4f5a-9816-7292c4dbf202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1", "name": "network-vif-unplugged", "status": "completed", "tag": "0c8ad3fe-361c-4cfa-8ba5-32478036f0ff"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:53.709409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5bb24ecb-0bc0-4f86-86cb-7d9e3b9a6896 req-04fda7c0-25b3-4f5a-9816-7292c4dbf202 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:53.709873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5bb24ecb-0bc0-4f86-86cb-7d9e3b9a6896 req-04fda7c0-25b3-4f5a-9816-7292c4dbf202 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:53.722464 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5bb24ecb-0bc0-4f86-86cb-7d9e3b9a6896 req-04fda7c0-25b3-4f5a-9816-7292c4dbf202 service nova] Creating event network-vif-unplugged:0c8ad3fe-361c-4cfa-8ba5-32478036f0ff for instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 on n-h1-760456-11 Jul 20 05:06:53.728081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-5bb24ecb-0bc0-4f86-86cb-7d9e3b9a6896 req-04fda7c0-25b3-4f5a-9816-7292c4dbf202 service nova] Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:06:53.740000 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5bb24ecb-0bc0-4f86-86cb-7d9e3b9a6896 req-04fda7c0-25b3-4f5a-9816-7292c4dbf202 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043613 Jul 20 05:06:53.740610 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3434/6883] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:54.270001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3b9e07e4-99de-4cd2-8bee-0c7b8dac0bbb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:54.270899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3b9e07e4-99de-4cd2-8bee-0c7b8dac0bbb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:54.285970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b9e07e4-99de-4cd2-8bee-0c7b8dac0bbb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:54.286479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b9e07e4-99de-4cd2-8bee-0c7b8dac0bbb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:54.287304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b9e07e4-99de-4cd2-8bee-0c7b8dac0bbb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:54.287816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3b9e07e4-99de-4cd2-8bee-0c7b8dac0bbb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:54.425346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3b9e07e4-99de-4cd2-8bee-0c7b8dac0bbb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:54.433914 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3b9e07e4-99de-4cd2-8bee-0c7b8dac0bbb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1676 microversion: 2.1 time: 0.168397 Jul 20 05:06:54.434535 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3450/6884] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:54 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:55.452153 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7e9e2b0c-cb4b-4565-be52-7fe94cd2b7c1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:55.452877 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7e9e2b0c-cb4b-4565-be52-7fe94cd2b7c1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:55.459258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9e2b0c-cb4b-4565-be52-7fe94cd2b7c1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:55.459734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9e2b0c-cb4b-4565-be52-7fe94cd2b7c1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:55.460519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9e2b0c-cb4b-4565-be52-7fe94cd2b7c1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:55.460976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9e2b0c-cb4b-4565-be52-7fe94cd2b7c1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:55.595810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7e9e2b0c-cb4b-4565-be52-7fe94cd2b7c1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:55.603881 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7e9e2b0c-cb4b-4565-be52-7fe94cd2b7c1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1676 microversion: 2.1 time: 0.156875 Jul 20 05:06:55.605177 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3435/6885] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:55 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:55.760653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-4e3035a6-576b-4edd-a3e9-8e8863bdf486 req-93af44b4-5efe-4f54-ba9b-2ae19c5370e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1", "tag": "0c8ad3fe-361c-4cfa-8ba5-32478036f0ff"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:55.769566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4e3035a6-576b-4edd-a3e9-8e8863bdf486 req-93af44b4-5efe-4f54-ba9b-2ae19c5370e3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:55.770024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-4e3035a6-576b-4edd-a3e9-8e8863bdf486 req-93af44b4-5efe-4f54-ba9b-2ae19c5370e3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:55.782162 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-4e3035a6-576b-4edd-a3e9-8e8863bdf486 req-93af44b4-5efe-4f54-ba9b-2ae19c5370e3 service nova] Creating event network-changed:0c8ad3fe-361c-4cfa-8ba5-32478036f0ff for instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 on n-h1-760456-11 Jul 20 05:06:55.787549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-4e3035a6-576b-4edd-a3e9-8e8863bdf486 req-93af44b4-5efe-4f54-ba9b-2ae19c5370e3 service nova] Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:06:55.798996 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-4e3035a6-576b-4edd-a3e9-8e8863bdf486 req-93af44b4-5efe-4f54-ba9b-2ae19c5370e3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042070 Jul 20 05:06:55.799594 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3451/6886] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:56.622485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c7e2484b-aa00-4b04-9e9d-1b7992250a8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:56.623118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c7e2484b-aa00-4b04-9e9d-1b7992250a8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:56.629848 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7e2484b-aa00-4b04-9e9d-1b7992250a8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:56.630352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7e2484b-aa00-4b04-9e9d-1b7992250a8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:56.631139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7e2484b-aa00-4b04-9e9d-1b7992250a8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:56.631746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c7e2484b-aa00-4b04-9e9d-1b7992250a8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:56.951050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c7e2484b-aa00-4b04-9e9d-1b7992250a8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:56.958976 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c7e2484b-aa00-4b04-9e9d-1b7992250a8e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1669 microversion: 2.1 time: 0.341274 Jul 20 05:06:56.959656 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3436/6887] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:56 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1669 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:56.976429 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5961cacd-e39b-4019-9f24-4602baa7a4df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:56.977136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5961cacd-e39b-4019-9f24-4602baa7a4df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:56.985365 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5961cacd-e39b-4019-9f24-4602baa7a4df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:56.985822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5961cacd-e39b-4019-9f24-4602baa7a4df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:56.986624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5961cacd-e39b-4019-9f24-4602baa7a4df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:56.987072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5961cacd-e39b-4019-9f24-4602baa7a4df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:57.135819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5961cacd-e39b-4019-9f24-4602baa7a4df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:57.144035 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5961cacd-e39b-4019-9f24-4602baa7a4df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1669 microversion: 2.1 time: 0.171781 Jul 20 05:06:57.144700 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3452/6888] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:56 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:57.160802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bab386e8-9c17-433f-8da0-dbd7079419b0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:57.161436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bab386e8-9c17-433f-8da0-dbd7079419b0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:57.168570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab386e8-9c17-433f-8da0-dbd7079419b0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:57.169042 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab386e8-9c17-433f-8da0-dbd7079419b0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:57.169833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab386e8-9c17-433f-8da0-dbd7079419b0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:57.170309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bab386e8-9c17-433f-8da0-dbd7079419b0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:57.174436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=100 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:57.309311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bab386e8-9c17-433f-8da0-dbd7079419b0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:57.317036 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bab386e8-9c17-433f-8da0-dbd7079419b0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1669 microversion: 2.1 time: 0.160249 Jul 20 05:06:57.317613 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3437/6889] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:57 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:57.333211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-51071242-1ef8-4aad-889d-bc0e59f01eaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:57.333733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-51071242-1ef8-4aad-889d-bc0e59f01eaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:57.340371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51071242-1ef8-4aad-889d-bc0e59f01eaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:57.340832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51071242-1ef8-4aad-889d-bc0e59f01eaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:57.341646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51071242-1ef8-4aad-889d-bc0e59f01eaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:57.342103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-51071242-1ef8-4aad-889d-bc0e59f01eaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:57.367507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-51071242-1ef8-4aad-889d-bc0e59f01eaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:06:57.440709 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:57.451591 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-51071242-1ef8-4aad-889d-bc0e59f01eaf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "DELETE /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 204 len: 0 microversion: 2.1 time: 0.121950 Jul 20 05:06:57.452621 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3453/6890] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:06:57 2022] DELETE /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:06:57.461035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0cee9504-924a-4fb6-8621-340d6df59150 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:57.461664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0cee9504-924a-4fb6-8621-340d6df59150 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:57.468664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cee9504-924a-4fb6-8621-340d6df59150 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:57.469130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cee9504-924a-4fb6-8621-340d6df59150 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:57.469915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cee9504-924a-4fb6-8621-340d6df59150 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:57.470397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cee9504-924a-4fb6-8621-340d6df59150 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:57.603470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0cee9504-924a-4fb6-8621-340d6df59150 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:57.611245 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0cee9504-924a-4fb6-8621-340d6df59150 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1675 microversion: 2.1 time: 0.154015 Jul 20 05:06:57.611824 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3438/6891] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:57 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:58.631502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2a350724-1ca4-4548-aa47-b95579df2a71 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:58.632218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2a350724-1ca4-4548-aa47-b95579df2a71 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:58.640075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a350724-1ca4-4548-aa47-b95579df2a71 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:58.640539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a350724-1ca4-4548-aa47-b95579df2a71 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:58.641323 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a350724-1ca4-4548-aa47-b95579df2a71 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:58.641774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a350724-1ca4-4548-aa47-b95579df2a71 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:58.772786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2a350724-1ca4-4548-aa47-b95579df2a71 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:58.781570 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2a350724-1ca4-4548-aa47-b95579df2a71 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1675 microversion: 2.1 time: 0.154292 Jul 20 05:06:58.782390 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3454/6892] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:58 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:59.615629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3abccdeb-cd95-481a-85d2-5bc9fbebc936 req-9efd6c32-f4d8-4aab-af62-cf03a27df30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1", "name": "network-vif-deleted", "tag": "0c8ad3fe-361c-4cfa-8ba5-32478036f0ff"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:59.620752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=39 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:59.636600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3abccdeb-cd95-481a-85d2-5bc9fbebc936 req-9efd6c32-f4d8-4aab-af62-cf03a27df30d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:59.637361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3abccdeb-cd95-481a-85d2-5bc9fbebc936 req-9efd6c32-f4d8-4aab-af62-cf03a27df30d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:59.650107 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3abccdeb-cd95-481a-85d2-5bc9fbebc936 req-9efd6c32-f4d8-4aab-af62-cf03a27df30d service nova] Creating event network-vif-deleted:0c8ad3fe-361c-4cfa-8ba5-32478036f0ff for instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 on n-h1-760456-11 Jul 20 05:06:59.656204 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3abccdeb-cd95-481a-85d2-5bc9fbebc936 req-9efd6c32-f4d8-4aab-af62-cf03a27df30d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044249 Jul 20 05:06:59.657123 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3439/6893] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:59.799431 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:59.800218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:59.808179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:59.808653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:59.809456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:59.809907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:59.843884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:59.844330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:59.844800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lazy-loading 'fault' on Instance uuid 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:06:59.887000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:59.894603 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc570c83-26bd-4892-b46c-cc8b980c3d73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 200 len: 1327 microversion: 2.1 time: 0.099247 Jul 20 05:06:59.895174 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3455/6894] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:59 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:00.914194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2154872-1518-46f6-a4c3-6fd0e9f23a39 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:00.914981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c2154872-1518-46f6-a4c3-6fd0e9f23a39 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:00.922010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2154872-1518-46f6-a4c3-6fd0e9f23a39 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:00.922521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2154872-1518-46f6-a4c3-6fd0e9f23a39 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:00.923340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2154872-1518-46f6-a4c3-6fd0e9f23a39 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:00.923829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2154872-1518-46f6-a4c3-6fd0e9f23a39 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:00.937220 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c2154872-1518-46f6-a4c3-6fd0e9f23a39 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2154872-1518-46f6-a4c3-6fd0e9f23a39 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 HTTP/1.1 Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1'} Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:00.938898 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:07:00.943351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:00.943351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:00.943351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:00.943351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:07:00.943351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:07:00.943351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:07:00.943351 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:07:00.943351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2154872-1518-46f6-a4c3-6fd0e9f23a39 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:07:00.943351 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c2154872-1518-46f6-a4c3-6fd0e9f23a39 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 404 len: 111 microversion: 2.1 time: 0.031534 Jul 20 05:07:00.943351 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3440/6895] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:00 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:07:00.957519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59a3f052-17b7-44af-8320-0df7f3b0363f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:00.958148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-59a3f052-17b7-44af-8320-0df7f3b0363f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:00.960121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:00.969320 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59a3f052-17b7-44af-8320-0df7f3b0363f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:00.969788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59a3f052-17b7-44af-8320-0df7f3b0363f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:00.970614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59a3f052-17b7-44af-8320-0df7f3b0363f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:00.971070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59a3f052-17b7-44af-8320-0df7f3b0363f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:00.985335 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-59a3f052-17b7-44af-8320-0df7f3b0363f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59a3f052-17b7-44af-8320-0df7f3b0363f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 HTTP/1.1 Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1'} Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:00.987048 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:07:00.991385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:00.991385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:00.991385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:00.991385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:07:00.991385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:07:00.991385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:07:00.991385 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:07:00.991385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59a3f052-17b7-44af-8320-0df7f3b0363f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:07:00.991385 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-59a3f052-17b7-44af-8320-0df7f3b0363f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 404 len: 111 microversion: 2.1 time: 0.034873 Jul 20 05:07:00.991385 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3456/6896] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:00 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:07:01.036148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2142431731", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "e66e46ae-4c0a-4cb2-9eef-7f390ec8fc02"}], "security_groups": [{"name": "tempest-securitygroup--1777061867"}], "key_name": "tempest-keypair-949232659", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:01.139605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] validate_networks() for [('e66e46ae-4c0a-4cb2-9eef-7f390ec8fc02', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:07:01.585959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:07:01.586463 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:07:01.586953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:07:01.587378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:07:01.587833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:07:01.600077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:01.600561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:01.601395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:01.601856 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:01.622664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:07:01.628044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for user e4ea64dbd5d2458aa813ee734342bf4d and project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:07:01.641271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:07:01.643598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:07:01.690293 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8116989b-00ea-4d7c-b87e-245efce162f8 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.658125 Jul 20 05:07:01.690946 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3441/6897] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:07:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:07:01.702443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce79213e-9780-4c23-a2f8-cbf822220d26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:01.703082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce79213e-9780-4c23-a2f8-cbf822220d26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:01.760873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce79213e-9780-4c23-a2f8-cbf822220d26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:01.771313 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce79213e-9780-4c23-a2f8-cbf822220d26 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1238 microversion: 2.1 time: 0.074123 Jul 20 05:07:01.781511 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3457/6898] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:01 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:02.790492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bbe765f5-bc8f-4f3c-8d76-352fcdfe63b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:02.791137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bbe765f5-bc8f-4f3c-8d76-352fcdfe63b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:02.801844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbe765f5-bc8f-4f3c-8d76-352fcdfe63b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:02.802347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbe765f5-bc8f-4f3c-8d76-352fcdfe63b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:02.803167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbe765f5-bc8f-4f3c-8d76-352fcdfe63b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:02.803613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bbe765f5-bc8f-4f3c-8d76-352fcdfe63b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:02.898536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bbe765f5-bc8f-4f3c-8d76-352fcdfe63b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:02.907516 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bbe765f5-bc8f-4f3c-8d76-352fcdfe63b4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1296 microversion: 2.1 time: 0.121992 Jul 20 05:07:02.908327 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3442/6899] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:02 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:03.927282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-41388fd2-921d-4b61-99ed-39236dfca019 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:03.928517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-41388fd2-921d-4b61-99ed-39236dfca019 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:03.937630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41388fd2-921d-4b61-99ed-39236dfca019 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:03.938308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41388fd2-921d-4b61-99ed-39236dfca019 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:03.939125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41388fd2-921d-4b61-99ed-39236dfca019 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:03.939584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-41388fd2-921d-4b61-99ed-39236dfca019 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:04.054927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1c0c3ec6-11bb-4398-ad28-87001597ce26 req-12434809-8399-4863-9ef5-569585f64910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb43573d-61ab-4101-a2a7-acb7bf1574e8", "tag": "6c8cdf02-dd0f-4d4c-8144-497307c1d28a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:04.066605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1c0c3ec6-11bb-4398-ad28-87001597ce26 req-12434809-8399-4863-9ef5-569585f64910 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:04.067002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1c0c3ec6-11bb-4398-ad28-87001597ce26 req-12434809-8399-4863-9ef5-569585f64910 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:04.085746 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1c0c3ec6-11bb-4398-ad28-87001597ce26 req-12434809-8399-4863-9ef5-569585f64910 service nova] Creating event network-changed:6c8cdf02-dd0f-4d4c-8144-497307c1d28a for instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 on n-h2-760456-11 Jul 20 05:07:04.097467 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1c0c3ec6-11bb-4398-ad28-87001597ce26 req-12434809-8399-4863-9ef5-569585f64910 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051213 Jul 20 05:07:04.098541 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3443/6900] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:04.101556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-41388fd2-921d-4b61-99ed-39236dfca019 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:04.111854 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-41388fd2-921d-4b61-99ed-39236dfca019 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1364 microversion: 2.1 time: 0.189583 Jul 20 05:07:04.113215 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3458/6901] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:03 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:05.131700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b97d13a3-9dd9-406d-9e86-95f659fcb56d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:05.132423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b97d13a3-9dd9-406d-9e86-95f659fcb56d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:05.138810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b97d13a3-9dd9-406d-9e86-95f659fcb56d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:05.139285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b97d13a3-9dd9-406d-9e86-95f659fcb56d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:05.140070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b97d13a3-9dd9-406d-9e86-95f659fcb56d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:05.140529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b97d13a3-9dd9-406d-9e86-95f659fcb56d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:05.303636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b97d13a3-9dd9-406d-9e86-95f659fcb56d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:05.311223 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b97d13a3-9dd9-406d-9e86-95f659fcb56d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1364 microversion: 2.1 time: 0.184601 Jul 20 05:07:05.311808 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3444/6902] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:05 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:06.329098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6362463c-d857-41da-b809-6e600291fed6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:06.329720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6362463c-d857-41da-b809-6e600291fed6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:06.336822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6362463c-d857-41da-b809-6e600291fed6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:06.337283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6362463c-d857-41da-b809-6e600291fed6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:06.338081 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6362463c-d857-41da-b809-6e600291fed6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:06.338535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6362463c-d857-41da-b809-6e600291fed6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:06.470237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6362463c-d857-41da-b809-6e600291fed6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:06.477853 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6362463c-d857-41da-b809-6e600291fed6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1364 microversion: 2.1 time: 0.152730 Jul 20 05:07:06.478455 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3459/6903] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:06 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:07.497841 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-20aba1d8-45cb-44c5-a483-d1db2cd8f9a9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:07.498513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-20aba1d8-45cb-44c5-a483-d1db2cd8f9a9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:07.505782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20aba1d8-45cb-44c5-a483-d1db2cd8f9a9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:07.506274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20aba1d8-45cb-44c5-a483-d1db2cd8f9a9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:07.507119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20aba1d8-45cb-44c5-a483-d1db2cd8f9a9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:07.507603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20aba1d8-45cb-44c5-a483-d1db2cd8f9a9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:07.646489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-20aba1d8-45cb-44c5-a483-d1db2cd8f9a9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:07.654993 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-20aba1d8-45cb-44c5-a483-d1db2cd8f9a9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1364 microversion: 2.1 time: 0.161913 Jul 20 05:07:07.655585 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3445/6904] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:07 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:08.673342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b9e8acd3-f484-4dc2-99bd-4685d82214fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:08.673941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b9e8acd3-f484-4dc2-99bd-4685d82214fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:08.680988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9e8acd3-f484-4dc2-99bd-4685d82214fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:08.681457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9e8acd3-f484-4dc2-99bd-4685d82214fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:08.682296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9e8acd3-f484-4dc2-99bd-4685d82214fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:08.683575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b9e8acd3-f484-4dc2-99bd-4685d82214fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:08.816984 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b9e8acd3-f484-4dc2-99bd-4685d82214fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:08.824473 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b9e8acd3-f484-4dc2-99bd-4685d82214fa tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1364 microversion: 2.1 time: 0.155171 Jul 20 05:07:08.825055 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3460/6905] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:08 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:09.400954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-b64d6182-767a-4d9b-b1ac-bbae931574ab req-9df4eebc-a28d-479e-aedd-8e8579191609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb43573d-61ab-4101-a2a7-acb7bf1574e8", "name": "network-vif-plugged", "status": "completed", "tag": "6c8cdf02-dd0f-4d4c-8144-497307c1d28a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:09.410899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b64d6182-767a-4d9b-b1ac-bbae931574ab req-9df4eebc-a28d-479e-aedd-8e8579191609 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:09.411370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-b64d6182-767a-4d9b-b1ac-bbae931574ab req-9df4eebc-a28d-479e-aedd-8e8579191609 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:09.424450 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-b64d6182-767a-4d9b-b1ac-bbae931574ab req-9df4eebc-a28d-479e-aedd-8e8579191609 service nova] Creating event network-vif-plugged:6c8cdf02-dd0f-4d4c-8144-497307c1d28a for instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 on n-h2-760456-11 Jul 20 05:07:09.429461 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-b64d6182-767a-4d9b-b1ac-bbae931574ab req-9df4eebc-a28d-479e-aedd-8e8579191609 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032257 Jul 20 05:07:09.430068 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3446/6906] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:09.841477 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-96460cbc-168c-47f5-9f1e-be5b81945481 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:09.842017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-96460cbc-168c-47f5-9f1e-be5b81945481 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:09.849082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96460cbc-168c-47f5-9f1e-be5b81945481 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:09.849545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96460cbc-168c-47f5-9f1e-be5b81945481 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:09.850381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96460cbc-168c-47f5-9f1e-be5b81945481 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:09.850832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-96460cbc-168c-47f5-9f1e-be5b81945481 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:09.981411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-96460cbc-168c-47f5-9f1e-be5b81945481 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:09.989169 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-96460cbc-168c-47f5-9f1e-be5b81945481 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1364 microversion: 2.1 time: 0.152155 Jul 20 05:07:09.989769 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3461/6907] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:09 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:11.008472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6800e921-2ddb-4300-a601-f79b7b9fb10e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:11.009223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6800e921-2ddb-4300-a601-f79b7b9fb10e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:11.016223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6800e921-2ddb-4300-a601-f79b7b9fb10e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.016696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6800e921-2ddb-4300-a601-f79b7b9fb10e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.017487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6800e921-2ddb-4300-a601-f79b7b9fb10e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.017951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6800e921-2ddb-4300-a601-f79b7b9fb10e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.158631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6800e921-2ddb-4300-a601-f79b7b9fb10e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:11.166177 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6800e921-2ddb-4300-a601-f79b7b9fb10e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1550 microversion: 2.1 time: 0.162898 Jul 20 05:07:11.166783 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3447/6908] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:11 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:11.183433 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-40dfd707-4e06-4b18-99b5-dccf44c8d720 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:11.183987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-40dfd707-4e06-4b18-99b5-dccf44c8d720 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:11.190420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40dfd707-4e06-4b18-99b5-dccf44c8d720 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.190879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40dfd707-4e06-4b18-99b5-dccf44c8d720 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.191647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40dfd707-4e06-4b18-99b5-dccf44c8d720 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.192091 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-40dfd707-4e06-4b18-99b5-dccf44c8d720 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.269551 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-40dfd707-4e06-4b18-99b5-dccf44c8d720 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090227 Jul 20 05:07:11.270163 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3462/6909] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 05:07:11 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:12.559014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:12.560315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:12.610509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-3e4c10f1-16ae-47a1-b6e3-59d957ed543f req-dd9a1e9c-58e4-4a51-bd0c-1d769147aa61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb43573d-61ab-4101-a2a7-acb7bf1574e8", "tag": "6c8cdf02-dd0f-4d4c-8144-497307c1d28a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:12.618478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3e4c10f1-16ae-47a1-b6e3-59d957ed543f req-dd9a1e9c-58e4-4a51-bd0c-1d769147aa61 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:12.618940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-3e4c10f1-16ae-47a1-b6e3-59d957ed543f req-dd9a1e9c-58e4-4a51-bd0c-1d769147aa61 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:12.630401 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-3e4c10f1-16ae-47a1-b6e3-59d957ed543f req-dd9a1e9c-58e4-4a51-bd0c-1d769147aa61 service nova] Creating event network-changed:6c8cdf02-dd0f-4d4c-8144-497307c1d28a for instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 on n-h2-760456-11 Jul 20 05:07:12.635602 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-3e4c10f1-16ae-47a1-b6e3-59d957ed543f req-dd9a1e9c-58e4-4a51-bd0c-1d769147aa61 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081210 Jul 20 05:07:12.636191 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3448/6910] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:46.743638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:46.746671 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:46.747313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:46.753067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b18cb844-c618-47ab-9208-f9095a6ddc0d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:46.753683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b18cb844-c618-47ab-9208-f9095a6ddc0d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:46.761963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b18cb844-c618-47ab-9208-f9095a6ddc0d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:46.762469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b18cb844-c618-47ab-9208-f9095a6ddc0d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:46.763259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b18cb844-c618-47ab-9208-f9095a6ddc0d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:46.763702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b18cb844-c618-47ab-9208-f9095a6ddc0d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:46.909372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b18cb844-c618-47ab-9208-f9095a6ddc0d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:46.917181 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b18cb844-c618-47ab-9208-f9095a6ddc0d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1669 microversion: 2.1 time: 0.174170 Jul 20 05:07:46.918491 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3463/6911] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:46 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:46.936085 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3f086736-10c8-4ea9-9dac-67d88f3469eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01aff530-0fa2-41b7-a09f-1640d5ff5504"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:46.937423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3f086736-10c8-4ea9-9dac-67d88f3469eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:46.940401 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:46.941368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=46 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:46.949767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f086736-10c8-4ea9-9dac-67d88f3469eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:46.950276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f086736-10c8-4ea9-9dac-67d88f3469eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:46.951093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f086736-10c8-4ea9-9dac-67d88f3469eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:46.951556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3f086736-10c8-4ea9-9dac-67d88f3469eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:47.218555 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3f086736-10c8-4ea9-9dac-67d88f3469eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287055 Jul 20 05:07:47.219414 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3449/6912] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 05:07:46 2022] POST /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:58.944544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:58.945530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:58.948311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:58.948963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:58.955333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:58.955789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:58.956560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:58.957004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:58.986410 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:58.992224 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Old instance type m1.heat2, new instance type m1.heat {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:07:58.999207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:07:58.999642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:07:59.000136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:07:59.000553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:07:59.001065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:07:59.063831 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b90a2636-496b-413d-8712-6d6feb9ca491 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/action" status: 202 len: 0 microversion: 2.1 time: 0.123082 Jul 20 05:07:59.064555 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3464/6913] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:07:58 2022] POST /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:07:59.071395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:59.072192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:59.077053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-477bb986-cbde-4740-950b-f8ed019d8638 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:59.077821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-477bb986-cbde-4740-950b-f8ed019d8638 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:59.088491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-477bb986-cbde-4740-950b-f8ed019d8638 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:59.088891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-477bb986-cbde-4740-950b-f8ed019d8638 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:59.089686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-477bb986-cbde-4740-950b-f8ed019d8638 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:59.090139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-477bb986-cbde-4740-950b-f8ed019d8638 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:59.256331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-477bb986-cbde-4740-950b-f8ed019d8638 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:59.264799 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-477bb986-cbde-4740-950b-f8ed019d8638 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1724 microversion: 2.1 time: 0.195622 Jul 20 05:07:59.265374 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3450/6914] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:59 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:00.284679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b5eb8e32-2336-4ce9-9871-218ff9e41fdd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:00.285300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b5eb8e32-2336-4ce9-9871-218ff9e41fdd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:00.291513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5eb8e32-2336-4ce9-9871-218ff9e41fdd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:00.292101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5eb8e32-2336-4ce9-9871-218ff9e41fdd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:00.292764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5eb8e32-2336-4ce9-9871-218ff9e41fdd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:00.293207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b5eb8e32-2336-4ce9-9871-218ff9e41fdd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:00.434689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b5eb8e32-2336-4ce9-9871-218ff9e41fdd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:00.444140 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b5eb8e32-2336-4ce9-9871-218ff9e41fdd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1724 microversion: 2.1 time: 0.164393 Jul 20 05:08:00.444756 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3465/6915] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:00 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:01.462234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c2d50df5-f703-4821-a26c-58f870b395eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:01.462897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c2d50df5-f703-4821-a26c-58f870b395eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:01.470509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2d50df5-f703-4821-a26c-58f870b395eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:01.471007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2d50df5-f703-4821-a26c-58f870b395eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:01.471784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2d50df5-f703-4821-a26c-58f870b395eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:01.472252 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c2d50df5-f703-4821-a26c-58f870b395eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:01.603988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c2d50df5-f703-4821-a26c-58f870b395eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:01.612560 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c2d50df5-f703-4821-a26c-58f870b395eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.154293 Jul 20 05:08:01.613136 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3451/6916] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:01 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:02.630415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fe9a2396-5c0a-4baa-bc69-6b4a648b2493 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:02.631110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fe9a2396-5c0a-4baa-bc69-6b4a648b2493 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:02.638582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe9a2396-5c0a-4baa-bc69-6b4a648b2493 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.639076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe9a2396-5c0a-4baa-bc69-6b4a648b2493 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.639861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe9a2396-5c0a-4baa-bc69-6b4a648b2493 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.640311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fe9a2396-5c0a-4baa-bc69-6b4a648b2493 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.773983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fe9a2396-5c0a-4baa-bc69-6b4a648b2493 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:02.782722 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fe9a2396-5c0a-4baa-bc69-6b4a648b2493 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.156209 Jul 20 05:08:02.783297 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3466/6917] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:02 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:03.800422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7329e295-fe64-4a91-a5ad-130a06980f73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:03.801058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7329e295-fe64-4a91-a5ad-130a06980f73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:03.808089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7329e295-fe64-4a91-a5ad-130a06980f73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:03.808564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7329e295-fe64-4a91-a5ad-130a06980f73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:03.809354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7329e295-fe64-4a91-a5ad-130a06980f73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:03.809814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7329e295-fe64-4a91-a5ad-130a06980f73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:03.946417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7329e295-fe64-4a91-a5ad-130a06980f73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:03.955646 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7329e295-fe64-4a91-a5ad-130a06980f73 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.159724 Jul 20 05:08:03.956236 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3452/6918] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:03 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:04.973742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7f8333da-2e73-45e3-b239-16a76c3a9b86 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:04.974399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7f8333da-2e73-45e3-b239-16a76c3a9b86 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:04.982239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f8333da-2e73-45e3-b239-16a76c3a9b86 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:04.982760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f8333da-2e73-45e3-b239-16a76c3a9b86 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:04.983543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f8333da-2e73-45e3-b239-16a76c3a9b86 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:04.983994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f8333da-2e73-45e3-b239-16a76c3a9b86 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:05.128670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7f8333da-2e73-45e3-b239-16a76c3a9b86 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:05.136769 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7f8333da-2e73-45e3-b239-16a76c3a9b86 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.167450 Jul 20 05:08:05.137348 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3467/6919] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:04 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:06.153358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-24595abf-6a30-48f2-9d94-b973ca16d6b7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:06.153999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-24595abf-6a30-48f2-9d94-b973ca16d6b7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:06.161018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24595abf-6a30-48f2-9d94-b973ca16d6b7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:06.161499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24595abf-6a30-48f2-9d94-b973ca16d6b7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:06.162319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24595abf-6a30-48f2-9d94-b973ca16d6b7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:06.162774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-24595abf-6a30-48f2-9d94-b973ca16d6b7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:06.292732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-24595abf-6a30-48f2-9d94-b973ca16d6b7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:06.301560 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-24595abf-6a30-48f2-9d94-b973ca16d6b7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.152122 Jul 20 05:08:06.302128 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3453/6920] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:06 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:07.319352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f5738a88-d7c2-4854-b0dc-dc03f4b446d5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:07.319947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f5738a88-d7c2-4854-b0dc-dc03f4b446d5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:07.326856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5738a88-d7c2-4854-b0dc-dc03f4b446d5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:07.327312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5738a88-d7c2-4854-b0dc-dc03f4b446d5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:07.328083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5738a88-d7c2-4854-b0dc-dc03f4b446d5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:07.328527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5738a88-d7c2-4854-b0dc-dc03f4b446d5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:07.459164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f5738a88-d7c2-4854-b0dc-dc03f4b446d5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:07.467231 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f5738a88-d7c2-4854-b0dc-dc03f4b446d5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.152107 Jul 20 05:08:07.467806 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3468/6921] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:07 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:08.485031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8581fd51-1c80-4d44-9893-bcf72b66776d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:08.486161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8581fd51-1c80-4d44-9893-bcf72b66776d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:08.493098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8581fd51-1c80-4d44-9893-bcf72b66776d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:08.493564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8581fd51-1c80-4d44-9893-bcf72b66776d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:08.494372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8581fd51-1c80-4d44-9893-bcf72b66776d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:08.494832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8581fd51-1c80-4d44-9893-bcf72b66776d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:08.627508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8581fd51-1c80-4d44-9893-bcf72b66776d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:08.635648 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8581fd51-1c80-4d44-9893-bcf72b66776d tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.154541 Jul 20 05:08:08.636221 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3454/6922] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:08 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:09.702374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0b0f0133-50cd-4b8c-84ef-e4c9e2da7864 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:09.702999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0b0f0133-50cd-4b8c-84ef-e4c9e2da7864 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:09.710300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b0f0133-50cd-4b8c-84ef-e4c9e2da7864 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.710765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b0f0133-50cd-4b8c-84ef-e4c9e2da7864 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.711558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b0f0133-50cd-4b8c-84ef-e4c9e2da7864 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.711987 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0b0f0133-50cd-4b8c-84ef-e4c9e2da7864 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.849661 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0b0f0133-50cd-4b8c-84ef-e4c9e2da7864 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:09.857775 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0b0f0133-50cd-4b8c-84ef-e4c9e2da7864 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.208606 Jul 20 05:08:09.858384 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3469/6923] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:09 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:10.875613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cdf63117-df40-45d6-9ed8-85059c01bb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:10.876316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cdf63117-df40-45d6-9ed8-85059c01bb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:10.883403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf63117-df40-45d6-9ed8-85059c01bb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:10.883766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf63117-df40-45d6-9ed8-85059c01bb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:10.884548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf63117-df40-45d6-9ed8-85059c01bb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:10.885004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cdf63117-df40-45d6-9ed8-85059c01bb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:11.019449 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cdf63117-df40-45d6-9ed8-85059c01bb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:11.027424 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cdf63117-df40-45d6-9ed8-85059c01bb1e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.155713 Jul 20 05:08:11.027994 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3455/6924] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:10 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:12.045244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-347fe25a-41a3-4708-89f4-19b7381a2d34 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:12.045862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-347fe25a-41a3-4708-89f4-19b7381a2d34 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:12.052793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-347fe25a-41a3-4708-89f4-19b7381a2d34 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:12.053256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-347fe25a-41a3-4708-89f4-19b7381a2d34 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:12.054025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-347fe25a-41a3-4708-89f4-19b7381a2d34 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:12.054492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-347fe25a-41a3-4708-89f4-19b7381a2d34 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:12.184111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-347fe25a-41a3-4708-89f4-19b7381a2d34 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:12.192341 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-347fe25a-41a3-4708-89f4-19b7381a2d34 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.151237 Jul 20 05:08:12.192923 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3470/6925] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:12 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:13.209036 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-29bb4456-8584-41a5-bee1-375bcd46529c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:13.209669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-29bb4456-8584-41a5-bee1-375bcd46529c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:13.216402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29bb4456-8584-41a5-bee1-375bcd46529c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:13.216869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29bb4456-8584-41a5-bee1-375bcd46529c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:13.217653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29bb4456-8584-41a5-bee1-375bcd46529c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:13.218108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-29bb4456-8584-41a5-bee1-375bcd46529c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:13.348129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-29bb4456-8584-41a5-bee1-375bcd46529c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:13.356119 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-29bb4456-8584-41a5-bee1-375bcd46529c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.151157 Jul 20 05:08:13.356709 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3456/6926] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:13 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:14.374779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1dc2b070-09e3-4e2f-8cbd-c738bdb641ed tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:14.375332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1dc2b070-09e3-4e2f-8cbd-c738bdb641ed tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:14.382934 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc2b070-09e3-4e2f-8cbd-c738bdb641ed tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.383402 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc2b070-09e3-4e2f-8cbd-c738bdb641ed tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.384183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc2b070-09e3-4e2f-8cbd-c738bdb641ed tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:14.384637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1dc2b070-09e3-4e2f-8cbd-c738bdb641ed tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:14.515165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1dc2b070-09e3-4e2f-8cbd-c738bdb641ed tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:14.523363 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1dc2b070-09e3-4e2f-8cbd-c738bdb641ed tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.152664 Jul 20 05:08:14.523937 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3471/6927] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:14 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:15.540705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6e507361-045a-46bc-ac2f-22bbe8a91b87 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:15.541342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6e507361-045a-46bc-ac2f-22bbe8a91b87 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:15.548562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e507361-045a-46bc-ac2f-22bbe8a91b87 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:15.549204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e507361-045a-46bc-ac2f-22bbe8a91b87 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:15.550004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e507361-045a-46bc-ac2f-22bbe8a91b87 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:15.550495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6e507361-045a-46bc-ac2f-22bbe8a91b87 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:15.687935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6e507361-045a-46bc-ac2f-22bbe8a91b87 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:15.696581 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6e507361-045a-46bc-ac2f-22bbe8a91b87 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.159913 Jul 20 05:08:15.697154 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3457/6928] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:15 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:16.715305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-63b43167-1f14-4625-83da-5758db8ba9df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:16.715905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-63b43167-1f14-4625-83da-5758db8ba9df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:16.723867 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b43167-1f14-4625-83da-5758db8ba9df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:16.724322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b43167-1f14-4625-83da-5758db8ba9df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:16.725095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b43167-1f14-4625-83da-5758db8ba9df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:16.725537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-63b43167-1f14-4625-83da-5758db8ba9df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:16.863748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-63b43167-1f14-4625-83da-5758db8ba9df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:16.871910 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-63b43167-1f14-4625-83da-5758db8ba9df tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.160638 Jul 20 05:08:16.872481 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3472/6929] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:16 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:17.889495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-66501968-4b9e-46c1-b05a-44b9c33d1f12 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:17.890827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-66501968-4b9e-46c1-b05a-44b9c33d1f12 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:17.900111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66501968-4b9e-46c1-b05a-44b9c33d1f12 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:17.900592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66501968-4b9e-46c1-b05a-44b9c33d1f12 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:17.901387 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66501968-4b9e-46c1-b05a-44b9c33d1f12 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:17.901850 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-66501968-4b9e-46c1-b05a-44b9c33d1f12 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:18.042208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-66501968-4b9e-46c1-b05a-44b9c33d1f12 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:18.051579 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-66501968-4b9e-46c1-b05a-44b9c33d1f12 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.166506 Jul 20 05:08:18.052194 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3458/6930] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:17 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:19.069314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-14667c25-0f61-4b32-b552-c11b9e24a25c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:19.069843 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-14667c25-0f61-4b32-b552-c11b9e24a25c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:19.076981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14667c25-0f61-4b32-b552-c11b9e24a25c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:19.077440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14667c25-0f61-4b32-b552-c11b9e24a25c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:19.078240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14667c25-0f61-4b32-b552-c11b9e24a25c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:19.078787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14667c25-0f61-4b32-b552-c11b9e24a25c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:19.214465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-14667c25-0f61-4b32-b552-c11b9e24a25c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:19.223766 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-14667c25-0f61-4b32-b552-c11b9e24a25c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1729 microversion: 2.1 time: 0.158530 Jul 20 05:08:19.224349 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3473/6931] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:19 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:20.241866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a3c18f3e-b4bf-4545-8e7d-0e286a5d5c00 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:20.242613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a3c18f3e-b4bf-4545-8e7d-0e286a5d5c00 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:20.249781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3c18f3e-b4bf-4545-8e7d-0e286a5d5c00 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:20.250436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3c18f3e-b4bf-4545-8e7d-0e286a5d5c00 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:20.251334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3c18f3e-b4bf-4545-8e7d-0e286a5d5c00 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:20.251869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a3c18f3e-b4bf-4545-8e7d-0e286a5d5c00 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:20.319216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-de0190f8-5e0c-4a47-a33c-2a474d4513d0 req-0ff977f9-e242-4f9d-a8fc-608a568f41f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb43573d-61ab-4101-a2a7-acb7bf1574e8", "name": "network-vif-unplugged", "status": "completed", "tag": "6c8cdf02-dd0f-4d4c-8144-497307c1d28a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:20.330367 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-de0190f8-5e0c-4a47-a33c-2a474d4513d0 req-0ff977f9-e242-4f9d-a8fc-608a568f41f4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:20.331249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-de0190f8-5e0c-4a47-a33c-2a474d4513d0 req-0ff977f9-e242-4f9d-a8fc-608a568f41f4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:20.344984 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-de0190f8-5e0c-4a47-a33c-2a474d4513d0 req-0ff977f9-e242-4f9d-a8fc-608a568f41f4 service nova] Creating event network-vif-unplugged:6c8cdf02-dd0f-4d4c-8144-497307c1d28a for instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 on n-h1-760456-11 Jul 20 05:08:20.352969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-de0190f8-5e0c-4a47-a33c-2a474d4513d0 req-0ff977f9-e242-4f9d-a8fc-608a568f41f4 service nova] Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:08:20.366832 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-de0190f8-5e0c-4a47-a33c-2a474d4513d0 req-0ff977f9-e242-4f9d-a8fc-608a568f41f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051881 Jul 20 05:08:20.367808 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3474/6932] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:20.739526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a3c18f3e-b4bf-4545-8e7d-0e286a5d5c00 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:20.747973 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a3c18f3e-b4bf-4545-8e7d-0e286a5d5c00 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1728 microversion: 2.1 time: 0.510182 Jul 20 05:08:20.748554 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3459/6933] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:20 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1728 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:21.767875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cb97b5ef-a57b-4c36-822d-c7842d66113f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:21.769397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cb97b5ef-a57b-4c36-822d-c7842d66113f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:21.776292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb97b5ef-a57b-4c36-822d-c7842d66113f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:21.776766 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb97b5ef-a57b-4c36-822d-c7842d66113f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:21.777557 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb97b5ef-a57b-4c36-822d-c7842d66113f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:21.778177 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb97b5ef-a57b-4c36-822d-c7842d66113f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:21.917056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cb97b5ef-a57b-4c36-822d-c7842d66113f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:21.926157 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cb97b5ef-a57b-4c36-822d-c7842d66113f tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.163518 Jul 20 05:08:21.926774 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3475/6934] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:21 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:22.387956 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-1a5d0050-5a77-437d-8ae5-a44da9312846 req-0a6f60dc-1f13-437c-9913-be55ca83e476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb43573d-61ab-4101-a2a7-acb7bf1574e8", "tag": "6c8cdf02-dd0f-4d4c-8144-497307c1d28a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:22.397708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1a5d0050-5a77-437d-8ae5-a44da9312846 req-0a6f60dc-1f13-437c-9913-be55ca83e476 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:22.398174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-1a5d0050-5a77-437d-8ae5-a44da9312846 req-0a6f60dc-1f13-437c-9913-be55ca83e476 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:22.410928 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-1a5d0050-5a77-437d-8ae5-a44da9312846 req-0a6f60dc-1f13-437c-9913-be55ca83e476 service nova] Creating event network-changed:6c8cdf02-dd0f-4d4c-8144-497307c1d28a for instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 on n-h1-760456-11 Jul 20 05:08:22.416390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-1a5d0050-5a77-437d-8ae5-a44da9312846 req-0a6f60dc-1f13-437c-9913-be55ca83e476 service nova] Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:08:22.428694 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-1a5d0050-5a77-437d-8ae5-a44da9312846 req-0a6f60dc-1f13-437c-9913-be55ca83e476 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044413 Jul 20 05:08:22.429421 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3460/6935] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:22.944687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4d9edd4a-2235-4641-9abf-82504ef7ddb1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:22.945479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4d9edd4a-2235-4641-9abf-82504ef7ddb1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:22.952990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d9edd4a-2235-4641-9abf-82504ef7ddb1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:22.953604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d9edd4a-2235-4641-9abf-82504ef7ddb1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:22.954850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d9edd4a-2235-4641-9abf-82504ef7ddb1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:22.955425 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4d9edd4a-2235-4641-9abf-82504ef7ddb1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:23.109397 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4d9edd4a-2235-4641-9abf-82504ef7ddb1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:23.119607 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4d9edd4a-2235-4641-9abf-82504ef7ddb1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.178829 Jul 20 05:08:23.120689 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3476/6936] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:22 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:24.139593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5d51a9a4-6071-4ac7-9840-d8da19ec302a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:24.140322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5d51a9a4-6071-4ac7-9840-d8da19ec302a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:24.148267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d51a9a4-6071-4ac7-9840-d8da19ec302a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:24.148743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d51a9a4-6071-4ac7-9840-d8da19ec302a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:24.149577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d51a9a4-6071-4ac7-9840-d8da19ec302a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:24.150040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5d51a9a4-6071-4ac7-9840-d8da19ec302a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:24.600172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5d51a9a4-6071-4ac7-9840-d8da19ec302a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:24.608659 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5d51a9a4-6071-4ac7-9840-d8da19ec302a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.474221 Jul 20 05:08:24.609267 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3461/6937] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:24 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:25.627415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d62330ae-87a5-4713-adca-cb06358cd729 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:25.628674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d62330ae-87a5-4713-adca-cb06358cd729 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:25.635811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d62330ae-87a5-4713-adca-cb06358cd729 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:25.636274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d62330ae-87a5-4713-adca-cb06358cd729 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:25.637058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d62330ae-87a5-4713-adca-cb06358cd729 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:25.637511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d62330ae-87a5-4713-adca-cb06358cd729 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:25.772519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d62330ae-87a5-4713-adca-cb06358cd729 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:25.780545 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d62330ae-87a5-4713-adca-cb06358cd729 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.157644 Jul 20 05:08:25.781125 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3477/6938] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:25 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:26.798358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c08b3ef3-4df3-4fc6-869c-6b11cd516507 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:26.798996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c08b3ef3-4df3-4fc6-869c-6b11cd516507 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:26.806386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c08b3ef3-4df3-4fc6-869c-6b11cd516507 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:26.806860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c08b3ef3-4df3-4fc6-869c-6b11cd516507 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:26.807652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c08b3ef3-4df3-4fc6-869c-6b11cd516507 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:26.808108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c08b3ef3-4df3-4fc6-869c-6b11cd516507 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:26.936888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c08b3ef3-4df3-4fc6-869c-6b11cd516507 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:26.945951 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c08b3ef3-4df3-4fc6-869c-6b11cd516507 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.151713 Jul 20 05:08:26.946551 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3462/6939] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:26 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:27.964096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e4577546-b0f5-4b6a-b979-30c81672c061 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:27.964720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e4577546-b0f5-4b6a-b979-30c81672c061 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:27.972340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4577546-b0f5-4b6a-b979-30c81672c061 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:27.972796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4577546-b0f5-4b6a-b979-30c81672c061 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:27.973562 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4577546-b0f5-4b6a-b979-30c81672c061 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:27.974006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4577546-b0f5-4b6a-b979-30c81672c061 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.107739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e4577546-b0f5-4b6a-b979-30c81672c061 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:28.116786 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e4577546-b0f5-4b6a-b979-30c81672c061 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.156700 Jul 20 05:08:28.117372 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3478/6940] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:27 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:29.134967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bc03f4fa-5f55-4109-8071-19b1d17f22dd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:29.135617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bc03f4fa-5f55-4109-8071-19b1d17f22dd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:29.138413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=27 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:29.144875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc03f4fa-5f55-4109-8071-19b1d17f22dd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.145349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc03f4fa-5f55-4109-8071-19b1d17f22dd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.146145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc03f4fa-5f55-4109-8071-19b1d17f22dd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.146644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bc03f4fa-5f55-4109-8071-19b1d17f22dd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.150812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=77 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:29.277946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bc03f4fa-5f55-4109-8071-19b1d17f22dd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:29.286779 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bc03f4fa-5f55-4109-8071-19b1d17f22dd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.155745 Jul 20 05:08:29.287362 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3463/6941] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:29 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:30.304579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d1cb419c-5de0-4832-9048-634df37db6eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:30.305208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d1cb419c-5de0-4832-9048-634df37db6eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:30.308094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=35 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:30.314376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1cb419c-5de0-4832-9048-634df37db6eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:30.314827 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1cb419c-5de0-4832-9048-634df37db6eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:30.315600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1cb419c-5de0-4832-9048-634df37db6eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:30.316041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d1cb419c-5de0-4832-9048-634df37db6eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:30.320302 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:30.454886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d1cb419c-5de0-4832-9048-634df37db6eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:30.463137 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d1cb419c-5de0-4832-9048-634df37db6eb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.162587 Jul 20 05:08:30.463742 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3479/6942] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:30 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:31.480768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b0a4e672-cff7-4819-94e1-df5b279ad904 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:31.481408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b0a4e672-cff7-4819-94e1-df5b279ad904 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:31.488371 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0a4e672-cff7-4819-94e1-df5b279ad904 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.488837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0a4e672-cff7-4819-94e1-df5b279ad904 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.489618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0a4e672-cff7-4819-94e1-df5b279ad904 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.490074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b0a4e672-cff7-4819-94e1-df5b279ad904 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.624113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b0a4e672-cff7-4819-94e1-df5b279ad904 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:31.632800 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b0a4e672-cff7-4819-94e1-df5b279ad904 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.156004 Jul 20 05:08:31.633371 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3464/6943] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:31 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:32.650481 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a23b676e-cf10-4cdf-a388-6f0bd9c76c0a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:32.651133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a23b676e-cf10-4cdf-a388-6f0bd9c76c0a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:32.658014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a23b676e-cf10-4cdf-a388-6f0bd9c76c0a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:32.659141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a23b676e-cf10-4cdf-a388-6f0bd9c76c0a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:32.659919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a23b676e-cf10-4cdf-a388-6f0bd9c76c0a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:32.660362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a23b676e-cf10-4cdf-a388-6f0bd9c76c0a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:32.794872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a23b676e-cf10-4cdf-a388-6f0bd9c76c0a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:32.803373 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a23b676e-cf10-4cdf-a388-6f0bd9c76c0a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.156904 Jul 20 05:08:32.803962 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3480/6944] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:32 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:33.820979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f916acc-eb33-4e13-851d-f084f363f884 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:33.821617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6f916acc-eb33-4e13-851d-f084f363f884 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:33.828773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f916acc-eb33-4e13-851d-f084f363f884 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:33.829244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f916acc-eb33-4e13-851d-f084f363f884 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:33.830038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f916acc-eb33-4e13-851d-f084f363f884 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:33.830524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f916acc-eb33-4e13-851d-f084f363f884 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:33.969298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6f916acc-eb33-4e13-851d-f084f363f884 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:33.978007 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f916acc-eb33-4e13-851d-f084f363f884 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1726 microversion: 2.1 time: 0.161076 Jul 20 05:08:33.978616 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3465/6945] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:33 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:34.996331 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-da6b3bb4-2702-4b54-bb15-1f8e03e8ee0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:34.996960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-da6b3bb4-2702-4b54-bb15-1f8e03e8ee0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:35.004347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da6b3bb4-2702-4b54-bb15-1f8e03e8ee0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.004812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da6b3bb4-2702-4b54-bb15-1f8e03e8ee0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.005599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da6b3bb4-2702-4b54-bb15-1f8e03e8ee0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.006056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-da6b3bb4-2702-4b54-bb15-1f8e03e8ee0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.149172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-da6b3bb4-2702-4b54-bb15-1f8e03e8ee0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:35.157251 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-da6b3bb4-2702-4b54-bb15-1f8e03e8ee0e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1723 microversion: 2.1 time: 0.165240 Jul 20 05:08:35.157844 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3481/6946] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:34 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:35.174544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:35.176070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:35.182796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.183270 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.184062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.184521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.220467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.220931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.221743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.223038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.243948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:08:35.249480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Getting quotas for user e4ea64dbd5d2458aa813ee734342bf4d and project 1bed81ce9b0848b5b7c665fb685bd760. Resources: {'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:08:35.349244 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d09870b6-90c7-40f9-8e9f-6c86f6c6d46c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "POST /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/action" status: 202 len: 0 microversion: 2.1 time: 0.178380 Jul 20 05:08:35.349983 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3466/6947] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:08:35 2022] POST /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:08:35.358502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8e828330-69fe-42ba-9473-04e9b39154b5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:35.359132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8e828330-69fe-42ba-9473-04e9b39154b5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:35.365978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e828330-69fe-42ba-9473-04e9b39154b5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.366498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e828330-69fe-42ba-9473-04e9b39154b5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.367297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e828330-69fe-42ba-9473-04e9b39154b5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.367872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e828330-69fe-42ba-9473-04e9b39154b5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.532554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8e828330-69fe-42ba-9473-04e9b39154b5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:35.542162 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8e828330-69fe-42ba-9473-04e9b39154b5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.187591 Jul 20 05:08:35.546288 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3482/6948] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:35 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:36.561461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6db01476-d25d-48ba-9b5d-4abaf47c3628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:36.562186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6db01476-d25d-48ba-9b5d-4abaf47c3628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:36.570241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6db01476-d25d-48ba-9b5d-4abaf47c3628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:36.570739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6db01476-d25d-48ba-9b5d-4abaf47c3628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:36.571534 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6db01476-d25d-48ba-9b5d-4abaf47c3628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:36.571993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6db01476-d25d-48ba-9b5d-4abaf47c3628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:36.713910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6db01476-d25d-48ba-9b5d-4abaf47c3628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:36.722689 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6db01476-d25d-48ba-9b5d-4abaf47c3628 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.165715 Jul 20 05:08:36.723311 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3467/6949] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:36 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:37.739514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dea284d1-b57d-499e-9810-e266cdda7a43 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:37.740148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dea284d1-b57d-499e-9810-e266cdda7a43 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:37.747359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dea284d1-b57d-499e-9810-e266cdda7a43 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:37.747833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dea284d1-b57d-499e-9810-e266cdda7a43 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:37.748626 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dea284d1-b57d-499e-9810-e266cdda7a43 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:37.749076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dea284d1-b57d-499e-9810-e266cdda7a43 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:37.888693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dea284d1-b57d-499e-9810-e266cdda7a43 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:37.899042 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dea284d1-b57d-499e-9810-e266cdda7a43 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.163643 Jul 20 05:08:37.899737 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3483/6950] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:37 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:38.917022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-71edc866-5727-4fa2-b996-8be52d0c56f7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:38.917946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-71edc866-5727-4fa2-b996-8be52d0c56f7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:38.925213 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71edc866-5727-4fa2-b996-8be52d0c56f7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:38.925690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71edc866-5727-4fa2-b996-8be52d0c56f7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:38.926531 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71edc866-5727-4fa2-b996-8be52d0c56f7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:38.927001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-71edc866-5727-4fa2-b996-8be52d0c56f7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:39.071686 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-71edc866-5727-4fa2-b996-8be52d0c56f7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:39.079894 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-71edc866-5727-4fa2-b996-8be52d0c56f7 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.167038 Jul 20 05:08:39.080472 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3468/6951] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:38 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:40.097978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0b080c6-a54b-4e02-8a62-54efdeb663bd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:40.098640 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d0b080c6-a54b-4e02-8a62-54efdeb663bd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:40.106099 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0b080c6-a54b-4e02-8a62-54efdeb663bd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:40.106587 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0b080c6-a54b-4e02-8a62-54efdeb663bd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:40.107387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0b080c6-a54b-4e02-8a62-54efdeb663bd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:40.107838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d0b080c6-a54b-4e02-8a62-54efdeb663bd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:40.248020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d0b080c6-a54b-4e02-8a62-54efdeb663bd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:40.257058 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d0b080c6-a54b-4e02-8a62-54efdeb663bd tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.163676 Jul 20 05:08:40.257954 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3484/6952] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:40 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:40.589226 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:08:40.589794 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:08:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:08:40.870965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-31501224-e466-49e8-ba9f-97bf3d7fe274 req-44adbfc0-4169-4fbe-818e-37f73657d74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb43573d-61ab-4101-a2a7-acb7bf1574e8", "tag": "6c8cdf02-dd0f-4d4c-8144-497307c1d28a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:40.881246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-31501224-e466-49e8-ba9f-97bf3d7fe274 req-44adbfc0-4169-4fbe-818e-37f73657d74e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:40.881717 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-31501224-e466-49e8-ba9f-97bf3d7fe274 req-44adbfc0-4169-4fbe-818e-37f73657d74e service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:40.904455 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-31501224-e466-49e8-ba9f-97bf3d7fe274 req-44adbfc0-4169-4fbe-818e-37f73657d74e service nova] Creating event network-changed:6c8cdf02-dd0f-4d4c-8144-497307c1d28a for instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 on n-h2-760456-11 Jul 20 05:08:40.911967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-31501224-e466-49e8-ba9f-97bf3d7fe274 req-44adbfc0-4169-4fbe-818e-37f73657d74e service nova] Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:08:40.924771 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-31501224-e466-49e8-ba9f-97bf3d7fe274 req-44adbfc0-4169-4fbe-818e-37f73657d74e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058733 Jul 20 05:08:40.926528 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3469/6953] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:41.275122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e40a7b36-b6f9-4b80-a571-a4cef2c24287 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:41.275838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e40a7b36-b6f9-4b80-a571-a4cef2c24287 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:41.282352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e40a7b36-b6f9-4b80-a571-a4cef2c24287 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:41.282824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e40a7b36-b6f9-4b80-a571-a4cef2c24287 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:41.283613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e40a7b36-b6f9-4b80-a571-a4cef2c24287 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:41.284078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e40a7b36-b6f9-4b80-a571-a4cef2c24287 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:41.426095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e40a7b36-b6f9-4b80-a571-a4cef2c24287 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:41.434610 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e40a7b36-b6f9-4b80-a571-a4cef2c24287 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.163780 Jul 20 05:08:41.435370 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3485/6954] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:41 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:42.453139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3a001c5a-7b83-4c7d-8e25-78cfb1d69837 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:42.455972 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3a001c5a-7b83-4c7d-8e25-78cfb1d69837 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:42.464200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a001c5a-7b83-4c7d-8e25-78cfb1d69837 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:42.464684 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a001c5a-7b83-4c7d-8e25-78cfb1d69837 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:42.465490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a001c5a-7b83-4c7d-8e25-78cfb1d69837 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:42.465951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3a001c5a-7b83-4c7d-8e25-78cfb1d69837 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:42.604653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3a001c5a-7b83-4c7d-8e25-78cfb1d69837 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:42.613066 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3a001c5a-7b83-4c7d-8e25-78cfb1d69837 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.164150 Jul 20 05:08:42.613740 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3470/6955] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:42 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:43.630855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-654cfd51-2dbf-418b-838f-6555f61d8a3e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:43.631508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-654cfd51-2dbf-418b-838f-6555f61d8a3e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:43.638717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-654cfd51-2dbf-418b-838f-6555f61d8a3e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:43.639254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-654cfd51-2dbf-418b-838f-6555f61d8a3e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:43.640044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-654cfd51-2dbf-418b-838f-6555f61d8a3e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:43.640491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-654cfd51-2dbf-418b-838f-6555f61d8a3e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:43.775468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-654cfd51-2dbf-418b-838f-6555f61d8a3e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:43.784401 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-654cfd51-2dbf-418b-838f-6555f61d8a3e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.157968 Jul 20 05:08:43.785528 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3486/6956] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:43 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:44.803029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-361369b2-6618-4aa1-a57a-7d9c5a57e5c0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:44.803681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-361369b2-6618-4aa1-a57a-7d9c5a57e5c0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:44.810949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-361369b2-6618-4aa1-a57a-7d9c5a57e5c0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:44.811439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-361369b2-6618-4aa1-a57a-7d9c5a57e5c0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:44.812259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-361369b2-6618-4aa1-a57a-7d9c5a57e5c0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:44.812723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-361369b2-6618-4aa1-a57a-7d9c5a57e5c0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:44.953548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-361369b2-6618-4aa1-a57a-7d9c5a57e5c0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:44.964473 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-361369b2-6618-4aa1-a57a-7d9c5a57e5c0 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.165736 Jul 20 05:08:44.965064 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3471/6957] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:44 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:45.982392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-859bc4d9-02b1-48d2-8056-0a1f9a913641 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:45.983027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-859bc4d9-02b1-48d2-8056-0a1f9a913641 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:45.990471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859bc4d9-02b1-48d2-8056-0a1f9a913641 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:45.990950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859bc4d9-02b1-48d2-8056-0a1f9a913641 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:45.991772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859bc4d9-02b1-48d2-8056-0a1f9a913641 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:45.992234 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-859bc4d9-02b1-48d2-8056-0a1f9a913641 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:46.129296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-859bc4d9-02b1-48d2-8056-0a1f9a913641 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:46.137506 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-859bc4d9-02b1-48d2-8056-0a1f9a913641 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.159114 Jul 20 05:08:46.138114 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3487/6958] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:45 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:47.155573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6ca2f15b-58b3-4223-97cf-3a9998b6c33e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:47.161410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6ca2f15b-58b3-4223-97cf-3a9998b6c33e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:47.164528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:47.170130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ca2f15b-58b3-4223-97cf-3a9998b6c33e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.170677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ca2f15b-58b3-4223-97cf-3a9998b6c33e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.171553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ca2f15b-58b3-4223-97cf-3a9998b6c33e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.172058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ca2f15b-58b3-4223-97cf-3a9998b6c33e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.306307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6ca2f15b-58b3-4223-97cf-3a9998b6c33e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:47.314448 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6ca2f15b-58b3-4223-97cf-3a9998b6c33e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.163140 Jul 20 05:08:47.315025 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3472/6959] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:47 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:48.332317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f4932cb1-17c3-48b9-a370-59162a58838a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:48.332940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f4932cb1-17c3-48b9-a370-59162a58838a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:48.339910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4932cb1-17c3-48b9-a370-59162a58838a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:48.340376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4932cb1-17c3-48b9-a370-59162a58838a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:48.341166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4932cb1-17c3-48b9-a370-59162a58838a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:48.341625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4932cb1-17c3-48b9-a370-59162a58838a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:48.477273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f4932cb1-17c3-48b9-a370-59162a58838a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:48.485322 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f4932cb1-17c3-48b9-a370-59162a58838a tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.157550 Jul 20 05:08:48.485929 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3488/6960] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:48 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:49.503577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8a00f504-9171-4923-9e86-488766fa916c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:49.504212 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8a00f504-9171-4923-9e86-488766fa916c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:49.511159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a00f504-9171-4923-9e86-488766fa916c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:49.511631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a00f504-9171-4923-9e86-488766fa916c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:49.512423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a00f504-9171-4923-9e86-488766fa916c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:49.512884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8a00f504-9171-4923-9e86-488766fa916c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:49.647568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8a00f504-9171-4923-9e86-488766fa916c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:49.655701 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8a00f504-9171-4923-9e86-488766fa916c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.156200 Jul 20 05:08:49.656352 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3473/6961] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:49 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:50.674222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0dfea2ea-9e9e-4445-b407-2b0d13e2a851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:50.675347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0dfea2ea-9e9e-4445-b407-2b0d13e2a851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:50.682052 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0dfea2ea-9e9e-4445-b407-2b0d13e2a851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:50.682546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0dfea2ea-9e9e-4445-b407-2b0d13e2a851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:50.683333 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0dfea2ea-9e9e-4445-b407-2b0d13e2a851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:50.683786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0dfea2ea-9e9e-4445-b407-2b0d13e2a851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:50.814100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0dfea2ea-9e9e-4445-b407-2b0d13e2a851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:50.823417 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0dfea2ea-9e9e-4445-b407-2b0d13e2a851 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.153077 Jul 20 05:08:50.824017 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3489/6962] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:50 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:51.842029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-80b7f7b5-0626-48fa-85ac-9098f5b9bbd3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:51.842924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-80b7f7b5-0626-48fa-85ac-9098f5b9bbd3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:51.851268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80b7f7b5-0626-48fa-85ac-9098f5b9bbd3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.851741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80b7f7b5-0626-48fa-85ac-9098f5b9bbd3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.852528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80b7f7b5-0626-48fa-85ac-9098f5b9bbd3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.852983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-80b7f7b5-0626-48fa-85ac-9098f5b9bbd3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.986904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-80b7f7b5-0626-48fa-85ac-9098f5b9bbd3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:51.995546 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-80b7f7b5-0626-48fa-85ac-9098f5b9bbd3 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.157143 Jul 20 05:08:51.996142 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3474/6963] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:51 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:53.013513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cb50ea37-58fd-4e72-badd-319e3afa2376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:53.014136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cb50ea37-58fd-4e72-badd-319e3afa2376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:53.022761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb50ea37-58fd-4e72-badd-319e3afa2376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:53.023227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb50ea37-58fd-4e72-badd-319e3afa2376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:53.024019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb50ea37-58fd-4e72-badd-319e3afa2376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:53.024473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cb50ea37-58fd-4e72-badd-319e3afa2376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:53.161652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cb50ea37-58fd-4e72-badd-319e3afa2376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:53.169690 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cb50ea37-58fd-4e72-badd-319e3afa2376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1722 microversion: 2.1 time: 0.160448 Jul 20 05:08:53.170287 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3490/6964] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:53 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:54.187102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6ab850c4-32a5-419d-9555-03bfb4d86573 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:54.187749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6ab850c4-32a5-419d-9555-03bfb4d86573 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:54.194908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ab850c4-32a5-419d-9555-03bfb4d86573 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.195386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ab850c4-32a5-419d-9555-03bfb4d86573 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.196185 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ab850c4-32a5-419d-9555-03bfb4d86573 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.196707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6ab850c4-32a5-419d-9555-03bfb4d86573 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.328439 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6ab850c4-32a5-419d-9555-03bfb4d86573 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:54.337214 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6ab850c4-32a5-419d-9555-03bfb4d86573 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1715 microversion: 2.1 time: 0.154026 Jul 20 05:08:54.337785 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3475/6965] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:54 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:54.354167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fbbab1ce-fd86-4527-9ed8-2ab3ede705e5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:54.354871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fbbab1ce-fd86-4527-9ed8-2ab3ede705e5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:54.361808 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbbab1ce-fd86-4527-9ed8-2ab3ede705e5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.362813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbbab1ce-fd86-4527-9ed8-2ab3ede705e5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.363596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbbab1ce-fd86-4527-9ed8-2ab3ede705e5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.364048 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbbab1ce-fd86-4527-9ed8-2ab3ede705e5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.496842 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fbbab1ce-fd86-4527-9ed8-2ab3ede705e5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:54.505638 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fbbab1ce-fd86-4527-9ed8-2ab3ede705e5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1715 microversion: 2.1 time: 0.155419 Jul 20 05:08:54.506285 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3491/6966] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:54 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:54.522447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e7eab89f-df2a-47e0-9b1d-3d249371a087 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:54.523082 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e7eab89f-df2a-47e0-9b1d-3d249371a087 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:54.529178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7eab89f-df2a-47e0-9b1d-3d249371a087 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.529647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7eab89f-df2a-47e0-9b1d-3d249371a087 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.530477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7eab89f-df2a-47e0-9b1d-3d249371a087 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.530936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e7eab89f-df2a-47e0-9b1d-3d249371a087 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.660643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e7eab89f-df2a-47e0-9b1d-3d249371a087 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:54.668715 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e7eab89f-df2a-47e0-9b1d-3d249371a087 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1715 microversion: 2.1 time: 0.150898 Jul 20 05:08:54.669293 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3476/6967] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:54 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:54.685368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2f3a4823-472a-4448-8b14-2d416393cc5b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:54.685885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f3a4823-472a-4448-8b14-2d416393cc5b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:54.692617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f3a4823-472a-4448-8b14-2d416393cc5b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.693084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f3a4823-472a-4448-8b14-2d416393cc5b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.693866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f3a4823-472a-4448-8b14-2d416393cc5b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.694350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2f3a4823-472a-4448-8b14-2d416393cc5b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.720097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2f3a4823-472a-4448-8b14-2d416393cc5b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:08:54.796253 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2f3a4823-472a-4448-8b14-2d416393cc5b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 204 len: 0 microversion: 2.1 time: 0.114571 Jul 20 05:08:54.796854 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3492/6968] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:54 2022] DELETE /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:08:54.805187 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16fa78fa-c3a0-4c16-bf9a-b34d115602d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:54.805838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16fa78fa-c3a0-4c16-bf9a-b34d115602d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:54.811938 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16fa78fa-c3a0-4c16-bf9a-b34d115602d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.812414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16fa78fa-c3a0-4c16-bf9a-b34d115602d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.813209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16fa78fa-c3a0-4c16-bf9a-b34d115602d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.813671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16fa78fa-c3a0-4c16-bf9a-b34d115602d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.818536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:54.952688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-16fa78fa-c3a0-4c16-bf9a-b34d115602d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:54.962802 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16fa78fa-c3a0-4c16-bf9a-b34d115602d9 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1721 microversion: 2.1 time: 0.161439 Jul 20 05:08:54.963387 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3477/6969] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:54 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:55.980256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7123df86-b482-446d-bf32-df8908eafd47 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:55.980967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7123df86-b482-446d-bf32-df8908eafd47 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:55.988784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7123df86-b482-446d-bf32-df8908eafd47 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:55.989243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7123df86-b482-446d-bf32-df8908eafd47 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:55.990022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7123df86-b482-446d-bf32-df8908eafd47 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:55.990496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7123df86-b482-446d-bf32-df8908eafd47 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:56.131359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7123df86-b482-446d-bf32-df8908eafd47 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:56.139845 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7123df86-b482-446d-bf32-df8908eafd47 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1721 microversion: 2.1 time: 0.163902 Jul 20 05:08:56.140430 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3493/6970] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:55 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:57.163849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f8802127-a850-4d9c-89ea-042fd625a05e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:57.165217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f8802127-a850-4d9c-89ea-042fd625a05e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:57.174155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8802127-a850-4d9c-89ea-042fd625a05e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:57.176050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8802127-a850-4d9c-89ea-042fd625a05e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:57.177072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8802127-a850-4d9c-89ea-042fd625a05e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:57.177707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f8802127-a850-4d9c-89ea-042fd625a05e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:57.258967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f8802127-a850-4d9c-89ea-042fd625a05e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:57.272233 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f8802127-a850-4d9c-89ea-042fd625a05e tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1653 microversion: 2.1 time: 0.119025 Jul 20 05:08:57.276561 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3478/6971] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:57 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1653 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:57.732004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2e26b0bd-970b-49f7-aa0b-7c18cea6b589 req-6d497590-b798-47d9-b20b-737433ad3538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb43573d-61ab-4101-a2a7-acb7bf1574e8", "name": "network-vif-deleted", "tag": "6c8cdf02-dd0f-4d4c-8144-497307c1d28a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:57.746307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2e26b0bd-970b-49f7-aa0b-7c18cea6b589 req-6d497590-b798-47d9-b20b-737433ad3538 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:57.747128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2e26b0bd-970b-49f7-aa0b-7c18cea6b589 req-6d497590-b798-47d9-b20b-737433ad3538 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:57.766876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:57.771702 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2e26b0bd-970b-49f7-aa0b-7c18cea6b589 req-6d497590-b798-47d9-b20b-737433ad3538 service nova] Creating event network-vif-deleted:6c8cdf02-dd0f-4d4c-8144-497307c1d28a for instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 on n-h2-760456-11 Jul 20 05:08:57.780921 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2e26b0bd-970b-49f7-aa0b-7c18cea6b589 req-6d497590-b798-47d9-b20b-737433ad3538 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053481 Jul 20 05:08:57.781661 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3494/6972] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:58.290697 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d8b32ac-3776-44a7-9086-69b7e4cac085 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:58.291555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d8b32ac-3776-44a7-9086-69b7e4cac085 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:58.299834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d8b32ac-3776-44a7-9086-69b7e4cac085 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:58.300377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d8b32ac-3776-44a7-9086-69b7e4cac085 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:58.301280 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d8b32ac-3776-44a7-9086-69b7e4cac085 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:58.301744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d8b32ac-3776-44a7-9086-69b7e4cac085 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:58.372194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d8b32ac-3776-44a7-9086-69b7e4cac085 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:58.386960 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d8b32ac-3776-44a7-9086-69b7e4cac085 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1369 microversion: 2.1 time: 0.100352 Jul 20 05:08:58.387775 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3479/6973] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:58 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:59.406707 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f5e84bf9-6852-4e69-bbf8-b131a78839f1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:59.407334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f5e84bf9-6852-4e69-bbf8-b131a78839f1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:59.415556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5e84bf9-6852-4e69-bbf8-b131a78839f1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:59.416021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5e84bf9-6852-4e69-bbf8-b131a78839f1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:59.416813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5e84bf9-6852-4e69-bbf8-b131a78839f1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:59.417259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f5e84bf9-6852-4e69-bbf8-b131a78839f1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:59.483944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f5e84bf9-6852-4e69-bbf8-b131a78839f1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:59.493206 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f5e84bf9-6852-4e69-bbf8-b131a78839f1 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1369 microversion: 2.1 time: 0.092590 Jul 20 05:08:59.493816 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3495/6974] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:59 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:00.511558 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-65e521ba-69d2-41c5-86f6-2913293c9558 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:00.512215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-65e521ba-69d2-41c5-86f6-2913293c9558 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:00.514946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:00.521242 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65e521ba-69d2-41c5-86f6-2913293c9558 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:00.521722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65e521ba-69d2-41c5-86f6-2913293c9558 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:00.522559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65e521ba-69d2-41c5-86f6-2913293c9558 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:00.523058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65e521ba-69d2-41c5-86f6-2913293c9558 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:00.589720 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-65e521ba-69d2-41c5-86f6-2913293c9558 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:00.598302 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-65e521ba-69d2-41c5-86f6-2913293c9558 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1369 microversion: 2.1 time: 0.090702 Jul 20 05:09:00.598893 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3480/6975] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:00 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:01.615732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-53762309-7dfe-4d94-8393-101b70570d93 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:01.616361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-53762309-7dfe-4d94-8393-101b70570d93 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:01.619221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:01.625076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53762309-7dfe-4d94-8393-101b70570d93 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:01.625558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53762309-7dfe-4d94-8393-101b70570d93 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:01.626369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53762309-7dfe-4d94-8393-101b70570d93 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:01.626823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-53762309-7dfe-4d94-8393-101b70570d93 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:01.692134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-53762309-7dfe-4d94-8393-101b70570d93 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ea64dbd5d2458aa813ee734342bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bed81ce9b0848b5b7c665fb685bd760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:01.700337 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-53762309-7dfe-4d94-8393-101b70570d93 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 200 len: 1369 microversion: 2.1 time: 0.089313 Jul 20 05:09:01.700918 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3496/6976] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:01 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:02.717818 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d12e738d-b3ea-4edd-b509-02c008d284a4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:02.718492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d12e738d-b3ea-4edd-b509-02c008d284a4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:02.726030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d12e738d-b3ea-4edd-b509-02c008d284a4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:02.726543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d12e738d-b3ea-4edd-b509-02c008d284a4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:02.727375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d12e738d-b3ea-4edd-b509-02c008d284a4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:02.727864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d12e738d-b3ea-4edd-b509-02c008d284a4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:02.741820 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-d12e738d-b3ea-4edd-b509-02c008d284a4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d12e738d-b3ea-4edd-b509-02c008d284a4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 HTTP/1.1 Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'cb43573d-61ab-4101-a2a7-acb7bf1574e8'} Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:02.743523 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:02.748472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:02.748472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:02.748472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:02.748472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:02.748472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:02.748472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:02.748472 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:02.748472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d12e738d-b3ea-4edd-b509-02c008d284a4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:02.748472 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d12e738d-b3ea-4edd-b509-02c008d284a4 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 404 len: 111 microversion: 2.1 time: 0.031106 Jul 20 05:09:02.748472 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3481/6977] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:02 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:02.802029 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-357f41fe-28eb-4012-a7a8-cf36cf0df9bb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:02.802995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-357f41fe-28eb-4012-a7a8-cf36cf0df9bb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:02.809858 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-357f41fe-28eb-4012-a7a8-cf36cf0df9bb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:02.810348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-357f41fe-28eb-4012-a7a8-cf36cf0df9bb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:02.811221 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-357f41fe-28eb-4012-a7a8-cf36cf0df9bb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:02.811774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-357f41fe-28eb-4012-a7a8-cf36cf0df9bb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:02.824527 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-357f41fe-28eb-4012-a7a8-cf36cf0df9bb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-357f41fe-28eb-4012-a7a8-cf36cf0df9bb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/os-volume_attachments HTTP/1.1 Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'server_id': 'cb43573d-61ab-4101-a2a7-acb7bf1574e8'} Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:02.826203 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-357f41fe-28eb-4012-a7a8-cf36cf0df9bb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-357f41fe-28eb-4012-a7a8-cf36cf0df9bb tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030438 Jul 20 05:09:02.830463 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3497/6978] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:09:02 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:05.847487 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:09:05.848118 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:09:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:09:06.137372 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ea4ec92-8a33-4830-af09-753c1f973376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.137892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ea4ec92-8a33-4830-af09-753c1f973376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.145576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ea4ec92-8a33-4830-af09-753c1f973376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.146052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ea4ec92-8a33-4830-af09-753c1f973376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.146887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ea4ec92-8a33-4830-af09-753c1f973376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.147347 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ea4ec92-8a33-4830-af09-753c1f973376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.161262 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-2ea4ec92-8a33-4830-af09-753c1f973376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ea4ec92-8a33-4830-af09-753c1f973376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 HTTP/1.1 Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'cb43573d-61ab-4101-a2a7-acb7bf1574e8'} Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:06.162889 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ea4ec92-8a33-4830-af09-753c1f973376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ea4ec92-8a33-4830-af09-753c1f973376 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 404 len: 111 microversion: 2.1 time: 0.030894 Jul 20 05:09:06.166420 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3482/6979] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:06 2022] DELETE /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:06.173153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49f71b70-04c9-4fc4-a77d-26d4d3d1a548 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.173839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-49f71b70-04c9-4fc4-a77d-26d4d3d1a548 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: cb43573d-61ab-4101-a2a7-acb7bf1574e8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.183127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49f71b70-04c9-4fc4-a77d-26d4d3d1a548 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.183675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49f71b70-04c9-4fc4-a77d-26d4d3d1a548 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.184525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49f71b70-04c9-4fc4-a77d-26d4d3d1a548 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.185037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-49f71b70-04c9-4fc4-a77d-26d4d3d1a548 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.203010 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-49f71b70-04c9-4fc4-a77d-26d4d3d1a548 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49f71b70-04c9-4fc4-a77d-26d4d3d1a548 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 HTTP/1.1 Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'cb43573d-61ab-4101-a2a7-acb7bf1574e8'} Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.204552 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.209916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.209916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.209916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.209916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:06.209916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:06.209916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. Jul 20 05:09:06.209916 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.209916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-49f71b70-04c9-4fc4-a77d-26d4d3d1a548 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance cb43573d-61ab-4101-a2a7-acb7bf1574e8 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:06.209916 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-49f71b70-04c9-4fc4-a77d-26d4d3d1a548 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8" status: 404 len: 111 microversion: 2.1 time: 0.037528 Jul 20 05:09:06.210836 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3498/6980] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:06 2022] GET /compute/v2.1/servers/cb43573d-61ab-4101-a2a7-acb7bf1574e8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:06.215572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-77a3de13-6a49-418e-8957-0d7e3c8febcf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.216104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-77a3de13-6a49-418e-8957-0d7e3c8febcf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.222549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77a3de13-6a49-418e-8957-0d7e3c8febcf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.223033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77a3de13-6a49-418e-8957-0d7e3c8febcf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.223837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77a3de13-6a49-418e-8957-0d7e3c8febcf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.224308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77a3de13-6a49-418e-8957-0d7e3c8febcf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.242198 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-77a3de13-6a49-418e-8957-0d7e3c8febcf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-77a3de13-6a49-418e-8957-0d7e3c8febcf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 HTTP/1.1 Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1'} Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:06.243845 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-77a3de13-6a49-418e-8957-0d7e3c8febcf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-77a3de13-6a49-418e-8957-0d7e3c8febcf tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "DELETE /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 404 len: 111 microversion: 2.1 time: 0.033757 Jul 20 05:09:06.248514 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3483/6981] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:06 2022] DELETE /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:06.254859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2fe742c2-e9df-4cf6-8a8b-4963ad2eab6c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.255490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2fe742c2-e9df-4cf6-8a8b-4963ad2eab6c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.261725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fe742c2-e9df-4cf6-8a8b-4963ad2eab6c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.262186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fe742c2-e9df-4cf6-8a8b-4963ad2eab6c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.262986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fe742c2-e9df-4cf6-8a8b-4963ad2eab6c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.263435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fe742c2-e9df-4cf6-8a8b-4963ad2eab6c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.278169 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-2fe742c2-e9df-4cf6-8a8b-4963ad2eab6c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2fe742c2-e9df-4cf6-8a8b-4963ad2eab6c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 HTTP/1.1 Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1'} Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.279839 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.286050 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.286050 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.286050 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.286050 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:06.286050 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:06.286050 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. Jul 20 05:09:06.286050 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.286050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2fe742c2-e9df-4cf6-8a8b-4963ad2eab6c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:06.286050 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2fe742c2-e9df-4cf6-8a8b-4963ad2eab6c tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1" status: 404 len: 111 microversion: 2.1 time: 0.031050 Jul 20 05:09:06.286050 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3499/6982] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:06 2022] GET /compute/v2.1/servers/45cbdc66-9fb7-4aa5-bed3-db0c81fc76b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:06.290703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6784cfe1-2823-44e4-b4ed-a53faf6330c5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.291230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6784cfe1-2823-44e4-b4ed-a53faf6330c5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.297786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6784cfe1-2823-44e4-b4ed-a53faf6330c5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.298281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6784cfe1-2823-44e4-b4ed-a53faf6330c5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.299083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6784cfe1-2823-44e4-b4ed-a53faf6330c5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.300071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6784cfe1-2823-44e4-b4ed-a53faf6330c5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.314411 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-6784cfe1-2823-44e4-b4ed-a53faf6330c5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6784cfe1-2823-44e4-b4ed-a53faf6330c5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 HTTP/1.1 Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '0da00dba-9ddf-4adb-8a9f-4c701809d181'} Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:06.316586 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6784cfe1-2823-44e4-b4ed-a53faf6330c5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6784cfe1-2823-44e4-b4ed-a53faf6330c5 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 404 len: 111 microversion: 2.1 time: 0.031574 Jul 20 05:09:06.324222 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3484/6983] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:06 2022] DELETE /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:06.327210 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-491cfe2a-7798-491e-8b8d-f4e4612333ac tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.327877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-491cfe2a-7798-491e-8b8d-f4e4612333ac tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 0da00dba-9ddf-4adb-8a9f-4c701809d181] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.335277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-491cfe2a-7798-491e-8b8d-f4e4612333ac tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.335742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-491cfe2a-7798-491e-8b8d-f4e4612333ac tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.336708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-491cfe2a-7798-491e-8b8d-f4e4612333ac tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.337161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-491cfe2a-7798-491e-8b8d-f4e4612333ac tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.353007 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-491cfe2a-7798-491e-8b8d-f4e4612333ac tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-491cfe2a-7798-491e-8b8d-f4e4612333ac tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 HTTP/1.1 Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '0da00dba-9ddf-4adb-8a9f-4c701809d181'} Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.354650 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.360170 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.360170 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.360170 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.360170 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:06.360170 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:06.360170 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. Jul 20 05:09:06.360170 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.360170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-491cfe2a-7798-491e-8b8d-f4e4612333ac tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 0da00dba-9ddf-4adb-8a9f-4c701809d181 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:06.360170 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-491cfe2a-7798-491e-8b8d-f4e4612333ac tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181" status: 404 len: 111 microversion: 2.1 time: 0.033123 Jul 20 05:09:06.360170 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3500/6984] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:06 2022] GET /compute/v2.1/servers/0da00dba-9ddf-4adb-8a9f-4c701809d181 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:06.366057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-637143e2-aa66-49f1-b131-8690281f011b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.366682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-637143e2-aa66-49f1-b131-8690281f011b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.373107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-637143e2-aa66-49f1-b131-8690281f011b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.373656 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-637143e2-aa66-49f1-b131-8690281f011b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.374616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-637143e2-aa66-49f1-b131-8690281f011b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.375150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-637143e2-aa66-49f1-b131-8690281f011b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.389361 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-637143e2-aa66-49f1-b131-8690281f011b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-637143e2-aa66-49f1-b131-8690281f011b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 HTTP/1.1 Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4537bade-25ce-4131-b844-d72d19cf5b31'} Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:06.391068 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.395675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-637143e2-aa66-49f1-b131-8690281f011b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:06.396546 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-637143e2-aa66-49f1-b131-8690281f011b tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 404 len: 111 microversion: 2.1 time: 0.033872 Jul 20 05:09:06.397055 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3485/6985] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:06 2022] DELETE /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:06.405298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a2c5b20-48de-453c-871f-66ba412180c6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.405913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3a2c5b20-48de-453c-871f-66ba412180c6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] [instance: 4537bade-25ce-4131-b844-d72d19cf5b31] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.413280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a2c5b20-48de-453c-871f-66ba412180c6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.413738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a2c5b20-48de-453c-871f-66ba412180c6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.414533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a2c5b20-48de-453c-871f-66ba412180c6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.414976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a2c5b20-48de-453c-871f-66ba412180c6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.429426 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3a2c5b20-48de-453c-871f-66ba412180c6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] HTTP exception thrown: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a2c5b20-48de-453c-871f-66ba412180c6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Request method failure captured: Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 HTTP/1.1 Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi14yMv-ERzvdrDvVGFpcMlv-Q_U4nd7pJ15U3yW5fHVh0ErE41kXtlCZ-bvzH1zfrATgJXKRF9AXr0cWQGJQ8OCeuv1ovoOCaFMdwdDom9WSlXxtpVzLJgpX8GaEN5mVrgcny46dSbFmYza-BYxK50LEAO90zfVX7BJ8IY89kfc3iGmw Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1bed81ce9b0848b5b7c665fb685bd760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 1bed81ce9b0848b5b7c665fb685bd760 Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServerActionsTestJSON-127189264 Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: e4ea64dbd5d2458aa813ee734342bf4d Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServerActionsTestJSON-127189264-project Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '4537bade-25ce-4131-b844-d72d19cf5b31'} Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:06.430948 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.434828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:06.434828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:06.434828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:06.434828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:06.434828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:06.434828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. Jul 20 05:09:06.434828 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:06.434828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a2c5b20-48de-453c-871f-66ba412180c6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Returning 404 to user: Instance 4537bade-25ce-4131-b844-d72d19cf5b31 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:06.434828 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3a2c5b20-48de-453c-871f-66ba412180c6 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31" status: 404 len: 111 microversion: 2.1 time: 0.031236 Jul 20 05:09:06.434828 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3501/6986] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:06 2022] GET /compute/v2.1/servers/4537bade-25ce-4131-b844-d72d19cf5b31 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:06.442089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3b1ab313-1b1f-4dbe-9bc1-0bcacee98f58 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] Calling method '.version_select at 0x7fb840670310>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.466376 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3b1ab313-1b1f-4dbe-9bc1-0bcacee98f58 tempest-ServerActionsTestJSON-127189264 tempest-ServerActionsTestJSON-127189264-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-949232659" status: 202 len: 0 microversion: 2.1 time: 0.028948 Jul 20 05:09:06.466966 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3486/6987] 10.222.0.59 () {58 vars in 1217 bytes} [Wed Jul 20 05:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-949232659 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:09:15.615542 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-152575706", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "dee3d27b-8559-4269-b7cd-3398609a2b44"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:15.671489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] validate_networks() for [('dee3d27b-8559-4269-b7cd-3398609a2b44', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:09:16.168645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:09:16.169079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:09:16.169568 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:09:16.169991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:09:16.170474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:09:16.180405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:16.180874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:16.181699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:16.182151 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:16.201016 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Getting quotas for project e6d5e15a9a4a435baa0f48e2828949db. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:09:16.207484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Getting quotas for user 22017528801846a1980f5dffac23e415 and project e6d5e15a9a4a435baa0f48e2828949db. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:09:16.220480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:09:16.223465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:09:16.272471 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bd4605cb-fdbc-440c-b14b-51e51d6627e3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782824 Jul 20 05:09:16.273082 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3502/6988] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:09:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:09:16.285026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-230cc208-b66b-4ba2-8cf3-bf2412f556bb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:16.285711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-230cc208-b66b-4ba2-8cf3-bf2412f556bb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:16.348616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-230cc208-b66b-4ba2-8cf3-bf2412f556bb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:16.355891 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-230cc208-b66b-4ba2-8cf3-bf2412f556bb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1216 microversion: 2.1 time: 0.076547 Jul 20 05:09:16.356804 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3487/6989] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:16 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:17.374693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-abdf55e4-7986-4807-a4ec-d5cedf32149b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:17.375411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-abdf55e4-7986-4807-a4ec-d5cedf32149b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:17.386336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abdf55e4-7986-4807-a4ec-d5cedf32149b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:17.387158 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abdf55e4-7986-4807-a4ec-d5cedf32149b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:17.388165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abdf55e4-7986-4807-a4ec-d5cedf32149b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:17.388816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-abdf55e4-7986-4807-a4ec-d5cedf32149b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:17.471775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-abdf55e4-7986-4807-a4ec-d5cedf32149b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:17.480882 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-abdf55e4-7986-4807-a4ec-d5cedf32149b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1274 microversion: 2.1 time: 0.111503 Jul 20 05:09:17.482185 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3503/6990] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:17 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:18.501231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d6b6fd29-6f01-46c7-96a0-c41b1504082a tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:18.503059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d6b6fd29-6f01-46c7-96a0-c41b1504082a tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:18.506481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=33 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:18.524151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6b6fd29-6f01-46c7-96a0-c41b1504082a tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:18.525077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6b6fd29-6f01-46c7-96a0-c41b1504082a tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:18.526240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6b6fd29-6f01-46c7-96a0-c41b1504082a tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:18.526890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6b6fd29-6f01-46c7-96a0-c41b1504082a tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:18.763559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d6b6fd29-6f01-46c7-96a0-c41b1504082a tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:18.777089 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d6b6fd29-6f01-46c7-96a0-c41b1504082a tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1316 microversion: 2.1 time: 0.280658 Jul 20 05:09:18.784177 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3488/6991] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:18 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:18.846751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-25d0c663-5379-4e01-8fbe-799baedec6e1 req-4e15d5e9-48d4-4448-97d5-c904fbc4b39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3dcff85-cbb1-41d6-8264-3ce224d4199f", "tag": "5d951312-4d39-4027-a037-b2c59e27ba94"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:18.865588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-25d0c663-5379-4e01-8fbe-799baedec6e1 req-4e15d5e9-48d4-4448-97d5-c904fbc4b39b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:18.866037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-25d0c663-5379-4e01-8fbe-799baedec6e1 req-4e15d5e9-48d4-4448-97d5-c904fbc4b39b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:18.886424 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-25d0c663-5379-4e01-8fbe-799baedec6e1 req-4e15d5e9-48d4-4448-97d5-c904fbc4b39b service nova] Creating event network-changed:5d951312-4d39-4027-a037-b2c59e27ba94 for instance c3dcff85-cbb1-41d6-8264-3ce224d4199f on n-h1-760456-11 Jul 20 05:09:18.892025 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-25d0c663-5379-4e01-8fbe-799baedec6e1 req-4e15d5e9-48d4-4448-97d5-c904fbc4b39b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050358 Jul 20 05:09:18.910473 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3504/6992] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:19.794509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-52fb5297-dfde-4e13-be8f-d1d2df9621d8 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:19.795066 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-52fb5297-dfde-4e13-be8f-d1d2df9621d8 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:19.802311 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52fb5297-dfde-4e13-be8f-d1d2df9621d8 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:19.802799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52fb5297-dfde-4e13-be8f-d1d2df9621d8 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:19.803690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52fb5297-dfde-4e13-be8f-d1d2df9621d8 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:19.804154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52fb5297-dfde-4e13-be8f-d1d2df9621d8 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:19.936913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-52fb5297-dfde-4e13-be8f-d1d2df9621d8 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:19.944740 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-52fb5297-dfde-4e13-be8f-d1d2df9621d8 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1316 microversion: 2.1 time: 0.154325 Jul 20 05:09:19.945305 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3489/6993] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:19 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:20.963142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-115403cd-b028-4254-bd4f-6440506b0bef tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:20.963865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-115403cd-b028-4254-bd4f-6440506b0bef tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:20.970216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-115403cd-b028-4254-bd4f-6440506b0bef tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:20.970712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-115403cd-b028-4254-bd4f-6440506b0bef tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:20.972164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-115403cd-b028-4254-bd4f-6440506b0bef tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:20.972611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-115403cd-b028-4254-bd4f-6440506b0bef tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:21.104903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-115403cd-b028-4254-bd4f-6440506b0bef tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:21.113225 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-115403cd-b028-4254-bd4f-6440506b0bef tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1316 microversion: 2.1 time: 0.155257 Jul 20 05:09:21.113809 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3505/6994] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:20 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:22.131214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b86b8c60-0469-4730-ac72-d39c8fb4be77 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:22.132065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b86b8c60-0469-4730-ac72-d39c8fb4be77 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:22.139025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b86b8c60-0469-4730-ac72-d39c8fb4be77 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:22.139491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b86b8c60-0469-4730-ac72-d39c8fb4be77 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:22.140271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b86b8c60-0469-4730-ac72-d39c8fb4be77 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:22.140729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b86b8c60-0469-4730-ac72-d39c8fb4be77 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:22.277970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b86b8c60-0469-4730-ac72-d39c8fb4be77 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:22.285884 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b86b8c60-0469-4730-ac72-d39c8fb4be77 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1316 microversion: 2.1 time: 0.159347 Jul 20 05:09:22.286483 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3490/6995] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:22 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:23.303389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-00c7d42d-7e31-46a3-b5af-14b4f430f01c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:23.304047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-00c7d42d-7e31-46a3-b5af-14b4f430f01c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:23.311139 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00c7d42d-7e31-46a3-b5af-14b4f430f01c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:23.311599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00c7d42d-7e31-46a3-b5af-14b4f430f01c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:23.312373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00c7d42d-7e31-46a3-b5af-14b4f430f01c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:23.312819 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00c7d42d-7e31-46a3-b5af-14b4f430f01c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:23.452733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-00c7d42d-7e31-46a3-b5af-14b4f430f01c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:23.460493 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-00c7d42d-7e31-46a3-b5af-14b4f430f01c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1316 microversion: 2.1 time: 0.161704 Jul 20 05:09:23.461159 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3506/6996] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:23 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:24.477810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-20fbe4eb-4a31-4823-8fc9-4e0b2d6b4573 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:24.478478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-20fbe4eb-4a31-4823-8fc9-4e0b2d6b4573 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:24.485374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20fbe4eb-4a31-4823-8fc9-4e0b2d6b4573 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:24.485842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20fbe4eb-4a31-4823-8fc9-4e0b2d6b4573 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:24.487277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20fbe4eb-4a31-4823-8fc9-4e0b2d6b4573 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:24.487772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-20fbe4eb-4a31-4823-8fc9-4e0b2d6b4573 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:24.617823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-20fbe4eb-4a31-4823-8fc9-4e0b2d6b4573 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:24.625654 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-20fbe4eb-4a31-4823-8fc9-4e0b2d6b4573 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1316 microversion: 2.1 time: 0.151802 Jul 20 05:09:24.626230 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3491/6997] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:24 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:25.642747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d259cc50-2bf2-469e-8f66-a6c8372882f9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:25.643438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d259cc50-2bf2-469e-8f66-a6c8372882f9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:25.650576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d259cc50-2bf2-469e-8f66-a6c8372882f9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:25.651260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d259cc50-2bf2-469e-8f66-a6c8372882f9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:25.651823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d259cc50-2bf2-469e-8f66-a6c8372882f9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:25.652275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d259cc50-2bf2-469e-8f66-a6c8372882f9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:25.787787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d259cc50-2bf2-469e-8f66-a6c8372882f9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:25.795426 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d259cc50-2bf2-469e-8f66-a6c8372882f9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1316 microversion: 2.1 time: 0.156616 Jul 20 05:09:25.796020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3507/6998] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:25 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:25.888176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-dfca1378-236a-4d0b-90e5-6bafa2bda0b5 req-8a268cf4-8969-41e2-8e38-1cb8c722c595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dcff85-cbb1-41d6-8264-3ce224d4199f", "name": "network-vif-plugged", "status": "completed", "tag": "5d951312-4d39-4027-a037-b2c59e27ba94"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:25.897464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-dfca1378-236a-4d0b-90e5-6bafa2bda0b5 req-8a268cf4-8969-41e2-8e38-1cb8c722c595 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:25.897942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-dfca1378-236a-4d0b-90e5-6bafa2bda0b5 req-8a268cf4-8969-41e2-8e38-1cb8c722c595 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:25.910479 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-dfca1378-236a-4d0b-90e5-6bafa2bda0b5 req-8a268cf4-8969-41e2-8e38-1cb8c722c595 service nova] Creating event network-vif-plugged:5d951312-4d39-4027-a037-b2c59e27ba94 for instance c3dcff85-cbb1-41d6-8264-3ce224d4199f on n-h1-760456-11 Jul 20 05:09:25.915559 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-dfca1378-236a-4d0b-90e5-6bafa2bda0b5 req-8a268cf4-8969-41e2-8e38-1cb8c722c595 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031265 Jul 20 05:09:25.916325 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3492/6999] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:26.813727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bbe2a042-2f6c-4b8a-80ec-1e2109158568 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:26.814386 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bbe2a042-2f6c-4b8a-80ec-1e2109158568 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:26.817020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:26.817737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:26.824438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbe2a042-2f6c-4b8a-80ec-1e2109158568 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:26.824904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbe2a042-2f6c-4b8a-80ec-1e2109158568 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:26.825693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbe2a042-2f6c-4b8a-80ec-1e2109158568 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:26.826145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbe2a042-2f6c-4b8a-80ec-1e2109158568 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:26.961184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bbe2a042-2f6c-4b8a-80ec-1e2109158568 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:26.968799 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bbe2a042-2f6c-4b8a-80ec-1e2109158568 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1316 microversion: 2.1 time: 0.158971 Jul 20 05:09:26.969377 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3508/7000] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:26 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:27.983827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:27.989412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bad8f527-b294-4cf6-90b5-1d0b5d38e0c6 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:27.990140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bad8f527-b294-4cf6-90b5-1d0b5d38e0c6 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:27.996985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bad8f527-b294-4cf6-90b5-1d0b5d38e0c6 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:27.997462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bad8f527-b294-4cf6-90b5-1d0b5d38e0c6 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:27.998239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bad8f527-b294-4cf6-90b5-1d0b5d38e0c6 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:27.998714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bad8f527-b294-4cf6-90b5-1d0b5d38e0c6 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:28.133279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bad8f527-b294-4cf6-90b5-1d0b5d38e0c6 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:28.140980 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bad8f527-b294-4cf6-90b5-1d0b5d38e0c6 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1506 microversion: 2.1 time: 0.158196 Jul 20 05:09:28.141593 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3493/7001] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:27 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:28.195014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-889244262", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "dee3d27b-8559-4269-b7cd-3398609a2b44"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:28.247570 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] validate_networks() for [('dee3d27b-8559-4269-b7cd-3398609a2b44', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:09:28.621222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:09:28.621649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:09:28.622128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:09:28.622576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:09:28.622991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:09:28.632787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:28.633283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:28.634624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:28.634624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:28.652004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Getting quotas for project e6d5e15a9a4a435baa0f48e2828949db. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:09:28.657502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Getting quotas for user 22017528801846a1980f5dffac23e415 and project e6d5e15a9a4a435baa0f48e2828949db. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:09:28.670586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:09:28.672886 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:09:28.718612 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-77338b1b-98e8-4188-958d-f955bf535e7b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527306 Jul 20 05:09:28.719197 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3509/7002] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:09:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:09:28.730806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b89e51fd-f82a-4aa2-8498-6b8dcc93076b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:28.731625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b89e51fd-f82a-4aa2-8498-6b8dcc93076b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:28.787681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b89e51fd-f82a-4aa2-8498-6b8dcc93076b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:28.794567 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b89e51fd-f82a-4aa2-8498-6b8dcc93076b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1216 microversion: 2.1 time: 0.068512 Jul 20 05:09:28.795148 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3494/7003] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:28 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:29.813495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4faf1b29-7eb2-46ff-af51-d38137577cc9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:29.814560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4faf1b29-7eb2-46ff-af51-d38137577cc9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:29.822666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4faf1b29-7eb2-46ff-af51-d38137577cc9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:29.823156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4faf1b29-7eb2-46ff-af51-d38137577cc9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:29.824123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4faf1b29-7eb2-46ff-af51-d38137577cc9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:29.824802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4faf1b29-7eb2-46ff-af51-d38137577cc9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:29.827859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=60 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:29.890650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4faf1b29-7eb2-46ff-af51-d38137577cc9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:29.898708 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4faf1b29-7eb2-46ff-af51-d38137577cc9 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1274 microversion: 2.1 time: 0.090033 Jul 20 05:09:29.899290 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3510/7004] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:29 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:30.921811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-33422403-9cc9-4494-bb84-599ca308e88f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:30.922595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-33422403-9cc9-4494-bb84-599ca308e88f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:30.926026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:30.936954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-93130531-be0a-4627-8de9-c3466fb3fd61 req-13c105d3-3193-44b2-80a2-6d3fb2a44547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cc9bda-f5cc-4179-9b3c-df68169a077c", "tag": "a98b605f-7084-446e-9fbb-2816547731f9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:30.946428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-93130531-be0a-4627-8de9-c3466fb3fd61 req-13c105d3-3193-44b2-80a2-6d3fb2a44547 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:30.947182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-93130531-be0a-4627-8de9-c3466fb3fd61 req-13c105d3-3193-44b2-80a2-6d3fb2a44547 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:30.950282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33422403-9cc9-4494-bb84-599ca308e88f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:30.951416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33422403-9cc9-4494-bb84-599ca308e88f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:30.952295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33422403-9cc9-4494-bb84-599ca308e88f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:30.952830 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-33422403-9cc9-4494-bb84-599ca308e88f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:30.960773 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-93130531-be0a-4627-8de9-c3466fb3fd61 req-13c105d3-3193-44b2-80a2-6d3fb2a44547 service nova] Creating event network-changed:a98b605f-7084-446e-9fbb-2816547731f9 for instance 13cc9bda-f5cc-4179-9b3c-df68169a077c on n-h2-760456-11 Jul 20 05:09:30.972755 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-93130531-be0a-4627-8de9-c3466fb3fd61 req-13c105d3-3193-44b2-80a2-6d3fb2a44547 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040369 Jul 20 05:09:30.973642 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3511/7005] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:09:31.197465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-33422403-9cc9-4494-bb84-599ca308e88f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:31.205861 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-33422403-9cc9-4494-bb84-599ca308e88f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1316 microversion: 2.1 time: 0.292934 Jul 20 05:09:31.206588 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3495/7006] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:30 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:32.227821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f82cd0c9-4dea-4a2f-8bbc-b201897e22c5 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:32.228541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f82cd0c9-4dea-4a2f-8bbc-b201897e22c5 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:32.230530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:32.237290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f82cd0c9-4dea-4a2f-8bbc-b201897e22c5 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:32.237765 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f82cd0c9-4dea-4a2f-8bbc-b201897e22c5 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:32.238581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f82cd0c9-4dea-4a2f-8bbc-b201897e22c5 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:32.239034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f82cd0c9-4dea-4a2f-8bbc-b201897e22c5 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:32.369789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f82cd0c9-4dea-4a2f-8bbc-b201897e22c5 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:32.378144 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f82cd0c9-4dea-4a2f-8bbc-b201897e22c5 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1316 microversion: 2.1 time: 0.155399 Jul 20 05:09:32.378684 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3512/7007] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:32 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:33.395546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2e5fc25d-f3b0-40f8-afda-df9c0335924d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:33.396431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2e5fc25d-f3b0-40f8-afda-df9c0335924d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:33.403695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e5fc25d-f3b0-40f8-afda-df9c0335924d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:33.404166 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e5fc25d-f3b0-40f8-afda-df9c0335924d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:33.404949 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e5fc25d-f3b0-40f8-afda-df9c0335924d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:33.405402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2e5fc25d-f3b0-40f8-afda-df9c0335924d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:33.548550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2e5fc25d-f3b0-40f8-afda-df9c0335924d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:33.556573 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2e5fc25d-f3b0-40f8-afda-df9c0335924d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1316 microversion: 2.1 time: 0.165421 Jul 20 05:09:33.557148 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3496/7008] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:33 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:34.574102 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fd10dc06-27f7-44c4-9d90-a7991eebd5f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:34.574879 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fd10dc06-27f7-44c4-9d90-a7991eebd5f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:34.581874 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd10dc06-27f7-44c4-9d90-a7991eebd5f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:34.582476 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd10dc06-27f7-44c4-9d90-a7991eebd5f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:34.583343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd10dc06-27f7-44c4-9d90-a7991eebd5f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:34.583890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd10dc06-27f7-44c4-9d90-a7991eebd5f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:34.716652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fd10dc06-27f7-44c4-9d90-a7991eebd5f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:34.724773 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fd10dc06-27f7-44c4-9d90-a7991eebd5f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1316 microversion: 2.1 time: 0.154679 Jul 20 05:09:34.725358 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3513/7009] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:34 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:35.742273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-850d51f5-9a1e-4b0b-8090-5f7299458bd7 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:35.742952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-850d51f5-9a1e-4b0b-8090-5f7299458bd7 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:35.750532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-850d51f5-9a1e-4b0b-8090-5f7299458bd7 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:35.751005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-850d51f5-9a1e-4b0b-8090-5f7299458bd7 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:35.751797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-850d51f5-9a1e-4b0b-8090-5f7299458bd7 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:35.752916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-850d51f5-9a1e-4b0b-8090-5f7299458bd7 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:35.893239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-850d51f5-9a1e-4b0b-8090-5f7299458bd7 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:35.900849 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-850d51f5-9a1e-4b0b-8090-5f7299458bd7 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1316 microversion: 2.1 time: 0.162539 Jul 20 05:09:35.901427 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3497/7010] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:35 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:36.223220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-df122b50-1ae5-4e18-8904-11939d57e54e req-591be8a9-402f-4b44-b9cb-4059375d431a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cc9bda-f5cc-4179-9b3c-df68169a077c", "name": "network-vif-plugged", "status": "completed", "tag": "a98b605f-7084-446e-9fbb-2816547731f9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:36.234012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-df122b50-1ae5-4e18-8904-11939d57e54e req-591be8a9-402f-4b44-b9cb-4059375d431a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:36.234514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-df122b50-1ae5-4e18-8904-11939d57e54e req-591be8a9-402f-4b44-b9cb-4059375d431a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:36.250698 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-df122b50-1ae5-4e18-8904-11939d57e54e req-591be8a9-402f-4b44-b9cb-4059375d431a service nova] Creating event network-vif-plugged:a98b605f-7084-446e-9fbb-2816547731f9 for instance 13cc9bda-f5cc-4179-9b3c-df68169a077c on n-h2-760456-11 Jul 20 05:09:36.256363 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-df122b50-1ae5-4e18-8904-11939d57e54e req-591be8a9-402f-4b44-b9cb-4059375d431a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037431 Jul 20 05:09:36.256984 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3514/7011] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:36.917519 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c3fe0df-c292-424d-b50a-aee0ea85fc60 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:36.918276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c3fe0df-c292-424d-b50a-aee0ea85fc60 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:36.925477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c3fe0df-c292-424d-b50a-aee0ea85fc60 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:36.925955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c3fe0df-c292-424d-b50a-aee0ea85fc60 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:36.926783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c3fe0df-c292-424d-b50a-aee0ea85fc60 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:36.927243 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c3fe0df-c292-424d-b50a-aee0ea85fc60 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:37.060201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c3fe0df-c292-424d-b50a-aee0ea85fc60 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:37.068448 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c3fe0df-c292-424d-b50a-aee0ea85fc60 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1316 microversion: 2.1 time: 0.154961 Jul 20 05:09:37.069031 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3498/7012] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:36 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:38.087305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-73d05710-e950-4817-a94a-55cc04ac5ca4 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:38.088018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-73d05710-e950-4817-a94a-55cc04ac5ca4 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:38.095252 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73d05710-e950-4817-a94a-55cc04ac5ca4 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:38.096511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73d05710-e950-4817-a94a-55cc04ac5ca4 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:38.097407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73d05710-e950-4817-a94a-55cc04ac5ca4 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:38.097945 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-73d05710-e950-4817-a94a-55cc04ac5ca4 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:38.235700 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-73d05710-e950-4817-a94a-55cc04ac5ca4 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:38.243355 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-73d05710-e950-4817-a94a-55cc04ac5ca4 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1505 microversion: 2.1 time: 0.160471 Jul 20 05:09:38.243931 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3515/7013] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:38 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:38.259588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bb61c927-d59a-45b0-99ce-49cf35f2fddb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:38.260114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bb61c927-d59a-45b0-99ce-49cf35f2fddb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:38.268000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb61c927-d59a-45b0-99ce-49cf35f2fddb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:38.268820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb61c927-d59a-45b0-99ce-49cf35f2fddb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:38.269617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb61c927-d59a-45b0-99ce-49cf35f2fddb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:38.270075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb61c927-d59a-45b0-99ce-49cf35f2fddb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:38.295550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bb61c927-d59a-45b0-99ce-49cf35f2fddb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:09:38.374799 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bb61c927-d59a-45b0-99ce-49cf35f2fddb tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "DELETE /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 204 len: 0 microversion: 2.1 time: 0.118299 Jul 20 05:09:38.375592 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3499/7014] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:38 2022] DELETE /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:09:38.387720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-09b39101-3d19-4b76-9057-62c592f4672c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:38.388825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-09b39101-3d19-4b76-9057-62c592f4672c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:38.399920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09b39101-3d19-4b76-9057-62c592f4672c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:38.400803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09b39101-3d19-4b76-9057-62c592f4672c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:38.401677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09b39101-3d19-4b76-9057-62c592f4672c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:38.402142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09b39101-3d19-4b76-9057-62c592f4672c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:38.546571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09b39101-3d19-4b76-9057-62c592f4672c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:38.554951 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-09b39101-3d19-4b76-9057-62c592f4672c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1511 microversion: 2.1 time: 0.173607 Jul 20 05:09:38.555533 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3516/7015] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:38 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:39.573583 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c32d9e3-9bf4-4a2c-9e4f-002cc3b67ef0 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:39.574330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c32d9e3-9bf4-4a2c-9e4f-002cc3b67ef0 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:39.576309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:39.583618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c32d9e3-9bf4-4a2c-9e4f-002cc3b67ef0 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:39.584093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c32d9e3-9bf4-4a2c-9e4f-002cc3b67ef0 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:39.584888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c32d9e3-9bf4-4a2c-9e4f-002cc3b67ef0 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:39.585346 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c32d9e3-9bf4-4a2c-9e4f-002cc3b67ef0 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:39.793027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3c32d9e3-9bf4-4a2c-9e4f-002cc3b67ef0 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:39.801799 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c32d9e3-9bf4-4a2c-9e4f-002cc3b67ef0 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 200 len: 1511 microversion: 2.1 time: 0.232556 Jul 20 05:09:39.802795 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3500/7016] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:39 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:40.179986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-0fd4affa-53c0-4a35-b65f-5d984eea0010 req-eab84dfe-53d6-4e59-9cfa-455311e15ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cc9bda-f5cc-4179-9b3c-df68169a077c", "name": "network-vif-deleted", "tag": "a98b605f-7084-446e-9fbb-2816547731f9"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:40.190586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:40.191581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:40.211955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0fd4affa-53c0-4a35-b65f-5d984eea0010 req-eab84dfe-53d6-4e59-9cfa-455311e15ed2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:40.214606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0fd4affa-53c0-4a35-b65f-5d984eea0010 req-eab84dfe-53d6-4e59-9cfa-455311e15ed2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:40.244678 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-0fd4affa-53c0-4a35-b65f-5d984eea0010 req-eab84dfe-53d6-4e59-9cfa-455311e15ed2 service nova] Creating event network-vif-deleted:a98b605f-7084-446e-9fbb-2816547731f9 for instance 13cc9bda-f5cc-4179-9b3c-df68169a077c on n-h2-760456-11 Jul 20 05:09:40.250814 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-0fd4affa-53c0-4a35-b65f-5d984eea0010 req-eab84dfe-53d6-4e59-9cfa-455311e15ed2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075057 Jul 20 05:09:40.252967 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3517/7017] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:40.820840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75a5ada4-e2f5-4bb8-9e48-338f45acf3af tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:40.821501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-75a5ada4-e2f5-4bb8-9e48-338f45acf3af tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:40.828641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75a5ada4-e2f5-4bb8-9e48-338f45acf3af tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:40.829117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75a5ada4-e2f5-4bb8-9e48-338f45acf3af tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:40.830679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75a5ada4-e2f5-4bb8-9e48-338f45acf3af tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:40.831157 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-75a5ada4-e2f5-4bb8-9e48-338f45acf3af tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:40.844745 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-75a5ada4-e2f5-4bb8-9e48-338f45acf3af tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] HTTP exception thrown: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75a5ada4-e2f5-4bb8-9e48-338f45acf3af tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Request method failure captured: Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c HTTP/1.1 Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi1437Njpxrfkr1wPEgtLtfEqRMsGnEPs-nzLZxcDKPsaA1VNqrS4uN_rncUx3FWldKGX4HzF4JdU-8HTFBWJu5LCFkXnpwoB4Sxev7fWmJ_jOYhxR40vx7ivDtl0d34RSDUmHL8fkVCo81h5lQUisUMHdYZqjbL-SnyE9tqglayiETxQ Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 22017528801846a1980f5dffac23e415 Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '13cc9bda-f5cc-4179-9b3c-df68169a077c'} Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:40.846470 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:40.850870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:40.850870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:40.850870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:40.850870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:40.850870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:40.850870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:40.850870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:40.850870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-75a5ada4-e2f5-4bb8-9e48-338f45acf3af tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Returning 404 to user: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:40.850870 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-75a5ada4-e2f5-4bb8-9e48-338f45acf3af tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 404 len: 111 microversion: 2.1 time: 0.031025 Jul 20 05:09:40.850870 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3501/7018] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:40 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:40.857498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3c9bbb8a-7e7f-41cf-8ae5-472e1423f1db tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:40.858204 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3c9bbb8a-7e7f-41cf-8ae5-472e1423f1db tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:40.864794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c9bbb8a-7e7f-41cf-8ae5-472e1423f1db tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:40.865246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c9bbb8a-7e7f-41cf-8ae5-472e1423f1db tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:40.866012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c9bbb8a-7e7f-41cf-8ae5-472e1423f1db tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:40.866529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3c9bbb8a-7e7f-41cf-8ae5-472e1423f1db tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:40.996577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3c9bbb8a-7e7f-41cf-8ae5-472e1423f1db tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:41.004827 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3c9bbb8a-7e7f-41cf-8ae5-472e1423f1db tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1506 microversion: 2.1 time: 0.151532 Jul 20 05:09:41.005408 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3518/7019] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:40 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:41.021129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a234f1af-66eb-4f9c-8555-76ba11309c8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:41.022124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a234f1af-66eb-4f9c-8555-76ba11309c8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 8450456e-eeb2-4b7c-9d92-477940ba0e33] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.027757 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-a234f1af-66eb-4f9c-8555-76ba11309c8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] HTTP exception thrown: Instance 8450456e-eeb2-4b7c-9d92-477940ba0e33 could not be found. Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a234f1af-66eb-4f9c-8555-76ba11309c8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Request method failure captured: Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/8450456e-eeb2-4b7c-9d92-477940ba0e33/action HTTP/1.1 Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 32 Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi1437Njpxrfkr1wPEgtLtfEqRMsGnEPs-nzLZxcDKPsaA1VNqrS4uN_rncUx3FWldKGX4HzF4JdU-8HTFBWJu5LCFkXnpwoB4Sxev7fWmJ_jOYhxR40vx7ivDtl0d34RSDUmHL8fkVCo81h5lQUisUMHdYZqjbL-SnyE9tqglayiETxQ Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 22017528801846a1980f5dffac23e415 Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: {"resize": {"flavorRef": "452"}} Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 8450456e-eeb2-4b7c-9d92-477940ba0e33 could not be found. Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '8450456e-eeb2-4b7c-9d92-477940ba0e33', 'body': {'resize': {'flavorRef': '452'}}} Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8450456e-eeb2-4b7c-9d92-477940ba0e33 could not be found. Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:41.029344 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8450456e-eeb2-4b7c-9d92-477940ba0e33 could not be found. Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8450456e-eeb2-4b7c-9d92-477940ba0e33 could not be found. Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a234f1af-66eb-4f9c-8555-76ba11309c8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Returning 404 to user: Instance 8450456e-eeb2-4b7c-9d92-477940ba0e33 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a234f1af-66eb-4f9c-8555-76ba11309c8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "POST /compute/v2.1/servers/8450456e-eeb2-4b7c-9d92-477940ba0e33/action" status: 404 len: 111 microversion: 2.1 time: 0.013675 Jul 20 05:09:41.033443 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3502/7020] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:09:41 2022] POST /compute/v2.1/servers/8450456e-eeb2-4b7c-9d92-477940ba0e33/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:41.039147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7ce755b-a457-490e-b5f1-756ab9a199d2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:41.039778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7ce755b-a457-490e-b5f1-756ab9a199d2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.045763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ce755b-a457-490e-b5f1-756ab9a199d2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.046227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ce755b-a457-490e-b5f1-756ab9a199d2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.047122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ce755b-a457-490e-b5f1-756ab9a199d2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.047579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ce755b-a457-490e-b5f1-756ab9a199d2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.181460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e7ce755b-a457-490e-b5f1-756ab9a199d2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:41.189954 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7ce755b-a457-490e-b5f1-756ab9a199d2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1506 microversion: 2.1 time: 0.153896 Jul 20 05:09:41.190845 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3519/7021] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:41 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:41.207375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5caa1bc0-46b3-47fd-921e-3d39befd55e2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:41.208002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5caa1bc0-46b3-47fd-921e-3d39befd55e2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.214997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5caa1bc0-46b3-47fd-921e-3d39befd55e2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.215460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5caa1bc0-46b3-47fd-921e-3d39befd55e2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.216233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5caa1bc0-46b3-47fd-921e-3d39befd55e2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.216714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5caa1bc0-46b3-47fd-921e-3d39befd55e2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.350424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5caa1bc0-46b3-47fd-921e-3d39befd55e2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:41.358109 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5caa1bc0-46b3-47fd-921e-3d39befd55e2 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1506 microversion: 2.1 time: 0.154751 Jul 20 05:09:41.358713 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3503/7022] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:41 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:41.375544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "047b2529-78bc-4350-87bd-63ca5bca4226"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:41.376458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.382809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.383273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.384060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.384508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.413314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:41.418391 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] HTTP exception thrown: Flavor 047b2529-78bc-4350-87bd-63ca5bca4226 could not be found. Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Request method failure captured: Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: request: POST /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f/action HTTP/1.1 Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 65 Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1437Njpxrfkr1wPEgtLtfEqRMsGnEPs-nzLZxcDKPsaA1VNqrS4uN_rncUx3FWldKGX4HzF4JdU-8HTFBWJu5LCFkXnpwoB4Sxev7fWmJ_jOYhxR40vx7ivDtl0d34RSDUmHL8fkVCo81h5lQUisUMHdYZqjbL-SnyE9tqglayiETxQ Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 22017528801846a1980f5dffac23e415 Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: {"resize": {"flavorRef": "047b2529-78bc-4350-87bd-63ca5bca4226"}} Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: exception: Flavor 047b2529-78bc-4350-87bd-63ca5bca4226 could not be found. Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'c3dcff85-cbb1-41d6-8264-3ce224d4199f', 'body': {'resize': {'flavorRef': '047b2529-78bc-4350-87bd-63ca5bca4226'}}} Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 05:09:41.420319 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 047b2529-78bc-4350-87bd-63ca5bca4226 could not be found. Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 047b2529-78bc-4350-87bd-63ca5bca4226 could not be found. Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 047b2529-78bc-4350-87bd-63ca5bca4226 could not be found. Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Returning 400 to user: Flavor 047b2529-78bc-4350-87bd-63ca5bca4226 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8774dcb7-0463-4ae9-ab94-e0efb47bff02 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "POST /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f/action" status: 400 len: 107 microversion: 2.1 time: 0.050395 Jul 20 05:09:41.424673 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3520/7023] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:09:41 2022] POST /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f/action => generated 107 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 05:09:41.430922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-adc6b552-3b1a-48f2-b7de-ba9fc34a3025 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:41.431559 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-adc6b552-3b1a-48f2-b7de-ba9fc34a3025 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.437865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adc6b552-3b1a-48f2-b7de-ba9fc34a3025 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.438398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adc6b552-3b1a-48f2-b7de-ba9fc34a3025 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.439305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adc6b552-3b1a-48f2-b7de-ba9fc34a3025 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.439907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adc6b552-3b1a-48f2-b7de-ba9fc34a3025 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.574307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-adc6b552-3b1a-48f2-b7de-ba9fc34a3025 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:41.582463 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-adc6b552-3b1a-48f2-b7de-ba9fc34a3025 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1506 microversion: 2.1 time: 0.155505 Jul 20 05:09:41.583048 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3504/7024] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:41 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:41.599943 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97f2867b-8525-45ff-8e59-62aad6905c8e tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:41.600598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97f2867b-8525-45ff-8e59-62aad6905c8e tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.606775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97f2867b-8525-45ff-8e59-62aad6905c8e tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.607243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97f2867b-8525-45ff-8e59-62aad6905c8e tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.608025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97f2867b-8525-45ff-8e59-62aad6905c8e tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.608479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97f2867b-8525-45ff-8e59-62aad6905c8e tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.740149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97f2867b-8525-45ff-8e59-62aad6905c8e tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:41.748143 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97f2867b-8525-45ff-8e59-62aad6905c8e tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1506 microversion: 2.1 time: 0.152797 Jul 20 05:09:41.748721 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3521/7025] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:41 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:41.765183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-982a4103-4403-4d14-b947-5a3dcfb0675f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-982a4103-4403-4d14-b947-5a3dcfb0675f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Request method failure captured: Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: request: POST /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f/action HTTP/1.1 Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 29 Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi1437Njpxrfkr1wPEgtLtfEqRMsGnEPs-nzLZxcDKPsaA1VNqrS4uN_rncUx3FWldKGX4HzF4JdU-8HTFBWJu5LCFkXnpwoB4Sxev7fWmJ_jOYhxR40vx7ivDtl0d34RSDUmHL8fkVCo81h5lQUisUMHdYZqjbL-SnyE9tqglayiETxQ Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 22017528801846a1980f5dffac23e415 Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: {"resize": {"flavorRef": ""}} Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c3dcff85-cbb1-41d6-8264-3ce224d4199f', 'body': {'resize': {'flavorRef': ''}}} Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise error Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi '' Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:41.772024 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.777816 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.777816 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:41.777816 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:41.777816 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 05:09:41.777816 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 05:09:41.777816 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:09:41.777816 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.777816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-982a4103-4403-4d14-b947-5a3dcfb0675f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:41.777816 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-982a4103-4403-4d14-b947-5a3dcfb0675f tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "POST /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f/action" status: 400 len: 113 microversion: 2.1 time: 0.012326 Jul 20 05:09:41.777816 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3505/7026] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:09:41 2022] POST /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f/action => generated 113 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 05:09:41.781757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fd96fe16-d792-4a3a-81cd-c75c232bcf29 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:41.782444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fd96fe16-d792-4a3a-81cd-c75c232bcf29 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.788822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd96fe16-d792-4a3a-81cd-c75c232bcf29 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.789283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd96fe16-d792-4a3a-81cd-c75c232bcf29 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.790058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd96fe16-d792-4a3a-81cd-c75c232bcf29 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.790528 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd96fe16-d792-4a3a-81cd-c75c232bcf29 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.919910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fd96fe16-d792-4a3a-81cd-c75c232bcf29 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:41.929006 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fd96fe16-d792-4a3a-81cd-c75c232bcf29 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1506 microversion: 2.1 time: 0.151090 Jul 20 05:09:41.929614 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3522/7027] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:41 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:41.950424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-82736307-b416-4599-8707-6a6cfc78078b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:41.950922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-82736307-b416-4599-8707-6a6cfc78078b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.958059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82736307-b416-4599-8707-6a6cfc78078b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.958568 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82736307-b416-4599-8707-6a6cfc78078b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.959351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82736307-b416-4599-8707-6a6cfc78078b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.959804 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82736307-b416-4599-8707-6a6cfc78078b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.973244 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-82736307-b416-4599-8707-6a6cfc78078b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] HTTP exception thrown: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-82736307-b416-4599-8707-6a6cfc78078b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Request method failure captured: Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c HTTP/1.1 Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi1437Njpxrfkr1wPEgtLtfEqRMsGnEPs-nzLZxcDKPsaA1VNqrS4uN_rncUx3FWldKGX4HzF4JdU-8HTFBWJu5LCFkXnpwoB4Sxev7fWmJ_jOYhxR40vx7ivDtl0d34RSDUmHL8fkVCo81h5lQUisUMHdYZqjbL-SnyE9tqglayiETxQ Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 22017528801846a1980f5dffac23e415 Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '13cc9bda-f5cc-4179-9b3c-df68169a077c'} Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:41.974870 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-82736307-b416-4599-8707-6a6cfc78078b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Returning 404 to user: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-82736307-b416-4599-8707-6a6cfc78078b tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "DELETE /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 404 len: 111 microversion: 2.1 time: 0.030992 Jul 20 05:09:41.978658 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3506/7028] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:41 2022] DELETE /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:41.984865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a882589-1c74-4e65-8aab-e17a943a860d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:41.985630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3a882589-1c74-4e65-8aab-e17a943a860d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: 13cc9bda-f5cc-4179-9b3c-df68169a077c] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.992877 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a882589-1c74-4e65-8aab-e17a943a860d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.993336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a882589-1c74-4e65-8aab-e17a943a860d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.994164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a882589-1c74-4e65-8aab-e17a943a860d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.994639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a882589-1c74-4e65-8aab-e17a943a860d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:42.008670 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-3a882589-1c74-4e65-8aab-e17a943a860d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] HTTP exception thrown: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a882589-1c74-4e65-8aab-e17a943a860d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Request method failure captured: Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c HTTP/1.1 Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi1437Njpxrfkr1wPEgtLtfEqRMsGnEPs-nzLZxcDKPsaA1VNqrS4uN_rncUx3FWldKGX4HzF4JdU-8HTFBWJu5LCFkXnpwoB4Sxev7fWmJ_jOYhxR40vx7ivDtl0d34RSDUmHL8fkVCo81h5lQUisUMHdYZqjbL-SnyE9tqglayiETxQ Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 22017528801846a1980f5dffac23e415 Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '13cc9bda-f5cc-4179-9b3c-df68169a077c'} Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:42.010218 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:42.014416 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:42.014416 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:42.014416 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:42.014416 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:42.014416 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:42.014416 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. Jul 20 05:09:42.014416 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:09:42.014416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a882589-1c74-4e65-8aab-e17a943a860d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Returning 404 to user: Instance 13cc9bda-f5cc-4179-9b3c-df68169a077c could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:42.014416 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3a882589-1c74-4e65-8aab-e17a943a860d tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c" status: 404 len: 111 microversion: 2.1 time: 0.030705 Jul 20 05:09:42.014416 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3523/7029] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:41 2022] GET /compute/v2.1/servers/13cc9bda-f5cc-4179-9b3c-df68169a077c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:09:42.020295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6447f8d2-eb68-4d4f-8f2d-25e8316d05ab tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:42.020819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6447f8d2-eb68-4d4f-8f2d-25e8316d05ab tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:42.026923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6447f8d2-eb68-4d4f-8f2d-25e8316d05ab tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:42.027398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6447f8d2-eb68-4d4f-8f2d-25e8316d05ab tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:42.028186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6447f8d2-eb68-4d4f-8f2d-25e8316d05ab tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:42.028648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6447f8d2-eb68-4d4f-8f2d-25e8316d05ab tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:42.055013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6447f8d2-eb68-4d4f-8f2d-25e8316d05ab tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:09:42.057781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:42.133413 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6447f8d2-eb68-4d4f-8f2d-25e8316d05ab tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 204 len: 0 microversion: 2.1 time: 0.116736 Jul 20 05:09:42.134018 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3507/7030] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:42 2022] DELETE /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:09:42.143357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8c0961f8-a7c1-4469-ac4c-b82e24b5fc8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:42.143996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8c0961f8-a7c1-4469-ac4c-b82e24b5fc8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:42.150597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c0961f8-a7c1-4469-ac4c-b82e24b5fc8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:42.151063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c0961f8-a7c1-4469-ac4c-b82e24b5fc8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:42.151839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c0961f8-a7c1-4469-ac4c-b82e24b5fc8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:42.152313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8c0961f8-a7c1-4469-ac4c-b82e24b5fc8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:42.285906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8c0961f8-a7c1-4469-ac4c-b82e24b5fc8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:42.293679 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8c0961f8-a7c1-4469-ac4c-b82e24b5fc8c tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1512 microversion: 2.1 time: 0.154840 Jul 20 05:09:42.294374 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3524/7031] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:42 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:43.312155 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0dae1d50-950e-4462-a53e-687b32b75426 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:43.312872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0dae1d50-950e-4462-a53e-687b32b75426 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:43.320417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0dae1d50-950e-4462-a53e-687b32b75426 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:43.320885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0dae1d50-950e-4462-a53e-687b32b75426 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:43.321667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0dae1d50-950e-4462-a53e-687b32b75426 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:43.322130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0dae1d50-950e-4462-a53e-687b32b75426 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:43.456727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0dae1d50-950e-4462-a53e-687b32b75426 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22017528801846a1980f5dffac23e415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d5e15a9a4a435baa0f48e2828949db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:43.464471 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0dae1d50-950e-4462-a53e-687b32b75426 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 200 len: 1512 microversion: 2.1 time: 0.156666 Jul 20 05:09:43.465136 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3508/7032] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:43 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:43.932463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ee24d247-fea3-47bc-b429-4f32d5ed54e2 req-55967d43-5f8e-4aba-a89f-fe5963d2ab14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dcff85-cbb1-41d6-8264-3ce224d4199f", "name": "network-vif-deleted", "tag": "5d951312-4d39-4027-a037-b2c59e27ba94"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:43.942422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ee24d247-fea3-47bc-b429-4f32d5ed54e2 req-55967d43-5f8e-4aba-a89f-fe5963d2ab14 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:43.942885 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ee24d247-fea3-47bc-b429-4f32d5ed54e2 req-55967d43-5f8e-4aba-a89f-fe5963d2ab14 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:43.958797 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ee24d247-fea3-47bc-b429-4f32d5ed54e2 req-55967d43-5f8e-4aba-a89f-fe5963d2ab14 service nova] Creating event network-vif-deleted:5d951312-4d39-4027-a037-b2c59e27ba94 for instance c3dcff85-cbb1-41d6-8264-3ce224d4199f on n-h1-760456-11 Jul 20 05:09:43.963556 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ee24d247-fea3-47bc-b429-4f32d5ed54e2 req-55967d43-5f8e-4aba-a89f-fe5963d2ab14 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035046 Jul 20 05:09:43.964176 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3525/7033] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:44.482641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d5e6b48-62fe-41cb-a29f-df3706eee6f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:44.483277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d5e6b48-62fe-41cb-a29f-df3706eee6f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] [instance: c3dcff85-cbb1-41d6-8264-3ce224d4199f] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:44.490812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d5e6b48-62fe-41cb-a29f-df3706eee6f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:44.491282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d5e6b48-62fe-41cb-a29f-df3706eee6f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:44.492060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d5e6b48-62fe-41cb-a29f-df3706eee6f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:44.492511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d5e6b48-62fe-41cb-a29f-df3706eee6f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:44.508666 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-1d5e6b48-62fe-41cb-a29f-df3706eee6f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] HTTP exception thrown: Instance c3dcff85-cbb1-41d6-8264-3ce224d4199f could not be found. Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d5e6b48-62fe-41cb-a29f-df3706eee6f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Request method failure captured: Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f HTTP/1.1 Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi1437Njpxrfkr1wPEgtLtfEqRMsGnEPs-nzLZxcDKPsaA1VNqrS4uN_rncUx3FWldKGX4HzF4JdU-8HTFBWJu5LCFkXnpwoB4Sxev7fWmJ_jOYhxR40vx7ivDtl0d34RSDUmHL8fkVCo81h5lQUisUMHdYZqjbL-SnyE9tqglayiETxQ Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6d5e15a9a4a435baa0f48e2828949db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: e6d5e15a9a4a435baa0f48e2828949db Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-ServersNegativeTestJSON-973939467 Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 22017528801846a1980f5dffac23e415 Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-ServersNegativeTestJSON-973939467-project Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance c3dcff85-cbb1-41d6-8264-3ce224d4199f could not be found. Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'c3dcff85-cbb1-41d6-8264-3ce224d4199f'} Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3dcff85-cbb1-41d6-8264-3ce224d4199f could not be found. Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3dcff85-cbb1-41d6-8264-3ce224d4199f could not be found. Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:44.510399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:44.514180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:44.514180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:44.514180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:44.514180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:44.514180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:44.514180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3dcff85-cbb1-41d6-8264-3ce224d4199f could not be found. Jul 20 05:09:44.514180 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:09:44.514180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d5e6b48-62fe-41cb-a29f-df3706eee6f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] Returning 404 to user: Instance c3dcff85-cbb1-41d6-8264-3ce224d4199f could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:44.514180 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d5e6b48-62fe-41cb-a29f-df3706eee6f3 tempest-ServersNegativeTestJSON-973939467 tempest-ServersNegativeTestJSON-973939467-project] 10.222.0.59 "GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f" status: 404 len: 111 microversion: 2.1 time: 0.033105 Jul 20 05:09:44.514180 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3509/7034] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:44 2022] GET /compute/v2.1/servers/c3dcff85-cbb1-41d6-8264-3ce224d4199f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:10:16.106442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=29 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:16.107193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=73 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:16.320389 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4399eef9-1f60-42ac-8308-f49a1e88b370 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Action: 'create', calling method: .version_select at 0x7fb841bfc790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-251126487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBH8G61xtaiz93/Sr7wHb5vqAhuKrqpqDuGaXzDZ4bk/WfIPBHE8a0AAo+xmlu3W26B5LFs3mqy0S8JRWVKZGcBsirL5N0DomtHhIi1shz+uFBQsmiipoT+86EIYNobNww=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:16.335833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4399eef9-1f60-42ac-8308-f49a1e88b370 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Getting quotas for project 930c4205c4f54aa697996dde54ab9aa1. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:10:16.341436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4399eef9-1f60-42ac-8308-f49a1e88b370 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Getting quotas for user 7291a15c5eae47449f8ba724bcbee32e and project 930c4205c4f54aa697996dde54ab9aa1. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:10:16.372562 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4399eef9-1f60-42ac-8308-f49a1e88b370 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.270618 Jul 20 05:10:16.373299 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3526/7035] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:10:16 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:16.423395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1764313719", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-251126487", "networks": [{"uuid": "cb9e305f-da00-48a2-beef-8ffe4ac7f98f"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:16.431277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:16.431954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:16.652396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] validate_networks() for [('cb9e305f-da00-48a2-beef-8ffe4ac7f98f', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:10:17.030943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:10:17.031389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:10:17.031889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:10:17.032360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:10:17.032793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:10:17.041971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:17.042490 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:17.043318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:17.043780 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:17.062423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Getting quotas for project 930c4205c4f54aa697996dde54ab9aa1. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:10:17.068414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Getting quotas for user 7291a15c5eae47449f8ba724bcbee32e and project 930c4205c4f54aa697996dde54ab9aa1. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:10:17.080762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:10:17.083104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:10:17.128299 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [7ba94ed2-cf1b-4861-bf6b-3cd08e35f9b7] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:10:18.137406 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [7ba94ed2-cf1b-4861-bf6b-3cd08e35f9b7] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 48154. Jul 20 05:10:18.143824 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16150646-1fc5-4f3c-b1c8-d0e37d2d4664 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724750 Jul 20 05:10:18.144690 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3510/7036] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:10:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:10:18.154461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5a1e3096-c98a-46e8-9d4f-08eee063f946 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:18.155141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5a1e3096-c98a-46e8-9d4f-08eee063f946 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:18.348782 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5a1e3096-c98a-46e8-9d4f-08eee063f946 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:18.357528 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5a1e3096-c98a-46e8-9d4f-08eee063f946 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1262 microversion: 2.1 time: 0.207046 Jul 20 05:10:18.358340 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3527/7037] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:18 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1262 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:19.380309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ec6d9298-b082-4e00-80d3-e3fcc58b0777 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:19.381080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ec6d9298-b082-4e00-80d3-e3fcc58b0777 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:19.388394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec6d9298-b082-4e00-80d3-e3fcc58b0777 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:19.388870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec6d9298-b082-4e00-80d3-e3fcc58b0777 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:19.389672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec6d9298-b082-4e00-80d3-e3fcc58b0777 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:19.390321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ec6d9298-b082-4e00-80d3-e3fcc58b0777 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:19.478654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ec6d9298-b082-4e00-80d3-e3fcc58b0777 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:19.487464 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ec6d9298-b082-4e00-80d3-e3fcc58b0777 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1320 microversion: 2.1 time: 0.112902 Jul 20 05:10:19.488352 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3511/7038] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:19 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1320 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:20.505241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7aad9e89-5e78-4546-8fe9-1f87e66f0bac tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:20.505699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7aad9e89-5e78-4546-8fe9-1f87e66f0bac tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:20.513092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aad9e89-5e78-4546-8fe9-1f87e66f0bac tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:20.513547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aad9e89-5e78-4546-8fe9-1f87e66f0bac tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:20.514353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aad9e89-5e78-4546-8fe9-1f87e66f0bac tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:20.514802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7aad9e89-5e78-4546-8fe9-1f87e66f0bac tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:20.659125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7aad9e89-5e78-4546-8fe9-1f87e66f0bac tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:20.666855 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7aad9e89-5e78-4546-8fe9-1f87e66f0bac tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1362 microversion: 2.1 time: 0.165779 Jul 20 05:10:20.667557 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3528/7039] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:20 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:20.701179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-5a48865b-bf54-4d71-b8c9-ad892ba2bbea req-56fc0394-7c30-461b-ac21-1ce25406143c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c5a221-089e-4652-a16f-7d2c1b4f92c3", "tag": "89de95ae-6bb1-46a4-8e23-b19a2d532f9b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:20.721512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5a48865b-bf54-4d71-b8c9-ad892ba2bbea req-56fc0394-7c30-461b-ac21-1ce25406143c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:20.722105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-5a48865b-bf54-4d71-b8c9-ad892ba2bbea req-56fc0394-7c30-461b-ac21-1ce25406143c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:20.741169 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-5a48865b-bf54-4d71-b8c9-ad892ba2bbea req-56fc0394-7c30-461b-ac21-1ce25406143c service nova] Creating event network-changed:89de95ae-6bb1-46a4-8e23-b19a2d532f9b for instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 on n-h2-760456-11 Jul 20 05:10:20.748771 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-5a48865b-bf54-4d71-b8c9-ad892ba2bbea req-56fc0394-7c30-461b-ac21-1ce25406143c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051323 Jul 20 05:10:20.749613 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3512/7040] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:21.684776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5d5f6961-fdc0-421c-b497-b31e41922856 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:21.685395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5d5f6961-fdc0-421c-b497-b31e41922856 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:21.693088 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d5f6961-fdc0-421c-b497-b31e41922856 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:21.693545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d5f6961-fdc0-421c-b497-b31e41922856 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:21.694346 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d5f6961-fdc0-421c-b497-b31e41922856 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:21.694793 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5d5f6961-fdc0-421c-b497-b31e41922856 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:21.827979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5d5f6961-fdc0-421c-b497-b31e41922856 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:21.836095 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5d5f6961-fdc0-421c-b497-b31e41922856 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1362 microversion: 2.1 time: 0.155302 Jul 20 05:10:21.836877 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3529/7041] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:21 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:22.855216 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f71f6c2-a272-490e-9e5e-d2cb772fc2bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:22.855925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6f71f6c2-a272-490e-9e5e-d2cb772fc2bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:22.863359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f71f6c2-a272-490e-9e5e-d2cb772fc2bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:22.863775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f71f6c2-a272-490e-9e5e-d2cb772fc2bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:22.864574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f71f6c2-a272-490e-9e5e-d2cb772fc2bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:22.865035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f71f6c2-a272-490e-9e5e-d2cb772fc2bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:23.002968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6f71f6c2-a272-490e-9e5e-d2cb772fc2bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:23.010955 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f71f6c2-a272-490e-9e5e-d2cb772fc2bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1362 microversion: 2.1 time: 0.160753 Jul 20 05:10:23.011777 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3513/7042] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:22 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:24.029212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8572230d-591b-450c-8360-8bc1686b6960 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:24.029849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8572230d-591b-450c-8360-8bc1686b6960 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:24.039404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8572230d-591b-450c-8360-8bc1686b6960 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:24.040114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8572230d-591b-450c-8360-8bc1686b6960 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:24.041299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8572230d-591b-450c-8360-8bc1686b6960 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:24.041983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8572230d-591b-450c-8360-8bc1686b6960 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:24.185423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8572230d-591b-450c-8360-8bc1686b6960 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:24.193004 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8572230d-591b-450c-8360-8bc1686b6960 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1362 microversion: 2.1 time: 0.167730 Jul 20 05:10:24.193603 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3530/7043] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:24 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:25.210175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-535ba144-dbb6-43d2-9deb-cf1a560036ce tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:25.210842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-535ba144-dbb6-43d2-9deb-cf1a560036ce tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:25.217724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-535ba144-dbb6-43d2-9deb-cf1a560036ce tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:25.218196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-535ba144-dbb6-43d2-9deb-cf1a560036ce tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:25.219022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-535ba144-dbb6-43d2-9deb-cf1a560036ce tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:25.219481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-535ba144-dbb6-43d2-9deb-cf1a560036ce tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:25.347443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-535ba144-dbb6-43d2-9deb-cf1a560036ce tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:25.355421 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-535ba144-dbb6-43d2-9deb-cf1a560036ce tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1362 microversion: 2.1 time: 0.149139 Jul 20 05:10:25.355934 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3514/7044] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:25 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:26.373299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b26a2a63-264c-4f81-896e-1e197d2bf083 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:26.374033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b26a2a63-264c-4f81-896e-1e197d2bf083 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:26.382372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b26a2a63-264c-4f81-896e-1e197d2bf083 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:26.382839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b26a2a63-264c-4f81-896e-1e197d2bf083 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:26.383625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b26a2a63-264c-4f81-896e-1e197d2bf083 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:26.384075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b26a2a63-264c-4f81-896e-1e197d2bf083 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:26.389359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-291202b6-dd60-4bb3-9a88-6212c981ee38 req-715f7e9a-c6ad-4bd5-a1a6-ee1c91bfc733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c5a221-089e-4652-a16f-7d2c1b4f92c3", "name": "network-vif-plugged", "status": "completed", "tag": "89de95ae-6bb1-46a4-8e23-b19a2d532f9b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:26.399837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-291202b6-dd60-4bb3-9a88-6212c981ee38 req-715f7e9a-c6ad-4bd5-a1a6-ee1c91bfc733 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:26.400354 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-291202b6-dd60-4bb3-9a88-6212c981ee38 req-715f7e9a-c6ad-4bd5-a1a6-ee1c91bfc733 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:26.414339 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-291202b6-dd60-4bb3-9a88-6212c981ee38 req-715f7e9a-c6ad-4bd5-a1a6-ee1c91bfc733 service nova] Creating event network-vif-plugged:89de95ae-6bb1-46a4-8e23-b19a2d532f9b for instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 on n-h2-760456-11 Jul 20 05:10:26.420234 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-291202b6-dd60-4bb3-9a88-6212c981ee38 req-715f7e9a-c6ad-4bd5-a1a6-ee1c91bfc733 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034566 Jul 20 05:10:26.421040 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3515/7045] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:26.528286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b26a2a63-264c-4f81-896e-1e197d2bf083 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:26.536399 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b26a2a63-264c-4f81-896e-1e197d2bf083 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1362 microversion: 2.1 time: 0.167307 Jul 20 05:10:26.537131 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3531/7046] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:26 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:27.553844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8baf4552-57b4-4a76-a414-4b77a78b78f9 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:27.554516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8baf4552-57b4-4a76-a414-4b77a78b78f9 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:27.556507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:27.557179 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:27.564964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8baf4552-57b4-4a76-a414-4b77a78b78f9 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:27.565427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8baf4552-57b4-4a76-a414-4b77a78b78f9 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:27.566209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8baf4552-57b4-4a76-a414-4b77a78b78f9 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:27.566691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8baf4552-57b4-4a76-a414-4b77a78b78f9 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:27.700491 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8baf4552-57b4-4a76-a414-4b77a78b78f9 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:27.708290 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8baf4552-57b4-4a76-a414-4b77a78b78f9 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1554 microversion: 2.1 time: 0.158858 Jul 20 05:10:27.708874 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3516/7047] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:27 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:27.724423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f567ccc1-3a4d-49cd-bbb6-beef89840b07 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:27.725041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f567ccc1-3a4d-49cd-bbb6-beef89840b07 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:27.731901 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f567ccc1-3a4d-49cd-bbb6-beef89840b07 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:27.732354 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f567ccc1-3a4d-49cd-bbb6-beef89840b07 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:27.733123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f567ccc1-3a4d-49cd-bbb6-beef89840b07 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:27.733565 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f567ccc1-3a4d-49cd-bbb6-beef89840b07 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:27.863805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f567ccc1-3a4d-49cd-bbb6-beef89840b07 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:27.871586 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f567ccc1-3a4d-49cd-bbb6-beef89840b07 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1554 microversion: 2.1 time: 0.151033 Jul 20 05:10:27.872159 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3532/7048] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:27 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:29.526825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-854cfd22-6f53-4b26-a79b-05d0b0d2b718 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7395ae3-1a02-4a07-9663-668ab52413de"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:29.527924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-854cfd22-6f53-4b26-a79b-05d0b0d2b718 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:29.535353 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-854cfd22-6f53-4b26-a79b-05d0b0d2b718 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:29.535769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-854cfd22-6f53-4b26-a79b-05d0b0d2b718 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:29.536607 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-854cfd22-6f53-4b26-a79b-05d0b0d2b718 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:29.537018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-854cfd22-6f53-4b26-a79b-05d0b0d2b718 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:29.783014 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-854cfd22-6f53-4b26-a79b-05d0b0d2b718 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "POST /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260055 Jul 20 05:10:29.783664 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3517/7049] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 05:10:29 2022] POST /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:40.451544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aff65add-6fa4-4b36-b422-9b9ba55ea5bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:40.452072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aff65add-6fa4-4b36-b422-9b9ba55ea5bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:40.453944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:40.456290 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:40.456997 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=30 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:40.463970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aff65add-6fa4-4b36-b422-9b9ba55ea5bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:40.464478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aff65add-6fa4-4b36-b422-9b9ba55ea5bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:40.465273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aff65add-6fa4-4b36-b422-9b9ba55ea5bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:40.465726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aff65add-6fa4-4b36-b422-9b9ba55ea5bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:40.548705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-aff65add-6fa4-4b36-b422-9b9ba55ea5bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lazy-loading 'services' on Instance uuid 03c5a221-089e-4652-a16f-7d2c1b4f92c3 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:10:40.621101 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aff65add-6fa4-4b36-b422-9b9ba55ea5bb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "DELETE /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments/e7395ae3-1a02-4a07-9663-668ab52413de" status: 202 len: 0 microversion: 2.1 time: 0.173528 Jul 20 05:10:40.621705 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3533/7050] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 05:10:40 2022] DELETE /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments/e7395ae3-1a02-4a07-9663-668ab52413de => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:10:40.628650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:40.629458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:40.633941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e25560eb-4675-4d68-96ba-9eda7e306377 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:40.635017 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e25560eb-4675-4d68-96ba-9eda7e306377 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:40.643264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e25560eb-4675-4d68-96ba-9eda7e306377 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:40.644318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e25560eb-4675-4d68-96ba-9eda7e306377 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:40.645151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e25560eb-4675-4d68-96ba-9eda7e306377 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:40.645615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e25560eb-4675-4d68-96ba-9eda7e306377 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:40.679815 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e25560eb-4675-4d68-96ba-9eda7e306377 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053540 Jul 20 05:10:40.680394 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3518/7051] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:40 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:41.693465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-803ec7df-9692-4cab-9d9d-7d67a1922fdb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:41.694701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-803ec7df-9692-4cab-9d9d-7d67a1922fdb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:41.701483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-803ec7df-9692-4cab-9d9d-7d67a1922fdb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:41.702013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-803ec7df-9692-4cab-9d9d-7d67a1922fdb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:41.702893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-803ec7df-9692-4cab-9d9d-7d67a1922fdb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:41.703336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-803ec7df-9692-4cab-9d9d-7d67a1922fdb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:41.734075 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-803ec7df-9692-4cab-9d9d-7d67a1922fdb tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046173 Jul 20 05:10:41.734980 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3534/7052] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:41 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:42.745910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-61d69912-fafb-4266-a4e0-5ea09ac19888 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:42.746891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-61d69912-fafb-4266-a4e0-5ea09ac19888 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:42.753604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61d69912-fafb-4266-a4e0-5ea09ac19888 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.754110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61d69912-fafb-4266-a4e0-5ea09ac19888 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.754923 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61d69912-fafb-4266-a4e0-5ea09ac19888 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:42.755377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-61d69912-fafb-4266-a4e0-5ea09ac19888 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:42.788220 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-61d69912-fafb-4266-a4e0-5ea09ac19888 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046937 Jul 20 05:10:42.788806 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3519/7053] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:42 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:43.800231 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62dbdf63-803a-48a3-be2b-962079731a0c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:43.801855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-62dbdf63-803a-48a3-be2b-962079731a0c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:43.809046 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62dbdf63-803a-48a3-be2b-962079731a0c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:43.809506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62dbdf63-803a-48a3-be2b-962079731a0c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:43.810332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62dbdf63-803a-48a3-be2b-962079731a0c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:43.810777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62dbdf63-803a-48a3-be2b-962079731a0c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:43.840414 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62dbdf63-803a-48a3-be2b-962079731a0c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 Jul 20 05:10:43.840985 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3535/7054] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:43 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:44.853123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3cbfe237-f02f-407c-ab54-892302e8f9cc tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:44.854058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3cbfe237-f02f-407c-ab54-892302e8f9cc tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:44.861156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3cbfe237-f02f-407c-ab54-892302e8f9cc tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:44.861631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3cbfe237-f02f-407c-ab54-892302e8f9cc tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:44.862591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3cbfe237-f02f-407c-ab54-892302e8f9cc tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:44.863057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3cbfe237-f02f-407c-ab54-892302e8f9cc tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:44.892758 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3cbfe237-f02f-407c-ab54-892302e8f9cc tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Jul 20 05:10:44.893846 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3520/7055] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:44 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:45.905220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f1e2500a-3bd6-4594-a18d-aff3641cacc1 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:45.906187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f1e2500a-3bd6-4594-a18d-aff3641cacc1 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:45.914293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1e2500a-3bd6-4594-a18d-aff3641cacc1 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:45.914758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1e2500a-3bd6-4594-a18d-aff3641cacc1 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:45.915533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1e2500a-3bd6-4594-a18d-aff3641cacc1 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:45.915978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f1e2500a-3bd6-4594-a18d-aff3641cacc1 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:45.949354 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f1e2500a-3bd6-4594-a18d-aff3641cacc1 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048470 Jul 20 05:10:45.949927 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3536/7056] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:10:45 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:10:45.959813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-13b4b2bf-66df-4dda-b1ef-9ce3b1b16d0a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:45.960338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-13b4b2bf-66df-4dda-b1ef-9ce3b1b16d0a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:45.967248 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13b4b2bf-66df-4dda-b1ef-9ce3b1b16d0a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:45.967727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13b4b2bf-66df-4dda-b1ef-9ce3b1b16d0a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:45.968515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13b4b2bf-66df-4dda-b1ef-9ce3b1b16d0a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:45.968973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-13b4b2bf-66df-4dda-b1ef-9ce3b1b16d0a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:46.044738 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-13b4b2bf-66df-4dda-b1ef-9ce3b1b16d0a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] HTTP exception thrown: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 is not attached to volume e7395ae3-1a02-4a07-9663-668ab52413de Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-13b4b2bf-66df-4dda-b1ef-9ce3b1b16d0a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Request method failure captured: Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments/e7395ae3-1a02-4a07-9663-668ab52413de HTTP/1.1 Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi144yXG-MbSwKhMKqgjbg1CQpr-QH5Ph592lfBMaJ273taXvi_FEPFJHsio-PGK1ivMBwRHhpwMNaEpiX6N35XCcOZH7KA1P08qqf19v5sWipohvYCjEiGoo43mheNa4pkwjKWvjYr04ThIlyBvI99AHO8IpJp6U2WFCTdtnCX78bZao Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 930c4205c4f54aa697996dde54ab9aa1 Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 930c4205c4f54aa697996dde54ab9aa1 Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestEncryptedCinderVolumes-18057723-project Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 7291a15c5eae47449f8ba724bcbee32e Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestEncryptedCinderVolumes-18057723-project Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 is not attached to volume e7395ae3-1a02-4a07-9663-668ab52413de Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'server_id': '03c5a221-089e-4652-a16f-7d2c1b4f92c3', 'id': 'e7395ae3-1a02-4a07-9663-668ab52413de'} Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e7395ae3-1a02-4a07-9663-668ab52413de. Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 is not attached to volume e7395ae3-1a02-4a07-9663-668ab52413de Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:10:46.051292 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:10:46.055549 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:10:46.055549 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:10:46.055549 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 is not attached to volume e7395ae3-1a02-4a07-9663-668ab52413de Jul 20 05:10:46.055549 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:10:46.055549 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-13b4b2bf-66df-4dda-b1ef-9ce3b1b16d0a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Returning 404 to user: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 is not attached to volume e7395ae3-1a02-4a07-9663-668ab52413de {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:10:46.055549 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-13b4b2bf-66df-4dda-b1ef-9ce3b1b16d0a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "DELETE /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments/e7395ae3-1a02-4a07-9663-668ab52413de" status: 404 len: 154 microversion: 2.1 time: 0.097119 Jul 20 05:10:46.055549 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3521/7057] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 05:10:45 2022] DELETE /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3/os-volume_attachments/e7395ae3-1a02-4a07-9663-668ab52413de => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:10:49.420266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1617cc6b-f5b5-42f6-a8d4-0264777d10a5 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:49.420810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1617cc6b-f5b5-42f6-a8d4-0264777d10a5 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:49.428960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1617cc6b-f5b5-42f6-a8d4-0264777d10a5 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:49.429510 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1617cc6b-f5b5-42f6-a8d4-0264777d10a5 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:49.430347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1617cc6b-f5b5-42f6-a8d4-0264777d10a5 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:49.430798 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1617cc6b-f5b5-42f6-a8d4-0264777d10a5 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:49.461347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1617cc6b-f5b5-42f6-a8d4-0264777d10a5 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:10:49.552615 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1617cc6b-f5b5-42f6-a8d4-0264777d10a5 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "DELETE /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 204 len: 0 microversion: 2.1 time: 0.135731 Jul 20 05:10:49.553336 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3537/7058] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:10:49 2022] DELETE /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:10:49.561768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6deb0067-703e-4d7f-91cc-50eff8553351 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:49.562522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6deb0067-703e-4d7f-91cc-50eff8553351 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:49.571170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6deb0067-703e-4d7f-91cc-50eff8553351 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:49.571735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6deb0067-703e-4d7f-91cc-50eff8553351 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:49.572590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6deb0067-703e-4d7f-91cc-50eff8553351 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:49.573117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6deb0067-703e-4d7f-91cc-50eff8553351 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:49.707343 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6deb0067-703e-4d7f-91cc-50eff8553351 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:49.715134 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6deb0067-703e-4d7f-91cc-50eff8553351 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1560 microversion: 2.1 time: 0.157415 Jul 20 05:10:49.715795 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3522/7059] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:49 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:50.733615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e4645b4f-f82b-4329-81a6-27f67c20a92c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:50.734348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e4645b4f-f82b-4329-81a6-27f67c20a92c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:50.742571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4645b4f-f82b-4329-81a6-27f67c20a92c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:50.743038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4645b4f-f82b-4329-81a6-27f67c20a92c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:50.743810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4645b4f-f82b-4329-81a6-27f67c20a92c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:50.744259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e4645b4f-f82b-4329-81a6-27f67c20a92c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:50.883328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e4645b4f-f82b-4329-81a6-27f67c20a92c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:50.890971 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e4645b4f-f82b-4329-81a6-27f67c20a92c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1560 microversion: 2.1 time: 0.161674 Jul 20 05:10:50.891574 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3538/7060] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:50 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:51.697251 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d53c2526-2679-4d18-801e-fdf588482cc6 req-89867b0c-c83f-48c3-a286-0570f05266e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c5a221-089e-4652-a16f-7d2c1b4f92c3", "name": "network-vif-deleted", "tag": "89de95ae-6bb1-46a4-8e23-b19a2d532f9b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:51.707250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d53c2526-2679-4d18-801e-fdf588482cc6 req-89867b0c-c83f-48c3-a286-0570f05266e1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:51.707985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d53c2526-2679-4d18-801e-fdf588482cc6 req-89867b0c-c83f-48c3-a286-0570f05266e1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:51.720434 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d53c2526-2679-4d18-801e-fdf588482cc6 req-89867b0c-c83f-48c3-a286-0570f05266e1 service nova] Creating event network-vif-deleted:89de95ae-6bb1-46a4-8e23-b19a2d532f9b for instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 on n-h2-760456-11 Jul 20 05:10:51.725680 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d53c2526-2679-4d18-801e-fdf588482cc6 req-89867b0c-c83f-48c3-a286-0570f05266e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103437 Jul 20 05:10:51.729537 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3523/7061] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:51.909314 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:51.910085 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:51.917039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:51.917501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:51.918304 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:51.918750 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:51.952123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:51.953237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:51.953761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lazy-loading 'fault' on Instance uuid 03c5a221-089e-4652-a16f-7d2c1b4f92c3 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:10:51.998263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:52.007266 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aea6f4ba-5f70-4135-911c-82ef9153deb3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 200 len: 1352 microversion: 2.1 time: 0.102905 Jul 20 05:10:52.008168 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3539/7062] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:51 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:53.025802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-60e175b9-9948-4079-9193-9e87f33d0006 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:53.026553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-60e175b9-9948-4079-9193-9e87f33d0006 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: 03c5a221-089e-4652-a16f-7d2c1b4f92c3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:53.032835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60e175b9-9948-4079-9193-9e87f33d0006 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:53.033308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60e175b9-9948-4079-9193-9e87f33d0006 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:53.034095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60e175b9-9948-4079-9193-9e87f33d0006 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:53.034571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60e175b9-9948-4079-9193-9e87f33d0006 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:53.047721 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-60e175b9-9948-4079-9193-9e87f33d0006 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] HTTP exception thrown: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 could not be found. Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-60e175b9-9948-4079-9193-9e87f33d0006 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Request method failure captured: Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 HTTP/1.1 Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi144yXG-MbSwKhMKqgjbg1CQpr-QH5Ph592lfBMaJ273taXvi_FEPFJHsio-PGK1ivMBwRHhpwMNaEpiX6N35XCcOZH7KA1P08qqf19v5sWipohvYCjEiGoo43mheNa4pkwjKWvjYr04ThIlyBvI99AHO8IpJp6U2WFCTdtnCX78bZao Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 930c4205c4f54aa697996dde54ab9aa1 Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 930c4205c4f54aa697996dde54ab9aa1 Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestEncryptedCinderVolumes-18057723-project Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 7291a15c5eae47449f8ba724bcbee32e Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestEncryptedCinderVolumes-18057723-project Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 could not be found. Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '03c5a221-089e-4652-a16f-7d2c1b4f92c3'} Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 could not be found. Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 could not be found. Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:10:53.050382 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:10:53.055245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:10:53.055245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:10:53.055245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:10:53.055245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:10:53.055245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:10:53.055245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 could not be found. Jul 20 05:10:53.055245 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:10:53.055245 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-60e175b9-9948-4079-9193-9e87f33d0006 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Returning 404 to user: Instance 03c5a221-089e-4652-a16f-7d2c1b4f92c3 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:10:53.055245 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-60e175b9-9948-4079-9193-9e87f33d0006 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3" status: 404 len: 111 microversion: 2.1 time: 0.031502 Jul 20 05:10:53.055245 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3524/7063] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:53 2022] GET /compute/v2.1/servers/03c5a221-089e-4652-a16f-7d2c1b4f92c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:10:53.061068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b0312e53-8bca-4d6d-a17f-7a7d19ae3395 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '.version_select at 0x7fb8422d43a0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:53.080912 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b0312e53-8bca-4d6d-a17f-7a7d19ae3395 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-251126487" status: 202 len: 0 microversion: 2.1 time: 0.023766 Jul 20 05:10:53.081522 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3540/7064] 10.222.0.59 () {58 vars in 1274 bytes} [Wed Jul 20 05:10:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-251126487 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:10:53.096973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a4120ff9-20b4-48d4-8d6e-0e96e2071215 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Action: 'create', calling method: .version_select at 0x7fb841072a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-19653717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1VTDs7oQPsb0Y2Eeh3/J6eoQM6VZquJ1TmHh2QzdZnMGc9VJxg9KksKBUnvxz5nHSH3OBTVT1m3h8/t2p/hCVRThZgEwYTgbzE8J4xSjW8lXqIVAjbvFNAD3NEPqcE5A=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:53.111084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a4120ff9-20b4-48d4-8d6e-0e96e2071215 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Getting quotas for project 930c4205c4f54aa697996dde54ab9aa1. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:10:53.120389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a4120ff9-20b4-48d4-8d6e-0e96e2071215 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Getting quotas for user 7291a15c5eae47449f8ba724bcbee32e and project 930c4205c4f54aa697996dde54ab9aa1. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:10:53.144575 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a4120ff9-20b4-48d4-8d6e-0e96e2071215 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051727 Jul 20 05:10:53.145202 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3525/7065] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:10:53 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:53.194847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1286061526", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-19653717", "networks": [{"uuid": "cb9e305f-da00-48a2-beef-8ffe4ac7f98f"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:53.245697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] validate_networks() for [('cb9e305f-da00-48a2-beef-8ffe4ac7f98f', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:10:53.620383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:10:53.620821 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:10:53.621308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:10:53.621751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:10:53.622174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:10:53.632150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:53.632608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:53.633458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:53.633906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:53.651550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Getting quotas for project 930c4205c4f54aa697996dde54ab9aa1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:10:53.656836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Getting quotas for user 7291a15c5eae47449f8ba724bcbee32e and project 930c4205c4f54aa697996dde54ab9aa1. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:10:53.669857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:10:53.672155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:10:53.719654 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0ccf11f0-16d1-4cad-93f6-9cd544c14492 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529414 Jul 20 05:10:53.720322 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3541/7066] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:10:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:10:53.731086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4dd18d30-d8ef-4274-a2a4-4e71e6cdec34 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:53.731834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4dd18d30-d8ef-4274-a2a4-4e71e6cdec34 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:53.789536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4dd18d30-d8ef-4274-a2a4-4e71e6cdec34 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:53.796306 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4dd18d30-d8ef-4274-a2a4-4e71e6cdec34 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1261 microversion: 2.1 time: 0.069269 Jul 20 05:10:53.796914 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3526/7067] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:53 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:54.814861 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a899157c-09ef-4977-ab1f-1e4666f6ee1d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:54.816859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a899157c-09ef-4977-ab1f-1e4666f6ee1d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:54.823194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a899157c-09ef-4977-ab1f-1e4666f6ee1d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:54.823653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a899157c-09ef-4977-ab1f-1e4666f6ee1d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:54.824436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a899157c-09ef-4977-ab1f-1e4666f6ee1d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:54.824880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a899157c-09ef-4977-ab1f-1e4666f6ee1d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:54.895786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a899157c-09ef-4977-ab1f-1e4666f6ee1d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:54.903434 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a899157c-09ef-4977-ab1f-1e4666f6ee1d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1331 microversion: 2.1 time: 0.093544 Jul 20 05:10:54.904017 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3542/7068] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:54 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:55.922283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-02090a3b-9202-4cf9-ad95-9f1476fa09cf tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:55.923095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-02090a3b-9202-4cf9-ad95-9f1476fa09cf tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:55.932701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02090a3b-9202-4cf9-ad95-9f1476fa09cf tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:55.933220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02090a3b-9202-4cf9-ad95-9f1476fa09cf tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:55.934040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02090a3b-9202-4cf9-ad95-9f1476fa09cf tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:55.934723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-02090a3b-9202-4cf9-ad95-9f1476fa09cf tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:56.151872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-d8516015-cd7f-486d-a5a8-b43b41443b4b req-42279c80-73dd-41c5-a77e-e7af3e61946a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d018cb60-3b99-4952-9d67-d2c3a4f9cd38", "tag": "66942ed2-ff1a-419e-a7aa-d2a5053444ca"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:56.166689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d8516015-cd7f-486d-a5a8-b43b41443b4b req-42279c80-73dd-41c5-a77e-e7af3e61946a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:56.168106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d8516015-cd7f-486d-a5a8-b43b41443b4b req-42279c80-73dd-41c5-a77e-e7af3e61946a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:56.181178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-02090a3b-9202-4cf9-ad95-9f1476fa09cf tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:56.181591 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-d8516015-cd7f-486d-a5a8-b43b41443b4b req-42279c80-73dd-41c5-a77e-e7af3e61946a service nova] Creating event network-changed:66942ed2-ff1a-419e-a7aa-d2a5053444ca for instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 on n-h2-760456-11 Jul 20 05:10:56.187174 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-d8516015-cd7f-486d-a5a8-b43b41443b4b req-42279c80-73dd-41c5-a77e-e7af3e61946a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039567 Jul 20 05:10:56.188672 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3543/7069] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:10:56.190808 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-02090a3b-9202-4cf9-ad95-9f1476fa09cf tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1361 microversion: 2.1 time: 0.272909 Jul 20 05:10:56.191408 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3527/7070] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:55 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:57.209952 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-95aa5eb1-9e9f-421e-a982-78c432c00757 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:57.210694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-95aa5eb1-9e9f-421e-a982-78c432c00757 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:57.216993 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95aa5eb1-9e9f-421e-a982-78c432c00757 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.217450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95aa5eb1-9e9f-421e-a982-78c432c00757 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.218222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95aa5eb1-9e9f-421e-a982-78c432c00757 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.218690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-95aa5eb1-9e9f-421e-a982-78c432c00757 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.353508 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-95aa5eb1-9e9f-421e-a982-78c432c00757 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:57.363165 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-95aa5eb1-9e9f-421e-a982-78c432c00757 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1361 microversion: 2.1 time: 0.158517 Jul 20 05:10:57.363708 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3544/7071] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:57 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:58.381229 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bdb42c2e-c352-49d2-9e66-a4ae633ca70a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:58.381781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bdb42c2e-c352-49d2-9e66-a4ae633ca70a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:58.388811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdb42c2e-c352-49d2-9e66-a4ae633ca70a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:58.389286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdb42c2e-c352-49d2-9e66-a4ae633ca70a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:58.390080 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdb42c2e-c352-49d2-9e66-a4ae633ca70a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:58.390569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bdb42c2e-c352-49d2-9e66-a4ae633ca70a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:58.522811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bdb42c2e-c352-49d2-9e66-a4ae633ca70a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:58.530209 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bdb42c2e-c352-49d2-9e66-a4ae633ca70a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1361 microversion: 2.1 time: 0.153716 Jul 20 05:10:58.530810 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3528/7072] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:58 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:59.547642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-85af665c-2f7d-4acb-83a5-edd57cc05c59 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:59.548261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-85af665c-2f7d-4acb-83a5-edd57cc05c59 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:59.555745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85af665c-2f7d-4acb-83a5-edd57cc05c59 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:59.556206 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85af665c-2f7d-4acb-83a5-edd57cc05c59 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:59.556981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85af665c-2f7d-4acb-83a5-edd57cc05c59 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:59.557428 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-85af665c-2f7d-4acb-83a5-edd57cc05c59 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:59.692357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-85af665c-2f7d-4acb-83a5-edd57cc05c59 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:59.700050 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-85af665c-2f7d-4acb-83a5-edd57cc05c59 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1361 microversion: 2.1 time: 0.156384 Jul 20 05:10:59.700631 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3545/7073] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:59 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:00.717623 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b048edad-155b-4276-a2c0-9402611488db tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:00.718278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b048edad-155b-4276-a2c0-9402611488db tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:00.725854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b048edad-155b-4276-a2c0-9402611488db tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:00.726369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b048edad-155b-4276-a2c0-9402611488db tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:00.727170 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b048edad-155b-4276-a2c0-9402611488db tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:00.727631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b048edad-155b-4276-a2c0-9402611488db tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:00.862361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b048edad-155b-4276-a2c0-9402611488db tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:00.870355 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b048edad-155b-4276-a2c0-9402611488db tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1361 microversion: 2.1 time: 0.156441 Jul 20 05:11:00.870945 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3529/7074] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:00 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:01.888150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6ba9e181-d050-446f-98ae-703e62f483dd tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:01.888694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6ba9e181-d050-446f-98ae-703e62f483dd tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:01.896286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ba9e181-d050-446f-98ae-703e62f483dd tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:01.896753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ba9e181-d050-446f-98ae-703e62f483dd tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:01.897552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ba9e181-d050-446f-98ae-703e62f483dd tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:01.898334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ba9e181-d050-446f-98ae-703e62f483dd tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:02.053986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6ba9e181-d050-446f-98ae-703e62f483dd tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:02.061686 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6ba9e181-d050-446f-98ae-703e62f483dd tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1361 microversion: 2.1 time: 0.177590 Jul 20 05:11:02.062414 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3546/7075] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:01 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:02.675854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e608914a-c3ab-482a-a8db-bee494ba0223 req-8d707e97-f6d9-44c0-bff0-e5ad964c893a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d018cb60-3b99-4952-9d67-d2c3a4f9cd38", "name": "network-vif-plugged", "status": "completed", "tag": "66942ed2-ff1a-419e-a7aa-d2a5053444ca"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:02.686008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e608914a-c3ab-482a-a8db-bee494ba0223 req-8d707e97-f6d9-44c0-bff0-e5ad964c893a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:02.686509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e608914a-c3ab-482a-a8db-bee494ba0223 req-8d707e97-f6d9-44c0-bff0-e5ad964c893a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:02.697698 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e608914a-c3ab-482a-a8db-bee494ba0223 req-8d707e97-f6d9-44c0-bff0-e5ad964c893a service nova] Creating event network-vif-plugged:66942ed2-ff1a-419e-a7aa-d2a5053444ca for instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 on n-h2-760456-11 Jul 20 05:11:02.702819 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e608914a-c3ab-482a-a8db-bee494ba0223 req-8d707e97-f6d9-44c0-bff0-e5ad964c893a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089136 Jul 20 05:11:02.703412 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3530/7076] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:11:03.082649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f48d072b-3c4a-4af8-9a2b-e9910fffe539 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:03.083196 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f48d072b-3c4a-4af8-9a2b-e9910fffe539 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:03.090173 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f48d072b-3c4a-4af8-9a2b-e9910fffe539 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.090669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f48d072b-3c4a-4af8-9a2b-e9910fffe539 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.091454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f48d072b-3c4a-4af8-9a2b-e9910fffe539 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.091908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f48d072b-3c4a-4af8-9a2b-e9910fffe539 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.227726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f48d072b-3c4a-4af8-9a2b-e9910fffe539 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:03.236186 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f48d072b-3c4a-4af8-9a2b-e9910fffe539 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1361 microversion: 2.1 time: 0.158273 Jul 20 05:11:03.237299 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3547/7077] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:03 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:04.252759 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:04.257260 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a56cd9a7-4bf0-41e4-8e2b-d288fc9e3005 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:04.257988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a56cd9a7-4bf0-41e4-8e2b-d288fc9e3005 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:04.264618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a56cd9a7-4bf0-41e4-8e2b-d288fc9e3005 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:04.265092 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a56cd9a7-4bf0-41e4-8e2b-d288fc9e3005 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:04.265880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a56cd9a7-4bf0-41e4-8e2b-d288fc9e3005 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:04.266429 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a56cd9a7-4bf0-41e4-8e2b-d288fc9e3005 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:04.397277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a56cd9a7-4bf0-41e4-8e2b-d288fc9e3005 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:04.404868 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a56cd9a7-4bf0-41e4-8e2b-d288fc9e3005 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1553 microversion: 2.1 time: 0.154488 Jul 20 05:11:04.405448 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3531/7078] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:04 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:04.421350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea8ac3e3-cb07-46a0-b9e8-a820e58817e7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:04.421988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea8ac3e3-cb07-46a0-b9e8-a820e58817e7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:04.424031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:04.424715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:04.431722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea8ac3e3-cb07-46a0-b9e8-a820e58817e7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:04.432185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea8ac3e3-cb07-46a0-b9e8-a820e58817e7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:04.432965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea8ac3e3-cb07-46a0-b9e8-a820e58817e7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:04.433424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea8ac3e3-cb07-46a0-b9e8-a820e58817e7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:04.570944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ea8ac3e3-cb07-46a0-b9e8-a820e58817e7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:04.578915 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea8ac3e3-cb07-46a0-b9e8-a820e58817e7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1553 microversion: 2.1 time: 0.161418 Jul 20 05:11:04.579488 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3548/7079] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:04 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:06.055787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-748bdf05-73fa-4c3b-adbd-6aa4f40b8a71 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eab5e015-d300-4efe-b652-d6babf4ad08d"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:06.057318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-748bdf05-73fa-4c3b-adbd-6aa4f40b8a71 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:06.064378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-748bdf05-73fa-4c3b-adbd-6aa4f40b8a71 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:06.065074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-748bdf05-73fa-4c3b-adbd-6aa4f40b8a71 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:06.065883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-748bdf05-73fa-4c3b-adbd-6aa4f40b8a71 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:06.066378 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-748bdf05-73fa-4c3b-adbd-6aa4f40b8a71 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:06.301776 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-748bdf05-73fa-4c3b-adbd-6aa4f40b8a71 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "POST /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249878 Jul 20 05:11:06.302560 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3532/7080] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 05:11:06 2022] POST /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:16.952360 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f87f2f20-d38b-402c-85cb-494d4926706c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:16.952927 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f87f2f20-d38b-402c-85cb-494d4926706c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:16.955161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:16.955973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:16.963979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f87f2f20-d38b-402c-85cb-494d4926706c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:16.964450 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f87f2f20-d38b-402c-85cb-494d4926706c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:16.965276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f87f2f20-d38b-402c-85cb-494d4926706c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:16.965729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f87f2f20-d38b-402c-85cb-494d4926706c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:17.053106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-f87f2f20-d38b-402c-85cb-494d4926706c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lazy-loading 'services' on Instance uuid d018cb60-3b99-4952-9d67-d2c3a4f9cd38 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:11:17.123926 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f87f2f20-d38b-402c-85cb-494d4926706c tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments/eab5e015-d300-4efe-b652-d6babf4ad08d" status: 202 len: 0 microversion: 2.1 time: 0.175343 Jul 20 05:11:17.124468 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3549/7081] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 05:11:16 2022] DELETE /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments/eab5e015-d300-4efe-b652-d6babf4ad08d => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:11:17.133099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:17.134580 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:17.139442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-22c3a0a2-64c0-4841-ba0f-1ac92ccaebd3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:17.140552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-22c3a0a2-64c0-4841-ba0f-1ac92ccaebd3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:17.149785 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22c3a0a2-64c0-4841-ba0f-1ac92ccaebd3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:17.150382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22c3a0a2-64c0-4841-ba0f-1ac92ccaebd3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:17.151240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22c3a0a2-64c0-4841-ba0f-1ac92ccaebd3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:17.151779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-22c3a0a2-64c0-4841-ba0f-1ac92ccaebd3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:17.183905 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-22c3a0a2-64c0-4841-ba0f-1ac92ccaebd3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053977 Jul 20 05:11:17.184497 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3533/7082] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:11:17 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:18.197816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1fe19d9e-e138-4fb7-9bcf-a4ace6fa0f1e tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:18.198852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1fe19d9e-e138-4fb7-9bcf-a4ace6fa0f1e tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:18.205208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe19d9e-e138-4fb7-9bcf-a4ace6fa0f1e tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:18.205670 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe19d9e-e138-4fb7-9bcf-a4ace6fa0f1e tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:18.206479 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe19d9e-e138-4fb7-9bcf-a4ace6fa0f1e tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:18.207463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1fe19d9e-e138-4fb7-9bcf-a4ace6fa0f1e tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:18.238600 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1fe19d9e-e138-4fb7-9bcf-a4ace6fa0f1e tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Jul 20 05:11:18.239307 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3550/7083] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:11:18 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:19.250707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4f9ead1b-c18c-442a-bdee-19cfa19457ff tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:19.251662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4f9ead1b-c18c-442a-bdee-19cfa19457ff tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:19.259546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f9ead1b-c18c-442a-bdee-19cfa19457ff tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:19.260018 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f9ead1b-c18c-442a-bdee-19cfa19457ff tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:19.260827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f9ead1b-c18c-442a-bdee-19cfa19457ff tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:19.261295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4f9ead1b-c18c-442a-bdee-19cfa19457ff tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:19.293149 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4f9ead1b-c18c-442a-bdee-19cfa19457ff tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046459 Jul 20 05:11:19.293724 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3534/7084] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:11:19 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:20.305780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f53befbc-81bd-4bca-b590-c2aa792db4a3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:20.306662 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f53befbc-81bd-4bca-b590-c2aa792db4a3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:20.313586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f53befbc-81bd-4bca-b590-c2aa792db4a3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.314047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f53befbc-81bd-4bca-b590-c2aa792db4a3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:20.314845 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f53befbc-81bd-4bca-b590-c2aa792db4a3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.315286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f53befbc-81bd-4bca-b590-c2aa792db4a3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:20.345661 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f53befbc-81bd-4bca-b590-c2aa792db4a3 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044800 Jul 20 05:11:20.346223 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3551/7085] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:11:20 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:21.357393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ccc86ae8-d8af-414f-b6aa-b3defad75d9a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:21.358364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ccc86ae8-d8af-414f-b6aa-b3defad75d9a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:21.365666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccc86ae8-d8af-414f-b6aa-b3defad75d9a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:21.366140 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccc86ae8-d8af-414f-b6aa-b3defad75d9a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:21.366961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccc86ae8-d8af-414f-b6aa-b3defad75d9a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:21.367423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ccc86ae8-d8af-414f-b6aa-b3defad75d9a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:21.397864 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ccc86ae8-d8af-414f-b6aa-b3defad75d9a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Jul 20 05:11:21.398389 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3535/7086] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:11:21 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:22.409187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-33833bef-861d-44ca-bf62-99e0fc6c9047 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:22.411117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-33833bef-861d-44ca-bf62-99e0fc6c9047 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:22.418032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33833bef-861d-44ca-bf62-99e0fc6c9047 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:22.418531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33833bef-861d-44ca-bf62-99e0fc6c9047 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.419308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33833bef-861d-44ca-bf62-99e0fc6c9047 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:22.419753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-33833bef-861d-44ca-bf62-99e0fc6c9047 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.449592 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-33833bef-861d-44ca-bf62-99e0fc6c9047 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044511 Jul 20 05:11:22.450155 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3552/7087] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:11:22 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:11:22.461069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34c16f3c-34e8-4e97-8967-b8dca731a255 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:22.461604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-34c16f3c-34e8-4e97-8967-b8dca731a255 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:22.468527 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34c16f3c-34e8-4e97-8967-b8dca731a255 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:22.469004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34c16f3c-34e8-4e97-8967-b8dca731a255 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.470010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34c16f3c-34e8-4e97-8967-b8dca731a255 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:22.470862 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-34c16f3c-34e8-4e97-8967-b8dca731a255 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.549969 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-34c16f3c-34e8-4e97-8967-b8dca731a255 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] HTTP exception thrown: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 is not attached to volume eab5e015-d300-4efe-b652-d6babf4ad08d Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34c16f3c-34e8-4e97-8967-b8dca731a255 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Request method failure captured: Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments/eab5e015-d300-4efe-b652-d6babf4ad08d HTTP/1.1 Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi144yXG-MbSwKhMKqgjbg1CQpr-QH5Ph592lfBMaJ273taXvi_FEPFJHsio-PGK1ivMBwRHhpwMNaEpiX6N35XCcOZH7KA1P08qqf19v5sWipohvYCjEiGoo43mheNa4pkwjKWvjYr04ThIlyBvI99AHO8IpJp6U2WFCTdtnCX78bZao Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 930c4205c4f54aa697996dde54ab9aa1 Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 930c4205c4f54aa697996dde54ab9aa1 Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestEncryptedCinderVolumes-18057723-project Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 7291a15c5eae47449f8ba724bcbee32e Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestEncryptedCinderVolumes-18057723-project Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 is not attached to volume eab5e015-d300-4efe-b652-d6babf4ad08d Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'server_id': 'd018cb60-3b99-4952-9d67-d2c3a4f9cd38', 'id': 'eab5e015-d300-4efe-b652-d6babf4ad08d'} Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eab5e015-d300-4efe-b652-d6babf4ad08d. Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 is not attached to volume eab5e015-d300-4efe-b652-d6babf4ad08d Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:22.552333 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:22.556801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:11:22.556801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:11:22.556801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 is not attached to volume eab5e015-d300-4efe-b652-d6babf4ad08d Jul 20 05:11:22.556801 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:11:22.556801 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-34c16f3c-34e8-4e97-8967-b8dca731a255 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Returning 404 to user: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 is not attached to volume eab5e015-d300-4efe-b652-d6babf4ad08d {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:11:22.556801 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-34c16f3c-34e8-4e97-8967-b8dca731a255 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments/eab5e015-d300-4efe-b652-d6babf4ad08d" status: 404 len: 154 microversion: 2.1 time: 0.097502 Jul 20 05:11:22.556801 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3536/7088] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 05:11:22 2022] DELETE /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38/os-volume_attachments/eab5e015-d300-4efe-b652-d6babf4ad08d => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:11:25.880007 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7f68d21d-a61e-4eaf-a234-3e764b3078a4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:25.880535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7f68d21d-a61e-4eaf-a234-3e764b3078a4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:25.888238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f68d21d-a61e-4eaf-a234-3e764b3078a4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:25.888862 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f68d21d-a61e-4eaf-a234-3e764b3078a4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:25.889683 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f68d21d-a61e-4eaf-a234-3e764b3078a4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:25.890132 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f68d21d-a61e-4eaf-a234-3e764b3078a4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:25.920439 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7f68d21d-a61e-4eaf-a234-3e764b3078a4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:11:26.006613 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7f68d21d-a61e-4eaf-a234-3e764b3078a4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 204 len: 0 microversion: 2.1 time: 0.129947 Jul 20 05:11:26.010988 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3553/7089] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:11:25 2022] DELETE /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:11:26.016340 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc71e723-32e9-49d7-aebd-d9b739a020b4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:26.017546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cc71e723-32e9-49d7-aebd-d9b739a020b4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:26.025536 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc71e723-32e9-49d7-aebd-d9b739a020b4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:26.026014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc71e723-32e9-49d7-aebd-d9b739a020b4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:26.026849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc71e723-32e9-49d7-aebd-d9b739a020b4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:26.027329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc71e723-32e9-49d7-aebd-d9b739a020b4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:26.170884 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cc71e723-32e9-49d7-aebd-d9b739a020b4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:26.179456 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cc71e723-32e9-49d7-aebd-d9b739a020b4 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1559 microversion: 2.1 time: 0.167436 Jul 20 05:11:26.180044 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3537/7090] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:26 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:27.197995 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-31d2744a-ad05-4650-9f8f-7995f30c030d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:27.198889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-31d2744a-ad05-4650-9f8f-7995f30c030d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:27.207583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d2744a-ad05-4650-9f8f-7995f30c030d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:27.208096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d2744a-ad05-4650-9f8f-7995f30c030d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:27.208881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d2744a-ad05-4650-9f8f-7995f30c030d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:27.209332 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-31d2744a-ad05-4650-9f8f-7995f30c030d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:27.348884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-31d2744a-ad05-4650-9f8f-7995f30c030d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:27.356437 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-31d2744a-ad05-4650-9f8f-7995f30c030d tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1559 microversion: 2.1 time: 0.163218 Jul 20 05:11:27.357010 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3554/7091] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:27 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:28.070562 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-38f2accf-2a52-4198-b970-5fa04d8b157d req-ebcd5e03-8209-44b0-9453-328e9a0a71e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d018cb60-3b99-4952-9d67-d2c3a4f9cd38", "name": "network-vif-deleted", "tag": "66942ed2-ff1a-419e-a7aa-d2a5053444ca"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:28.084721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-38f2accf-2a52-4198-b970-5fa04d8b157d req-ebcd5e03-8209-44b0-9453-328e9a0a71e7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:28.085183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-38f2accf-2a52-4198-b970-5fa04d8b157d req-ebcd5e03-8209-44b0-9453-328e9a0a71e7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:28.098461 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-38f2accf-2a52-4198-b970-5fa04d8b157d req-ebcd5e03-8209-44b0-9453-328e9a0a71e7 service nova] Creating event network-vif-deleted:66942ed2-ff1a-419e-a7aa-d2a5053444ca for instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 on n-h2-760456-11 Jul 20 05:11:28.107484 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-38f2accf-2a52-4198-b970-5fa04d8b157d req-ebcd5e03-8209-44b0-9453-328e9a0a71e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037908 Jul 20 05:11:28.107484 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3538/7092] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:28.374391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:28.374931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:28.381774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:28.382229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:28.383023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:28.383471 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:28.414779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:28.415243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:28.415703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lazy-loading 'fault' on Instance uuid d018cb60-3b99-4952-9d67-d2c3a4f9cd38 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:11:28.458123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7291a15c5eae47449f8ba724bcbee32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930c4205c4f54aa697996dde54ab9aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:28.466699 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dff8102f-d365-4fa2-9dec-30db2c4ef06a tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 200 len: 1351 microversion: 2.1 time: 0.096552 Jul 20 05:11:28.473678 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3555/7093] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:28 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:29.486750 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16ebc515-9781-4ffb-a83d-c577510b44f7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:29.487427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16ebc515-9781-4ffb-a83d-c577510b44f7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] [instance: d018cb60-3b99-4952-9d67-d2c3a4f9cd38] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:29.495031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16ebc515-9781-4ffb-a83d-c577510b44f7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.495510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16ebc515-9781-4ffb-a83d-c577510b44f7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.496323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16ebc515-9781-4ffb-a83d-c577510b44f7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.496779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16ebc515-9781-4ffb-a83d-c577510b44f7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.511167 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-16ebc515-9781-4ffb-a83d-c577510b44f7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] HTTP exception thrown: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 could not be found. Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16ebc515-9781-4ffb-a83d-c577510b44f7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Request method failure captured: Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 HTTP/1.1 Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi144yXG-MbSwKhMKqgjbg1CQpr-QH5Ph592lfBMaJ273taXvi_FEPFJHsio-PGK1ivMBwRHhpwMNaEpiX6N35XCcOZH7KA1P08qqf19v5sWipohvYCjEiGoo43mheNa4pkwjKWvjYr04ThIlyBvI99AHO8IpJp6U2WFCTdtnCX78bZao Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 930c4205c4f54aa697996dde54ab9aa1 Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_930c4205c4f54aa697996dde54ab9aa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 930c4205c4f54aa697996dde54ab9aa1 Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-18057723 Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestEncryptedCinderVolumes-18057723-project Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 7291a15c5eae47449f8ba724bcbee32e Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestEncryptedCinderVolumes-18057723-project Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 could not be found. Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': 'd018cb60-3b99-4952-9d67-d2c3a4f9cd38'} Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 could not be found. Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 could not be found. Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:29.512807 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:11:29.517294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:29.517294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:29.517294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:29.517294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:11:29.517294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:11:29.517294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 could not be found. Jul 20 05:11:29.517294 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:11:29.517294 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16ebc515-9781-4ffb-a83d-c577510b44f7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Returning 404 to user: Instance d018cb60-3b99-4952-9d67-d2c3a4f9cd38 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:11:29.517294 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16ebc515-9781-4ffb-a83d-c577510b44f7 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38" status: 404 len: 111 microversion: 2.1 time: 0.032796 Jul 20 05:11:29.517294 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3539/7094] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:29 2022] GET /compute/v2.1/servers/d018cb60-3b99-4952-9d67-d2c3a4f9cd38 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:11:29.523746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d0fcfe91-e1d2-47f3-af5d-659361b94be1 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] Calling method '.version_select at 0x7fb841ee1160>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:29.542607 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d0fcfe91-e1d2-47f3-af5d-659361b94be1 tempest-TestEncryptedCinderVolumes-18057723 tempest-TestEncryptedCinderVolumes-18057723-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-19653717" status: 202 len: 0 microversion: 2.1 time: 0.023372 Jul 20 05:11:29.543187 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3556/7095] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 05:11:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-19653717 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:11:56.661416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3cc98493-99b4-496f-acd3-3ad61bffee5b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'create', calling method: .version_select at 0x7fb84100ee50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1753346409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPywPakHpxcOMSl/52yTPg8jqSO0s9mchNUaugbqWlOdUS2P6Ahr3GsICpQCYm5b79cRB5o9fLGyBhlDxqJsd4nPqRR7gODgPDoq2jKso5yNuX0B0/PjhXGbFgPsJ4Me4g=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:56.665918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=14 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:56.666616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=34 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:56.679625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3cc98493-99b4-496f-acd3-3ad61bffee5b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Getting quotas for project d2248330263b46e2834d4a9b900644cd. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:11:56.684846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-3cc98493-99b4-496f-acd3-3ad61bffee5b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Getting quotas for user 654fa76e2f2e4fdf97f377b9389ff224 and project d2248330263b46e2834d4a9b900644cd. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:11:56.707741 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3cc98493-99b4-496f-acd3-3ad61bffee5b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050818 Jul 20 05:11:56.708333 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3540/7096] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:11:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:56.755449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:56.756205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:56.760591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-44866522", "imageRef": "7162b0d1-2301-4618-88cb-07e391b76e12", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1753346409", "networks": [{"uuid": "2d43624c-81f0-4247-8424-78e891304d6d"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:56.815002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] validate_networks() for [('2d43624c-81f0-4247-8424-78e891304d6d', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:11:57.225138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:11:57.225606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:11:57.226122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:11:57.226569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:11:57.227027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:11:57.236194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:57.236663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:57.237914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:57.238464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:57.256892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Getting quotas for project d2248330263b46e2834d4a9b900644cd. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:11:57.263208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Getting quotas for user 654fa76e2f2e4fdf97f377b9389ff224 and project d2248330263b46e2834d4a9b900644cd. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:11:57.276712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:11:57.278953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7162b0d1-2301-4618-88cb-07e391b76e12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:11:57.322933 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-18dd4d62-0d6b-4b78-ae03-faef6831b884 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569506 Jul 20 05:11:57.323590 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3557/7097] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:11:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:11:57.334577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-685ee750-1f66-472b-adbd-a9a908717895 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:57.335219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-685ee750-1f66-472b-adbd-a9a908717895 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:57.391567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-685ee750-1f66-472b-adbd-a9a908717895 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:57.402520 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-685ee750-1f66-472b-adbd-a9a908717895 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1257 microversion: 2.1 time: 0.072918 Jul 20 05:11:57.403113 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3541/7098] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:57 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:58.421280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cbe2ba4e-c63a-4c93-b6b8-0c9fbecb9a94 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:58.421873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cbe2ba4e-c63a-4c93-b6b8-0c9fbecb9a94 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:58.429005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbe2ba4e-c63a-4c93-b6b8-0c9fbecb9a94 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:58.429468 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbe2ba4e-c63a-4c93-b6b8-0c9fbecb9a94 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:58.430357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbe2ba4e-c63a-4c93-b6b8-0c9fbecb9a94 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:58.430816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cbe2ba4e-c63a-4c93-b6b8-0c9fbecb9a94 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:58.501685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cbe2ba4e-c63a-4c93-b6b8-0c9fbecb9a94 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:58.512148 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cbe2ba4e-c63a-4c93-b6b8-0c9fbecb9a94 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1327 microversion: 2.1 time: 0.095606 Jul 20 05:11:58.523351 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3558/7099] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:58 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:59.531812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-52c63cf0-c1ea-4a3f-933e-2b247b863ccd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:59.533350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-52c63cf0-c1ea-4a3f-933e-2b247b863ccd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:59.545942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52c63cf0-c1ea-4a3f-933e-2b247b863ccd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:59.546517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52c63cf0-c1ea-4a3f-933e-2b247b863ccd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:59.547406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52c63cf0-c1ea-4a3f-933e-2b247b863ccd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:59.548016 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-52c63cf0-c1ea-4a3f-933e-2b247b863ccd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:59.723595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-52c63cf0-c1ea-4a3f-933e-2b247b863ccd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:59.734709 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-52c63cf0-c1ea-4a3f-933e-2b247b863ccd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.208158 Jul 20 05:11:59.735907 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3542/7100] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:59 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:00.753493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-77b2c9e7-c702-414c-b936-84929ceb7675 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:00.754444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-77b2c9e7-c702-414c-b936-84929ceb7675 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:00.762006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77b2c9e7-c702-414c-b936-84929ceb7675 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:00.762511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77b2c9e7-c702-414c-b936-84929ceb7675 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:00.763307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77b2c9e7-c702-414c-b936-84929ceb7675 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:00.763762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-77b2c9e7-c702-414c-b936-84929ceb7675 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:00.895047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-77b2c9e7-c702-414c-b936-84929ceb7675 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:00.902560 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-77b2c9e7-c702-414c-b936-84929ceb7675 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.153502 Jul 20 05:12:00.903133 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3559/7101] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:00 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:01.919421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5553658f-42aa-4210-ad87-8a52c7575edd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:01.920088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5553658f-42aa-4210-ad87-8a52c7575edd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:01.927893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5553658f-42aa-4210-ad87-8a52c7575edd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:01.928365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5553658f-42aa-4210-ad87-8a52c7575edd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:01.929173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5553658f-42aa-4210-ad87-8a52c7575edd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:01.929629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5553658f-42aa-4210-ad87-8a52c7575edd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:02.062101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5553658f-42aa-4210-ad87-8a52c7575edd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:02.069611 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5553658f-42aa-4210-ad87-8a52c7575edd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.154243 Jul 20 05:12:02.070173 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3543/7102] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:01 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:03.088129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e5f72c1-5d9e-441a-901c-19c464f6258d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:03.089490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e5f72c1-5d9e-441a-901c-19c464f6258d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:03.097968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e5f72c1-5d9e-441a-901c-19c464f6258d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:03.098462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e5f72c1-5d9e-441a-901c-19c464f6258d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:03.099264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e5f72c1-5d9e-441a-901c-19c464f6258d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:03.099716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e5f72c1-5d9e-441a-901c-19c464f6258d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:03.241816 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e5f72c1-5d9e-441a-901c-19c464f6258d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:03.250582 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e5f72c1-5d9e-441a-901c-19c464f6258d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.166551 Jul 20 05:12:03.258398 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3560/7103] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:03 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:04.269488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-12441843-a46c-464a-ae62-480d1dd83c93 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:04.270124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-12441843-a46c-464a-ae62-480d1dd83c93 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:04.277279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12441843-a46c-464a-ae62-480d1dd83c93 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:04.277752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12441843-a46c-464a-ae62-480d1dd83c93 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:04.278616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12441843-a46c-464a-ae62-480d1dd83c93 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:04.279074 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-12441843-a46c-464a-ae62-480d1dd83c93 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:04.429981 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-12441843-a46c-464a-ae62-480d1dd83c93 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:04.437600 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-12441843-a46c-464a-ae62-480d1dd83c93 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.172827 Jul 20 05:12:04.438183 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3544/7104] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:04 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:05.455646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-af7c25b3-954d-489c-b28f-96a465314fed tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:05.456307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-af7c25b3-954d-489c-b28f-96a465314fed tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:05.463499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af7c25b3-954d-489c-b28f-96a465314fed tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:05.463838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af7c25b3-954d-489c-b28f-96a465314fed tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:05.464803 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af7c25b3-954d-489c-b28f-96a465314fed tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:05.465303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af7c25b3-954d-489c-b28f-96a465314fed tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:05.626829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-af7c25b3-954d-489c-b28f-96a465314fed tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:05.636311 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-af7c25b3-954d-489c-b28f-96a465314fed tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.184611 Jul 20 05:12:05.637284 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3561/7105] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:05 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:06.654500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-803de85b-35e0-4db5-a9d1-657ada8874f1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:06.655118 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-803de85b-35e0-4db5-a9d1-657ada8874f1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:06.663224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-803de85b-35e0-4db5-a9d1-657ada8874f1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:06.663694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-803de85b-35e0-4db5-a9d1-657ada8874f1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:06.664506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-803de85b-35e0-4db5-a9d1-657ada8874f1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:06.664941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-803de85b-35e0-4db5-a9d1-657ada8874f1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:06.801537 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-803de85b-35e0-4db5-a9d1-657ada8874f1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:06.809058 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-803de85b-35e0-4db5-a9d1-657ada8874f1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.158532 Jul 20 05:12:06.809637 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3545/7106] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:06 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:07.826593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-42175370-d7c2-4c95-86d0-e2b003130951 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:07.827495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-42175370-d7c2-4c95-86d0-e2b003130951 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:07.830976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:07.831541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:07.838337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42175370-d7c2-4c95-86d0-e2b003130951 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:07.838799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42175370-d7c2-4c95-86d0-e2b003130951 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:07.839581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42175370-d7c2-4c95-86d0-e2b003130951 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:07.840028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-42175370-d7c2-4c95-86d0-e2b003130951 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:08.014438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-42175370-d7c2-4c95-86d0-e2b003130951 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:08.023143 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-42175370-d7c2-4c95-86d0-e2b003130951 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.200562 Jul 20 05:12:08.023762 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3562/7107] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:07 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:09.041221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-220010a4-4b0e-49cf-be62-75479128c09a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:09.042824 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-220010a4-4b0e-49cf-be62-75479128c09a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:09.045510 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:09.051574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-220010a4-4b0e-49cf-be62-75479128c09a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:09.052050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-220010a4-4b0e-49cf-be62-75479128c09a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:09.053005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-220010a4-4b0e-49cf-be62-75479128c09a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:09.055578 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-220010a4-4b0e-49cf-be62-75479128c09a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:09.189672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-220010a4-4b0e-49cf-be62-75479128c09a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:09.197316 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-220010a4-4b0e-49cf-be62-75479128c09a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.160097 Jul 20 05:12:09.197893 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3546/7108] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:09 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:10.215501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-76762665-9801-4e4d-a36f-ff2035f34c99 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:10.216121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-76762665-9801-4e4d-a36f-ff2035f34c99 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:10.224262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76762665-9801-4e4d-a36f-ff2035f34c99 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:10.224714 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76762665-9801-4e4d-a36f-ff2035f34c99 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:10.225495 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76762665-9801-4e4d-a36f-ff2035f34c99 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:10.226137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-76762665-9801-4e4d-a36f-ff2035f34c99 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:10.364480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-76762665-9801-4e4d-a36f-ff2035f34c99 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:10.372923 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-76762665-9801-4e4d-a36f-ff2035f34c99 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.162445 Jul 20 05:12:10.373512 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3563/7109] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:10 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:10.641235 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-7fce25ab-66e5-4dfe-a1aa-35a6c10c1c8e req-0b71a687-88d1-4f14-aec1-ba1b0df02e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63b8714f-e426-468d-ac4c-8f26f863bffc", "tag": "f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:10.654514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7fce25ab-66e5-4dfe-a1aa-35a6c10c1c8e req-0b71a687-88d1-4f14-aec1-ba1b0df02e12 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:10.654979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7fce25ab-66e5-4dfe-a1aa-35a6c10c1c8e req-0b71a687-88d1-4f14-aec1-ba1b0df02e12 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:10.669261 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-7fce25ab-66e5-4dfe-a1aa-35a6c10c1c8e req-0b71a687-88d1-4f14-aec1-ba1b0df02e12 service nova] Creating event network-changed:f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026 for instance 63b8714f-e426-468d-ac4c-8f26f863bffc on n-h2-760456-11 Jul 20 05:12:10.675887 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-7fce25ab-66e5-4dfe-a1aa-35a6c10c1c8e req-0b71a687-88d1-4f14-aec1-ba1b0df02e12 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039553 Jul 20 05:12:10.677120 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3547/7110] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:11.390639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4f979d61-1a8b-4a18-b916-d9641708d1df tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:11.391292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4f979d61-1a8b-4a18-b916-d9641708d1df tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:11.397974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f979d61-1a8b-4a18-b916-d9641708d1df tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:11.398475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f979d61-1a8b-4a18-b916-d9641708d1df tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:11.399260 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f979d61-1a8b-4a18-b916-d9641708d1df tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:11.399739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4f979d61-1a8b-4a18-b916-d9641708d1df tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:11.530786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4f979d61-1a8b-4a18-b916-d9641708d1df tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:11.539958 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4f979d61-1a8b-4a18-b916-d9641708d1df tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.153612 Jul 20 05:12:11.540631 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3564/7111] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:11 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:12.558121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f4a3febc-2f4a-465f-ad2c-defacb875015 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:12.558786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f4a3febc-2f4a-465f-ad2c-defacb875015 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:12.565980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f4a3febc-2f4a-465f-ad2c-defacb875015 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:12.566500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f4a3febc-2f4a-465f-ad2c-defacb875015 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:12.567292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f4a3febc-2f4a-465f-ad2c-defacb875015 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:12.567751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f4a3febc-2f4a-465f-ad2c-defacb875015 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:12.702029 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f4a3febc-2f4a-465f-ad2c-defacb875015 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:12.709693 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f4a3febc-2f4a-465f-ad2c-defacb875015 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.155945 Jul 20 05:12:12.710311 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3548/7112] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:12 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:13.727308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d130028b-b998-4bba-b4c9-18b8d7388b2f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:13.727929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d130028b-b998-4bba-b4c9-18b8d7388b2f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:13.734950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d130028b-b998-4bba-b4c9-18b8d7388b2f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:13.735409 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d130028b-b998-4bba-b4c9-18b8d7388b2f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:13.736176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d130028b-b998-4bba-b4c9-18b8d7388b2f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:13.737152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d130028b-b998-4bba-b4c9-18b8d7388b2f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:13.865338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d130028b-b998-4bba-b4c9-18b8d7388b2f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:13.873102 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d130028b-b998-4bba-b4c9-18b8d7388b2f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.149806 Jul 20 05:12:13.873678 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3565/7113] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:13 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:14.891396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a20fc069-1d40-40ad-945b-eb4f390ff097 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:14.892038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a20fc069-1d40-40ad-945b-eb4f390ff097 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:14.899677 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a20fc069-1d40-40ad-945b-eb4f390ff097 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:14.900150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a20fc069-1d40-40ad-945b-eb4f390ff097 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:14.901022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a20fc069-1d40-40ad-945b-eb4f390ff097 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:14.901409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a20fc069-1d40-40ad-945b-eb4f390ff097 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:15.039744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a20fc069-1d40-40ad-945b-eb4f390ff097 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:15.048366 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a20fc069-1d40-40ad-945b-eb4f390ff097 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.160981 Jul 20 05:12:15.049009 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3549/7114] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:14 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:16.065971 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f4c80fba-dd3d-4802-ac66-323be2365665 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:16.066613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f4c80fba-dd3d-4802-ac66-323be2365665 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:16.073569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4c80fba-dd3d-4802-ac66-323be2365665 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:16.074036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4c80fba-dd3d-4802-ac66-323be2365665 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:16.074850 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4c80fba-dd3d-4802-ac66-323be2365665 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:16.075300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f4c80fba-dd3d-4802-ac66-323be2365665 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:16.211174 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f4c80fba-dd3d-4802-ac66-323be2365665 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:16.218688 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f4c80fba-dd3d-4802-ac66-323be2365665 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.157545 Jul 20 05:12:16.219267 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3566/7115] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:16 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:16.961493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e069d100-fb69-432c-bc29-cce3ccbf9763 req-28d2f9fe-7132-4edb-92b1-8f40364baa75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63b8714f-e426-468d-ac4c-8f26f863bffc", "name": "network-vif-plugged", "status": "completed", "tag": "f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:16.972563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e069d100-fb69-432c-bc29-cce3ccbf9763 req-28d2f9fe-7132-4edb-92b1-8f40364baa75 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:16.973234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e069d100-fb69-432c-bc29-cce3ccbf9763 req-28d2f9fe-7132-4edb-92b1-8f40364baa75 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:16.984647 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e069d100-fb69-432c-bc29-cce3ccbf9763 req-28d2f9fe-7132-4edb-92b1-8f40364baa75 service nova] Creating event network-vif-plugged:f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026 for instance 63b8714f-e426-468d-ac4c-8f26f863bffc on n-h2-760456-11 Jul 20 05:12:16.990525 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e069d100-fb69-432c-bc29-cce3ccbf9763 req-28d2f9fe-7132-4edb-92b1-8f40364baa75 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 Jul 20 05:12:16.991133 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3550/7116] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:17.236187 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83eadbc0-d5c2-4d9a-b14a-dac8bd878690 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:17.237327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-83eadbc0-d5c2-4d9a-b14a-dac8bd878690 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:17.244315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83eadbc0-d5c2-4d9a-b14a-dac8bd878690 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:17.245040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83eadbc0-d5c2-4d9a-b14a-dac8bd878690 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:17.245810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83eadbc0-d5c2-4d9a-b14a-dac8bd878690 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:17.246272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83eadbc0-d5c2-4d9a-b14a-dac8bd878690 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:17.378771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-83eadbc0-d5c2-4d9a-b14a-dac8bd878690 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:17.386270 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-83eadbc0-d5c2-4d9a-b14a-dac8bd878690 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1357 microversion: 2.1 time: 0.154067 Jul 20 05:12:17.386852 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3567/7117] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:17 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:18.404303 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ed785e0-75ef-489b-b15f-a7dfa14a2031 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:18.404939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ed785e0-75ef-489b-b15f-a7dfa14a2031 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:18.412979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ed785e0-75ef-489b-b15f-a7dfa14a2031 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:18.413453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ed785e0-75ef-489b-b15f-a7dfa14a2031 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:18.414241 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ed785e0-75ef-489b-b15f-a7dfa14a2031 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:18.414723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ed785e0-75ef-489b-b15f-a7dfa14a2031 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:18.550726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ed785e0-75ef-489b-b15f-a7dfa14a2031 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:18.558230 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ed785e0-75ef-489b-b15f-a7dfa14a2031 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1547 microversion: 2.1 time: 0.158387 Jul 20 05:12:18.558817 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3551/7118] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:18 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:18.575511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-89ebeff9-2f35-4c1d-8c5f-b49a6046dab1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:18.576261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-89ebeff9-2f35-4c1d-8c5f-b49a6046dab1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:18.583833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89ebeff9-2f35-4c1d-8c5f-b49a6046dab1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:18.584292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89ebeff9-2f35-4c1d-8c5f-b49a6046dab1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:18.585061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89ebeff9-2f35-4c1d-8c5f-b49a6046dab1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:18.585509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-89ebeff9-2f35-4c1d-8c5f-b49a6046dab1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:18.722929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-89ebeff9-2f35-4c1d-8c5f-b49a6046dab1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:18.730488 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-89ebeff9-2f35-4c1d-8c5f-b49a6046dab1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1547 microversion: 2.1 time: 0.158801 Jul 20 05:12:18.731060 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3568/7119] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:18 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:18.747024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16a5e07c-5362-4381-95f2-71368385f325 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:18.750308 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-16a5e07c-5362-4381-95f2-71368385f325 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:18.751090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16a5e07c-5362-4381-95f2-71368385f325 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Searching by: {'deleted': False, 'project_id': 'd2248330263b46e2834d4a9b900644cd'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 05:12:18.757050 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16a5e07c-5362-4381-95f2-71368385f325 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:18.757521 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16a5e07c-5362-4381-95f2-71368385f325 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:18.758368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16a5e07c-5362-4381-95f2-71368385f325 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:18.758823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16a5e07c-5362-4381-95f2-71368385f325 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:18.782581 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-16a5e07c-5362-4381-95f2-71368385f325 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 05:12:18.810455 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16a5e07c-5362-4381-95f2-71368385f325 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.067487 Jul 20 05:12:18.811040 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3552/7120] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 05:12:18 2022] GET /compute/v2.1/servers => generated 341 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:18.821822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-eb954349-670a-4c33-820b-9b196e39271d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:18.822502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-eb954349-670a-4c33-820b-9b196e39271d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:18.828464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb954349-670a-4c33-820b-9b196e39271d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:18.828920 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb954349-670a-4c33-820b-9b196e39271d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:18.829689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb954349-670a-4c33-820b-9b196e39271d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:18.830650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-eb954349-670a-4c33-820b-9b196e39271d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:18.958506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-eb954349-670a-4c33-820b-9b196e39271d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:18.966134 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-eb954349-670a-4c33-820b-9b196e39271d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1547 microversion: 2.1 time: 0.148206 Jul 20 05:12:18.966730 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3569/7121] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:18 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:20.479655 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-84d3b013-2bf1-408f-8ac5-17af5b79cd52 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40ac10bb-568e-4fd1-939a-2893cdb9da0e"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:20.480789 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-84d3b013-2bf1-408f-8ac5-17af5b79cd52 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:20.488335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84d3b013-2bf1-408f-8ac5-17af5b79cd52 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:20.488807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84d3b013-2bf1-408f-8ac5-17af5b79cd52 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:20.489599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84d3b013-2bf1-408f-8ac5-17af5b79cd52 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:20.490059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-84d3b013-2bf1-408f-8ac5-17af5b79cd52 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:20.725400 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-84d3b013-2bf1-408f-8ac5-17af5b79cd52 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249621 Jul 20 05:12:20.726193 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3553/7122] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 05:12:20 2022] POST /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:33.688947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-69a217d4-8297-43fc-8062-72315fadbbb6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:33.689576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-69a217d4-8297-43fc-8062-72315fadbbb6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:33.693779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:33.694473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=74 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:33.700981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69a217d4-8297-43fc-8062-72315fadbbb6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.701446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69a217d4-8297-43fc-8062-72315fadbbb6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.702225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69a217d4-8297-43fc-8062-72315fadbbb6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.702694 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-69a217d4-8297-43fc-8062-72315fadbbb6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.837352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-69a217d4-8297-43fc-8062-72315fadbbb6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:33.845396 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-69a217d4-8297-43fc-8062-72315fadbbb6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1593 microversion: 2.1 time: 0.160341 Jul 20 05:12:33.845981 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3570/7123] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:33 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1593 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:35.484002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-857f20d2-1f21-4d6a-8602-c1ad7ef04a76 req-66217c91-2d2f-44a5-8884-b1d9ea2b0b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63b8714f-e426-468d-ac4c-8f26f863bffc", "tag": "f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:35.490007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:35.491101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:35.491925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:35.501163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-857f20d2-1f21-4d6a-8602-c1ad7ef04a76 req-66217c91-2d2f-44a5-8884-b1d9ea2b0b23 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:35.501698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-857f20d2-1f21-4d6a-8602-c1ad7ef04a76 req-66217c91-2d2f-44a5-8884-b1d9ea2b0b23 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:35.516596 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-857f20d2-1f21-4d6a-8602-c1ad7ef04a76 req-66217c91-2d2f-44a5-8884-b1d9ea2b0b23 service nova] Creating event network-changed:f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026 for instance 63b8714f-e426-468d-ac4c-8f26f863bffc on n-h2-760456-11 Jul 20 05:12:35.522918 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-857f20d2-1f21-4d6a-8602-c1ad7ef04a76 req-66217c91-2d2f-44a5-8884-b1d9ea2b0b23 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043693 Jul 20 05:12:35.523741 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3554/7124] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:36.504723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f6005e58-5fa2-49e1-98ca-6a4697cc5c77 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1661475911"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:36.505291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f6005e58-5fa2-49e1-98ca-6a4697cc5c77 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:36.512292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6005e58-5fa2-49e1-98ca-6a4697cc5c77 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:36.512754 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6005e58-5fa2-49e1-98ca-6a4697cc5c77 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:36.513526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6005e58-5fa2-49e1-98ca-6a4697cc5c77 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:36.513970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f6005e58-5fa2-49e1-98ca-6a4697cc5c77 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:36.646031 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.network.security_group_api [None req-f6005e58-5fa2-49e1-98ca-6a4697cc5c77 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Adding security group d43a5117-38cb-4a73-9d93-e9601579ff94 to port f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026 Jul 20 05:12:36.994290 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f6005e58-5fa2-49e1-98ca-6a4697cc5c77 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/action" status: 202 len: 0 microversion: 2.1 time: 0.494253 Jul 20 05:12:36.995353 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3571/7125] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:12:36 2022] POST /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:12:37.014403 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-99818ba8-8c78-4757-9de0-44c95022c3ee tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:37.015146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-99818ba8-8c78-4757-9de0-44c95022c3ee tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:37.026994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99818ba8-8c78-4757-9de0-44c95022c3ee tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.027464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99818ba8-8c78-4757-9de0-44c95022c3ee tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.028379 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99818ba8-8c78-4757-9de0-44c95022c3ee tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.029223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-99818ba8-8c78-4757-9de0-44c95022c3ee tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.226612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-381459cc-22c9-476d-bb17-c028337286de req-e86f5537-d0ee-40a4-a7b0-fa640be83f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63b8714f-e426-468d-ac4c-8f26f863bffc", "tag": "f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:37.236005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-381459cc-22c9-476d-bb17-c028337286de req-e86f5537-d0ee-40a4-a7b0-fa640be83f82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.236870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-381459cc-22c9-476d-bb17-c028337286de req-e86f5537-d0ee-40a4-a7b0-fa640be83f82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.250301 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-381459cc-22c9-476d-bb17-c028337286de req-e86f5537-d0ee-40a4-a7b0-fa640be83f82 service nova] Creating event network-changed:f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026 for instance 63b8714f-e426-468d-ac4c-8f26f863bffc on n-h2-760456-11 Jul 20 05:12:37.259985 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-381459cc-22c9-476d-bb17-c028337286de req-e86f5537-d0ee-40a4-a7b0-fa640be83f82 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250263 Jul 20 05:12:37.260944 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3572/7126] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:37.264990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-99818ba8-8c78-4757-9de0-44c95022c3ee tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:37.274081 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-99818ba8-8c78-4757-9de0-44c95022c3ee tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1759 microversion: 2.1 time: 0.274095 Jul 20 05:12:37.274730 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3555/7127] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:36 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1759 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:05.857866 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:14:05.858506 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:14:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:14:15.855422 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33eca72a-4e3b-4f88-b8f7-6f5bf76f74ec] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 20 05:14:15.856997 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0d612395-2abe-406a-94ab-07f31ffa6d77] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 20 05:14:15.857584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:15.858351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:15.863351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8495888a-ab00-41b9-93c4-1fde91eded58 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:15.864385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8495888a-ab00-41b9-93c4-1fde91eded58 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:15.872364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8495888a-ab00-41b9-93c4-1fde91eded58 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:15.872820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8495888a-ab00-41b9-93c4-1fde91eded58 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:15.873589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8495888a-ab00-41b9-93c4-1fde91eded58 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:15.874031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8495888a-ab00-41b9-93c4-1fde91eded58 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:15.944889 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8495888a-ab00-41b9-93c4-1fde91eded58 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/action" status: 202 len: 0 microversion: 2.1 time: 0.092499 Jul 20 05:14:15.945604 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3573/7128] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:14:15 2022] POST /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:14:15.952362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:15.953156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:15.957748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43945063-7efe-4a38-ba3b-7e0546700231 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:15.958414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43945063-7efe-4a38-ba3b-7e0546700231 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:15.967189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43945063-7efe-4a38-ba3b-7e0546700231 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:15.967707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43945063-7efe-4a38-ba3b-7e0546700231 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:15.968516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43945063-7efe-4a38-ba3b-7e0546700231 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:15.968983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43945063-7efe-4a38-ba3b-7e0546700231 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:16.215368 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-43945063-7efe-4a38-ba3b-7e0546700231 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:16.223427 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43945063-7efe-4a38-ba3b-7e0546700231 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1761 microversion: 2.1 time: 0.273283 Jul 20 05:14:16.224084 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3556/7129] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:15 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1761 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:17.246480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-488e8ccc-e701-4c33-9e9f-a3c819010595 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:17.247188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-488e8ccc-e701-4c33-9e9f-a3c819010595 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:17.257162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-488e8ccc-e701-4c33-9e9f-a3c819010595 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:17.257634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-488e8ccc-e701-4c33-9e9f-a3c819010595 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:17.258465 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-488e8ccc-e701-4c33-9e9f-a3c819010595 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:17.258929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-488e8ccc-e701-4c33-9e9f-a3c819010595 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:17.263780 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] [0d612395-2abe-406a-94ab-07f31ffa6d77] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 48834. Jul 20 05:14:17.266969 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] [33eca72a-4e3b-4f88-b8f7-6f5bf76f74ec] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 48832. Jul 20 05:14:17.414128 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-488e8ccc-e701-4c33-9e9f-a3c819010595 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:17.422764 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-488e8ccc-e701-4c33-9e9f-a3c819010595 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1759 microversion: 2.1 time: 0.184356 Jul 20 05:14:17.423340 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3574/7130] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:17 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:23.815981 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:14:23.816750 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:14:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:15:20.634489 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:15:20.635777 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:15:30.262299 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec14a2d6-59f0-443f-9e2b-92ddf2d0a5cf] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:15:30.262911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:30.263554 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:30.268386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2dd06878-349a-457c-998b-146dfddd01e9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1661475911"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:30.269073 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2dd06878-349a-457c-998b-146dfddd01e9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:30.275954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd06878-349a-457c-998b-146dfddd01e9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:30.276424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd06878-349a-457c-998b-146dfddd01e9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:30.277207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd06878-349a-457c-998b-146dfddd01e9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:30.277666 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2dd06878-349a-457c-998b-146dfddd01e9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:30.507501 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.network.security_group_api [None req-2dd06878-349a-457c-998b-146dfddd01e9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Removing security group d43a5117-38cb-4a73-9d93-e9601579ff94 from port f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026 Jul 20 05:15:30.846528 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2dd06878-349a-457c-998b-146dfddd01e9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/action" status: 202 len: 0 microversion: 2.1 time: 0.587246 Jul 20 05:15:30.850366 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3557/7131] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:15:30 2022] POST /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:15:30.864149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c011fcac-559f-4c26-8295-ab14858db933 req-b2ef2cff-0a7c-4205-aa37-de642afd0aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63b8714f-e426-468d-ac4c-8f26f863bffc", "tag": "f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:30.876791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:30.877751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:30.881472 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c011fcac-559f-4c26-8295-ab14858db933 req-b2ef2cff-0a7c-4205-aa37-de642afd0aa4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:30.882176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c011fcac-559f-4c26-8295-ab14858db933 req-b2ef2cff-0a7c-4205-aa37-de642afd0aa4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:30.920581 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c011fcac-559f-4c26-8295-ab14858db933 req-b2ef2cff-0a7c-4205-aa37-de642afd0aa4 service nova] Creating event network-changed:f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026 for instance 63b8714f-e426-468d-ac4c-8f26f863bffc on n-h2-760456-11 Jul 20 05:15:30.928448 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c011fcac-559f-4c26-8295-ab14858db933 req-b2ef2cff-0a7c-4205-aa37-de642afd0aa4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074888 Jul 20 05:15:30.930156 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3575/7132] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:32.269409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-88891479-8f56-44b6-847c-513f2c035d3c req-085f6568-3c1d-44b3-bea9-0e4b3c3f3978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63b8714f-e426-468d-ac4c-8f26f863bffc", "tag": "f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:32.280275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-88891479-8f56-44b6-847c-513f2c035d3c req-085f6568-3c1d-44b3-bea9-0e4b3c3f3978 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:32.280873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-88891479-8f56-44b6-847c-513f2c035d3c req-085f6568-3c1d-44b3-bea9-0e4b3c3f3978 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:32.294104 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec14a2d6-59f0-443f-9e2b-92ddf2d0a5cf] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 48878. Jul 20 05:15:32.297088 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-88891479-8f56-44b6-847c-513f2c035d3c req-085f6568-3c1d-44b3-bea9-0e4b3c3f3978 service nova] Creating event network-changed:f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026 for instance 63b8714f-e426-468d-ac4c-8f26f863bffc on n-h2-760456-11 Jul 20 05:15:32.300788 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [req-88891479-8f56-44b6-847c-513f2c035d3c req-085f6568-3c1d-44b3-bea9-0e4b3c3f3978 service nova] [5413226e-52c3-44f0-818e-301b7d3e7bcd] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:15:32.316933 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3600948a-f0c4-4264-9da8-9fa2d846f6f9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:32.317541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3600948a-f0c4-4264-9da8-9fa2d846f6f9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:32.326124 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3600948a-f0c4-4264-9da8-9fa2d846f6f9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:32.326618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3600948a-f0c4-4264-9da8-9fa2d846f6f9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:32.327408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3600948a-f0c4-4264-9da8-9fa2d846f6f9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:32.327857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3600948a-f0c4-4264-9da8-9fa2d846f6f9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:32.547406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-3600948a-f0c4-4264-9da8-9fa2d846f6f9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lazy-loading 'services' on Instance uuid 63b8714f-e426-468d-ac4c-8f26f863bffc {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:15:32.619788 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3600948a-f0c4-4264-9da8-9fa2d846f6f9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "DELETE /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments/40ac10bb-568e-4fd1-939a-2893cdb9da0e" status: 202 len: 0 microversion: 2.1 time: 0.308387 Jul 20 05:15:32.620490 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3576/7133] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 05:15:32 2022] DELETE /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments/40ac10bb-568e-4fd1-939a-2893cdb9da0e => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:15:32.629840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-982b8773-99ca-4cf7-a801-a35b2b6593d7 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:32.630963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-982b8773-99ca-4cf7-a801-a35b2b6593d7 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:32.639894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-982b8773-99ca-4cf7-a801-a35b2b6593d7 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:32.640441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-982b8773-99ca-4cf7-a801-a35b2b6593d7 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:32.641905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-982b8773-99ca-4cf7-a801-a35b2b6593d7 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:32.642395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-982b8773-99ca-4cf7-a801-a35b2b6593d7 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:32.677983 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-982b8773-99ca-4cf7-a801-a35b2b6593d7 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052665 Jul 20 05:15:32.678657 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3577/7134] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:15:32 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:33.310020 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [req-88891479-8f56-44b6-847c-513f2c035d3c req-085f6568-3c1d-44b3-bea9-0e4b3c3f3978 service nova] [5413226e-52c3-44f0-818e-301b7d3e7bcd] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 48896. Jul 20 05:15:33.314787 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-88891479-8f56-44b6-847c-513f2c035d3c req-085f6568-3c1d-44b3-bea9-0e4b3c3f3978 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.050332 Jul 20 05:15:33.318887 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3558/7135] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:33.690315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-98ee0408-0b6d-4505-b3de-4457d031e2eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:33.691273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-98ee0408-0b6d-4505-b3de-4457d031e2eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:33.698154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98ee0408-0b6d-4505-b3de-4457d031e2eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:33.698638 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98ee0408-0b6d-4505-b3de-4457d031e2eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:33.699427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98ee0408-0b6d-4505-b3de-4457d031e2eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:33.699866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98ee0408-0b6d-4505-b3de-4457d031e2eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:33.731361 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-98ee0408-0b6d-4505-b3de-4457d031e2eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045027 Jul 20 05:15:33.732231 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3578/7136] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:15:33 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:34.745871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4a9cc932-f98c-4d68-a807-ff1f6ab23226 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:34.746940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4a9cc932-f98c-4d68-a807-ff1f6ab23226 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:34.753356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a9cc932-f98c-4d68-a807-ff1f6ab23226 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:34.753828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a9cc932-f98c-4d68-a807-ff1f6ab23226 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:34.754660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a9cc932-f98c-4d68-a807-ff1f6ab23226 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:34.755126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4a9cc932-f98c-4d68-a807-ff1f6ab23226 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:34.785334 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4a9cc932-f98c-4d68-a807-ff1f6ab23226 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045638 Jul 20 05:15:34.785909 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3559/7137] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:15:34 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:35.797424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae226af3-e4f4-45df-8331-cc306828ae81 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:35.798300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ae226af3-e4f4-45df-8331-cc306828ae81 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:35.805264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae226af3-e4f4-45df-8331-cc306828ae81 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:35.805883 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae226af3-e4f4-45df-8331-cc306828ae81 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:35.806593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae226af3-e4f4-45df-8331-cc306828ae81 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:35.807168 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae226af3-e4f4-45df-8331-cc306828ae81 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:35.837553 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae226af3-e4f4-45df-8331-cc306828ae81 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044113 Jul 20 05:15:35.838709 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3579/7138] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:15:35 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:36.849356 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-db7d195d-dcfb-42b6-aca8-e54e50feeb86 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:36.850332 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-db7d195d-dcfb-42b6-aca8-e54e50feeb86 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:36.858410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db7d195d-dcfb-42b6-aca8-e54e50feeb86 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:36.858879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db7d195d-dcfb-42b6-aca8-e54e50feeb86 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:36.859664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db7d195d-dcfb-42b6-aca8-e54e50feeb86 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:36.860122 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-db7d195d-dcfb-42b6-aca8-e54e50feeb86 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:36.890791 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-db7d195d-dcfb-42b6-aca8-e54e50feeb86 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045418 Jul 20 05:15:36.891378 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3560/7139] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:15:36 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:37.903185 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c06c841f-ff50-4eb0-b00c-9c9e818e2750 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:37.904131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c06c841f-ff50-4eb0-b00c-9c9e818e2750 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:37.911135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c06c841f-ff50-4eb0-b00c-9c9e818e2750 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:37.911600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c06c841f-ff50-4eb0-b00c-9c9e818e2750 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:37.912391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c06c841f-ff50-4eb0-b00c-9c9e818e2750 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:37.912844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c06c841f-ff50-4eb0-b00c-9c9e818e2750 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:37.944241 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c06c841f-ff50-4eb0-b00c-9c9e818e2750 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045576 Jul 20 05:15:37.944834 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3580/7140] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:15:37 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:15:37.955244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d4147ea-b176-45f3-a921-5e4d8082b99a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:37.955749 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9d4147ea-b176-45f3-a921-5e4d8082b99a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:37.963767 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d4147ea-b176-45f3-a921-5e4d8082b99a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:37.964253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d4147ea-b176-45f3-a921-5e4d8082b99a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:37.965044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d4147ea-b176-45f3-a921-5e4d8082b99a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:37.965502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d4147ea-b176-45f3-a921-5e4d8082b99a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:38.041469 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-9d4147ea-b176-45f3-a921-5e4d8082b99a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] HTTP exception thrown: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc is not attached to volume 40ac10bb-568e-4fd1-939a-2893cdb9da0e Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d4147ea-b176-45f3-a921-5e4d8082b99a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Request method failure captured: Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: request: DELETE /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments/40ac10bb-568e-4fd1-939a-2893cdb9da0e HTTP/1.1 Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi146Na1XFvWIBzMrtu7bZwanuqQKCXZTSunjC-qhQSnmi42aw90nqcddy7z7L-IAgvE8VBh7m6MVLre7LzkrBrixuTZ4A9QDZKlsGF93bWYdAq178kEqK5IzvFEdinaCfZs_7sF84QQUsIzh1dWMwBMSOhfcTeKftfxoUk_veorKBcSA Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d2248330263b46e2834d4a9b900644cd Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2248330263b46e2834d4a9b900644cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d2248330263b46e2834d4a9b900644cd Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestMinimumBasicScenario-2142285551-project Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 654fa76e2f2e4fdf97f377b9389ff224 Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestMinimumBasicScenario-2142285551-project Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc is not attached to volume 40ac10bb-568e-4fd1-939a-2893cdb9da0e Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'server_id': '63b8714f-e426-468d-ac4c-8f26f863bffc', 'id': '40ac10bb-568e-4fd1-939a-2893cdb9da0e'} Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 40ac10bb-568e-4fd1-939a-2893cdb9da0e. Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc is not attached to volume 40ac10bb-568e-4fd1-939a-2893cdb9da0e Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:38.043142 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:38.047654 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:38.047654 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:38.047654 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc is not attached to volume 40ac10bb-568e-4fd1-939a-2893cdb9da0e Jul 20 05:15:38.047654 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:15:38.047654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d4147ea-b176-45f3-a921-5e4d8082b99a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Returning 404 to user: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc is not attached to volume 40ac10bb-568e-4fd1-939a-2893cdb9da0e {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:38.047654 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9d4147ea-b176-45f3-a921-5e4d8082b99a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "DELETE /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments/40ac10bb-568e-4fd1-939a-2893cdb9da0e" status: 404 len: 154 microversion: 2.1 time: 0.093438 Jul 20 05:15:38.047654 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3561/7141] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 05:15:37 2022] DELETE /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc/os-volume_attachments/40ac10bb-568e-4fd1-939a-2893cdb9da0e => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:15:41.291416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e783c75a-371d-4d16-9a7f-863b1ca5ae43 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:41.291898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e783c75a-371d-4d16-9a7f-863b1ca5ae43 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:41.299070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e783c75a-371d-4d16-9a7f-863b1ca5ae43 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:41.299538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e783c75a-371d-4d16-9a7f-863b1ca5ae43 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:41.300336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e783c75a-371d-4d16-9a7f-863b1ca5ae43 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:41.300787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e783c75a-371d-4d16-9a7f-863b1ca5ae43 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:41.328316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e783c75a-371d-4d16-9a7f-863b1ca5ae43 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:15:41.404899 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e783c75a-371d-4d16-9a7f-863b1ca5ae43 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "DELETE /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 204 len: 0 microversion: 2.1 time: 0.117023 Jul 20 05:15:41.405462 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3581/7142] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:15:41 2022] DELETE /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:15:41.414288 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eea00c7b-5d35-48b3-95f7-329a7f8bc4bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:41.414931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eea00c7b-5d35-48b3-95f7-329a7f8bc4bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:41.422797 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eea00c7b-5d35-48b3-95f7-329a7f8bc4bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:41.423304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eea00c7b-5d35-48b3-95f7-329a7f8bc4bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:41.424116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eea00c7b-5d35-48b3-95f7-329a7f8bc4bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:41.424576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eea00c7b-5d35-48b3-95f7-329a7f8bc4bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:41.566022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eea00c7b-5d35-48b3-95f7-329a7f8bc4bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:41.574891 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eea00c7b-5d35-48b3-95f7-329a7f8bc4bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1553 microversion: 2.1 time: 0.164693 Jul 20 05:15:41.575448 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3562/7143] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:41 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:42.594148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-768ab6b2-7add-4a16-a8ab-1b97c1d698fd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:42.594915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-768ab6b2-7add-4a16-a8ab-1b97c1d698fd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:42.602460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-768ab6b2-7add-4a16-a8ab-1b97c1d698fd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:42.602974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-768ab6b2-7add-4a16-a8ab-1b97c1d698fd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:42.603811 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-768ab6b2-7add-4a16-a8ab-1b97c1d698fd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:42.604249 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-768ab6b2-7add-4a16-a8ab-1b97c1d698fd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:42.736110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-768ab6b2-7add-4a16-a8ab-1b97c1d698fd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:42.743943 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-768ab6b2-7add-4a16-a8ab-1b97c1d698fd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1553 microversion: 2.1 time: 0.153933 Jul 20 05:15:42.744728 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3582/7144] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:42 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:43.464564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e57a3ff8-914d-428a-8a2a-0ce55c673079 req-8a84f259-d6cb-49d7-9adf-585d35b919f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63b8714f-e426-468d-ac4c-8f26f863bffc", "name": "network-vif-deleted", "tag": "f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:43.473473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e57a3ff8-914d-428a-8a2a-0ce55c673079 req-8a84f259-d6cb-49d7-9adf-585d35b919f1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:43.474304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e57a3ff8-914d-428a-8a2a-0ce55c673079 req-8a84f259-d6cb-49d7-9adf-585d35b919f1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:43.487019 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e57a3ff8-914d-428a-8a2a-0ce55c673079 req-8a84f259-d6cb-49d7-9adf-585d35b919f1 service nova] Creating event network-vif-deleted:f64b3420-6e6c-4e8b-8dbc-b6bb7d8a0026 for instance 63b8714f-e426-468d-ac4c-8f26f863bffc on n-h2-760456-11 Jul 20 05:15:43.492141 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e57a3ff8-914d-428a-8a2a-0ce55c673079 req-8a84f259-d6cb-49d7-9adf-585d35b919f1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032638 Jul 20 05:15:43.492739 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3563/7145] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:43.761284 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:43.762028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:43.769475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:43.769940 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:43.770753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:43.771195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:43.814623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:43.815086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:43.815549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lazy-loading 'fault' on Instance uuid 63b8714f-e426-468d-ac4c-8f26f863bffc {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:15:43.861900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:43.871427 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d3d6c158-ecc2-468d-a17a-8702e66ea1bc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 200 len: 1347 microversion: 2.1 time: 0.114188 Jul 20 05:15:43.872124 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3583/7146] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:43 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 1347 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:44.890394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9ee6a5c-c641-45c8-907f-26f990d7caf1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:44.891147 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b9ee6a5c-c641-45c8-907f-26f990d7caf1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 63b8714f-e426-468d-ac4c-8f26f863bffc] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:44.898361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9ee6a5c-c641-45c8-907f-26f990d7caf1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:44.898835 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9ee6a5c-c641-45c8-907f-26f990d7caf1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:44.899682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9ee6a5c-c641-45c8-907f-26f990d7caf1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:44.900726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b9ee6a5c-c641-45c8-907f-26f990d7caf1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:44.916415 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-b9ee6a5c-c641-45c8-907f-26f990d7caf1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] HTTP exception thrown: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc could not be found. Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9ee6a5c-c641-45c8-907f-26f990d7caf1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Request method failure captured: Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc HTTP/1.1 Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi146Na1XFvWIBzMrtu7bZwanuqQKCXZTSunjC-qhQSnmi42aw90nqcddy7z7L-IAgvE8VBh7m6MVLre7LzkrBrixuTZ4A9QDZKlsGF93bWYdAq178kEqK5IzvFEdinaCfZs_7sF84QQUsIzh1dWMwBMSOhfcTeKftfxoUk_veorKBcSA Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: d2248330263b46e2834d4a9b900644cd Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2248330263b46e2834d4a9b900644cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: d2248330263b46e2834d4a9b900644cd Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestMinimumBasicScenario-2142285551-project Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 654fa76e2f2e4fdf97f377b9389ff224 Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestMinimumBasicScenario-2142285551-project Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc could not be found. Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '63b8714f-e426-468d-ac4c-8f26f863bffc'} Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc could not be found. Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc could not be found. Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:44.918064 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:15:44.923112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:44.923112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:44.923112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:44.923112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:44.923112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:44.923112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc could not be found. Jul 20 05:15:44.923112 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:15:44.923112 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b9ee6a5c-c641-45c8-907f-26f990d7caf1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Returning 404 to user: Instance 63b8714f-e426-468d-ac4c-8f26f863bffc could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:44.923112 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b9ee6a5c-c641-45c8-907f-26f990d7caf1 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc" status: 404 len: 111 microversion: 2.1 time: 0.033420 Jul 20 05:15:44.923112 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3564/7147] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:44 2022] GET /compute/v2.1/servers/63b8714f-e426-468d-ac4c-8f26f863bffc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:15:44.928343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5686e08f-f22d-4882-99c2-f538ba030d56 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '.version_select at 0x7fb841b0a040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:44.951936 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5686e08f-f22d-4882-99c2-f538ba030d56 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1753346409" status: 202 len: 0 microversion: 2.1 time: 0.027443 Jul 20 05:15:44.952517 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3584/7148] 10.222.0.59 () {58 vars in 1271 bytes} [Wed Jul 20 05:15:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1753346409 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:15:53.896291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-47a87450-911d-4c15-95c3-278d3286b37f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'create', calling method: .version_select at 0x7fb841f19940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-59070156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNle5oGgnJRj6J0Nj/1eLMqmTPiWCS61XfdfWxT3+MG0lNY+Ed2HkuvxTbBU0YSgSEZZDj3ktBrhuY3jfWW6zqD1eONWGt9VH1HcJ/4hwRFdeO/3ezM5dNA4Py8NVAwgyQ=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:53.912193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-47a87450-911d-4c15-95c3-278d3286b37f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Getting quotas for project d2248330263b46e2834d4a9b900644cd. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:15:53.919320 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-47a87450-911d-4c15-95c3-278d3286b37f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Getting quotas for user 654fa76e2f2e4fdf97f377b9389ff224 and project d2248330263b46e2834d4a9b900644cd. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:15:53.943179 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-47a87450-911d-4c15-95c3-278d3286b37f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.050776 Jul 20 05:15:53.943815 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3565/7149] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:15:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:53.989464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:53.994780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-120530939", "imageRef": "35694b7c-355e-40b3-a373-4659a0d74e37", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-59070156", "networks": [{"uuid": "2d43624c-81f0-4247-8424-78e891304d6d"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:54.047193 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] validate_networks() for [('2d43624c-81f0-4247-8424-78e891304d6d', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:15:54.457642 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:15:54.458076 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:15:54.458599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:15:54.459021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:15:54.459443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:15:54.469356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:54.469814 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:54.470659 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:54.471110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:54.488792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Getting quotas for project d2248330263b46e2834d4a9b900644cd. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:15:54.495093 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Getting quotas for user 654fa76e2f2e4fdf97f377b9389ff224 and project d2248330263b46e2834d4a9b900644cd. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:15:54.507416 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:15:54.510649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35694b7c-355e-40b3-a373-4659a0d74e37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:15:54.556534 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7272f0a-197e-4c2e-8dfb-93d24e5209b5 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568900 Jul 20 05:15:54.557301 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3585/7150] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:15:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:15:54.567627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e1217b45-5761-4060-81d6-7b06992881a6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:54.568267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e1217b45-5761-4060-81d6-7b06992881a6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:54.625313 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e1217b45-5761-4060-81d6-7b06992881a6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:54.632092 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e1217b45-5761-4060-81d6-7b06992881a6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1256 microversion: 2.1 time: 0.068537 Jul 20 05:15:54.632878 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3566/7151] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:54 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:55.651722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-16174e6c-4cf5-4305-a00d-95e4abc8b709 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:55.652351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-16174e6c-4cf5-4305-a00d-95e4abc8b709 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:55.705860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-16174e6c-4cf5-4305-a00d-95e4abc8b709 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:55.713656 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-16174e6c-4cf5-4305-a00d-95e4abc8b709 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1256 microversion: 2.1 time: 0.067450 Jul 20 05:15:55.714268 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3586/7152] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:55 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1256 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:56.732081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-77f6d9ae-a738-4579-bba0-ba4c26697352 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:56.732695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-77f6d9ae-a738-4579-bba0-ba4c26697352 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:56.735483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=34 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:56.741875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77f6d9ae-a738-4579-bba0-ba4c26697352 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:56.742390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77f6d9ae-a738-4579-bba0-ba4c26697352 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:56.743192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77f6d9ae-a738-4579-bba0-ba4c26697352 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:56.744600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77f6d9ae-a738-4579-bba0-ba4c26697352 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:56.809502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-77f6d9ae-a738-4579-bba0-ba4c26697352 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:56.817056 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-77f6d9ae-a738-4579-bba0-ba4c26697352 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1260 microversion: 2.1 time: 0.090183 Jul 20 05:15:56.817635 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3567/7153] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:56 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1260 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:57.841097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6762ab58-aeaf-4e64-8d99-82297a0a0c9c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:57.841778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6762ab58-aeaf-4e64-8d99-82297a0a0c9c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:57.852719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6762ab58-aeaf-4e64-8d99-82297a0a0c9c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:57.853726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6762ab58-aeaf-4e64-8d99-82297a0a0c9c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:57.854613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6762ab58-aeaf-4e64-8d99-82297a0a0c9c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:57.855053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6762ab58-aeaf-4e64-8d99-82297a0a0c9c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:58.006352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6762ab58-aeaf-4e64-8d99-82297a0a0c9c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:58.022027 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6762ab58-aeaf-4e64-8d99-82297a0a0c9c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1314 microversion: 2.1 time: 0.191039 Jul 20 05:15:58.025055 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3587/7154] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:57 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:59.041014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f5bda8e8-280c-492a-8988-d5538af36ffd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:59.041651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f5bda8e8-280c-492a-8988-d5538af36ffd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:59.049246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5bda8e8-280c-492a-8988-d5538af36ffd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.049734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5bda8e8-280c-492a-8988-d5538af36ffd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.050565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5bda8e8-280c-492a-8988-d5538af36ffd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.051031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5bda8e8-280c-492a-8988-d5538af36ffd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.217942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f5bda8e8-280c-492a-8988-d5538af36ffd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:59.230141 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f5bda8e8-280c-492a-8988-d5538af36ffd tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.192909 Jul 20 05:15:59.231073 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3568/7155] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:59 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:00.249313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8e3ba82f-eab7-46f7-a195-a1bfcf8f557d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:00.250604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8e3ba82f-eab7-46f7-a195-a1bfcf8f557d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:00.258075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e3ba82f-eab7-46f7-a195-a1bfcf8f557d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:00.258572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e3ba82f-eab7-46f7-a195-a1bfcf8f557d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:00.259918 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e3ba82f-eab7-46f7-a195-a1bfcf8f557d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:00.260372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e3ba82f-eab7-46f7-a195-a1bfcf8f557d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:00.403006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8e3ba82f-eab7-46f7-a195-a1bfcf8f557d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:00.411499 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8e3ba82f-eab7-46f7-a195-a1bfcf8f557d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.166283 Jul 20 05:16:00.418410 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3588/7156] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:00 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:01.429008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bf90b897-ef90-405b-b91f-0b4d3a13ca3c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:01.429819 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bf90b897-ef90-405b-b91f-0b4d3a13ca3c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:01.432925 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:01.438756 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf90b897-ef90-405b-b91f-0b4d3a13ca3c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:01.439315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf90b897-ef90-405b-b91f-0b4d3a13ca3c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:01.440214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf90b897-ef90-405b-b91f-0b4d3a13ca3c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:01.440741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bf90b897-ef90-405b-b91f-0b4d3a13ca3c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:01.589171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bf90b897-ef90-405b-b91f-0b4d3a13ca3c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:01.596748 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bf90b897-ef90-405b-b91f-0b4d3a13ca3c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.171881 Jul 20 05:16:01.597329 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3569/7157] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:01 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:02.615138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f858f3a4-72d3-40e0-b3ee-656fd6de3916 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:02.615773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f858f3a4-72d3-40e0-b3ee-656fd6de3916 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:02.618517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:02.624436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f858f3a4-72d3-40e0-b3ee-656fd6de3916 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:02.624910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f858f3a4-72d3-40e0-b3ee-656fd6de3916 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:02.625713 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f858f3a4-72d3-40e0-b3ee-656fd6de3916 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:02.626167 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f858f3a4-72d3-40e0-b3ee-656fd6de3916 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:02.778646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f858f3a4-72d3-40e0-b3ee-656fd6de3916 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:02.786546 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f858f3a4-72d3-40e0-b3ee-656fd6de3916 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.175266 Jul 20 05:16:02.787428 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3589/7158] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:02 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:03.804857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-46743e5b-dc94-4d5c-99ad-0e80d51337f8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:03.806787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-46743e5b-dc94-4d5c-99ad-0e80d51337f8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:03.813735 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46743e5b-dc94-4d5c-99ad-0e80d51337f8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:03.814342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46743e5b-dc94-4d5c-99ad-0e80d51337f8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:03.815223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46743e5b-dc94-4d5c-99ad-0e80d51337f8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:03.815724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-46743e5b-dc94-4d5c-99ad-0e80d51337f8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:03.997056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-46743e5b-dc94-4d5c-99ad-0e80d51337f8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:04.005056 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-46743e5b-dc94-4d5c-99ad-0e80d51337f8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.204957 Jul 20 05:16:04.005645 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3570/7159] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:03 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:05.022650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9699d460-84e7-4f8a-a0b4-85ac17f952e6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:05.023227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9699d460-84e7-4f8a-a0b4-85ac17f952e6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:05.027095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:05.032444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9699d460-84e7-4f8a-a0b4-85ac17f952e6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:05.032907 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9699d460-84e7-4f8a-a0b4-85ac17f952e6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:05.033689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9699d460-84e7-4f8a-a0b4-85ac17f952e6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:05.034159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9699d460-84e7-4f8a-a0b4-85ac17f952e6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:05.184153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9699d460-84e7-4f8a-a0b4-85ac17f952e6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:05.192022 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9699d460-84e7-4f8a-a0b4-85ac17f952e6 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.173368 Jul 20 05:16:05.192611 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3590/7160] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:05 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:06.209359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73421123-108e-4f32-a299-caa36490ca21 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:06.210002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-73421123-108e-4f32-a299-caa36490ca21 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:06.212284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:06.219106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73421123-108e-4f32-a299-caa36490ca21 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:06.219579 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73421123-108e-4f32-a299-caa36490ca21 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:06.220383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73421123-108e-4f32-a299-caa36490ca21 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:06.220899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73421123-108e-4f32-a299-caa36490ca21 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:06.444134 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-73421123-108e-4f32-a299-caa36490ca21 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:06.451896 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-73421123-108e-4f32-a299-caa36490ca21 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.246573 Jul 20 05:16:06.452492 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3571/7161] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:06 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:06.557941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:06.641797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-904ccc90-6cc5-4127-8006-889104ee1366 req-5533ce09-e8d1-4f0b-863d-10c3c6c581ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c896a1f-d636-4807-b19a-44c5b361c044", "tag": "442751f0-3b46-427a-bf31-fb8dad9b3631"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:06.651056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-904ccc90-6cc5-4127-8006-889104ee1366 req-5533ce09-e8d1-4f0b-863d-10c3c6c581ff service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:06.651509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-904ccc90-6cc5-4127-8006-889104ee1366 req-5533ce09-e8d1-4f0b-863d-10c3c6c581ff service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:06.663486 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-904ccc90-6cc5-4127-8006-889104ee1366 req-5533ce09-e8d1-4f0b-863d-10c3c6c581ff service nova] Creating event network-changed:442751f0-3b46-427a-bf31-fb8dad9b3631 for instance 3c896a1f-d636-4807-b19a-44c5b361c044 on n-h1-760456-11 Jul 20 05:16:06.669664 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-904ccc90-6cc5-4127-8006-889104ee1366 req-5533ce09-e8d1-4f0b-863d-10c3c6c581ff service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116181 Jul 20 05:16:06.670767 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3591/7162] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:07.469566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-65f70e56-c5b8-4842-b384-27466aa011cc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:07.470197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-65f70e56-c5b8-4842-b384-27466aa011cc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:07.477210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65f70e56-c5b8-4842-b384-27466aa011cc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:07.478454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65f70e56-c5b8-4842-b384-27466aa011cc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:07.479508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65f70e56-c5b8-4842-b384-27466aa011cc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:07.479962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-65f70e56-c5b8-4842-b384-27466aa011cc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:07.616477 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-65f70e56-c5b8-4842-b384-27466aa011cc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:07.624373 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-65f70e56-c5b8-4842-b384-27466aa011cc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.158838 Jul 20 05:16:07.624969 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3572/7163] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:07 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:08.642599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0332a023-0f8d-49d7-8980-6704e1a2ef3d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:08.643316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0332a023-0f8d-49d7-8980-6704e1a2ef3d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:08.650268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0332a023-0f8d-49d7-8980-6704e1a2ef3d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:08.650736 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0332a023-0f8d-49d7-8980-6704e1a2ef3d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:08.651513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0332a023-0f8d-49d7-8980-6704e1a2ef3d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:08.651959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0332a023-0f8d-49d7-8980-6704e1a2ef3d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:08.787648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0332a023-0f8d-49d7-8980-6704e1a2ef3d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:08.796849 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0332a023-0f8d-49d7-8980-6704e1a2ef3d tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.159469 Jul 20 05:16:08.797443 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3592/7164] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:08 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:09.814918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5c088617-8b4f-43f3-bfbb-26c7c69a2425 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:09.815552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5c088617-8b4f-43f3-bfbb-26c7c69a2425 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:09.823119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c088617-8b4f-43f3-bfbb-26c7c69a2425 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:09.823594 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c088617-8b4f-43f3-bfbb-26c7c69a2425 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:09.824390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c088617-8b4f-43f3-bfbb-26c7c69a2425 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:09.824845 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5c088617-8b4f-43f3-bfbb-26c7c69a2425 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:10.268189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5c088617-8b4f-43f3-bfbb-26c7c69a2425 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:10.276759 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5c088617-8b4f-43f3-bfbb-26c7c69a2425 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.465781 Jul 20 05:16:10.277322 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3573/7165] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:09 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:11.294153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d4e44a60-20c3-4c99-a248-9bf0aad70c35 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:11.294802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d4e44a60-20c3-4c99-a248-9bf0aad70c35 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:11.301740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4e44a60-20c3-4c99-a248-9bf0aad70c35 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:11.302200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4e44a60-20c3-4c99-a248-9bf0aad70c35 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:11.303009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4e44a60-20c3-4c99-a248-9bf0aad70c35 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:11.303453 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d4e44a60-20c3-4c99-a248-9bf0aad70c35 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:11.441770 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d4e44a60-20c3-4c99-a248-9bf0aad70c35 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:11.449434 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d4e44a60-20c3-4c99-a248-9bf0aad70c35 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.159617 Jul 20 05:16:11.450010 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3593/7166] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:11 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:11.830450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-29358cd5-8df1-4c64-90d7-8f8c9bd889cc req-94678c05-afac-4a39-ad82-010ce04ef16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c896a1f-d636-4807-b19a-44c5b361c044", "name": "network-vif-plugged", "status": "completed", "tag": "442751f0-3b46-427a-bf31-fb8dad9b3631"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:11.839959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-29358cd5-8df1-4c64-90d7-8f8c9bd889cc req-94678c05-afac-4a39-ad82-010ce04ef16c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:11.840499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-29358cd5-8df1-4c64-90d7-8f8c9bd889cc req-94678c05-afac-4a39-ad82-010ce04ef16c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:11.851678 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-29358cd5-8df1-4c64-90d7-8f8c9bd889cc req-94678c05-afac-4a39-ad82-010ce04ef16c service nova] Creating event network-vif-plugged:442751f0-3b46-427a-bf31-fb8dad9b3631 for instance 3c896a1f-d636-4807-b19a-44c5b361c044 on n-h1-760456-11 Jul 20 05:16:11.857902 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-29358cd5-8df1-4c64-90d7-8f8c9bd889cc req-94678c05-afac-4a39-ad82-010ce04ef16c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094769 Jul 20 05:16:11.858537 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3574/7167] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:16:12.467939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c631189d-a5ca-49e0-82e2-1c1e5d55e732 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:12.468571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c631189d-a5ca-49e0-82e2-1c1e5d55e732 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:12.475825 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c631189d-a5ca-49e0-82e2-1c1e5d55e732 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:12.476292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c631189d-a5ca-49e0-82e2-1c1e5d55e732 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:12.477067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c631189d-a5ca-49e0-82e2-1c1e5d55e732 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:12.478014 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c631189d-a5ca-49e0-82e2-1c1e5d55e732 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:12.619666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c631189d-a5ca-49e0-82e2-1c1e5d55e732 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:12.627583 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c631189d-a5ca-49e0-82e2-1c1e5d55e732 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1356 microversion: 2.1 time: 0.163555 Jul 20 05:16:12.628171 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3594/7168] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:12 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:13.646916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e41dcaa1-269e-4190-a929-06796779db78 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:13.647556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e41dcaa1-269e-4190-a929-06796779db78 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:13.654339 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e41dcaa1-269e-4190-a929-06796779db78 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.654817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e41dcaa1-269e-4190-a929-06796779db78 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:13.655600 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e41dcaa1-269e-4190-a929-06796779db78 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.656052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e41dcaa1-269e-4190-a929-06796779db78 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:13.787512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e41dcaa1-269e-4190-a929-06796779db78 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:13.796086 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e41dcaa1-269e-4190-a929-06796779db78 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1547 microversion: 2.1 time: 0.154445 Jul 20 05:16:13.796658 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3575/7169] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:13 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:13.813238 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-74810007-2a44-4937-891a-d221129c0333 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:13.813863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-74810007-2a44-4937-891a-d221129c0333 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:13.820832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74810007-2a44-4937-891a-d221129c0333 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.821982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74810007-2a44-4937-891a-d221129c0333 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:13.822779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74810007-2a44-4937-891a-d221129c0333 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.823222 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74810007-2a44-4937-891a-d221129c0333 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:13.954752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-74810007-2a44-4937-891a-d221129c0333 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:13.963535 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-74810007-2a44-4937-891a-d221129c0333 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1547 microversion: 2.1 time: 0.154118 Jul 20 05:16:13.964115 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3595/7170] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:13 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:13.979742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1d88fef7-8c29-4f78-963a-be3d942e36b4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:13.983078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1d88fef7-8c29-4f78-963a-be3d942e36b4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:13.983887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1d88fef7-8c29-4f78-963a-be3d942e36b4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Searching by: {'deleted': False, 'project_id': 'd2248330263b46e2834d4a9b900644cd'} {{(pid=119605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 05:16:13.989390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d88fef7-8c29-4f78-963a-be3d942e36b4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.989854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d88fef7-8c29-4f78-963a-be3d942e36b4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:13.990715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d88fef7-8c29-4f78-963a-be3d942e36b4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.991176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1d88fef7-8c29-4f78-963a-be3d942e36b4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:14.016193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.multi_cell_list [None req-1d88fef7-8c29-4f78-963a-be3d942e36b4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 05:16:14.043635 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1d88fef7-8c29-4f78-963a-be3d942e36b4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068248 Jul 20 05:16:14.044222 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3576/7171] 10.222.0.59 () {58 vars in 1124 bytes} [Wed Jul 20 05:16:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:14.054527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97805dcb-62a0-48c4-9383-58d90e897aac tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:14.055165 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97805dcb-62a0-48c4-9383-58d90e897aac tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:14.062035 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97805dcb-62a0-48c4-9383-58d90e897aac tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:14.062549 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97805dcb-62a0-48c4-9383-58d90e897aac tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:14.063325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97805dcb-62a0-48c4-9383-58d90e897aac tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:14.063769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97805dcb-62a0-48c4-9383-58d90e897aac tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:14.198233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97805dcb-62a0-48c4-9383-58d90e897aac tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:14.205928 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97805dcb-62a0-48c4-9383-58d90e897aac tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1547 microversion: 2.1 time: 0.155312 Jul 20 05:16:14.206549 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3596/7172] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:14 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:15.692544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b74635d9-e155-4a7b-8fa7-a168ce22a235 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c80c922-0b89-49e5-a12c-27662b24ad87"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:15.693662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b74635d9-e155-4a7b-8fa7-a168ce22a235 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:15.701298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b74635d9-e155-4a7b-8fa7-a168ce22a235 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:15.701778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b74635d9-e155-4a7b-8fa7-a168ce22a235 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:15.702596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b74635d9-e155-4a7b-8fa7-a168ce22a235 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:15.703057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b74635d9-e155-4a7b-8fa7-a168ce22a235 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:15.936558 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b74635d9-e155-4a7b-8fa7-a168ce22a235 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247845 Jul 20 05:16:15.937214 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3577/7173] 10.222.0.59 () {60 vars in 1322 bytes} [Wed Jul 20 05:16:15 2022] POST /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:26.646914 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea12356c-c189-4879-8859-d591e0155a7a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:26.647543 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea12356c-c189-4879-8859-d591e0155a7a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:26.650558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=15 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:26.651226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=58 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:26.657348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea12356c-c189-4879-8859-d591e0155a7a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:26.657983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea12356c-c189-4879-8859-d591e0155a7a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:26.658829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea12356c-c189-4879-8859-d591e0155a7a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:26.659278 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea12356c-c189-4879-8859-d591e0155a7a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:26.788268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ea12356c-c189-4879-8859-d591e0155a7a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:26.796861 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea12356c-c189-4879-8859-d591e0155a7a tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1593 microversion: 2.1 time: 0.154093 Jul 20 05:16:26.797433 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3597/7174] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:26 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1593 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:28.406569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:28.407961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=17 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:28.408838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:28.413067 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-6d154ffa-d1cb-474b-bc8d-a3718eafa680 req-2a46a949-7623-4008-9c16-5fc9b46f1b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c896a1f-d636-4807-b19a-44c5b361c044", "tag": "442751f0-3b46-427a-bf31-fb8dad9b3631"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:28.423125 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6d154ffa-d1cb-474b-bc8d-a3718eafa680 req-2a46a949-7623-4008-9c16-5fc9b46f1b43 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:28.423973 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6d154ffa-d1cb-474b-bc8d-a3718eafa680 req-2a46a949-7623-4008-9c16-5fc9b46f1b43 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:28.440728 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6d154ffa-d1cb-474b-bc8d-a3718eafa680 req-2a46a949-7623-4008-9c16-5fc9b46f1b43 service nova] Creating event network-changed:442751f0-3b46-427a-bf31-fb8dad9b3631 for instance 3c896a1f-d636-4807-b19a-44c5b361c044 on n-h1-760456-11 Jul 20 05:16:28.447274 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-6d154ffa-d1cb-474b-bc8d-a3718eafa680 req-2a46a949-7623-4008-9c16-5fc9b46f1b43 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041829 Jul 20 05:16:28.448018 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3578/7175] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:29.603348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59b7a42a-6ac4-45e2-975b-7aa582fc37b8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-716182273"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:29.603917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-59b7a42a-6ac4-45e2-975b-7aa582fc37b8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:29.611859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59b7a42a-6ac4-45e2-975b-7aa582fc37b8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:29.612419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59b7a42a-6ac4-45e2-975b-7aa582fc37b8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:29.613344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59b7a42a-6ac4-45e2-975b-7aa582fc37b8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:29.613887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59b7a42a-6ac4-45e2-975b-7aa582fc37b8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:29.749755 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.network.security_group_api [None req-59b7a42a-6ac4-45e2-975b-7aa582fc37b8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Adding security group a7ee20e5-3dca-44c3-8c5c-2115403037a9 to port 442751f0-3b46-427a-bf31-fb8dad9b3631 Jul 20 05:16:30.096603 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-59b7a42a-6ac4-45e2-975b-7aa582fc37b8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/action" status: 202 len: 0 microversion: 2.1 time: 0.497691 Jul 20 05:16:30.097666 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3598/7176] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:16:29 2022] POST /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:16:30.108499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a90a4773-4dd4-4100-bd6e-6fd93251552c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:30.109833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a90a4773-4dd4-4100-bd6e-6fd93251552c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:30.131411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a90a4773-4dd4-4100-bd6e-6fd93251552c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:30.131895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a90a4773-4dd4-4100-bd6e-6fd93251552c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:30.132734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a90a4773-4dd4-4100-bd6e-6fd93251552c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:30.133183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a90a4773-4dd4-4100-bd6e-6fd93251552c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:30.302791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a90a4773-4dd4-4100-bd6e-6fd93251552c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:30.312333 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a90a4773-4dd4-4100-bd6e-6fd93251552c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1757 microversion: 2.1 time: 0.210295 Jul 20 05:16:30.313196 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3579/7177] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:30 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1757 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:30.463065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-25faf693-45da-436b-94f2-8d3baf227a99 req-6174b307-e0ff-4e48-8e06-4507d6282fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c896a1f-d636-4807-b19a-44c5b361c044", "tag": "442751f0-3b46-427a-bf31-fb8dad9b3631"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:30.471711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-25faf693-45da-436b-94f2-8d3baf227a99 req-6174b307-e0ff-4e48-8e06-4507d6282fc9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:30.472188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-25faf693-45da-436b-94f2-8d3baf227a99 req-6174b307-e0ff-4e48-8e06-4507d6282fc9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:30.483691 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-25faf693-45da-436b-94f2-8d3baf227a99 req-6174b307-e0ff-4e48-8e06-4507d6282fc9 service nova] Creating event network-changed:442751f0-3b46-427a-bf31-fb8dad9b3631 for instance 3c896a1f-d636-4807-b19a-44c5b361c044 on n-h1-760456-11 Jul 20 05:16:30.489021 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-25faf693-45da-436b-94f2-8d3baf227a99 req-6174b307-e0ff-4e48-8e06-4507d6282fc9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029972 Jul 20 05:16:30.489940 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3599/7178] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:45.288076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-45bbba06-e274-4080-8412-0f1396ada736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:45.289057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-45bbba06-e274-4080-8412-0f1396ada736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:45.291810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:45.292662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=8 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:45.298699 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45bbba06-e274-4080-8412-0f1396ada736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:45.299178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45bbba06-e274-4080-8412-0f1396ada736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:45.299977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45bbba06-e274-4080-8412-0f1396ada736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:45.300437 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-45bbba06-e274-4080-8412-0f1396ada736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:45.377492 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-45bbba06-e274-4080-8412-0f1396ada736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/action" status: 202 len: 0 microversion: 2.1 time: 0.093131 Jul 20 05:16:45.378144 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3580/7179] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:16:45 2022] POST /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:16:45.385567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:45.386447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:45.390667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-feba8489-99e8-4037-afe3-d48d070ecae9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:45.391590 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-feba8489-99e8-4037-afe3-d48d070ecae9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:45.398676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feba8489-99e8-4037-afe3-d48d070ecae9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:45.399134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feba8489-99e8-4037-afe3-d48d070ecae9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:45.399908 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feba8489-99e8-4037-afe3-d48d070ecae9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:45.400513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-feba8489-99e8-4037-afe3-d48d070ecae9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:45.555650 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-feba8489-99e8-4037-afe3-d48d070ecae9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:45.563932 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-feba8489-99e8-4037-afe3-d48d070ecae9 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1749 microversion: 2.1 time: 0.181336 Jul 20 05:16:45.564518 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3600/7180] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:45 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:46.584114 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e8196361-53cc-41f8-8209-c2466b21dc13 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:46.584834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e8196361-53cc-41f8-8209-c2466b21dc13 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:46.591328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8196361-53cc-41f8-8209-c2466b21dc13 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:46.591799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8196361-53cc-41f8-8209-c2466b21dc13 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:46.592589 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8196361-53cc-41f8-8209-c2466b21dc13 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:46.593045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e8196361-53cc-41f8-8209-c2466b21dc13 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:46.736253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e8196361-53cc-41f8-8209-c2466b21dc13 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:46.745156 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e8196361-53cc-41f8-8209-c2466b21dc13 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1754 microversion: 2.1 time: 0.166278 Jul 20 05:16:46.745740 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3581/7181] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:46 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:47.810593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-090670d0-af80-4ccf-8ed5-79a7d36d3736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:47.811229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-090670d0-af80-4ccf-8ed5-79a7d36d3736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:47.817779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-090670d0-af80-4ccf-8ed5-79a7d36d3736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:47.818242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-090670d0-af80-4ccf-8ed5-79a7d36d3736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:47.819053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-090670d0-af80-4ccf-8ed5-79a7d36d3736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:47.819505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-090670d0-af80-4ccf-8ed5-79a7d36d3736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:47.965613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-090670d0-af80-4ccf-8ed5-79a7d36d3736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:47.973762 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-090670d0-af80-4ccf-8ed5-79a7d36d3736 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1754 microversion: 2.1 time: 0.215106 Jul 20 05:16:47.974478 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3601/7182] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:47 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1754 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:48.991829 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-abb2eef6-87a0-4cf5-ad1f-4f889f09fb71 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:48.992468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-abb2eef6-87a0-4cf5-ad1f-4f889f09fb71 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:48.999739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abb2eef6-87a0-4cf5-ad1f-4f889f09fb71 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:49.000218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abb2eef6-87a0-4cf5-ad1f-4f889f09fb71 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:49.001010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abb2eef6-87a0-4cf5-ad1f-4f889f09fb71 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:49.001471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abb2eef6-87a0-4cf5-ad1f-4f889f09fb71 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:49.145905 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-abb2eef6-87a0-4cf5-ad1f-4f889f09fb71 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:49.154670 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-abb2eef6-87a0-4cf5-ad1f-4f889f09fb71 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1754 microversion: 2.1 time: 0.166803 Jul 20 05:16:49.155254 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3582/7183] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:48 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:50.172117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fc7174c1-d270-431b-b358-42a99d335e65 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:50.172740 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fc7174c1-d270-431b-b358-42a99d335e65 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:50.179647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc7174c1-d270-431b-b358-42a99d335e65 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:50.180101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc7174c1-d270-431b-b358-42a99d335e65 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:50.180871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc7174c1-d270-431b-b358-42a99d335e65 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:50.182044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fc7174c1-d270-431b-b358-42a99d335e65 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:50.325070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-fc7174c1-d270-431b-b358-42a99d335e65 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:50.333152 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fc7174c1-d270-431b-b358-42a99d335e65 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1754 microversion: 2.1 time: 0.165019 Jul 20 05:16:50.333729 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3602/7184] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:50 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:51.354618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bcd5a267-9c66-48dc-92fc-1ebfae33e878 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:51.355131 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bcd5a267-9c66-48dc-92fc-1ebfae33e878 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:51.362210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bcd5a267-9c66-48dc-92fc-1ebfae33e878 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:51.362705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bcd5a267-9c66-48dc-92fc-1ebfae33e878 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:51.363489 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bcd5a267-9c66-48dc-92fc-1ebfae33e878 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:51.363940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bcd5a267-9c66-48dc-92fc-1ebfae33e878 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:51.512071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bcd5a267-9c66-48dc-92fc-1ebfae33e878 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:51.520104 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bcd5a267-9c66-48dc-92fc-1ebfae33e878 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1754 microversion: 2.1 time: 0.172412 Jul 20 05:16:51.520681 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3583/7185] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:51 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:52.538705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3013a27d-a267-4e88-bca2-3bb389b45ad4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:52.539361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3013a27d-a267-4e88-bca2-3bb389b45ad4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:52.546297 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3013a27d-a267-4e88-bca2-3bb389b45ad4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:52.546761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3013a27d-a267-4e88-bca2-3bb389b45ad4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:52.547537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3013a27d-a267-4e88-bca2-3bb389b45ad4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:52.547985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3013a27d-a267-4e88-bca2-3bb389b45ad4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:52.694310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3013a27d-a267-4e88-bca2-3bb389b45ad4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:52.703021 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3013a27d-a267-4e88-bca2-3bb389b45ad4 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1754 microversion: 2.1 time: 0.168214 Jul 20 05:16:52.703607 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3603/7186] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:52 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:53.720722 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d7019044-f8e8-4727-8bee-5689299962dc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:53.721361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d7019044-f8e8-4727-8bee-5689299962dc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:53.729408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7019044-f8e8-4727-8bee-5689299962dc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:53.729914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7019044-f8e8-4727-8bee-5689299962dc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:53.730736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7019044-f8e8-4727-8bee-5689299962dc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:53.731191 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d7019044-f8e8-4727-8bee-5689299962dc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:53.889307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d7019044-f8e8-4727-8bee-5689299962dc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:53.897346 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d7019044-f8e8-4727-8bee-5689299962dc tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1754 microversion: 2.1 time: 0.180785 Jul 20 05:16:53.897908 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3584/7187] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:53 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:54.914917 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b0fdbb0e-654a-4cc2-aa12-e346f2adc7d0 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:54.915548 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b0fdbb0e-654a-4cc2-aa12-e346f2adc7d0 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:54.923496 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0fdbb0e-654a-4cc2-aa12-e346f2adc7d0 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:54.923964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0fdbb0e-654a-4cc2-aa12-e346f2adc7d0 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:54.924746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0fdbb0e-654a-4cc2-aa12-e346f2adc7d0 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:54.925227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b0fdbb0e-654a-4cc2-aa12-e346f2adc7d0 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:55.075947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b0fdbb0e-654a-4cc2-aa12-e346f2adc7d0 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:55.084740 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b0fdbb0e-654a-4cc2-aa12-e346f2adc7d0 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1754 microversion: 2.1 time: 0.173703 Jul 20 05:16:55.085360 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3604/7188] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:54 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:56.103776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-07adfa48-1486-4005-b705-af2ddf8c682b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:56.104406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-07adfa48-1486-4005-b705-af2ddf8c682b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:56.111518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07adfa48-1486-4005-b705-af2ddf8c682b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:56.111982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07adfa48-1486-4005-b705-af2ddf8c682b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:56.112762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07adfa48-1486-4005-b705-af2ddf8c682b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:56.113211 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-07adfa48-1486-4005-b705-af2ddf8c682b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:56.262405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-07adfa48-1486-4005-b705-af2ddf8c682b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:56.270966 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-07adfa48-1486-4005-b705-af2ddf8c682b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1754 microversion: 2.1 time: 0.171722 Jul 20 05:16:56.271534 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3585/7189] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:56 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:57.288799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9451c29c-9fe8-4f6f-9e9d-c966cd9e74ce tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:57.289417 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9451c29c-9fe8-4f6f-9e9d-c966cd9e74ce tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:57.296636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9451c29c-9fe8-4f6f-9e9d-c966cd9e74ce tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:57.297092 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9451c29c-9fe8-4f6f-9e9d-c966cd9e74ce tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:57.297857 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9451c29c-9fe8-4f6f-9e9d-c966cd9e74ce tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:57.298330 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9451c29c-9fe8-4f6f-9e9d-c966cd9e74ce tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:57.446130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9451c29c-9fe8-4f6f-9e9d-c966cd9e74ce tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:57.455242 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9451c29c-9fe8-4f6f-9e9d-c966cd9e74ce tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1757 microversion: 2.1 time: 0.170346 Jul 20 05:16:57.455818 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3605/7190] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:57 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:29.729769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-299497ca-90d7-4133-9266-788cc3cd9cc8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-716182273"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:29.730391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-299497ca-90d7-4133-9266-788cc3cd9cc8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:29.734891 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=12 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:29.735611 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:29.740105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-299497ca-90d7-4133-9266-788cc3cd9cc8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:29.740585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-299497ca-90d7-4133-9266-788cc3cd9cc8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:29.741385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-299497ca-90d7-4133-9266-788cc3cd9cc8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:29.741846 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-299497ca-90d7-4133-9266-788cc3cd9cc8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:29.874969 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.network.security_group_api [None req-299497ca-90d7-4133-9266-788cc3cd9cc8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Removing security group a7ee20e5-3dca-44c3-8c5c-2115403037a9 from port 442751f0-3b46-427a-bf31-fb8dad9b3631 Jul 20 05:17:30.221641 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-bda58d19-4311-49f1-9937-08795121e82d req-d7bbf29c-11ac-4527-bd83-41d6c860a173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c896a1f-d636-4807-b19a-44c5b361c044", "tag": "442751f0-3b46-427a-bf31-fb8dad9b3631"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:30.223201 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-299497ca-90d7-4133-9266-788cc3cd9cc8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "POST /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/action" status: 202 len: 0 microversion: 2.1 time: 0.497675 Jul 20 05:17:30.223837 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3586/7191] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:17:29 2022] POST /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:17:30.228866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=12 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:30.229672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=36 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:30.247062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bda58d19-4311-49f1-9937-08795121e82d req-d7bbf29c-11ac-4527-bd83-41d6c860a173 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:30.248243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bda58d19-4311-49f1-9937-08795121e82d req-d7bbf29c-11ac-4527-bd83-41d6c860a173 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:30.276740 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-bda58d19-4311-49f1-9937-08795121e82d req-d7bbf29c-11ac-4527-bd83-41d6c860a173 service nova] Creating event network-changed:442751f0-3b46-427a-bf31-fb8dad9b3631 for instance 3c896a1f-d636-4807-b19a-44c5b361c044 on n-h1-760456-11 Jul 20 05:17:30.283070 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-bda58d19-4311-49f1-9937-08795121e82d req-d7bbf29c-11ac-4527-bd83-41d6c860a173 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065164 Jul 20 05:17:30.283870 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3606/7192] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:31.331046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ffd17243-cd41-4057-9a3f-92081f9447ab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:31.332208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ffd17243-cd41-4057-9a3f-92081f9447ab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:31.333375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-bf4a2304-bd4c-4acf-8cc5-2d0075ac8e7a req-56add6f0-7c17-406c-9d60-39f6287f7ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c896a1f-d636-4807-b19a-44c5b361c044", "tag": "442751f0-3b46-427a-bf31-fb8dad9b3631"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:31.338792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffd17243-cd41-4057-9a3f-92081f9447ab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:31.339264 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffd17243-cd41-4057-9a3f-92081f9447ab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:31.340275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffd17243-cd41-4057-9a3f-92081f9447ab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:31.340741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ffd17243-cd41-4057-9a3f-92081f9447ab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:31.342687 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bf4a2304-bd4c-4acf-8cc5-2d0075ac8e7a req-56add6f0-7c17-406c-9d60-39f6287f7ab6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:31.343136 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-bf4a2304-bd4c-4acf-8cc5-2d0075ac8e7a req-56add6f0-7c17-406c-9d60-39f6287f7ab6 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:31.357812 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-bf4a2304-bd4c-4acf-8cc5-2d0075ac8e7a req-56add6f0-7c17-406c-9d60-39f6287f7ab6 service nova] Creating event network-changed:442751f0-3b46-427a-bf31-fb8dad9b3631 for instance 3c896a1f-d636-4807-b19a-44c5b361c044 on n-h1-760456-11 Jul 20 05:17:31.362506 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-bf4a2304-bd4c-4acf-8cc5-2d0075ac8e7a req-56add6f0-7c17-406c-9d60-39f6287f7ab6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033755 Jul 20 05:17:31.363122 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3607/7193] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:17:31.431774 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-ffd17243-cd41-4057-9a3f-92081f9447ab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lazy-loading 'services' on Instance uuid 3c896a1f-d636-4807-b19a-44c5b361c044 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:17:31.526148 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ffd17243-cd41-4057-9a3f-92081f9447ab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments/8c80c922-0b89-49e5-a12c-27662b24ad87" status: 202 len: 0 microversion: 2.1 time: 0.200157 Jul 20 05:17:31.527480 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3587/7194] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 05:17:31 2022] DELETE /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments/8c80c922-0b89-49e5-a12c-27662b24ad87 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:17:31.537973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0c2bc1d3-3fb3-4d84-988c-cc04f2f98df8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:31.539569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0c2bc1d3-3fb3-4d84-988c-cc04f2f98df8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:31.553649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c2bc1d3-3fb3-4d84-988c-cc04f2f98df8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:31.554126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c2bc1d3-3fb3-4d84-988c-cc04f2f98df8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:31.554953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c2bc1d3-3fb3-4d84-988c-cc04f2f98df8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:31.555579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0c2bc1d3-3fb3-4d84-988c-cc04f2f98df8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:31.600319 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0c2bc1d3-3fb3-4d84-988c-cc04f2f98df8 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067012 Jul 20 05:17:31.606313 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3608/7195] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:31 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:32.613592 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d515f01-85e3-48a5-b96c-b6a2953c9bdb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:32.614629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d515f01-85e3-48a5-b96c-b6a2953c9bdb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:32.622373 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d515f01-85e3-48a5-b96c-b6a2953c9bdb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:32.622858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d515f01-85e3-48a5-b96c-b6a2953c9bdb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:32.623713 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d515f01-85e3-48a5-b96c-b6a2953c9bdb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:32.624143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d515f01-85e3-48a5-b96c-b6a2953c9bdb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:32.663522 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d515f01-85e3-48a5-b96c-b6a2953c9bdb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054325 Jul 20 05:17:32.664101 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3588/7196] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:32 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:33.675559 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a1ca3bd5-2813-4c46-b003-b75cca3449be tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:33.676512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a1ca3bd5-2813-4c46-b003-b75cca3449be tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:33.683755 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ca3bd5-2813-4c46-b003-b75cca3449be tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:33.684217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ca3bd5-2813-4c46-b003-b75cca3449be tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:33.685041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ca3bd5-2813-4c46-b003-b75cca3449be tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:33.685598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a1ca3bd5-2813-4c46-b003-b75cca3449be tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:33.715924 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a1ca3bd5-2813-4c46-b003-b75cca3449be tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044244 Jul 20 05:17:33.717119 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3609/7197] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:33 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:34.728517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d6a23452-17f8-46f2-92e6-5948ac6ed3d3 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:34.729350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d6a23452-17f8-46f2-92e6-5948ac6ed3d3 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:34.736515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6a23452-17f8-46f2-92e6-5948ac6ed3d3 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:34.736988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6a23452-17f8-46f2-92e6-5948ac6ed3d3 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:34.737776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6a23452-17f8-46f2-92e6-5948ac6ed3d3 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:34.738236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d6a23452-17f8-46f2-92e6-5948ac6ed3d3 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:34.769234 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d6a23452-17f8-46f2-92e6-5948ac6ed3d3 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044820 Jul 20 05:17:34.769813 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3589/7198] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:34 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:35.781775 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a020cb5b-823d-4b63-8528-87831722b39f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:35.782761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a020cb5b-823d-4b63-8528-87831722b39f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:35.790106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a020cb5b-823d-4b63-8528-87831722b39f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:35.790615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a020cb5b-823d-4b63-8528-87831722b39f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:35.791398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a020cb5b-823d-4b63-8528-87831722b39f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:35.791848 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a020cb5b-823d-4b63-8528-87831722b39f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:35.822633 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a020cb5b-823d-4b63-8528-87831722b39f tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045441 Jul 20 05:17:35.823197 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3610/7199] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:35 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:36.834635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1ec16250-4676-467b-bc38-fe819104d4eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:36.835603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1ec16250-4676-467b-bc38-fe819104d4eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:36.843276 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ec16250-4676-467b-bc38-fe819104d4eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:36.843743 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ec16250-4676-467b-bc38-fe819104d4eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:36.844514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ec16250-4676-467b-bc38-fe819104d4eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:36.844966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1ec16250-4676-467b-bc38-fe819104d4eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:36.874941 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1ec16250-4676-467b-bc38-fe819104d4eb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044147 Jul 20 05:17:36.875458 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3590/7200] 10.222.0.59 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:36 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:17:36.885515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0925f1fe-8066-4e9c-98ec-781ca1b17dab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:36.886030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0925f1fe-8066-4e9c-98ec-781ca1b17dab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:36.893250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0925f1fe-8066-4e9c-98ec-781ca1b17dab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:36.893720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0925f1fe-8066-4e9c-98ec-781ca1b17dab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:36.894537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0925f1fe-8066-4e9c-98ec-781ca1b17dab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:36.894988 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0925f1fe-8066-4e9c-98ec-781ca1b17dab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:36.980798 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-0925f1fe-8066-4e9c-98ec-781ca1b17dab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] HTTP exception thrown: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 is not attached to volume 8c80c922-0b89-49e5-a12c-27662b24ad87 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0925f1fe-8066-4e9c-98ec-781ca1b17dab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Request method failure captured: Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: request: DELETE /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments/8c80c922-0b89-49e5-a12c-27662b24ad87 HTTP/1.1 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi146Na1XFvWIBzMrtu7bZwanuqQKCXZTSunjC-qhQSnmi42aw90nqcddy7z7L-IAgvE8VBh7m6MVLre7LzkrBrixuTZ4A9QDZKlsGF93bWYdAq178kEqK5IzvFEdinaCfZs_7sF84QQUsIzh1dWMwBMSOhfcTeKftfxoUk_veorKBcSA Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d2248330263b46e2834d4a9b900644cd Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2248330263b46e2834d4a9b900644cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d2248330263b46e2834d4a9b900644cd Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestMinimumBasicScenario-2142285551-project Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 654fa76e2f2e4fdf97f377b9389ff224 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestMinimumBasicScenario-2142285551-project Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 is not attached to volume 8c80c922-0b89-49e5-a12c-27662b24ad87 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'server_id': '3c896a1f-d636-4807-b19a-44c5b361c044', 'id': '8c80c922-0b89-49e5-a12c-27662b24ad87'} Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8c80c922-0b89-49e5-a12c-27662b24ad87. Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 is not attached to volume 8c80c922-0b89-49e5-a12c-27662b24ad87 Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:36.983371 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:36.988020 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:36.988020 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:36.988020 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 is not attached to volume 8c80c922-0b89-49e5-a12c-27662b24ad87 Jul 20 05:17:36.988020 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:17:36.988020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0925f1fe-8066-4e9c-98ec-781ca1b17dab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Returning 404 to user: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 is not attached to volume 8c80c922-0b89-49e5-a12c-27662b24ad87 {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:36.988020 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0925f1fe-8066-4e9c-98ec-781ca1b17dab tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments/8c80c922-0b89-49e5-a12c-27662b24ad87" status: 404 len: 154 microversion: 2.1 time: 0.103534 Jul 20 05:17:36.988020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3611/7201] 10.222.0.59 () {58 vars in 1415 bytes} [Wed Jul 20 05:17:36 2022] DELETE /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044/os-volume_attachments/8c80c922-0b89-49e5-a12c-27662b24ad87 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:17:40.229505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2b83e4cc-dd78-48bf-86c0-decb49a3f81c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:40.230156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2b83e4cc-dd78-48bf-86c0-decb49a3f81c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:40.237476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b83e4cc-dd78-48bf-86c0-decb49a3f81c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:40.237948 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b83e4cc-dd78-48bf-86c0-decb49a3f81c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:40.238768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b83e4cc-dd78-48bf-86c0-decb49a3f81c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:40.239232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2b83e4cc-dd78-48bf-86c0-decb49a3f81c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:40.268076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2b83e4cc-dd78-48bf-86c0-decb49a3f81c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:17:40.344133 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2b83e4cc-dd78-48bf-86c0-decb49a3f81c tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 204 len: 0 microversion: 2.1 time: 0.118196 Jul 20 05:17:40.344763 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3591/7202] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:17:40 2022] DELETE /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:17:40.353227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e389ed02-d298-4e43-876e-479ff68f086e tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:40.353889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e389ed02-d298-4e43-876e-479ff68f086e tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:40.361019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e389ed02-d298-4e43-876e-479ff68f086e tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:40.361490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e389ed02-d298-4e43-876e-479ff68f086e tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:40.362289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e389ed02-d298-4e43-876e-479ff68f086e tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:40.362742 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e389ed02-d298-4e43-876e-479ff68f086e tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:40.502327 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e389ed02-d298-4e43-876e-479ff68f086e tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:40.510101 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e389ed02-d298-4e43-876e-479ff68f086e tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1553 microversion: 2.1 time: 0.160830 Jul 20 05:17:40.510721 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3612/7203] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:40 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:41.527806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf37decb-6346-4a02-b3d4-15864ab8b1bb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:41.529259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cf37decb-6346-4a02-b3d4-15864ab8b1bb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:41.536149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf37decb-6346-4a02-b3d4-15864ab8b1bb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.536610 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf37decb-6346-4a02-b3d4-15864ab8b1bb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.537386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf37decb-6346-4a02-b3d4-15864ab8b1bb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.537836 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf37decb-6346-4a02-b3d4-15864ab8b1bb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.678412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cf37decb-6346-4a02-b3d4-15864ab8b1bb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:41.686069 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf37decb-6346-4a02-b3d4-15864ab8b1bb tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1553 microversion: 2.1 time: 0.162591 Jul 20 05:17:41.686681 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3592/7204] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:41 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:42.419520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c86a3283-5898-4f28-9731-3fa25cdda221 req-804f0e5e-f614-413e-a12c-16a685431b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c896a1f-d636-4807-b19a-44c5b361c044", "name": "network-vif-deleted", "tag": "442751f0-3b46-427a-bf31-fb8dad9b3631"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:42.430711 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c86a3283-5898-4f28-9731-3fa25cdda221 req-804f0e5e-f614-413e-a12c-16a685431b06 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:42.431178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c86a3283-5898-4f28-9731-3fa25cdda221 req-804f0e5e-f614-413e-a12c-16a685431b06 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:42.443211 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c86a3283-5898-4f28-9731-3fa25cdda221 req-804f0e5e-f614-413e-a12c-16a685431b06 service nova] Creating event network-vif-deleted:442751f0-3b46-427a-bf31-fb8dad9b3631 for instance 3c896a1f-d636-4807-b19a-44c5b361c044 on n-h1-760456-11 Jul 20 05:17:42.448130 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c86a3283-5898-4f28-9731-3fa25cdda221 req-804f0e5e-f614-413e-a12c-16a685431b06 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Jul 20 05:17:42.448735 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3613/7205] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:42.704012 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:42.704660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:42.711945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:42.712419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:42.713227 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:42.713814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:42.751812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:42.752286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:42.752930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lazy-loading 'fault' on Instance uuid 3c896a1f-d636-4807-b19a-44c5b361c044 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:17:42.801348 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654fa76e2f2e4fdf97f377b9389ff224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2248330263b46e2834d4a9b900644cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:42.809412 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-62506b6f-81c2-4c67-be70-ca1acf0d4244 tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 200 len: 1346 microversion: 2.1 time: 0.109747 Jul 20 05:17:42.818905 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3593/7206] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:42 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 1346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:43.829525 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b73d5095-3f70-4bf8-93a9-cac542330aea tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:43.830239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b73d5095-3f70-4bf8-93a9-cac542330aea tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] [instance: 3c896a1f-d636-4807-b19a-44c5b361c044] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:43.836529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b73d5095-3f70-4bf8-93a9-cac542330aea tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:43.836990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b73d5095-3f70-4bf8-93a9-cac542330aea tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:43.837759 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b73d5095-3f70-4bf8-93a9-cac542330aea tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:43.838236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b73d5095-3f70-4bf8-93a9-cac542330aea tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:43.852064 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-b73d5095-3f70-4bf8-93a9-cac542330aea tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] HTTP exception thrown: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 could not be found. Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b73d5095-3f70-4bf8-93a9-cac542330aea tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Request method failure captured: Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 HTTP/1.1 Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi146Na1XFvWIBzMrtu7bZwanuqQKCXZTSunjC-qhQSnmi42aw90nqcddy7z7L-IAgvE8VBh7m6MVLre7LzkrBrixuTZ4A9QDZKlsGF93bWYdAq178kEqK5IzvFEdinaCfZs_7sF84QQUsIzh1dWMwBMSOhfcTeKftfxoUk_veorKBcSA Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: d2248330263b46e2834d4a9b900644cd Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2248330263b46e2834d4a9b900644cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2248330263b46e2834d4a9b900644cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: d2248330263b46e2834d4a9b900644cd Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2142285551 Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestMinimumBasicScenario-2142285551-project Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 654fa76e2f2e4fdf97f377b9389ff224 Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestMinimumBasicScenario-2142285551-project Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 could not be found. Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '3c896a1f-d636-4807-b19a-44c5b361c044'} Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 could not be found. Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 could not be found. Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:43.853690 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:17:43.858458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:43.858458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:43.858458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:43.858458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:43.858458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:43.858458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 could not be found. Jul 20 05:17:43.858458 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:17:43.858458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b73d5095-3f70-4bf8-93a9-cac542330aea tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Returning 404 to user: Instance 3c896a1f-d636-4807-b19a-44c5b361c044 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:43.858458 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b73d5095-3f70-4bf8-93a9-cac542330aea tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044" status: 404 len: 111 microversion: 2.1 time: 0.031955 Jul 20 05:17:43.858458 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3614/7207] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:43 2022] GET /compute/v2.1/servers/3c896a1f-d636-4807-b19a-44c5b361c044 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:17:43.864896 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e3b6168e-26a8-4eec-9e65-0793a92fdd8b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] Calling method '.version_select at 0x7fb8410fa160>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:43.884130 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e3b6168e-26a8-4eec-9e65-0793a92fdd8b tempest-TestMinimumBasicScenario-2142285551 tempest-TestMinimumBasicScenario-2142285551-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-59070156" status: 202 len: 0 microversion: 2.1 time: 0.023045 Jul 20 05:17:43.884705 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3594/7208] 10.222.0.59 () {58 vars in 1265 bytes} [Wed Jul 20 05:17:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-59070156 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:17:53.547121 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9f0a9db4-9cc5-4c7e-b323-069b17218268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'create', calling method: .version_select at 0x7fb841436040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-336532543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/uu33IiBkdjUMYt+EERmOGG0fL/ZoNPWuxiFofrQY92NZK+seTgahyD6gSleBmvYmuKcUxuOioG3UZ+EYi0St7qCQ4NH6ZGwdxhsWOsD8xeQBoAUBcBbPEoNDRf+j4sw=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:53.561366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9f0a9db4-9cc5-4c7e-b323-069b17218268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:17:53.567487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-9f0a9db4-9cc5-4c7e-b323-069b17218268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for user 94ce2ee1efa04a06806daec00f2dea0c and project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:17:53.593670 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9f0a9db4-9cc5-4c7e-b323-069b17218268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.218640 Jul 20 05:17:53.594378 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3615/7209] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:17:53 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:58.971043 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:58.972538 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:58.977222 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1093369010", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "ff45cfcc-37b9-4860-84a3-358f7a4c08a8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-336532543", "security_groups": [{"name": "tempest-secgroup-smoke-563316442"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:59.114068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] validate_networks() for [('ff45cfcc-37b9-4860-84a3-358f7a4c08a8', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:17:59.631577 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:17:59.632096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:17:59.633146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:17:59.633619 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:17:59.634063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:17:59.644887 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:59.645287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:59.646676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:59.647146 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:59.665832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:17:59.671384 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for user 94ce2ee1efa04a06806daec00f2dea0c and project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:17:59.684301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:17:59.686652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:17:59.735782 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2d7db4e5-2ddf-4390-b928-22a1e1133019 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.766715 Jul 20 05:17:59.736630 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3595/7210] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:17:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:17:59.744197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=38 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:59.750769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3118b860-51ad-4152-9c44-54569712ea83 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:59.751395 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3118b860-51ad-4152-9c44-54569712ea83 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:59.837226 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3118b860-51ad-4152-9c44-54569712ea83 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:59.845062 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3118b860-51ad-4152-9c44-54569712ea83 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1266 microversion: 2.1 time: 0.101888 Jul 20 05:17:59.845642 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3616/7211] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:59 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:00.865426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d25c079-a92f-4d9f-be25-b22d5f6fc2f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:00.866065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d25c079-a92f-4d9f-be25-b22d5f6fc2f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:00.878953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d25c079-a92f-4d9f-be25-b22d5f6fc2f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:00.879714 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d25c079-a92f-4d9f-be25-b22d5f6fc2f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:00.881650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d25c079-a92f-4d9f-be25-b22d5f6fc2f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:00.882445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d25c079-a92f-4d9f-be25-b22d5f6fc2f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:00.972707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d25c079-a92f-4d9f-be25-b22d5f6fc2f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:00.981954 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d25c079-a92f-4d9f-be25-b22d5f6fc2f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1326 microversion: 2.1 time: 0.123363 Jul 20 05:18:00.983250 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3596/7212] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:00 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:02.002335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-efc55d69-6bed-45bc-b8e6-8800fbc7f255 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:02.002880 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-efc55d69-6bed-45bc-b8e6-8800fbc7f255 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:02.007074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:02.012588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-efc55d69-6bed-45bc-b8e6-8800fbc7f255 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:02.013385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-efc55d69-6bed-45bc-b8e6-8800fbc7f255 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:02.014588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-efc55d69-6bed-45bc-b8e6-8800fbc7f255 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:02.015262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-efc55d69-6bed-45bc-b8e6-8800fbc7f255 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:02.183954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-efc55d69-6bed-45bc-b8e6-8800fbc7f255 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:02.193683 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-efc55d69-6bed-45bc-b8e6-8800fbc7f255 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1391 microversion: 2.1 time: 0.195790 Jul 20 05:18:02.194767 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3617/7213] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:01 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:02.557618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d38ad3f1-e156-404c-85bd-78379cb2fc51 req-82ba576a-d272-4ed9-ba8e-2ae7af13ecb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4010bb86-4da4-4555-840a-7be96dcaea0d", "tag": "ef722250-1aad-4f1c-91b3-cd74af12de90"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:02.583700 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d38ad3f1-e156-404c-85bd-78379cb2fc51 req-82ba576a-d272-4ed9-ba8e-2ae7af13ecb9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:02.584205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d38ad3f1-e156-404c-85bd-78379cb2fc51 req-82ba576a-d272-4ed9-ba8e-2ae7af13ecb9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:02.601214 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d38ad3f1-e156-404c-85bd-78379cb2fc51 req-82ba576a-d272-4ed9-ba8e-2ae7af13ecb9 service nova] Creating event network-changed:ef722250-1aad-4f1c-91b3-cd74af12de90 for instance 4010bb86-4da4-4555-840a-7be96dcaea0d on n-h2-760456-11 Jul 20 05:18:02.613109 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d38ad3f1-e156-404c-85bd-78379cb2fc51 req-82ba576a-d272-4ed9-ba8e-2ae7af13ecb9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059661 Jul 20 05:18:02.613869 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3597/7214] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:18:03.212023 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-991c04c4-208d-40a6-bcdb-1fa2e1966df0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:03.212647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-991c04c4-208d-40a6-bcdb-1fa2e1966df0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:03.219689 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-991c04c4-208d-40a6-bcdb-1fa2e1966df0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:03.220172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-991c04c4-208d-40a6-bcdb-1fa2e1966df0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:03.220983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-991c04c4-208d-40a6-bcdb-1fa2e1966df0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:03.221435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-991c04c4-208d-40a6-bcdb-1fa2e1966df0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:03.361462 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-991c04c4-208d-40a6-bcdb-1fa2e1966df0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:03.369271 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-991c04c4-208d-40a6-bcdb-1fa2e1966df0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1391 microversion: 2.1 time: 0.160928 Jul 20 05:18:03.369846 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3618/7215] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:03 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:04.388555 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-77ceb4d6-7f58-40dd-987f-f8e43450a0f2 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:04.389220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-77ceb4d6-7f58-40dd-987f-f8e43450a0f2 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:04.395832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77ceb4d6-7f58-40dd-987f-f8e43450a0f2 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.396309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77ceb4d6-7f58-40dd-987f-f8e43450a0f2 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.397103 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77ceb4d6-7f58-40dd-987f-f8e43450a0f2 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:04.397561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-77ceb4d6-7f58-40dd-987f-f8e43450a0f2 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:04.625857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-77ceb4d6-7f58-40dd-987f-f8e43450a0f2 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:04.636497 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-77ceb4d6-7f58-40dd-987f-f8e43450a0f2 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1391 microversion: 2.1 time: 0.253597 Jul 20 05:18:04.639571 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3598/7216] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:04 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:05.656725 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-cf9682a2-84e3-406a-95e1-a6590169c22f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:05.657282 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-cf9682a2-84e3-406a-95e1-a6590169c22f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:05.664380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf9682a2-84e3-406a-95e1-a6590169c22f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:05.664844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf9682a2-84e3-406a-95e1-a6590169c22f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:05.665624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf9682a2-84e3-406a-95e1-a6590169c22f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:05.666077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-cf9682a2-84e3-406a-95e1-a6590169c22f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:05.799905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-cf9682a2-84e3-406a-95e1-a6590169c22f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:05.807709 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-cf9682a2-84e3-406a-95e1-a6590169c22f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1391 microversion: 2.1 time: 0.156215 Jul 20 05:18:05.808288 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3619/7217] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:05 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:06.726941 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c67f89f6-77ba-477b-a647-f772ff69d684 req-72f38bcc-dc09-474a-80c5-c4a105d3f01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4010bb86-4da4-4555-840a-7be96dcaea0d", "name": "network-vif-plugged", "status": "completed", "tag": "ef722250-1aad-4f1c-91b3-cd74af12de90"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:06.736576 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c67f89f6-77ba-477b-a647-f772ff69d684 req-72f38bcc-dc09-474a-80c5-c4a105d3f01c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:06.737927 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c67f89f6-77ba-477b-a647-f772ff69d684 req-72f38bcc-dc09-474a-80c5-c4a105d3f01c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:06.750434 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c67f89f6-77ba-477b-a647-f772ff69d684 req-72f38bcc-dc09-474a-80c5-c4a105d3f01c service nova] Creating event network-vif-plugged:ef722250-1aad-4f1c-91b3-cd74af12de90 for instance 4010bb86-4da4-4555-840a-7be96dcaea0d on n-h2-760456-11 Jul 20 05:18:06.755715 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c67f89f6-77ba-477b-a647-f772ff69d684 req-72f38bcc-dc09-474a-80c5-c4a105d3f01c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032545 Jul 20 05:18:06.756319 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3599/7218] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:06.825015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-af223dce-b803-4650-9d6a-ef4282a9b764 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:06.825636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-af223dce-b803-4650-9d6a-ef4282a9b764 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:06.832677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af223dce-b803-4650-9d6a-ef4282a9b764 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:06.833142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af223dce-b803-4650-9d6a-ef4282a9b764 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:06.833929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af223dce-b803-4650-9d6a-ef4282a9b764 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:06.834405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af223dce-b803-4650-9d6a-ef4282a9b764 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:06.973586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-af223dce-b803-4650-9d6a-ef4282a9b764 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:06.982458 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-af223dce-b803-4650-9d6a-ef4282a9b764 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1391 microversion: 2.1 time: 0.161962 Jul 20 05:18:06.983044 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3620/7219] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:06 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:18:08.001305 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3ccdcd67-462b-489a-8684-519d226c3cba tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:08.002010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3ccdcd67-462b-489a-8684-519d226c3cba tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:08.009228 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ccdcd67-462b-489a-8684-519d226c3cba tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:08.009709 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ccdcd67-462b-489a-8684-519d226c3cba tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:08.010546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ccdcd67-462b-489a-8684-519d226c3cba tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:08.010994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3ccdcd67-462b-489a-8684-519d226c3cba tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:08.151254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3ccdcd67-462b-489a-8684-519d226c3cba tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:08.159805 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3ccdcd67-462b-489a-8684-519d226c3cba tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1563 microversion: 2.1 time: 0.163614 Jul 20 05:18:08.160387 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3600/7220] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:07 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:08.175978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e5667db2-9700-4121-96d5-56fa6238bc8d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:08.176603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e5667db2-9700-4121-96d5-56fa6238bc8d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:08.183497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5667db2-9700-4121-96d5-56fa6238bc8d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:08.184534 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5667db2-9700-4121-96d5-56fa6238bc8d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:08.185317 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5667db2-9700-4121-96d5-56fa6238bc8d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:08.185769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5667db2-9700-4121-96d5-56fa6238bc8d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:08.318144 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e5667db2-9700-4121-96d5-56fa6238bc8d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:08.326757 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e5667db2-9700-4121-96d5-56fa6238bc8d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1563 microversion: 2.1 time: 0.154388 Jul 20 05:18:08.327346 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3621/7221] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:08 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:10.236918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d676a838-29f1-41ad-8634-08e44f6c14c4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:10.237572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d676a838-29f1-41ad-8634-08e44f6c14c4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:10.240950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:10.241776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:10.242498 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:10.249499 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d676a838-29f1-41ad-8634-08e44f6c14c4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:10.249989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d676a838-29f1-41ad-8634-08e44f6c14c4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:10.251010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d676a838-29f1-41ad-8634-08e44f6c14c4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:10.251639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d676a838-29f1-41ad-8634-08e44f6c14c4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:10.315420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-c6fd6e3a-147a-4259-bb72-5409c5492ef0 req-56d6e65c-789c-426c-8b9b-d8691370d6ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4010bb86-4da4-4555-840a-7be96dcaea0d", "tag": "ef722250-1aad-4f1c-91b3-cd74af12de90"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:10.324702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c6fd6e3a-147a-4259-bb72-5409c5492ef0 req-56d6e65c-789c-426c-8b9b-d8691370d6ec service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:10.325380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-c6fd6e3a-147a-4259-bb72-5409c5492ef0 req-56d6e65c-789c-426c-8b9b-d8691370d6ec service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:10.337211 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-c6fd6e3a-147a-4259-bb72-5409c5492ef0 req-56d6e65c-789c-426c-8b9b-d8691370d6ec service nova] Creating event network-changed:ef722250-1aad-4f1c-91b3-cd74af12de90 for instance 4010bb86-4da4-4555-840a-7be96dcaea0d on n-h2-760456-11 Jul 20 05:18:10.343631 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-c6fd6e3a-147a-4259-bb72-5409c5492ef0 req-56d6e65c-789c-426c-8b9b-d8691370d6ec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108944 Jul 20 05:18:10.344627 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3622/7222] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:10.430766 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d676a838-29f1-41ad-8634-08e44f6c14c4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:10.441786 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d676a838-29f1-41ad-8634-08e44f6c14c4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1563 microversion: 2.1 time: 0.208786 Jul 20 05:18:10.458753 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3601/7223] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:10 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1563 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:33.724547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ed45a4a8-8329-4be5-9d98-e3ff1ddbc226 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:33.726072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ed45a4a8-8329-4be5-9d98-e3ff1ddbc226 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:33.728460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=11 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:33.729122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=32 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:33.736577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed45a4a8-8329-4be5-9d98-e3ff1ddbc226 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:33.737041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed45a4a8-8329-4be5-9d98-e3ff1ddbc226 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:33.737837 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed45a4a8-8329-4be5-9d98-e3ff1ddbc226 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:33.738307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ed45a4a8-8329-4be5-9d98-e3ff1ddbc226 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:33.802853 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ed45a4a8-8329-4be5-9d98-e3ff1ddbc226 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d/action" status: 200 len: 24545 microversion: 2.1 time: 0.084657 Jul 20 05:18:33.803499 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3623/7224] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:33 2022] POST /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d/action => generated 24545 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:18:44.828650 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7e1b3c32-8618-4efa-92f1-9484433852ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:44.829279 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7e1b3c32-8618-4efa-92f1-9484433852ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:44.831552 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:44.832342 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=30 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:44.839120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e1b3c32-8618-4efa-92f1-9484433852ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:44.839591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e1b3c32-8618-4efa-92f1-9484433852ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:44.840382 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e1b3c32-8618-4efa-92f1-9484433852ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:44.841421 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e1b3c32-8618-4efa-92f1-9484433852ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:44.909103 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7e1b3c32-8618-4efa-92f1-9484433852ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d/action" status: 202 len: 0 microversion: 2.1 time: 0.084815 Jul 20 05:18:44.909743 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3602/7225] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:44 2022] POST /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:18:44.918592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bcde6fd4-5de0-4156-a2e4-b5d250493b82 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:44.919911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bcde6fd4-5de0-4156-a2e4-b5d250493b82 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:44.923022 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:44.923691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=4 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:44.930521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bcde6fd4-5de0-4156-a2e4-b5d250493b82 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:44.930983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bcde6fd4-5de0-4156-a2e4-b5d250493b82 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:44.931792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bcde6fd4-5de0-4156-a2e4-b5d250493b82 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:44.932239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bcde6fd4-5de0-4156-a2e4-b5d250493b82 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:45.076550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bcde6fd4-5de0-4156-a2e4-b5d250493b82 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:45.085018 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bcde6fd4-5de0-4156-a2e4-b5d250493b82 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1687 microversion: 2.1 time: 0.170603 Jul 20 05:18:45.085861 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3624/7226] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:44 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:46.104682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8d9b3e91-0df1-4bfb-a3d3-78fd84ee10a0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:46.105420 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8d9b3e91-0df1-4bfb-a3d3-78fd84ee10a0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:46.112533 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d9b3e91-0df1-4bfb-a3d3-78fd84ee10a0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:46.112997 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d9b3e91-0df1-4bfb-a3d3-78fd84ee10a0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:46.113775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d9b3e91-0df1-4bfb-a3d3-78fd84ee10a0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:46.114226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8d9b3e91-0df1-4bfb-a3d3-78fd84ee10a0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:46.247893 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-8d9b3e91-0df1-4bfb-a3d3-78fd84ee10a0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:46.255896 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8d9b3e91-0df1-4bfb-a3d3-78fd84ee10a0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1667 microversion: 2.1 time: 0.156406 Jul 20 05:18:46.256474 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3603/7227] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:46 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:47.347082 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f9a88fc4-129f-44ad-abe3-772f15ea350d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:47.348019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f9a88fc4-129f-44ad-abe3-772f15ea350d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:47.354604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a88fc4-129f-44ad-abe3-772f15ea350d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:47.355065 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a88fc4-129f-44ad-abe3-772f15ea350d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:47.355835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a88fc4-129f-44ad-abe3-772f15ea350d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:47.357055 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f9a88fc4-129f-44ad-abe3-772f15ea350d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:47.408131 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f9a88fc4-129f-44ad-abe3-772f15ea350d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d/action" status: 200 len: 32613 microversion: 2.1 time: 0.064969 Jul 20 05:18:47.408695 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3625/7228] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:47 2022] POST /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d/action => generated 32613 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:18:47.421052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-51d6c859-5ebe-4fc9-a712-d8765895dd88 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:47.421629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-51d6c859-5ebe-4fc9-a712-d8765895dd88 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:47.428564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51d6c859-5ebe-4fc9-a712-d8765895dd88 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:47.429030 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51d6c859-5ebe-4fc9-a712-d8765895dd88 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:47.429809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51d6c859-5ebe-4fc9-a712-d8765895dd88 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:47.430278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-51d6c859-5ebe-4fc9-a712-d8765895dd88 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:47.500526 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-51d6c859-5ebe-4fc9-a712-d8765895dd88 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d/action" status: 202 len: 0 microversion: 2.1 time: 0.084045 Jul 20 05:18:47.501177 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3604/7229] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:47 2022] POST /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:18:47.512176 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-48d0e624-707e-4c09-afd2-e4d498d23615 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:47.513096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-48d0e624-707e-4c09-afd2-e4d498d23615 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:47.520915 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-48d0e624-707e-4c09-afd2-e4d498d23615 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:47.521378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-48d0e624-707e-4c09-afd2-e4d498d23615 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:47.522164 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-48d0e624-707e-4c09-afd2-e4d498d23615 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:47.522686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-48d0e624-707e-4c09-afd2-e4d498d23615 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:47.662996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-48d0e624-707e-4c09-afd2-e4d498d23615 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:47.670582 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-48d0e624-707e-4c09-afd2-e4d498d23615 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1674 microversion: 2.1 time: 0.162635 Jul 20 05:18:47.671415 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3626/7230] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:47 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:48.691282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b1c5bf40-6948-4300-a6fb-fd258003c231 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:48.692180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b1c5bf40-6948-4300-a6fb-fd258003c231 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:48.698694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1c5bf40-6948-4300-a6fb-fd258003c231 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:48.699172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1c5bf40-6948-4300-a6fb-fd258003c231 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:48.700119 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1c5bf40-6948-4300-a6fb-fd258003c231 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:48.701272 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b1c5bf40-6948-4300-a6fb-fd258003c231 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:48.835892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b1c5bf40-6948-4300-a6fb-fd258003c231 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:48.843537 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b1c5bf40-6948-4300-a6fb-fd258003c231 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1682 microversion: 2.1 time: 0.157525 Jul 20 05:18:48.844118 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3605/7231] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:48 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:48.932519 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fbf32827-a5ab-4a9b-a621-dfbab27e43fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:48.933475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fbf32827-a5ab-4a9b-a621-dfbab27e43fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:48.941983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf32827-a5ab-4a9b-a621-dfbab27e43fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:48.942492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf32827-a5ab-4a9b-a621-dfbab27e43fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:48.943273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf32827-a5ab-4a9b-a621-dfbab27e43fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:48.943720 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fbf32827-a5ab-4a9b-a621-dfbab27e43fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:48.993578 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fbf32827-a5ab-4a9b-a621-dfbab27e43fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d/action" status: 200 len: 38438 microversion: 2.1 time: 0.064879 Jul 20 05:18:48.994523 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3627/7232] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:18:48 2022] POST /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d/action => generated 38438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:18:49.980478 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e9ad467f-3bcf-4117-85b5-ef4744c2d7de tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:49.981010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e9ad467f-3bcf-4117-85b5-ef4744c2d7de tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:49.984718 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9adb2f98-0982-44d4-84b2-28f90c0f0cd1 req-2c4ce5d1-81aa-4112-b705-1e5ca6900335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4010bb86-4da4-4555-840a-7be96dcaea0d", "tag": "ef722250-1aad-4f1c-91b3-cd74af12de90"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:49.989351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9ad467f-3bcf-4117-85b5-ef4744c2d7de tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:49.989945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9ad467f-3bcf-4117-85b5-ef4744c2d7de tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:49.990869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9ad467f-3bcf-4117-85b5-ef4744c2d7de tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:49.991405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9ad467f-3bcf-4117-85b5-ef4744c2d7de tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:49.995061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9adb2f98-0982-44d4-84b2-28f90c0f0cd1 req-2c4ce5d1-81aa-4112-b705-1e5ca6900335 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:49.995524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9adb2f98-0982-44d4-84b2-28f90c0f0cd1 req-2c4ce5d1-81aa-4112-b705-1e5ca6900335 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:50.006858 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9adb2f98-0982-44d4-84b2-28f90c0f0cd1 req-2c4ce5d1-81aa-4112-b705-1e5ca6900335 service nova] Creating event network-changed:ef722250-1aad-4f1c-91b3-cd74af12de90 for instance 4010bb86-4da4-4555-840a-7be96dcaea0d on n-h2-760456-11 Jul 20 05:18:50.011748 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9adb2f98-0982-44d4-84b2-28f90c0f0cd1 req-2c4ce5d1-81aa-4112-b705-1e5ca6900335 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031199 Jul 20 05:18:50.012360 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3628/7233] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:18:50.019468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e9ad467f-3bcf-4117-85b5-ef4744c2d7de tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:18:50.111156 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e9ad467f-3bcf-4117-85b5-ef4744c2d7de tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 204 len: 0 microversion: 2.1 time: 0.134200 Jul 20 05:18:50.112110 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3606/7234] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:18:49 2022] DELETE /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:18:50.128944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b82225da-a5e6-46a1-8a9a-50bd82753096 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:50.130981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b82225da-a5e6-46a1-8a9a-50bd82753096 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:50.138040 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b82225da-a5e6-46a1-8a9a-50bd82753096 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:50.139047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b82225da-a5e6-46a1-8a9a-50bd82753096 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:50.139996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b82225da-a5e6-46a1-8a9a-50bd82753096 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:50.140669 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b82225da-a5e6-46a1-8a9a-50bd82753096 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:50.280613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b82225da-a5e6-46a1-8a9a-50bd82753096 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:50.288389 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b82225da-a5e6-46a1-8a9a-50bd82753096 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1688 microversion: 2.1 time: 0.171333 Jul 20 05:18:50.289098 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3629/7235] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:50 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:51.308419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0ade3a65-73a2-459f-b470-b09e94086b0c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:51.309075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0ade3a65-73a2-459f-b470-b09e94086b0c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:51.316732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ade3a65-73a2-459f-b470-b09e94086b0c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:51.317206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ade3a65-73a2-459f-b470-b09e94086b0c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:51.317998 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ade3a65-73a2-459f-b470-b09e94086b0c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:51.318501 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ade3a65-73a2-459f-b470-b09e94086b0c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:51.525238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0ade3a65-73a2-459f-b470-b09e94086b0c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:51.533152 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0ade3a65-73a2-459f-b470-b09e94086b0c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 200 len: 1688 microversion: 2.1 time: 0.229129 Jul 20 05:18:51.533780 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3607/7236] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:51 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 1688 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:52.117529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-24864114-0d22-40b3-8f7f-c102d272244b req-2a5d79fe-c4e0-4dad-89aa-8524fb5104aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4010bb86-4da4-4555-840a-7be96dcaea0d", "name": "network-vif-deleted", "tag": "ef722250-1aad-4f1c-91b3-cd74af12de90"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:52.129991 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-24864114-0d22-40b3-8f7f-c102d272244b req-2a5d79fe-c4e0-4dad-89aa-8524fb5104aa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:52.130840 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-24864114-0d22-40b3-8f7f-c102d272244b req-2a5d79fe-c4e0-4dad-89aa-8524fb5104aa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:52.143672 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-24864114-0d22-40b3-8f7f-c102d272244b req-2a5d79fe-c4e0-4dad-89aa-8524fb5104aa service nova] Creating event network-vif-deleted:ef722250-1aad-4f1c-91b3-cd74af12de90 for instance 4010bb86-4da4-4555-840a-7be96dcaea0d on n-h2-760456-11 Jul 20 05:18:52.149947 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-24864114-0d22-40b3-8f7f-c102d272244b req-2a5d79fe-c4e0-4dad-89aa-8524fb5104aa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036208 Jul 20 05:18:52.150584 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3630/7237] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:52.552624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c091cdef-ff2d-4d87-84e0-97e015c2847e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:52.553465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c091cdef-ff2d-4d87-84e0-97e015c2847e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 4010bb86-4da4-4555-840a-7be96dcaea0d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:52.561514 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c091cdef-ff2d-4d87-84e0-97e015c2847e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:52.562076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c091cdef-ff2d-4d87-84e0-97e015c2847e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:52.562989 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c091cdef-ff2d-4d87-84e0-97e015c2847e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:52.563453 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c091cdef-ff2d-4d87-84e0-97e015c2847e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:52.579522 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-c091cdef-ff2d-4d87-84e0-97e015c2847e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] HTTP exception thrown: Instance 4010bb86-4da4-4555-840a-7be96dcaea0d could not be found. Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c091cdef-ff2d-4d87-84e0-97e015c2847e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Request method failure captured: Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d HTTP/1.1 Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi15AA32MdWGcsRKaegS9wCO7BQHCiBClAHs8Yj7W55ghdKLBdFaoEB0VWdUPDzVnnjmtcoweYy1DbFe8xTKqrn31fS7Ei4EM2dAu-nEmvlKhj2nHYdoMCGwfnui78t-amakQizCUO4R9Mqw4cezwzBJRYmq1_pk4SMpNM8U4Yv_ZgzeU Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 7dd78539b9cf4df8874c9562bef52b8c Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 7dd78539b9cf4df8874c9562bef52b8c Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestNetworkAdvancedServerOps-1617251458-project Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 94ce2ee1efa04a06806daec00f2dea0c Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1617251458-project Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 4010bb86-4da4-4555-840a-7be96dcaea0d could not be found. Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '4010bb86-4da4-4555-840a-7be96dcaea0d'} Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4010bb86-4da4-4555-840a-7be96dcaea0d could not be found. Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4010bb86-4da4-4555-840a-7be96dcaea0d could not be found. Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:18:52.581240 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4010bb86-4da4-4555-840a-7be96dcaea0d could not be found. Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c091cdef-ff2d-4d87-84e0-97e015c2847e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Returning 404 to user: Instance 4010bb86-4da4-4555-840a-7be96dcaea0d could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c091cdef-ff2d-4d87-84e0-97e015c2847e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d" status: 404 len: 111 microversion: 2.1 time: 0.035176 Jul 20 05:18:52.586005 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3608/7238] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:52 2022] GET /compute/v2.1/servers/4010bb86-4da4-4555-840a-7be96dcaea0d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:18:56.015882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32abe685-8dff-47a4-8a69-7a305d441c9a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '.version_select at 0x7fb8410e5820>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:56.037394 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-32abe685-8dff-47a4-8a69-7a305d441c9a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-336532543" status: 202 len: 0 microversion: 2.1 time: 0.026069 Jul 20 05:18:56.037998 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3631/7239] 10.222.0.59 () {58 vars in 1280 bytes} [Wed Jul 20 05:18:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-336532543 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:18:56.068193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b877431d-0f34-41c9-ba81-c311899c7241 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'create', calling method: .version_select at 0x7fb84148c790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2093799309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6Qxp3M+KgPbhh1BXuqL+HgHGYbFApat6HfCuranl3C8h3AHxeH+LNbVXD1IEePpWyrrxyvhXp7w3Br9/Q+hRuwOsSueCg1vMWAYglP6vUmIbmebp6DnE5sHYVZzR0knA=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:56.084963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b877431d-0f34-41c9-ba81-c311899c7241 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:18:56.090693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b877431d-0f34-41c9-ba81-c311899c7241 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for user 94ce2ee1efa04a06806daec00f2dea0c and project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:18:56.118146 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b877431d-0f34-41c9-ba81-c311899c7241 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055188 Jul 20 05:18:56.119049 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3609/7240] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:18:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:01.648703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1901704328", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "8dd64af1-1482-4a93-af27-5911b62018d3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2093799309", "security_groups": [{"name": "tempest-secgroup-smoke-444710098"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:01.771788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] validate_networks() for [('8dd64af1-1482-4a93-af27-5911b62018d3', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:19:02.136404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=30 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:02.218723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:19:02.219195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:19:02.219727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:19:02.220117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:19:02.220554 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:19:02.230676 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:02.232030 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:02.232859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:02.233310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:02.255529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:19:02.261384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for user 94ce2ee1efa04a06806daec00f2dea0c and project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:19:02.276621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:19:02.280630 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:19:02.348186 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4a3f3a8d-0188-4b24-b0cf-7b444d0c40c0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703305 Jul 20 05:19:02.348872 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3632/7241] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:19:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:19:02.361329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1fbefe90-eeb6-4314-89fe-7ec44f9a74cd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:02.362398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1fbefe90-eeb6-4314-89fe-7ec44f9a74cd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:02.436902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1fbefe90-eeb6-4314-89fe-7ec44f9a74cd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:02.444009 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1fbefe90-eeb6-4314-89fe-7ec44f9a74cd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1267 microversion: 2.1 time: 0.088833 Jul 20 05:19:02.454527 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3610/7242] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:02 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:03.462531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7ceffbb-d860-4164-85fd-8bea5bf7d636 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:03.463976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7ceffbb-d860-4164-85fd-8bea5bf7d636 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:03.477270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ceffbb-d860-4164-85fd-8bea5bf7d636 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:03.478832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ceffbb-d860-4164-85fd-8bea5bf7d636 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:03.482685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ceffbb-d860-4164-85fd-8bea5bf7d636 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:03.484967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ceffbb-d860-4164-85fd-8bea5bf7d636 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:03.636806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e7ceffbb-d860-4164-85fd-8bea5bf7d636 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:03.658950 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7ceffbb-d860-4164-85fd-8bea5bf7d636 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1327 microversion: 2.1 time: 0.198981 Jul 20 05:19:03.659606 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3633/7243] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:03 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1327 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:04.676679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6224397f-795b-4549-a4a4-941ba38fe920 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:04.677316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6224397f-795b-4549-a4a4-941ba38fe920 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:04.679661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:04.690814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6224397f-795b-4549-a4a4-941ba38fe920 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:04.691286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6224397f-795b-4549-a4a4-941ba38fe920 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:04.692283 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6224397f-795b-4549-a4a4-941ba38fe920 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:04.692908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6224397f-795b-4549-a4a4-941ba38fe920 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:04.845400 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6224397f-795b-4549-a4a4-941ba38fe920 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:04.855633 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6224397f-795b-4549-a4a4-941ba38fe920 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1392 microversion: 2.1 time: 0.181808 Jul 20 05:19:04.858211 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3611/7244] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:04 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:05.192097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1926c3f3-ca9e-412f-bce9-038f5650c642 req-205440a5-320c-459a-affd-1a1682c431a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d4db2f-b0a5-4cac-a357-d83f89d5f6f6", "tag": "2a009f25-ea5a-4899-ad90-c6620ff40b4d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:05.208127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1926c3f3-ca9e-412f-bce9-038f5650c642 req-205440a5-320c-459a-affd-1a1682c431a3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:05.208127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1926c3f3-ca9e-412f-bce9-038f5650c642 req-205440a5-320c-459a-affd-1a1682c431a3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:05.230617 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1926c3f3-ca9e-412f-bce9-038f5650c642 req-205440a5-320c-459a-affd-1a1682c431a3 service nova] Creating event network-changed:2a009f25-ea5a-4899-ad90-c6620ff40b4d for instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 on n-h2-760456-11 Jul 20 05:19:05.236401 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1926c3f3-ca9e-412f-bce9-038f5650c642 req-205440a5-320c-459a-affd-1a1682c431a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051748 Jul 20 05:19:05.237528 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3634/7245] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:05.875934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-15d5efbe-ed18-4dde-8600-986aff53abaa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:05.876476 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-15d5efbe-ed18-4dde-8600-986aff53abaa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:05.883515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15d5efbe-ed18-4dde-8600-986aff53abaa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:05.883976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15d5efbe-ed18-4dde-8600-986aff53abaa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:05.884757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15d5efbe-ed18-4dde-8600-986aff53abaa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:05.885209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-15d5efbe-ed18-4dde-8600-986aff53abaa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:06.031083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-15d5efbe-ed18-4dde-8600-986aff53abaa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:06.038647 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-15d5efbe-ed18-4dde-8600-986aff53abaa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1392 microversion: 2.1 time: 0.167304 Jul 20 05:19:06.039278 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3612/7246] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:05 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:07.057787 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0dcfa1e1-7b25-4559-a409-c909e3aea6bc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:07.058512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0dcfa1e1-7b25-4559-a409-c909e3aea6bc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:07.065316 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0dcfa1e1-7b25-4559-a409-c909e3aea6bc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:07.065769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0dcfa1e1-7b25-4559-a409-c909e3aea6bc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:07.066575 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0dcfa1e1-7b25-4559-a409-c909e3aea6bc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:07.067018 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0dcfa1e1-7b25-4559-a409-c909e3aea6bc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:07.206632 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0dcfa1e1-7b25-4559-a409-c909e3aea6bc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:07.214293 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0dcfa1e1-7b25-4559-a409-c909e3aea6bc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1392 microversion: 2.1 time: 0.161504 Jul 20 05:19:07.215106 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3635/7247] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:07 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:08.232638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ed8cd4f6-23ff-4b6b-ac4f-8cc9498f0da4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:08.233268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ed8cd4f6-23ff-4b6b-ac4f-8cc9498f0da4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:08.240341 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed8cd4f6-23ff-4b6b-ac4f-8cc9498f0da4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:08.240812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed8cd4f6-23ff-4b6b-ac4f-8cc9498f0da4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:08.241597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed8cd4f6-23ff-4b6b-ac4f-8cc9498f0da4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:08.242057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ed8cd4f6-23ff-4b6b-ac4f-8cc9498f0da4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:08.380467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ed8cd4f6-23ff-4b6b-ac4f-8cc9498f0da4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:08.388228 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ed8cd4f6-23ff-4b6b-ac4f-8cc9498f0da4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1392 microversion: 2.1 time: 0.160490 Jul 20 05:19:08.388802 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3613/7248] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:08 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:08.967873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-0a0e0bc9-f036-4846-8f79-66ae4d9ff527 req-7b9bb4e8-ea95-4c8c-babf-70a9883e197a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d4db2f-b0a5-4cac-a357-d83f89d5f6f6", "name": "network-vif-plugged", "status": "completed", "tag": "2a009f25-ea5a-4899-ad90-c6620ff40b4d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:08.977305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0a0e0bc9-f036-4846-8f79-66ae4d9ff527 req-7b9bb4e8-ea95-4c8c-babf-70a9883e197a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:08.977964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-0a0e0bc9-f036-4846-8f79-66ae4d9ff527 req-7b9bb4e8-ea95-4c8c-babf-70a9883e197a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:08.991260 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-0a0e0bc9-f036-4846-8f79-66ae4d9ff527 req-7b9bb4e8-ea95-4c8c-babf-70a9883e197a service nova] Creating event network-vif-plugged:2a009f25-ea5a-4899-ad90-c6620ff40b4d for instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 on n-h2-760456-11 Jul 20 05:19:08.997781 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-0a0e0bc9-f036-4846-8f79-66ae4d9ff527 req-7b9bb4e8-ea95-4c8c-babf-70a9883e197a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033095 Jul 20 05:19:08.998575 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3636/7249] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:09.406201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b992a1e4-f49f-4983-ba9a-f748e23b3ddc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:09.406799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b992a1e4-f49f-4983-ba9a-f748e23b3ddc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:09.413760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b992a1e4-f49f-4983-ba9a-f748e23b3ddc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:09.414236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b992a1e4-f49f-4983-ba9a-f748e23b3ddc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:09.415063 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b992a1e4-f49f-4983-ba9a-f748e23b3ddc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:09.415524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b992a1e4-f49f-4983-ba9a-f748e23b3ddc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:09.556414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b992a1e4-f49f-4983-ba9a-f748e23b3ddc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:09.567276 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b992a1e4-f49f-4983-ba9a-f748e23b3ddc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1392 microversion: 2.1 time: 0.165750 Jul 20 05:19:09.568141 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3614/7250] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:09 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:10.592253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-12126ea9-4508-4df5-8130-c300a2a8bbb1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:10.592974 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-12126ea9-4508-4df5-8130-c300a2a8bbb1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:10.600159 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-12126ea9-4508-4df5-8130-c300a2a8bbb1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.600624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-12126ea9-4508-4df5-8130-c300a2a8bbb1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.601564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-12126ea9-4508-4df5-8130-c300a2a8bbb1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.602020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-12126ea9-4508-4df5-8130-c300a2a8bbb1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.735828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-12126ea9-4508-4df5-8130-c300a2a8bbb1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:10.743256 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-12126ea9-4508-4df5-8130-c300a2a8bbb1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1564 microversion: 2.1 time: 0.156126 Jul 20 05:19:10.744093 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3637/7251] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:10 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:10.760037 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-16c6fffe-6620-46df-92a9-b975d92d100a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:10.760769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-16c6fffe-6620-46df-92a9-b975d92d100a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:10.767943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16c6fffe-6620-46df-92a9-b975d92d100a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.768418 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16c6fffe-6620-46df-92a9-b975d92d100a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.769215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16c6fffe-6620-46df-92a9-b975d92d100a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.769673 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-16c6fffe-6620-46df-92a9-b975d92d100a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.900344 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-16c6fffe-6620-46df-92a9-b975d92d100a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:10.909903 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-16c6fffe-6620-46df-92a9-b975d92d100a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1564 microversion: 2.1 time: 0.153566 Jul 20 05:19:10.910969 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3615/7252] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:10 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:12.939319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e3a8daa0-e8cb-4c18-9a2a-acf55aa7d404 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:12.940154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e3a8daa0-e8cb-4c18-9a2a-acf55aa7d404 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:12.940542 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e87f452a-8206-4f08-9382-5b8f13e93a14 req-265ea710-4802-481a-91e7-c832bebb9b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d4db2f-b0a5-4cac-a357-d83f89d5f6f6", "tag": "2a009f25-ea5a-4899-ad90-c6620ff40b4d"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:12.943830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:12.944718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:12.945217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:12.952337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3a8daa0-e8cb-4c18-9a2a-acf55aa7d404 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:12.953135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3a8daa0-e8cb-4c18-9a2a-acf55aa7d404 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:12.953266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e87f452a-8206-4f08-9382-5b8f13e93a14 req-265ea710-4802-481a-91e7-c832bebb9b1a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:12.953652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e87f452a-8206-4f08-9382-5b8f13e93a14 req-265ea710-4802-481a-91e7-c832bebb9b1a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:12.954572 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3a8daa0-e8cb-4c18-9a2a-acf55aa7d404 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:12.955113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e3a8daa0-e8cb-4c18-9a2a-acf55aa7d404 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:12.966484 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e87f452a-8206-4f08-9382-5b8f13e93a14 req-265ea710-4802-481a-91e7-c832bebb9b1a service nova] Creating event network-changed:2a009f25-ea5a-4899-ad90-c6620ff40b4d for instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 on n-h2-760456-11 Jul 20 05:19:12.974133 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e87f452a-8206-4f08-9382-5b8f13e93a14 req-265ea710-4802-481a-91e7-c832bebb9b1a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037225 Jul 20 05:19:12.975863 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3616/7253] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:19:13.199189 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e3a8daa0-e8cb-4c18-9a2a-acf55aa7d404 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:13.216351 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e3a8daa0-e8cb-4c18-9a2a-acf55aa7d404 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1564 microversion: 2.1 time: 0.282428 Jul 20 05:19:13.229519 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3638/7254] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:12 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1564 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:34.541164 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-03c778b6-96fc-48bd-a50d-c6ec2f67d522 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:34.542200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-03c778b6-96fc-48bd-a50d-c6ec2f67d522 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:34.545071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:34.545827 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=32 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:34.552467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c778b6-96fc-48bd-a50d-c6ec2f67d522 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:34.552950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c778b6-96fc-48bd-a50d-c6ec2f67d522 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:34.553755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c778b6-96fc-48bd-a50d-c6ec2f67d522 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:34.554218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-03c778b6-96fc-48bd-a50d-c6ec2f67d522 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:34.608439 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-03c778b6-96fc-48bd-a50d-c6ec2f67d522 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6/action" status: 200 len: 24571 microversion: 2.1 time: 0.071597 Jul 20 05:19:34.609137 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3617/7255] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:19:34 2022] POST /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:19:45.659722 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2b8b07a8-d5c6-45b3-aa24-0df66e7c32e7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:45.660677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2b8b07a8-d5c6-45b3-aa24-0df66e7c32e7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:45.663101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:45.663870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=30 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:45.670045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b8b07a8-d5c6-45b3-aa24-0df66e7c32e7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:45.670522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b8b07a8-d5c6-45b3-aa24-0df66e7c32e7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:45.671293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b8b07a8-d5c6-45b3-aa24-0df66e7c32e7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:45.671732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2b8b07a8-d5c6-45b3-aa24-0df66e7c32e7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:45.749161 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2b8b07a8-d5c6-45b3-aa24-0df66e7c32e7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6/action" status: 202 len: 0 microversion: 2.1 time: 0.093801 Jul 20 05:19:45.749723 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3639/7256] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:19:45 2022] POST /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:19:45.758662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6cf1b798-cde8-4ef7-a579-8047a8d53ce9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:45.759388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6cf1b798-cde8-4ef7-a579-8047a8d53ce9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:45.762284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:45.763144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:45.771526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cf1b798-cde8-4ef7-a579-8047a8d53ce9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:45.771994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cf1b798-cde8-4ef7-a579-8047a8d53ce9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:45.772778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cf1b798-cde8-4ef7-a579-8047a8d53ce9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:45.773329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6cf1b798-cde8-4ef7-a579-8047a8d53ce9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:45.912786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6cf1b798-cde8-4ef7-a579-8047a8d53ce9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:45.920564 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6cf1b798-cde8-4ef7-a579-8047a8d53ce9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1675 microversion: 2.1 time: 0.166166 Jul 20 05:19:45.921142 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3618/7257] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:45 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:46.940583 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4dd485a8-9021-4715-ab7c-f28a6a81aa09 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:46.941296 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4dd485a8-9021-4715-ab7c-f28a6a81aa09 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:46.947664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dd485a8-9021-4715-ab7c-f28a6a81aa09 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:46.948126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dd485a8-9021-4715-ab7c-f28a6a81aa09 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:46.948906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dd485a8-9021-4715-ab7c-f28a6a81aa09 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:46.949353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4dd485a8-9021-4715-ab7c-f28a6a81aa09 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:47.085526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4dd485a8-9021-4715-ab7c-f28a6a81aa09 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:47.093058 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4dd485a8-9021-4715-ab7c-f28a6a81aa09 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.157668 Jul 20 05:19:47.093624 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3640/7258] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:46 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:48.112274 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a6978fc2-422f-4e17-a1e6-c26824751db4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:48.112911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a6978fc2-422f-4e17-a1e6-c26824751db4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:48.120329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6978fc2-422f-4e17-a1e6-c26824751db4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:48.120802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6978fc2-422f-4e17-a1e6-c26824751db4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:48.121605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6978fc2-422f-4e17-a1e6-c26824751db4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:48.122072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a6978fc2-422f-4e17-a1e6-c26824751db4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:48.261976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a6978fc2-422f-4e17-a1e6-c26824751db4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:48.270347 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a6978fc2-422f-4e17-a1e6-c26824751db4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.163098 Jul 20 05:19:48.270856 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3619/7259] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:48 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:49.288212 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dc28af88-c055-47aa-b800-c4a83181df6e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:49.288826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dc28af88-c055-47aa-b800-c4a83181df6e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:49.295247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc28af88-c055-47aa-b800-c4a83181df6e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:49.295702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc28af88-c055-47aa-b800-c4a83181df6e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:49.296464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc28af88-c055-47aa-b800-c4a83181df6e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:49.296904 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dc28af88-c055-47aa-b800-c4a83181df6e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:49.432970 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dc28af88-c055-47aa-b800-c4a83181df6e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:49.440715 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dc28af88-c055-47aa-b800-c4a83181df6e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.156470 Jul 20 05:19:49.441298 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3641/7260] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:49 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:50.458640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-acbfec66-ff02-4c76-8af9-44edb0c59b14 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:50.459302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-acbfec66-ff02-4c76-8af9-44edb0c59b14 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:50.466328 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acbfec66-ff02-4c76-8af9-44edb0c59b14 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:50.466799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acbfec66-ff02-4c76-8af9-44edb0c59b14 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:50.467586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acbfec66-ff02-4c76-8af9-44edb0c59b14 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:50.468046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-acbfec66-ff02-4c76-8af9-44edb0c59b14 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:50.609060 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-acbfec66-ff02-4c76-8af9-44edb0c59b14 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:50.620156 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-acbfec66-ff02-4c76-8af9-44edb0c59b14 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.165630 Jul 20 05:19:50.621199 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3620/7261] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:50 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:51.638478 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6ebfadaa-b03f-49fd-a6e4-b63001b064e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:51.639096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6ebfadaa-b03f-49fd-a6e4-b63001b064e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:51.646241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ebfadaa-b03f-49fd-a6e4-b63001b064e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:51.646721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ebfadaa-b03f-49fd-a6e4-b63001b064e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:51.647489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ebfadaa-b03f-49fd-a6e4-b63001b064e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:51.647928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ebfadaa-b03f-49fd-a6e4-b63001b064e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:51.778791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6ebfadaa-b03f-49fd-a6e4-b63001b064e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:51.787047 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6ebfadaa-b03f-49fd-a6e4-b63001b064e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.152478 Jul 20 05:19:51.787627 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3642/7262] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:51 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:52.804951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-82ca4214-eb78-4850-aa87-73ec6875587e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:52.805593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-82ca4214-eb78-4850-aa87-73ec6875587e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:52.812667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82ca4214-eb78-4850-aa87-73ec6875587e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:52.813149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82ca4214-eb78-4850-aa87-73ec6875587e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:52.814718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82ca4214-eb78-4850-aa87-73ec6875587e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:52.815275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-82ca4214-eb78-4850-aa87-73ec6875587e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:52.951102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-82ca4214-eb78-4850-aa87-73ec6875587e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:52.959131 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-82ca4214-eb78-4850-aa87-73ec6875587e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.158176 Jul 20 05:19:52.959711 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3621/7263] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:52 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:53.976931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-958c4f0e-cf39-4ebb-b6d6-1eb6246d7c5d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:53.977551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-958c4f0e-cf39-4ebb-b6d6-1eb6246d7c5d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:53.984518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-958c4f0e-cf39-4ebb-b6d6-1eb6246d7c5d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:53.984979 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-958c4f0e-cf39-4ebb-b6d6-1eb6246d7c5d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:53.985767 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-958c4f0e-cf39-4ebb-b6d6-1eb6246d7c5d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:53.987480 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-958c4f0e-cf39-4ebb-b6d6-1eb6246d7c5d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:54.119757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-958c4f0e-cf39-4ebb-b6d6-1eb6246d7c5d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:54.128018 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-958c4f0e-cf39-4ebb-b6d6-1eb6246d7c5d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.154866 Jul 20 05:19:54.128599 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3643/7264] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:53 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:55.145528 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3aa294ea-f9d2-43af-acb4-56115de54d24 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:55.146169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3aa294ea-f9d2-43af-acb4-56115de54d24 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:55.153374 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3aa294ea-f9d2-43af-acb4-56115de54d24 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:55.153854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3aa294ea-f9d2-43af-acb4-56115de54d24 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:55.154671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3aa294ea-f9d2-43af-acb4-56115de54d24 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:55.155137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3aa294ea-f9d2-43af-acb4-56115de54d24 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:55.292747 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3aa294ea-f9d2-43af-acb4-56115de54d24 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:55.300677 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3aa294ea-f9d2-43af-acb4-56115de54d24 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.159348 Jul 20 05:19:55.301255 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3622/7265] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:55 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:56.318335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-26a3dbdb-a632-447b-b81b-1b7ec3a86592 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:56.318962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-26a3dbdb-a632-447b-b81b-1b7ec3a86592 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:56.325975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26a3dbdb-a632-447b-b81b-1b7ec3a86592 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:56.326473 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26a3dbdb-a632-447b-b81b-1b7ec3a86592 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:56.327271 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26a3dbdb-a632-447b-b81b-1b7ec3a86592 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:56.327702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-26a3dbdb-a632-447b-b81b-1b7ec3a86592 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:56.462769 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-26a3dbdb-a632-447b-b81b-1b7ec3a86592 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:56.470811 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-26a3dbdb-a632-447b-b81b-1b7ec3a86592 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.155955 Jul 20 05:19:56.471386 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3644/7266] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:56 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:57.490129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f178e6fe-a08e-4256-a637-de5c0460448d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:57.490806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f178e6fe-a08e-4256-a637-de5c0460448d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:57.498410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f178e6fe-a08e-4256-a637-de5c0460448d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:57.498890 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f178e6fe-a08e-4256-a637-de5c0460448d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:57.499696 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f178e6fe-a08e-4256-a637-de5c0460448d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:57.500188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f178e6fe-a08e-4256-a637-de5c0460448d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:57.636196 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f178e6fe-a08e-4256-a637-de5c0460448d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:57.644454 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f178e6fe-a08e-4256-a637-de5c0460448d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.159974 Jul 20 05:19:57.645030 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3623/7267] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:57 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:58.662033 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1e5afa99-1ae2-48ee-acf4-0b9f655da9f6 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:58.662690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1e5afa99-1ae2-48ee-acf4-0b9f655da9f6 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:58.669647 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e5afa99-1ae2-48ee-acf4-0b9f655da9f6 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:58.670105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e5afa99-1ae2-48ee-acf4-0b9f655da9f6 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:58.670916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e5afa99-1ae2-48ee-acf4-0b9f655da9f6 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:58.671361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1e5afa99-1ae2-48ee-acf4-0b9f655da9f6 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:58.805021 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1e5afa99-1ae2-48ee-acf4-0b9f655da9f6 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:58.812590 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1e5afa99-1ae2-48ee-acf4-0b9f655da9f6 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.155305 Jul 20 05:19:58.813186 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3645/7268] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:58 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:59.831868 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c44755cd-bd0b-454f-853c-fc75f45f38e0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:59.832771 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c44755cd-bd0b-454f-853c-fc75f45f38e0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:59.839571 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c44755cd-bd0b-454f-853c-fc75f45f38e0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:59.840045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c44755cd-bd0b-454f-853c-fc75f45f38e0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:59.840838 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c44755cd-bd0b-454f-853c-fc75f45f38e0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:59.841304 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c44755cd-bd0b-454f-853c-fc75f45f38e0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:59.975306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c44755cd-bd0b-454f-853c-fc75f45f38e0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:59.982873 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c44755cd-bd0b-454f-853c-fc75f45f38e0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.154993 Jul 20 05:19:59.983493 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3624/7269] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:59 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:01.001786 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b1e339a5-aafa-4a00-8da6-a565d445ceeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:01.002498 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b1e339a5-aafa-4a00-8da6-a565d445ceeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:01.010044 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1e339a5-aafa-4a00-8da6-a565d445ceeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:01.010527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1e339a5-aafa-4a00-8da6-a565d445ceeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:01.011295 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1e339a5-aafa-4a00-8da6-a565d445ceeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:01.011735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b1e339a5-aafa-4a00-8da6-a565d445ceeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:01.150352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b1e339a5-aafa-4a00-8da6-a565d445ceeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:01.157822 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b1e339a5-aafa-4a00-8da6-a565d445ceeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1680 microversion: 2.1 time: 0.159982 Jul 20 05:20:01.158420 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3646/7270] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:00 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:02.174940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ab86d37-4b8b-45ad-8d97-757ac92fb847 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:02.175663 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4ab86d37-4b8b-45ad-8d97-757ac92fb847 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:02.182769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ab86d37-4b8b-45ad-8d97-757ac92fb847 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:02.183233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ab86d37-4b8b-45ad-8d97-757ac92fb847 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:02.184065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ab86d37-4b8b-45ad-8d97-757ac92fb847 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:02.184526 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ab86d37-4b8b-45ad-8d97-757ac92fb847 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:02.321874 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4ab86d37-4b8b-45ad-8d97-757ac92fb847 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:02.329679 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ab86d37-4b8b-45ad-8d97-757ac92fb847 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1683 microversion: 2.1 time: 0.158731 Jul 20 05:20:02.330270 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3625/7271] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:02 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:20.644464 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:20:20.645847 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:20:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:20:26.523968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-32445fb3-de1e-4cbc-9962-cbf8305c8a39 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:26.524912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-32445fb3-de1e-4cbc-9962-cbf8305c8a39 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:26.527385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=16 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:26.528148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:26.533717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32445fb3-de1e-4cbc-9962-cbf8305c8a39 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:26.534182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32445fb3-de1e-4cbc-9962-cbf8305c8a39 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:26.534985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32445fb3-de1e-4cbc-9962-cbf8305c8a39 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:26.536539 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-32445fb3-de1e-4cbc-9962-cbf8305c8a39 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:26.591053 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-32445fb3-de1e-4cbc-9962-cbf8305c8a39 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6/action" status: 200 len: 69172 microversion: 2.1 time: 0.071912 Jul 20 05:20:26.591735 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3647/7272] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:20:26 2022] POST /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6/action => generated 69172 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:20:33.776760 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-466b36d5-b144-4f1a-9b37-a5bbbaa39f01 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:33.777398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-466b36d5-b144-4f1a-9b37-a5bbbaa39f01 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:33.779506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ffbd37cc-f664-41c3-a0f8-896b4f262bf6 req-3bb70636-80da-4c34-8722-33c3c392e6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d4db2f-b0a5-4cac-a357-d83f89d5f6f6", "tag": "2a009f25-ea5a-4899-ad90-c6620ff40b4d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:33.779916 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=16 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:33.780511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=48 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:33.786635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-466b36d5-b144-4f1a-9b37-a5bbbaa39f01 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:33.787414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-466b36d5-b144-4f1a-9b37-a5bbbaa39f01 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:33.788450 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-466b36d5-b144-4f1a-9b37-a5bbbaa39f01 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:33.788988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-466b36d5-b144-4f1a-9b37-a5bbbaa39f01 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:33.791243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ffbd37cc-f664-41c3-a0f8-896b4f262bf6 req-3bb70636-80da-4c34-8722-33c3c392e6a9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:33.792072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ffbd37cc-f664-41c3-a0f8-896b4f262bf6 req-3bb70636-80da-4c34-8722-33c3c392e6a9 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:33.806866 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ffbd37cc-f664-41c3-a0f8-896b4f262bf6 req-3bb70636-80da-4c34-8722-33c3c392e6a9 service nova] Creating event network-changed:2a009f25-ea5a-4899-ad90-c6620ff40b4d for instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 on n-h2-760456-11 Jul 20 05:20:33.812807 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ffbd37cc-f664-41c3-a0f8-896b4f262bf6 req-3bb70636-80da-4c34-8722-33c3c392e6a9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037496 Jul 20 05:20:33.813740 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3648/7273] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:20:33.815745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-466b36d5-b144-4f1a-9b37-a5bbbaa39f01 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:20:33.922664 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-466b36d5-b144-4f1a-9b37-a5bbbaa39f01 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "DELETE /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 204 len: 0 microversion: 2.1 time: 0.150031 Jul 20 05:20:33.923471 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3626/7274] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:20:33 2022] DELETE /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:20:33.933063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6765fc26-11ca-4f2c-a9c0-9a0adc7faf75 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:33.933781 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6765fc26-11ca-4f2c-a9c0-9a0adc7faf75 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:33.940824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6765fc26-11ca-4f2c-a9c0-9a0adc7faf75 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:33.941905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6765fc26-11ca-4f2c-a9c0-9a0adc7faf75 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:33.943303 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6765fc26-11ca-4f2c-a9c0-9a0adc7faf75 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:33.943762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6765fc26-11ca-4f2c-a9c0-9a0adc7faf75 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:34.195366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6765fc26-11ca-4f2c-a9c0-9a0adc7faf75 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:34.203085 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6765fc26-11ca-4f2c-a9c0-9a0adc7faf75 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1689 microversion: 2.1 time: 0.274200 Jul 20 05:20:34.203680 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3649/7275] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:33 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1689 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:35.221572 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-150f3fd6-c876-46fb-86cb-1b10d032a693 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:35.222936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-150f3fd6-c876-46fb-86cb-1b10d032a693 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:35.229907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-150f3fd6-c876-46fb-86cb-1b10d032a693 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:35.230416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-150f3fd6-c876-46fb-86cb-1b10d032a693 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:35.231215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-150f3fd6-c876-46fb-86cb-1b10d032a693 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:35.231675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-150f3fd6-c876-46fb-86cb-1b10d032a693 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:35.424644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-150f3fd6-c876-46fb-86cb-1b10d032a693 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:35.432478 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-150f3fd6-c876-46fb-86cb-1b10d032a693 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1689 microversion: 2.1 time: 0.215157 Jul 20 05:20:35.433425 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3627/7276] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:35 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:36.270436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a579d2a6-e9b3-4164-b6a2-5fe43a1a076e req-b17f04dc-1f8b-4452-a102-4a8f7fffd52f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d4db2f-b0a5-4cac-a357-d83f89d5f6f6", "name": "network-vif-deleted", "tag": "2a009f25-ea5a-4899-ad90-c6620ff40b4d"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:36.281137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a579d2a6-e9b3-4164-b6a2-5fe43a1a076e req-b17f04dc-1f8b-4452-a102-4a8f7fffd52f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:36.282000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a579d2a6-e9b3-4164-b6a2-5fe43a1a076e req-b17f04dc-1f8b-4452-a102-4a8f7fffd52f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:36.296972 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a579d2a6-e9b3-4164-b6a2-5fe43a1a076e req-b17f04dc-1f8b-4452-a102-4a8f7fffd52f service nova] Creating event network-vif-deleted:2a009f25-ea5a-4899-ad90-c6620ff40b4d for instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 on n-h2-760456-11 Jul 20 05:20:36.304273 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a579d2a6-e9b3-4164-b6a2-5fe43a1a076e req-b17f04dc-1f8b-4452-a102-4a8f7fffd52f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037641 Jul 20 05:20:36.304902 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3650/7277] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:36.450432 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:36.451056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:36.458184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:36.458676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:36.459460 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:36.459910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:36.493705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:36.494086 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:36.494591 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lazy-loading 'fault' on Instance uuid 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:20:36.537433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:36.545048 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e9001d37-2729-4690-8b16-415e356de085 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 200 len: 1357 microversion: 2.1 time: 0.098612 Jul 20 05:20:36.545632 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3628/7278] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:36 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 1357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:37.563470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9bf3fef9-0615-4357-b27b-4b830ad4e32a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:37.564184 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9bf3fef9-0615-4357-b27b-4b830ad4e32a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:37.572166 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bf3fef9-0615-4357-b27b-4b830ad4e32a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:37.572663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bf3fef9-0615-4357-b27b-4b830ad4e32a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:37.573516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bf3fef9-0615-4357-b27b-4b830ad4e32a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:37.574054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9bf3fef9-0615-4357-b27b-4b830ad4e32a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:37.588676 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-9bf3fef9-0615-4357-b27b-4b830ad4e32a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] HTTP exception thrown: Instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 could not be found. Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9bf3fef9-0615-4357-b27b-4b830ad4e32a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Request method failure captured: Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 HTTP/1.1 Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi15AA32MdWGcsRKaegS9wCO7BQHCiBClAHs8Yj7W55ghdKLBdFaoEB0VWdUPDzVnnjmtcoweYy1DbFe8xTKqrn31fS7Ei4EM2dAu-nEmvlKhj2nHYdoMCGwfnui78t-amakQizCUO4R9Mqw4cezwzBJRYmq1_pk4SMpNM8U4Yv_ZgzeU Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 7dd78539b9cf4df8874c9562bef52b8c Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 7dd78539b9cf4df8874c9562bef52b8c Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestNetworkAdvancedServerOps-1617251458-project Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 94ce2ee1efa04a06806daec00f2dea0c Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1617251458-project Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 could not be found. Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '61d4db2f-b0a5-4cac-a357-d83f89d5f6f6'} Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 could not be found. Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 could not be found. Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:20:37.590509 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 could not be found. Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9bf3fef9-0615-4357-b27b-4b830ad4e32a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Returning 404 to user: Instance 61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9bf3fef9-0615-4357-b27b-4b830ad4e32a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6" status: 404 len: 111 microversion: 2.1 time: 0.032808 Jul 20 05:20:37.594894 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3651/7279] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:37 2022] GET /compute/v2.1/servers/61d4db2f-b0a5-4cac-a357-d83f89d5f6f6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:20:40.725013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-08c763f5-52a8-4d31-b72c-f7d38d962bb5 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '.version_select at 0x7fb841ebb700>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:40.749600 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-08c763f5-52a8-4d31-b72c-f7d38d962bb5 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2093799309" status: 202 len: 0 microversion: 2.1 time: 0.030170 Jul 20 05:20:40.751448 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3629/7280] 10.222.0.59 () {58 vars in 1283 bytes} [Wed Jul 20 05:20:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2093799309 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:20:40.778950 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-29863d61-bfb1-4d2a-8df3-2f2f3a9f6d43 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'create', calling method: .version_select at 0x7fb841bfc3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-249307213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCk6HCjB8lm2rp2bMB574QqUIfUIAApoxtYPTI3YSYbGWBYSx7snitSvQ52mTXC5LfirkTAQq5DUra9q0HhRypHtcyJCriTXh64gxOLbkQ6r/ZjogUTTF0wtESS/1MuwQ=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:40.796008 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-29863d61-bfb1-4d2a-8df3-2f2f3a9f6d43 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:20:40.801262 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-29863d61-bfb1-4d2a-8df3-2f2f3a9f6d43 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for user 94ce2ee1efa04a06806daec00f2dea0c and project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:20:40.825196 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-29863d61-bfb1-4d2a-8df3-2f2f3a9f6d43 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050872 Jul 20 05:20:40.825815 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3652/7281] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:20:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:46.923757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:46.928398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1619850958", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "ebf4d017-d14b-43a4-875d-ccda9f5ae31a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-249307213", "security_groups": [{"name": "tempest-secgroup-smoke-1630668657"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:47.057349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] validate_networks() for [('ebf4d017-d14b-43a4-875d-ccda9f5ae31a', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:20:47.457601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:20:47.458047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:20:47.458573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:20:47.459006 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:20:47.459475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:20:47.469457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:47.469959 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:47.470851 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:47.471315 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:47.490454 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:20:47.496307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for user 94ce2ee1efa04a06806daec00f2dea0c and project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:20:47.513046 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:20:47.515417 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:20:47.568302 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f60e5a62-7345-43fe-a7c6-b8350deba174 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.646386 Jul 20 05:20:47.568975 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3630/7282] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:20:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:20:47.581094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dd5bc469-6a47-4da9-a63e-219a436c1a57 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:47.583614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dd5bc469-6a47-4da9-a63e-219a436c1a57 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:47.589487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=16 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:47.646434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dd5bc469-6a47-4da9-a63e-219a436c1a57 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:47.653376 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dd5bc469-6a47-4da9-a63e-219a436c1a57 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1266 microversion: 2.1 time: 0.077949 Jul 20 05:20:47.653952 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3653/7283] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:47 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:48.673005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0dba6842-681a-4109-92d5-4c1eae2e2e96 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:48.674338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0dba6842-681a-4109-92d5-4c1eae2e2e96 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:48.731674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0dba6842-681a-4109-92d5-4c1eae2e2e96 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:48.738748 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0dba6842-681a-4109-92d5-4c1eae2e2e96 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1266 microversion: 2.1 time: 0.071231 Jul 20 05:20:48.739342 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3631/7284] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:48 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1266 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:20:49.756567 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a37a4991-204f-4491-9f4b-ae916ec4c5fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:49.757120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a37a4991-204f-4491-9f4b-ae916ec4c5fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:49.815419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a37a4991-204f-4491-9f4b-ae916ec4c5fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:49.829010 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a37a4991-204f-4491-9f4b-ae916ec4c5fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1266 microversion: 2.1 time: 0.076240 Jul 20 05:20:49.829685 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3654/7285] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:49 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:50.847866 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0edd0559-d44f-4edc-be6f-97b5d8cc8b9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:50.849148 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0edd0559-d44f-4edc-be6f-97b5d8cc8b9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:50.909236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0edd0559-d44f-4edc-be6f-97b5d8cc8b9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:50.917585 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0edd0559-d44f-4edc-be6f-97b5d8cc8b9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1266 microversion: 2.1 time: 0.073833 Jul 20 05:20:50.918289 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3632/7286] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:50 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:51.935195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d407437a-6205-4a39-a352-7461c5d01fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:51.935921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d407437a-6205-4a39-a352-7461c5d01fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:51.943872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d407437a-6205-4a39-a352-7461c5d01fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:51.944342 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d407437a-6205-4a39-a352-7461c5d01fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:51.945138 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d407437a-6205-4a39-a352-7461c5d01fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:51.945573 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d407437a-6205-4a39-a352-7461c5d01fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:52.013125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d407437a-6205-4a39-a352-7461c5d01fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:52.021286 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d407437a-6205-4a39-a352-7461c5d01fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1270 microversion: 2.1 time: 0.090054 Jul 20 05:20:52.021879 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3655/7287] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:51 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:53.039126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d2793c70-1106-429b-8ab2-a9ec67dde7b4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:53.039764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d2793c70-1106-429b-8ab2-a9ec67dde7b4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:53.047084 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2793c70-1106-429b-8ab2-a9ec67dde7b4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:53.047557 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2793c70-1106-429b-8ab2-a9ec67dde7b4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:53.048360 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2793c70-1106-429b-8ab2-a9ec67dde7b4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:53.048821 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d2793c70-1106-429b-8ab2-a9ec67dde7b4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:53.131943 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d2793c70-1106-429b-8ab2-a9ec67dde7b4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:53.139710 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d2793c70-1106-429b-8ab2-a9ec67dde7b4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1324 microversion: 2.1 time: 0.105339 Jul 20 05:20:53.140305 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3633/7288] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:53 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1324 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:53.928963 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-2d5057e6-1dc3-4431-95c4-d848fb540a63 req-4bb3c0cd-4add-43db-873f-972cd4ee0ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285bfe01-2edc-4b9f-b3ec-7218151a1f23", "tag": "55744477-d957-4772-883b-62045bf7e822"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:53.940435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2d5057e6-1dc3-4431-95c4-d848fb540a63 req-4bb3c0cd-4add-43db-873f-972cd4ee0ba3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:53.941071 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-2d5057e6-1dc3-4431-95c4-d848fb540a63 req-4bb3c0cd-4add-43db-873f-972cd4ee0ba3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:53.954067 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-2d5057e6-1dc3-4431-95c4-d848fb540a63 req-4bb3c0cd-4add-43db-873f-972cd4ee0ba3 service nova] Creating event network-changed:55744477-d957-4772-883b-62045bf7e822 for instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 on n-h1-760456-11 Jul 20 05:20:53.960206 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-2d5057e6-1dc3-4431-95c4-d848fb540a63 req-4bb3c0cd-4add-43db-873f-972cd4ee0ba3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035458 Jul 20 05:20:53.961530 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3656/7289] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:20:54.158024 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-57f27de0-b551-4337-ad5e-2e9b976bd734 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:54.158687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-57f27de0-b551-4337-ad5e-2e9b976bd734 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:54.165629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57f27de0-b551-4337-ad5e-2e9b976bd734 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:54.166109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57f27de0-b551-4337-ad5e-2e9b976bd734 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:54.166935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57f27de0-b551-4337-ad5e-2e9b976bd734 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:54.167394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-57f27de0-b551-4337-ad5e-2e9b976bd734 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:54.383817 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-57f27de0-b551-4337-ad5e-2e9b976bd734 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:54.392780 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-57f27de0-b551-4337-ad5e-2e9b976bd734 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1392 microversion: 2.1 time: 0.239645 Jul 20 05:20:54.393378 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3634/7290] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:54 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:55.412646 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a5ed4515-a00a-4804-a492-f4d612a80575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:55.413438 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a5ed4515-a00a-4804-a492-f4d612a80575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:55.419889 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5ed4515-a00a-4804-a492-f4d612a80575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:55.420349 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5ed4515-a00a-4804-a492-f4d612a80575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:55.421134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5ed4515-a00a-4804-a492-f4d612a80575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:55.421581 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a5ed4515-a00a-4804-a492-f4d612a80575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:55.560337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a5ed4515-a00a-4804-a492-f4d612a80575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:55.568859 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a5ed4515-a00a-4804-a492-f4d612a80575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1392 microversion: 2.1 time: 0.162104 Jul 20 05:20:55.569447 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3657/7291] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:55 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:56.586988 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c99677f7-e303-413b-be9e-d139ffaaf1e9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:56.587645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c99677f7-e303-413b-be9e-d139ffaaf1e9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:56.594602 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c99677f7-e303-413b-be9e-d139ffaaf1e9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:56.595072 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c99677f7-e303-413b-be9e-d139ffaaf1e9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:56.595855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c99677f7-e303-413b-be9e-d139ffaaf1e9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:56.596312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c99677f7-e303-413b-be9e-d139ffaaf1e9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:56.732047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c99677f7-e303-413b-be9e-d139ffaaf1e9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:56.739778 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c99677f7-e303-413b-be9e-d139ffaaf1e9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1392 microversion: 2.1 time: 0.157809 Jul 20 05:20:56.740349 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3635/7292] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:56 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:57.758307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4eb01ee0-6bac-4dfd-a97c-3ea0d91a9d4c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:57.758884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4eb01ee0-6bac-4dfd-a97c-3ea0d91a9d4c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:57.761651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:57.767506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4eb01ee0-6bac-4dfd-a97c-3ea0d91a9d4c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:57.767965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4eb01ee0-6bac-4dfd-a97c-3ea0d91a9d4c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:57.768737 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4eb01ee0-6bac-4dfd-a97c-3ea0d91a9d4c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:57.769179 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4eb01ee0-6bac-4dfd-a97c-3ea0d91a9d4c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:57.911384 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4eb01ee0-6bac-4dfd-a97c-3ea0d91a9d4c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:57.919035 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4eb01ee0-6bac-4dfd-a97c-3ea0d91a9d4c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1392 microversion: 2.1 time: 0.164794 Jul 20 05:20:57.919600 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3658/7293] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:57 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:58.938141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-98a8ccfb-fbdd-46ea-b51e-2d507e748e15 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:20:58.938823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-98a8ccfb-fbdd-46ea-b51e-2d507e748e15 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:20:58.940736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:20:58.947369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98a8ccfb-fbdd-46ea-b51e-2d507e748e15 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:58.947880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98a8ccfb-fbdd-46ea-b51e-2d507e748e15 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:58.948678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98a8ccfb-fbdd-46ea-b51e-2d507e748e15 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:58.949180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-98a8ccfb-fbdd-46ea-b51e-2d507e748e15 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:59.089590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-98a8ccfb-fbdd-46ea-b51e-2d507e748e15 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:20:59.097173 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-98a8ccfb-fbdd-46ea-b51e-2d507e748e15 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1392 microversion: 2.1 time: 0.162973 Jul 20 05:20:59.098495 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3636/7294] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:20:58 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:20:59.169784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-08834563-16c2-4a3b-8478-4d646d173d44 req-edfec3c4-1a40-405c-906c-5ab567a25d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285bfe01-2edc-4b9f-b3ec-7218151a1f23", "name": "network-vif-plugged", "status": "completed", "tag": "55744477-d957-4772-883b-62045bf7e822"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:20:59.181075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-08834563-16c2-4a3b-8478-4d646d173d44 req-edfec3c4-1a40-405c-906c-5ab567a25d36 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:20:59.181541 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-08834563-16c2-4a3b-8478-4d646d173d44 req-edfec3c4-1a40-405c-906c-5ab567a25d36 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:20:59.193379 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-08834563-16c2-4a3b-8478-4d646d173d44 req-edfec3c4-1a40-405c-906c-5ab567a25d36 service nova] Creating event network-vif-plugged:55744477-d957-4772-883b-62045bf7e822 for instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 on n-h1-760456-11 Jul 20 05:20:59.198456 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-08834563-16c2-4a3b-8478-4d646d173d44 req-edfec3c4-1a40-405c-906c-5ab567a25d36 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032431 Jul 20 05:20:59.199059 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3659/7295] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:00.115195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4d79da76-a93d-418d-af7b-10998758fbcb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:00.115978 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4d79da76-a93d-418d-af7b-10998758fbcb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:00.123508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d79da76-a93d-418d-af7b-10998758fbcb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:00.124041 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d79da76-a93d-418d-af7b-10998758fbcb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:00.124919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d79da76-a93d-418d-af7b-10998758fbcb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:00.125380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4d79da76-a93d-418d-af7b-10998758fbcb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:00.264014 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4d79da76-a93d-418d-af7b-10998758fbcb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:00.272214 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4d79da76-a93d-418d-af7b-10998758fbcb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1392 microversion: 2.1 time: 0.161300 Jul 20 05:21:00.272781 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3637/7296] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:00 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:01.290677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c2afa96-fb91-4a96-918e-db66b4a4939d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:01.291305 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2c2afa96-fb91-4a96-918e-db66b4a4939d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:01.293530 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:01.300656 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c2afa96-fb91-4a96-918e-db66b4a4939d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:01.301967 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c2afa96-fb91-4a96-918e-db66b4a4939d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:01.302809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c2afa96-fb91-4a96-918e-db66b4a4939d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:01.303261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c2afa96-fb91-4a96-918e-db66b4a4939d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:01.436403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c2afa96-fb91-4a96-918e-db66b4a4939d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:01.444136 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c2afa96-fb91-4a96-918e-db66b4a4939d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1564 microversion: 2.1 time: 0.158134 Jul 20 05:21:01.444723 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3660/7297] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:01 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:01.460678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-992c0d32-258f-431f-9612-8be33d923813 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:01.461442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-992c0d32-258f-431f-9612-8be33d923813 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:01.463402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=10 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:01.469870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-992c0d32-258f-431f-9612-8be33d923813 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:01.470393 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-992c0d32-258f-431f-9612-8be33d923813 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:01.471184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-992c0d32-258f-431f-9612-8be33d923813 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:01.471639 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-992c0d32-258f-431f-9612-8be33d923813 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:01.605618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-992c0d32-258f-431f-9612-8be33d923813 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:01.613498 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-992c0d32-258f-431f-9612-8be33d923813 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1564 microversion: 2.1 time: 0.157059 Jul 20 05:21:01.614389 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3638/7298] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:01 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:03.541856 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d049762b-031d-4651-9d03-ca7960337dad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:03.542668 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d049762b-031d-4651-9d03-ca7960337dad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:03.544169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-8b99597a-27a2-46e6-a4ce-0c0912873fb1 req-53f65307-fdb6-4673-b657-b8788cf8659c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285bfe01-2edc-4b9f-b3ec-7218151a1f23", "tag": "55744477-d957-4772-883b-62045bf7e822"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:03.549741 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d049762b-031d-4651-9d03-ca7960337dad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:03.550310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d049762b-031d-4651-9d03-ca7960337dad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:03.551799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d049762b-031d-4651-9d03-ca7960337dad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:03.552351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d049762b-031d-4651-9d03-ca7960337dad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:03.553486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8b99597a-27a2-46e6-a4ce-0c0912873fb1 req-53f65307-fdb6-4673-b657-b8788cf8659c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:03.553966 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-8b99597a-27a2-46e6-a4ce-0c0912873fb1 req-53f65307-fdb6-4673-b657-b8788cf8659c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:03.566009 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-8b99597a-27a2-46e6-a4ce-0c0912873fb1 req-53f65307-fdb6-4673-b657-b8788cf8659c service nova] Creating event network-changed:55744477-d957-4772-883b-62045bf7e822 for instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 on n-h1-760456-11 Jul 20 05:21:03.572456 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-8b99597a-27a2-46e6-a4ce-0c0912873fb1 req-53f65307-fdb6-4673-b657-b8788cf8659c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032279 Jul 20 05:21:03.573156 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3639/7299] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:21:03.714292 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d049762b-031d-4651-9d03-ca7960337dad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:03.721960 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d049762b-031d-4651-9d03-ca7960337dad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1564 microversion: 2.1 time: 0.184226 Jul 20 05:21:03.723430 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3661/7300] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:03 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:24.968675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:24.969472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=40 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:24.973888 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c49718f4-ddfa-47f1-b53f-2eced9b1c919 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:24.975366 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c49718f4-ddfa-47f1-b53f-2eced9b1c919 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:24.982885 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c49718f4-ddfa-47f1-b53f-2eced9b1c919 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:24.983358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c49718f4-ddfa-47f1-b53f-2eced9b1c919 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:24.984143 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c49718f4-ddfa-47f1-b53f-2eced9b1c919 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:24.984599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c49718f4-ddfa-47f1-b53f-2eced9b1c919 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:25.061656 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c49718f4-ddfa-47f1-b53f-2eced9b1c919 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23/action" status: 200 len: 24570 microversion: 2.1 time: 0.094761 Jul 20 05:21:25.062333 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3640/7301] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:21:24 2022] POST /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23/action => generated 24570 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:21:36.036747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:36.037747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:36.040079 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=7 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:36.040738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=34 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:36.047036 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:36.047490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:36.048255 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:36.048696 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:36.134664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:36.141385 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Old instance type m1.heat2, new instance type m1.heat {{(pid=119606) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:21:36.148398 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:21:36.148829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:21:36.149311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:21:36.149731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:21:36.150155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:21:36.214200 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7f691b40-82ff-41ce-b0d8-ed5efb603ece tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23/action" status: 202 len: 0 microversion: 2.1 time: 0.182179 Jul 20 05:21:36.217961 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3662/7302] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:21:36 2022] POST /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:21:36.224746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5bec2fc1-48ee-46b1-902d-d6388682bbeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:36.225488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5bec2fc1-48ee-46b1-902d-d6388682bbeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:36.228220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:36.228879 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:36.235132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bec2fc1-48ee-46b1-902d-d6388682bbeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:36.235608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bec2fc1-48ee-46b1-902d-d6388682bbeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:36.236402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bec2fc1-48ee-46b1-902d-d6388682bbeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:36.236858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5bec2fc1-48ee-46b1-902d-d6388682bbeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:36.414154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5bec2fc1-48ee-46b1-902d-d6388682bbeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:36.422090 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5bec2fc1-48ee-46b1-902d-d6388682bbeb tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1690 microversion: 2.1 time: 0.202758 Jul 20 05:21:36.422901 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3641/7303] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:36 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:37.441512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6ade88c-6a4e-488d-862f-200cee19183d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:37.442751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6ade88c-6a4e-488d-862f-200cee19183d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:37.448992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6ade88c-6a4e-488d-862f-200cee19183d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:37.449454 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6ade88c-6a4e-488d-862f-200cee19183d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:37.450236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6ade88c-6a4e-488d-862f-200cee19183d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:37.450705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6ade88c-6a4e-488d-862f-200cee19183d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:37.588100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6ade88c-6a4e-488d-862f-200cee19183d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:37.595802 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6ade88c-6a4e-488d-862f-200cee19183d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1690 microversion: 2.1 time: 0.159338 Jul 20 05:21:37.596373 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3663/7304] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:37 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:38.613397 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38b0d236-bde6-40cf-93c0-6fe5fd4a3428 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:38.614467 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-38b0d236-bde6-40cf-93c0-6fe5fd4a3428 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:38.621894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38b0d236-bde6-40cf-93c0-6fe5fd4a3428 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:38.622487 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38b0d236-bde6-40cf-93c0-6fe5fd4a3428 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:38.623380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38b0d236-bde6-40cf-93c0-6fe5fd4a3428 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:38.623957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38b0d236-bde6-40cf-93c0-6fe5fd4a3428 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:38.764907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-38b0d236-bde6-40cf-93c0-6fe5fd4a3428 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:38.773203 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-38b0d236-bde6-40cf-93c0-6fe5fd4a3428 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.164030 Jul 20 05:21:38.773778 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3642/7305] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:38 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:39.791681 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ef7e898f-1077-447a-80dc-c63f5de4e21f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:39.792244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ef7e898f-1077-447a-80dc-c63f5de4e21f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:39.799247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef7e898f-1077-447a-80dc-c63f5de4e21f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:39.799710 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef7e898f-1077-447a-80dc-c63f5de4e21f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:39.800487 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef7e898f-1077-447a-80dc-c63f5de4e21f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:39.800937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef7e898f-1077-447a-80dc-c63f5de4e21f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:39.941263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ef7e898f-1077-447a-80dc-c63f5de4e21f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:39.948887 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ef7e898f-1077-447a-80dc-c63f5de4e21f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.161316 Jul 20 05:21:39.949461 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3664/7306] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:39 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:40.967182 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2eaffca7-f0db-42fc-8f24-cf7545c01976 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:40.967849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2eaffca7-f0db-42fc-8f24-cf7545c01976 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:40.975645 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2eaffca7-f0db-42fc-8f24-cf7545c01976 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:40.976152 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2eaffca7-f0db-42fc-8f24-cf7545c01976 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:40.976945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2eaffca7-f0db-42fc-8f24-cf7545c01976 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:40.977408 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2eaffca7-f0db-42fc-8f24-cf7545c01976 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:41.109412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2eaffca7-f0db-42fc-8f24-cf7545c01976 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:41.117698 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2eaffca7-f0db-42fc-8f24-cf7545c01976 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.154471 Jul 20 05:21:41.118576 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3643/7307] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:40 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:42.136954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ae77efce-890e-42f0-8b72-7d2c5bca326f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:42.137614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ae77efce-890e-42f0-8b72-7d2c5bca326f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:42.145732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae77efce-890e-42f0-8b72-7d2c5bca326f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:42.146489 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae77efce-890e-42f0-8b72-7d2c5bca326f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:42.147705 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae77efce-890e-42f0-8b72-7d2c5bca326f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:42.148444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ae77efce-890e-42f0-8b72-7d2c5bca326f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:42.283690 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ae77efce-890e-42f0-8b72-7d2c5bca326f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:42.292403 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ae77efce-890e-42f0-8b72-7d2c5bca326f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.159349 Jul 20 05:21:42.292994 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3665/7308] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:42 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:43.309955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6b116866-16d7-4892-8c3b-77d19556b558 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:43.310613 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6b116866-16d7-4892-8c3b-77d19556b558 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:43.318077 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b116866-16d7-4892-8c3b-77d19556b558 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:43.318567 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b116866-16d7-4892-8c3b-77d19556b558 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:43.319350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b116866-16d7-4892-8c3b-77d19556b558 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:43.319813 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6b116866-16d7-4892-8c3b-77d19556b558 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:43.462910 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6b116866-16d7-4892-8c3b-77d19556b558 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:43.470559 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6b116866-16d7-4892-8c3b-77d19556b558 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.164576 Jul 20 05:21:43.471132 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3644/7309] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:43 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:44.491598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c179ea78-a5a2-4bb4-aff7-243e1c7b78ac tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:44.492261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c179ea78-a5a2-4bb4-aff7-243e1c7b78ac tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:44.499558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c179ea78-a5a2-4bb4-aff7-243e1c7b78ac tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:44.500026 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c179ea78-a5a2-4bb4-aff7-243e1c7b78ac tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:44.500799 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c179ea78-a5a2-4bb4-aff7-243e1c7b78ac tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:44.501247 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c179ea78-a5a2-4bb4-aff7-243e1c7b78ac tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:44.638447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c179ea78-a5a2-4bb4-aff7-243e1c7b78ac tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:44.646188 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c179ea78-a5a2-4bb4-aff7-243e1c7b78ac tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.159491 Jul 20 05:21:44.646794 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3666/7310] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:44 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:45.664225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f717713a-d4ba-40ea-b168-50b8f14342f8 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:45.664894 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f717713a-d4ba-40ea-b168-50b8f14342f8 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:45.671920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f717713a-d4ba-40ea-b168-50b8f14342f8 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:45.672389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f717713a-d4ba-40ea-b168-50b8f14342f8 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:45.673178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f717713a-d4ba-40ea-b168-50b8f14342f8 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:45.673635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f717713a-d4ba-40ea-b168-50b8f14342f8 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:45.809953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f717713a-d4ba-40ea-b168-50b8f14342f8 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:45.818032 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f717713a-d4ba-40ea-b168-50b8f14342f8 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.158489 Jul 20 05:21:45.818632 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3645/7311] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:45 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:21:46.835005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e39a98b4-decc-489b-b861-f5c0a6f22117 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:46.835624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e39a98b4-decc-489b-b861-f5c0a6f22117 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:46.842693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e39a98b4-decc-489b-b861-f5c0a6f22117 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:46.843149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e39a98b4-decc-489b-b861-f5c0a6f22117 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:46.843946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e39a98b4-decc-489b-b861-f5c0a6f22117 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:46.844391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e39a98b4-decc-489b-b861-f5c0a6f22117 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:46.982146 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e39a98b4-decc-489b-b861-f5c0a6f22117 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:46.989639 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e39a98b4-decc-489b-b861-f5c0a6f22117 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.159230 Jul 20 05:21:46.990214 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3667/7312] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:46 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:48.007325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a5bab396-d5ad-47bb-a339-aa63831aec8f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:48.007970 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a5bab396-d5ad-47bb-a339-aa63831aec8f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:48.015281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5bab396-d5ad-47bb-a339-aa63831aec8f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:48.015762 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5bab396-d5ad-47bb-a339-aa63831aec8f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:48.016565 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5bab396-d5ad-47bb-a339-aa63831aec8f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:48.017027 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a5bab396-d5ad-47bb-a339-aa63831aec8f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:48.156748 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a5bab396-d5ad-47bb-a339-aa63831aec8f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:48.165197 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a5bab396-d5ad-47bb-a339-aa63831aec8f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.161861 Jul 20 05:21:48.165795 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3646/7313] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:48 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:49.183122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-97934f6b-b2ae-4886-bffa-479ff91c4449 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:49.183743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-97934f6b-b2ae-4886-bffa-479ff91c4449 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:49.190178 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97934f6b-b2ae-4886-bffa-479ff91c4449 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:49.190693 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97934f6b-b2ae-4886-bffa-479ff91c4449 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:49.191456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97934f6b-b2ae-4886-bffa-479ff91c4449 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:49.191906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-97934f6b-b2ae-4886-bffa-479ff91c4449 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:49.325328 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-97934f6b-b2ae-4886-bffa-479ff91c4449 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:49.332841 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-97934f6b-b2ae-4886-bffa-479ff91c4449 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.153683 Jul 20 05:21:49.333419 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3668/7314] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:49 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:21:50.350652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-adda65aa-2cb8-4005-ae80-d8a120f9f853 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:50.351337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-adda65aa-2cb8-4005-ae80-d8a120f9f853 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:50.358402 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adda65aa-2cb8-4005-ae80-d8a120f9f853 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:50.358873 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adda65aa-2cb8-4005-ae80-d8a120f9f853 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:50.359660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adda65aa-2cb8-4005-ae80-d8a120f9f853 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:50.360117 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-adda65aa-2cb8-4005-ae80-d8a120f9f853 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:50.496660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-adda65aa-2cb8-4005-ae80-d8a120f9f853 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:50.504364 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-adda65aa-2cb8-4005-ae80-d8a120f9f853 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.158142 Jul 20 05:21:50.504959 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3647/7315] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:50 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:51.522919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-74e05f31-ec7a-4cd8-b565-219a1f81ed78 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:51.523576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-74e05f31-ec7a-4cd8-b565-219a1f81ed78 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:51.530571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74e05f31-ec7a-4cd8-b565-219a1f81ed78 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:51.531041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74e05f31-ec7a-4cd8-b565-219a1f81ed78 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:51.531820 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74e05f31-ec7a-4cd8-b565-219a1f81ed78 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:51.532273 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-74e05f31-ec7a-4cd8-b565-219a1f81ed78 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:51.667822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-74e05f31-ec7a-4cd8-b565-219a1f81ed78 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:51.675315 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-74e05f31-ec7a-4cd8-b565-219a1f81ed78 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.156995 Jul 20 05:21:51.675883 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3669/7316] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:51 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:52.692967 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1df4833e-01d4-4b5d-9d58-e8e093e12b74 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:52.693732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1df4833e-01d4-4b5d-9d58-e8e093e12b74 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:52.700617 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1df4833e-01d4-4b5d-9d58-e8e093e12b74 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:52.701083 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1df4833e-01d4-4b5d-9d58-e8e093e12b74 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:52.701859 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1df4833e-01d4-4b5d-9d58-e8e093e12b74 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:52.702330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1df4833e-01d4-4b5d-9d58-e8e093e12b74 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:52.837070 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1df4833e-01d4-4b5d-9d58-e8e093e12b74 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:52.844936 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1df4833e-01d4-4b5d-9d58-e8e093e12b74 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.155919 Jul 20 05:21:52.845520 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3648/7317] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:52 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:53.863172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f71bbd5d-2f8e-4cb5-b23f-cfbde1cd1140 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:53.863708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f71bbd5d-2f8e-4cb5-b23f-cfbde1cd1140 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:53.871743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f71bbd5d-2f8e-4cb5-b23f-cfbde1cd1140 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:53.872209 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f71bbd5d-2f8e-4cb5-b23f-cfbde1cd1140 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:53.872992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f71bbd5d-2f8e-4cb5-b23f-cfbde1cd1140 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:53.873445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f71bbd5d-2f8e-4cb5-b23f-cfbde1cd1140 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:54.004728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f71bbd5d-2f8e-4cb5-b23f-cfbde1cd1140 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:54.012966 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f71bbd5d-2f8e-4cb5-b23f-cfbde1cd1140 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.153773 Jul 20 05:21:54.013618 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3670/7318] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:53 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:55.030742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-309a378b-7cc6-4daf-857f-2226d9b8711d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:55.031391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-309a378b-7cc6-4daf-857f-2226d9b8711d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:55.039261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-309a378b-7cc6-4daf-857f-2226d9b8711d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:55.039755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-309a378b-7cc6-4daf-857f-2226d9b8711d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:55.040546 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-309a378b-7cc6-4daf-857f-2226d9b8711d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:55.040994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-309a378b-7cc6-4daf-857f-2226d9b8711d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:55.183982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-309a378b-7cc6-4daf-857f-2226d9b8711d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:55.192600 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-309a378b-7cc6-4daf-857f-2226d9b8711d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1695 microversion: 2.1 time: 0.165980 Jul 20 05:21:55.193801 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3649/7319] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:55 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:55.691629 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b904eaf1-09bc-4f74-9af6-b35ad696027c req-5b6c6a1d-211e-46f5-9d8f-d06717088026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285bfe01-2edc-4b9f-b3ec-7218151a1f23", "name": "network-vif-unplugged", "status": "completed", "tag": "55744477-d957-4772-883b-62045bf7e822"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:55.701141 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b904eaf1-09bc-4f74-9af6-b35ad696027c req-5b6c6a1d-211e-46f5-9d8f-d06717088026 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:55.701586 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b904eaf1-09bc-4f74-9af6-b35ad696027c req-5b6c6a1d-211e-46f5-9d8f-d06717088026 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:55.715126 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b904eaf1-09bc-4f74-9af6-b35ad696027c req-5b6c6a1d-211e-46f5-9d8f-d06717088026 service nova] Creating event network-vif-unplugged:55744477-d957-4772-883b-62045bf7e822 for instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 on n-h2-760456-11 Jul 20 05:21:55.721343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [req-b904eaf1-09bc-4f74-9af6-b35ad696027c req-5b6c6a1d-211e-46f5-9d8f-d06717088026 service nova] Instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119606) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:21:55.733281 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b904eaf1-09bc-4f74-9af6-b35ad696027c req-5b6c6a1d-211e-46f5-9d8f-d06717088026 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102860 Jul 20 05:21:55.734241 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3671/7320] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:56.211913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-74a835da-8331-4e87-935d-fab89eb14b81 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:56.212575 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-74a835da-8331-4e87-935d-fab89eb14b81 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:56.219980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74a835da-8331-4e87-935d-fab89eb14b81 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:56.220457 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74a835da-8331-4e87-935d-fab89eb14b81 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:56.221271 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74a835da-8331-4e87-935d-fab89eb14b81 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:56.221728 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-74a835da-8331-4e87-935d-fab89eb14b81 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:56.441870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-74a835da-8331-4e87-935d-fab89eb14b81 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:56.450368 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-74a835da-8331-4e87-935d-fab89eb14b81 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1694 microversion: 2.1 time: 0.243665 Jul 20 05:21:56.450949 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3650/7321] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:56 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1694 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:57.470242 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-aecc8776-ad40-4c60-a93a-68bcbc07c0ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:57.470968 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-aecc8776-ad40-4c60-a93a-68bcbc07c0ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:57.477708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aecc8776-ad40-4c60-a93a-68bcbc07c0ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:57.478157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aecc8776-ad40-4c60-a93a-68bcbc07c0ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:57.478951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aecc8776-ad40-4c60-a93a-68bcbc07c0ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:57.479387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-aecc8776-ad40-4c60-a93a-68bcbc07c0ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:57.613232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-aecc8776-ad40-4c60-a93a-68bcbc07c0ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:57.621656 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-aecc8776-ad40-4c60-a93a-68bcbc07c0ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1692 microversion: 2.1 time: 0.156728 Jul 20 05:21:57.622221 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3672/7322] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:57 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:57.754792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-7b576d5f-374b-4220-b895-220ab395efac req-48527857-b47d-480b-b101-6e6a00026cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285bfe01-2edc-4b9f-b3ec-7218151a1f23", "tag": "55744477-d957-4772-883b-62045bf7e822"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:57.764177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7b576d5f-374b-4220-b895-220ab395efac req-48527857-b47d-480b-b101-6e6a00026cb5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:57.764642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7b576d5f-374b-4220-b895-220ab395efac req-48527857-b47d-480b-b101-6e6a00026cb5 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:57.777079 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-7b576d5f-374b-4220-b895-220ab395efac req-48527857-b47d-480b-b101-6e6a00026cb5 service nova] Creating event network-changed:55744477-d957-4772-883b-62045bf7e822 for instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 on n-h2-760456-11 Jul 20 05:21:57.782573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [req-7b576d5f-374b-4220-b895-220ab395efac req-48527857-b47d-480b-b101-6e6a00026cb5 service nova] Instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-760456-11', 'n-h2-760456-11'} {{(pid=119605) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:21:57.794623 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-7b576d5f-374b-4220-b895-220ab395efac req-48527857-b47d-480b-b101-6e6a00026cb5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043501 Jul 20 05:21:57.795232 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3651/7323] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:58.639746 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6328868-8bb3-4a38-80ec-3aff05c42b6f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:58.640353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d6328868-8bb3-4a38-80ec-3aff05c42b6f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:58.647491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6328868-8bb3-4a38-80ec-3aff05c42b6f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:58.647965 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6328868-8bb3-4a38-80ec-3aff05c42b6f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:58.648764 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6328868-8bb3-4a38-80ec-3aff05c42b6f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:58.649215 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6328868-8bb3-4a38-80ec-3aff05c42b6f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:58.788058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d6328868-8bb3-4a38-80ec-3aff05c42b6f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:58.795751 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d6328868-8bb3-4a38-80ec-3aff05c42b6f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1689 microversion: 2.1 time: 0.159900 Jul 20 05:21:58.796322 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3673/7324] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:58 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:58.814517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f5d3dd74-2091-4fad-80dc-54e901e97475 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:58.815189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f5d3dd74-2091-4fad-80dc-54e901e97475 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:58.822661 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5d3dd74-2091-4fad-80dc-54e901e97475 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:58.823239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5d3dd74-2091-4fad-80dc-54e901e97475 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:58.825310 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5d3dd74-2091-4fad-80dc-54e901e97475 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:58.825768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f5d3dd74-2091-4fad-80dc-54e901e97475 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:58.886720 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f5d3dd74-2091-4fad-80dc-54e901e97475 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23/action" status: 204 len: 0 microversion: 2.1 time: 0.077389 Jul 20 05:21:58.887282 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3652/7325] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:21:58 2022] POST /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:21:58.895435 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-03da9300-8b10-449a-9a8d-dbdf4ef8ddca tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:58.896606 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-03da9300-8b10-449a-9a8d-dbdf4ef8ddca tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:58.902440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03da9300-8b10-449a-9a8d-dbdf4ef8ddca tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:58.902937 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03da9300-8b10-449a-9a8d-dbdf4ef8ddca tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:58.903836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03da9300-8b10-449a-9a8d-dbdf4ef8ddca tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:58.904299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-03da9300-8b10-449a-9a8d-dbdf4ef8ddca tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:59.042422 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-03da9300-8b10-449a-9a8d-dbdf4ef8ddca tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:59.050309 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-03da9300-8b10-449a-9a8d-dbdf4ef8ddca tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1689 microversion: 2.1 time: 0.158699 Jul 20 05:21:59.050913 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3674/7326] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:58 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:21:59.068261 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9513bfd7-c417-40ba-bf12-ca86eb85fe95 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:59.068994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9513bfd7-c417-40ba-bf12-ca86eb85fe95 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:59.075426 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9513bfd7-c417-40ba-bf12-ca86eb85fe95 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:59.075904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9513bfd7-c417-40ba-bf12-ca86eb85fe95 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:59.076701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9513bfd7-c417-40ba-bf12-ca86eb85fe95 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:59.077165 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9513bfd7-c417-40ba-bf12-ca86eb85fe95 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:59.625267 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9513bfd7-c417-40ba-bf12-ca86eb85fe95 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:59.634374 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9513bfd7-c417-40ba-bf12-ca86eb85fe95 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1689 microversion: 2.1 time: 0.570371 Jul 20 05:21:59.635219 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3653/7327] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:59 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1689 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:00.652153 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0aa987f5-e6c1-4cf0-9577-e1d37dcfe980 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:00.652732 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0aa987f5-e6c1-4cf0-9577-e1d37dcfe980 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:00.659992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aa987f5-e6c1-4cf0-9577-e1d37dcfe980 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:00.660457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aa987f5-e6c1-4cf0-9577-e1d37dcfe980 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:00.661235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aa987f5-e6c1-4cf0-9577-e1d37dcfe980 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:00.662598 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0aa987f5-e6c1-4cf0-9577-e1d37dcfe980 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:00.803518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0aa987f5-e6c1-4cf0-9577-e1d37dcfe980 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:00.810977 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0aa987f5-e6c1-4cf0-9577-e1d37dcfe980 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1681 microversion: 2.1 time: 0.162870 Jul 20 05:22:00.811558 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3675/7328] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:00 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:01.835999 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-6318696f-ed2a-4e4f-a5fe-f54c6a814cbd req-7c5a5b5c-4eda-4814-bd41-04d8e13c7b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285bfe01-2edc-4b9f-b3ec-7218151a1f23", "name": "network-vif-plugged", "status": "completed", "tag": "55744477-d957-4772-883b-62045bf7e822"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:01.844405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6318696f-ed2a-4e4f-a5fe-f54c6a814cbd req-7c5a5b5c-4eda-4814-bd41-04d8e13c7b66 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:01.844876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6318696f-ed2a-4e4f-a5fe-f54c6a814cbd req-7c5a5b5c-4eda-4814-bd41-04d8e13c7b66 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:01.856907 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6318696f-ed2a-4e4f-a5fe-f54c6a814cbd req-7c5a5b5c-4eda-4814-bd41-04d8e13c7b66 service nova] Creating event network-vif-plugged:55744477-d957-4772-883b-62045bf7e822 for instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 on n-h2-760456-11 Jul 20 05:22:01.862317 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-6318696f-ed2a-4e4f-a5fe-f54c6a814cbd req-7c5a5b5c-4eda-4814-bd41-04d8e13c7b66 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106609 Jul 20 05:22:01.862945 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3654/7329] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:22:22.999069 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e8c90da8-17bd-41aa-8839-bcbdd5b9ac19 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:23.000050 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e8c90da8-17bd-41aa-8839-bcbdd5b9ac19 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:23.002597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=32 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:23.003259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:23.009509 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e8c90da8-17bd-41aa-8839-bcbdd5b9ac19 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:23.009969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e8c90da8-17bd-41aa-8839-bcbdd5b9ac19 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:23.010773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e8c90da8-17bd-41aa-8839-bcbdd5b9ac19 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:23.011213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e8c90da8-17bd-41aa-8839-bcbdd5b9ac19 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:23.066155 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e8c90da8-17bd-41aa-8839-bcbdd5b9ac19 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23/action" status: 200 len: 24579 microversion: 2.1 time: 0.070892 Jul 20 05:22:23.066818 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3676/7330] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:22:22 2022] POST /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23/action => generated 24579 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:22:30.266693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-53cc440d-a1c6-438a-b6d1-8c6238b007ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:30.267300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-53cc440d-a1c6-438a-b6d1-8c6238b007ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:30.268451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-1c4a3970-4e8a-46e8-90b0-066ff2e4750d req-0c38b4f1-b0ff-450a-bd32-cf1044b256be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285bfe01-2edc-4b9f-b3ec-7218151a1f23", "tag": "55744477-d957-4772-883b-62045bf7e822"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:30.270951 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=28 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:30.271732 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:30.277842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53cc440d-a1c6-438a-b6d1-8c6238b007ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:30.278331 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53cc440d-a1c6-438a-b6d1-8c6238b007ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:30.279132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53cc440d-a1c6-438a-b6d1-8c6238b007ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:30.279587 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-53cc440d-a1c6-438a-b6d1-8c6238b007ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:30.280299 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1c4a3970-4e8a-46e8-90b0-066ff2e4750d req-0c38b4f1-b0ff-450a-bd32-cf1044b256be service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:30.280833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-1c4a3970-4e8a-46e8-90b0-066ff2e4750d req-0c38b4f1-b0ff-450a-bd32-cf1044b256be service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:30.295187 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-1c4a3970-4e8a-46e8-90b0-066ff2e4750d req-0c38b4f1-b0ff-450a-bd32-cf1044b256be service nova] Creating event network-changed:55744477-d957-4772-883b-62045bf7e822 for instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 on n-h2-760456-11 Jul 20 05:22:30.301119 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-1c4a3970-4e8a-46e8-90b0-066ff2e4750d req-0c38b4f1-b0ff-450a-bd32-cf1044b256be service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036759 Jul 20 05:22:30.302178 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3677/7331] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:22:30.309068 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-53cc440d-a1c6-438a-b6d1-8c6238b007ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:22:30.397943 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-53cc440d-a1c6-438a-b6d1-8c6238b007ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "DELETE /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 204 len: 0 microversion: 2.1 time: 0.135210 Jul 20 05:22:30.398838 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3655/7332] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:22:30 2022] DELETE /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:22:30.409522 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2353b4ba-7caf-48a3-ae84-1fdcdbde4177 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:30.410863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2353b4ba-7caf-48a3-ae84-1fdcdbde4177 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:30.419531 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2353b4ba-7caf-48a3-ae84-1fdcdbde4177 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:30.420275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2353b4ba-7caf-48a3-ae84-1fdcdbde4177 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:30.421229 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2353b4ba-7caf-48a3-ae84-1fdcdbde4177 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:30.421841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2353b4ba-7caf-48a3-ae84-1fdcdbde4177 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:30.572555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2353b4ba-7caf-48a3-ae84-1fdcdbde4177 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:30.580202 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2353b4ba-7caf-48a3-ae84-1fdcdbde4177 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1687 microversion: 2.1 time: 0.176187 Jul 20 05:22:30.580785 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3678/7333] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:30 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:31.598832 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7dec3c67-a90d-48cb-a1b5-24f8cb017ab1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:31.599641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7dec3c67-a90d-48cb-a1b5-24f8cb017ab1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:31.606952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7dec3c67-a90d-48cb-a1b5-24f8cb017ab1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:31.607495 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7dec3c67-a90d-48cb-a1b5-24f8cb017ab1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:31.608358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7dec3c67-a90d-48cb-a1b5-24f8cb017ab1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:31.608878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7dec3c67-a90d-48cb-a1b5-24f8cb017ab1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:31.803570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7dec3c67-a90d-48cb-a1b5-24f8cb017ab1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:31.811476 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7dec3c67-a90d-48cb-a1b5-24f8cb017ab1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 200 len: 1687 microversion: 2.1 time: 0.217047 Jul 20 05:22:31.812065 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3656/7334] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:31 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 1687 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:32.315909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-ea8ab8cf-83a5-47e3-9c6a-14568c5b584d req-fb07403a-4766-4c5b-b96e-a5d91bee7c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285bfe01-2edc-4b9f-b3ec-7218151a1f23", "name": "network-vif-deleted", "tag": "55744477-d957-4772-883b-62045bf7e822"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:32.326458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ea8ab8cf-83a5-47e3-9c6a-14568c5b584d req-fb07403a-4766-4c5b-b96e-a5d91bee7c35 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:32.326830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-ea8ab8cf-83a5-47e3-9c6a-14568c5b584d req-fb07403a-4766-4c5b-b96e-a5d91bee7c35 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:32.340293 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-ea8ab8cf-83a5-47e3-9c6a-14568c5b584d req-fb07403a-4766-4c5b-b96e-a5d91bee7c35 service nova] Creating event network-vif-deleted:55744477-d957-4772-883b-62045bf7e822 for instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 on n-h2-760456-11 Jul 20 05:22:32.344982 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-ea8ab8cf-83a5-47e3-9c6a-14568c5b584d req-fb07403a-4766-4c5b-b96e-a5d91bee7c35 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032891 Jul 20 05:22:32.345578 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3679/7335] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:22:32.831133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dbe3cdba-4851-4877-814a-e841f01ee410 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:32.831704 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dbe3cdba-4851-4877-814a-e841f01ee410 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 285bfe01-2edc-4b9f-b3ec-7218151a1f23] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:32.839221 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbe3cdba-4851-4877-814a-e841f01ee410 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:32.839687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbe3cdba-4851-4877-814a-e841f01ee410 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:32.840465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbe3cdba-4851-4877-814a-e841f01ee410 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:32.840914 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbe3cdba-4851-4877-814a-e841f01ee410 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:32.854575 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-dbe3cdba-4851-4877-814a-e841f01ee410 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] HTTP exception thrown: Instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 could not be found. Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dbe3cdba-4851-4877-814a-e841f01ee410 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Request method failure captured: Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 HTTP/1.1 Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi15AA32MdWGcsRKaegS9wCO7BQHCiBClAHs8Yj7W55ghdKLBdFaoEB0VWdUPDzVnnjmtcoweYy1DbFe8xTKqrn31fS7Ei4EM2dAu-nEmvlKhj2nHYdoMCGwfnui78t-amakQizCUO4R9Mqw4cezwzBJRYmq1_pk4SMpNM8U4Yv_ZgzeU Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 7dd78539b9cf4df8874c9562bef52b8c Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 7dd78539b9cf4df8874c9562bef52b8c Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestNetworkAdvancedServerOps-1617251458-project Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 94ce2ee1efa04a06806daec00f2dea0c Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1617251458-project Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 could not be found. Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '285bfe01-2edc-4b9f-b3ec-7218151a1f23'} Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 could not be found. Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 could not be found. Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:22:32.856220 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 could not be found. Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dbe3cdba-4851-4877-814a-e841f01ee410 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Returning 404 to user: Instance 285bfe01-2edc-4b9f-b3ec-7218151a1f23 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dbe3cdba-4851-4877-814a-e841f01ee410 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23" status: 404 len: 111 microversion: 2.1 time: 0.030635 Jul 20 05:22:32.861109 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3657/7336] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:32 2022] GET /compute/v2.1/servers/285bfe01-2edc-4b9f-b3ec-7218151a1f23 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:22:35.889726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7452a5d5-e9d7-462b-98dd-9cf1a0bf155a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '.version_select at 0x7fb841032040>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:35.911888 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7452a5d5-e9d7-462b-98dd-9cf1a0bf155a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-249307213" status: 202 len: 0 microversion: 2.1 time: 0.026378 Jul 20 05:22:35.913273 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3680/7337] 10.222.0.59 () {58 vars in 1280 bytes} [Wed Jul 20 05:22:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-249307213 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:22:35.945409 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b14ca15e-ea7d-457c-8591-8c6d7f8ea1ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'create', calling method: .version_select at 0x7fb841cce3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1819016787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ91GJBRj0nrX2zVld7dK+I5OAx5CPZYV35/0VHHq6iHqeg/KIu/htuIssQHSEYh7k2++mgPtOVdDte0CPcLVhYIFDKAo76auz/m897uE4R3jTxPPFpmA9u8SwEHDy7OA=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:35.961687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b14ca15e-ea7d-457c-8591-8c6d7f8ea1ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:22:35.968204 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-b14ca15e-ea7d-457c-8591-8c6d7f8ea1ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for user 94ce2ee1efa04a06806daec00f2dea0c and project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:22:35.993492 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b14ca15e-ea7d-457c-8591-8c6d7f8ea1ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052237 Jul 20 05:22:35.994035 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3658/7338] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:22:35 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:22:41.680265 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-618234850", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "8ecbc4d6-0587-4a5b-aa13-058e70c8f0ac"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1819016787", "security_groups": [{"name": "tempest-secgroup-smoke-1488986855"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:41.797406 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] validate_networks() for [('8ecbc4d6-0587-4a5b-aa13-058e70c8f0ac', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:22:42.259084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:22:42.260832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:22:42.261887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:22:42.262832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:22:42.263434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:22:42.278948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:42.279617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:42.281066 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:42.281788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:42.307256 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:22:42.322163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for user 94ce2ee1efa04a06806daec00f2dea0c and project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:22:42.349607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:22:42.353552 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:22:42.409266 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-af8c8c29-0002-4762-86a9-2c21f9bc7d41 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734514 Jul 20 05:22:42.409931 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3681/7339] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:22:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:22:42.421358 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f0a7f6d0-498e-448a-938c-307c7f759d37 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:42.422667 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f0a7f6d0-498e-448a-938c-307c7f759d37 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:42.513297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f0a7f6d0-498e-448a-938c-307c7f759d37 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:42.522105 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f0a7f6d0-498e-448a-938c-307c7f759d37 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1266 microversion: 2.1 time: 0.104857 Jul 20 05:22:42.532665 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3659/7340] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:42 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:43.541699 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-34aedef3-29c6-45da-954b-f15fb0e1e7f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:43.543049 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-34aedef3-29c6-45da-954b-f15fb0e1e7f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:43.557227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34aedef3-29c6-45da-954b-f15fb0e1e7f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:43.564154 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34aedef3-29c6-45da-954b-f15fb0e1e7f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:43.565277 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34aedef3-29c6-45da-954b-f15fb0e1e7f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:43.565906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-34aedef3-29c6-45da-954b-f15fb0e1e7f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:43.676865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-34aedef3-29c6-45da-954b-f15fb0e1e7f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:43.693157 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-34aedef3-29c6-45da-954b-f15fb0e1e7f7 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1336 microversion: 2.1 time: 0.157064 Jul 20 05:22:43.699259 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3682/7341] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:43 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1336 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:44.711751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6dc1190f-19ec-41e9-9d09-4f25eba6b856 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:44.713015 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6dc1190f-19ec-41e9-9d09-4f25eba6b856 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:44.716209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:44.721936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc1190f-19ec-41e9-9d09-4f25eba6b856 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:44.722448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc1190f-19ec-41e9-9d09-4f25eba6b856 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:44.723239 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc1190f-19ec-41e9-9d09-4f25eba6b856 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:44.723690 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6dc1190f-19ec-41e9-9d09-4f25eba6b856 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:44.955897 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6dc1190f-19ec-41e9-9d09-4f25eba6b856 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:44.976208 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6dc1190f-19ec-41e9-9d09-4f25eba6b856 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1392 microversion: 2.1 time: 0.268725 Jul 20 05:22:44.976821 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3660/7342] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:44 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1392 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:45.072322 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-fbd29739-8644-4959-87ca-34b7a10f69dd req-919cd5f9-048e-46e8-a4c5-b63a2137c047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d", "tag": "4e3c2f48-dad3-44e5-a042-3e910432a75b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:45.083719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fbd29739-8644-4959-87ca-34b7a10f69dd req-919cd5f9-048e-46e8-a4c5-b63a2137c047 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:45.085087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fbd29739-8644-4959-87ca-34b7a10f69dd req-919cd5f9-048e-46e8-a4c5-b63a2137c047 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:45.096835 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-fbd29739-8644-4959-87ca-34b7a10f69dd req-919cd5f9-048e-46e8-a4c5-b63a2137c047 service nova] Creating event network-changed:4e3c2f48-dad3-44e5-a042-3e910432a75b for instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d on n-h1-760456-11 Jul 20 05:22:45.102782 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-fbd29739-8644-4959-87ca-34b7a10f69dd req-919cd5f9-048e-46e8-a4c5-b63a2137c047 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034887 Jul 20 05:22:45.103413 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3683/7343] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:22:45.993286 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0ea58de2-2160-4a02-bdf3-4daf2cdd0268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:45.993945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0ea58de2-2160-4a02-bdf3-4daf2cdd0268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:46.001007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ea58de2-2160-4a02-bdf3-4daf2cdd0268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:46.001481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ea58de2-2160-4a02-bdf3-4daf2cdd0268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:46.002287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ea58de2-2160-4a02-bdf3-4daf2cdd0268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:46.002755 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0ea58de2-2160-4a02-bdf3-4daf2cdd0268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:46.159167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0ea58de2-2160-4a02-bdf3-4daf2cdd0268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:46.166905 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0ea58de2-2160-4a02-bdf3-4daf2cdd0268 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1392 microversion: 2.1 time: 0.177841 Jul 20 05:22:46.167485 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3661/7344] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:45 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:47.188326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-83b7e918-0165-4341-83a0-c2682594a317 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:47.189062 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-83b7e918-0165-4341-83a0-c2682594a317 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:47.195936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83b7e918-0165-4341-83a0-c2682594a317 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:47.196396 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83b7e918-0165-4341-83a0-c2682594a317 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:47.197170 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83b7e918-0165-4341-83a0-c2682594a317 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:47.197623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-83b7e918-0165-4341-83a0-c2682594a317 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:47.341517 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-83b7e918-0165-4341-83a0-c2682594a317 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:47.348957 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-83b7e918-0165-4341-83a0-c2682594a317 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1392 microversion: 2.1 time: 0.167053 Jul 20 05:22:47.350083 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3684/7345] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:47 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:48.365435 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d9c353f5-4632-4651-8020-5392dd7ac575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:48.366486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d9c353f5-4632-4651-8020-5392dd7ac575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:48.373327 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9c353f5-4632-4651-8020-5392dd7ac575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:48.373798 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9c353f5-4632-4651-8020-5392dd7ac575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:48.374641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9c353f5-4632-4651-8020-5392dd7ac575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:48.375096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9c353f5-4632-4651-8020-5392dd7ac575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:48.513622 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d9c353f5-4632-4651-8020-5392dd7ac575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:48.521342 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d9c353f5-4632-4651-8020-5392dd7ac575 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1392 microversion: 2.1 time: 0.160291 Jul 20 05:22:48.522040 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3662/7346] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:48 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:49.539447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8b4cbad4-7403-4494-a22a-0bc6f13b7380 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:49.540157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8b4cbad4-7403-4494-a22a-0bc6f13b7380 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:49.547392 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b4cbad4-7403-4494-a22a-0bc6f13b7380 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:49.547882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b4cbad4-7403-4494-a22a-0bc6f13b7380 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:49.548672 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b4cbad4-7403-4494-a22a-0bc6f13b7380 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:49.549122 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b4cbad4-7403-4494-a22a-0bc6f13b7380 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:49.685959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8b4cbad4-7403-4494-a22a-0bc6f13b7380 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:49.693771 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8b4cbad4-7403-4494-a22a-0bc6f13b7380 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1392 microversion: 2.1 time: 0.158910 Jul 20 05:22:49.694392 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3685/7347] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:49 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:50.711616 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ee1e07ca-01b8-4349-9c5c-de9b44a3b65c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:50.712285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ee1e07ca-01b8-4349-9c5c-de9b44a3b65c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:50.719301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee1e07ca-01b8-4349-9c5c-de9b44a3b65c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:50.719776 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee1e07ca-01b8-4349-9c5c-de9b44a3b65c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:50.720595 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee1e07ca-01b8-4349-9c5c-de9b44a3b65c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:50.721055 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee1e07ca-01b8-4349-9c5c-de9b44a3b65c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:50.854184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ee1e07ca-01b8-4349-9c5c-de9b44a3b65c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:50.861809 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ee1e07ca-01b8-4349-9c5c-de9b44a3b65c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1392 microversion: 2.1 time: 0.154587 Jul 20 05:22:50.862392 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3663/7348] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:50 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:51.691199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3a40df74-5433-4571-b1ed-ab5ad39255e1 req-5e0703c9-6615-4902-a1d1-a1e2acc34393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d", "name": "network-vif-plugged", "status": "completed", "tag": "4e3c2f48-dad3-44e5-a042-3e910432a75b"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:51.700966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3a40df74-5433-4571-b1ed-ab5ad39255e1 req-5e0703c9-6615-4902-a1d1-a1e2acc34393 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:51.701451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3a40df74-5433-4571-b1ed-ab5ad39255e1 req-5e0703c9-6615-4902-a1d1-a1e2acc34393 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:51.714200 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3a40df74-5433-4571-b1ed-ab5ad39255e1 req-5e0703c9-6615-4902-a1d1-a1e2acc34393 service nova] Creating event network-vif-plugged:4e3c2f48-dad3-44e5-a042-3e910432a75b for instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d on n-h1-760456-11 Jul 20 05:22:51.719797 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3a40df74-5433-4571-b1ed-ab5ad39255e1 req-5e0703c9-6615-4902-a1d1-a1e2acc34393 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032293 Jul 20 05:22:51.720930 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3686/7349] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:22:51.879664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cf3d6382-e38f-4e5a-a56f-bfe10be6fc1a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:51.880293 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cf3d6382-e38f-4e5a-a56f-bfe10be6fc1a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:51.887898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf3d6382-e38f-4e5a-a56f-bfe10be6fc1a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:51.888370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf3d6382-e38f-4e5a-a56f-bfe10be6fc1a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:51.889156 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf3d6382-e38f-4e5a-a56f-bfe10be6fc1a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:51.889615 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cf3d6382-e38f-4e5a-a56f-bfe10be6fc1a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:52.022081 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cf3d6382-e38f-4e5a-a56f-bfe10be6fc1a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:52.029654 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cf3d6382-e38f-4e5a-a56f-bfe10be6fc1a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1392 microversion: 2.1 time: 0.153933 Jul 20 05:22:52.030233 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3664/7350] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:51 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:53.046648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ea6f10d5-b24d-4d82-a137-c524bb2f29ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:53.047516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ea6f10d5-b24d-4d82-a137-c524bb2f29ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:53.049571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:53.050232 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:53.052336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:53.060087 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea6f10d5-b24d-4d82-a137-c524bb2f29ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:53.060544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea6f10d5-b24d-4d82-a137-c524bb2f29ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:53.061319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea6f10d5-b24d-4d82-a137-c524bb2f29ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:53.061760 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ea6f10d5-b24d-4d82-a137-c524bb2f29ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:53.064891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=39 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:53.204261 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ea6f10d5-b24d-4d82-a137-c524bb2f29ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:53.212509 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ea6f10d5-b24d-4d82-a137-c524bb2f29ad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1565 microversion: 2.1 time: 0.170316 Jul 20 05:22:53.213088 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3687/7351] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:53 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:53.229658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:53.276289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ce7bdcff-bd22-4952-8761-4420cfced556 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:53.276918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ce7bdcff-bd22-4952-8761-4420cfced556 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:53.283076 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce7bdcff-bd22-4952-8761-4420cfced556 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:53.283573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce7bdcff-bd22-4952-8761-4420cfced556 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:53.284362 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce7bdcff-bd22-4952-8761-4420cfced556 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:53.284826 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce7bdcff-bd22-4952-8761-4420cfced556 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:53.420939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ce7bdcff-bd22-4952-8761-4420cfced556 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:53.428656 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ce7bdcff-bd22-4952-8761-4420cfced556 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1565 microversion: 2.1 time: 0.203578 Jul 20 05:22:53.429243 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3665/7352] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:53 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1565 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:55.345314 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-ef700189-3150-40fa-a13a-aa65164ba1e4 req-9bc57080-1a3c-4541-b921-3389b764e0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d", "tag": "4e3c2f48-dad3-44e5-a042-3e910432a75b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:55.351951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1edb18a1-d3ea-40eb-aee9-434d445bd819 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:55.352595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1edb18a1-d3ea-40eb-aee9-434d445bd819 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:55.359899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1edb18a1-d3ea-40eb-aee9-434d445bd819 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:55.360369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1edb18a1-d3ea-40eb-aee9-434d445bd819 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:55.360721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ef700189-3150-40fa-a13a-aa65164ba1e4 req-9bc57080-1a3c-4541-b921-3389b764e0a4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:55.361190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-ef700189-3150-40fa-a13a-aa65164ba1e4 req-9bc57080-1a3c-4541-b921-3389b764e0a4 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:55.361368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1edb18a1-d3ea-40eb-aee9-434d445bd819 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:55.362006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1edb18a1-d3ea-40eb-aee9-434d445bd819 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:55.375363 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-ef700189-3150-40fa-a13a-aa65164ba1e4 req-9bc57080-1a3c-4541-b921-3389b764e0a4 service nova] Creating event network-changed:4e3c2f48-dad3-44e5-a042-3e910432a75b for instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d on n-h1-760456-11 Jul 20 05:22:55.381375 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-ef700189-3150-40fa-a13a-aa65164ba1e4 req-9bc57080-1a3c-4541-b921-3389b764e0a4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039201 Jul 20 05:22:55.382291 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3666/7353] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:22:55.510941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1edb18a1-d3ea-40eb-aee9-434d445bd819 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:55.521858 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1edb18a1-d3ea-40eb-aee9-434d445bd819 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1565 microversion: 2.1 time: 0.183601 Jul 20 05:22:55.522935 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3688/7354] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:55 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:18.782442 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:18.783223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=38 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:18.787647 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1025fa4f-f485-4e7e-9828-1535f2eac770 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:18.789162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1025fa4f-f485-4e7e-9828-1535f2eac770 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:18.797444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1025fa4f-f485-4e7e-9828-1535f2eac770 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:18.797908 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1025fa4f-f485-4e7e-9828-1535f2eac770 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:18.798719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1025fa4f-f485-4e7e-9828-1535f2eac770 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:18.799169 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1025fa4f-f485-4e7e-9828-1535f2eac770 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:18.849868 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1025fa4f-f485-4e7e-9828-1535f2eac770 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d/action" status: 200 len: 24570 microversion: 2.1 time: 0.069277 Jul 20 05:23:18.850759 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3667/7355] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:23:18 2022] POST /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d/action => generated 24570 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:23:25.256449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a05fdf9e-faa7-40f4-9cf3-0bbbcf0b0393 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:25.259259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:25.259916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=11 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:25.266100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a05fdf9e-faa7-40f4-9cf3-0bbbcf0b0393 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:25.266584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a05fdf9e-faa7-40f4-9cf3-0bbbcf0b0393 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:25.288792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a05fdf9e-faa7-40f4-9cf3-0bbbcf0b0393 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Going to try to stop instance {{(pid=119606) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 05:23:25.331925 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a05fdf9e-faa7-40f4-9cf3-0bbbcf0b0393 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d/action" status: 202 len: 0 microversion: 2.1 time: 0.079466 Jul 20 05:23:25.332569 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3689/7356] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:23:25 2022] POST /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:23:25.341367 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1cc3ef8e-75f0-4746-b3af-4627f4252fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:25.342189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1cc3ef8e-75f0-4746-b3af-4627f4252fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:25.350188 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cc3ef8e-75f0-4746-b3af-4627f4252fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:25.350770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cc3ef8e-75f0-4746-b3af-4627f4252fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:25.352174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cc3ef8e-75f0-4746-b3af-4627f4252fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:25.352638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1cc3ef8e-75f0-4746-b3af-4627f4252fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:25.491200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1cc3ef8e-75f0-4746-b3af-4627f4252fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:25.499736 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1cc3ef8e-75f0-4746-b3af-4627f4252fad tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1694 microversion: 2.1 time: 0.162699 Jul 20 05:23:25.500307 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3668/7357] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:25 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:26.518905 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3d435150-6826-41cc-bd9a-983a8d20f309 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:26.519612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3d435150-6826-41cc-bd9a-983a8d20f309 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:26.526063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d435150-6826-41cc-bd9a-983a8d20f309 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:26.526556 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d435150-6826-41cc-bd9a-983a8d20f309 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:26.527324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d435150-6826-41cc-bd9a-983a8d20f309 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:26.527761 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3d435150-6826-41cc-bd9a-983a8d20f309 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:26.663061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-3d435150-6826-41cc-bd9a-983a8d20f309 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:26.671176 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3d435150-6826-41cc-bd9a-983a8d20f309 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1694 microversion: 2.1 time: 0.157732 Jul 20 05:23:26.671759 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3690/7358] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:26 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:27.689742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-989d58f8-fb5e-4ad3-b588-d67daa469100 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:27.690396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-989d58f8-fb5e-4ad3-b588-d67daa469100 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:27.698102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-989d58f8-fb5e-4ad3-b588-d67daa469100 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:27.698968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-989d58f8-fb5e-4ad3-b588-d67daa469100 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:27.699733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-989d58f8-fb5e-4ad3-b588-d67daa469100 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:27.700192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-989d58f8-fb5e-4ad3-b588-d67daa469100 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:27.839192 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-989d58f8-fb5e-4ad3-b588-d67daa469100 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:27.846712 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-989d58f8-fb5e-4ad3-b588-d67daa469100 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1694 microversion: 2.1 time: 0.160944 Jul 20 05:23:27.847312 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3669/7359] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:27 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:28.864692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e559fc26-752a-4b08-bed1-140ff46fb8fa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:28.865319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e559fc26-752a-4b08-bed1-140ff46fb8fa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:28.872538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e559fc26-752a-4b08-bed1-140ff46fb8fa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:28.873009 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e559fc26-752a-4b08-bed1-140ff46fb8fa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:28.873785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e559fc26-752a-4b08-bed1-140ff46fb8fa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:28.874235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e559fc26-752a-4b08-bed1-140ff46fb8fa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:29.013494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e559fc26-752a-4b08-bed1-140ff46fb8fa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:29.021058 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e559fc26-752a-4b08-bed1-140ff46fb8fa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1694 microversion: 2.1 time: 0.160310 Jul 20 05:23:29.021643 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3691/7360] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:28 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:30.038901 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b58005c8-e330-487d-ab58-b862135db3ae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:30.039556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b58005c8-e330-487d-ab58-b862135db3ae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:30.046629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b58005c8-e330-487d-ab58-b862135db3ae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:30.047093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b58005c8-e330-487d-ab58-b862135db3ae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:30.047867 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b58005c8-e330-487d-ab58-b862135db3ae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:30.048319 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b58005c8-e330-487d-ab58-b862135db3ae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:30.180278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b58005c8-e330-487d-ab58-b862135db3ae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:30.188109 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b58005c8-e330-487d-ab58-b862135db3ae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1694 microversion: 2.1 time: 0.153056 Jul 20 05:23:30.188668 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3670/7361] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:30 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:31.206152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2ccdf8dc-adc9-418c-ad0c-5cb38adb4221 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:31.206809 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2ccdf8dc-adc9-418c-ad0c-5cb38adb4221 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:31.214364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ccdf8dc-adc9-418c-ad0c-5cb38adb4221 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:31.214826 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ccdf8dc-adc9-418c-ad0c-5cb38adb4221 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:31.215609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ccdf8dc-adc9-418c-ad0c-5cb38adb4221 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:31.216059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2ccdf8dc-adc9-418c-ad0c-5cb38adb4221 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:31.347324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2ccdf8dc-adc9-418c-ad0c-5cb38adb4221 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:31.355788 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2ccdf8dc-adc9-418c-ad0c-5cb38adb4221 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1694 microversion: 2.1 time: 0.153577 Jul 20 05:23:31.356366 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3692/7362] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:31 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:32.373464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-38f212eb-563f-4737-9e26-69be4f30bde4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:32.374002 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-38f212eb-563f-4737-9e26-69be4f30bde4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:32.380682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f212eb-563f-4737-9e26-69be4f30bde4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:32.381110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f212eb-563f-4737-9e26-69be4f30bde4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:32.381906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f212eb-563f-4737-9e26-69be4f30bde4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:32.382492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-38f212eb-563f-4737-9e26-69be4f30bde4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:32.518124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-38f212eb-563f-4737-9e26-69be4f30bde4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:32.526825 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-38f212eb-563f-4737-9e26-69be4f30bde4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1694 microversion: 2.1 time: 0.157551 Jul 20 05:23:32.527406 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3671/7363] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:32 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:33.543663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5fe20e18-5e82-44fc-b458-22e57a069923 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:33.544293 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5fe20e18-5e82-44fc-b458-22e57a069923 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:33.551308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fe20e18-5e82-44fc-b458-22e57a069923 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:33.551774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fe20e18-5e82-44fc-b458-22e57a069923 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:33.552551 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fe20e18-5e82-44fc-b458-22e57a069923 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:33.553003 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5fe20e18-5e82-44fc-b458-22e57a069923 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:33.691959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5fe20e18-5e82-44fc-b458-22e57a069923 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:33.700189 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5fe20e18-5e82-44fc-b458-22e57a069923 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1694 microversion: 2.1 time: 0.160510 Jul 20 05:23:33.700769 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3693/7364] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:33 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:34.717144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e1ea50f4-ed1a-406f-afcd-a004db9a271e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:34.717772 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e1ea50f4-ed1a-406f-afcd-a004db9a271e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:34.724739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1ea50f4-ed1a-406f-afcd-a004db9a271e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:34.725208 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1ea50f4-ed1a-406f-afcd-a004db9a271e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:34.726653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1ea50f4-ed1a-406f-afcd-a004db9a271e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:34.727102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e1ea50f4-ed1a-406f-afcd-a004db9a271e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:34.858604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e1ea50f4-ed1a-406f-afcd-a004db9a271e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:34.866734 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e1ea50f4-ed1a-406f-afcd-a004db9a271e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1694 microversion: 2.1 time: 0.152982 Jul 20 05:23:34.867476 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3672/7365] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:34 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:35.883946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5b463013-8cbf-4888-98c4-f9d770ec2122 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:35.885380 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5b463013-8cbf-4888-98c4-f9d770ec2122 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:35.892521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b463013-8cbf-4888-98c4-f9d770ec2122 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:35.892977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b463013-8cbf-4888-98c4-f9d770ec2122 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:35.893743 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b463013-8cbf-4888-98c4-f9d770ec2122 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:35.894183 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5b463013-8cbf-4888-98c4-f9d770ec2122 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:36.030491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5b463013-8cbf-4888-98c4-f9d770ec2122 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:36.037858 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5b463013-8cbf-4888-98c4-f9d770ec2122 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1671 microversion: 2.1 time: 0.157963 Jul 20 05:23:36.038535 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3694/7366] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:35 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:37.128198 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0e39a46b-902d-4acb-ad53-36592422ef34 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:37.129176 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0e39a46b-902d-4acb-ad53-36592422ef34 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:37.136886 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e39a46b-902d-4acb-ad53-36592422ef34 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:37.137352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e39a46b-902d-4acb-ad53-36592422ef34 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:37.138133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e39a46b-902d-4acb-ad53-36592422ef34 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:37.138631 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0e39a46b-902d-4acb-ad53-36592422ef34 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:37.188508 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0e39a46b-902d-4acb-ad53-36592422ef34 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d/action" status: 200 len: 36205 microversion: 2.1 time: 0.064093 Jul 20 05:23:37.189195 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3673/7367] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:23:37 2022] POST /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d/action => generated 36205 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:23:37.201020 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e5e1e966-0ef0-4f5b-afc3-933211d6d560 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:37.207959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5e1e966-0ef0-4f5b-afc3-933211d6d560 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:37.208421 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e5e1e966-0ef0-4f5b-afc3-933211d6d560 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:37.229892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e5e1e966-0ef0-4f5b-afc3-933211d6d560 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Going to try to start instance {{(pid=119606) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 05:23:37.270925 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e5e1e966-0ef0-4f5b-afc3-933211d6d560 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d/action" status: 202 len: 0 microversion: 2.1 time: 0.073557 Jul 20 05:23:37.271563 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3695/7368] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:23:37 2022] POST /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:23:37.280505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2ff6913c-113b-4b16-9969-d4c42ef0147e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:37.281226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2ff6913c-113b-4b16-9969-d4c42ef0147e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:37.289977 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ff6913c-113b-4b16-9969-d4c42ef0147e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:37.290608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ff6913c-113b-4b16-9969-d4c42ef0147e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:37.291604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ff6913c-113b-4b16-9969-d4c42ef0147e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:37.292075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2ff6913c-113b-4b16-9969-d4c42ef0147e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:37.527209 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2ff6913c-113b-4b16-9969-d4c42ef0147e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:37.534971 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2ff6913c-113b-4b16-9969-d4c42ef0147e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1680 microversion: 2.1 time: 0.258743 Jul 20 05:23:37.535562 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3674/7369] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:37 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:38.556216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2c543a1d-eef6-49e4-8b60-e3a3e820882c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:38.556939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2c543a1d-eef6-49e4-8b60-e3a3e820882c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:38.563415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c543a1d-eef6-49e4-8b60-e3a3e820882c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:38.563873 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c543a1d-eef6-49e4-8b60-e3a3e820882c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:38.564652 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c543a1d-eef6-49e4-8b60-e3a3e820882c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:38.565100 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2c543a1d-eef6-49e4-8b60-e3a3e820882c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:38.706738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2c543a1d-eef6-49e4-8b60-e3a3e820882c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:38.714867 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2c543a1d-eef6-49e4-8b60-e3a3e820882c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1684 microversion: 2.1 time: 0.164931 Jul 20 05:23:38.715462 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3696/7370] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:38 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:40.653205 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:23:40.653811 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:23:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:24:02.909642 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-8cf31dbc-386a-426c-8997-24a83c41c7c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:02.910365 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-8cf31dbc-386a-426c-8997-24a83c41c7c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:02.913671 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=16 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:02.914492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=44 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:02.921740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cf31dbc-386a-426c-8997-24a83c41c7c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:02.922219 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cf31dbc-386a-426c-8997-24a83c41c7c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:02.923047 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cf31dbc-386a-426c-8997-24a83c41c7c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:02.923509 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-8cf31dbc-386a-426c-8997-24a83c41c7c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:02.974818 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-8cf31dbc-386a-426c-8997-24a83c41c7c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d/action" status: 200 len: 60771 microversion: 2.1 time: 0.069393 Jul 20 05:24:02.976123 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3675/7371] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:24:02 2022] POST /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d/action => generated 60771 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:24:10.023717 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-3a881402-5741-430b-9e67-3b869ac0c017 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:10.024263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3a881402-5741-430b-9e67-3b869ac0c017 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:10.026059 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-d0b82f80-b948-4f27-89e8-2196b22cbd01 req-1710ebfc-57c2-43d2-9c1b-f9c0ec73e911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d", "tag": "4e3c2f48-dad3-44e5-a042-3e910432a75b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:10.026956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=16 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:10.027622 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:10.033582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a881402-5741-430b-9e67-3b869ac0c017 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:10.034047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a881402-5741-430b-9e67-3b869ac0c017 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:10.034994 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a881402-5741-430b-9e67-3b869ac0c017 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:10.035447 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-3a881402-5741-430b-9e67-3b869ac0c017 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:10.037854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d0b82f80-b948-4f27-89e8-2196b22cbd01 req-1710ebfc-57c2-43d2-9c1b-f9c0ec73e911 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:10.038964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-d0b82f80-b948-4f27-89e8-2196b22cbd01 req-1710ebfc-57c2-43d2-9c1b-f9c0ec73e911 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:10.051297 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-d0b82f80-b948-4f27-89e8-2196b22cbd01 req-1710ebfc-57c2-43d2-9c1b-f9c0ec73e911 service nova] Creating event network-changed:4e3c2f48-dad3-44e5-a042-3e910432a75b for instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d on n-h1-760456-11 Jul 20 05:24:10.057522 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-d0b82f80-b948-4f27-89e8-2196b22cbd01 req-1710ebfc-57c2-43d2-9c1b-f9c0ec73e911 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036757 Jul 20 05:24:10.058599 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3676/7372] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:24:10.067310 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-3a881402-5741-430b-9e67-3b869ac0c017 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:24:10.164924 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-3a881402-5741-430b-9e67-3b869ac0c017 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 204 len: 0 microversion: 2.1 time: 0.146433 Jul 20 05:24:10.165967 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3697/7373] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:24:10 2022] DELETE /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:24:10.174939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d9b3d13b-5e11-4cda-8dca-d709b0a07937 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:10.175701 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d9b3d13b-5e11-4cda-8dca-d709b0a07937 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:10.183553 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b3d13b-5e11-4cda-8dca-d709b0a07937 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:10.184023 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b3d13b-5e11-4cda-8dca-d709b0a07937 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:10.185101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b3d13b-5e11-4cda-8dca-d709b0a07937 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:10.185715 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d9b3d13b-5e11-4cda-8dca-d709b0a07937 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:10.343653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d9b3d13b-5e11-4cda-8dca-d709b0a07937 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:10.352838 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d9b3d13b-5e11-4cda-8dca-d709b0a07937 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1690 microversion: 2.1 time: 0.182627 Jul 20 05:24:10.353429 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3677/7374] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:10 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:24:11.371493 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8b8a8d11-4b07-4738-aed7-66561ecfd51b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:11.372200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8b8a8d11-4b07-4738-aed7-66561ecfd51b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:11.379227 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8a8d11-4b07-4738-aed7-66561ecfd51b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:11.379685 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8a8d11-4b07-4738-aed7-66561ecfd51b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:11.380653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8a8d11-4b07-4738-aed7-66561ecfd51b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:11.381104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8b8a8d11-4b07-4738-aed7-66561ecfd51b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:11.520415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8b8a8d11-4b07-4738-aed7-66561ecfd51b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:11.530646 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8b8a8d11-4b07-4738-aed7-66561ecfd51b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 200 len: 1690 microversion: 2.1 time: 0.163460 Jul 20 05:24:11.531476 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3698/7375] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:11 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:12.120011 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-c583d4f4-172d-41b6-ba78-9ad1b8dde976 req-bdc24269-9c7a-4b88-9138-a3a7ab95e7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d", "name": "network-vif-deleted", "tag": "4e3c2f48-dad3-44e5-a042-3e910432a75b"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:12.132486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c583d4f4-172d-41b6-ba78-9ad1b8dde976 req-bdc24269-9c7a-4b88-9138-a3a7ab95e7b2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:12.133965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-c583d4f4-172d-41b6-ba78-9ad1b8dde976 req-bdc24269-9c7a-4b88-9138-a3a7ab95e7b2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:12.147666 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-c583d4f4-172d-41b6-ba78-9ad1b8dde976 req-bdc24269-9c7a-4b88-9138-a3a7ab95e7b2 service nova] Creating event network-vif-deleted:4e3c2f48-dad3-44e5-a042-3e910432a75b for instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d on n-h1-760456-11 Jul 20 05:24:12.153109 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-c583d4f4-172d-41b6-ba78-9ad1b8dde976 req-bdc24269-9c7a-4b88-9138-a3a7ab95e7b2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092458 Jul 20 05:24:12.153712 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3678/7376] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:24:12.549205 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be8fbfdb-6467-4b99-9f8f-3810c9fadba0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:12.549833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-be8fbfdb-6467-4b99-9f8f-3810c9fadba0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:12.557399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be8fbfdb-6467-4b99-9f8f-3810c9fadba0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:12.557887 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be8fbfdb-6467-4b99-9f8f-3810c9fadba0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:12.558684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be8fbfdb-6467-4b99-9f8f-3810c9fadba0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:12.559135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-be8fbfdb-6467-4b99-9f8f-3810c9fadba0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:12.572894 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-be8fbfdb-6467-4b99-9f8f-3810c9fadba0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] HTTP exception thrown: Instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d could not be found. Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be8fbfdb-6467-4b99-9f8f-3810c9fadba0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Request method failure captured: Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d HTTP/1.1 Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi15AA32MdWGcsRKaegS9wCO7BQHCiBClAHs8Yj7W55ghdKLBdFaoEB0VWdUPDzVnnjmtcoweYy1DbFe8xTKqrn31fS7Ei4EM2dAu-nEmvlKhj2nHYdoMCGwfnui78t-amakQizCUO4R9Mqw4cezwzBJRYmq1_pk4SMpNM8U4Yv_ZgzeU Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 7dd78539b9cf4df8874c9562bef52b8c Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 7dd78539b9cf4df8874c9562bef52b8c Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestNetworkAdvancedServerOps-1617251458-project Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 94ce2ee1efa04a06806daec00f2dea0c Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1617251458-project Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d could not be found. Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': '0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d'} Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d could not be found. Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d could not be found. Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:24:12.574636 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d could not be found. Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-be8fbfdb-6467-4b99-9f8f-3810c9fadba0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Returning 404 to user: Instance 0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-be8fbfdb-6467-4b99-9f8f-3810c9fadba0 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d" status: 404 len: 111 microversion: 2.1 time: 0.031105 Jul 20 05:24:12.578882 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3699/7377] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:12 2022] GET /compute/v2.1/servers/0a1fbaaf-a6cf-4e7f-99fe-8261afd0794d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:24:15.933854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-98820561-c78d-40dd-a28d-85895668c991 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '.version_select at 0x7fb841d998b0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:15.954554 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-98820561-c78d-40dd-a28d-85895668c991 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1819016787" status: 202 len: 0 microversion: 2.1 time: 0.024683 Jul 20 05:24:15.954938 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3679/7378] 10.222.0.59 () {58 vars in 1283 bytes} [Wed Jul 20 05:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1819016787 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:24:15.988213 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ed9d02c0-992f-41e6-a46e-47decb196a44 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'create', calling method: .version_select at 0x7fb840ee7790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-907736922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxethZNSq5QTo/SvhNDbQC6C8rSRUbiiun2/KT8cdbpNKjJVmI+8T/V2JNMAmgQgnJcEzCsqG6f1w7UdO7T2xr+ecyx1IOMnj0cTKPwi/l60+4WvXL6otqBvscEeNqPSw=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:16.004283 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ed9d02c0-992f-41e6-a46e-47decb196a44 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:24:16.011869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-ed9d02c0-992f-41e6-a46e-47decb196a44 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for user 94ce2ee1efa04a06806daec00f2dea0c and project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:24:16.035500 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ed9d02c0-992f-41e6-a46e-47decb196a44 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051567 Jul 20 05:24:16.036098 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3700/7379] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:24:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:24:22.029930 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1424066745", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "networks": [{"uuid": "69755fd2-4a83-4f8f-b0c8-a54e4af45c1f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-907736922", "security_groups": [{"name": "tempest-secgroup-smoke-76515561"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:22.140480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=14 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:22.146744 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] validate_networks() for [('69755fd2-4a83-4f8f-b0c8-a54e4af45c1f', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:24:22.579912 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:24:22.580351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:24:22.580834 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:24:22.581262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:24:22.581695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:24:22.591953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:22.592422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:22.593234 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:22.593727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:22.611183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:24:22.617263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Getting quotas for user 94ce2ee1efa04a06806daec00f2dea0c and project 7dd78539b9cf4df8874c9562bef52b8c. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:24:22.630814 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:24:22.634168 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:24:22.685961 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a66431b5-4510-4ea7-94f4-ccc6492ed1f9 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.661102 Jul 20 05:24:22.687200 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3680/7380] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:24:22 2022] POST /compute/v2.1/servers => generated 404 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:24:22.695955 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:22.700863 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ba0cd77e-ac74-4fbe-8ddb-f4ac3244195d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:22.701490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ba0cd77e-ac74-4fbe-8ddb-f4ac3244195d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:22.776445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ba0cd77e-ac74-4fbe-8ddb-f4ac3244195d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:22.785103 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ba0cd77e-ac74-4fbe-8ddb-f4ac3244195d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1266 microversion: 2.1 time: 0.091609 Jul 20 05:24:22.785818 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3701/7381] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:22 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:23.805513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ee156acb-30af-475f-aa1f-e8625841a5e1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:23.806869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ee156acb-30af-475f-aa1f-e8625841a5e1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:23.816939 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee156acb-30af-475f-aa1f-e8625841a5e1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:23.817775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee156acb-30af-475f-aa1f-e8625841a5e1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:23.819396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee156acb-30af-475f-aa1f-e8625841a5e1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:23.821424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ee156acb-30af-475f-aa1f-e8625841a5e1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:23.899296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ee156acb-30af-475f-aa1f-e8625841a5e1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:23.907653 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ee156acb-30af-475f-aa1f-e8625841a5e1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1336 microversion: 2.1 time: 0.108349 Jul 20 05:24:23.908581 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3681/7382] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:23 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1336 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:24.925113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8a29ff8f-1e5f-44d7-92bb-6264220b396d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:24.925731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8a29ff8f-1e5f-44d7-92bb-6264220b396d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:24.935028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a29ff8f-1e5f-44d7-92bb-6264220b396d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:24.935560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a29ff8f-1e5f-44d7-92bb-6264220b396d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:24.936608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a29ff8f-1e5f-44d7-92bb-6264220b396d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:24.937129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8a29ff8f-1e5f-44d7-92bb-6264220b396d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:25.159611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8a29ff8f-1e5f-44d7-92bb-6264220b396d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:25.175562 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8a29ff8f-1e5f-44d7-92bb-6264220b396d tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1390 microversion: 2.1 time: 0.254151 Jul 20 05:24:25.176810 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3702/7383] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:24 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1390 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:25.396145 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-658d7eb6-3e6c-4f01-80f0-8ef0a20cc8ae req-200e63ad-e34f-45ea-b42f-382ef19aad4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07d3220-53e1-401d-9068-050de73f08d5", "tag": "06198a82-699d-4bca-8f03-d5e86fd0a917"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:25.409994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-658d7eb6-3e6c-4f01-80f0-8ef0a20cc8ae req-200e63ad-e34f-45ea-b42f-382ef19aad4c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:25.410792 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-658d7eb6-3e6c-4f01-80f0-8ef0a20cc8ae req-200e63ad-e34f-45ea-b42f-382ef19aad4c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:25.439245 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-658d7eb6-3e6c-4f01-80f0-8ef0a20cc8ae req-200e63ad-e34f-45ea-b42f-382ef19aad4c service nova] Creating event network-changed:06198a82-699d-4bca-8f03-d5e86fd0a917 for instance d07d3220-53e1-401d-9068-050de73f08d5 on n-h2-760456-11 Jul 20 05:24:25.448060 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-658d7eb6-3e6c-4f01-80f0-8ef0a20cc8ae req-200e63ad-e34f-45ea-b42f-382ef19aad4c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056978 Jul 20 05:24:25.449047 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3682/7384] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:24:26.193794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d7aa9d0f-978b-4503-ad6d-2d3d45d4b590 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:26.194457 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d7aa9d0f-978b-4503-ad6d-2d3d45d4b590 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:26.201976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7aa9d0f-978b-4503-ad6d-2d3d45d4b590 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:26.202484 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7aa9d0f-978b-4503-ad6d-2d3d45d4b590 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:26.203259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7aa9d0f-978b-4503-ad6d-2d3d45d4b590 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:26.203703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d7aa9d0f-978b-4503-ad6d-2d3d45d4b590 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:26.338114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d7aa9d0f-978b-4503-ad6d-2d3d45d4b590 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:26.345668 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d7aa9d0f-978b-4503-ad6d-2d3d45d4b590 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1390 microversion: 2.1 time: 0.155843 Jul 20 05:24:26.346701 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3703/7385] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:26 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:27.363618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e324bbf5-81a8-43d7-8dee-acc49f795adc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:27.364336 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e324bbf5-81a8-43d7-8dee-acc49f795adc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:27.372259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e324bbf5-81a8-43d7-8dee-acc49f795adc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:27.372739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e324bbf5-81a8-43d7-8dee-acc49f795adc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:27.373532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e324bbf5-81a8-43d7-8dee-acc49f795adc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:27.373992 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e324bbf5-81a8-43d7-8dee-acc49f795adc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:27.509569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e324bbf5-81a8-43d7-8dee-acc49f795adc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:27.517091 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e324bbf5-81a8-43d7-8dee-acc49f795adc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1390 microversion: 2.1 time: 0.158119 Jul 20 05:24:27.517675 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3683/7386] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:27 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:28.535625 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f00bdf22-7510-433c-addc-109a31ae9bfa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:28.536244 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f00bdf22-7510-433c-addc-109a31ae9bfa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:28.544074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f00bdf22-7510-433c-addc-109a31ae9bfa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:28.544660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f00bdf22-7510-433c-addc-109a31ae9bfa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:28.545492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f00bdf22-7510-433c-addc-109a31ae9bfa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:28.545941 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f00bdf22-7510-433c-addc-109a31ae9bfa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:28.686220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f00bdf22-7510-433c-addc-109a31ae9bfa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:28.693701 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f00bdf22-7510-433c-addc-109a31ae9bfa tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1390 microversion: 2.1 time: 0.162138 Jul 20 05:24:28.694325 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3704/7387] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:28 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:29.711729 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b2eb9476-c022-49ee-8b41-516ebce98a16 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:29.712361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b2eb9476-c022-49ee-8b41-516ebce98a16 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:29.719301 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2eb9476-c022-49ee-8b41-516ebce98a16 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:29.719768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2eb9476-c022-49ee-8b41-516ebce98a16 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:29.720551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2eb9476-c022-49ee-8b41-516ebce98a16 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:29.721003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b2eb9476-c022-49ee-8b41-516ebce98a16 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:29.854321 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b2eb9476-c022-49ee-8b41-516ebce98a16 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:29.862178 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b2eb9476-c022-49ee-8b41-516ebce98a16 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1390 microversion: 2.1 time: 0.154592 Jul 20 05:24:29.862813 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3684/7388] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:29 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:24:30.533436 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e1b0ff3c-49af-4b10-b0b2-041cb8253c5c req-4bd458de-561c-47ed-af06-897aa4214b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07d3220-53e1-401d-9068-050de73f08d5", "name": "network-vif-plugged", "status": "completed", "tag": "06198a82-699d-4bca-8f03-d5e86fd0a917"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:30.542895 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e1b0ff3c-49af-4b10-b0b2-041cb8253c5c req-4bd458de-561c-47ed-af06-897aa4214b1d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:30.543353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e1b0ff3c-49af-4b10-b0b2-041cb8253c5c req-4bd458de-561c-47ed-af06-897aa4214b1d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:30.555429 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e1b0ff3c-49af-4b10-b0b2-041cb8253c5c req-4bd458de-561c-47ed-af06-897aa4214b1d service nova] Creating event network-vif-plugged:06198a82-699d-4bca-8f03-d5e86fd0a917 for instance d07d3220-53e1-401d-9068-050de73f08d5 on n-h2-760456-11 Jul 20 05:24:30.560319 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e1b0ff3c-49af-4b10-b0b2-041cb8253c5c req-4bd458de-561c-47ed-af06-897aa4214b1d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030651 Jul 20 05:24:30.560914 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3705/7389] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:24:30.880629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d8d81e0e-735b-4425-9f4b-2336ef4de3c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:30.881302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d8d81e0e-735b-4425-9f4b-2336ef4de3c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:30.888406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8d81e0e-735b-4425-9f4b-2336ef4de3c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:30.888872 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8d81e0e-735b-4425-9f4b-2336ef4de3c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:30.889652 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8d81e0e-735b-4425-9f4b-2336ef4de3c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:30.890101 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d8d81e0e-735b-4425-9f4b-2336ef4de3c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:31.028195 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-d8d81e0e-735b-4425-9f4b-2336ef4de3c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:31.035675 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d8d81e0e-735b-4425-9f4b-2336ef4de3c1 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1390 microversion: 2.1 time: 0.158989 Jul 20 05:24:31.036253 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3685/7390] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:30 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:32.054294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9396ce53-a734-450b-8e76-9e761ab666fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:32.054928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9396ce53-a734-450b-8e76-9e761ab666fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:32.061597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9396ce53-a734-450b-8e76-9e761ab666fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:32.062067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9396ce53-a734-450b-8e76-9e761ab666fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:32.062891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9396ce53-a734-450b-8e76-9e761ab666fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:32.063343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9396ce53-a734-450b-8e76-9e761ab666fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:32.199697 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9396ce53-a734-450b-8e76-9e761ab666fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:32.207241 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9396ce53-a734-450b-8e76-9e761ab666fd tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1561 microversion: 2.1 time: 0.158718 Jul 20 05:24:32.207824 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3706/7391] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:32 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:32.223638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3e55b85a-6163-45be-a91b-47c25b7d0c9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:32.224285 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3e55b85a-6163-45be-a91b-47c25b7d0c9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:32.231675 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3e55b85a-6163-45be-a91b-47c25b7d0c9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:32.232149 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3e55b85a-6163-45be-a91b-47c25b7d0c9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:32.232935 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3e55b85a-6163-45be-a91b-47c25b7d0c9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:32.233390 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3e55b85a-6163-45be-a91b-47c25b7d0c9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:32.380113 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3e55b85a-6163-45be-a91b-47c25b7d0c9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:32.388484 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3e55b85a-6163-45be-a91b-47c25b7d0c9e tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1561 microversion: 2.1 time: 0.168719 Jul 20 05:24:32.389058 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3686/7392] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:32 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:34.001240 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:34.006065 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-aba79c68-7996-4363-a74b-b72be8661edb req-0fdec3d9-a211-4e0d-adf1-8432eda71e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07d3220-53e1-401d-9068-050de73f08d5", "tag": "06198a82-699d-4bca-8f03-d5e86fd0a917"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:34.008352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a119faef-8b51-4fc9-8e2b-857ece6d50e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:34.009111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a119faef-8b51-4fc9-8e2b-857ece6d50e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:34.014604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:34.015291 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:34.017423 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:34.018047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a119faef-8b51-4fc9-8e2b-857ece6d50e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:34.018977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a119faef-8b51-4fc9-8e2b-857ece6d50e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:34.020163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a119faef-8b51-4fc9-8e2b-857ece6d50e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:34.020812 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a119faef-8b51-4fc9-8e2b-857ece6d50e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:34.021099 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-aba79c68-7996-4363-a74b-b72be8661edb req-0fdec3d9-a211-4e0d-adf1-8432eda71e87 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:34.021573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-aba79c68-7996-4363-a74b-b72be8661edb req-0fdec3d9-a211-4e0d-adf1-8432eda71e87 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:34.035514 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-aba79c68-7996-4363-a74b-b72be8661edb req-0fdec3d9-a211-4e0d-adf1-8432eda71e87 service nova] Creating event network-changed:06198a82-699d-4bca-8f03-d5e86fd0a917 for instance d07d3220-53e1-401d-9068-050de73f08d5 on n-h2-760456-11 Jul 20 05:24:34.041174 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-aba79c68-7996-4363-a74b-b72be8661edb req-0fdec3d9-a211-4e0d-adf1-8432eda71e87 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038616 Jul 20 05:24:34.042378 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3687/7393] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:24:34.254274 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a119faef-8b51-4fc9-8e2b-857ece6d50e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:34.263656 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a119faef-8b51-4fc9-8e2b-857ece6d50e4 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1561 microversion: 2.1 time: 0.263333 Jul 20 05:24:34.264258 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3707/7394] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:33 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1561 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:57.510560 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=36 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:57.515098 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3403fe10-44cc-4371-a776-292e45b4e7ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:57.516124 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3403fe10-44cc-4371-a776-292e45b4e7ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:57.524395 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3403fe10-44cc-4371-a776-292e45b4e7ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:57.525444 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3403fe10-44cc-4371-a776-292e45b4e7ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:57.526230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3403fe10-44cc-4371-a776-292e45b4e7ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:57.526746 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3403fe10-44cc-4371-a776-292e45b4e7ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:57.581240 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3403fe10-44cc-4371-a776-292e45b4e7ec tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5/action" status: 200 len: 24568 microversion: 2.1 time: 0.073007 Jul 20 05:24:57.581898 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3688/7395] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:24:57 2022] POST /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5/action => generated 24568 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:25:08.595056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-59629df3-26b3-4f5c-b71a-d2364feba5fc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:08.595645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-59629df3-26b3-4f5c-b71a-d2364feba5fc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:08.597922 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:08.598660 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=32 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:08.605339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59629df3-26b3-4f5c-b71a-d2364feba5fc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:08.605802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59629df3-26b3-4f5c-b71a-d2364feba5fc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:08.606608 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59629df3-26b3-4f5c-b71a-d2364feba5fc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:08.607074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-59629df3-26b3-4f5c-b71a-d2364feba5fc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:08.631350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-59629df3-26b3-4f5c-b71a-d2364feba5fc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lazy-loading 'flavor' on Instance uuid d07d3220-53e1-401d-9068-050de73f08d5 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:25:08.697916 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-59629df3-26b3-4f5c-b71a-d2364feba5fc tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5/action" status: 202 len: 0 microversion: 2.1 time: 0.106493 Jul 20 05:25:08.698607 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3708/7396] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:25:08 2022] POST /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:25:08.707624 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e5c05162-6ebf-42f3-a3ff-b9e23735400c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:08.709026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e5c05162-6ebf-42f3-a3ff-b9e23735400c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:08.711678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:08.713071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:08.719800 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5c05162-6ebf-42f3-a3ff-b9e23735400c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:08.720295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5c05162-6ebf-42f3-a3ff-b9e23735400c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:08.721120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5c05162-6ebf-42f3-a3ff-b9e23735400c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:08.721585 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e5c05162-6ebf-42f3-a3ff-b9e23735400c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:08.860137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e5c05162-6ebf-42f3-a3ff-b9e23735400c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:08.868770 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e5c05162-6ebf-42f3-a3ff-b9e23735400c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1688 microversion: 2.1 time: 0.165175 Jul 20 05:25:08.869340 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3689/7397] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:08 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:09.888160 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2a719386-54b3-484f-b0fd-a1ff1e2e3f3c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:09.888897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2a719386-54b3-484f-b0fd-a1ff1e2e3f3c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:09.895270 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a719386-54b3-484f-b0fd-a1ff1e2e3f3c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:09.895733 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a719386-54b3-484f-b0fd-a1ff1e2e3f3c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:09.896535 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a719386-54b3-484f-b0fd-a1ff1e2e3f3c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:09.896985 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2a719386-54b3-484f-b0fd-a1ff1e2e3f3c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:10.044748 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2a719386-54b3-484f-b0fd-a1ff1e2e3f3c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:10.053006 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2a719386-54b3-484f-b0fd-a1ff1e2e3f3c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1671 microversion: 2.1 time: 0.170420 Jul 20 05:25:10.053612 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3709/7398] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:09 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:11.148116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3c6be7c0-55d9-4dab-84aa-8d87ec9c104a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:11.149062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3c6be7c0-55d9-4dab-84aa-8d87ec9c104a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:11.157045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c6be7c0-55d9-4dab-84aa-8d87ec9c104a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.157518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c6be7c0-55d9-4dab-84aa-8d87ec9c104a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.158329 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c6be7c0-55d9-4dab-84aa-8d87ec9c104a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.158793 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3c6be7c0-55d9-4dab-84aa-8d87ec9c104a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.207509 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3c6be7c0-55d9-4dab-84aa-8d87ec9c104a tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5/action" status: 200 len: 38364 microversion: 2.1 time: 0.063179 Jul 20 05:25:11.208141 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3690/7399] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:25:11 2022] POST /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5/action => generated 38364 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:25:11.219665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4efe0660-69ec-40cf-ab34-4dc10a5d4332 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:11.220219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4efe0660-69ec-40cf-ab34-4dc10a5d4332 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:11.227195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4efe0660-69ec-40cf-ab34-4dc10a5d4332 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.227663 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4efe0660-69ec-40cf-ab34-4dc10a5d4332 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.228441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4efe0660-69ec-40cf-ab34-4dc10a5d4332 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.228896 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4efe0660-69ec-40cf-ab34-4dc10a5d4332 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.297746 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4efe0660-69ec-40cf-ab34-4dc10a5d4332 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5/action" status: 202 len: 0 microversion: 2.1 time: 0.081802 Jul 20 05:25:11.298743 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3710/7400] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:25:11 2022] POST /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:25:11.307922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a45c79f1-3579-47a2-a6f6-51a595f0edae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:11.308653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a45c79f1-3579-47a2-a6f6-51a595f0edae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:11.316337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a45c79f1-3579-47a2-a6f6-51a595f0edae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.316855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a45c79f1-3579-47a2-a6f6-51a595f0edae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.317665 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a45c79f1-3579-47a2-a6f6-51a595f0edae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.318128 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a45c79f1-3579-47a2-a6f6-51a595f0edae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.458751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a45c79f1-3579-47a2-a6f6-51a595f0edae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:11.466782 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a45c79f1-3579-47a2-a6f6-51a595f0edae tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1677 microversion: 2.1 time: 0.163795 Jul 20 05:25:11.467365 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3691/7401] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:11 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:12.484964 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-444b3995-5815-4584-a0f0-9fe8b1c87312 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:12.485664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-444b3995-5815-4584-a0f0-9fe8b1c87312 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:12.493235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-444b3995-5815-4584-a0f0-9fe8b1c87312 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:12.494239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-444b3995-5815-4584-a0f0-9fe8b1c87312 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:12.495031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-444b3995-5815-4584-a0f0-9fe8b1c87312 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:12.495469 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-444b3995-5815-4584-a0f0-9fe8b1c87312 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:12.638191 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-444b3995-5815-4584-a0f0-9fe8b1c87312 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:12.646123 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-444b3995-5815-4584-a0f0-9fe8b1c87312 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1677 microversion: 2.1 time: 0.165314 Jul 20 05:25:12.646952 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3711/7402] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:12 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:13.664289 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0cb6a8ee-af53-41e1-b62c-95eda2b39f2b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:13.665795 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0cb6a8ee-af53-41e1-b62c-95eda2b39f2b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:13.673424 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cb6a8ee-af53-41e1-b62c-95eda2b39f2b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:13.673902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cb6a8ee-af53-41e1-b62c-95eda2b39f2b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:13.674721 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cb6a8ee-af53-41e1-b62c-95eda2b39f2b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:13.675184 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0cb6a8ee-af53-41e1-b62c-95eda2b39f2b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:13.806773 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0cb6a8ee-af53-41e1-b62c-95eda2b39f2b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:13.814301 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0cb6a8ee-af53-41e1-b62c-95eda2b39f2b tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1680 microversion: 2.1 time: 0.154211 Jul 20 05:25:13.814878 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3692/7403] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:13 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:13.906337 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-17fd3fe6-391f-425f-88fa-c03e3cfb244f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:13.907313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-17fd3fe6-391f-425f-88fa-c03e3cfb244f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:13.914356 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17fd3fe6-391f-425f-88fa-c03e3cfb244f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:13.915463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17fd3fe6-391f-425f-88fa-c03e3cfb244f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:13.916289 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17fd3fe6-391f-425f-88fa-c03e3cfb244f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:13.916739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-17fd3fe6-391f-425f-88fa-c03e3cfb244f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:13.956301 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-17fd3fe6-391f-425f-88fa-c03e3cfb244f tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "POST /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5/action" status: 200 len: 38364 microversion: 2.1 time: 0.053730 Jul 20 05:25:13.957947 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3712/7404] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:25:13 2022] POST /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5/action => generated 38364 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:25:14.944979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-76901578-d27e-4d6d-9c94-55c357c3a52c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:14.946088 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-76901578-d27e-4d6d-9c94-55c357c3a52c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:14.948307 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8f08c4cc-c30d-4546-80e4-815bbdc6931d req-efd61845-58f9-41f0-ad49-73436e859bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07d3220-53e1-401d-9068-050de73f08d5", "tag": "06198a82-699d-4bca-8f03-d5e86fd0a917"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:14.955352 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76901578-d27e-4d6d-9c94-55c357c3a52c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:14.956290 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76901578-d27e-4d6d-9c94-55c357c3a52c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:14.958664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76901578-d27e-4d6d-9c94-55c357c3a52c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:14.959195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8f08c4cc-c30d-4546-80e4-815bbdc6931d req-efd61845-58f9-41f0-ad49-73436e859bf1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:14.959502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-76901578-d27e-4d6d-9c94-55c357c3a52c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:14.959854 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8f08c4cc-c30d-4546-80e4-815bbdc6931d req-efd61845-58f9-41f0-ad49-73436e859bf1 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:14.973846 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8f08c4cc-c30d-4546-80e4-815bbdc6931d req-efd61845-58f9-41f0-ad49-73436e859bf1 service nova] Creating event network-changed:06198a82-699d-4bca-8f03-d5e86fd0a917 for instance d07d3220-53e1-401d-9068-050de73f08d5 on n-h2-760456-11 Jul 20 05:25:14.983786 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8f08c4cc-c30d-4546-80e4-815bbdc6931d req-efd61845-58f9-41f0-ad49-73436e859bf1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040676 Jul 20 05:25:14.984403 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3713/7405] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:25:14.996292 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-76901578-d27e-4d6d-9c94-55c357c3a52c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:25:15.101745 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-76901578-d27e-4d6d-9c94-55c357c3a52c tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 204 len: 0 microversion: 2.1 time: 0.162182 Jul 20 05:25:15.108330 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3693/7406] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:25:14 2022] DELETE /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:25:15.115616 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-13f2c408-e97f-4b60-bdef-e773e33b9175 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:15.116835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-13f2c408-e97f-4b60-bdef-e773e33b9175 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:15.132634 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13f2c408-e97f-4b60-bdef-e773e33b9175 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:15.133101 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13f2c408-e97f-4b60-bdef-e773e33b9175 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:15.134207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13f2c408-e97f-4b60-bdef-e773e33b9175 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:15.147133 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-13f2c408-e97f-4b60-bdef-e773e33b9175 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:15.345553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-13f2c408-e97f-4b60-bdef-e773e33b9175 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:15.356551 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-13f2c408-e97f-4b60-bdef-e773e33b9175 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1686 microversion: 2.1 time: 0.246464 Jul 20 05:25:15.358739 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3714/7407] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:15 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1686 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:16.375968 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2804ad2f-5032-4e97-a9ce-afbef82a1143 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:16.376694 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2804ad2f-5032-4e97-a9ce-afbef82a1143 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:16.383752 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2804ad2f-5032-4e97-a9ce-afbef82a1143 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:16.384167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2804ad2f-5032-4e97-a9ce-afbef82a1143 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:16.385473 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2804ad2f-5032-4e97-a9ce-afbef82a1143 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:16.385931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2804ad2f-5032-4e97-a9ce-afbef82a1143 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:16.524825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2804ad2f-5032-4e97-a9ce-afbef82a1143 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:16.533987 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2804ad2f-5032-4e97-a9ce-afbef82a1143 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1686 microversion: 2.1 time: 0.162215 Jul 20 05:25:16.534759 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3694/7408] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:16 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:17.433119 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-a385a5e5-5ab9-44f5-a371-4345d9bacf4a req-0e6d33e7-00ff-4149-969d-37c7f1980d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07d3220-53e1-401d-9068-050de73f08d5", "name": "network-vif-deleted", "tag": "06198a82-699d-4bca-8f03-d5e86fd0a917"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:17.444497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a385a5e5-5ab9-44f5-a371-4345d9bacf4a req-0e6d33e7-00ff-4149-969d-37c7f1980d5c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:17.444951 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-a385a5e5-5ab9-44f5-a371-4345d9bacf4a req-0e6d33e7-00ff-4149-969d-37c7f1980d5c service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:17.458896 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-a385a5e5-5ab9-44f5-a371-4345d9bacf4a req-0e6d33e7-00ff-4149-969d-37c7f1980d5c service nova] Creating event network-vif-deleted:06198a82-699d-4bca-8f03-d5e86fd0a917 for instance d07d3220-53e1-401d-9068-050de73f08d5 on n-h2-760456-11 Jul 20 05:25:17.464538 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-a385a5e5-5ab9-44f5-a371-4345d9bacf4a req-0e6d33e7-00ff-4149-969d-37c7f1980d5c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036910 Jul 20 05:25:17.465155 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3715/7409] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:17.557839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:17.558522 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:17.565703 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:17.566173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:17.567003 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:17.567459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:17.601447 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:17.601919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:17.602413 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lazy-loading 'fault' on Instance uuid d07d3220-53e1-401d-9068-050de73f08d5 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:25:17.644786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce2ee1efa04a06806daec00f2dea0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd78539b9cf4df8874c9562bef52b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:17.652357 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2f463fcb-1f1b-4a65-95e3-46e549b55afe tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 200 len: 1356 microversion: 2.1 time: 0.099279 Jul 20 05:25:17.652941 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3695/7410] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:17 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:18.670482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-467423ad-ae98-44cc-b656-bba640b69511 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:18.671200 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-467423ad-ae98-44cc-b656-bba640b69511 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] [instance: d07d3220-53e1-401d-9068-050de73f08d5] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:18.678526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-467423ad-ae98-44cc-b656-bba640b69511 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:18.678992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-467423ad-ae98-44cc-b656-bba640b69511 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:18.679776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-467423ad-ae98-44cc-b656-bba640b69511 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:18.680225 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-467423ad-ae98-44cc-b656-bba640b69511 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:18.694625 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-467423ad-ae98-44cc-b656-bba640b69511 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] HTTP exception thrown: Instance d07d3220-53e1-401d-9068-050de73f08d5 could not be found. Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-467423ad-ae98-44cc-b656-bba640b69511 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Request method failure captured: Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 HTTP/1.1 Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi15AA32MdWGcsRKaegS9wCO7BQHCiBClAHs8Yj7W55ghdKLBdFaoEB0VWdUPDzVnnjmtcoweYy1DbFe8xTKqrn31fS7Ei4EM2dAu-nEmvlKhj2nHYdoMCGwfnui78t-amakQizCUO4R9Mqw4cezwzBJRYmq1_pk4SMpNM8U4Yv_ZgzeU Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 7dd78539b9cf4df8874c9562bef52b8c Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7dd78539b9cf4df8874c9562bef52b8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 7dd78539b9cf4df8874c9562bef52b8c Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1617251458 Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestNetworkAdvancedServerOps-1617251458-project Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 94ce2ee1efa04a06806daec00f2dea0c Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1617251458-project Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance d07d3220-53e1-401d-9068-050de73f08d5 could not be found. Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'd07d3220-53e1-401d-9068-050de73f08d5'} Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d07d3220-53e1-401d-9068-050de73f08d5 could not be found. Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d07d3220-53e1-401d-9068-050de73f08d5 could not be found. Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:25:18.696595 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d07d3220-53e1-401d-9068-050de73f08d5 could not be found. Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-467423ad-ae98-44cc-b656-bba640b69511 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Returning 404 to user: Instance d07d3220-53e1-401d-9068-050de73f08d5 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-467423ad-ae98-44cc-b656-bba640b69511 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5" status: 404 len: 111 microversion: 2.1 time: 0.033177 Jul 20 05:25:18.702150 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3716/7411] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:18 2022] GET /compute/v2.1/servers/d07d3220-53e1-401d-9068-050de73f08d5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:25:22.156262 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-30f17ce7-59f9-4269-aa02-6ae56bb5b471 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] Calling method '.version_select at 0x7fb8412ea820>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:22.177146 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-30f17ce7-59f9-4269-aa02-6ae56bb5b471 tempest-TestNetworkAdvancedServerOps-1617251458 tempest-TestNetworkAdvancedServerOps-1617251458-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-907736922" status: 202 len: 0 microversion: 2.1 time: 0.025246 Jul 20 05:25:22.177869 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3696/7412] 10.222.0.59 () {58 vars in 1280 bytes} [Wed Jul 20 05:25:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-907736922 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:25:33.136996 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=18 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:33.137977 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:33.350408 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a49e15cb-57d1-4efc-8b31-8bb4e0fa16bc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Action: 'create', calling method: .version_select at 0x7fb840fc8160>, body: {"keypair": {"name": "tempest-TestShelveInstance-184980118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATpxHS304SWQSgobvbrNkLqZlQJAZjdA7CVMkOMc2ijfKfEdn3pQNZp6gZaBNlQ7OvnM+hlsAOFW4tXX/JXNgC7SI43zjqBteqXuYwHqR0ZV6YYwCsiOrGoVGaNmTQoWw=="}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:33.365912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-a49e15cb-57d1-4efc-8b31-8bb4e0fa16bc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Getting quotas for project 11f6aabed5c94415ad006ffbcc434497. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:25:33.373135 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-a49e15cb-57d1-4efc-8b31-8bb4e0fa16bc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Getting quotas for user b0839820df2e469fbfafa017a9a71d5f and project 11f6aabed5c94415ad006ffbcc434497. Resources: {'key_pairs'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:25:33.403279 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a49e15cb-57d1-4efc-8b31-8bb4e0fa16bc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.272559 Jul 20 05:25:33.406859 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3717/7413] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:25:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:34.495882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-249351153", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-184980118", "security_groups": [{"name": "tempest-secgroup-smoke-1925785001"}], "networks": [{"uuid": "072b57fc-1b2f-41cf-ad2f-9f27f548fd2b"}]}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:34.503882 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:34.504649 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:34.613550 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.network.neutron [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] validate_networks() for [('072b57fc-1b2f-41cf-ad2f-9f27f548fd2b', None, None, None, None, None)] {{(pid=119605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:25:35.029556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Flavor limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:25:35.029994 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Image limits 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:25:35.030512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Flavor pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:25:35.030934 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Image pref 0:0:0 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:25:35.031359 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.virt.hardware [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:25:35.040820 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:35.041954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:35.042837 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:35.043335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:35.061312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Getting quotas for project 11f6aabed5c94415ad006ffbcc434497. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:25:35.066783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Getting quotas for user b0839820df2e469fbfafa017a9a71d5f and project 11f6aabed5c94415ad006ffbcc434497. Resources: {'instances', 'cores', 'ram'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:25:35.080193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Going to run 1 instances... {{(pid=119605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:25:35.082551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:25:35.132209 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a7d65b4d-8c35-4ac7-b32a-a112241a159b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.641277 Jul 20 05:25:35.132873 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3697/7414] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:25:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:25:35.143865 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4cc832f6-e731-46f8-a4a2-7211a1f1a13f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:35.144497 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4cc832f6-e731-46f8-a4a2-7211a1f1a13f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:35.309298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4cc832f6-e731-46f8-a4a2-7211a1f1a13f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:35.316221 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4cc832f6-e731-46f8-a4a2-7211a1f1a13f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1245 microversion: 2.1 time: 0.177258 Jul 20 05:25:35.316795 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3718/7415] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:35 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1245 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:36.334670 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e4983a1b-02dd-4d58-b0ae-ce4d6b9faf05 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:36.335322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e4983a1b-02dd-4d58-b0ae-ce4d6b9faf05 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:36.451062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e4983a1b-02dd-4d58-b0ae-ce4d6b9faf05 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:36.457862 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e4983a1b-02dd-4d58-b0ae-ce4d6b9faf05 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1245 microversion: 2.1 time: 0.128876 Jul 20 05:25:36.458498 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3698/7416] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:36 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1245 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:37.475147 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1d16c5dd-208c-42bf-9474-20368afef457 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:37.476077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1d16c5dd-208c-42bf-9474-20368afef457 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:37.551503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1d16c5dd-208c-42bf-9474-20368afef457 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:37.559008 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1d16c5dd-208c-42bf-9474-20368afef457 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1245 microversion: 2.1 time: 0.087720 Jul 20 05:25:37.559771 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3719/7417] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:37 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:38.576566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c5d6a7b0-01c4-4d09-9760-62c841c77e0c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:38.577734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c5d6a7b0-01c4-4d09-9760-62c841c77e0c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:38.643911 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c5d6a7b0-01c4-4d09-9760-62c841c77e0c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:38.652327 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c5d6a7b0-01c4-4d09-9760-62c841c77e0c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1245 microversion: 2.1 time: 0.079681 Jul 20 05:25:38.663732 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3699/7418] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:38 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:39.669939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-67db6b99-d1f7-496c-8c3f-e0a220101d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:39.670605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-67db6b99-d1f7-496c-8c3f-e0a220101d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:39.677635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67db6b99-d1f7-496c-8c3f-e0a220101d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:39.678096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67db6b99-d1f7-496c-8c3f-e0a220101d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:39.678897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67db6b99-d1f7-496c-8c3f-e0a220101d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:39.679347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-67db6b99-d1f7-496c-8c3f-e0a220101d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:39.745280 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-67db6b99-d1f7-496c-8c3f-e0a220101d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:39.752924 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-67db6b99-d1f7-496c-8c3f-e0a220101d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1249 microversion: 2.1 time: 0.087847 Jul 20 05:25:39.753578 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3720/7419] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:39 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:40.770466 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4db18c85-fa02-4777-a308-e3014a22d49d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:40.771307 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4db18c85-fa02-4777-a308-e3014a22d49d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:40.779173 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4db18c85-fa02-4777-a308-e3014a22d49d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:40.779654 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4db18c85-fa02-4777-a308-e3014a22d49d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:40.780456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4db18c85-fa02-4777-a308-e3014a22d49d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:40.780918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4db18c85-fa02-4777-a308-e3014a22d49d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:40.853007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4db18c85-fa02-4777-a308-e3014a22d49d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:40.860945 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4db18c85-fa02-4777-a308-e3014a22d49d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1303 microversion: 2.1 time: 0.094305 Jul 20 05:25:40.861545 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3700/7420] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:40 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:41.670315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-814e785c-efae-4bef-b160-818970a0bc87 req-22715edb-f5ca-4544-b0d7-d973778dab4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b2fbf6-0907-4d31-96ba-c2490aadd6f8", "tag": "3a1e4c2a-79b4-47d8-9309-10c80ca92037"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:41.681130 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-814e785c-efae-4bef-b160-818970a0bc87 req-22715edb-f5ca-4544-b0d7-d973778dab4b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:41.681588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-814e785c-efae-4bef-b160-818970a0bc87 req-22715edb-f5ca-4544-b0d7-d973778dab4b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:41.698846 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-814e785c-efae-4bef-b160-818970a0bc87 req-22715edb-f5ca-4544-b0d7-d973778dab4b service nova] Creating event network-changed:3a1e4c2a-79b4-47d8-9309-10c80ca92037 for instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 on n-h2-760456-11 Jul 20 05:25:41.706183 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-814e785c-efae-4bef-b160-818970a0bc87 req-22715edb-f5ca-4544-b0d7-d973778dab4b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041147 Jul 20 05:25:41.707038 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3721/7421] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:41.878736 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9db2a0c6-6fae-415c-9398-8cf4ef95cb89 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:41.879411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9db2a0c6-6fae-415c-9398-8cf4ef95cb89 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:41.886142 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9db2a0c6-6fae-415c-9398-8cf4ef95cb89 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:41.887231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9db2a0c6-6fae-415c-9398-8cf4ef95cb89 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:41.888726 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9db2a0c6-6fae-415c-9398-8cf4ef95cb89 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:41.889249 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9db2a0c6-6fae-415c-9398-8cf4ef95cb89 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:42.104000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9db2a0c6-6fae-415c-9398-8cf4ef95cb89 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:42.111980 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9db2a0c6-6fae-415c-9398-8cf4ef95cb89 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1371 microversion: 2.1 time: 0.237406 Jul 20 05:25:42.112608 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3701/7422] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:41 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:43.130544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4c10aafb-984e-472b-8d68-1789ba924420 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:43.131259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4c10aafb-984e-472b-8d68-1789ba924420 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:43.139802 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c10aafb-984e-472b-8d68-1789ba924420 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:43.140268 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c10aafb-984e-472b-8d68-1789ba924420 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:43.141063 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c10aafb-984e-472b-8d68-1789ba924420 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:43.141507 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4c10aafb-984e-472b-8d68-1789ba924420 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:43.287612 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4c10aafb-984e-472b-8d68-1789ba924420 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:43.295694 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4c10aafb-984e-472b-8d68-1789ba924420 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1371 microversion: 2.1 time: 0.169271 Jul 20 05:25:43.296296 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3722/7423] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:43 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:44.312915 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa57e7c1-2e39-4ad7-920c-1cc34f9a0145 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:44.313465 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aa57e7c1-2e39-4ad7-920c-1cc34f9a0145 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:44.320480 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa57e7c1-2e39-4ad7-920c-1cc34f9a0145 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:44.320945 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa57e7c1-2e39-4ad7-920c-1cc34f9a0145 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:44.321718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa57e7c1-2e39-4ad7-920c-1cc34f9a0145 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:44.322171 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa57e7c1-2e39-4ad7-920c-1cc34f9a0145 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:44.453723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aa57e7c1-2e39-4ad7-920c-1cc34f9a0145 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:44.461425 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aa57e7c1-2e39-4ad7-920c-1cc34f9a0145 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1371 microversion: 2.1 time: 0.152524 Jul 20 05:25:44.462009 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3702/7424] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:44 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:45.479701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-827b0970-85fe-46df-98b1-009374b43de4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:45.480852 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-827b0970-85fe-46df-98b1-009374b43de4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:45.487870 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-827b0970-85fe-46df-98b1-009374b43de4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:45.488340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-827b0970-85fe-46df-98b1-009374b43de4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:45.489120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-827b0970-85fe-46df-98b1-009374b43de4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:45.489576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-827b0970-85fe-46df-98b1-009374b43de4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:45.631012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-827b0970-85fe-46df-98b1-009374b43de4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:45.639268 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-827b0970-85fe-46df-98b1-009374b43de4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1371 microversion: 2.1 time: 0.163510 Jul 20 05:25:45.639844 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3723/7425] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:45 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:46.656563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-759b8860-2412-4afd-ae03-191bb48be455 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:46.657299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-759b8860-2412-4afd-ae03-191bb48be455 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:46.659299 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:46.665734 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-759b8860-2412-4afd-ae03-191bb48be455 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:46.666201 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-759b8860-2412-4afd-ae03-191bb48be455 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:46.667013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-759b8860-2412-4afd-ae03-191bb48be455 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:46.667464 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-759b8860-2412-4afd-ae03-191bb48be455 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:46.792560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-e8db747d-688c-43b7-a44a-905a2b9e9aaf req-da07f1b8-ca94-439e-b2a7-f28ec6aa7d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b2fbf6-0907-4d31-96ba-c2490aadd6f8", "name": "network-vif-plugged", "status": "completed", "tag": "3a1e4c2a-79b4-47d8-9309-10c80ca92037"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:46.802059 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e8db747d-688c-43b7-a44a-905a2b9e9aaf req-da07f1b8-ca94-439e-b2a7-f28ec6aa7d82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:46.802514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-e8db747d-688c-43b7-a44a-905a2b9e9aaf req-da07f1b8-ca94-439e-b2a7-f28ec6aa7d82 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:46.805257 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-759b8860-2412-4afd-ae03-191bb48be455 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:46.814008 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-759b8860-2412-4afd-ae03-191bb48be455 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1371 microversion: 2.1 time: 0.161632 Jul 20 05:25:46.814945 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3703/7426] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:46 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:46.815760 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-e8db747d-688c-43b7-a44a-905a2b9e9aaf req-da07f1b8-ca94-439e-b2a7-f28ec6aa7d82 service nova] Creating event network-vif-plugged:3a1e4c2a-79b4-47d8-9309-10c80ca92037 for instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 on n-h2-760456-11 Jul 20 05:25:46.821332 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-e8db747d-688c-43b7-a44a-905a2b9e9aaf req-da07f1b8-ca94-439e-b2a7-f28ec6aa7d82 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032642 Jul 20 05:25:46.822391 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3724/7427] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:25:47.831976 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-aa1f2338-e2f6-450a-82c4-11ee6376acdb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:47.832606 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-aa1f2338-e2f6-450a-82c4-11ee6376acdb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:47.839608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa1f2338-e2f6-450a-82c4-11ee6376acdb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:47.840069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa1f2338-e2f6-450a-82c4-11ee6376acdb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:47.840843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa1f2338-e2f6-450a-82c4-11ee6376acdb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:47.842064 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-aa1f2338-e2f6-450a-82c4-11ee6376acdb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:47.979880 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-aa1f2338-e2f6-450a-82c4-11ee6376acdb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:47.990457 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-aa1f2338-e2f6-450a-82c4-11ee6376acdb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1371 microversion: 2.1 time: 0.162144 Jul 20 05:25:47.991075 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3704/7428] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:47 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:49.009335 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-90946f03-f7ae-4384-9d59-a6d478797604 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:49.010041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-90946f03-f7ae-4384-9d59-a6d478797604 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:49.012194 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:49.018415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90946f03-f7ae-4384-9d59-a6d478797604 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:49.018876 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90946f03-f7ae-4384-9d59-a6d478797604 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:49.019658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90946f03-f7ae-4384-9d59-a6d478797604 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:49.020105 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-90946f03-f7ae-4384-9d59-a6d478797604 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:49.158482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-90946f03-f7ae-4384-9d59-a6d478797604 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:49.166041 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-90946f03-f7ae-4384-9d59-a6d478797604 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1554 microversion: 2.1 time: 0.161237 Jul 20 05:25:49.166724 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3725/7429] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:49 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:49.187857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-47aac024-cba0-4fd5-9635-34f827cdff3d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:49.188500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-47aac024-cba0-4fd5-9635-34f827cdff3d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:49.190370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=10 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:49.196724 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47aac024-cba0-4fd5-9635-34f827cdff3d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:49.197190 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47aac024-cba0-4fd5-9635-34f827cdff3d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:49.197996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47aac024-cba0-4fd5-9635-34f827cdff3d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:49.198475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47aac024-cba0-4fd5-9635-34f827cdff3d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:49.333266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-47aac024-cba0-4fd5-9635-34f827cdff3d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:49.340898 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-47aac024-cba0-4fd5-9635-34f827cdff3d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1554 microversion: 2.1 time: 0.156971 Jul 20 05:25:49.342088 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3705/7430] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:49 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:50.989308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-86a39c61-4d82-4834-9319-8eaa1da62968 req-26384c59-7edb-4e4d-ac2a-8147c79ed8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b2fbf6-0907-4d31-96ba-c2490aadd6f8", "tag": "3a1e4c2a-79b4-47d8-9309-10c80ca92037"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:50.999077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-86a39c61-4d82-4834-9319-8eaa1da62968 req-26384c59-7edb-4e4d-ac2a-8147c79ed8eb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:50.999526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-86a39c61-4d82-4834-9319-8eaa1da62968 req-26384c59-7edb-4e4d-ac2a-8147c79ed8eb service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:51.010699 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-86a39c61-4d82-4834-9319-8eaa1da62968 req-26384c59-7edb-4e4d-ac2a-8147c79ed8eb service nova] Creating event network-changed:3a1e4c2a-79b4-47d8-9309-10c80ca92037 for instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 on n-h2-760456-11 Jul 20 05:25:51.015831 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-86a39c61-4d82-4834-9319-8eaa1da62968 req-26384c59-7edb-4e4d-ac2a-8147c79ed8eb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030208 Jul 20 05:25:51.016429 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3726/7431] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:27:43.860840 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:27:43.861585 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:27:48.505601 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec14a2d6-59f0-443f-9e2b-92ddf2d0a5cf] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:27:48.506556 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac98bfe5-b186-469e-8e5c-23ebe79e6c0b] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:27:48.507349 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:48.508278 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=38 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:48.512742 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e388b769-9e14-4236-a754-eac857f12cfc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:48.513296 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e388b769-9e14-4236-a754-eac857f12cfc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:48.520322 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e388b769-9e14-4236-a754-eac857f12cfc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:48.520790 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e388b769-9e14-4236-a754-eac857f12cfc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:48.521569 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e388b769-9e14-4236-a754-eac857f12cfc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:48.522021 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e388b769-9e14-4236-a754-eac857f12cfc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:48.546648 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-e388b769-9e14-4236-a754-eac857f12cfc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lazy-loading 'flavor' on Instance uuid 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:27:48.804778 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e388b769-9e14-4236-a754-eac857f12cfc tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "POST /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8/action" status: 202 len: 0 microversion: 2.1 time: 0.300866 Jul 20 05:27:48.805409 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3706/7432] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:27:48 2022] POST /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:27:48.812362 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33eca72a-4e3b-4f88-b8f7-6f5bf76f74ec] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:27:48.813176 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0d612395-2abe-406a-94ab-07f31ffa6d77] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:27:48.813791 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:48.814561 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=30 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:48.818916 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-dabf9ca3-7821-4132-8efd-9aea51a61832 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:48.819621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-dabf9ca3-7821-4132-8efd-9aea51a61832 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:48.828813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dabf9ca3-7821-4132-8efd-9aea51a61832 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:48.829263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dabf9ca3-7821-4132-8efd-9aea51a61832 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:48.830043 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dabf9ca3-7821-4132-8efd-9aea51a61832 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:48.830511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-dabf9ca3-7821-4132-8efd-9aea51a61832 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:48.970926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-dabf9ca3-7821-4132-8efd-9aea51a61832 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:48.978568 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-dabf9ca3-7821-4132-8efd-9aea51a61832 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.168010 Jul 20 05:27:48.979174 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3727/7433] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:48 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:50.000154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1eff0b9a-c8c4-4355-8fad-0e53dde0d308 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:50.000802 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1eff0b9a-c8c4-4355-8fad-0e53dde0d308 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:50.010141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eff0b9a-c8c4-4355-8fad-0e53dde0d308 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:50.010643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eff0b9a-c8c4-4355-8fad-0e53dde0d308 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:50.011523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eff0b9a-c8c4-4355-8fad-0e53dde0d308 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:50.011980 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1eff0b9a-c8c4-4355-8fad-0e53dde0d308 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:50.016004 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec14a2d6-59f0-443f-9e2b-92ddf2d0a5cf] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50612. Jul 20 05:27:50.016722 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac98bfe5-b186-469e-8e5c-23ebe79e6c0b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50614. Jul 20 05:27:50.149031 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-1eff0b9a-c8c4-4355-8fad-0e53dde0d308 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:50.156861 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1eff0b9a-c8c4-4355-8fad-0e53dde0d308 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.163089 Jul 20 05:27:50.157432 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3707/7434] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:49 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:51.174272 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-127f1ce1-9df0-43f1-8d70-a2670abf26c5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:51.174925 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-127f1ce1-9df0-43f1-8d70-a2670abf26c5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:51.187900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-127f1ce1-9df0-43f1-8d70-a2670abf26c5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:51.188362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-127f1ce1-9df0-43f1-8d70-a2670abf26c5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:51.189155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-127f1ce1-9df0-43f1-8d70-a2670abf26c5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:51.189604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-127f1ce1-9df0-43f1-8d70-a2670abf26c5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:51.197315 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] [0d612395-2abe-406a-94ab-07f31ffa6d77] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50620. Jul 20 05:27:51.209615 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] [33eca72a-4e3b-4f88-b8f7-6f5bf76f74ec] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50618. Jul 20 05:27:51.335719 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-127f1ce1-9df0-43f1-8d70-a2670abf26c5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:51.343608 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-127f1ce1-9df0-43f1-8d70-a2670abf26c5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.173279 Jul 20 05:27:51.344184 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3728/7435] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:51 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:52.360405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-964aad4e-45d6-49a9-8c76-ca86ce8279b6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:52.361025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-964aad4e-45d6-49a9-8c76-ca86ce8279b6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:52.368388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-964aad4e-45d6-49a9-8c76-ca86ce8279b6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:52.368858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-964aad4e-45d6-49a9-8c76-ca86ce8279b6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:52.369640 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-964aad4e-45d6-49a9-8c76-ca86ce8279b6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:52.370094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-964aad4e-45d6-49a9-8c76-ca86ce8279b6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:52.502091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-964aad4e-45d6-49a9-8c76-ca86ce8279b6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:52.509697 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-964aad4e-45d6-49a9-8c76-ca86ce8279b6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.153298 Jul 20 05:27:52.510290 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3708/7436] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:52 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:53.527832 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-673edc99-d683-4736-9f9e-31004a8ed890 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:53.528460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-673edc99-d683-4736-9f9e-31004a8ed890 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:53.535407 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-673edc99-d683-4736-9f9e-31004a8ed890 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:53.535860 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-673edc99-d683-4736-9f9e-31004a8ed890 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:53.536623 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-673edc99-d683-4736-9f9e-31004a8ed890 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:53.537061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-673edc99-d683-4736-9f9e-31004a8ed890 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:53.674308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-673edc99-d683-4736-9f9e-31004a8ed890 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:53.681831 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-673edc99-d683-4736-9f9e-31004a8ed890 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.158668 Jul 20 05:27:53.682430 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3729/7437] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:53 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:54.701123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f42d597a-7668-4bb8-bc1a-54dae6f32df0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:54.701764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f42d597a-7668-4bb8-bc1a-54dae6f32df0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:54.708855 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f42d597a-7668-4bb8-bc1a-54dae6f32df0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:54.709326 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f42d597a-7668-4bb8-bc1a-54dae6f32df0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:54.710111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f42d597a-7668-4bb8-bc1a-54dae6f32df0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:54.710599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f42d597a-7668-4bb8-bc1a-54dae6f32df0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:54.848214 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f42d597a-7668-4bb8-bc1a-54dae6f32df0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:54.856008 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f42d597a-7668-4bb8-bc1a-54dae6f32df0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.159986 Jul 20 05:27:54.856599 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3709/7438] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:54 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:55.873777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-58825dc8-0009-4b53-9eea-2d82c3b96702 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:55.874427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-58825dc8-0009-4b53-9eea-2d82c3b96702 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:55.881326 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58825dc8-0009-4b53-9eea-2d82c3b96702 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:55.881784 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58825dc8-0009-4b53-9eea-2d82c3b96702 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:55.882591 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58825dc8-0009-4b53-9eea-2d82c3b96702 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:55.883039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58825dc8-0009-4b53-9eea-2d82c3b96702 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:56.016137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-58825dc8-0009-4b53-9eea-2d82c3b96702 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:56.023787 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-58825dc8-0009-4b53-9eea-2d82c3b96702 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.154040 Jul 20 05:27:56.024370 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3730/7439] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:55 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:57.041698 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0d71a8e0-c992-4675-996e-ac36d1165bad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:57.043007 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0d71a8e0-c992-4675-996e-ac36d1165bad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:57.050090 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d71a8e0-c992-4675-996e-ac36d1165bad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:57.050596 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d71a8e0-c992-4675-996e-ac36d1165bad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:57.051392 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d71a8e0-c992-4675-996e-ac36d1165bad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:57.051849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0d71a8e0-c992-4675-996e-ac36d1165bad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:57.182078 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0d71a8e0-c992-4675-996e-ac36d1165bad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:57.189827 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0d71a8e0-c992-4675-996e-ac36d1165bad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.152025 Jul 20 05:27:57.190432 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3710/7440] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:57 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:58.207276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d100d83-4999-47f2-ab1b-0b97241bfce2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:58.207898 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d100d83-4999-47f2-ab1b-0b97241bfce2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:58.214906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d100d83-4999-47f2-ab1b-0b97241bfce2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:58.215369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d100d83-4999-47f2-ab1b-0b97241bfce2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:58.216149 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d100d83-4999-47f2-ab1b-0b97241bfce2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:58.216611 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d100d83-4999-47f2-ab1b-0b97241bfce2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:58.351216 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d100d83-4999-47f2-ab1b-0b97241bfce2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:58.359662 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d100d83-4999-47f2-ab1b-0b97241bfce2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.156265 Jul 20 05:27:58.360246 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3731/7441] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:58 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:59.377630 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-715a3cc0-26a3-417f-9a43-6a064d1df619 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:59.378183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-715a3cc0-26a3-417f-9a43-6a064d1df619 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:59.385206 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-715a3cc0-26a3-417f-9a43-6a064d1df619 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:59.385676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-715a3cc0-26a3-417f-9a43-6a064d1df619 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:59.387236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-715a3cc0-26a3-417f-9a43-6a064d1df619 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:59.387702 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-715a3cc0-26a3-417f-9a43-6a064d1df619 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:59.524982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-715a3cc0-26a3-417f-9a43-6a064d1df619 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:59.533952 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-715a3cc0-26a3-417f-9a43-6a064d1df619 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1699 microversion: 2.1 time: 0.160293 Jul 20 05:27:59.534568 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3711/7442] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:59 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:00.550797 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-09c31695-24df-4e0d-90f7-b9d661e33f80 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:00.551411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-09c31695-24df-4e0d-90f7-b9d661e33f80 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:00.558475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09c31695-24df-4e0d-90f7-b9d661e33f80 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:00.558929 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09c31695-24df-4e0d-90f7-b9d661e33f80 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:00.559695 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09c31695-24df-4e0d-90f7-b9d661e33f80 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:00.560137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-09c31695-24df-4e0d-90f7-b9d661e33f80 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:00.692800 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-09c31695-24df-4e0d-90f7-b9d661e33f80 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:00.701813 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-09c31695-24df-4e0d-90f7-b9d661e33f80 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1699 microversion: 2.1 time: 0.154898 Jul 20 05:28:00.702554 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3732/7443] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:00 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:01.720541 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-27eb4c01-69c5-4e58-acf9-d68fa7a56c47 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:01.725917 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-27eb4c01-69c5-4e58-acf9-d68fa7a56c47 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:01.733864 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27eb4c01-69c5-4e58-acf9-d68fa7a56c47 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:01.734810 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27eb4c01-69c5-4e58-acf9-d68fa7a56c47 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:01.735809 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27eb4c01-69c5-4e58-acf9-d68fa7a56c47 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:01.736472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-27eb4c01-69c5-4e58-acf9-d68fa7a56c47 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:01.920993 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-27eb4c01-69c5-4e58-acf9-d68fa7a56c47 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:01.929305 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-27eb4c01-69c5-4e58-acf9-d68fa7a56c47 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1694 microversion: 2.1 time: 0.213232 Jul 20 05:28:01.930405 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3712/7444] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:01 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1694 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:02.947537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ac812dc6-a438-471d-b813-776cf131b257 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:02.948990 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ac812dc6-a438-471d-b813-776cf131b257 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:02.957536 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac812dc6-a438-471d-b813-776cf131b257 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:02.958363 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac812dc6-a438-471d-b813-776cf131b257 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:02.959239 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac812dc6-a438-471d-b813-776cf131b257 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:02.959763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ac812dc6-a438-471d-b813-776cf131b257 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:03.119619 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ac812dc6-a438-471d-b813-776cf131b257 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:03.129014 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ac812dc6-a438-471d-b813-776cf131b257 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1694 microversion: 2.1 time: 0.185020 Jul 20 05:28:03.129613 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3733/7445] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:02 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:03.653483 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2311b934-2284-41c0-adf3-6eea31603d52 req-92006c1e-52c0-423a-af5d-238ad1cf2e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b2fbf6-0907-4d31-96ba-c2490aadd6f8", "name": "network-vif-plugged", "status": "completed", "tag": "3a1e4c2a-79b4-47d8-9309-10c80ca92037"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:03.663669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2311b934-2284-41c0-adf3-6eea31603d52 req-92006c1e-52c0-423a-af5d-238ad1cf2e0a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:03.664137 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2311b934-2284-41c0-adf3-6eea31603d52 req-92006c1e-52c0-423a-af5d-238ad1cf2e0a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:03.676974 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2311b934-2284-41c0-adf3-6eea31603d52 req-92006c1e-52c0-423a-af5d-238ad1cf2e0a service nova] Creating event network-vif-plugged:3a1e4c2a-79b4-47d8-9309-10c80ca92037 for instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 on n-h2-760456-11 Jul 20 05:28:03.683138 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2311b934-2284-41c0-adf3-6eea31603d52 req-92006c1e-52c0-423a-af5d-238ad1cf2e0a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124914 Jul 20 05:28:03.683855 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3713/7446] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:28:04.146526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6b513693-cc34-4f3f-b69b-07a941097942 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:04.147259 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6b513693-cc34-4f3f-b69b-07a941097942 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:04.154399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b513693-cc34-4f3f-b69b-07a941097942 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:04.154855 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b513693-cc34-4f3f-b69b-07a941097942 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:04.155810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b513693-cc34-4f3f-b69b-07a941097942 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:04.156415 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6b513693-cc34-4f3f-b69b-07a941097942 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:04.307025 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6b513693-cc34-4f3f-b69b-07a941097942 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:04.315794 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6b513693-cc34-4f3f-b69b-07a941097942 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1694 microversion: 2.1 time: 0.173171 Jul 20 05:28:04.316382 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3734/7447] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:04 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:05.335033 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-43a23ae3-c04f-4538-b49e-6d3fc3754439 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:05.336391 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-43a23ae3-c04f-4538-b49e-6d3fc3754439 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:05.344788 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43a23ae3-c04f-4538-b49e-6d3fc3754439 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:05.345259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43a23ae3-c04f-4538-b49e-6d3fc3754439 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:05.346056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43a23ae3-c04f-4538-b49e-6d3fc3754439 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:05.348297 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-43a23ae3-c04f-4538-b49e-6d3fc3754439 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:05.488676 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-43a23ae3-c04f-4538-b49e-6d3fc3754439 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:05.498522 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-43a23ae3-c04f-4538-b49e-6d3fc3754439 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1694 microversion: 2.1 time: 0.167770 Jul 20 05:28:05.499364 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3714/7448] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:05 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:06.517595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b70a2c0b-8149-4e0e-9ce0-08e7f22f0d9a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:06.517595 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b70a2c0b-8149-4e0e-9ce0-08e7f22f0d9a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:06.524068 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b70a2c0b-8149-4e0e-9ce0-08e7f22f0d9a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:06.524527 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b70a2c0b-8149-4e0e-9ce0-08e7f22f0d9a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:06.525315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b70a2c0b-8149-4e0e-9ce0-08e7f22f0d9a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:06.525763 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b70a2c0b-8149-4e0e-9ce0-08e7f22f0d9a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:06.678983 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b70a2c0b-8149-4e0e-9ce0-08e7f22f0d9a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:06.687816 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b70a2c0b-8149-4e0e-9ce0-08e7f22f0d9a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1694 microversion: 2.1 time: 0.175303 Jul 20 05:28:06.688420 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3735/7449] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:06 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:07.707306 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-86bf2721-0a3f-4bb1-ac36-3d7086a5325a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:07.707961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-86bf2721-0a3f-4bb1-ac36-3d7086a5325a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:07.715412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86bf2721-0a3f-4bb1-ac36-3d7086a5325a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:07.715983 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86bf2721-0a3f-4bb1-ac36-3d7086a5325a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:07.716909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86bf2721-0a3f-4bb1-ac36-3d7086a5325a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:07.717459 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-86bf2721-0a3f-4bb1-ac36-3d7086a5325a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:07.868183 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-86bf2721-0a3f-4bb1-ac36-3d7086a5325a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:07.881109 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-86bf2721-0a3f-4bb1-ac36-3d7086a5325a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1694 microversion: 2.1 time: 0.179044 Jul 20 05:28:07.881871 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3715/7450] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:07 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:08.900836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4301ab2a-1a51-47ef-8c8e-51570b4dda98 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:08.901628 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4301ab2a-1a51-47ef-8c8e-51570b4dda98 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:08.909485 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4301ab2a-1a51-47ef-8c8e-51570b4dda98 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:08.909936 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4301ab2a-1a51-47ef-8c8e-51570b4dda98 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:08.910777 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4301ab2a-1a51-47ef-8c8e-51570b4dda98 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:08.911220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4301ab2a-1a51-47ef-8c8e-51570b4dda98 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:09.060833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4301ab2a-1a51-47ef-8c8e-51570b4dda98 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:09.071337 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4301ab2a-1a51-47ef-8c8e-51570b4dda98 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1694 microversion: 2.1 time: 0.174481 Jul 20 05:28:09.072110 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3736/7451] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:08 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:10.089777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-10c68ecb-9966-46f2-93c6-3eb0a5dad3a5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:10.090451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-10c68ecb-9966-46f2-93c6-3eb0a5dad3a5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:10.097574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10c68ecb-9966-46f2-93c6-3eb0a5dad3a5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:10.098056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10c68ecb-9966-46f2-93c6-3eb0a5dad3a5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:10.098898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10c68ecb-9966-46f2-93c6-3eb0a5dad3a5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:10.099389 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-10c68ecb-9966-46f2-93c6-3eb0a5dad3a5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:10.238325 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-10c68ecb-9966-46f2-93c6-3eb0a5dad3a5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:10.247333 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-10c68ecb-9966-46f2-93c6-3eb0a5dad3a5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1694 microversion: 2.1 time: 0.161626 Jul 20 05:28:10.247933 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3716/7452] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:10 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:11.265440 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-197260b3-758a-4e99-91b9-380572f4bae2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:11.266096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-197260b3-758a-4e99-91b9-380572f4bae2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:11.273084 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-197260b3-758a-4e99-91b9-380572f4bae2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:11.273546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-197260b3-758a-4e99-91b9-380572f4bae2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:11.274348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-197260b3-758a-4e99-91b9-380572f4bae2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:11.274796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-197260b3-758a-4e99-91b9-380572f4bae2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:11.410631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-197260b3-758a-4e99-91b9-380572f4bae2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:11.418504 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-197260b3-758a-4e99-91b9-380572f4bae2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1676 microversion: 2.1 time: 0.157819 Jul 20 05:28:11.419085 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3737/7453] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:11 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:12.436053 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ac9379eb-f318-46ff-a4f1-010d69d2a901 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:12.436681 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ac9379eb-f318-46ff-a4f1-010d69d2a901 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:12.443586 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac9379eb-f318-46ff-a4f1-010d69d2a901 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:12.444048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac9379eb-f318-46ff-a4f1-010d69d2a901 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:12.444822 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac9379eb-f318-46ff-a4f1-010d69d2a901 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:12.445268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ac9379eb-f318-46ff-a4f1-010d69d2a901 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:12.582876 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ac9379eb-f318-46ff-a4f1-010d69d2a901 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:12.591446 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ac9379eb-f318-46ff-a4f1-010d69d2a901 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1676 microversion: 2.1 time: 0.159355 Jul 20 05:28:12.592031 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3717/7454] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:12 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:13.549228 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-839b8b7d-2804-4fa3-ab19-b1f99860fb19 req-c9fd4225-ab9b-44ba-bbb7-ae91200c2b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b2fbf6-0907-4d31-96ba-c2490aadd6f8", "name": "network-vif-unplugged", "status": "completed", "tag": "3a1e4c2a-79b4-47d8-9309-10c80ca92037"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:13.559352 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-839b8b7d-2804-4fa3-ab19-b1f99860fb19 req-c9fd4225-ab9b-44ba-bbb7-ae91200c2b4d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:13.559864 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-839b8b7d-2804-4fa3-ab19-b1f99860fb19 req-c9fd4225-ab9b-44ba-bbb7-ae91200c2b4d service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:13.572519 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-839b8b7d-2804-4fa3-ab19-b1f99860fb19 req-c9fd4225-ab9b-44ba-bbb7-ae91200c2b4d service nova] Creating event network-vif-unplugged:3a1e4c2a-79b4-47d8-9309-10c80ca92037 for instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 on n-h2-760456-11 Jul 20 05:28:13.578559 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-839b8b7d-2804-4fa3-ab19-b1f99860fb19 req-c9fd4225-ab9b-44ba-bbb7-ae91200c2b4d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033196 Jul 20 05:28:13.579256 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3738/7455] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:13.610539 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6f8daa62-4f10-46bf-82d7-9f874cd086f0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:13.611258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6f8daa62-4f10-46bf-82d7-9f874cd086f0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:13.619494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f8daa62-4f10-46bf-82d7-9f874cd086f0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:13.619494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f8daa62-4f10-46bf-82d7-9f874cd086f0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:13.621215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f8daa62-4f10-46bf-82d7-9f874cd086f0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:13.621679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6f8daa62-4f10-46bf-82d7-9f874cd086f0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:13.761787 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6f8daa62-4f10-46bf-82d7-9f874cd086f0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:13.769371 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6f8daa62-4f10-46bf-82d7-9f874cd086f0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1619 microversion: 2.1 time: 0.163780 Jul 20 05:28:13.769946 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3718/7456] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:13 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1619 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:13.787279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28ab6437-a3f6-4ea2-a0ff-71cb5a72a44d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:13.787948 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-28ab6437-a3f6-4ea2-a0ff-71cb5a72a44d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:13.795114 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28ab6437-a3f6-4ea2-a0ff-71cb5a72a44d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:13.795574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28ab6437-a3f6-4ea2-a0ff-71cb5a72a44d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:13.796344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28ab6437-a3f6-4ea2-a0ff-71cb5a72a44d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:13.796789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28ab6437-a3f6-4ea2-a0ff-71cb5a72a44d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:13.932407 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-28ab6437-a3f6-4ea2-a0ff-71cb5a72a44d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "POST /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8/action" status: 202 len: 0 microversion: 2.1 time: 0.149275 Jul 20 05:28:13.933572 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3739/7457] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:28:13 2022] POST /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:28:13.941849 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b21b088e-8a98-4838-8bd0-81924ebb1ac6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:13.942517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b21b088e-8a98-4838-8bd0-81924ebb1ac6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:13.949641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b21b088e-8a98-4838-8bd0-81924ebb1ac6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:13.950116 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b21b088e-8a98-4838-8bd0-81924ebb1ac6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:13.950950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b21b088e-8a98-4838-8bd0-81924ebb1ac6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:13.951406 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b21b088e-8a98-4838-8bd0-81924ebb1ac6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:14.096593 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b21b088e-8a98-4838-8bd0-81924ebb1ac6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:14.104141 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b21b088e-8a98-4838-8bd0-81924ebb1ac6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1627 microversion: 2.1 time: 0.166196 Jul 20 05:28:14.105410 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3719/7458] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:13 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1627 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:15.124134 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-253fb6a9-0005-4286-be8d-21d8a7083898 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:15.124728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-253fb6a9-0005-4286-be8d-21d8a7083898 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:15.131607 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-253fb6a9-0005-4286-be8d-21d8a7083898 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:15.132094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-253fb6a9-0005-4286-be8d-21d8a7083898 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:15.132942 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-253fb6a9-0005-4286-be8d-21d8a7083898 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:15.133420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-253fb6a9-0005-4286-be8d-21d8a7083898 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:15.277502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-253fb6a9-0005-4286-be8d-21d8a7083898 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:15.285165 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-253fb6a9-0005-4286-be8d-21d8a7083898 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.166180 Jul 20 05:28:15.285749 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3740/7459] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:15 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:16.303691 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5037dd79-390e-4380-a954-4c1188cf47a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:16.304281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5037dd79-390e-4380-a954-4c1188cf47a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:16.312443 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5037dd79-390e-4380-a954-4c1188cf47a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:16.312920 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5037dd79-390e-4380-a954-4c1188cf47a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:16.313718 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5037dd79-390e-4380-a954-4c1188cf47a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:16.314174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5037dd79-390e-4380-a954-4c1188cf47a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:16.474529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5037dd79-390e-4380-a954-4c1188cf47a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:16.485007 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5037dd79-390e-4380-a954-4c1188cf47a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.185233 Jul 20 05:28:16.485724 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3720/7460] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:16 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:17.505027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-14c13bfe-7e78-4955-a4c3-6cc3791f1c13 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:17.506752 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-14c13bfe-7e78-4955-a4c3-6cc3791f1c13 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:17.517839 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14c13bfe-7e78-4955-a4c3-6cc3791f1c13 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:17.521002 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14c13bfe-7e78-4955-a4c3-6cc3791f1c13 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:17.522350 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14c13bfe-7e78-4955-a4c3-6cc3791f1c13 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:17.523017 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-14c13bfe-7e78-4955-a4c3-6cc3791f1c13 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:17.687195 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-14c13bfe-7e78-4955-a4c3-6cc3791f1c13 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:17.694999 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-14c13bfe-7e78-4955-a4c3-6cc3791f1c13 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.194677 Jul 20 05:28:17.695872 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3741/7461] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:17 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:18.713338 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d2271a3-f3d2-49c1-b274-11da1de2f23a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:18.714492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d2271a3-f3d2-49c1-b274-11da1de2f23a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:18.717273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=31 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:18.723174 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d2271a3-f3d2-49c1-b274-11da1de2f23a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:18.723644 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d2271a3-f3d2-49c1-b274-11da1de2f23a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:18.724437 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d2271a3-f3d2-49c1-b274-11da1de2f23a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:18.725005 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d2271a3-f3d2-49c1-b274-11da1de2f23a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:18.728494 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:18.877618 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d2271a3-f3d2-49c1-b274-11da1de2f23a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:18.887932 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d2271a3-f3d2-49c1-b274-11da1de2f23a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.178716 Jul 20 05:28:18.888911 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3721/7462] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:18 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:19.905649 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f2ce6084-6e25-4c2e-bc7e-1d22d0e99282 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:19.906343 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f2ce6084-6e25-4c2e-bc7e-1d22d0e99282 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:19.909246 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=33 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:19.915041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2ce6084-6e25-4c2e-bc7e-1d22d0e99282 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:19.915503 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2ce6084-6e25-4c2e-bc7e-1d22d0e99282 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:19.916298 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2ce6084-6e25-4c2e-bc7e-1d22d0e99282 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:19.916980 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f2ce6084-6e25-4c2e-bc7e-1d22d0e99282 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:19.920111 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:20.066074 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f2ce6084-6e25-4c2e-bc7e-1d22d0e99282 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:20.074520 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f2ce6084-6e25-4c2e-bc7e-1d22d0e99282 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.173411 Jul 20 05:28:20.075101 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3742/7463] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:19 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:21.093008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c6b2e53e-dc81-44ba-8bd0-ce81c46fc62d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:21.093638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c6b2e53e-dc81-44ba-8bd0-ce81c46fc62d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:21.100603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6b2e53e-dc81-44ba-8bd0-ce81c46fc62d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:21.101069 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6b2e53e-dc81-44ba-8bd0-ce81c46fc62d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:21.101870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6b2e53e-dc81-44ba-8bd0-ce81c46fc62d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:21.102458 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c6b2e53e-dc81-44ba-8bd0-ce81c46fc62d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:21.257205 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-c6b2e53e-dc81-44ba-8bd0-ce81c46fc62d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:21.266408 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c6b2e53e-dc81-44ba-8bd0-ce81c46fc62d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.178314 Jul 20 05:28:21.266980 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3722/7464] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:21 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:22.285444 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e7b3c95-996c-4545-a993-edeea9920138 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:22.286106 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e7b3c95-996c-4545-a993-edeea9920138 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:22.294597 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e7b3c95-996c-4545-a993-edeea9920138 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:22.295053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e7b3c95-996c-4545-a993-edeea9920138 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:22.295838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e7b3c95-996c-4545-a993-edeea9920138 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:22.296563 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e7b3c95-996c-4545-a993-edeea9920138 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:22.465373 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e7b3c95-996c-4545-a993-edeea9920138 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:22.477937 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e7b3c95-996c-4545-a993-edeea9920138 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.196036 Jul 20 05:28:22.478740 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3743/7465] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:22 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:23.500940 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a1001f5b-c177-49e5-bb45-4eaede254e56 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:23.501898 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a1001f5b-c177-49e5-bb45-4eaede254e56 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:23.509488 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1001f5b-c177-49e5-bb45-4eaede254e56 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:23.509963 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1001f5b-c177-49e5-bb45-4eaede254e56 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:23.511132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1001f5b-c177-49e5-bb45-4eaede254e56 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:23.511544 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a1001f5b-c177-49e5-bb45-4eaede254e56 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:23.660517 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a1001f5b-c177-49e5-bb45-4eaede254e56 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:23.668748 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a1001f5b-c177-49e5-bb45-4eaede254e56 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.171649 Jul 20 05:28:23.669340 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3723/7466] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:23 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:24.687286 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-00169c30-5ea1-4538-8041-3ca71b0f5a37 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:24.687931 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-00169c30-5ea1-4538-8041-3ca71b0f5a37 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:24.694844 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00169c30-5ea1-4538-8041-3ca71b0f5a37 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:24.695300 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00169c30-5ea1-4538-8041-3ca71b0f5a37 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:24.696060 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00169c30-5ea1-4538-8041-3ca71b0f5a37 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:24.696501 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-00169c30-5ea1-4538-8041-3ca71b0f5a37 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:24.830703 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-00169c30-5ea1-4538-8041-3ca71b0f5a37 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:24.838818 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-00169c30-5ea1-4538-8041-3ca71b0f5a37 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.154858 Jul 20 05:28:24.839445 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3744/7467] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:24 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:25.856638 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e98f8040-db14-4032-b8b8-9690866b8c3f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:25.857330 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e98f8040-db14-4032-b8b8-9690866b8c3f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:25.865678 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e98f8040-db14-4032-b8b8-9690866b8c3f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:25.866139 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e98f8040-db14-4032-b8b8-9690866b8c3f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:25.867203 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e98f8040-db14-4032-b8b8-9690866b8c3f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:25.867651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e98f8040-db14-4032-b8b8-9690866b8c3f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:26.001688 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-e98f8040-db14-4032-b8b8-9690866b8c3f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:26.009275 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e98f8040-db14-4032-b8b8-9690866b8c3f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.157464 Jul 20 05:28:26.009856 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3724/7468] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:25 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:27.027113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e9a59c4d-4d30-49e7-ad21-2acb426752f5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:27.027727 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e9a59c4d-4d30-49e7-ad21-2acb426752f5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:27.034701 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a59c4d-4d30-49e7-ad21-2acb426752f5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:27.035163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a59c4d-4d30-49e7-ad21-2acb426752f5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:27.035944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a59c4d-4d30-49e7-ad21-2acb426752f5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:27.036387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e9a59c4d-4d30-49e7-ad21-2acb426752f5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:27.173569 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e9a59c4d-4d30-49e7-ad21-2acb426752f5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:27.181168 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e9a59c4d-4d30-49e7-ad21-2acb426752f5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.158570 Jul 20 05:28:27.181738 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3745/7469] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:27 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:28.199556 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-407e7570-9cd1-4387-a73d-74a372100e25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:28.200258 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-407e7570-9cd1-4387-a73d-74a372100e25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:28.207309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-407e7570-9cd1-4387-a73d-74a372100e25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:28.207781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-407e7570-9cd1-4387-a73d-74a372100e25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:28.208564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-407e7570-9cd1-4387-a73d-74a372100e25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:28.209020 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-407e7570-9cd1-4387-a73d-74a372100e25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:28.360363 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-407e7570-9cd1-4387-a73d-74a372100e25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:28.368338 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-407e7570-9cd1-4387-a73d-74a372100e25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.173872 Jul 20 05:28:28.368923 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3725/7470] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:28 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:29.386866 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-62845af7-1893-4316-bb4a-acdd23d21d62 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:29.387404 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-62845af7-1893-4316-bb4a-acdd23d21d62 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:29.394490 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62845af7-1893-4316-bb4a-acdd23d21d62 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:29.394946 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62845af7-1893-4316-bb4a-acdd23d21d62 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:29.395723 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62845af7-1893-4316-bb4a-acdd23d21d62 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:29.396162 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-62845af7-1893-4316-bb4a-acdd23d21d62 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:29.532118 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-62845af7-1893-4316-bb4a-acdd23d21d62 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:29.539878 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-62845af7-1893-4316-bb4a-acdd23d21d62 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.157585 Jul 20 05:28:29.540491 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3746/7471] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:29 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:29.655405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-2ce56adc-5bd1-402c-9bb4-98b46dbb8af1 req-50cfc25c-0909-4ec0-b72c-f026a57f4084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b2fbf6-0907-4d31-96ba-c2490aadd6f8", "name": "network-vif-plugged", "status": "completed", "tag": "3a1e4c2a-79b4-47d8-9309-10c80ca92037"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:29.664317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2ce56adc-5bd1-402c-9bb4-98b46dbb8af1 req-50cfc25c-0909-4ec0-b72c-f026a57f4084 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:29.664783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-2ce56adc-5bd1-402c-9bb4-98b46dbb8af1 req-50cfc25c-0909-4ec0-b72c-f026a57f4084 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:29.676711 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-2ce56adc-5bd1-402c-9bb4-98b46dbb8af1 req-50cfc25c-0909-4ec0-b72c-f026a57f4084 service nova] Creating event network-vif-plugged:3a1e4c2a-79b4-47d8-9309-10c80ca92037 for instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 on n-h2-760456-11 Jul 20 05:28:29.681696 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-2ce56adc-5bd1-402c-9bb4-98b46dbb8af1 req-50cfc25c-0909-4ec0-b72c-f026a57f4084 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030291 Jul 20 05:28:29.682329 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3726/7472] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:28:30.558027 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b232f90e-acb5-4630-8616-0a83a2d0a93b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:30.558715 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b232f90e-acb5-4630-8616-0a83a2d0a93b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:30.565615 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b232f90e-acb5-4630-8616-0a83a2d0a93b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:30.566077 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b232f90e-acb5-4630-8616-0a83a2d0a93b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:30.566890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b232f90e-acb5-4630-8616-0a83a2d0a93b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:30.567340 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b232f90e-acb5-4630-8616-0a83a2d0a93b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:30.702387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b232f90e-acb5-4630-8616-0a83a2d0a93b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:30.709864 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b232f90e-acb5-4630-8616-0a83a2d0a93b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1685 microversion: 2.1 time: 0.155809 Jul 20 05:28:30.710468 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3747/7473] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:30 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:31.729044 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5ad0b0d0-b476-45f7-90dd-6b7dc78ecee4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:31.729875 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5ad0b0d0-b476-45f7-90dd-6b7dc78ecee4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:31.736323 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ad0b0d0-b476-45f7-90dd-6b7dc78ecee4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:31.736796 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ad0b0d0-b476-45f7-90dd-6b7dc78ecee4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:31.737584 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ad0b0d0-b476-45f7-90dd-6b7dc78ecee4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:31.738045 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-5ad0b0d0-b476-45f7-90dd-6b7dc78ecee4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:31.876380 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5ad0b0d0-b476-45f7-90dd-6b7dc78ecee4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:31.883994 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5ad0b0d0-b476-45f7-90dd-6b7dc78ecee4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1672 microversion: 2.1 time: 0.160299 Jul 20 05:28:31.884599 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3727/7474] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:31 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:40.615849 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:28:40.616769 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:28:40.662613 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:28:40.662788 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:29:45.652155 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=11 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:45.656049 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=13 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:45.657167 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=37 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:45.657524 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=35 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:45.667547 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d43f8a91-276d-44b9-85e8-64902d16c9f4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:45.668157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d43f8a91-276d-44b9-85e8-64902d16c9f4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:45.677823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d43f8a91-276d-44b9-85e8-64902d16c9f4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.678603 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d43f8a91-276d-44b9-85e8-64902d16c9f4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.679391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d43f8a91-276d-44b9-85e8-64902d16c9f4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.679871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d43f8a91-276d-44b9-85e8-64902d16c9f4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.706680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d43f8a91-276d-44b9-85e8-64902d16c9f4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:29:45.730918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-af42f9e9-0445-4b6f-92c0-c68ead6136be req-95b30e99-b79a-4b1d-bf65-dec9fe03fe86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b2fbf6-0907-4d31-96ba-c2490aadd6f8", "tag": "3a1e4c2a-79b4-47d8-9309-10c80ca92037"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:45.740162 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-af42f9e9-0445-4b6f-92c0-c68ead6136be req-95b30e99-b79a-4b1d-bf65-dec9fe03fe86 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.740708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-af42f9e9-0445-4b6f-92c0-c68ead6136be req-95b30e99-b79a-4b1d-bf65-dec9fe03fe86 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.753474 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-af42f9e9-0445-4b6f-92c0-c68ead6136be req-95b30e99-b79a-4b1d-bf65-dec9fe03fe86 service nova] Creating event network-changed:3a1e4c2a-79b4-47d8-9309-10c80ca92037 for instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 on n-h2-760456-11 Jul 20 05:29:45.759950 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-af42f9e9-0445-4b6f-92c0-c68ead6136be req-95b30e99-b79a-4b1d-bf65-dec9fe03fe86 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105767 Jul 20 05:29:45.761413 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3728/7475] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:45.796801 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d43f8a91-276d-44b9-85e8-64902d16c9f4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "DELETE /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 204 len: 0 microversion: 2.1 time: 0.145754 Jul 20 05:29:45.797600 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3748/7476] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:29:45 2022] DELETE /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:29:45.810643 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a57ea668-b627-4720-a24f-ccd5fb9ff5e4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:45.811370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-a57ea668-b627-4720-a24f-ccd5fb9ff5e4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:45.818324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a57ea668-b627-4720-a24f-ccd5fb9ff5e4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.819000 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a57ea668-b627-4720-a24f-ccd5fb9ff5e4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.819765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a57ea668-b627-4720-a24f-ccd5fb9ff5e4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.820383 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-a57ea668-b627-4720-a24f-ccd5fb9ff5e4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.988563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-a57ea668-b627-4720-a24f-ccd5fb9ff5e4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:45.996960 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a57ea668-b627-4720-a24f-ccd5fb9ff5e4 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.193149 Jul 20 05:29:45.997631 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3729/7477] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:45 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:47.014375 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d49f9a0f-1b3d-4e17-be43-2909dc0645d0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:47.015095 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d49f9a0f-1b3d-4e17-be43-2909dc0645d0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:47.023571 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d49f9a0f-1b3d-4e17-be43-2909dc0645d0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:47.024034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d49f9a0f-1b3d-4e17-be43-2909dc0645d0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:47.024869 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d49f9a0f-1b3d-4e17-be43-2909dc0645d0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:47.025319 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d49f9a0f-1b3d-4e17-be43-2909dc0645d0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:47.251419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d49f9a0f-1b3d-4e17-be43-2909dc0645d0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:47.260130 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d49f9a0f-1b3d-4e17-be43-2909dc0645d0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1678 microversion: 2.1 time: 0.250032 Jul 20 05:29:47.261269 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3749/7478] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:47 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1678 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:48.033268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-7c3142b9-871e-4ded-9662-075c9a5a407b req-056ca675-e933-4460-934c-21b01defd60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b2fbf6-0907-4d31-96ba-c2490aadd6f8", "name": "network-vif-deleted", "tag": "3a1e4c2a-79b4-47d8-9309-10c80ca92037"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:48.044412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7c3142b9-871e-4ded-9662-075c9a5a407b req-056ca675-e933-4460-934c-21b01defd60b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:48.044889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-7c3142b9-871e-4ded-9662-075c9a5a407b req-056ca675-e933-4460-934c-21b01defd60b service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:48.057429 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-7c3142b9-871e-4ded-9662-075c9a5a407b req-056ca675-e933-4460-934c-21b01defd60b service nova] Creating event network-vif-deleted:3a1e4c2a-79b4-47d8-9309-10c80ca92037 for instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 on n-h2-760456-11 Jul 20 05:29:48.062373 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-7c3142b9-871e-4ded-9662-075c9a5a407b req-056ca675-e933-4460-934c-21b01defd60b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111930 Jul 20 05:29:48.062977 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3730/7479] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:48.279427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:48.280051 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:48.287882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:48.288344 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:48.289123 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:48.289564 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:48.324359 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:48.324911 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:48.325374 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lazy-loading 'fault' on Instance uuid 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:29:48.370636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:48.378965 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5e9011b5-8ab2-4782-8c69-f3eb03f6ad2d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 200 len: 1335 microversion: 2.1 time: 0.104713 Jul 20 05:29:48.385917 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3750/7480] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:48 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:49.399004 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b42607d4-eb85-4be9-9ff1-15ce839ff2c1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:49.399660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b42607d4-eb85-4be9-9ff1-15ce839ff2c1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 25b2fbf6-0907-4d31-96ba-c2490aadd6f8] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:49.406115 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b42607d4-eb85-4be9-9ff1-15ce839ff2c1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:49.406614 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b42607d4-eb85-4be9-9ff1-15ce839ff2c1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:49.407385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b42607d4-eb85-4be9-9ff1-15ce839ff2c1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:49.407833 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b42607d4-eb85-4be9-9ff1-15ce839ff2c1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:49.420891 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-b42607d4-eb85-4be9-9ff1-15ce839ff2c1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] HTTP exception thrown: Instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 could not be found. Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b42607d4-eb85-4be9-9ff1-15ce839ff2c1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Request method failure captured: Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 HTTP/1.1 Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi15HINQ1w4By1HmTQhj-Vq4um-Tu-mU0-ZVQTWqwBlkFgkIV5fTESeVhgMVcguZdIx-pp-RvazLbUw_f0ETNUi1YKauiALVCvJh8UoiWqa5fWTU9sLAJxUp3iXlJW0sUc2uJ5EfgKqCKBc7a36z5lM3gEBqbTJlMF04gF5_U_k6HUGNE Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 11f6aabed5c94415ad006ffbcc434497 Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestShelveInstance-994652073 Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/11f6aabed5c94415ad006ffbcc434497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/11f6aabed5c94415ad006ffbcc434497"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/11f6aabed5c94415ad006ffbcc434497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_11f6aabed5c94415ad006ffbcc434497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestShelveInstance-994652073 Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 11f6aabed5c94415ad006ffbcc434497 Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestShelveInstance-994652073 Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestShelveInstance-994652073-project Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: b0839820df2e469fbfafa017a9a71d5f Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestShelveInstance-994652073-project Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 could not be found. Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '25b2fbf6-0907-4d31-96ba-c2490aadd6f8'} Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 could not be found. Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 could not be found. Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:29:49.422532 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:29:49.427725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:29:49.427725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:29:49.427725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:29:49.427725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:29:49.427725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:29:49.427725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 could not be found. Jul 20 05:29:49.427725 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:29:49.427725 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b42607d4-eb85-4be9-9ff1-15ce839ff2c1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Returning 404 to user: Instance 25b2fbf6-0907-4d31-96ba-c2490aadd6f8 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:29:49.427725 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b42607d4-eb85-4be9-9ff1-15ce839ff2c1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8" status: 404 len: 111 microversion: 2.1 time: 0.030976 Jul 20 05:29:49.427725 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3731/7481] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:49 2022] GET /compute/v2.1/servers/25b2fbf6-0907-4d31-96ba-c2490aadd6f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:29:49.588482 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5cffc113-fc36-431b-ab87-29a0185d9551 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '.version_select at 0x7fb840eb2ee0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:49.606536 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5cffc113-fc36-431b-ab87-29a0185d9551 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-184980118" status: 202 len: 0 microversion: 2.1 time: 0.022781 Jul 20 05:29:49.607248 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3751/7482] 10.222.0.59 () {58 vars in 1250 bytes} [Wed Jul 20 05:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-184980118 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:29:49.633524 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d4a8937d-32d4-404b-8e49-803a619d4d77 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Action: 'create', calling method: .version_select at 0x7fb841f190d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1079158385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYzop7W3Tl38/2lUoPiNXDHv/IJONDxSMdk+mO6ss0iU0AkX6Jl5Q7p/KTJNxd3iz7kXTcfsnhEruVHH/XCxOLRwrnSllTc1w8KyL0rhT0dgWmooz7x3OADKHTlbW4+eg=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:49.648093 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d4a8937d-32d4-404b-8e49-803a619d4d77 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Getting quotas for project 11f6aabed5c94415ad006ffbcc434497. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:29:49.653317 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-d4a8937d-32d4-404b-8e49-803a619d4d77 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Getting quotas for user b0839820df2e469fbfafa017a9a71d5f and project 11f6aabed5c94415ad006ffbcc434497. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:29:49.679643 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d4a8937d-32d4-404b-8e49-803a619d4d77 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.051111 Jul 20 05:29:49.680261 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3732/7483] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:29:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:30:05.764675 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:05.765822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:05.770833 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-415751746", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1079158385", "security_groups": [{"name": "tempest-secgroup-smoke-430672037"}], "networks": [{"uuid": "072b57fc-1b2f-41cf-ad2f-9f27f548fd2b"}], "block_device_mapping_v2": [{"uuid": "187b0e8b-7f0d-4cf4-a4f5-a5643c19eb3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:05.887691 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] validate_networks() for [('072b57fc-1b2f-41cf-ad2f-9f27f548fd2b', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:30:06.252318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:30:06.252762 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:30:06.253903 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:30:06.254442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:30:06.254881 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:30:06.264163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:06.264614 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:06.265411 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:06.265853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:06.282726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Getting quotas for project 11f6aabed5c94415ad006ffbcc434497. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:30:06.288635 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Getting quotas for user b0839820df2e469fbfafa017a9a71d5f and project 11f6aabed5c94415ad006ffbcc434497. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:30:06.347353 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:30:06.349443 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='187b0e8b-7f0d-4cf4-a4f5-a5643c19eb3b',volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:30:06.476690 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2fe8ef38-c65e-4dc5-9471-e94551319822 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.713454 Jul 20 05:30:06.477529 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3752/7484] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:30:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:30:06.485468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=12 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:06.486512 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:06.487653 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:06.492388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-447bc83d-cfb7-40d6-8935-ffe8f920c2a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:06.493035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-447bc83d-cfb7-40d6-8935-ffe8f920c2a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:06.554883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-447bc83d-cfb7-40d6-8935-ffe8f920c2a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:06.562439 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-447bc83d-cfb7-40d6-8935-ffe8f920c2a6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1088 microversion: 2.1 time: 0.078767 Jul 20 05:30:06.563016 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3733/7485] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:06 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:07.583834 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c55f93ff-cd8c-44b5-ab96-d65921d51def tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:07.584466 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c55f93ff-cd8c-44b5-ab96-d65921d51def tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:07.644254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c55f93ff-cd8c-44b5-ab96-d65921d51def tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:07.652761 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c55f93ff-cd8c-44b5-ab96-d65921d51def tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1088 microversion: 2.1 time: 0.074034 Jul 20 05:30:07.653348 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3753/7486] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:07 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:08.670782 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5a5605ca-abe1-4e22-a092-6d0111ce9ec0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:08.671411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-5a5605ca-abe1-4e22-a092-6d0111ce9ec0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:08.737843 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-5a5605ca-abe1-4e22-a092-6d0111ce9ec0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:08.744886 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5a5605ca-abe1-4e22-a092-6d0111ce9ec0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1088 microversion: 2.1 time: 0.078063 Jul 20 05:30:08.745466 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3734/7487] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:08 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:09.761999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-c33961e9-01be-4835-bbd2-7e9c622c907c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:09.762637 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-c33961e9-01be-4835-bbd2-7e9c622c907c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:09.770919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c33961e9-01be-4835-bbd2-7e9c622c907c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:09.770919 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c33961e9-01be-4835-bbd2-7e9c622c907c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:09.771788 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c33961e9-01be-4835-bbd2-7e9c622c907c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:09.772233 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-c33961e9-01be-4835-bbd2-7e9c622c907c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:09.833291 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-c33961e9-01be-4835-bbd2-7e9c622c907c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:09.840712 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-c33961e9-01be-4835-bbd2-7e9c622c907c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1138 microversion: 2.1 time: 0.082672 Jul 20 05:30:09.841285 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3754/7488] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:09 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:10.858175 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a4c8bc0-deff-4381-9296-81d37049e3a0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:10.859636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2a4c8bc0-deff-4381-9296-81d37049e3a0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:10.868812 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a4c8bc0-deff-4381-9296-81d37049e3a0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:10.869281 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a4c8bc0-deff-4381-9296-81d37049e3a0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:10.870075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a4c8bc0-deff-4381-9296-81d37049e3a0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:10.870551 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a4c8bc0-deff-4381-9296-81d37049e3a0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:10.940651 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2a4c8bc0-deff-4381-9296-81d37049e3a0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:10.949333 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a4c8bc0-deff-4381-9296-81d37049e3a0 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1204 microversion: 2.1 time: 0.095835 Jul 20 05:30:10.959586 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3735/7489] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:10 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1204 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:11.876594 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-cc45f73f-261d-4188-9031-c99c440d13d8 req-d4cb8d78-a785-478c-a501-052199296f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85501081-d1fd-4bbd-9855-446c8fa56547", "tag": "e5c1784b-0b98-4e99-841c-6ed5b6f825f7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:11.899078 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cc45f73f-261d-4188-9031-c99c440d13d8 req-d4cb8d78-a785-478c-a501-052199296f06 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:11.900045 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-cc45f73f-261d-4188-9031-c99c440d13d8 req-d4cb8d78-a785-478c-a501-052199296f06 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:11.922842 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-cc45f73f-261d-4188-9031-c99c440d13d8 req-d4cb8d78-a785-478c-a501-052199296f06 service nova] Creating event network-changed:e5c1784b-0b98-4e99-841c-6ed5b6f825f7 for instance 85501081-d1fd-4bbd-9855-446c8fa56547 on n-h1-760456-11 Jul 20 05:30:11.929225 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-cc45f73f-261d-4188-9031-c99c440d13d8 req-d4cb8d78-a785-478c-a501-052199296f06 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055925 Jul 20 05:30:11.933885 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3755/7490] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:30:11.968226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d94610e-8f9f-4b0b-84c2-b29517bf38ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:11.968878 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d94610e-8f9f-4b0b-84c2-b29517bf38ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:11.976244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d94610e-8f9f-4b0b-84c2-b29517bf38ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:11.976711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d94610e-8f9f-4b0b-84c2-b29517bf38ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:11.977516 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d94610e-8f9f-4b0b-84c2-b29517bf38ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:11.977962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d94610e-8f9f-4b0b-84c2-b29517bf38ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:12.159094 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d94610e-8f9f-4b0b-84c2-b29517bf38ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:12.169657 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d94610e-8f9f-4b0b-84c2-b29517bf38ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1271 microversion: 2.1 time: 0.206900 Jul 20 05:30:12.172260 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3736/7491] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:11 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:13.187560 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2e5dd46b-ce99-466b-907f-e0a379366ce6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:13.188311 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2e5dd46b-ce99-466b-907f-e0a379366ce6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:13.196379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e5dd46b-ce99-466b-907f-e0a379366ce6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:13.196830 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e5dd46b-ce99-466b-907f-e0a379366ce6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:13.197576 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e5dd46b-ce99-466b-907f-e0a379366ce6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:13.198024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2e5dd46b-ce99-466b-907f-e0a379366ce6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:13.338378 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2e5dd46b-ce99-466b-907f-e0a379366ce6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:13.345971 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2e5dd46b-ce99-466b-907f-e0a379366ce6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1271 microversion: 2.1 time: 0.162750 Jul 20 05:30:13.346584 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3756/7492] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:13 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:14.362765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cebc5785-7b9c-407f-a608-97ebcbe8efee tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:14.363523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cebc5785-7b9c-407f-a608-97ebcbe8efee tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:14.370907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cebc5785-7b9c-407f-a608-97ebcbe8efee tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:14.371377 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cebc5785-7b9c-407f-a608-97ebcbe8efee tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:14.372180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cebc5785-7b9c-407f-a608-97ebcbe8efee tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:14.372641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cebc5785-7b9c-407f-a608-97ebcbe8efee tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:14.507485 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cebc5785-7b9c-407f-a608-97ebcbe8efee tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:14.515566 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cebc5785-7b9c-407f-a608-97ebcbe8efee tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1271 microversion: 2.1 time: 0.156803 Jul 20 05:30:14.516160 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3737/7493] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:14 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:15.532828 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-305e12dd-3364-4ec4-88f2-fe8694a4ad11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:15.533458 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-305e12dd-3364-4ec4-88f2-fe8694a4ad11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:15.542610 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-305e12dd-3364-4ec4-88f2-fe8694a4ad11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:15.543264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-305e12dd-3364-4ec4-88f2-fe8694a4ad11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:15.544056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-305e12dd-3364-4ec4-88f2-fe8694a4ad11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:15.544504 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-305e12dd-3364-4ec4-88f2-fe8694a4ad11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:15.680474 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-305e12dd-3364-4ec4-88f2-fe8694a4ad11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:15.688035 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-305e12dd-3364-4ec4-88f2-fe8694a4ad11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1271 microversion: 2.1 time: 0.159102 Jul 20 05:30:15.688612 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3757/7494] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:15 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:16.705052 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-abad63a2-0dd1-4744-b8af-320a21f78250 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:16.705685 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-abad63a2-0dd1-4744-b8af-320a21f78250 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:16.713757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abad63a2-0dd1-4744-b8af-320a21f78250 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:16.714225 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abad63a2-0dd1-4744-b8af-320a21f78250 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:16.715040 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abad63a2-0dd1-4744-b8af-320a21f78250 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:16.715496 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-abad63a2-0dd1-4744-b8af-320a21f78250 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:16.853309 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-abad63a2-0dd1-4744-b8af-320a21f78250 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:16.861323 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-abad63a2-0dd1-4744-b8af-320a21f78250 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1259 microversion: 2.1 time: 0.160295 Jul 20 05:30:16.861890 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3738/7495] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:16 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:17.879521 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ce307577-9ac6-4176-85de-1a32e1c6c364 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:17.880072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ce307577-9ac6-4176-85de-1a32e1c6c364 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:17.882199 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:17.883749 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=8 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:17.889645 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce307577-9ac6-4176-85de-1a32e1c6c364 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:17.890097 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce307577-9ac6-4176-85de-1a32e1c6c364 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:17.890892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce307577-9ac6-4176-85de-1a32e1c6c364 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:17.891336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ce307577-9ac6-4176-85de-1a32e1c6c364 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:18.023982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ce307577-9ac6-4176-85de-1a32e1c6c364 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:18.031830 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ce307577-9ac6-4176-85de-1a32e1c6c364 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1259 microversion: 2.1 time: 0.156239 Jul 20 05:30:18.032432 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3758/7496] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:17 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:19.050919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-9d9b8570-f277-41a9-8b9a-ed2bcf5ec10d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:19.051625 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-9d9b8570-f277-41a9-8b9a-ed2bcf5ec10d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:19.054350 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=4 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:19.060186 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d9b8570-f277-41a9-8b9a-ed2bcf5ec10d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:19.060695 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d9b8570-f277-41a9-8b9a-ed2bcf5ec10d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:19.061532 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d9b8570-f277-41a9-8b9a-ed2bcf5ec10d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:19.061950 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-9d9b8570-f277-41a9-8b9a-ed2bcf5ec10d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:19.196636 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-9d9b8570-f277-41a9-8b9a-ed2bcf5ec10d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:19.204183 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-9d9b8570-f277-41a9-8b9a-ed2bcf5ec10d tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1259 microversion: 2.1 time: 0.157861 Jul 20 05:30:19.204776 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3739/7497] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:19 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:20.221186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6e77baea-4123-4600-9773-86db50cfd829 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:20.221807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6e77baea-4123-4600-9773-86db50cfd829 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:20.229467 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e77baea-4123-4600-9773-86db50cfd829 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:20.229924 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e77baea-4123-4600-9773-86db50cfd829 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:20.230757 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e77baea-4123-4600-9773-86db50cfd829 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:20.231202 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6e77baea-4123-4600-9773-86db50cfd829 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:20.368188 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6e77baea-4123-4600-9773-86db50cfd829 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:20.375608 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6e77baea-4123-4600-9773-86db50cfd829 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1259 microversion: 2.1 time: 0.158395 Jul 20 05:30:20.376175 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3759/7498] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:20 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:21.392971 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b7ef1fc8-8608-4ef7-baa2-1d1d956362d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:21.393566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b7ef1fc8-8608-4ef7-baa2-1d1d956362d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:21.400411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7ef1fc8-8608-4ef7-baa2-1d1d956362d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:21.400883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7ef1fc8-8608-4ef7-baa2-1d1d956362d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:21.401664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7ef1fc8-8608-4ef7-baa2-1d1d956362d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:21.402120 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b7ef1fc8-8608-4ef7-baa2-1d1d956362d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:21.535394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b7ef1fc8-8608-4ef7-baa2-1d1d956362d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:21.542889 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b7ef1fc8-8608-4ef7-baa2-1d1d956362d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1259 microversion: 2.1 time: 0.154182 Jul 20 05:30:21.543457 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3740/7499] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:21 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:22.560208 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-72cd4b13-7b08-44da-8131-3bb55de879e6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:22.560836 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-72cd4b13-7b08-44da-8131-3bb55de879e6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:22.567818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72cd4b13-7b08-44da-8131-3bb55de879e6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:22.568276 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72cd4b13-7b08-44da-8131-3bb55de879e6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:22.569054 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72cd4b13-7b08-44da-8131-3bb55de879e6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:22.569502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-72cd4b13-7b08-44da-8131-3bb55de879e6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:22.704992 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-72cd4b13-7b08-44da-8131-3bb55de879e6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:22.712528 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-72cd4b13-7b08-44da-8131-3bb55de879e6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1259 microversion: 2.1 time: 0.156587 Jul 20 05:30:22.713108 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3760/7500] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:22 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:23.729854 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7105dddb-7373-4987-a39c-24bf6f459e41 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:23.730511 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7105dddb-7373-4987-a39c-24bf6f459e41 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:23.737451 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7105dddb-7373-4987-a39c-24bf6f459e41 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:23.738172 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7105dddb-7373-4987-a39c-24bf6f459e41 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:23.739263 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7105dddb-7373-4987-a39c-24bf6f459e41 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:23.739719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7105dddb-7373-4987-a39c-24bf6f459e41 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:23.870273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7105dddb-7373-4987-a39c-24bf6f459e41 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:23.877998 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7105dddb-7373-4987-a39c-24bf6f459e41 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1259 microversion: 2.1 time: 0.152510 Jul 20 05:30:23.879157 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3741/7501] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:23 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:24.897505 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1f6a6b0c-c5da-4f76-82d4-f5c4ac1a6d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:24.898129 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1f6a6b0c-c5da-4f76-82d4-f5c4ac1a6d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:24.905437 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f6a6b0c-c5da-4f76-82d4-f5c4ac1a6d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:24.905884 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f6a6b0c-c5da-4f76-82d4-f5c4ac1a6d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:24.906702 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f6a6b0c-c5da-4f76-82d4-f5c4ac1a6d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:24.907145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1f6a6b0c-c5da-4f76-82d4-f5c4ac1a6d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:25.059442 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1f6a6b0c-c5da-4f76-82d4-f5c4ac1a6d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:25.067306 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1f6a6b0c-c5da-4f76-82d4-f5c4ac1a6d64 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1259 microversion: 2.1 time: 0.174805 Jul 20 05:30:25.067895 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3761/7502] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:24 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:26.085954 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cc6e7260-44ac-47c6-8c68-07eb442dfd32 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:26.086621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cc6e7260-44ac-47c6-8c68-07eb442dfd32 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:26.094095 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc6e7260-44ac-47c6-8c68-07eb442dfd32 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:26.094597 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc6e7260-44ac-47c6-8c68-07eb442dfd32 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:26.095433 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc6e7260-44ac-47c6-8c68-07eb442dfd32 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:26.095892 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cc6e7260-44ac-47c6-8c68-07eb442dfd32 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:26.232218 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cc6e7260-44ac-47c6-8c68-07eb442dfd32 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:26.240887 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cc6e7260-44ac-47c6-8c68-07eb442dfd32 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1259 microversion: 2.1 time: 0.159716 Jul 20 05:30:26.241756 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3742/7503] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:26 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:26.287309 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-35ba9659-a5ce-4a9f-b053-b1cb6145f828 req-c43c48e9-1924-4f43-a91c-0c45a1dcfdaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85501081-d1fd-4bbd-9855-446c8fa56547", "name": "network-vif-plugged", "status": "completed", "tag": "e5c1784b-0b98-4e99-841c-6ed5b6f825f7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:26.297954 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-35ba9659-a5ce-4a9f-b053-b1cb6145f828 req-c43c48e9-1924-4f43-a91c-0c45a1dcfdaa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:26.299070 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-35ba9659-a5ce-4a9f-b053-b1cb6145f828 req-c43c48e9-1924-4f43-a91c-0c45a1dcfdaa service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:26.311031 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-35ba9659-a5ce-4a9f-b053-b1cb6145f828 req-c43c48e9-1924-4f43-a91c-0c45a1dcfdaa service nova] Creating event network-vif-plugged:e5c1784b-0b98-4e99-841c-6ed5b6f825f7 for instance 85501081-d1fd-4bbd-9855-446c8fa56547 on n-h1-760456-11 Jul 20 05:30:26.316130 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-35ba9659-a5ce-4a9f-b053-b1cb6145f828 req-c43c48e9-1924-4f43-a91c-0c45a1dcfdaa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033160 Jul 20 05:30:26.316741 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3762/7504] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:30:27.258664 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-566c3e7b-0068-4aea-89f6-5f9f8979ba46 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:27.259334 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-566c3e7b-0068-4aea-89f6-5f9f8979ba46 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:27.266658 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-566c3e7b-0068-4aea-89f6-5f9f8979ba46 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:27.267129 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-566c3e7b-0068-4aea-89f6-5f9f8979ba46 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:27.267907 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-566c3e7b-0068-4aea-89f6-5f9f8979ba46 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:27.268364 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-566c3e7b-0068-4aea-89f6-5f9f8979ba46 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:27.424840 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-566c3e7b-0068-4aea-89f6-5f9f8979ba46 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:27.433400 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-566c3e7b-0068-4aea-89f6-5f9f8979ba46 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1259 microversion: 2.1 time: 0.178661 Jul 20 05:30:27.434002 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3743/7505] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:27 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:28.451771 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0feecd1f-0342-4fcc-8c36-d0ff56a1d5d2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:28.452492 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0feecd1f-0342-4fcc-8c36-d0ff56a1d5d2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:28.459939 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0feecd1f-0342-4fcc-8c36-d0ff56a1d5d2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:28.460405 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0feecd1f-0342-4fcc-8c36-d0ff56a1d5d2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:28.461243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0feecd1f-0342-4fcc-8c36-d0ff56a1d5d2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:28.461708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0feecd1f-0342-4fcc-8c36-d0ff56a1d5d2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:28.595774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0feecd1f-0342-4fcc-8c36-d0ff56a1d5d2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:28.604266 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0feecd1f-0342-4fcc-8c36-d0ff56a1d5d2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1443 microversion: 2.1 time: 0.156774 Jul 20 05:30:28.604845 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3763/7506] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:28 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:28.620964 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7e9f1417-393c-400c-b63b-bce713acb158 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:28.621604 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7e9f1417-393c-400c-b63b-bce713acb158 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:28.628777 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9f1417-393c-400c-b63b-bce713acb158 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:28.629300 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9f1417-393c-400c-b63b-bce713acb158 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:28.630096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9f1417-393c-400c-b63b-bce713acb158 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:28.630598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7e9f1417-393c-400c-b63b-bce713acb158 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:28.762058 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7e9f1417-393c-400c-b63b-bce713acb158 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:28.770317 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7e9f1417-393c-400c-b63b-bce713acb158 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1443 microversion: 2.1 time: 0.153291 Jul 20 05:30:28.770901 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3744/7507] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:28 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:30.671001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5b98b42a-561a-4896-b8c9-e531f61cb28e req-878e6547-353e-4632-8a05-fb1979102e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85501081-d1fd-4bbd-9855-446c8fa56547", "tag": "e5c1784b-0b98-4e99-841c-6ed5b6f825f7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:30.679892 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5b98b42a-561a-4896-b8c9-e531f61cb28e req-878e6547-353e-4632-8a05-fb1979102e30 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:30.680338 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5b98b42a-561a-4896-b8c9-e531f61cb28e req-878e6547-353e-4632-8a05-fb1979102e30 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:30.692595 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5b98b42a-561a-4896-b8c9-e531f61cb28e req-878e6547-353e-4632-8a05-fb1979102e30 service nova] Creating event network-changed:e5c1784b-0b98-4e99-841c-6ed5b6f825f7 for instance 85501081-d1fd-4bbd-9855-446c8fa56547 on n-h1-760456-11 Jul 20 05:30:30.697808 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5b98b42a-561a-4896-b8c9-e531f61cb28e req-878e6547-353e-4632-8a05-fb1979102e30 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030417 Jul 20 05:30:30.698591 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3764/7508] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:32:00.669788 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:32:00.670456 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:32:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:32:24.746951 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec14a2d6-59f0-443f-9e2b-92ddf2d0a5cf] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:32:24.748082 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac98bfe5-b186-469e-8e5c-23ebe79e6c0b] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:32:24.748662 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=28 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:24.749422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=60 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:24.822089 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-e47e14c7-2981-4447-8c35-0dc26f973c11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:24.822779 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-e47e14c7-2981-4447-8c35-0dc26f973c11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:24.828865 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e47e14c7-2981-4447-8c35-0dc26f973c11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:24.829335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e47e14c7-2981-4447-8c35-0dc26f973c11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:24.830132 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e47e14c7-2981-4447-8c35-0dc26f973c11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:24.830608 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-e47e14c7-2981-4447-8c35-0dc26f973c11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:24.853515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.objects.instance [None req-e47e14c7-2981-4447-8c35-0dc26f973c11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lazy-loading 'flavor' on Instance uuid 85501081-d1fd-4bbd-9855-446c8fa56547 {{(pid=119605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:32:24.927554 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-e47e14c7-2981-4447-8c35-0dc26f973c11 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "POST /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547/action" status: 202 len: 0 microversion: 2.1 time: 0.182165 Jul 20 05:32:24.928245 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3745/7509] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:32:24 2022] POST /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:32:24.934649 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33eca72a-4e3b-4f88-b8f7-6f5bf76f74ec] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:32:24.935469 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0d612395-2abe-406a-94ab-07f31ffa6d77] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:32:24.936053 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:24.936906 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=56 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:24.941841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-ef171671-f6bd-4583-bc22-a139e4a24a14 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:24.942582 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-ef171671-f6bd-4583-bc22-a139e4a24a14 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:24.951888 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef171671-f6bd-4583-bc22-a139e4a24a14 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:24.952351 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef171671-f6bd-4583-bc22-a139e4a24a14 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:24.953127 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef171671-f6bd-4583-bc22-a139e4a24a14 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:24.953574 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-ef171671-f6bd-4583-bc22-a139e4a24a14 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:25.147846 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-ef171671-f6bd-4583-bc22-a139e4a24a14 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:25.155480 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-ef171671-f6bd-4583-bc22-a139e4a24a14 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.222650 Jul 20 05:32:25.156040 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3765/7510] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:24 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:25.881929 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:32:25.882140 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:32:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:32:26.176130 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-dbbad93e-3de2-4fde-bcf7-907bb7f83bfa tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:26.176860 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-dbbad93e-3de2-4fde-bcf7-907bb7f83bfa tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:26.186692 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbbad93e-3de2-4fde-bcf7-907bb7f83bfa tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:26.187159 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbbad93e-3de2-4fde-bcf7-907bb7f83bfa tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:26.187957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbbad93e-3de2-4fde-bcf7-907bb7f83bfa tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:26.188412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-dbbad93e-3de2-4fde-bcf7-907bb7f83bfa tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:26.193280 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac98bfe5-b186-469e-8e5c-23ebe79e6c0b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51164. Jul 20 05:32:26.198455 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec14a2d6-59f0-443f-9e2b-92ddf2d0a5cf] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51162. Jul 20 05:32:26.407282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-dbbad93e-3de2-4fde-bcf7-907bb7f83bfa tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:26.415186 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-dbbad93e-3de2-4fde-bcf7-907bb7f83bfa tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.245345 Jul 20 05:32:26.415808 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3746/7511] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:26 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:27.433032 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7f00ef50-e314-403d-a280-67bdad163689 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:27.433665 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7f00ef50-e314-403d-a280-67bdad163689 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:27.443267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f00ef50-e314-403d-a280-67bdad163689 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:27.443731 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f00ef50-e314-403d-a280-67bdad163689 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:27.444512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f00ef50-e314-403d-a280-67bdad163689 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:27.444959 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7f00ef50-e314-403d-a280-67bdad163689 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:27.451818 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] [33eca72a-4e3b-4f88-b8f7-6f5bf76f74ec] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51172. Jul 20 05:32:27.478221 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] [0d612395-2abe-406a-94ab-07f31ffa6d77] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51174. Jul 20 05:32:27.599403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7f00ef50-e314-403d-a280-67bdad163689 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:27.607005 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7f00ef50-e314-403d-a280-67bdad163689 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.177945 Jul 20 05:32:27.607566 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3766/7512] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:27 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:28.623719 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-73613472-24ef-431e-86a9-943005fcc856 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:28.624351 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-73613472-24ef-431e-86a9-943005fcc856 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:28.631564 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73613472-24ef-431e-86a9-943005fcc856 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:28.632038 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73613472-24ef-431e-86a9-943005fcc856 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:28.632825 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73613472-24ef-431e-86a9-943005fcc856 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:28.633277 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-73613472-24ef-431e-86a9-943005fcc856 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:28.764508 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-73613472-24ef-431e-86a9-943005fcc856 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:28.772979 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-73613472-24ef-431e-86a9-943005fcc856 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.153242 Jul 20 05:32:28.773561 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3747/7513] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:28 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:29.790910 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e7ac9158-add9-4d47-bf4b-647f7dac7892 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:29.791427 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e7ac9158-add9-4d47-bf4b-647f7dac7892 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:29.798312 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ac9158-add9-4d47-bf4b-647f7dac7892 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:29.798776 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ac9158-add9-4d47-bf4b-647f7dac7892 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:29.799553 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ac9158-add9-4d47-bf4b-647f7dac7892 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:29.800000 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e7ac9158-add9-4d47-bf4b-647f7dac7892 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:29.933735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e7ac9158-add9-4d47-bf4b-647f7dac7892 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:29.941382 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e7ac9158-add9-4d47-bf4b-647f7dac7892 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.154497 Jul 20 05:32:29.941965 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3767/7514] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:29 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:30.959230 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-17a09771-13f3-40e5-8fc5-17cbdea3d9e1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:30.959852 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-17a09771-13f3-40e5-8fc5-17cbdea3d9e1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:30.966781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17a09771-13f3-40e5-8fc5-17cbdea3d9e1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:30.967250 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17a09771-13f3-40e5-8fc5-17cbdea3d9e1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:30.968022 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17a09771-13f3-40e5-8fc5-17cbdea3d9e1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:30.968471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-17a09771-13f3-40e5-8fc5-17cbdea3d9e1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:31.106224 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-17a09771-13f3-40e5-8fc5-17cbdea3d9e1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:31.114710 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-17a09771-13f3-40e5-8fc5-17cbdea3d9e1 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.159786 Jul 20 05:32:31.115303 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3748/7515] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:30 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:32.132724 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f63c5727-c88b-41b7-8bf7-2e0ab839bccf tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:32.133394 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f63c5727-c88b-41b7-8bf7-2e0ab839bccf tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:32.140347 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f63c5727-c88b-41b7-8bf7-2e0ab839bccf tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:32.140810 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f63c5727-c88b-41b7-8bf7-2e0ab839bccf tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:32.141584 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f63c5727-c88b-41b7-8bf7-2e0ab839bccf tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:32.142031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f63c5727-c88b-41b7-8bf7-2e0ab839bccf tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:32.277604 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f63c5727-c88b-41b7-8bf7-2e0ab839bccf tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:32.285340 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f63c5727-c88b-41b7-8bf7-2e0ab839bccf tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.156854 Jul 20 05:32:32.285913 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3768/7516] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:32 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:33.302588 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-eaff99bc-876e-474a-a3b6-5652913796be tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:33.303207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-eaff99bc-876e-474a-a3b6-5652913796be tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:33.310111 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaff99bc-876e-474a-a3b6-5652913796be tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:33.310605 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaff99bc-876e-474a-a3b6-5652913796be tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:33.311376 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaff99bc-876e-474a-a3b6-5652913796be tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:33.311828 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-eaff99bc-876e-474a-a3b6-5652913796be tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:33.446386 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-eaff99bc-876e-474a-a3b6-5652913796be tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:33.455824 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-eaff99bc-876e-474a-a3b6-5652913796be tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.156505 Jul 20 05:32:33.456556 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3749/7517] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:33 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:34.474558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-88d390a8-3dfb-4e2b-afca-3318eebf635c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:34.475220 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-88d390a8-3dfb-4e2b-afca-3318eebf635c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:34.482156 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-88d390a8-3dfb-4e2b-afca-3318eebf635c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:34.482664 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-88d390a8-3dfb-4e2b-afca-3318eebf635c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:34.483441 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-88d390a8-3dfb-4e2b-afca-3318eebf635c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:34.483891 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-88d390a8-3dfb-4e2b-afca-3318eebf635c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:34.617677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-88d390a8-3dfb-4e2b-afca-3318eebf635c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:34.625409 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-88d390a8-3dfb-4e2b-afca-3318eebf635c tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.155649 Jul 20 05:32:34.625988 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3769/7518] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:34 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:35.642672 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-25eddf16-4fe6-4c77-80ab-28baa5b643ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:35.643302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-25eddf16-4fe6-4c77-80ab-28baa5b643ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:35.651100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25eddf16-4fe6-4c77-80ab-28baa5b643ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:35.651561 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25eddf16-4fe6-4c77-80ab-28baa5b643ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:35.652337 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25eddf16-4fe6-4c77-80ab-28baa5b643ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:35.652784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-25eddf16-4fe6-4c77-80ab-28baa5b643ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:35.785396 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-25eddf16-4fe6-4c77-80ab-28baa5b643ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:35.793297 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-25eddf16-4fe6-4c77-80ab-28baa5b643ad tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.154576 Jul 20 05:32:35.793877 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3750/7519] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:35 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:36.810729 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a7bfb33a-7089-4cb7-8fc0-0bacaaf1fdc7 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:36.811379 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a7bfb33a-7089-4cb7-8fc0-0bacaaf1fdc7 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:36.818500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7bfb33a-7089-4cb7-8fc0-0bacaaf1fdc7 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:36.818957 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7bfb33a-7089-4cb7-8fc0-0bacaaf1fdc7 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:36.819726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7bfb33a-7089-4cb7-8fc0-0bacaaf1fdc7 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:36.820163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a7bfb33a-7089-4cb7-8fc0-0bacaaf1fdc7 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:36.952921 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a7bfb33a-7089-4cb7-8fc0-0bacaaf1fdc7 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:36.961043 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a7bfb33a-7089-4cb7-8fc0-0bacaaf1fdc7 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.154187 Jul 20 05:32:36.961613 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3770/7520] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:36 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:37.978500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cce7f2e2-02c6-4d2d-ae1d-196a4364bc61 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:37.979414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cce7f2e2-02c6-4d2d-ae1d-196a4364bc61 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:37.986598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cce7f2e2-02c6-4d2d-ae1d-196a4364bc61 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:37.987061 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cce7f2e2-02c6-4d2d-ae1d-196a4364bc61 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:37.987844 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cce7f2e2-02c6-4d2d-ae1d-196a4364bc61 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:37.988952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cce7f2e2-02c6-4d2d-ae1d-196a4364bc61 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:38.134768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cce7f2e2-02c6-4d2d-ae1d-196a4364bc61 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:38.142566 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cce7f2e2-02c6-4d2d-ae1d-196a4364bc61 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.167995 Jul 20 05:32:38.143142 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3751/7521] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:37 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:39.160031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-1eedeea0-55ed-40c9-a6fc-25ca0a129a2b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:39.160772 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-1eedeea0-55ed-40c9-a6fc-25ca0a129a2b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:39.169789 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1eedeea0-55ed-40c9-a6fc-25ca0a129a2b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:39.171372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1eedeea0-55ed-40c9-a6fc-25ca0a129a2b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:39.172745 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1eedeea0-55ed-40c9-a6fc-25ca0a129a2b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:39.173841 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-1eedeea0-55ed-40c9-a6fc-25ca0a129a2b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:39.319716 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-1eedeea0-55ed-40c9-a6fc-25ca0a129a2b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:39.327577 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-1eedeea0-55ed-40c9-a6fc-25ca0a129a2b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1569 microversion: 2.1 time: 0.171547 Jul 20 05:32:39.328156 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3771/7522] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:39 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:39.344385 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-1e4af6e4-9352-42ce-8ecf-18f7313c8865 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:39.344985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-1e4af6e4-9352-42ce-8ecf-18f7313c8865 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:39.352505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e4af6e4-9352-42ce-8ecf-18f7313c8865 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:39.352985 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e4af6e4-9352-42ce-8ecf-18f7313c8865 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:39.353781 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e4af6e4-9352-42ce-8ecf-18f7313c8865 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:39.354266 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-1e4af6e4-9352-42ce-8ecf-18f7313c8865 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:39.502324 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-1e4af6e4-9352-42ce-8ecf-18f7313c8865 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "POST /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547/action" status: 202 len: 0 microversion: 2.1 time: 0.161771 Jul 20 05:32:39.503293 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3752/7523] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:32:39 2022] POST /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:32:39.512192 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d6aeee60-9b56-4aee-a78c-254a605080c8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:39.513230 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d6aeee60-9b56-4aee-a78c-254a605080c8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:39.521308 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6aeee60-9b56-4aee-a78c-254a605080c8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:39.522148 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6aeee60-9b56-4aee-a78c-254a605080c8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:39.523555 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6aeee60-9b56-4aee-a78c-254a605080c8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:39.524267 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d6aeee60-9b56-4aee-a78c-254a605080c8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:39.669368 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d6aeee60-9b56-4aee-a78c-254a605080c8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:39.679017 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d6aeee60-9b56-4aee-a78c-254a605080c8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1517 microversion: 2.1 time: 0.171107 Jul 20 05:32:39.679607 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3772/7524] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:39 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:40.698783 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-b5efe596-86ce-49b1-9993-a52df9f97ec6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:40.699394 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-b5efe596-86ce-49b1-9993-a52df9f97ec6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:40.706163 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5efe596-86ce-49b1-9993-a52df9f97ec6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:40.706823 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5efe596-86ce-49b1-9993-a52df9f97ec6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:40.707712 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5efe596-86ce-49b1-9993-a52df9f97ec6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:40.708233 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-b5efe596-86ce-49b1-9993-a52df9f97ec6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:40.763981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-fd8ce5bb-0a52-4488-b9da-6b4f1ad56aaf req-92288b13-9cf3-4a30-bd3c-a791f5d122b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85501081-d1fd-4bbd-9855-446c8fa56547", "name": "network-vif-unplugged", "status": "completed", "tag": "e5c1784b-0b98-4e99-841c-6ed5b6f825f7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:40.776461 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fd8ce5bb-0a52-4488-b9da-6b4f1ad56aaf req-92288b13-9cf3-4a30-bd3c-a791f5d122b2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:40.777624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-fd8ce5bb-0a52-4488-b9da-6b4f1ad56aaf req-92288b13-9cf3-4a30-bd3c-a791f5d122b2 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:40.791960 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.compute.server_external_events [req-fd8ce5bb-0a52-4488-b9da-6b4f1ad56aaf req-92288b13-9cf3-4a30-bd3c-a791f5d122b2 service nova] Unable to find a host for instance 85501081-d1fd-4bbd-9855-446c8fa56547. Dropping event network-vif-unplugged {{(pid=119606) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 05:32:40.793190 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-fd8ce5bb-0a52-4488-b9da-6b4f1ad56aaf req-92288b13-9cf3-4a30-bd3c-a791f5d122b2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033137 Jul 20 05:32:40.794391 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3773/7525] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 05:32:40.866869 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-b5efe596-86ce-49b1-9993-a52df9f97ec6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:40.874760 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-b5efe596-86ce-49b1-9993-a52df9f97ec6 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1519 microversion: 2.1 time: 0.180845 Jul 20 05:32:40.875426 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3753/7526] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:40 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:41.892704 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-2df35cea-be8a-4042-8713-cc15fb0a18ff tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:41.893324 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-2df35cea-be8a-4042-8713-cc15fb0a18ff tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:41.901315 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2df35cea-be8a-4042-8713-cc15fb0a18ff tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:41.901805 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2df35cea-be8a-4042-8713-cc15fb0a18ff tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:41.902621 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2df35cea-be8a-4042-8713-cc15fb0a18ff tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:41.903067 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-2df35cea-be8a-4042-8713-cc15fb0a18ff tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:42.041801 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-2df35cea-be8a-4042-8713-cc15fb0a18ff tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:42.049559 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-2df35cea-be8a-4042-8713-cc15fb0a18ff tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1519 microversion: 2.1 time: 0.160864 Jul 20 05:32:42.050150 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3774/7527] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:41 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:43.068456 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4ee97e54-4364-4626-bbcc-2ed9dc228bec tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:43.069013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4ee97e54-4364-4626-bbcc-2ed9dc228bec tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:43.076445 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ee97e54-4364-4626-bbcc-2ed9dc228bec tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:43.076909 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ee97e54-4364-4626-bbcc-2ed9dc228bec tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:43.077707 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ee97e54-4364-4626-bbcc-2ed9dc228bec tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:43.078158 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4ee97e54-4364-4626-bbcc-2ed9dc228bec tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:43.228902 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4ee97e54-4364-4626-bbcc-2ed9dc228bec tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:43.236989 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4ee97e54-4364-4626-bbcc-2ed9dc228bec tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1519 microversion: 2.1 time: 0.173469 Jul 20 05:32:43.237567 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3754/7528] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:43 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:43.871741 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:32:43.872298 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:32:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:32:44.255056 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9a81119c-7b1e-4c94-a9c7-18e5d1382463 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:44.255679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9a81119c-7b1e-4c94-a9c7-18e5d1382463 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:44.262859 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a81119c-7b1e-4c94-a9c7-18e5d1382463 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:44.263313 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a81119c-7b1e-4c94-a9c7-18e5d1382463 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:44.264075 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a81119c-7b1e-4c94-a9c7-18e5d1382463 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:44.264511 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a81119c-7b1e-4c94-a9c7-18e5d1382463 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:44.403550 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-9a81119c-7b1e-4c94-a9c7-18e5d1382463 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:44.412270 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9a81119c-7b1e-4c94-a9c7-18e5d1382463 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1519 microversion: 2.1 time: 0.161269 Jul 20 05:32:44.412859 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3775/7529] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:44 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:45.430144 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f3c66e24-aec0-419c-a1bd-af00838afe35 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:45.430806 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f3c66e24-aec0-419c-a1bd-af00838afe35 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:45.437716 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3c66e24-aec0-419c-a1bd-af00838afe35 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:45.438180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3c66e24-aec0-419c-a1bd-af00838afe35 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:45.438987 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3c66e24-aec0-419c-a1bd-af00838afe35 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:45.439436 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f3c66e24-aec0-419c-a1bd-af00838afe35 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:45.580108 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f3c66e24-aec0-419c-a1bd-af00838afe35 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:45.588079 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f3c66e24-aec0-419c-a1bd-af00838afe35 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.162453 Jul 20 05:32:45.588658 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3755/7530] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:45 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:46.441796 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-def8d01f-ce46-4a89-8f50-2adf3e5f0628 req-7e23e156-bccc-4f0c-bb98-5e980aab879f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85501081-d1fd-4bbd-9855-446c8fa56547", "tag": "e5c1784b-0b98-4e99-841c-6ed5b6f825f7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:46.453235 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-def8d01f-ce46-4a89-8f50-2adf3e5f0628 req-7e23e156-bccc-4f0c-bb98-5e980aab879f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:46.454001 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-def8d01f-ce46-4a89-8f50-2adf3e5f0628 req-7e23e156-bccc-4f0c-bb98-5e980aab879f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:46.466245 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-def8d01f-ce46-4a89-8f50-2adf3e5f0628 req-7e23e156-bccc-4f0c-bb98-5e980aab879f service nova] Creating event network-changed:e5c1784b-0b98-4e99-841c-6ed5b6f825f7 for instance 85501081-d1fd-4bbd-9855-446c8fa56547 on n-h2-760456-11 Jul 20 05:32:46.471900 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-def8d01f-ce46-4a89-8f50-2adf3e5f0628 req-7e23e156-bccc-4f0c-bb98-5e980aab879f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034517 Jul 20 05:32:46.473020 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3776/7531] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:32:46.606100 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ab7cb29e-72ca-4d75-947c-ac9fb4cf9c53 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:46.606769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ab7cb29e-72ca-4d75-947c-ac9fb4cf9c53 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:46.614975 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab7cb29e-72ca-4d75-947c-ac9fb4cf9c53 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:46.615441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab7cb29e-72ca-4d75-947c-ac9fb4cf9c53 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:46.616471 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab7cb29e-72ca-4d75-947c-ac9fb4cf9c53 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:46.616931 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ab7cb29e-72ca-4d75-947c-ac9fb4cf9c53 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:46.773123 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ab7cb29e-72ca-4d75-947c-ac9fb4cf9c53 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:46.781394 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ab7cb29e-72ca-4d75-947c-ac9fb4cf9c53 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.179143 Jul 20 05:32:46.781979 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3756/7532] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:46 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:47.798533 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-98b56ed1-d8c4-47fc-b159-03b14cd45c27 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:47.799236 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-98b56ed1-d8c4-47fc-b159-03b14cd45c27 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:47.806688 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98b56ed1-d8c4-47fc-b159-03b14cd45c27 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:47.807120 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98b56ed1-d8c4-47fc-b159-03b14cd45c27 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:47.807897 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98b56ed1-d8c4-47fc-b159-03b14cd45c27 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:47.808339 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-98b56ed1-d8c4-47fc-b159-03b14cd45c27 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:47.973538 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-98b56ed1-d8c4-47fc-b159-03b14cd45c27 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:47.981208 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-98b56ed1-d8c4-47fc-b159-03b14cd45c27 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.186966 Jul 20 05:32:47.981777 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3777/7533] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:47 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:48.999515 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-2a98ad8b-8d71-4163-a153-2060c56d4c25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:49.000151 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-2a98ad8b-8d71-4163-a153-2060c56d4c25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:49.007189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a98ad8b-8d71-4163-a153-2060c56d4c25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:49.007660 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a98ad8b-8d71-4163-a153-2060c56d4c25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:49.008461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a98ad8b-8d71-4163-a153-2060c56d4c25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:49.008904 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-2a98ad8b-8d71-4163-a153-2060c56d4c25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:49.146200 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-2a98ad8b-8d71-4163-a153-2060c56d4c25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:49.153887 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-2a98ad8b-8d71-4163-a153-2060c56d4c25 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.158409 Jul 20 05:32:49.154511 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3757/7534] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:48 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:50.171329 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-80934ae5-977e-463c-b1fa-68ebbfb351d8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:50.172019 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-80934ae5-977e-463c-b1fa-68ebbfb351d8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:50.179073 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80934ae5-977e-463c-b1fa-68ebbfb351d8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:50.179537 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80934ae5-977e-463c-b1fa-68ebbfb351d8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:50.180318 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80934ae5-977e-463c-b1fa-68ebbfb351d8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:50.180773 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-80934ae5-977e-463c-b1fa-68ebbfb351d8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:50.312250 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-80934ae5-977e-463c-b1fa-68ebbfb351d8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:50.320052 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-80934ae5-977e-463c-b1fa-68ebbfb351d8 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.152703 Jul 20 05:32:50.320827 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3778/7535] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:50 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:51.337711 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cb857dc8-5798-49e9-98ce-628fb401d6cb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:51.338361 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cb857dc8-5798-49e9-98ce-628fb401d6cb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:51.345275 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb857dc8-5798-49e9-98ce-628fb401d6cb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:51.345741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb857dc8-5798-49e9-98ce-628fb401d6cb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:51.346547 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb857dc8-5798-49e9-98ce-628fb401d6cb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:51.346995 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cb857dc8-5798-49e9-98ce-628fb401d6cb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:51.364807 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:51.484741 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cb857dc8-5798-49e9-98ce-628fb401d6cb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:51.493142 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cb857dc8-5798-49e9-98ce-628fb401d6cb tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.159989 Jul 20 05:32:51.493727 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3758/7536] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:51 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:52.510636 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8e804418-60c5-4869-8bbb-5657b3bf961f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:52.511254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8e804418-60c5-4869-8bbb-5657b3bf961f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:52.518117 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e804418-60c5-4869-8bbb-5657b3bf961f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:52.518601 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e804418-60c5-4869-8bbb-5657b3bf961f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:52.519362 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e804418-60c5-4869-8bbb-5657b3bf961f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:52.520072 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8e804418-60c5-4869-8bbb-5657b3bf961f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:52.659794 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8e804418-60c5-4869-8bbb-5657b3bf961f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:52.667974 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8e804418-60c5-4869-8bbb-5657b3bf961f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.161211 Jul 20 05:32:52.668541 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3779/7537] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:52 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:53.685302 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-0c9e4605-81f4-4f57-af69-56aae75897da tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:53.685936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-0c9e4605-81f4-4f57-af69-56aae75897da tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:53.692986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c9e4605-81f4-4f57-af69-56aae75897da tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:53.693441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c9e4605-81f4-4f57-af69-56aae75897da tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:53.694448 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c9e4605-81f4-4f57-af69-56aae75897da tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:53.694900 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-0c9e4605-81f4-4f57-af69-56aae75897da tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:53.826857 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-0c9e4605-81f4-4f57-af69-56aae75897da tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:53.834844 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-0c9e4605-81f4-4f57-af69-56aae75897da tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.153246 Jul 20 05:32:53.835177 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3759/7538] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:53 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:54.851962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-6ce24293-de8d-40a8-b76e-525e31af0ac5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:54.852617 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-6ce24293-de8d-40a8-b76e-525e31af0ac5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:54.859579 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ce24293-de8d-40a8-b76e-525e31af0ac5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:54.860419 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ce24293-de8d-40a8-b76e-525e31af0ac5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:54.861005 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ce24293-de8d-40a8-b76e-525e31af0ac5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:54.861336 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-6ce24293-de8d-40a8-b76e-525e31af0ac5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:54.996483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-6ce24293-de8d-40a8-b76e-525e31af0ac5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:54.998947 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=87 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:55.005861 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-6ce24293-de8d-40a8-b76e-525e31af0ac5 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.157814 Jul 20 05:32:55.007248 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3780/7539] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:54 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:56.025246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-37301304-293c-48cd-8e62-9ea1a6d2149b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:56.026217 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-37301304-293c-48cd-8e62-9ea1a6d2149b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:56.028979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=33 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:56.034481 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37301304-293c-48cd-8e62-9ea1a6d2149b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:56.034953 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37301304-293c-48cd-8e62-9ea1a6d2149b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:56.035739 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37301304-293c-48cd-8e62-9ea1a6d2149b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:56.036193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-37301304-293c-48cd-8e62-9ea1a6d2149b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:56.171842 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-37301304-293c-48cd-8e62-9ea1a6d2149b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:56.180138 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-37301304-293c-48cd-8e62-9ea1a6d2149b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.159796 Jul 20 05:32:56.180753 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3760/7540] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:56 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:56.976083 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-f2c2a234-75f6-46a4-b159-0e911775d4a3 req-90c924a2-cd18-4f37-ba58-8cbc81a9c590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85501081-d1fd-4bbd-9855-446c8fa56547", "name": "network-vif-plugged", "status": "completed", "tag": "e5c1784b-0b98-4e99-841c-6ed5b6f825f7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:56.980529 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=33 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:56.987157 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f2c2a234-75f6-46a4-b159-0e911775d4a3 req-90c924a2-cd18-4f37-ba58-8cbc81a9c590 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:56.987613 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-f2c2a234-75f6-46a4-b159-0e911775d4a3 req-90c924a2-cd18-4f37-ba58-8cbc81a9c590 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:57.003505 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-f2c2a234-75f6-46a4-b159-0e911775d4a3 req-90c924a2-cd18-4f37-ba58-8cbc81a9c590 service nova] Creating event network-vif-plugged:e5c1784b-0b98-4e99-841c-6ed5b6f825f7 for instance 85501081-d1fd-4bbd-9855-446c8fa56547 on n-h2-760456-11 Jul 20 05:32:57.010263 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-f2c2a234-75f6-46a4-b159-0e911775d4a3 req-90c924a2-cd18-4f37-ba58-8cbc81a9c590 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038647 Jul 20 05:32:57.011103 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3781/7541] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:32:57.198414 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-89cd2383-2a08-4c44-8245-2b8971deceb2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:57.199189 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-89cd2383-2a08-4c44-8245-2b8971deceb2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:57.205398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89cd2383-2a08-4c44-8245-2b8971deceb2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:57.205899 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89cd2383-2a08-4c44-8245-2b8971deceb2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:57.206708 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89cd2383-2a08-4c44-8245-2b8971deceb2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:57.207161 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-89cd2383-2a08-4c44-8245-2b8971deceb2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:57.339388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-89cd2383-2a08-4c44-8245-2b8971deceb2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:57.347026 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-89cd2383-2a08-4c44-8245-2b8971deceb2 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1575 microversion: 2.1 time: 0.153994 Jul 20 05:32:57.347611 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3761/7542] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:57 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:58.365577 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-e2b14518-cf7a-4b62-b0ef-440e3e3d8f87 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:58.367600 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-e2b14518-cf7a-4b62-b0ef-440e3e3d8f87 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:58.374294 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2b14518-cf7a-4b62-b0ef-440e3e3d8f87 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:58.374753 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2b14518-cf7a-4b62-b0ef-440e3e3d8f87 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:58.375520 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2b14518-cf7a-4b62-b0ef-440e3e3d8f87 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:58.375966 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-e2b14518-cf7a-4b62-b0ef-440e3e3d8f87 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:58.514953 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-e2b14518-cf7a-4b62-b0ef-440e3e3d8f87 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:58.523185 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-e2b14518-cf7a-4b62-b0ef-440e3e3d8f87 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1562 microversion: 2.1 time: 0.161901 Jul 20 05:32:58.523734 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3782/7543] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:58 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:12.304764 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=3 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:12.305529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=20 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:12.308058 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:12.309041 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=9 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:12.311784 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-47b96cb0-434f-4de2-9dc0-1b3c82dc6340 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:12.312284 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-47b96cb0-434f-4de2-9dc0-1b3c82dc6340 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:12.314186 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-b9009ca9-5e6d-4c41-96cd-761ff5583b27 req-1c58c859-709a-40c2-943a-c958037c4ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85501081-d1fd-4bbd-9855-446c8fa56547", "tag": "e5c1784b-0b98-4e99-841c-6ed5b6f825f7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:12.321001 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47b96cb0-434f-4de2-9dc0-1b3c82dc6340 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:12.321468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47b96cb0-434f-4de2-9dc0-1b3c82dc6340 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:12.322287 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47b96cb0-434f-4de2-9dc0-1b3c82dc6340 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:12.322770 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-47b96cb0-434f-4de2-9dc0-1b3c82dc6340 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:12.325545 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b9009ca9-5e6d-4c41-96cd-761ff5583b27 req-1c58c859-709a-40c2-943a-c958037c4ccc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:12.326004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-b9009ca9-5e6d-4c41-96cd-761ff5583b27 req-1c58c859-709a-40c2-943a-c958037c4ccc service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:12.343000 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-b9009ca9-5e6d-4c41-96cd-761ff5583b27 req-1c58c859-709a-40c2-943a-c958037c4ccc service nova] Creating event network-changed:e5c1784b-0b98-4e99-841c-6ed5b6f825f7 for instance 85501081-d1fd-4bbd-9855-446c8fa56547 on n-h2-760456-11 Jul 20 05:34:12.349442 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-b9009ca9-5e6d-4c41-96cd-761ff5583b27 req-1c58c859-709a-40c2-943a-c958037c4ccc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044246 Jul 20 05:34:12.350548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-47b96cb0-434f-4de2-9dc0-1b3c82dc6340 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:34:12.350692 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3783/7544] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:34:12.449175 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-47b96cb0-434f-4de2-9dc0-1b3c82dc6340 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "DELETE /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 204 len: 0 microversion: 2.1 time: 0.146159 Jul 20 05:34:12.453711 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3762/7545] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:34:12 2022] DELETE /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:34:12.461658 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-5280236e-927a-48c1-9086-07abb80d977b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:12.463269 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-5280236e-927a-48c1-9086-07abb80d977b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:12.476712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5280236e-927a-48c1-9086-07abb80d977b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:12.477334 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5280236e-927a-48c1-9086-07abb80d977b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:12.478393 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5280236e-927a-48c1-9086-07abb80d977b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:12.478956 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-5280236e-927a-48c1-9086-07abb80d977b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:12.630110 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-5280236e-927a-48c1-9086-07abb80d977b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:12.637766 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-5280236e-927a-48c1-9086-07abb80d977b tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.182039 Jul 20 05:34:12.638386 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3784/7546] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:12 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:34:13.656506 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-321f55c2-e6b4-4a1f-997b-1e51659ffa3a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:13.657381 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-321f55c2-e6b4-4a1f-997b-1e51659ffa3a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:13.666504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-321f55c2-e6b4-4a1f-997b-1e51659ffa3a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:13.666979 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-321f55c2-e6b4-4a1f-997b-1e51659ffa3a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:13.667936 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-321f55c2-e6b4-4a1f-997b-1e51659ffa3a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:13.668398 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-321f55c2-e6b4-4a1f-997b-1e51659ffa3a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:13.809375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-321f55c2-e6b4-4a1f-997b-1e51659ffa3a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:13.817727 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-321f55c2-e6b4-4a1f-997b-1e51659ffa3a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1568 microversion: 2.1 time: 0.165597 Jul 20 05:34:13.818324 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3763/7547] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:13 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:14.430456 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-3f87a689-5804-47b9-9ba4-1d02db8159d0 req-712a0dcb-03b5-43a9-bba1-ce59a4b5ef20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85501081-d1fd-4bbd-9855-446c8fa56547", "name": "network-vif-deleted", "tag": "e5c1784b-0b98-4e99-841c-6ed5b6f825f7"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:14.440172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3f87a689-5804-47b9-9ba4-1d02db8159d0 req-712a0dcb-03b5-43a9-bba1-ce59a4b5ef20 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:14.440624 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-3f87a689-5804-47b9-9ba4-1d02db8159d0 req-712a0dcb-03b5-43a9-bba1-ce59a4b5ef20 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:14.452119 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-3f87a689-5804-47b9-9ba4-1d02db8159d0 req-712a0dcb-03b5-43a9-bba1-ce59a4b5ef20 service nova] Creating event network-vif-deleted:e5c1784b-0b98-4e99-841c-6ed5b6f825f7 for instance 85501081-d1fd-4bbd-9855-446c8fa56547 on n-h2-760456-11 Jul 20 05:34:14.458117 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-3f87a689-5804-47b9-9ba4-1d02db8159d0 req-712a0dcb-03b5-43a9-bba1-ce59a4b5ef20 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031294 Jul 20 05:34:14.458790 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3785/7548] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:34:14.836318 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ce84cc08-4cf3-44f4-a2d1-72244ec4726a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:14.838197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ce84cc08-4cf3-44f4-a2d1-72244ec4726a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:14.845629 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce84cc08-4cf3-44f4-a2d1-72244ec4726a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:14.846096 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce84cc08-4cf3-44f4-a2d1-72244ec4726a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:14.846924 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce84cc08-4cf3-44f4-a2d1-72244ec4726a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:14.847598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ce84cc08-4cf3-44f4-a2d1-72244ec4726a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:14.916620 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ce84cc08-4cf3-44f4-a2d1-72244ec4726a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:14.924346 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ce84cc08-4cf3-44f4-a2d1-72244ec4726a tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1219 microversion: 2.1 time: 0.092947 Jul 20 05:34:14.924903 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3764/7549] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:14 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:15.943369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a9ded374-a5ae-4f95-8ff9-a90f0215c2b9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:15.944107 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a9ded374-a5ae-4f95-8ff9-a90f0215c2b9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:15.950512 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9ded374-a5ae-4f95-8ff9-a90f0215c2b9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:15.950973 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9ded374-a5ae-4f95-8ff9-a90f0215c2b9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:15.951751 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9ded374-a5ae-4f95-8ff9-a90f0215c2b9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:15.952197 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a9ded374-a5ae-4f95-8ff9-a90f0215c2b9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:16.023403 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a9ded374-a5ae-4f95-8ff9-a90f0215c2b9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:16.031326 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a9ded374-a5ae-4f95-8ff9-a90f0215c2b9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1219 microversion: 2.1 time: 0.093467 Jul 20 05:34:16.031911 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3786/7550] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:15 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:17.050574 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-72b230cd-f802-43cb-b013-a730ca4cd21f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:17.051110 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-72b230cd-f802-43cb-b013-a730ca4cd21f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:17.058996 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72b230cd-f802-43cb-b013-a730ca4cd21f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:17.059462 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72b230cd-f802-43cb-b013-a730ca4cd21f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:17.060254 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72b230cd-f802-43cb-b013-a730ca4cd21f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:17.060839 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-72b230cd-f802-43cb-b013-a730ca4cd21f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:17.126816 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-72b230cd-f802-43cb-b013-a730ca4cd21f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:17.138199 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-72b230cd-f802-43cb-b013-a730ca4cd21f tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1219 microversion: 2.1 time: 0.091765 Jul 20 05:34:17.139023 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3765/7551] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:17 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:18.156361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-f8ad2c2e-055d-47f6-bf52-4b53f5d00864 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:18.157094 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-f8ad2c2e-055d-47f6-bf52-4b53f5d00864 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:18.164807 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8ad2c2e-055d-47f6-bf52-4b53f5d00864 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:18.165254 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8ad2c2e-055d-47f6-bf52-4b53f5d00864 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:18.166034 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8ad2c2e-055d-47f6-bf52-4b53f5d00864 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:18.166513 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-f8ad2c2e-055d-47f6-bf52-4b53f5d00864 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:18.228823 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-f8ad2c2e-055d-47f6-bf52-4b53f5d00864 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0839820df2e469fbfafa017a9a71d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6aabed5c94415ad006ffbcc434497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:18.236415 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-f8ad2c2e-055d-47f6-bf52-4b53f5d00864 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 200 len: 1219 microversion: 2.1 time: 0.084022 Jul 20 05:34:18.236998 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3787/7552] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:18 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:19.254388 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-92004740-6358-4cca-86a7-e45c9c8458d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:19.254955 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-92004740-6358-4cca-86a7-e45c9c8458d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] [instance: 85501081-d1fd-4bbd-9855-446c8fa56547] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:19.262133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92004740-6358-4cca-86a7-e45c9c8458d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:19.262635 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92004740-6358-4cca-86a7-e45c9c8458d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:19.263431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92004740-6358-4cca-86a7-e45c9c8458d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:19.263895 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-92004740-6358-4cca-86a7-e45c9c8458d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:19.278236 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-92004740-6358-4cca-86a7-e45c9c8458d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] HTTP exception thrown: Instance 85501081-d1fd-4bbd-9855-446c8fa56547 could not be found. Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-92004740-6358-4cca-86a7-e45c9c8458d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Request method failure captured: Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 HTTP/1.1 Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi15HINQ1w4By1HmTQhj-Vq4um-Tu-mU0-ZVQTWqwBlkFgkIV5fTESeVhgMVcguZdIx-pp-RvazLbUw_f0ETNUi1YKauiALVCvJh8UoiWqa5fWTU9sLAJxUp3iXlJW0sUc2uJ5EfgKqCKBc7a36z5lM3gEBqbTJlMF04gF5_U_k6HUGNE Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 11f6aabed5c94415ad006ffbcc434497 Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestShelveInstance-994652073 Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/11f6aabed5c94415ad006ffbcc434497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/11f6aabed5c94415ad006ffbcc434497"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/11f6aabed5c94415ad006ffbcc434497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_11f6aabed5c94415ad006ffbcc434497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestShelveInstance-994652073 Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 11f6aabed5c94415ad006ffbcc434497 Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestShelveInstance-994652073 Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestShelveInstance-994652073-project Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: b0839820df2e469fbfafa017a9a71d5f Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestShelveInstance-994652073-project Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 85501081-d1fd-4bbd-9855-446c8fa56547 could not be found. Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '85501081-d1fd-4bbd-9855-446c8fa56547'} Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85501081-d1fd-4bbd-9855-446c8fa56547 could not be found. Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85501081-d1fd-4bbd-9855-446c8fa56547 could not be found. Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:34:19.279942 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:34:19.284298 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:34:19.284298 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:34:19.284298 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:34:19.284298 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:34:19.284298 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:34:19.284298 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85501081-d1fd-4bbd-9855-446c8fa56547 could not be found. Jul 20 05:34:19.284298 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:34:19.284298 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-92004740-6358-4cca-86a7-e45c9c8458d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Returning 404 to user: Instance 85501081-d1fd-4bbd-9855-446c8fa56547 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:34:19.284298 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-92004740-6358-4cca-86a7-e45c9c8458d9 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547" status: 404 len: 111 microversion: 2.1 time: 0.031819 Jul 20 05:34:19.284298 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3766/7553] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:19 2022] GET /compute/v2.1/servers/85501081-d1fd-4bbd-9855-446c8fa56547 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:34:19.457387 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b3d4322a-0814-4e0f-8b59-f1a5bbb6a338 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] Calling method '.version_select at 0x7fb840cb58b0>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:19.485841 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b3d4322a-0814-4e0f-8b59-f1a5bbb6a338 tempest-TestShelveInstance-994652073 tempest-TestShelveInstance-994652073-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1079158385" status: 202 len: 0 microversion: 2.1 time: 0.033325 Jul 20 05:34:19.486646 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3788/7554] 10.222.0.59 () {58 vars in 1253 bytes} [Wed Jul 20 05:34:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1079158385 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:34:37.057751 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:37.058946 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:37.255091 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-5655f3ff-70c9-46af-bd06-14c29d68038e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Action: 'create', calling method: .version_select at 0x7fb841e00dc0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1335118399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKl9rEGurvQzL/tVf/MwG/aZSuBVDLmqLg4zs37FvrO8N6YT4aCBAEYNVFTr4HNz/MH7rkoSckjB5TD7q/gKfkt0MxFyqCg+QrBIPjnCDFbSR0OEIEGKSQCSTEFrLAiHoA=="}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:37.269757 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-5655f3ff-70c9-46af-bd06-14c29d68038e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Getting quotas for project 515ab2acb4d84b89b0cdc1efe80300b9. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:34:37.275154 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.quota [None req-5655f3ff-70c9-46af-bd06-14c29d68038e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Getting quotas for user 67ce3f6110804050b87c49cb26faf925 and project 515ab2acb4d84b89b0cdc1efe80300b9. Resources: {'key_pairs'} {{(pid=119605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:34:37.302524 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-5655f3ff-70c9-46af-bd06-14c29d68038e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.249836 Jul 20 05:34:37.303140 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3767/7555] 10.222.0.59 () {60 vars in 1158 bytes} [Wed Jul 20 05:34:37 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:34:38.730639 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=22 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:38.731391 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:38.736103 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1516619601", "imageRef": "e42aeec8-ce44-4145-9a4d-e614edbe956b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1335118399", "security_groups": [{"name": "tempest-secgroup-smoke-413939980"}], "networks": [{"uuid": "4be2b78c-a0d7-4c05-a211-d429af5e5e57"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:38.864882 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] validate_networks() for [('4be2b78c-a0d7-4c05-a211-d429af5e5e57', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:34:39.398459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:34:39.398780 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:34:39.399264 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:34:39.399930 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:34:39.400526 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:34:39.411684 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:39.412152 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:39.412975 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:39.413424 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:39.432499 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Getting quotas for project 515ab2acb4d84b89b0cdc1efe80300b9. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:34:39.438116 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Getting quotas for user 67ce3f6110804050b87c49cb26faf925 and project 515ab2acb4d84b89b0cdc1efe80300b9. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:34:39.451325 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:34:39.453972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e42aeec8-ce44-4145-9a4d-e614edbe956b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:34:39.513235 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-fd8c247b-06b2-4f21-bd5f-c2654c8568a8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.784441 Jul 20 05:34:39.521135 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3789/7556] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:34:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:34:39.532295 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-33a4cbde-5159-4294-ae7d-81d358d3ad4c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:39.533513 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-33a4cbde-5159-4294-ae7d-81d358d3ad4c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:39.914105 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-33a4cbde-5159-4294-ae7d-81d358d3ad4c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:39.924749 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-33a4cbde-5159-4294-ae7d-81d358d3ad4c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1249 microversion: 2.1 time: 0.397109 Jul 20 05:34:39.925515 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3768/7557] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:39 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1249 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:40.942890 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-58ababc9-5721-40a8-b286-9598c769607a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:40.943523 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-58ababc9-5721-40a8-b286-9598c769607a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:40.953679 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58ababc9-5721-40a8-b286-9598c769607a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:40.954515 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58ababc9-5721-40a8-b286-9598c769607a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:40.955518 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58ababc9-5721-40a8-b286-9598c769607a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:40.956163 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-58ababc9-5721-40a8-b286-9598c769607a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:41.038735 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-58ababc9-5721-40a8-b286-9598c769607a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:41.048061 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-58ababc9-5721-40a8-b286-9598c769607a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1307 microversion: 2.1 time: 0.110526 Jul 20 05:34:41.048991 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3790/7558] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:40 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:42.066419 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4b9028c5-550e-4213-8c3e-0891c901f0bb tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:42.067057 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4b9028c5-550e-4213-8c3e-0891c901f0bb tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:42.077482 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b9028c5-550e-4213-8c3e-0891c901f0bb tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:42.077958 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b9028c5-550e-4213-8c3e-0891c901f0bb tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:42.078937 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b9028c5-550e-4213-8c3e-0891c901f0bb tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:42.079255 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4b9028c5-550e-4213-8c3e-0891c901f0bb tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:42.319479 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-4b9028c5-550e-4213-8c3e-0891c901f0bb tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:42.328706 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4b9028c5-550e-4213-8c3e-0891c901f0bb tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1374 microversion: 2.1 time: 0.266144 Jul 20 05:34:42.329451 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3769/7559] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:42 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1374 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:42.388037 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-d20f89c5-a70c-488d-bb36-ea2242ec8b42 req-491d29a9-4313-417a-844e-bd7b8e8ebfbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a070c767-6239-46bf-ac01-de90e20d7578", "tag": "89014d89-9e40-4912-a007-ed9068148cb4"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:42.401275 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d20f89c5-a70c-488d-bb36-ea2242ec8b42 req-491d29a9-4313-417a-844e-bd7b8e8ebfbe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:42.401969 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d20f89c5-a70c-488d-bb36-ea2242ec8b42 req-491d29a9-4313-417a-844e-bd7b8e8ebfbe service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:42.420355 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-d20f89c5-a70c-488d-bb36-ea2242ec8b42 req-491d29a9-4313-417a-844e-bd7b8e8ebfbe service nova] Creating event network-changed:89014d89-9e40-4912-a007-ed9068148cb4 for instance a070c767-6239-46bf-ac01-de90e20d7578 on n-h1-760456-11 Jul 20 05:34:42.427151 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-d20f89c5-a70c-488d-bb36-ea2242ec8b42 req-491d29a9-4313-417a-844e-bd7b8e8ebfbe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043442 Jul 20 05:34:42.428343 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3791/7560] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:34:43.345566 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f0dd7748-8de8-4bf2-bbaf-adfbc3ec752c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:43.346126 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f0dd7748-8de8-4bf2-bbaf-adfbc3ec752c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:43.353775 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0dd7748-8de8-4bf2-bbaf-adfbc3ec752c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:43.354273 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0dd7748-8de8-4bf2-bbaf-adfbc3ec752c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:43.355071 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0dd7748-8de8-4bf2-bbaf-adfbc3ec752c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:43.355530 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0dd7748-8de8-4bf2-bbaf-adfbc3ec752c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:43.493753 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f0dd7748-8de8-4bf2-bbaf-adfbc3ec752c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:43.505785 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f0dd7748-8de8-4bf2-bbaf-adfbc3ec752c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1374 microversion: 2.1 time: 0.164159 Jul 20 05:34:43.506403 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3770/7561] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:43 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:44.524686 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6117ab9-39db-4875-a22e-0e878b8b02e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:44.525423 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6117ab9-39db-4875-a22e-0e878b8b02e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:44.532978 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6117ab9-39db-4875-a22e-0e878b8b02e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:44.533506 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6117ab9-39db-4875-a22e-0e878b8b02e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:44.534383 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6117ab9-39db-4875-a22e-0e878b8b02e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:44.534838 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6117ab9-39db-4875-a22e-0e878b8b02e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:44.673875 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6117ab9-39db-4875-a22e-0e878b8b02e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:44.682146 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6117ab9-39db-4875-a22e-0e878b8b02e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1374 microversion: 2.1 time: 0.161861 Jul 20 05:34:44.682811 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3792/7562] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:44 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:45.699324 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-60980469-2f15-4fd9-9536-a9a53e8e0920 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:45.699962 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-60980469-2f15-4fd9-9536-a9a53e8e0920 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:45.707493 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60980469-2f15-4fd9-9536-a9a53e8e0920 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:45.707969 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60980469-2f15-4fd9-9536-a9a53e8e0920 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:45.708768 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60980469-2f15-4fd9-9536-a9a53e8e0920 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:45.709231 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-60980469-2f15-4fd9-9536-a9a53e8e0920 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:45.851141 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-60980469-2f15-4fd9-9536-a9a53e8e0920 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:45.859227 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-60980469-2f15-4fd9-9536-a9a53e8e0920 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1374 microversion: 2.1 time: 0.163857 Jul 20 05:34:45.859911 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3771/7563] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:45 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:46.876706 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d2e17ebd-5fd1-40ee-888b-861875b5c119 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:46.877849 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d2e17ebd-5fd1-40ee-888b-861875b5c119 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:46.884774 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2e17ebd-5fd1-40ee-888b-861875b5c119 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:46.885237 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2e17ebd-5fd1-40ee-888b-861875b5c119 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:46.886015 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2e17ebd-5fd1-40ee-888b-861875b5c119 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:46.886488 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d2e17ebd-5fd1-40ee-888b-861875b5c119 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:47.019420 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-d2e17ebd-5fd1-40ee-888b-861875b5c119 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:47.027009 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d2e17ebd-5fd1-40ee-888b-861875b5c119 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1374 microversion: 2.1 time: 0.154317 Jul 20 05:34:47.027587 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3793/7564] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:46 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:47.501563 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-6ab99083-6f6b-4035-915a-8360ce89724b req-3541c3f5-cf29-48b3-ab5c-57427c25b796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a070c767-6239-46bf-ac01-de90e20d7578", "name": "network-vif-plugged", "status": "completed", "tag": "89014d89-9e40-4912-a007-ed9068148cb4"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:47.510034 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6ab99083-6f6b-4035-915a-8360ce89724b req-3541c3f5-cf29-48b3-ab5c-57427c25b796 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:47.510529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-6ab99083-6f6b-4035-915a-8360ce89724b req-3541c3f5-cf29-48b3-ab5c-57427c25b796 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:47.524824 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-6ab99083-6f6b-4035-915a-8360ce89724b req-3541c3f5-cf29-48b3-ab5c-57427c25b796 service nova] Creating event network-vif-plugged:89014d89-9e40-4912-a007-ed9068148cb4 for instance a070c767-6239-46bf-ac01-de90e20d7578 on n-h1-760456-11 Jul 20 05:34:47.529999 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-6ab99083-6f6b-4035-915a-8360ce89724b req-3541c3f5-cf29-48b3-ab5c-57427c25b796 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094417 Jul 20 05:34:47.530676 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3772/7565] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:34:48.043039 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bacc6fcd-9124-46ef-96c9-82b41c7c5b9a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:48.043654 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bacc6fcd-9124-46ef-96c9-82b41c7c5b9a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:48.051370 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bacc6fcd-9124-46ef-96c9-82b41c7c5b9a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:48.051822 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bacc6fcd-9124-46ef-96c9-82b41c7c5b9a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:48.052589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bacc6fcd-9124-46ef-96c9-82b41c7c5b9a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:48.053031 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bacc6fcd-9124-46ef-96c9-82b41c7c5b9a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:48.193831 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bacc6fcd-9124-46ef-96c9-82b41c7c5b9a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:48.201269 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bacc6fcd-9124-46ef-96c9-82b41c7c5b9a tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1374 microversion: 2.1 time: 0.162139 Jul 20 05:34:48.201838 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3794/7566] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:48 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:49.219102 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-f0188245-d1ef-4320-9957-eaabcf0649ed tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:49.219863 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-f0188245-d1ef-4320-9957-eaabcf0649ed tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:49.227026 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0188245-d1ef-4320-9957-eaabcf0649ed tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:49.227590 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0188245-d1ef-4320-9957-eaabcf0649ed tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:49.228529 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0188245-d1ef-4320-9957-eaabcf0649ed tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:49.229075 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-f0188245-d1ef-4320-9957-eaabcf0649ed tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:49.363889 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-f0188245-d1ef-4320-9957-eaabcf0649ed tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:49.371637 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-f0188245-d1ef-4320-9957-eaabcf0649ed tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1558 microversion: 2.1 time: 0.157730 Jul 20 05:34:49.372205 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3773/7567] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:49 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:49.394747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bbf50564-c9c5-4096-80e2-a18540f31eaf tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:49.395372 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bbf50564-c9c5-4096-80e2-a18540f31eaf tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:49.402243 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbf50564-c9c5-4096-80e2-a18540f31eaf tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:49.402726 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbf50564-c9c5-4096-80e2-a18540f31eaf tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:49.403778 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbf50564-c9c5-4096-80e2-a18540f31eaf tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:49.404223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bbf50564-c9c5-4096-80e2-a18540f31eaf tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:49.422824 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:49.445446 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:49.540013 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bbf50564-c9c5-4096-80e2-a18540f31eaf tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:49.547517 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bbf50564-c9c5-4096-80e2-a18540f31eaf tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1558 microversion: 2.1 time: 0.163031 Jul 20 05:34:49.548090 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3795/7568] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:49 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:51.521411 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=6 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:51.577259 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-9c677a4a-1d46-4f4d-8a73-9d8aefbbb4a5 req-7da0d19f-ec8a-4fe0-9e6e-3e94af1e69c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a070c767-6239-46bf-ac01-de90e20d7578", "tag": "89014d89-9e40-4912-a007-ed9068148cb4"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:51.586492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9c677a4a-1d46-4f4d-8a73-9d8aefbbb4a5 req-7da0d19f-ec8a-4fe0-9e6e-3e94af1e69c8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:51.586961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9c677a4a-1d46-4f4d-8a73-9d8aefbbb4a5 req-7da0d19f-ec8a-4fe0-9e6e-3e94af1e69c8 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:51.598979 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-9c677a4a-1d46-4f4d-8a73-9d8aefbbb4a5 req-7da0d19f-ec8a-4fe0-9e6e-3e94af1e69c8 service nova] Creating event network-changed:89014d89-9e40-4912-a007-ed9068148cb4 for instance a070c767-6239-46bf-ac01-de90e20d7578 on n-h1-760456-11 Jul 20 05:34:51.604261 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-9c677a4a-1d46-4f4d-8a73-9d8aefbbb4a5 req-7da0d19f-ec8a-4fe0-9e6e-3e94af1e69c8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087678 Jul 20 05:34:51.604879 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3774/7569] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:35:20.678497 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:35:20.679227 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:35:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:36:46.977912 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0d612395-2abe-406a-94ab-07f31ffa6d77] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:36:46.979155 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33eca72a-4e3b-4f88-b8f7-6f5bf76f74ec] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 05:36:46.979596 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:46.980434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=34 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:46.984758 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-29101c3b-b061-45c9-976d-d6160960a551 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1986419460"}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:46.985779 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-29101c3b-b061-45c9-976d-d6160960a551 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:46.994369 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29101c3b-b061-45c9-976d-d6160960a551 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:46.994829 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29101c3b-b061-45c9-976d-d6160960a551 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:46.995592 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29101c3b-b061-45c9-976d-d6160960a551 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:46.996028 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-29101c3b-b061-45c9-976d-d6160960a551 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:47.273001 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-29101c3b-b061-45c9-976d-d6160960a551 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "POST /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578/action" status: 202 len: 0 microversion: 2.1 time: 0.296571 Jul 20 05:36:47.273623 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3796/7570] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:36:46 2022] POST /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 05:36:52.244706 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac98bfe5-b186-469e-8e5c-23ebe79e6c0b] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:36:52.246410 n-d-760456-11 devstack@n-api.service[119605]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec14a2d6-59f0-443f-9e2b-92ddf2d0a5cf] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:36:52.247375 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:52.248405 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=28 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:52.254497 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-a0837a6c-9e3f-4e2e-b7cf-a40b80b665e8 req-d0bc131b-19a2-422a-94b4-69893f8810f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a070c767-6239-46bf-ac01-de90e20d7578", "name": "network-vif-plugged", "status": "completed", "tag": "89014d89-9e40-4912-a007-ed9068148cb4"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:52.265609 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a0837a6c-9e3f-4e2e-b7cf-a40b80b665e8 req-d0bc131b-19a2-422a-94b4-69893f8810f7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:52.266505 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-a0837a6c-9e3f-4e2e-b7cf-a40b80b665e8 req-d0bc131b-19a2-422a-94b4-69893f8810f7 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:52.280065 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-a0837a6c-9e3f-4e2e-b7cf-a40b80b665e8 req-d0bc131b-19a2-422a-94b4-69893f8810f7 service nova] Creating event network-vif-plugged:89014d89-9e40-4912-a007-ed9068148cb4 for instance a070c767-6239-46bf-ac01-de90e20d7578 on n-h1-760456-11 Jul 20 05:36:52.286999 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-a0837a6c-9e3f-4e2e-b7cf-a40b80b665e8 req-d0bc131b-19a2-422a-94b4-69893f8810f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043517 Jul 20 05:36:52.288257 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3775/7571] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:59.768558 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:59.769357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:59.775999 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2015126764", "imageRef": "14b00f45-5e42-444e-96b8-81da807a6f34", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1335118399", "security_groups": [{"name": "tempest-secgroup-smoke-413939980"}], "networks": [{"uuid": "4be2b78c-a0d7-4c05-a211-d429af5e5e57"}]}} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:59.800695 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] [33eca72a-4e3b-4f88-b8f7-6f5bf76f74ec] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51658. Jul 20 05:36:59.802920 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] [0d612395-2abe-406a-94ab-07f31ffa6d77] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51656. Jul 20 05:36:59.889605 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.network.neutron [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] validate_networks() for [('4be2b78c-a0d7-4c05-a211-d429af5e5e57', None, None, None, None, None)] {{(pid=119606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:37:00.272445 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Flavor limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:37:00.272893 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Image limits 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:37:00.273357 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Flavor pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:37:00.273792 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Image pref 0:0:0 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:37:00.274211 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.virt.hardware [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:37:00.283161 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:00.283618 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:00.284426 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:00.284871 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:00.302899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Getting quotas for project 515ab2acb4d84b89b0cdc1efe80300b9. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:37:00.308113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.quota [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Getting quotas for user 67ce3f6110804050b87c49cb26faf925 and project 515ab2acb4d84b89b0cdc1efe80300b9. Resources: {'instances', 'cores', 'ram'} {{(pid=119606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:37:00.321137 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Going to run 1 instances... {{(pid=119606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:37:00.323653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b00f45-5e42-444e-96b8-81da807a6f34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:37:00.367937 n-d-760456-11 devstack@n-api.service[119606]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [9e48f012-368c-4e1e-959c-b0206ed1e785] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:37:00.629961 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:37:00.630695 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:37:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:37:01.375128 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [9e48f012-368c-4e1e-959c-b0206ed1e785] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51670. Jul 20 05:37:01.379055 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-d17463a0-ae44-428c-91c4-d013ccf58fd3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.613698 Jul 20 05:37:01.380461 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3797/7572] 10.222.0.59 () {60 vars in 1146 bytes} [Wed Jul 20 05:36:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:37:01.392416 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ad8a00d9-e769-43bf-9344-c430e7468da3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:01.393133 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ad8a00d9-e769-43bf-9344-c430e7468da3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:01.407311 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac98bfe5-b186-469e-8e5c-23ebe79e6c0b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51674. Jul 20 05:37:01.421356 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec14a2d6-59f0-443f-9e2b-92ddf2d0a5cf] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51676. Jul 20 05:37:01.459669 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ad8a00d9-e769-43bf-9344-c430e7468da3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:01.466951 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ad8a00d9-e769-43bf-9344-c430e7468da3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1249 microversion: 2.1 time: 0.080040 Jul 20 05:37:01.467528 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3776/7573] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:01 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:02.248266 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-d1bf69e1-d64d-4ac5-b5f9-9a204afef3e5 req-204a4f4f-34eb-4683-bdf6-e3253e8a3fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a070c767-6239-46bf-ac01-de90e20d7578", "name": "network-vif-unplugged", "status": "completed", "tag": "89014d89-9e40-4912-a007-ed9068148cb4"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:02.257872 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d1bf69e1-d64d-4ac5-b5f9-9a204afef3e5 req-204a4f4f-34eb-4683-bdf6-e3253e8a3fff service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:02.258666 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d1bf69e1-d64d-4ac5-b5f9-9a204afef3e5 req-204a4f4f-34eb-4683-bdf6-e3253e8a3fff service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:02.270659 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-d1bf69e1-d64d-4ac5-b5f9-9a204afef3e5 req-204a4f4f-34eb-4683-bdf6-e3253e8a3fff service nova] Creating event network-vif-unplugged:89014d89-9e40-4912-a007-ed9068148cb4 for instance a070c767-6239-46bf-ac01-de90e20d7578 on n-h1-760456-11 Jul 20 05:37:02.275696 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-d1bf69e1-d64d-4ac5-b5f9-9a204afef3e5 req-204a4f4f-34eb-4683-bdf6-e3253e8a3fff service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032123 Jul 20 05:37:02.276534 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3798/7574] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:37:02.485178 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-ea066873-d1e0-4bb6-b82f-a17509cd6dc7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:02.485731 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-ea066873-d1e0-4bb6-b82f-a17509cd6dc7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:02.487627 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:02.495226 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea066873-d1e0-4bb6-b82f-a17509cd6dc7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:02.495693 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea066873-d1e0-4bb6-b82f-a17509cd6dc7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:02.496504 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea066873-d1e0-4bb6-b82f-a17509cd6dc7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:02.496957 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-ea066873-d1e0-4bb6-b82f-a17509cd6dc7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:02.579682 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-ea066873-d1e0-4bb6-b82f-a17509cd6dc7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:02.590936 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-ea066873-d1e0-4bb6-b82f-a17509cd6dc7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1307 microversion: 2.1 time: 0.109727 Jul 20 05:37:02.591655 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3777/7575] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:02 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:03.610500 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a65bfb38-fc5e-4ee5-9493-58d15c212207 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:03.611207 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a65bfb38-fc5e-4ee5-9493-58d15c212207 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:03.618602 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a65bfb38-fc5e-4ee5-9493-58d15c212207 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:03.619064 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a65bfb38-fc5e-4ee5-9493-58d15c212207 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:03.619835 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a65bfb38-fc5e-4ee5-9493-58d15c212207 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:03.620279 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a65bfb38-fc5e-4ee5-9493-58d15c212207 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:03.774241 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a65bfb38-fc5e-4ee5-9493-58d15c212207 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:03.783281 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a65bfb38-fc5e-4ee5-9493-58d15c212207 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.177912 Jul 20 05:37:03.783865 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3799/7576] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:03 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:04.802427 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-94c1202e-67aa-4c90-b0b7-c8306b73d167 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:04.804193 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-94c1202e-67aa-4c90-b0b7-c8306b73d167 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:04.812150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94c1202e-67aa-4c90-b0b7-c8306b73d167 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:04.812705 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94c1202e-67aa-4c90-b0b7-c8306b73d167 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:04.813507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94c1202e-67aa-4c90-b0b7-c8306b73d167 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:04.813965 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-94c1202e-67aa-4c90-b0b7-c8306b73d167 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:04.963922 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-94c1202e-67aa-4c90-b0b7-c8306b73d167 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:04.971552 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-94c1202e-67aa-4c90-b0b7-c8306b73d167 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.174995 Jul 20 05:37:04.972130 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3778/7577] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:04 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:05.995926 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-bee8e737-3406-4462-93b5-fec09c2100e9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:05.998728 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-bee8e737-3406-4462-93b5-fec09c2100e9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:06.009692 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bee8e737-3406-4462-93b5-fec09c2100e9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:06.010546 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bee8e737-3406-4462-93b5-fec09c2100e9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:06.011599 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bee8e737-3406-4462-93b5-fec09c2100e9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:06.012263 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-bee8e737-3406-4462-93b5-fec09c2100e9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:06.169098 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-bee8e737-3406-4462-93b5-fec09c2100e9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:06.178142 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-bee8e737-3406-4462-93b5-fec09c2100e9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.192019 Jul 20 05:37:06.178795 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3800/7578] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:05 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:07.195674 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-6d7ffe32-42fe-4198-aac7-9053ddf50256 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:07.196316 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-6d7ffe32-42fe-4198-aac7-9053ddf50256 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:07.203601 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d7ffe32-42fe-4198-aac7-9053ddf50256 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:07.204177 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d7ffe32-42fe-4198-aac7-9053ddf50256 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:07.205039 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d7ffe32-42fe-4198-aac7-9053ddf50256 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:07.205570 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-6d7ffe32-42fe-4198-aac7-9053ddf50256 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:07.352197 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-6d7ffe32-42fe-4198-aac7-9053ddf50256 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:07.362140 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-6d7ffe32-42fe-4198-aac7-9053ddf50256 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.169682 Jul 20 05:37:07.363393 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3779/7579] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:07 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:08.381451 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-4b285e20-71db-4c27-a98d-b13ae569bcc3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:08.382024 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-4b285e20-71db-4c27-a98d-b13ae569bcc3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:08.388928 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b285e20-71db-4c27-a98d-b13ae569bcc3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:08.389381 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b285e20-71db-4c27-a98d-b13ae569bcc3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:08.390145 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b285e20-71db-4c27-a98d-b13ae569bcc3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:08.390631 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-4b285e20-71db-4c27-a98d-b13ae569bcc3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:08.550483 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-4b285e20-71db-4c27-a98d-b13ae569bcc3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:08.562823 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-4b285e20-71db-4c27-a98d-b13ae569bcc3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.185658 Jul 20 05:37:08.564260 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3801/7580] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:08 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:09.585858 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-23020479-dd73-4934-b3f3-251faeda150e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:09.588215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-23020479-dd73-4934-b3f3-251faeda150e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:09.602986 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23020479-dd73-4934-b3f3-251faeda150e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:09.604238 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23020479-dd73-4934-b3f3-251faeda150e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:09.605918 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23020479-dd73-4934-b3f3-251faeda150e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:09.607035 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-23020479-dd73-4934-b3f3-251faeda150e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:09.763194 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-23020479-dd73-4934-b3f3-251faeda150e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:09.773437 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-23020479-dd73-4934-b3f3-251faeda150e tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.194931 Jul 20 05:37:09.783374 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3780/7581] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:09 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:10.790491 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-7a317139-73cb-4487-b399-68217049f793 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:10.791113 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-7a317139-73cb-4487-b399-68217049f793 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:10.795061 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=2 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:10.795708 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell0:SELECT=6 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:10.800223 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a317139-73cb-4487-b399-68217049f793 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:10.800677 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a317139-73cb-4487-b399-68217049f793 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:10.801460 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a317139-73cb-4487-b399-68217049f793 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:10.801900 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-7a317139-73cb-4487-b399-68217049f793 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:10.944981 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-7a317139-73cb-4487-b399-68217049f793 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:10.952488 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-7a317139-73cb-4487-b399-68217049f793 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.166462 Jul 20 05:37:10.953067 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3802/7582] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:10 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:11.969990 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-cd42f175-9a82-46f4-a123-8ba81c9a98d3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:11.970543 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-cd42f175-9a82-46f4-a123-8ba81c9a98d3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:11.974502 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell0:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:11.979121 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd42f175-9a82-46f4-a123-8ba81c9a98d3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:11.979599 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd42f175-9a82-46f4-a123-8ba81c9a98d3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:11.980412 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd42f175-9a82-46f4-a123-8ba81c9a98d3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:11.980871 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-cd42f175-9a82-46f4-a123-8ba81c9a98d3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:12.188455 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-cd42f175-9a82-46f4-a123-8ba81c9a98d3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:12.196048 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-cd42f175-9a82-46f4-a123-8ba81c9a98d3 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.230621 Jul 20 05:37:12.196835 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3781/7583] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:11 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:12.794944 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-5096cea5-8387-4035-88ce-ef416d4bd4e4 req-50513de9-dd39-45a2-b733-67b26814f120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3", "tag": "7a862150-7ace-483e-bce4-c1536128754a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:12.803588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5096cea5-8387-4035-88ce-ef416d4bd4e4 req-50513de9-dd39-45a2-b733-67b26814f120 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:12.804038 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-5096cea5-8387-4035-88ce-ef416d4bd4e4 req-50513de9-dd39-45a2-b733-67b26814f120 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:12.816886 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-5096cea5-8387-4035-88ce-ef416d4bd4e4 req-50513de9-dd39-45a2-b733-67b26814f120 service nova] Creating event network-changed:7a862150-7ace-483e-bce4-c1536128754a for instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 on n-h2-760456-11 Jul 20 05:37:12.822313 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-5096cea5-8387-4035-88ce-ef416d4bd4e4 req-50513de9-dd39-45a2-b733-67b26814f120 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114070 Jul 20 05:37:12.822937 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3803/7584] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:37:13.213769 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7251f595-08fb-4e73-a0ea-1822a3c39732 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:13.214434 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7251f595-08fb-4e73-a0ea-1822a3c39732 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:13.221441 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7251f595-08fb-4e73-a0ea-1822a3c39732 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:13.221913 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7251f595-08fb-4e73-a0ea-1822a3c39732 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:13.222723 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7251f595-08fb-4e73-a0ea-1822a3c39732 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:13.223180 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7251f595-08fb-4e73-a0ea-1822a3c39732 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:13.360104 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7251f595-08fb-4e73-a0ea-1822a3c39732 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:13.368342 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7251f595-08fb-4e73-a0ea-1822a3c39732 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.158537 Jul 20 05:37:13.368925 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3782/7585] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:13 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:14.386853 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a6679632-6db5-4e52-b120-39be44ded662 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:14.387566 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a6679632-6db5-4e52-b120-39be44ded662 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:14.394172 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6679632-6db5-4e52-b120-39be44ded662 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:14.394680 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6679632-6db5-4e52-b120-39be44ded662 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:14.395464 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6679632-6db5-4e52-b120-39be44ded662 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:14.395913 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a6679632-6db5-4e52-b120-39be44ded662 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:14.533514 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a6679632-6db5-4e52-b120-39be44ded662 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:14.541895 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a6679632-6db5-4e52-b120-39be44ded662 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.161139 Jul 20 05:37:14.542508 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3804/7586] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:14 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:15.561370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-bb845ddf-0c1b-4086-8fd2-ed79023cf295 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:15.562008 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-bb845ddf-0c1b-4086-8fd2-ed79023cf295 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:15.569919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb845ddf-0c1b-4086-8fd2-ed79023cf295 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:15.570422 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb845ddf-0c1b-4086-8fd2-ed79023cf295 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:15.571223 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb845ddf-0c1b-4086-8fd2-ed79023cf295 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:15.571687 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-bb845ddf-0c1b-4086-8fd2-ed79023cf295 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:15.707150 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-bb845ddf-0c1b-4086-8fd2-ed79023cf295 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:15.714585 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-bb845ddf-0c1b-4086-8fd2-ed79023cf295 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.157334 Jul 20 05:37:15.715162 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3783/7587] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:15 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:16.731847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-8d48b690-2046-4767-87f5-b6eb34617bd7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:16.732516 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-8d48b690-2046-4767-87f5-b6eb34617bd7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:16.739463 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d48b690-2046-4767-87f5-b6eb34617bd7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:16.739986 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d48b690-2046-4767-87f5-b6eb34617bd7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:16.741190 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d48b690-2046-4767-87f5-b6eb34617bd7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:16.741653 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-8d48b690-2046-4767-87f5-b6eb34617bd7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:16.875585 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-8d48b690-2046-4767-87f5-b6eb34617bd7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:16.884062 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-8d48b690-2046-4767-87f5-b6eb34617bd7 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.156268 Jul 20 05:37:16.884632 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3805/7588] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:16 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:17.901799 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-3bfae2a0-265c-4296-8928-905af3ce0d5c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:17.902431 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-3bfae2a0-265c-4296-8928-905af3ce0d5c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:17.909475 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bfae2a0-265c-4296-8928-905af3ce0d5c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:17.909952 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bfae2a0-265c-4296-8928-905af3ce0d5c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:17.910786 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bfae2a0-265c-4296-8928-905af3ce0d5c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:17.911244 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-3bfae2a0-265c-4296-8928-905af3ce0d5c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:18.056428 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-3bfae2a0-265c-4296-8928-905af3ce0d5c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:18.068548 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-3bfae2a0-265c-4296-8928-905af3ce0d5c tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.170625 Jul 20 05:37:18.069188 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3784/7589] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:17 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:18.535182 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-d798bb49-9fd6-4462-81a4-1b1eeca9e98d req-9e474a83-e99b-41f3-b4d4-c99970471bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3", "name": "network-vif-plugged", "status": "completed", "tag": "7a862150-7ace-483e-bce4-c1536128754a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:18.544449 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d798bb49-9fd6-4462-81a4-1b1eeca9e98d req-9e474a83-e99b-41f3-b4d4-c99970471bae service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:18.544899 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-d798bb49-9fd6-4462-81a4-1b1eeca9e98d req-9e474a83-e99b-41f3-b4d4-c99970471bae service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:18.556858 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-d798bb49-9fd6-4462-81a4-1b1eeca9e98d req-9e474a83-e99b-41f3-b4d4-c99970471bae service nova] Creating event network-vif-plugged:7a862150-7ace-483e-bce4-c1536128754a for instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 on n-h2-760456-11 Jul 20 05:37:18.561979 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-d798bb49-9fd6-4462-81a4-1b1eeca9e98d req-9e474a83-e99b-41f3-b4d4-c99970471bae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030561 Jul 20 05:37:18.562607 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3806/7590] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:37:19.086486 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-14a48c37-6013-4c35-854f-e4e76ec5c764 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:19.087048 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-14a48c37-6013-4c35-854f-e4e76ec5c764 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:19.094013 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14a48c37-6013-4c35-854f-e4e76ec5c764 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:19.094523 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14a48c37-6013-4c35-854f-e4e76ec5c764 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:19.095312 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14a48c37-6013-4c35-854f-e4e76ec5c764 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:19.095765 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-14a48c37-6013-4c35-854f-e4e76ec5c764 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:19.234438 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-14a48c37-6013-4c35-854f-e4e76ec5c764 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:19.242952 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-14a48c37-6013-4c35-854f-e4e76ec5c764 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1374 microversion: 2.1 time: 0.161112 Jul 20 05:37:19.243525 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3785/7591] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:19 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:20.261721 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a0fc3be6-960f-487c-8882-5d6d2ca5b143 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:20.262366 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a0fc3be6-960f-487c-8882-5d6d2ca5b143 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:20.269006 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0fc3be6-960f-487c-8882-5d6d2ca5b143 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:20.269455 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0fc3be6-960f-487c-8882-5d6d2ca5b143 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:20.270217 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0fc3be6-960f-487c-8882-5d6d2ca5b143 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:20.270682 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a0fc3be6-960f-487c-8882-5d6d2ca5b143 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:20.406593 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a0fc3be6-960f-487c-8882-5d6d2ca5b143 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:20.414766 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a0fc3be6-960f-487c-8882-5d6d2ca5b143 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1558 microversion: 2.1 time: 0.159129 Jul 20 05:37:20.415352 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3807/7592] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:20 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:20.431603 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-7a599153-fe84-40ea-b89a-77337152cb68 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:20.432236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-7a599153-fe84-40ea-b89a-77337152cb68 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:20.439207 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a599153-fe84-40ea-b89a-77337152cb68 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:20.439679 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a599153-fe84-40ea-b89a-77337152cb68 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:20.440461 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a599153-fe84-40ea-b89a-77337152cb68 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:20.440919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-7a599153-fe84-40ea-b89a-77337152cb68 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:20.588345 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-7a599153-fe84-40ea-b89a-77337152cb68 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:20.598383 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-7a599153-fe84-40ea-b89a-77337152cb68 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1558 microversion: 2.1 time: 0.171199 Jul 20 05:37:20.598986 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3786/7593] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:20 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:22.211785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-9737ed18-73d1-42fa-a147-e1ec4c84c171 req-bc17665f-4a2d-4f2e-b8cd-ab2908de0894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3", "tag": "7a862150-7ace-483e-bce4-c1536128754a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:22.220909 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9737ed18-73d1-42fa-a147-e1ec4c84c171 req-bc17665f-4a2d-4f2e-b8cd-ab2908de0894 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:22.221434 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-9737ed18-73d1-42fa-a147-e1ec4c84c171 req-bc17665f-4a2d-4f2e-b8cd-ab2908de0894 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:22.232748 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-9737ed18-73d1-42fa-a147-e1ec4c84c171 req-bc17665f-4a2d-4f2e-b8cd-ab2908de0894 service nova] Creating event network-changed:7a862150-7ace-483e-bce4-c1536128754a for instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 on n-h2-760456-11 Jul 20 05:37:22.237928 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-9737ed18-73d1-42fa-a147-e1ec4c84c171 req-bc17665f-4a2d-4f2e-b8cd-ab2908de0894 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030004 Jul 20 05:37:22.238804 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3808/7594] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:37:25.893695 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:37:25.894543 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:37:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:38:40.686500 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:38:40.687129 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:38:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:38:49.266215 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=26 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:49.267025 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=60 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:49.271268 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-d642c477-c24f-42ab-843b-77bc8cf9ca21 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2084718209"}} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:49.272369 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-d642c477-c24f-42ab-843b-77bc8cf9ca21 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:38:49.279335 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d642c477-c24f-42ab-843b-77bc8cf9ca21 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:49.279811 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d642c477-c24f-42ab-843b-77bc8cf9ca21 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:49.280598 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d642c477-c24f-42ab-843b-77bc8cf9ca21 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:49.281062 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-d642c477-c24f-42ab-843b-77bc8cf9ca21 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:49.753075 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-d642c477-c24f-42ab-843b-77bc8cf9ca21 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "POST /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3/action" status: 202 len: 0 microversion: 2.1 time: 0.488580 Jul 20 05:38:49.753722 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3787/7595] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Jul 20 05:38:49 2022] POST /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 05:38:54.829651 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-16503dfe-e389-4a8f-a803-2c56120923f3 req-6ce3bdda-e6d9-4534-af0c-22b7277961dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3", "name": "network-vif-plugged", "status": "completed", "tag": "7a862150-7ace-483e-bce4-c1536128754a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:38:54.835648 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:54.836470 n-d-760456-11 devstack@n-api.service[119606]: DEBUG dbcounter [-] [119606] Writing DB stats nova_cell1:SELECT=52 {{(pid=119606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:38:54.846171 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-16503dfe-e389-4a8f-a803-2c56120923f3 req-6ce3bdda-e6d9-4534-af0c-22b7277961dd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:38:54.847125 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-16503dfe-e389-4a8f-a803-2c56120923f3 req-6ce3bdda-e6d9-4534-af0c-22b7277961dd service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:38:54.863296 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-16503dfe-e389-4a8f-a803-2c56120923f3 req-6ce3bdda-e6d9-4534-af0c-22b7277961dd service nova] Creating event network-vif-plugged:7a862150-7ace-483e-bce4-c1536128754a for instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 on n-h2-760456-11 Jul 20 05:38:54.869708 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-16503dfe-e389-4a8f-a803-2c56120923f3 req-6ce3bdda-e6d9-4534-af0c-22b7277961dd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047092 Jul 20 05:38:54.870833 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3809/7596] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:39:03.424246 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_api:SELECT=2 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:03.425232 n-d-760456-11 devstack@n-api.service[119605]: DEBUG dbcounter [-] [119605] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:03.429492 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-c5e2ef36-de8f-4363-8978-635ec4d7dba9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:03.429976 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [req-8e5c1f00-500c-45fb-a9f8-308ec9779ab4 req-7ed11de7-96ec-498e-8d28-6b5f9fe3e477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3", "tag": "7a862150-7ace-483e-bce4-c1536128754a"}]} {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:03.430468 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c5e2ef36-de8f-4363-8978-635ec4d7dba9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:03.438621 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5e2ef36-de8f-4363-8978-635ec4d7dba9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:03.439452 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5e2ef36-de8f-4363-8978-635ec4d7dba9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:03.440131 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8e5c1f00-500c-45fb-a9f8-308ec9779ab4 req-7ed11de7-96ec-498e-8d28-6b5f9fe3e477 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:03.440472 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5e2ef36-de8f-4363-8978-635ec4d7dba9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:03.440588 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [req-8e5c1f00-500c-45fb-a9f8-308ec9779ab4 req-7ed11de7-96ec-498e-8d28-6b5f9fe3e477 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:03.441136 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-c5e2ef36-de8f-4363-8978-635ec4d7dba9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:03.456002 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.compute.server_external_events [req-8e5c1f00-500c-45fb-a9f8-308ec9779ab4 req-7ed11de7-96ec-498e-8d28-6b5f9fe3e477 service nova] Creating event network-changed:7a862150-7ace-483e-bce4-c1536128754a for instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 on n-h2-760456-11 Jul 20 05:39:03.461458 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [req-8e5c1f00-500c-45fb-a9f8-308ec9779ab4 req-7ed11de7-96ec-498e-8d28-6b5f9fe3e477 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036266 Jul 20 05:39:03.462653 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3810/7597] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:39:03.470883 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-c5e2ef36-de8f-4363-8978-635ec4d7dba9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Going to try to terminate instance {{(pid=119605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:39:03.561053 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-c5e2ef36-de8f-4363-8978-635ec4d7dba9 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "DELETE /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 204 len: 0 microversion: 2.1 time: 0.136952 Jul 20 05:39:03.565425 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3788/7598] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:39:03 2022] DELETE /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:39:03.571361 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-0cd32900-be3a-4556-8768-c907e52295c2 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:03.572096 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-0cd32900-be3a-4556-8768-c907e52295c2 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:03.579739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0cd32900-be3a-4556-8768-c907e52295c2 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:03.580348 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0cd32900-be3a-4556-8768-c907e52295c2 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:03.581258 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0cd32900-be3a-4556-8768-c907e52295c2 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:03.581813 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-0cd32900-be3a-4556-8768-c907e52295c2 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:03.789609 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-0cd32900-be3a-4556-8768-c907e52295c2 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:03.798921 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-0cd32900-be3a-4556-8768-c907e52295c2 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1683 microversion: 2.1 time: 0.231835 Jul 20 05:39:03.799560 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3811/7599] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:03 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1683 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:04.795740 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-fec3200a-b886-490d-8641-e7ec70958d25 req-cd23d03a-61db-4aa4-9c70-f931b276eb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3", "name": "network-vif-unplugged", "status": "completed", "tag": "7a862150-7ace-483e-bce4-c1536128754a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:04.805919 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fec3200a-b886-490d-8641-e7ec70958d25 req-cd23d03a-61db-4aa4-9c70-f931b276eb49 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:04.806410 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-fec3200a-b886-490d-8641-e7ec70958d25 req-cd23d03a-61db-4aa4-9c70-f931b276eb49 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:04.819012 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-08011b02-28b2-4c94-8da1-46a5072d9396 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:04.819627 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-fec3200a-b886-490d-8641-e7ec70958d25 req-cd23d03a-61db-4aa4-9c70-f931b276eb49 service nova] Creating event network-vif-unplugged:7a862150-7ace-483e-bce4-c1536128754a for instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 on n-h2-760456-11 Jul 20 05:39:04.820712 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-08011b02-28b2-4c94-8da1-46a5072d9396 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:04.825106 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-fec3200a-b886-490d-8641-e7ec70958d25 req-cd23d03a-61db-4aa4-9c70-f931b276eb49 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034798 Jul 20 05:39:04.825727 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3789/7600] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:39:04.830382 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08011b02-28b2-4c94-8da1-46a5072d9396 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:04.830847 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08011b02-28b2-4c94-8da1-46a5072d9396 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:04.831674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08011b02-28b2-4c94-8da1-46a5072d9396 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:04.832126 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-08011b02-28b2-4c94-8da1-46a5072d9396 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:04.973747 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-08011b02-28b2-4c94-8da1-46a5072d9396 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:04.981848 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-08011b02-28b2-4c94-8da1-46a5072d9396 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1683 microversion: 2.1 time: 0.168063 Jul 20 05:39:04.982455 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3812/7601] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:04 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:05.583106 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-94c1fe6a-7589-4547-a503-8de2ad1bfe4e req-8ffae301-2bee-4f7d-9b28-e60c891a200f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3", "name": "network-vif-deleted", "tag": "7a862150-7ace-483e-bce4-c1536128754a"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:05.592573 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-94c1fe6a-7589-4547-a503-8de2ad1bfe4e req-8ffae301-2bee-4f7d-9b28-e60c891a200f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:05.593056 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-94c1fe6a-7589-4547-a503-8de2ad1bfe4e req-8ffae301-2bee-4f7d-9b28-e60c891a200f service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:05.606779 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-94c1fe6a-7589-4547-a503-8de2ad1bfe4e req-8ffae301-2bee-4f7d-9b28-e60c891a200f service nova] Creating event network-vif-deleted:7a862150-7ace-483e-bce4-c1536128754a for instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 on n-h2-760456-11 Jul 20 05:39:05.612177 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-94c1fe6a-7589-4547-a503-8de2ad1bfe4e req-8ffae301-2bee-4f7d-9b28-e60c891a200f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033121 Jul 20 05:39:05.613038 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3790/7602] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:39:06.000459 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:06.001738 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:06.009219 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:06.009667 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:06.010502 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:06.011253 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:06.045785 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:06.046376 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:06.046912 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.objects.instance [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lazy-loading 'fault' on Instance uuid 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 {{(pid=119606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:39:06.088818 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:06.095790 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-a05ea9ad-b46a-400d-ae5d-663d2871d6e0 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 200 len: 1339 microversion: 2.1 time: 0.099998 Jul 20 05:39:06.096361 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3813/7603] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:05 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:07.115210 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4fae615d-e91b-40aa-8673-4c35e4c91c64 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:07.116107 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-4fae615d-e91b-40aa-8673-4c35e4c91c64 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:07.122507 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fae615d-e91b-40aa-8673-4c35e4c91c64 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:07.122982 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fae615d-e91b-40aa-8673-4c35e4c91c64 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:07.123778 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fae615d-e91b-40aa-8673-4c35e4c91c64 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:07.124236 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-4fae615d-e91b-40aa-8673-4c35e4c91c64 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:07.138031 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.wsgi [None req-4fae615d-e91b-40aa-8673-4c35e4c91c64 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] HTTP exception thrown: Instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 could not be found. Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4fae615d-e91b-40aa-8673-4c35e4c91c64 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Request method failure captured: Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: request: GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 HTTP/1.1 Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: Accept: application/json Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: Accept-Encoding: identity Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: Connection: close Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: Content-Length: 0 Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: Content-Type: application/json Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: Host: 10.222.0.59 Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: Openstack-System-Scope: None Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: User-Agent: python-urllib3/1.26.9 Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Auth-Token: gAAAAABi15Po_FFw3f6IojH_en8raapa1dO2p2PsnkXtCa9XOKCZnpfnneRlWVs3BeMrEiSI-GdfkeylfExcMJG5AdJgfj4Re_hEjSfLWDDXvaxqWJM36eNhB-O0KQ6c1ItfS0M5Biy7DMO3XVMrjqEaqts17AZNgxdPxcsVcKsbcoUxBJEDxhY Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Id: None Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Domain-Name: None Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Identity-Status: Confirmed Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Is-Admin-Project: True Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Id: default Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Domain-Name: Default Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Id: 515ab2acb4d84b89b0cdc1efe80300b9 Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Project-Name: tempest-TestSnapshotPattern-1440430981 Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Role: member,reader Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Roles: member,reader Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/515ab2acb4d84b89b0cdc1efe80300b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/515ab2acb4d84b89b0cdc1efe80300b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/515ab2acb4d84b89b0cdc1efe80300b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_515ab2acb4d84b89b0cdc1efe80300b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant: tempest-TestSnapshotPattern-1440430981 Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Id: 515ab2acb4d84b89b0cdc1efe80300b9 Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-Tenant-Name: tempest-TestSnapshotPattern-1440430981 Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-User: tempest-TestSnapshotPattern-1440430981-project Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Id: default Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-User-Domain-Name: Default Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-User-Id: 67ce3f6110804050b87c49cb26faf925 Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: X-User-Name: tempest-TestSnapshotPattern-1440430981-project Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: method: > Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: exception: Instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 could not be found. Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: action_args: {'id': '71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3'} Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 could not be found. Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 could not be found. Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:39:07.139733 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:39:07.144399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:39:07.144399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:39:07.144399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:39:07.144399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:39:07.144399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:39:07.144399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 could not be found. Jul 20 05:39:07.144399 n-d-760456-11 devstack@n-api.service[119605]: ERROR nova.api.openstack.wsgi Jul 20 05:39:07.144399 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-4fae615d-e91b-40aa-8673-4c35e4c91c64 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Returning 404 to user: Instance 71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 could not be found. {{(pid=119605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:39:07.144399 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-4fae615d-e91b-40aa-8673-4c35e4c91c64 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3" status: 404 len: 111 microversion: 2.1 time: 0.031137 Jul 20 05:39:07.144399 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3791/7604] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:07 2022] GET /compute/v2.1/servers/71b92dd6-a7d1-4f2e-9cf2-e7b624c73cc3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:39:08.513972 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-28a8bc9e-fb90-40b2-980b-f572dc22c4c6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:08.514806 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-28a8bc9e-fb90-40b2-980b-f572dc22c4c6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:08.515253 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-9a57a726-b493-4441-916c-7eee02b87ccf req-a086c0a7-20c4-48b0-80b3-e4bdc2becb6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a070c767-6239-46bf-ac01-de90e20d7578", "tag": "89014d89-9e40-4912-a007-ed9068148cb4"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:08.523004 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28a8bc9e-fb90-40b2-980b-f572dc22c4c6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:08.523589 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28a8bc9e-fb90-40b2-980b-f572dc22c4c6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:08.524494 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28a8bc9e-fb90-40b2-980b-f572dc22c4c6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:08.524641 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9a57a726-b493-4441-916c-7eee02b87ccf req-a086c0a7-20c4-48b0-80b3-e4bdc2becb6a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:08.524961 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-9a57a726-b493-4441-916c-7eee02b87ccf req-a086c0a7-20c4-48b0-80b3-e4bdc2becb6a service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:08.525390 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-28a8bc9e-fb90-40b2-980b-f572dc22c4c6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:08.540806 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-9a57a726-b493-4441-916c-7eee02b87ccf req-a086c0a7-20c4-48b0-80b3-e4bdc2becb6a service nova] Creating event network-changed:89014d89-9e40-4912-a007-ed9068148cb4 for instance a070c767-6239-46bf-ac01-de90e20d7578 on n-h1-760456-11 Jul 20 05:39:08.546881 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-9a57a726-b493-4441-916c-7eee02b87ccf req-a086c0a7-20c4-48b0-80b3-e4bdc2becb6a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035391 Jul 20 05:39:08.547865 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3792/7605] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:39:08.556181 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-28a8bc9e-fb90-40b2-980b-f572dc22c4c6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Going to try to terminate instance {{(pid=119606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:39:08.647474 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-28a8bc9e-fb90-40b2-980b-f572dc22c4c6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 204 len: 0 microversion: 2.1 time: 0.137694 Jul 20 05:39:08.648413 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3814/7606] 10.222.0.59 () {58 vars in 1238 bytes} [Wed Jul 20 05:39:08 2022] DELETE /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:39:08.658282 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-90a0494d-17d2-412d-855a-6b09933847e8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:08.659010 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.compute.api [None req-90a0494d-17d2-412d-855a-6b09933847e8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119605) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:08.665370 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90a0494d-17d2-412d-855a-6b09933847e8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:08.665906 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90a0494d-17d2-412d-855a-6b09933847e8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:08.666727 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90a0494d-17d2-412d-855a-6b09933847e8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:08.667745 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [None req-90a0494d-17d2-412d-855a-6b09933847e8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:08.811791 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.policy [None req-90a0494d-17d2-412d-855a-6b09933847e8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119605) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:08.819484 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-90a0494d-17d2-412d-855a-6b09933847e8 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1682 microversion: 2.1 time: 0.165529 Jul 20 05:39:08.820249 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3793/7607] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:08 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:09.838086 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-b94acf77-b93a-4dda-ae8f-e0282ec9bef6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:09.838739 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-b94acf77-b93a-4dda-ae8f-e0282ec9bef6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:09.845674 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b94acf77-b93a-4dda-ae8f-e0282ec9bef6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:09.846142 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b94acf77-b93a-4dda-ae8f-e0282ec9bef6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:09.846962 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b94acf77-b93a-4dda-ae8f-e0282ec9bef6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:09.847412 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-b94acf77-b93a-4dda-ae8f-e0282ec9bef6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:10.017104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.policy [None req-b94acf77-b93a-4dda-ae8f-e0282ec9bef6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce3f6110804050b87c49cb26faf925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ab2acb4d84b89b0cdc1efe80300b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119606) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:10.025880 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-b94acf77-b93a-4dda-ae8f-e0282ec9bef6 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 200 len: 1682 microversion: 2.1 time: 0.192116 Jul 20 05:39:10.026976 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3815/7608] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:09 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:39:10.610518 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [req-e3048501-27de-4e70-b8ab-231f0bbe748a req-e03480ec-3c03-44cc-98d2-e174823088c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a070c767-6239-46bf-ac01-de90e20d7578", "name": "network-vif-deleted", "tag": "89014d89-9e40-4912-a007-ed9068148cb4"}]} {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:10.619870 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e3048501-27de-4e70-b8ab-231f0bbe748a req-e03480ec-3c03-44cc-98d2-e174823088c3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:10.620500 n-d-760456-11 devstack@n-api.service[119605]: DEBUG oslo_concurrency.lockutils [req-e3048501-27de-4e70-b8ab-231f0bbe748a req-e03480ec-3c03-44cc-98d2-e174823088c3 service nova] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:10.632617 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.compute.server_external_events [req-e3048501-27de-4e70-b8ab-231f0bbe748a req-e03480ec-3c03-44cc-98d2-e174823088c3 service nova] Creating event network-vif-deleted:89014d89-9e40-4912-a007-ed9068148cb4 for instance a070c767-6239-46bf-ac01-de90e20d7578 on n-h1-760456-11 Jul 20 05:39:10.640116 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [req-e3048501-27de-4e70-b8ab-231f0bbe748a req-e03480ec-3c03-44cc-98d2-e174823088c3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Jul 20 05:39:10.641054 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3794/7609] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Jul 20 05:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:39:11.044475 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9a6dc66c-3b3d-467a-a7c4-b418400be233 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '>' {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:11.045104 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.compute.api [None req-9a6dc66c-3b3d-467a-a7c4-b418400be233 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] [instance: a070c767-6239-46bf-ac01-de90e20d7578] Fetching instance by UUID {{(pid=119606) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:11.053047 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a6dc66c-3b3d-467a-a7c4-b418400be233 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:11.053544 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a6dc66c-3b3d-467a-a7c4-b418400be233 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:11.054364 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a6dc66c-3b3d-467a-a7c4-b418400be233 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:11.054815 n-d-760456-11 devstack@n-api.service[119606]: DEBUG oslo_concurrency.lockutils [None req-9a6dc66c-3b3d-467a-a7c4-b418400be233 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Lock "0ab3dd1d-caba-46da-92a7-0cc28af64ce3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:11.072557 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.wsgi [None req-9a6dc66c-3b3d-467a-a7c4-b418400be233 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] HTTP exception thrown: Instance a070c767-6239-46bf-ac01-de90e20d7578 could not be found. Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9a6dc66c-3b3d-467a-a7c4-b418400be233 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Request method failure captured: Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: request: GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 HTTP/1.1 Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: Accept: application/json Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: Accept-Encoding: identity Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: Connection: close Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: Content-Length: 0 Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: Content-Type: application/json Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: Host: 10.222.0.59 Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: Openstack-System-Scope: None Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: User-Agent: python-urllib3/1.26.9 Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Auth-Token: gAAAAABi15Po_FFw3f6IojH_en8raapa1dO2p2PsnkXtCa9XOKCZnpfnneRlWVs3BeMrEiSI-GdfkeylfExcMJG5AdJgfj4Re_hEjSfLWDDXvaxqWJM36eNhB-O0KQ6c1ItfS0M5Biy7DMO3XVMrjqEaqts17AZNgxdPxcsVcKsbcoUxBJEDxhY Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Id: None Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Domain-Name: None Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Identity-Status: Confirmed Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Is-Admin-Project: True Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Id: default Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Domain-Name: Default Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Id: 515ab2acb4d84b89b0cdc1efe80300b9 Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Project-Name: tempest-TestSnapshotPattern-1440430981 Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Role: member,reader Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Roles: member,reader Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/515ab2acb4d84b89b0cdc1efe80300b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/515ab2acb4d84b89b0cdc1efe80300b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/515ab2acb4d84b89b0cdc1efe80300b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_515ab2acb4d84b89b0cdc1efe80300b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant: tempest-TestSnapshotPattern-1440430981 Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Id: 515ab2acb4d84b89b0cdc1efe80300b9 Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-Tenant-Name: tempest-TestSnapshotPattern-1440430981 Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-User: tempest-TestSnapshotPattern-1440430981-project Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Id: default Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-User-Domain-Name: Default Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-User-Id: 67ce3f6110804050b87c49cb26faf925 Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: X-User-Name: tempest-TestSnapshotPattern-1440430981-project Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: method: > Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: exception: Instance a070c767-6239-46bf-ac01-de90e20d7578 could not be found. Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: action_args: {'id': 'a070c767-6239-46bf-ac01-de90e20d7578'} Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: {{(pid=119606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a070c767-6239-46bf-ac01-de90e20d7578 could not be found. Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a070c767-6239-46bf-ac01-de90e20d7578 could not be found. Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:39:11.074982 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:39:11.079399 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:39:11.079399 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:39:11.079399 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:39:11.079399 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:39:11.079399 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:39:11.079399 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a070c767-6239-46bf-ac01-de90e20d7578 could not be found. Jul 20 05:39:11.079399 n-d-760456-11 devstack@n-api.service[119606]: ERROR nova.api.openstack.wsgi Jul 20 05:39:11.079399 n-d-760456-11 devstack@n-api.service[119606]: DEBUG nova.api.openstack.wsgi [None req-9a6dc66c-3b3d-467a-a7c4-b418400be233 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Returning 404 to user: Instance a070c767-6239-46bf-ac01-de90e20d7578 could not be found. {{(pid=119606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:39:11.079399 n-d-760456-11 devstack@n-api.service[119606]: INFO nova.api.openstack.requestlog [None req-9a6dc66c-3b3d-467a-a7c4-b418400be233 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578" status: 404 len: 111 microversion: 2.1 time: 0.036459 Jul 20 05:39:11.079399 n-d-760456-11 devstack@n-api.service[119606]: [pid: 119606|app: 0|req: 3816/7610] 10.222.0.59 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:11 2022] GET /compute/v2.1/servers/a070c767-6239-46bf-ac01-de90e20d7578 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:39:11.262548 n-d-760456-11 devstack@n-api.service[119605]: DEBUG nova.api.openstack.wsgi [None req-a69f1f8c-4718-4814-8ce9-ed8e094a3414 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] Calling method '.version_select at 0x7fb841bebca0>' {{(pid=119605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:11.284887 n-d-760456-11 devstack@n-api.service[119605]: INFO nova.api.openstack.requestlog [None req-a69f1f8c-4718-4814-8ce9-ed8e094a3414 tempest-TestSnapshotPattern-1440430981 tempest-TestSnapshotPattern-1440430981-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1335118399" status: 202 len: 0 microversion: 2.1 time: 0.027496 Jul 20 05:39:11.285491 n-d-760456-11 devstack@n-api.service[119605]: [pid: 119605|app: 0|req: 3795/7611] 10.222.0.59 () {58 vars in 1256 bytes} [Wed Jul 20 05:39:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1335118399 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:40:45.901859 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:40:45.902521 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:40:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:42:00.640109 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:42:00.640748 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:42:00.694386 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:42:00.694548 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:42:16.460638 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:42:16.461849 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:42:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:42:43.891165 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:42:43.891906 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:42:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:44:05.911006 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:44:05.911990 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:44:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:44:10.831215 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:44:10.831809 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:44:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:45:20.648414 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:45:20.649127 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:45:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:45:20.703332 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:45:20.703489 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:45:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:45:36.469182 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:45:36.469770 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:45:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:46:03.899363 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:46:03.900094 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:46:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:47:25.919757 n-d-760456-11 devstack@n-api.service[119606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:47:25.920494 n-d-760456-11 devstack@n-api.service[119606]: Wed Jul 20 05:47:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:47:30.839135 n-d-760456-11 devstack@n-api.service[119605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:47:30.839730 n-d-760456-11 devstack@n-api.service[119605]: Wed Jul 20 05:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!